Note: This is test shard 2 of 3.
[==========] Running 1 test from 1 test suite.
[----------] Global test environment set-up.
[----------] 1 test from CatalogManagerConfigurations/MasterStressTest
[ RUN ] CatalogManagerConfigurations/MasterStressTest.Test/1
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20250830 07:54:27.442878 13124 test_util.cc:276] Using random seed: 1922593944
2025-08-30T07:54:27Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
2025-08-30T07:54:27Z Disabled control of system clock
I20250830 07:54:27.473446 13124 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskbivBUj/build/asan/bin/kudu
/tmp/dist-test-taskbivBUj/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.209.62:39725
--webserver_interface=127.12.209.62
--webserver_port=0
--builtin_ntp_servers=127.12.209.20:33943
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.209.62:39725,127.12.209.61:44241,127.12.209.60:43889
--hive_metastore_notification_log_poll_period_seconds=1
--enable_metadata_cleanup_for_deleted_tables_and_tablets=true
--catalog_manager_bg_task_wait_ms=10
--metadata_for_deleted_table_and_tablet_reserved_secs=0
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
W20250830 07:54:27.764377 13132 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20250830 07:54:27.764632 13132 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20250830 07:54:27.764705 13132 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20250830 07:54:27.772163 13132 flags.cc:425] Enabled experimental flag: --enable_metadata_cleanup_for_deleted_tables_and_tablets=true
W20250830 07:54:27.772233 13132 flags.cc:425] Enabled experimental flag: --metadata_for_deleted_table_and_tablet_reserved_secs=0
W20250830 07:54:27.772296 13132 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20250830 07:54:27.772341 13132 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20250830 07:54:27.772398 13132 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20250830 07:54:27.772441 13132 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20250830 07:54:27.781317 13132 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.209.20:33943
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/master-0/wal
--catalog_manager_bg_task_wait_ms=10
--enable_metadata_cleanup_for_deleted_tables_and_tablets=true
--metadata_for_deleted_table_and_tablet_reserved_secs=0
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.12.209.62:39725,127.12.209.61:44241,127.12.209.60:43889
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.209.62:39725
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.209.62
--webserver_port=0
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.19.0-SNAPSHOT
revision 06466b25e294b4d7d455e6c56263318dc34a80ef
build type FASTDEBUG
built by None at 30 Aug 2025 07:43:23 UTC on 24a791456cd2
build id 7812
ASAN enabled
I20250830 07:54:27.782729 13132 env_posix.cc:2264] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20250830 07:54:27.784463 13132 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20250830 07:54:27.791584 13137 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250830 07:54:27.792454 13138 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250830 07:54:27.792608 13140 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20250830 07:54:27.793316 13132 server_base.cc:1047] running on GCE node
I20250830 07:54:27.793972 13132 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20250830 07:54:27.795246 13132 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20250830 07:54:27.796432 13132 hybrid_clock.cc:648] HybridClock initialized: now 1756540467796352 us; error 71 us; skew 500 ppm
I20250830 07:54:27.796748 13132 server_base.cc:847] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20250830 07:54:27.798691 13132 webserver.cc:480] Webserver started at http://127.12.209.62:35923/ using document root <none> and password file <none>
I20250830 07:54:27.799369 13132 fs_manager.cc:362] Metadata directory not provided
I20250830 07:54:27.799461 13132 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20250830 07:54:27.799769 13132 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20250830 07:54:27.802026 13132 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/master-0/data/instance:
uuid: "fea6152429cc4e79a25b18e02aafae57"
format_stamp: "Formatted at 2025-08-30 07:54:27 on dist-test-slave-g8n5"
I20250830 07:54:27.804111 13132 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/master-0/wal/instance:
uuid: "fea6152429cc4e79a25b18e02aafae57"
format_stamp: "Formatted at 2025-08-30 07:54:27 on dist-test-slave-g8n5"
I20250830 07:54:27.808967 13132 fs_manager.cc:696] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20250830 07:54:27.811996 13146 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20250830 07:54:27.813071 13132 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.000s sys 0.003s
I20250830 07:54:27.813218 13132 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/master-0/data,/tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/master-0/wal
uuid: "fea6152429cc4e79a25b18e02aafae57"
format_stamp: "Formatted at 2025-08-30 07:54:27 on dist-test-slave-g8n5"
I20250830 07:54:27.813378 13132 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20250830 07:54:27.832149 13132 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20250830 07:54:27.832857 13132 env_posix.cc:2264] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20250830 07:54:27.833081 13132 kserver.cc:163] Server-wide thread pool size limit: 3276
I20250830 07:54:27.851262 13132 rpc_server.cc:307] RPC server started. Bound to: 127.12.209.62:39725
I20250830 07:54:27.851282 13197 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.12.209.62:39725 every 8 connection(s)
I20250830 07:54:27.852582 13132 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/master-0/data/info.pb
I20250830 07:54:27.856137 13198 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:27.856427 13124 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskbivBUj/build/asan/bin/kudu as pid 13132
I20250830 07:54:27.856714 13124 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/master-0/wal/instance
I20250830 07:54:27.859998 13124 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskbivBUj/build/asan/bin/kudu
/tmp/dist-test-taskbivBUj/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.209.61:44241
--webserver_interface=127.12.209.61
--webserver_port=0
--builtin_ntp_servers=127.12.209.20:33943
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.209.62:39725,127.12.209.61:44241,127.12.209.60:43889
--hive_metastore_notification_log_poll_period_seconds=1
--enable_metadata_cleanup_for_deleted_tables_and_tablets=true
--catalog_manager_bg_task_wait_ms=10
--metadata_for_deleted_table_and_tablet_reserved_secs=0
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
I20250830 07:54:27.864143 13198 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.209.62" port: 39725 } has no permanent_uuid. Determining permanent_uuid...
I20250830 07:54:27.881705 13198 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.209.61" port: 44241 } has no permanent_uuid. Determining permanent_uuid...
W20250830 07:54:27.882741 13148 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.12.209.61:44241: connect: Connection refused (error 111)
W20250830 07:54:27.884214 13198 consensus_peers.cc:648] Error getting permanent uuid from config peer 127.12.209.61:44241: Network error: Client connection negotiation failed: client connection to 127.12.209.61:44241: connect: Connection refused (error 111)
I20250830 07:54:27.933526 13198 consensus_peers.cc:658] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.209.61" port: 44241 } attempt: 1
W20250830 07:54:27.935350 13198 consensus_peers.cc:648] Error getting permanent uuid from config peer 127.12.209.61:44241: Network error: Client connection negotiation failed: client connection to 127.12.209.61:44241: connect: Connection refused (error 111)
I20250830 07:54:28.003615 13198 consensus_peers.cc:658] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.209.61" port: 44241 } attempt: 2
W20250830 07:54:28.005440 13198 consensus_peers.cc:648] Error getting permanent uuid from config peer 127.12.209.61:44241: Network error: Client connection negotiation failed: client connection to 127.12.209.61:44241: connect: Connection refused (error 111)
I20250830 07:54:28.096716 13198 consensus_peers.cc:658] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.209.61" port: 44241 } attempt: 3
W20250830 07:54:28.098551 13198 consensus_peers.cc:648] Error getting permanent uuid from config peer 127.12.209.61:44241: Network error: Client connection negotiation failed: client connection to 127.12.209.61:44241: connect: Connection refused (error 111)
W20250830 07:54:28.157258 13200 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20250830 07:54:28.157522 13200 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20250830 07:54:28.157596 13200 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20250830 07:54:28.164842 13200 flags.cc:425] Enabled experimental flag: --enable_metadata_cleanup_for_deleted_tables_and_tablets=true
W20250830 07:54:28.164909 13200 flags.cc:425] Enabled experimental flag: --metadata_for_deleted_table_and_tablet_reserved_secs=0
W20250830 07:54:28.164970 13200 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20250830 07:54:28.165016 13200 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20250830 07:54:28.165082 13200 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20250830 07:54:28.165127 13200 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20250830 07:54:28.173832 13200 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.209.20:33943
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/master-1/wal
--catalog_manager_bg_task_wait_ms=10
--enable_metadata_cleanup_for_deleted_tables_and_tablets=true
--metadata_for_deleted_table_and_tablet_reserved_secs=0
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.12.209.62:39725,127.12.209.61:44241,127.12.209.60:43889
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.209.61:44241
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.12.209.61
--webserver_port=0
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.19.0-SNAPSHOT
revision 06466b25e294b4d7d455e6c56263318dc34a80ef
build type FASTDEBUG
built by None at 30 Aug 2025 07:43:23 UTC on 24a791456cd2
build id 7812
ASAN enabled
I20250830 07:54:28.175477 13200 env_posix.cc:2264] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20250830 07:54:28.177311 13200 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20250830 07:54:28.184989 13209 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250830 07:54:28.185034 13208 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250830 07:54:28.185632 13211 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20250830 07:54:28.186192 13200 server_base.cc:1047] running on GCE node
I20250830 07:54:28.186828 13200 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20250830 07:54:28.188041 13200 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20250830 07:54:28.189251 13200 hybrid_clock.cc:648] HybridClock initialized: now 1756540468189207 us; error 40 us; skew 500 ppm
I20250830 07:54:28.189563 13200 server_base.cc:847] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20250830 07:54:28.191520 13200 webserver.cc:480] Webserver started at http://127.12.209.61:41655/ using document root <none> and password file <none>
I20250830 07:54:28.192158 13200 fs_manager.cc:362] Metadata directory not provided
I20250830 07:54:28.192257 13200 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20250830 07:54:28.192585 13200 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20250830 07:54:28.194598 13200 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/master-1/data/instance:
uuid: "5e9d6449ae824acab24c459a72075e88"
format_stamp: "Formatted at 2025-08-30 07:54:28 on dist-test-slave-g8n5"
I20250830 07:54:28.195282 13200 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/master-1/wal/instance:
uuid: "5e9d6449ae824acab24c459a72075e88"
format_stamp: "Formatted at 2025-08-30 07:54:28 on dist-test-slave-g8n5"
I20250830 07:54:28.199821 13200 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20250830 07:54:28.202701 13217 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20250830 07:54:28.203850 13200 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20250830 07:54:28.204003 13200 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/master-1/data,/tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/master-1/wal
uuid: "5e9d6449ae824acab24c459a72075e88"
format_stamp: "Formatted at 2025-08-30 07:54:28 on dist-test-slave-g8n5"
I20250830 07:54:28.204196 13200 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20250830 07:54:28.223794 13200 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20250830 07:54:28.224467 13200 env_posix.cc:2264] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20250830 07:54:28.224709 13200 kserver.cc:163] Server-wide thread pool size limit: 3276
I20250830 07:54:28.241773 13198 consensus_peers.cc:658] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.209.61" port: 44241 } attempt: 4
I20250830 07:54:28.242151 13200 rpc_server.cc:307] RPC server started. Bound to: 127.12.209.61:44241
I20250830 07:54:28.242146 13268 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.12.209.61:44241 every 8 connection(s)
I20250830 07:54:28.243783 13200 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/master-1/data/info.pb
I20250830 07:54:28.245630 13124 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskbivBUj/build/asan/bin/kudu as pid 13200
I20250830 07:54:28.245808 13124 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/master-1/wal/instance
I20250830 07:54:28.247195 13124 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskbivBUj/build/asan/bin/kudu
/tmp/dist-test-taskbivBUj/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.209.60:43889
--webserver_interface=127.12.209.60
--webserver_port=0
--builtin_ntp_servers=127.12.209.20:33943
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.209.62:39725,127.12.209.61:44241,127.12.209.60:43889
--hive_metastore_notification_log_poll_period_seconds=1
--enable_metadata_cleanup_for_deleted_tables_and_tablets=true
--catalog_manager_bg_task_wait_ms=10
--metadata_for_deleted_table_and_tablet_reserved_secs=0
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
I20250830 07:54:28.247694 13270 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:28.254953 13270 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.209.62" port: 39725 } has no permanent_uuid. Determining permanent_uuid...
I20250830 07:54:28.256480 13198 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.209.60" port: 43889 } has no permanent_uuid. Determining permanent_uuid...
W20250830 07:54:28.258077 13198 consensus_peers.cc:648] Error getting permanent uuid from config peer 127.12.209.60:43889: Network error: Client connection negotiation failed: client connection to 127.12.209.60:43889: connect: Connection refused (error 111)
I20250830 07:54:28.263939 13270 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.209.61" port: 44241 } has no permanent_uuid. Determining permanent_uuid...
I20250830 07:54:28.269454 13270 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.209.60" port: 43889 } has no permanent_uuid. Determining permanent_uuid...
W20250830 07:54:28.270251 13219 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.12.209.60:43889: connect: Connection refused (error 111)
W20250830 07:54:28.271658 13270 consensus_peers.cc:648] Error getting permanent uuid from config peer 127.12.209.60:43889: Network error: Client connection negotiation failed: client connection to 127.12.209.60:43889: connect: Connection refused (error 111)
I20250830 07:54:28.317307 13198 consensus_peers.cc:658] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.209.60" port: 43889 } attempt: 1
W20250830 07:54:28.318967 13198 consensus_peers.cc:648] Error getting permanent uuid from config peer 127.12.209.60:43889: Network error: Client connection negotiation failed: client connection to 127.12.209.60:43889: connect: Connection refused (error 111)
I20250830 07:54:28.320961 13270 consensus_peers.cc:658] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.209.60" port: 43889 } attempt: 1
W20250830 07:54:28.322432 13270 consensus_peers.cc:648] Error getting permanent uuid from config peer 127.12.209.60:43889: Network error: Client connection negotiation failed: client connection to 127.12.209.60:43889: connect: Connection refused (error 111)
I20250830 07:54:28.386201 13198 consensus_peers.cc:658] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.209.60" port: 43889 } attempt: 2
W20250830 07:54:28.388016 13198 consensus_peers.cc:648] Error getting permanent uuid from config peer 127.12.209.60:43889: Network error: Client connection negotiation failed: client connection to 127.12.209.60:43889: connect: Connection refused (error 111)
I20250830 07:54:28.390673 13270 consensus_peers.cc:658] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.209.60" port: 43889 } attempt: 2
W20250830 07:54:28.392215 13270 consensus_peers.cc:648] Error getting permanent uuid from config peer 127.12.209.60:43889: Network error: Client connection negotiation failed: client connection to 127.12.209.60:43889: connect: Connection refused (error 111)
I20250830 07:54:28.483439 13270 consensus_peers.cc:658] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.209.60" port: 43889 } attempt: 3
W20250830 07:54:28.485157 13270 consensus_peers.cc:648] Error getting permanent uuid from config peer 127.12.209.60:43889: Network error: Client connection negotiation failed: client connection to 127.12.209.60:43889: connect: Connection refused (error 111)
I20250830 07:54:28.488279 13198 consensus_peers.cc:658] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.209.60" port: 43889 } attempt: 3
W20250830 07:54:28.489781 13198 consensus_peers.cc:648] Error getting permanent uuid from config peer 127.12.209.60:43889: Network error: Client connection negotiation failed: client connection to 127.12.209.60:43889: connect: Connection refused (error 111)
W20250830 07:54:28.542498 13272 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20250830 07:54:28.542742 13272 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20250830 07:54:28.542809 13272 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20250830 07:54:28.551312 13272 flags.cc:425] Enabled experimental flag: --enable_metadata_cleanup_for_deleted_tables_and_tablets=true
W20250830 07:54:28.551384 13272 flags.cc:425] Enabled experimental flag: --metadata_for_deleted_table_and_tablet_reserved_secs=0
W20250830 07:54:28.551445 13272 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20250830 07:54:28.551491 13272 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20250830 07:54:28.551548 13272 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20250830 07:54:28.551592 13272 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20250830 07:54:28.560212 13272 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.209.20:33943
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/master-2/wal
--catalog_manager_bg_task_wait_ms=10
--enable_metadata_cleanup_for_deleted_tables_and_tablets=true
--metadata_for_deleted_table_and_tablet_reserved_secs=0
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.12.209.62:39725,127.12.209.61:44241,127.12.209.60:43889
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.209.60:43889
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.12.209.60
--webserver_port=0
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.19.0-SNAPSHOT
revision 06466b25e294b4d7d455e6c56263318dc34a80ef
build type FASTDEBUG
built by None at 30 Aug 2025 07:43:23 UTC on 24a791456cd2
build id 7812
ASAN enabled
I20250830 07:54:28.561523 13272 env_posix.cc:2264] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20250830 07:54:28.563058 13272 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20250830 07:54:28.569969 13279 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250830 07:54:28.569940 13280 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250830 07:54:28.570900 13282 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20250830 07:54:28.571396 13272 server_base.cc:1047] running on GCE node
I20250830 07:54:28.572034 13272 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20250830 07:54:28.573196 13272 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20250830 07:54:28.574374 13272 hybrid_clock.cc:648] HybridClock initialized: now 1756540468574333 us; error 38 us; skew 500 ppm
I20250830 07:54:28.574659 13272 server_base.cc:847] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20250830 07:54:28.576565 13272 webserver.cc:480] Webserver started at http://127.12.209.60:32915/ using document root <none> and password file <none>
I20250830 07:54:28.577188 13272 fs_manager.cc:362] Metadata directory not provided
I20250830 07:54:28.577280 13272 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20250830 07:54:28.577602 13272 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20250830 07:54:28.579722 13272 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/master-2/data/instance:
uuid: "3ea183a890b84f408b20b55e9eb7c7ed"
format_stamp: "Formatted at 2025-08-30 07:54:28 on dist-test-slave-g8n5"
I20250830 07:54:28.580449 13272 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/master-2/wal/instance:
uuid: "3ea183a890b84f408b20b55e9eb7c7ed"
format_stamp: "Formatted at 2025-08-30 07:54:28 on dist-test-slave-g8n5"
I20250830 07:54:28.585052 13272 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20250830 07:54:28.587996 13288 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20250830 07:54:28.589111 13272 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.000s sys 0.003s
I20250830 07:54:28.589258 13272 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/master-2/data,/tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/master-2/wal
uuid: "3ea183a890b84f408b20b55e9eb7c7ed"
format_stamp: "Formatted at 2025-08-30 07:54:28 on dist-test-slave-g8n5"
I20250830 07:54:28.589419 13272 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20250830 07:54:28.610852 13272 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20250830 07:54:28.611575 13272 env_posix.cc:2264] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20250830 07:54:28.611802 13272 kserver.cc:163] Server-wide thread pool size limit: 3276
I20250830 07:54:28.628383 13270 consensus_peers.cc:658] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.209.60" port: 43889 } attempt: 4
W20250830 07:54:28.630008 13270 consensus_peers.cc:648] Error getting permanent uuid from config peer 127.12.209.60:43889: Network error: Client connection negotiation failed: client connection to 127.12.209.60:43889: connect: Connection refused (error 111)
I20250830 07:54:28.630275 13272 rpc_server.cc:307] RPC server started. Bound to: 127.12.209.60:43889
I20250830 07:54:28.630293 13339 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.12.209.60:43889 every 8 connection(s)
I20250830 07:54:28.631603 13272 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/master-2/data/info.pb
I20250830 07:54:28.633407 13124 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskbivBUj/build/asan/bin/kudu as pid 13272
I20250830 07:54:28.633620 13124 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/master-2/wal/instance
I20250830 07:54:28.635499 13340 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:28.641649 13340 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.209.62" port: 39725 } has no permanent_uuid. Determining permanent_uuid...
I20250830 07:54:28.652724 13340 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.209.61" port: 44241 } has no permanent_uuid. Determining permanent_uuid...
I20250830 07:54:28.659636 13340 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.209.60" port: 43889 } has no permanent_uuid. Determining permanent_uuid...
I20250830 07:54:28.659991 13198 consensus_peers.cc:658] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.209.60" port: 43889 } attempt: 4
I20250830 07:54:28.671706 13340 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3ea183a890b84f408b20b55e9eb7c7ed: Bootstrap starting.
I20250830 07:54:28.671825 13198 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fea6152429cc4e79a25b18e02aafae57: Bootstrap starting.
I20250830 07:54:28.674273 13340 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3ea183a890b84f408b20b55e9eb7c7ed: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:28.674271 13198 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P fea6152429cc4e79a25b18e02aafae57: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:28.675179 13340 log.cc:826] T 00000000000000000000000000000000 P 3ea183a890b84f408b20b55e9eb7c7ed: Log is configured to *not* fsync() on all Append() calls
I20250830 07:54:28.675182 13198 log.cc:826] T 00000000000000000000000000000000 P fea6152429cc4e79a25b18e02aafae57: Log is configured to *not* fsync() on all Append() calls
I20250830 07:54:28.677611 13198 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fea6152429cc4e79a25b18e02aafae57: No bootstrap required, opened a new log
I20250830 07:54:28.677676 13340 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3ea183a890b84f408b20b55e9eb7c7ed: No bootstrap required, opened a new log
I20250830 07:54:28.681926 13198 raft_consensus.cc:357] T 00000000000000000000000000000000 P fea6152429cc4e79a25b18e02aafae57 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fea6152429cc4e79a25b18e02aafae57" member_type: VOTER last_known_addr { host: "127.12.209.62" port: 39725 } } peers { permanent_uuid: "5e9d6449ae824acab24c459a72075e88" member_type: VOTER last_known_addr { host: "127.12.209.61" port: 44241 } } peers { permanent_uuid: "3ea183a890b84f408b20b55e9eb7c7ed" member_type: VOTER last_known_addr { host: "127.12.209.60" port: 43889 } }
I20250830 07:54:28.681927 13340 raft_consensus.cc:357] T 00000000000000000000000000000000 P 3ea183a890b84f408b20b55e9eb7c7ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fea6152429cc4e79a25b18e02aafae57" member_type: VOTER last_known_addr { host: "127.12.209.62" port: 39725 } } peers { permanent_uuid: "5e9d6449ae824acab24c459a72075e88" member_type: VOTER last_known_addr { host: "127.12.209.61" port: 44241 } } peers { permanent_uuid: "3ea183a890b84f408b20b55e9eb7c7ed" member_type: VOTER last_known_addr { host: "127.12.209.60" port: 43889 } }
I20250830 07:54:28.682153 13340 raft_consensus.cc:383] T 00000000000000000000000000000000 P 3ea183a890b84f408b20b55e9eb7c7ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:28.682163 13198 raft_consensus.cc:383] T 00000000000000000000000000000000 P fea6152429cc4e79a25b18e02aafae57 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:28.682248 13198 raft_consensus.cc:738] T 00000000000000000000000000000000 P fea6152429cc4e79a25b18e02aafae57 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fea6152429cc4e79a25b18e02aafae57, State: Initialized, Role: FOLLOWER
I20250830 07:54:28.682245 13340 raft_consensus.cc:738] T 00000000000000000000000000000000 P 3ea183a890b84f408b20b55e9eb7c7ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea183a890b84f408b20b55e9eb7c7ed, State: Initialized, Role: FOLLOWER
I20250830 07:54:28.682756 13198 consensus_queue.cc:260] T 00000000000000000000000000000000 P fea6152429cc4e79a25b18e02aafae57 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fea6152429cc4e79a25b18e02aafae57" member_type: VOTER last_known_addr { host: "127.12.209.62" port: 39725 } } peers { permanent_uuid: "5e9d6449ae824acab24c459a72075e88" member_type: VOTER last_known_addr { host: "127.12.209.61" port: 44241 } } peers { permanent_uuid: "3ea183a890b84f408b20b55e9eb7c7ed" member_type: VOTER last_known_addr { host: "127.12.209.60" port: 43889 } }
I20250830 07:54:28.682754 13340 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3ea183a890b84f408b20b55e9eb7c7ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fea6152429cc4e79a25b18e02aafae57" member_type: VOTER last_known_addr { host: "127.12.209.62" port: 39725 } } peers { permanent_uuid: "5e9d6449ae824acab24c459a72075e88" member_type: VOTER last_known_addr { host: "127.12.209.61" port: 44241 } } peers { permanent_uuid: "3ea183a890b84f408b20b55e9eb7c7ed" member_type: VOTER last_known_addr { host: "127.12.209.60" port: 43889 } }
I20250830 07:54:28.683610 13351 sys_catalog.cc:455] T 00000000000000000000000000000000 P fea6152429cc4e79a25b18e02aafae57 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fea6152429cc4e79a25b18e02aafae57" member_type: VOTER last_known_addr { host: "127.12.209.62" port: 39725 } } peers { permanent_uuid: "5e9d6449ae824acab24c459a72075e88" member_type: VOTER last_known_addr { host: "127.12.209.61" port: 44241 } } peers { permanent_uuid: "3ea183a890b84f408b20b55e9eb7c7ed" member_type: VOTER last_known_addr { host: "127.12.209.60" port: 43889 } } }
I20250830 07:54:28.683614 13352 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3ea183a890b84f408b20b55e9eb7c7ed [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fea6152429cc4e79a25b18e02aafae57" member_type: VOTER last_known_addr { host: "127.12.209.62" port: 39725 } } peers { permanent_uuid: "5e9d6449ae824acab24c459a72075e88" member_type: VOTER last_known_addr { host: "127.12.209.61" port: 44241 } } peers { permanent_uuid: "3ea183a890b84f408b20b55e9eb7c7ed" member_type: VOTER last_known_addr { host: "127.12.209.60" port: 43889 } } }
I20250830 07:54:28.683899 13351 sys_catalog.cc:458] T 00000000000000000000000000000000 P fea6152429cc4e79a25b18e02aafae57 [sys.catalog]: This master's current role is: FOLLOWER
I20250830 07:54:28.684059 13352 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3ea183a890b84f408b20b55e9eb7c7ed [sys.catalog]: This master's current role is: FOLLOWER
I20250830 07:54:28.684593 13340 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3ea183a890b84f408b20b55e9eb7c7ed [sys.catalog]: configured and running, proceeding with master startup.
I20250830 07:54:28.684667 13198 sys_catalog.cc:564] T 00000000000000000000000000000000 P fea6152429cc4e79a25b18e02aafae57 [sys.catalog]: configured and running, proceeding with master startup.
I20250830 07:54:28.695268 13132 master_runner.cc:186] Error getting master registration for 127.12.209.61:44241: OK, instance_id { permanent_uuid: "5e9d6449ae824acab24c459a72075e88" instance_seqno: 1756540468237560 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20250830 07:54:28.700850 13132 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20250830 07:54:28.701305 13374 catalog_manager.cc:1560] T 00000000000000000000000000000000 P fea6152429cc4e79a25b18e02aafae57: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20250830 07:54:28.701627 13374 catalog_manager.cc:875] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20250830 07:54:28.698616 13272 master_runner.cc:186] Error getting master registration for 127.12.209.61:44241: OK, instance_id { permanent_uuid: "5e9d6449ae824acab24c459a72075e88" instance_seqno: 1756540468237560 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20250830 07:54:28.706764 13272 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20250830 07:54:28.712855 13374 catalog_manager.cc:1560] T 00000000000000000000000000000000 P fea6152429cc4e79a25b18e02aafae57: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20250830 07:54:28.712947 13374 catalog_manager.cc:875] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
W20250830 07:54:28.715085 13373 catalog_manager.cc:1560] T 00000000000000000000000000000000 P 3ea183a890b84f408b20b55e9eb7c7ed: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20250830 07:54:28.715188 13373 catalog_manager.cc:875] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
W20250830 07:54:28.724058 13374 catalog_manager.cc:1560] T 00000000000000000000000000000000 P fea6152429cc4e79a25b18e02aafae57: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20250830 07:54:28.724185 13374 catalog_manager.cc:875] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
W20250830 07:54:28.726293 13373 catalog_manager.cc:1560] T 00000000000000000000000000000000 P 3ea183a890b84f408b20b55e9eb7c7ed: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20250830 07:54:28.726400 13373 catalog_manager.cc:875] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
W20250830 07:54:28.735594 13374 catalog_manager.cc:1560] T 00000000000000000000000000000000 P fea6152429cc4e79a25b18e02aafae57: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20250830 07:54:28.735698 13374 catalog_manager.cc:875] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
W20250830 07:54:28.737514 13373 catalog_manager.cc:1560] T 00000000000000000000000000000000 P 3ea183a890b84f408b20b55e9eb7c7ed: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20250830 07:54:28.737617 13373 catalog_manager.cc:875] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
W20250830 07:54:28.747203 13374 catalog_manager.cc:1560] T 00000000000000000000000000000000 P fea6152429cc4e79a25b18e02aafae57: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20250830 07:54:28.747329 13374 catalog_manager.cc:875] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
W20250830 07:54:28.748792 13373 catalog_manager.cc:1560] T 00000000000000000000000000000000 P 3ea183a890b84f408b20b55e9eb7c7ed: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20250830 07:54:28.748893 13373 catalog_manager.cc:875] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
W20250830 07:54:28.758431 13374 catalog_manager.cc:1560] T 00000000000000000000000000000000 P fea6152429cc4e79a25b18e02aafae57: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20250830 07:54:28.758526 13374 catalog_manager.cc:875] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
W20250830 07:54:28.759953 13373 catalog_manager.cc:1560] T 00000000000000000000000000000000 P 3ea183a890b84f408b20b55e9eb7c7ed: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20250830 07:54:28.760051 13373 catalog_manager.cc:875] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
W20250830 07:54:28.769618 13374 catalog_manager.cc:1560] T 00000000000000000000000000000000 P fea6152429cc4e79a25b18e02aafae57: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20250830 07:54:28.769727 13374 catalog_manager.cc:875] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
W20250830 07:54:28.771142 13373 catalog_manager.cc:1560] T 00000000000000000000000000000000 P 3ea183a890b84f408b20b55e9eb7c7ed: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20250830 07:54:28.771236 13373 catalog_manager.cc:875] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
W20250830 07:54:28.780856 13374 catalog_manager.cc:1560] T 00000000000000000000000000000000 P fea6152429cc4e79a25b18e02aafae57: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20250830 07:54:28.780967 13374 catalog_manager.cc:875] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
W20250830 07:54:28.782356 13373 catalog_manager.cc:1560] T 00000000000000000000000000000000 P 3ea183a890b84f408b20b55e9eb7c7ed: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20250830 07:54:28.782466 13373 catalog_manager.cc:875] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
W20250830 07:54:28.792120 13374 catalog_manager.cc:1560] T 00000000000000000000000000000000 P fea6152429cc4e79a25b18e02aafae57: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20250830 07:54:28.792214 13374 catalog_manager.cc:875] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
W20250830 07:54:28.793457 13373 catalog_manager.cc:1560] T 00000000000000000000000000000000 P 3ea183a890b84f408b20b55e9eb7c7ed: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20250830 07:54:28.793573 13373 catalog_manager.cc:875] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
W20250830 07:54:28.803366 13374 catalog_manager.cc:1560] T 00000000000000000000000000000000 P fea6152429cc4e79a25b18e02aafae57: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20250830 07:54:28.803468 13374 catalog_manager.cc:875] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
W20250830 07:54:28.804644 13373 catalog_manager.cc:1560] T 00000000000000000000000000000000 P 3ea183a890b84f408b20b55e9eb7c7ed: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20250830 07:54:28.804738 13373 catalog_manager.cc:875] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
W20250830 07:54:28.814513 13374 catalog_manager.cc:1560] T 00000000000000000000000000000000 P fea6152429cc4e79a25b18e02aafae57: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20250830 07:54:28.814639 13374 catalog_manager.cc:875] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
W20250830 07:54:28.815884 13373 catalog_manager.cc:1560] T 00000000000000000000000000000000 P 3ea183a890b84f408b20b55e9eb7c7ed: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20250830 07:54:28.815982 13373 catalog_manager.cc:875] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20250830 07:54:28.820932 13352 raft_consensus.cc:491] T 00000000000000000000000000000000 P 3ea183a890b84f408b20b55e9eb7c7ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:28.821195 13352 raft_consensus.cc:513] T 00000000000000000000000000000000 P 3ea183a890b84f408b20b55e9eb7c7ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fea6152429cc4e79a25b18e02aafae57" member_type: VOTER last_known_addr { host: "127.12.209.62" port: 39725 } } peers { permanent_uuid: "5e9d6449ae824acab24c459a72075e88" member_type: VOTER last_known_addr { host: "127.12.209.61" port: 44241 } } peers { permanent_uuid: "3ea183a890b84f408b20b55e9eb7c7ed" member_type: VOTER last_known_addr { host: "127.12.209.60" port: 43889 } }
I20250830 07:54:28.822970 13352 leader_election.cc:290] T 00000000000000000000000000000000 P 3ea183a890b84f408b20b55e9eb7c7ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fea6152429cc4e79a25b18e02aafae57 (127.12.209.62:39725), 5e9d6449ae824acab24c459a72075e88 (127.12.209.61:44241)
I20250830 07:54:28.823657 13173 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "3ea183a890b84f408b20b55e9eb7c7ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fea6152429cc4e79a25b18e02aafae57" is_pre_election: true
I20250830 07:54:28.824110 13173 raft_consensus.cc:2466] T 00000000000000000000000000000000 P fea6152429cc4e79a25b18e02aafae57 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ea183a890b84f408b20b55e9eb7c7ed in term 0.
I20250830 07:54:28.824640 13292 leader_election.cc:304] T 00000000000000000000000000000000 P 3ea183a890b84f408b20b55e9eb7c7ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ea183a890b84f408b20b55e9eb7c7ed, fea6152429cc4e79a25b18e02aafae57; no voters:
I20250830 07:54:28.825069 13352 raft_consensus.cc:2802] T 00000000000000000000000000000000 P 3ea183a890b84f408b20b55e9eb7c7ed [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:54:28.825206 13352 raft_consensus.cc:491] T 00000000000000000000000000000000 P 3ea183a890b84f408b20b55e9eb7c7ed [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:54:28.825307 13352 raft_consensus.cc:3058] T 00000000000000000000000000000000 P 3ea183a890b84f408b20b55e9eb7c7ed [term 0 FOLLOWER]: Advancing to term 1
W20250830 07:54:28.826673 13374 catalog_manager.cc:1560] T 00000000000000000000000000000000 P fea6152429cc4e79a25b18e02aafae57: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20250830 07:54:28.826853 13374 catalog_manager.cc:875] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20250830 07:54:28.830058 13352 raft_consensus.cc:513] T 00000000000000000000000000000000 P 3ea183a890b84f408b20b55e9eb7c7ed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fea6152429cc4e79a25b18e02aafae57" member_type: VOTER last_known_addr { host: "127.12.209.62" port: 39725 } } peers { permanent_uuid: "5e9d6449ae824acab24c459a72075e88" member_type: VOTER last_known_addr { host: "127.12.209.61" port: 44241 } } peers { permanent_uuid: "3ea183a890b84f408b20b55e9eb7c7ed" member_type: VOTER last_known_addr { host: "127.12.209.60" port: 43889 } }
I20250830 07:54:28.831059 13173 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "3ea183a890b84f408b20b55e9eb7c7ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fea6152429cc4e79a25b18e02aafae57"
I20250830 07:54:28.831233 13173 raft_consensus.cc:3058] T 00000000000000000000000000000000 P fea6152429cc4e79a25b18e02aafae57 [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:28.834439 13173 raft_consensus.cc:2466] T 00000000000000000000000000000000 P fea6152429cc4e79a25b18e02aafae57 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ea183a890b84f408b20b55e9eb7c7ed in term 1.
I20250830 07:54:28.834940 13292 leader_election.cc:304] T 00000000000000000000000000000000 P 3ea183a890b84f408b20b55e9eb7c7ed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ea183a890b84f408b20b55e9eb7c7ed, fea6152429cc4e79a25b18e02aafae57; no voters:
W20250830 07:54:28.835470 13152 tablet.cc:2378] T 00000000000000000000000000000000 P fea6152429cc4e79a25b18e02aafae57: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20250830 07:54:28.835834 13377 raft_consensus.cc:2802] T 00000000000000000000000000000000 P 3ea183a890b84f408b20b55e9eb7c7ed [term 1 FOLLOWER]: Leader election won for term 1
I20250830 07:54:28.836194 13352 leader_election.cc:290] T 00000000000000000000000000000000 P 3ea183a890b84f408b20b55e9eb7c7ed [CANDIDATE]: Term 1 election: Requested vote from peers fea6152429cc4e79a25b18e02aafae57 (127.12.209.62:39725), 5e9d6449ae824acab24c459a72075e88 (127.12.209.61:44241)
W20250830 07:54:28.838187 13374 catalog_manager.cc:1560] T 00000000000000000000000000000000 P fea6152429cc4e79a25b18e02aafae57: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20250830 07:54:28.838284 13374 catalog_manager.cc:875] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20250830 07:54:28.838382 13377 raft_consensus.cc:695] T 00000000000000000000000000000000 P 3ea183a890b84f408b20b55e9eb7c7ed [term 1 LEADER]: Becoming Leader. State: Replica: 3ea183a890b84f408b20b55e9eb7c7ed, State: Running, Role: LEADER
I20250830 07:54:28.838953 13377 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3ea183a890b84f408b20b55e9eb7c7ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fea6152429cc4e79a25b18e02aafae57" member_type: VOTER last_known_addr { host: "127.12.209.62" port: 39725 } } peers { permanent_uuid: "5e9d6449ae824acab24c459a72075e88" member_type: VOTER last_known_addr { host: "127.12.209.61" port: 44241 } } peers { permanent_uuid: "3ea183a890b84f408b20b55e9eb7c7ed" member_type: VOTER last_known_addr { host: "127.12.209.60" port: 43889 } }
I20250830 07:54:28.841967 13352 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3ea183a890b84f408b20b55e9eb7c7ed [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3ea183a890b84f408b20b55e9eb7c7ed. Latest consensus state: current_term: 1 leader_uuid: "3ea183a890b84f408b20b55e9eb7c7ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fea6152429cc4e79a25b18e02aafae57" member_type: VOTER last_known_addr { host: "127.12.209.62" port: 39725 } } peers { permanent_uuid: "5e9d6449ae824acab24c459a72075e88" member_type: VOTER last_known_addr { host: "127.12.209.61" port: 44241 } } peers { permanent_uuid: "3ea183a890b84f408b20b55e9eb7c7ed" member_type: VOTER last_known_addr { host: "127.12.209.60" port: 43889 } } }
I20250830 07:54:28.842201 13352 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3ea183a890b84f408b20b55e9eb7c7ed [sys.catalog]: This master's current role is: LEADER
W20250830 07:54:28.843530 13373 catalog_manager.cc:1560] T 00000000000000000000000000000000 P 3ea183a890b84f408b20b55e9eb7c7ed: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20250830 07:54:28.843622 13373 catalog_manager.cc:875] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20250830 07:54:28.844403 13380 catalog_manager.cc:1477] Loading table and tablet metadata into memory...
I20250830 07:54:28.846490 13380 catalog_manager.cc:1486] Initializing Kudu cluster ID...
W20250830 07:54:28.849370 13374 catalog_manager.cc:1560] T 00000000000000000000000000000000 P fea6152429cc4e79a25b18e02aafae57: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20250830 07:54:28.849463 13374 catalog_manager.cc:875] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20250830 07:54:28.856716 13173 raft_consensus.cc:1273] T 00000000000000000000000000000000 P fea6152429cc4e79a25b18e02aafae57 [term 1 FOLLOWER]: Refusing update from remote peer 3ea183a890b84f408b20b55e9eb7c7ed: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250830 07:54:28.857586 13352 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 3ea183a890b84f408b20b55e9eb7c7ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "fea6152429cc4e79a25b18e02aafae57" member_type: VOTER last_known_addr { host: "127.12.209.62" port: 39725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20250830 07:54:28.863530 13294 tablet.cc:2378] T 00000000000000000000000000000000 P 3ea183a890b84f408b20b55e9eb7c7ed: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20250830 07:54:28.881119 13374 catalog_manager.cc:1560] T 00000000000000000000000000000000 P fea6152429cc4e79a25b18e02aafae57: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20250830 07:54:28.881230 13374 catalog_manager.cc:875] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20250830 07:54:28.881733 13351 sys_catalog.cc:455] T 00000000000000000000000000000000 P fea6152429cc4e79a25b18e02aafae57 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3ea183a890b84f408b20b55e9eb7c7ed. Latest consensus state: current_term: 1 leader_uuid: "3ea183a890b84f408b20b55e9eb7c7ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fea6152429cc4e79a25b18e02aafae57" member_type: VOTER last_known_addr { host: "127.12.209.62" port: 39725 } } peers { permanent_uuid: "5e9d6449ae824acab24c459a72075e88" member_type: VOTER last_known_addr { host: "127.12.209.61" port: 44241 } } peers { permanent_uuid: "3ea183a890b84f408b20b55e9eb7c7ed" member_type: VOTER last_known_addr { host: "127.12.209.60" port: 43889 } } }
I20250830 07:54:28.881947 13351 sys_catalog.cc:458] T 00000000000000000000000000000000 P fea6152429cc4e79a25b18e02aafae57 [sys.catalog]: This master's current role is: FOLLOWER
I20250830 07:54:28.886399 13377 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3ea183a890b84f408b20b55e9eb7c7ed [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "3ea183a890b84f408b20b55e9eb7c7ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fea6152429cc4e79a25b18e02aafae57" member_type: VOTER last_known_addr { host: "127.12.209.62" port: 39725 } } peers { permanent_uuid: "5e9d6449ae824acab24c459a72075e88" member_type: VOTER last_known_addr { host: "127.12.209.61" port: 44241 } } peers { permanent_uuid: "3ea183a890b84f408b20b55e9eb7c7ed" member_type: VOTER last_known_addr { host: "127.12.209.60" port: 43889 } } }
I20250830 07:54:28.887010 13377 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3ea183a890b84f408b20b55e9eb7c7ed [sys.catalog]: This master's current role is: LEADER
I20250830 07:54:28.888026 13380 catalog_manager.cc:1349] Generated new cluster ID: 90fa2c64725e4c7399db393bcf7c431d
I20250830 07:54:28.888132 13380 catalog_manager.cc:1497] Initializing Kudu internal certificate authority...
I20250830 07:54:28.913408 13351 sys_catalog.cc:455] T 00000000000000000000000000000000 P fea6152429cc4e79a25b18e02aafae57 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "3ea183a890b84f408b20b55e9eb7c7ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fea6152429cc4e79a25b18e02aafae57" member_type: VOTER last_known_addr { host: "127.12.209.62" port: 39725 } } peers { permanent_uuid: "5e9d6449ae824acab24c459a72075e88" member_type: VOTER last_known_addr { host: "127.12.209.61" port: 44241 } } peers { permanent_uuid: "3ea183a890b84f408b20b55e9eb7c7ed" member_type: VOTER last_known_addr { host: "127.12.209.60" port: 43889 } } }
I20250830 07:54:28.913604 13351 sys_catalog.cc:458] T 00000000000000000000000000000000 P fea6152429cc4e79a25b18e02aafae57 [sys.catalog]: This master's current role is: FOLLOWER
I20250830 07:54:28.915601 13374 catalog_manager.cc:1261] Loaded cluster ID: 90fa2c64725e4c7399db393bcf7c431d
I20250830 07:54:28.915684 13374 catalog_manager.cc:1554] T 00000000000000000000000000000000 P fea6152429cc4e79a25b18e02aafae57: loading cluster ID for follower catalog manager: success
W20250830 07:54:28.917814 13374 catalog_manager.cc:1578] T 00000000000000000000000000000000 P fea6152429cc4e79a25b18e02aafae57: acquiring CA information for follower catalog manager: Not found: root CA entry not found
W20250830 07:54:28.918025 13374 catalog_manager.cc:875] Not found: root CA entry not found: failed to prepare follower catalog manager, will retry
I20250830 07:54:28.923596 13380 catalog_manager.cc:1372] Generated new certificate authority record
I20250830 07:54:28.925186 13380 catalog_manager.cc:1506] Loading token signing keys...
I20250830 07:54:28.931707 13374 catalog_manager.cc:1576] T 00000000000000000000000000000000 P fea6152429cc4e79a25b18e02aafae57: acquiring CA information for follower catalog manager: success
I20250830 07:54:28.931838 13270 consensus_peers.cc:658] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.209.60" port: 43889 } attempt: 5
W20250830 07:54:28.933980 13374 catalog_manager.cc:875] Not found: no TSK found in the system table: failed to prepare follower catalog manager, will retry
W20250830 07:54:28.945542 13374 catalog_manager.cc:875] Not found: no TSK found in the system table: failed to prepare follower catalog manager, will retry
I20250830 07:54:28.946688 13270 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Bootstrap starting.
I20250830 07:54:28.950865 13380 catalog_manager.cc:5955] T 00000000000000000000000000000000 P 3ea183a890b84f408b20b55e9eb7c7ed: Generated new TSK 0
I20250830 07:54:28.951817 13380 catalog_manager.cc:1516] Initializing in-progress tserver states...
I20250830 07:54:28.954246 13270 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:28.955678 13270 log.cc:826] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Log is configured to *not* fsync() on all Append() calls
I20250830 07:54:28.958103 13374 catalog_manager.cc:1604] T 00000000000000000000000000000000 P fea6152429cc4e79a25b18e02aafae57: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20250830 07:54:28.959025 13270 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: No bootstrap required, opened a new log
I20250830 07:54:28.967536 13124 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskbivBUj/build/asan/bin/kudu
/tmp/dist-test-taskbivBUj/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.209.1:0
--local_ip_for_outbound_sockets=127.12.209.1
--webserver_interface=127.12.209.1
--webserver_port=0
--tserver_master_addrs=127.12.209.62:39725,127.12.209.61:44241,127.12.209.60:43889
--builtin_ntp_servers=127.12.209.20:33943
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--raft_heartbeat_interval_ms=1000
--heartbeat_rpc_timeout_ms=1000
--heartbeat_max_failures_before_backoff=1
--heartbeat_interval_ms=500 with env {}
I20250830 07:54:28.971094 13270 raft_consensus.cc:357] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fea6152429cc4e79a25b18e02aafae57" member_type: VOTER last_known_addr { host: "127.12.209.62" port: 39725 } } peers { permanent_uuid: "5e9d6449ae824acab24c459a72075e88" member_type: VOTER last_known_addr { host: "127.12.209.61" port: 44241 } } peers { permanent_uuid: "3ea183a890b84f408b20b55e9eb7c7ed" member_type: VOTER last_known_addr { host: "127.12.209.60" port: 43889 } }
I20250830 07:54:28.971410 13270 raft_consensus.cc:383] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:28.971514 13270 raft_consensus.cc:738] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e9d6449ae824acab24c459a72075e88, State: Initialized, Role: FOLLOWER
I20250830 07:54:28.972211 13270 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fea6152429cc4e79a25b18e02aafae57" member_type: VOTER last_known_addr { host: "127.12.209.62" port: 39725 } } peers { permanent_uuid: "5e9d6449ae824acab24c459a72075e88" member_type: VOTER last_known_addr { host: "127.12.209.61" port: 44241 } } peers { permanent_uuid: "3ea183a890b84f408b20b55e9eb7c7ed" member_type: VOTER last_known_addr { host: "127.12.209.60" port: 43889 } }
I20250830 07:54:28.979321 13387 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fea6152429cc4e79a25b18e02aafae57" member_type: VOTER last_known_addr { host: "127.12.209.62" port: 39725 } } peers { permanent_uuid: "5e9d6449ae824acab24c459a72075e88" member_type: VOTER last_known_addr { host: "127.12.209.61" port: 44241 } } peers { permanent_uuid: "3ea183a890b84f408b20b55e9eb7c7ed" member_type: VOTER last_known_addr { host: "127.12.209.60" port: 43889 } } }
I20250830 07:54:28.979611 13387 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88 [sys.catalog]: This master's current role is: FOLLOWER
I20250830 07:54:28.981295 13270 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88 [sys.catalog]: configured and running, proceeding with master startup.
I20250830 07:54:28.981338 13243 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "3ea183a890b84f408b20b55e9eb7c7ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e9d6449ae824acab24c459a72075e88"
I20250830 07:54:28.981717 13243 raft_consensus.cc:3058] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88 [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:28.985813 13243 raft_consensus.cc:2466] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ea183a890b84f408b20b55e9eb7c7ed in term 1.
I20250830 07:54:28.987334 13242 raft_consensus.cc:1273] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88 [term 1 FOLLOWER]: Refusing update from remote peer 3ea183a890b84f408b20b55e9eb7c7ed: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250830 07:54:28.988068 13244 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "3ea183a890b84f408b20b55e9eb7c7ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e9d6449ae824acab24c459a72075e88" is_pre_election: true
I20250830 07:54:28.988384 13244 raft_consensus.cc:2374] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88 [term 1 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 3ea183a890b84f408b20b55e9eb7c7ed in term 1. Re-sending same reply.
I20250830 07:54:28.990319 13377 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 3ea183a890b84f408b20b55e9eb7c7ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9d6449ae824acab24c459a72075e88" member_type: VOTER last_known_addr { host: "127.12.209.61" port: 44241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:54:29.034488 13387 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3ea183a890b84f408b20b55e9eb7c7ed. Latest consensus state: current_term: 1 leader_uuid: "3ea183a890b84f408b20b55e9eb7c7ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fea6152429cc4e79a25b18e02aafae57" member_type: VOTER last_known_addr { host: "127.12.209.62" port: 39725 } } peers { permanent_uuid: "5e9d6449ae824acab24c459a72075e88" member_type: VOTER last_known_addr { host: "127.12.209.61" port: 44241 } } peers { permanent_uuid: "3ea183a890b84f408b20b55e9eb7c7ed" member_type: VOTER last_known_addr { host: "127.12.209.60" port: 43889 } } }
I20250830 07:54:29.034829 13387 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88 [sys.catalog]: This master's current role is: FOLLOWER
I20250830 07:54:29.035367 13397 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "3ea183a890b84f408b20b55e9eb7c7ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fea6152429cc4e79a25b18e02aafae57" member_type: VOTER last_known_addr { host: "127.12.209.62" port: 39725 } } peers { permanent_uuid: "5e9d6449ae824acab24c459a72075e88" member_type: VOTER last_known_addr { host: "127.12.209.61" port: 44241 } } peers { permanent_uuid: "3ea183a890b84f408b20b55e9eb7c7ed" member_type: VOTER last_known_addr { host: "127.12.209.60" port: 43889 } } }
I20250830 07:54:29.035835 13397 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88 [sys.catalog]: This master's current role is: FOLLOWER
I20250830 07:54:29.060148 13404 catalog_manager.cc:797] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
I20250830 07:54:29.084821 13404 catalog_manager.cc:1261] Loaded cluster ID: 90fa2c64725e4c7399db393bcf7c431d
I20250830 07:54:29.084940 13404 catalog_manager.cc:1554] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: loading cluster ID for follower catalog manager: success
I20250830 07:54:29.089738 13404 catalog_manager.cc:1576] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: acquiring CA information for follower catalog manager: success
I20250830 07:54:29.092259 13404 catalog_manager.cc:1604] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20250830 07:54:29.421437 13388 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20250830 07:54:29.421710 13388 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20250830 07:54:29.421841 13388 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20250830 07:54:29.429937 13388 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20250830 07:54:29.430142 13388 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.209.1
I20250830 07:54:29.439045 13388 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.209.20:33943
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--raft_heartbeat_interval_ms=1000
--fs_data_dirs=/tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.209.1:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.209.1
--webserver_port=0
--heartbeat_interval_ms=500
--heartbeat_max_failures_before_backoff=1
--heartbeat_rpc_timeout_ms=1000
--tserver_master_addrs=127.12.209.62:39725,127.12.209.61:44241,127.12.209.60:43889
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.209.1
--log_dir=/tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 06466b25e294b4d7d455e6c56263318dc34a80ef
build type FASTDEBUG
built by None at 30 Aug 2025 07:43:23 UTC on 24a791456cd2
build id 7812
ASAN enabled
I20250830 07:54:29.440438 13388 env_posix.cc:2264] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20250830 07:54:29.442250 13388 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20250830 07:54:29.451005 13411 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250830 07:54:29.451514 13410 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250830 07:54:29.452370 13413 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20250830 07:54:29.452847 13415 raft_consensus.cc:491] T 00000000000000000000000000000000 P fea6152429cc4e79a25b18e02aafae57 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3ea183a890b84f408b20b55e9eb7c7ed)
I20250830 07:54:29.453177 13388 server_base.cc:1047] running on GCE node
I20250830 07:54:29.453742 13388 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20250830 07:54:29.453106 13415 raft_consensus.cc:513] T 00000000000000000000000000000000 P fea6152429cc4e79a25b18e02aafae57 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fea6152429cc4e79a25b18e02aafae57" member_type: VOTER last_known_addr { host: "127.12.209.62" port: 39725 } } peers { permanent_uuid: "5e9d6449ae824acab24c459a72075e88" member_type: VOTER last_known_addr { host: "127.12.209.61" port: 44241 } } peers { permanent_uuid: "3ea183a890b84f408b20b55e9eb7c7ed" member_type: VOTER last_known_addr { host: "127.12.209.60" port: 43889 } }
I20250830 07:54:29.454794 13388 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20250830 07:54:29.455252 13415 leader_election.cc:290] T 00000000000000000000000000000000 P fea6152429cc4e79a25b18e02aafae57 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e9d6449ae824acab24c459a72075e88 (127.12.209.61:44241), 3ea183a890b84f408b20b55e9eb7c7ed (127.12.209.60:43889)
I20250830 07:54:29.455849 13244 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "fea6152429cc4e79a25b18e02aafae57" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5e9d6449ae824acab24c459a72075e88" is_pre_election: true
I20250830 07:54:29.455919 13314 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "fea6152429cc4e79a25b18e02aafae57" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3ea183a890b84f408b20b55e9eb7c7ed" is_pre_election: true
I20250830 07:54:29.456015 13388 hybrid_clock.cc:648] HybridClock initialized: now 1756540469455969 us; error 37 us; skew 500 ppm
I20250830 07:54:29.456367 13388 server_base.cc:847] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20250830 07:54:29.456681 13148 leader_election.cc:304] T 00000000000000000000000000000000 P fea6152429cc4e79a25b18e02aafae57 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fea6152429cc4e79a25b18e02aafae57; no voters: 3ea183a890b84f408b20b55e9eb7c7ed, 5e9d6449ae824acab24c459a72075e88
I20250830 07:54:29.456992 13415 raft_consensus.cc:2747] T 00000000000000000000000000000000 P fea6152429cc4e79a25b18e02aafae57 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20250830 07:54:29.458933 13388 webserver.cc:480] Webserver started at http://127.12.209.1:33475/ using document root <none> and password file <none>
I20250830 07:54:29.459825 13388 fs_manager.cc:362] Metadata directory not provided
I20250830 07:54:29.459947 13388 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20250830 07:54:29.460364 13388 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20250830 07:54:29.463409 13388 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/ts-0/data/instance:
uuid: "2065c332f15a4739899af79f3669c3ba"
format_stamp: "Formatted at 2025-08-30 07:54:29 on dist-test-slave-g8n5"
I20250830 07:54:29.464424 13388 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/ts-0/wal/instance:
uuid: "2065c332f15a4739899af79f3669c3ba"
format_stamp: "Formatted at 2025-08-30 07:54:29 on dist-test-slave-g8n5"
I20250830 07:54:29.470849 13388 fs_manager.cc:696] Time spent creating directory manager: real 0.006s user 0.002s sys 0.005s
I20250830 07:54:29.474035 13420 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20250830 07:54:29.475302 13388 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20250830 07:54:29.475466 13388 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/ts-0/data,/tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/ts-0/wal
uuid: "2065c332f15a4739899af79f3669c3ba"
format_stamp: "Formatted at 2025-08-30 07:54:29 on dist-test-slave-g8n5"
I20250830 07:54:29.475639 13388 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20250830 07:54:29.489661 13388 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20250830 07:54:29.490406 13388 env_posix.cc:2264] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20250830 07:54:29.490639 13388 kserver.cc:163] Server-wide thread pool size limit: 3276
I20250830 07:54:29.491600 13388 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20250830 07:54:29.493086 13388 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20250830 07:54:29.493182 13388 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20250830 07:54:29.493286 13388 ts_tablet_manager.cc:610] Registered 0 tablets
I20250830 07:54:29.493366 13388 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20250830 07:54:29.493539 13397 raft_consensus.cc:491] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3ea183a890b84f408b20b55e9eb7c7ed)
I20250830 07:54:29.493734 13397 raft_consensus.cc:513] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fea6152429cc4e79a25b18e02aafae57" member_type: VOTER last_known_addr { host: "127.12.209.62" port: 39725 } } peers { permanent_uuid: "5e9d6449ae824acab24c459a72075e88" member_type: VOTER last_known_addr { host: "127.12.209.61" port: 44241 } } peers { permanent_uuid: "3ea183a890b84f408b20b55e9eb7c7ed" member_type: VOTER last_known_addr { host: "127.12.209.60" port: 43889 } }
I20250830 07:54:29.495201 13397 leader_election.cc:290] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fea6152429cc4e79a25b18e02aafae57 (127.12.209.62:39725), 3ea183a890b84f408b20b55e9eb7c7ed (127.12.209.60:43889)
I20250830 07:54:29.495564 13173 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "5e9d6449ae824acab24c459a72075e88" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fea6152429cc4e79a25b18e02aafae57" is_pre_election: true
I20250830 07:54:29.495867 13314 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "5e9d6449ae824acab24c459a72075e88" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3ea183a890b84f408b20b55e9eb7c7ed" is_pre_election: true
I20250830 07:54:29.496506 13219 leader_election.cc:304] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e9d6449ae824acab24c459a72075e88; no voters: 3ea183a890b84f408b20b55e9eb7c7ed, fea6152429cc4e79a25b18e02aafae57
I20250830 07:54:29.496925 13397 raft_consensus.cc:2747] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20250830 07:54:29.533797 13377 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3ea183a890b84f408b20b55e9eb7c7ed [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "3ea183a890b84f408b20b55e9eb7c7ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fea6152429cc4e79a25b18e02aafae57" member_type: VOTER last_known_addr { host: "127.12.209.62" port: 39725 } } peers { permanent_uuid: "5e9d6449ae824acab24c459a72075e88" member_type: VOTER last_known_addr { host: "127.12.209.61" port: 44241 } } peers { permanent_uuid: "3ea183a890b84f408b20b55e9eb7c7ed" member_type: VOTER last_known_addr { host: "127.12.209.60" port: 43889 } } }
I20250830 07:54:29.534003 13377 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3ea183a890b84f408b20b55e9eb7c7ed [sys.catalog]: This master's current role is: LEADER
I20250830 07:54:29.544200 13533 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.12.209.1:45325 every 8 connection(s)
I20250830 07:54:29.544377 13388 rpc_server.cc:307] RPC server started. Bound to: 127.12.209.1:45325
I20250830 07:54:29.545791 13388 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/ts-0/data/info.pb
I20250830 07:54:29.553575 13124 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskbivBUj/build/asan/bin/kudu as pid 13388
I20250830 07:54:29.553802 13124 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/ts-0/wal/instance
I20250830 07:54:29.559589 13124 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskbivBUj/build/asan/bin/kudu
/tmp/dist-test-taskbivBUj/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.209.2:0
--local_ip_for_outbound_sockets=127.12.209.2
--webserver_interface=127.12.209.2
--webserver_port=0
--tserver_master_addrs=127.12.209.62:39725,127.12.209.61:44241,127.12.209.60:43889
--builtin_ntp_servers=127.12.209.20:33943
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--raft_heartbeat_interval_ms=1000
--heartbeat_rpc_timeout_ms=1000
--heartbeat_max_failures_before_backoff=1
--heartbeat_interval_ms=500 with env {}
I20250830 07:54:29.585749 13537 heartbeater.cc:344] Connected to a master server at 127.12.209.62:39725
I20250830 07:54:29.586174 13537 heartbeater.cc:461] Registering TS with master...
I20250830 07:54:29.587205 13537 heartbeater.cc:507] Master 127.12.209.62:39725 requested a full tablet report, sending...
I20250830 07:54:29.588105 13536 heartbeater.cc:344] Connected to a master server at 127.12.209.60:43889
I20250830 07:54:29.588230 13536 heartbeater.cc:461] Registering TS with master...
I20250830 07:54:29.588689 13536 heartbeater.cc:507] Master 127.12.209.60:43889 requested a full tablet report, sending...
I20250830 07:54:29.588944 13538 heartbeater.cc:344] Connected to a master server at 127.12.209.61:44241
I20250830 07:54:29.589068 13538 heartbeater.cc:461] Registering TS with master...
I20250830 07:54:29.589440 13538 heartbeater.cc:507] Master 127.12.209.61:44241 requested a full tablet report, sending...
I20250830 07:54:29.589776 13162 ts_manager.cc:194] Registered new tserver with Master: 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
I20250830 07:54:29.590559 13305 ts_manager.cc:194] Registered new tserver with Master: 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
I20250830 07:54:29.590900 13234 ts_manager.cc:194] Registered new tserver with Master: 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
I20250830 07:54:29.592074 13305 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.12.209.1:55879
W20250830 07:54:29.887617 13546 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20250830 07:54:29.887866 13546 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20250830 07:54:29.888005 13546 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20250830 07:54:29.896099 13546 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20250830 07:54:29.896237 13546 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.209.2
I20250830 07:54:29.905767 13546 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.209.20:33943
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--raft_heartbeat_interval_ms=1000
--fs_data_dirs=/tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.209.2:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.209.2
--webserver_port=0
--heartbeat_interval_ms=500
--heartbeat_max_failures_before_backoff=1
--heartbeat_rpc_timeout_ms=1000
--tserver_master_addrs=127.12.209.62:39725,127.12.209.61:44241,127.12.209.60:43889
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.209.2
--log_dir=/tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 06466b25e294b4d7d455e6c56263318dc34a80ef
build type FASTDEBUG
built by None at 30 Aug 2025 07:43:23 UTC on 24a791456cd2
build id 7812
ASAN enabled
I20250830 07:54:29.907199 13546 env_posix.cc:2264] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20250830 07:54:29.908834 13546 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20250830 07:54:29.917264 13554 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250830 07:54:29.917164 13552 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250830 07:54:29.917236 13551 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20250830 07:54:29.918190 13546 server_base.cc:1047] running on GCE node
I20250830 07:54:29.918675 13546 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20250830 07:54:29.922580 13546 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20250830 07:54:29.924299 13546 hybrid_clock.cc:648] HybridClock initialized: now 1756540469923722 us; error 46 us; skew 500 ppm
I20250830 07:54:29.924592 13546 server_base.cc:847] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20250830 07:54:29.926591 13546 webserver.cc:480] Webserver started at http://127.12.209.2:41657/ using document root <none> and password file <none>
I20250830 07:54:29.927286 13546 fs_manager.cc:362] Metadata directory not provided
I20250830 07:54:29.927392 13546 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20250830 07:54:29.927697 13546 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20250830 07:54:29.929805 13546 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/ts-1/data/instance:
uuid: "6b5e454d98894637b466ea27f1b647f9"
format_stamp: "Formatted at 2025-08-30 07:54:29 on dist-test-slave-g8n5"
I20250830 07:54:29.930473 13546 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/ts-1/wal/instance:
uuid: "6b5e454d98894637b466ea27f1b647f9"
format_stamp: "Formatted at 2025-08-30 07:54:29 on dist-test-slave-g8n5"
I20250830 07:54:29.935039 13546 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.007s sys 0.000s
I20250830 07:54:29.938273 13560 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20250830 07:54:29.939433 13546 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20250830 07:54:29.939558 13546 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/ts-1/data,/tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/ts-1/wal
uuid: "6b5e454d98894637b466ea27f1b647f9"
format_stamp: "Formatted at 2025-08-30 07:54:29 on dist-test-slave-g8n5"
I20250830 07:54:29.939718 13546 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20250830 07:54:29.964659 13546 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20250830 07:54:29.965375 13546 env_posix.cc:2264] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20250830 07:54:29.965608 13546 kserver.cc:163] Server-wide thread pool size limit: 3276
I20250830 07:54:29.966339 13546 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20250830 07:54:29.967806 13546 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20250830 07:54:29.967898 13546 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20250830 07:54:29.968003 13546 ts_tablet_manager.cc:610] Registered 0 tablets
I20250830 07:54:29.968075 13546 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20250830 07:54:29.969870 13568 raft_consensus.cc:491] T 00000000000000000000000000000000 P fea6152429cc4e79a25b18e02aafae57 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3ea183a890b84f408b20b55e9eb7c7ed)
I20250830 07:54:29.969996 13568 raft_consensus.cc:513] T 00000000000000000000000000000000 P fea6152429cc4e79a25b18e02aafae57 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fea6152429cc4e79a25b18e02aafae57" member_type: VOTER last_known_addr { host: "127.12.209.62" port: 39725 } } peers { permanent_uuid: "5e9d6449ae824acab24c459a72075e88" member_type: VOTER last_known_addr { host: "127.12.209.61" port: 44241 } } peers { permanent_uuid: "3ea183a890b84f408b20b55e9eb7c7ed" member_type: VOTER last_known_addr { host: "127.12.209.60" port: 43889 } }
I20250830 07:54:29.970600 13568 leader_election.cc:290] T 00000000000000000000000000000000 P fea6152429cc4e79a25b18e02aafae57 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e9d6449ae824acab24c459a72075e88 (127.12.209.61:44241), 3ea183a890b84f408b20b55e9eb7c7ed (127.12.209.60:43889)
I20250830 07:54:29.971084 13244 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "fea6152429cc4e79a25b18e02aafae57" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5e9d6449ae824acab24c459a72075e88" is_pre_election: true
I20250830 07:54:29.971210 13314 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "fea6152429cc4e79a25b18e02aafae57" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3ea183a890b84f408b20b55e9eb7c7ed" is_pre_election: true
I20250830 07:54:29.971660 13148 leader_election.cc:304] T 00000000000000000000000000000000 P fea6152429cc4e79a25b18e02aafae57 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fea6152429cc4e79a25b18e02aafae57; no voters: 3ea183a890b84f408b20b55e9eb7c7ed, 5e9d6449ae824acab24c459a72075e88
I20250830 07:54:29.971874 13568 raft_consensus.cc:2747] T 00000000000000000000000000000000 P fea6152429cc4e79a25b18e02aafae57 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20250830 07:54:30.002274 13546 rpc_server.cc:307] RPC server started. Bound to: 127.12.209.2:38967
I20250830 07:54:30.002393 13673 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.12.209.2:38967 every 8 connection(s)
I20250830 07:54:30.003751 13546 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/ts-1/data/info.pb
I20250830 07:54:30.008374 13124 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskbivBUj/build/asan/bin/kudu as pid 13546
I20250830 07:54:30.008605 13124 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/ts-1/wal/instance
I20250830 07:54:30.018635 13124 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskbivBUj/build/asan/bin/kudu
/tmp/dist-test-taskbivBUj/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.209.3:0
--local_ip_for_outbound_sockets=127.12.209.3
--webserver_interface=127.12.209.3
--webserver_port=0
--tserver_master_addrs=127.12.209.62:39725,127.12.209.61:44241,127.12.209.60:43889
--builtin_ntp_servers=127.12.209.20:33943
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--raft_heartbeat_interval_ms=1000
--heartbeat_rpc_timeout_ms=1000
--heartbeat_max_failures_before_backoff=1
--heartbeat_interval_ms=500 with env {}
I20250830 07:54:30.029672 13676 heartbeater.cc:344] Connected to a master server at 127.12.209.61:44241
I20250830 07:54:30.029757 13674 heartbeater.cc:344] Connected to a master server at 127.12.209.60:43889
I20250830 07:54:30.030010 13674 heartbeater.cc:461] Registering TS with master...
I20250830 07:54:30.030059 13675 heartbeater.cc:344] Connected to a master server at 127.12.209.62:39725
I20250830 07:54:30.030015 13676 heartbeater.cc:461] Registering TS with master...
I20250830 07:54:30.030182 13675 heartbeater.cc:461] Registering TS with master...
I20250830 07:54:30.030953 13674 heartbeater.cc:507] Master 127.12.209.60:43889 requested a full tablet report, sending...
I20250830 07:54:30.031823 13675 heartbeater.cc:507] Master 127.12.209.62:39725 requested a full tablet report, sending...
I20250830 07:54:30.031875 13676 heartbeater.cc:507] Master 127.12.209.61:44241 requested a full tablet report, sending...
I20250830 07:54:30.032599 13305 ts_manager.cc:194] Registered new tserver with Master: 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967)
I20250830 07:54:30.032900 13234 ts_manager.cc:194] Registered new tserver with Master: 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967)
I20250830 07:54:30.033574 13305 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.12.209.2:49929
I20250830 07:54:30.034531 13162 ts_manager.cc:194] Registered new tserver with Master: 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967)
I20250830 07:54:30.035848 13682 raft_consensus.cc:491] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3ea183a890b84f408b20b55e9eb7c7ed)
I20250830 07:54:30.035995 13682 raft_consensus.cc:513] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fea6152429cc4e79a25b18e02aafae57" member_type: VOTER last_known_addr { host: "127.12.209.62" port: 39725 } } peers { permanent_uuid: "5e9d6449ae824acab24c459a72075e88" member_type: VOTER last_known_addr { host: "127.12.209.61" port: 44241 } } peers { permanent_uuid: "3ea183a890b84f408b20b55e9eb7c7ed" member_type: VOTER last_known_addr { host: "127.12.209.60" port: 43889 } }
I20250830 07:54:30.036530 13682 leader_election.cc:290] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fea6152429cc4e79a25b18e02aafae57 (127.12.209.62:39725), 3ea183a890b84f408b20b55e9eb7c7ed (127.12.209.60:43889)
I20250830 07:54:30.036868 13173 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "5e9d6449ae824acab24c459a72075e88" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fea6152429cc4e79a25b18e02aafae57" is_pre_election: true
I20250830 07:54:30.037065 13173 raft_consensus.cc:2466] T 00000000000000000000000000000000 P fea6152429cc4e79a25b18e02aafae57 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d6449ae824acab24c459a72075e88 in term 1.
I20250830 07:54:30.037423 13314 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "5e9d6449ae824acab24c459a72075e88" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3ea183a890b84f408b20b55e9eb7c7ed" is_pre_election: true
I20250830 07:54:30.037541 13221 leader_election.cc:304] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d6449ae824acab24c459a72075e88, fea6152429cc4e79a25b18e02aafae57; no voters:
I20250830 07:54:30.038105 13682 raft_consensus.cc:2802] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20250830 07:54:30.038210 13682 raft_consensus.cc:491] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 3ea183a890b84f408b20b55e9eb7c7ed)
I20250830 07:54:30.038314 13682 raft_consensus.cc:3058] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88 [term 1 FOLLOWER]: Advancing to term 2
I20250830 07:54:30.040172 13682 raft_consensus.cc:513] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fea6152429cc4e79a25b18e02aafae57" member_type: VOTER last_known_addr { host: "127.12.209.62" port: 39725 } } peers { permanent_uuid: "5e9d6449ae824acab24c459a72075e88" member_type: VOTER last_known_addr { host: "127.12.209.61" port: 44241 } } peers { permanent_uuid: "3ea183a890b84f408b20b55e9eb7c7ed" member_type: VOTER last_known_addr { host: "127.12.209.60" port: 43889 } }
I20250830 07:54:30.040679 13682 leader_election.cc:290] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88 [CANDIDATE]: Term 2 election: Requested vote from peers fea6152429cc4e79a25b18e02aafae57 (127.12.209.62:39725), 3ea183a890b84f408b20b55e9eb7c7ed (127.12.209.60:43889)
I20250830 07:54:30.040968 13173 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "5e9d6449ae824acab24c459a72075e88" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fea6152429cc4e79a25b18e02aafae57"
I20250830 07:54:30.041164 13173 raft_consensus.cc:3058] T 00000000000000000000000000000000 P fea6152429cc4e79a25b18e02aafae57 [term 1 FOLLOWER]: Advancing to term 2
I20250830 07:54:30.041175 13314 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "5e9d6449ae824acab24c459a72075e88" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3ea183a890b84f408b20b55e9eb7c7ed"
I20250830 07:54:30.042824 13173 raft_consensus.cc:2466] T 00000000000000000000000000000000 P fea6152429cc4e79a25b18e02aafae57 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e9d6449ae824acab24c459a72075e88 in term 2.
I20250830 07:54:30.043184 13221 leader_election.cc:304] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e9d6449ae824acab24c459a72075e88, fea6152429cc4e79a25b18e02aafae57; no voters: 3ea183a890b84f408b20b55e9eb7c7ed
I20250830 07:54:30.043462 13682 raft_consensus.cc:2802] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88 [term 2 FOLLOWER]: Leader election won for term 2
I20250830 07:54:30.043876 13682 raft_consensus.cc:695] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88 [term 2 LEADER]: Becoming Leader. State: Replica: 5e9d6449ae824acab24c459a72075e88, State: Running, Role: LEADER
I20250830 07:54:30.044395 13682 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fea6152429cc4e79a25b18e02aafae57" member_type: VOTER last_known_addr { host: "127.12.209.62" port: 39725 } } peers { permanent_uuid: "5e9d6449ae824acab24c459a72075e88" member_type: VOTER last_known_addr { host: "127.12.209.61" port: 44241 } } peers { permanent_uuid: "3ea183a890b84f408b20b55e9eb7c7ed" member_type: VOTER last_known_addr { host: "127.12.209.60" port: 43889 } }
I20250830 07:54:30.046101 13244 raft_consensus.cc:1238] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88 [term 2 LEADER]: Rejecting Update request from peer 3ea183a890b84f408b20b55e9eb7c7ed for earlier term 1. Current term is 2. Ops: []
I20250830 07:54:30.046164 13683 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5e9d6449ae824acab24c459a72075e88. Latest consensus state: current_term: 2 leader_uuid: "5e9d6449ae824acab24c459a72075e88" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fea6152429cc4e79a25b18e02aafae57" member_type: VOTER last_known_addr { host: "127.12.209.62" port: 39725 } } peers { permanent_uuid: "5e9d6449ae824acab24c459a72075e88" member_type: VOTER last_known_addr { host: "127.12.209.61" port: 44241 } } peers { permanent_uuid: "3ea183a890b84f408b20b55e9eb7c7ed" member_type: VOTER last_known_addr { host: "127.12.209.60" port: 43889 } } }
I20250830 07:54:30.046425 13683 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88 [sys.catalog]: This master's current role is: LEADER
I20250830 07:54:30.047104 13685 catalog_manager.cc:1477] Loading table and tablet metadata into memory...
I20250830 07:54:30.047317 13534 consensus_queue.cc:1046] T 00000000000000000000000000000000 P 3ea183a890b84f408b20b55e9eb7c7ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e9d6449ae824acab24c459a72075e88" member_type: VOTER last_known_addr { host: "127.12.209.61" port: 44241 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20250830 07:54:30.049974 13685 catalog_manager.cc:1486] Initializing Kudu cluster ID...
I20250830 07:54:30.051148 13534 consensus_queue.cc:1230] T 00000000000000000000000000000000 P 3ea183a890b84f408b20b55e9eb7c7ed [LEADER]: Peer 5e9d6449ae824acab24c459a72075e88 log is divergent from this leader: its last log entry 2.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20250830 07:54:30.051388 13686 raft_consensus.cc:3053] T 00000000000000000000000000000000 P 3ea183a890b84f408b20b55e9eb7c7ed [term 1 LEADER]: Stepping down as leader of term 1
I20250830 07:54:30.051484 13686 raft_consensus.cc:738] T 00000000000000000000000000000000 P 3ea183a890b84f408b20b55e9eb7c7ed [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3ea183a890b84f408b20b55e9eb7c7ed, State: Running, Role: LEADER
I20250830 07:54:30.051753 13685 catalog_manager.cc:1261] Loaded cluster ID: 90fa2c64725e4c7399db393bcf7c431d
I20250830 07:54:30.051868 13685 catalog_manager.cc:1497] Initializing Kudu internal certificate authority...
I20250830 07:54:30.051810 13686 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3ea183a890b84f408b20b55e9eb7c7ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fea6152429cc4e79a25b18e02aafae57" member_type: VOTER last_known_addr { host: "127.12.209.62" port: 39725 } } peers { permanent_uuid: "5e9d6449ae824acab24c459a72075e88" member_type: VOTER last_known_addr { host: "127.12.209.61" port: 44241 } } peers { permanent_uuid: "3ea183a890b84f408b20b55e9eb7c7ed" member_type: VOTER last_known_addr { host: "127.12.209.60" port: 43889 } }
I20250830 07:54:30.052275 13686 raft_consensus.cc:3058] T 00000000000000000000000000000000 P 3ea183a890b84f408b20b55e9eb7c7ed [term 1 FOLLOWER]: Advancing to term 2
I20250830 07:54:30.052912 13685 catalog_manager.cc:1506] Loading token signing keys...
I20250830 07:54:30.053610 13685 catalog_manager.cc:5966] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Loaded TSK: 0
I20250830 07:54:30.054311 13685 catalog_manager.cc:1516] Initializing in-progress tserver states...
I20250830 07:54:30.059579 13373 catalog_manager.cc:1604] T 00000000000000000000000000000000 P 3ea183a890b84f408b20b55e9eb7c7ed: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20250830 07:54:30.094066 13536 heartbeater.cc:499] Master 127.12.209.60:43889 was elected leader, sending a full tablet report...
W20250830 07:54:30.344034 13681 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20250830 07:54:30.344280 13681 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20250830 07:54:30.344403 13681 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20250830 07:54:30.352022 13681 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20250830 07:54:30.352213 13681 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.209.3
I20250830 07:54:30.361006 13681 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.209.20:33943
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--raft_heartbeat_interval_ms=1000
--fs_data_dirs=/tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/ts-2/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.209.3:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.209.3
--webserver_port=0
--heartbeat_interval_ms=500
--heartbeat_max_failures_before_backoff=1
--heartbeat_rpc_timeout_ms=1000
--tserver_master_addrs=127.12.209.62:39725,127.12.209.61:44241,127.12.209.60:43889
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.209.3
--log_dir=/tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 06466b25e294b4d7d455e6c56263318dc34a80ef
build type FASTDEBUG
built by None at 30 Aug 2025 07:43:23 UTC on 24a791456cd2
build id 7812
ASAN enabled
I20250830 07:54:30.362375 13681 env_posix.cc:2264] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20250830 07:54:30.363950 13681 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20250830 07:54:30.372570 13692 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250830 07:54:30.372670 13691 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250830 07:54:30.372926 13694 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20250830 07:54:30.373327 13681 server_base.cc:1047] running on GCE node
I20250830 07:54:30.373828 13681 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20250830 07:54:30.375283 13681 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20250830 07:54:30.376489 13681 hybrid_clock.cc:648] HybridClock initialized: now 1756540470376424 us; error 86 us; skew 500 ppm
I20250830 07:54:30.376711 13681 server_base.cc:847] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20250830 07:54:30.378639 13681 webserver.cc:480] Webserver started at http://127.12.209.3:45251/ using document root <none> and password file <none>
I20250830 07:54:30.379305 13681 fs_manager.cc:362] Metadata directory not provided
I20250830 07:54:30.379415 13681 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20250830 07:54:30.379690 13681 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20250830 07:54:30.381688 13681 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/ts-2/data/instance:
uuid: "9b057ade5dce45af9f8bf0bedf8b917f"
format_stamp: "Formatted at 2025-08-30 07:54:30 on dist-test-slave-g8n5"
I20250830 07:54:30.382320 13681 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/ts-2/wal/instance:
uuid: "9b057ade5dce45af9f8bf0bedf8b917f"
format_stamp: "Formatted at 2025-08-30 07:54:30 on dist-test-slave-g8n5"
I20250830 07:54:30.386981 13681 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.004s sys 0.004s
I20250830 07:54:30.389973 13700 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20250830 07:54:30.391144 13681 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20250830 07:54:30.391283 13681 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/ts-2/data,/tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/ts-2/wal
uuid: "9b057ade5dce45af9f8bf0bedf8b917f"
format_stamp: "Formatted at 2025-08-30 07:54:30 on dist-test-slave-g8n5"
I20250830 07:54:30.391467 13681 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20250830 07:54:30.437570 13314 raft_consensus.cc:1273] T 00000000000000000000000000000000 P 3ea183a890b84f408b20b55e9eb7c7ed [term 2 FOLLOWER]: Refusing update from remote peer 5e9d6449ae824acab24c459a72075e88: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20250830 07:54:30.438252 13683 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ea183a890b84f408b20b55e9eb7c7ed" member_type: VOTER last_known_addr { host: "127.12.209.60" port: 43889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20250830 07:54:30.438863 13681 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20250830 07:54:30.439661 13681 env_posix.cc:2264] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20250830 07:54:30.439903 13681 kserver.cc:163] Server-wide thread pool size limit: 3276
I20250830 07:54:30.440209 13686 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3ea183a890b84f408b20b55e9eb7c7ed [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5e9d6449ae824acab24c459a72075e88. Latest consensus state: current_term: 2 leader_uuid: "5e9d6449ae824acab24c459a72075e88" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fea6152429cc4e79a25b18e02aafae57" member_type: VOTER last_known_addr { host: "127.12.209.62" port: 39725 } } peers { permanent_uuid: "5e9d6449ae824acab24c459a72075e88" member_type: VOTER last_known_addr { host: "127.12.209.61" port: 44241 } } peers { permanent_uuid: "3ea183a890b84f408b20b55e9eb7c7ed" member_type: VOTER last_known_addr { host: "127.12.209.60" port: 43889 } } }
I20250830 07:54:30.440416 13686 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3ea183a890b84f408b20b55e9eb7c7ed [sys.catalog]: This master's current role is: FOLLOWER
I20250830 07:54:30.440917 13681 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20250830 07:54:30.442770 13686 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3ea183a890b84f408b20b55e9eb7c7ed [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 2 leader_uuid: "5e9d6449ae824acab24c459a72075e88" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fea6152429cc4e79a25b18e02aafae57" member_type: VOTER last_known_addr { host: "127.12.209.62" port: 39725 } } peers { permanent_uuid: "5e9d6449ae824acab24c459a72075e88" member_type: VOTER last_known_addr { host: "127.12.209.61" port: 44241 } } peers { permanent_uuid: "3ea183a890b84f408b20b55e9eb7c7ed" member_type: VOTER last_known_addr { host: "127.12.209.60" port: 43889 } } }
I20250830 07:54:30.442961 13686 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3ea183a890b84f408b20b55e9eb7c7ed [sys.catalog]: This master's current role is: FOLLOWER
I20250830 07:54:30.442991 13681 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20250830 07:54:30.443081 13681 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20250830 07:54:30.443166 13681 ts_tablet_manager.cc:610] Registered 0 tablets
I20250830 07:54:30.443234 13681 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20250830 07:54:30.451095 13173 raft_consensus.cc:1273] T 00000000000000000000000000000000 P fea6152429cc4e79a25b18e02aafae57 [term 2 FOLLOWER]: Refusing update from remote peer 5e9d6449ae824acab24c459a72075e88: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20250830 07:54:30.451610 13682 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 2 leader_uuid: "5e9d6449ae824acab24c459a72075e88" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fea6152429cc4e79a25b18e02aafae57" member_type: VOTER last_known_addr { host: "127.12.209.62" port: 39725 } } peers { permanent_uuid: "5e9d6449ae824acab24c459a72075e88" member_type: VOTER last_known_addr { host: "127.12.209.61" port: 44241 } } peers { permanent_uuid: "3ea183a890b84f408b20b55e9eb7c7ed" member_type: VOTER last_known_addr { host: "127.12.209.60" port: 43889 } } }
I20250830 07:54:30.451807 13682 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88 [sys.catalog]: This master's current role is: LEADER
I20250830 07:54:30.451881 13715 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fea6152429cc4e79a25b18e02aafae57" member_type: VOTER last_known_addr { host: "127.12.209.62" port: 39725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20250830 07:54:30.459722 13568 sys_catalog.cc:455] T 00000000000000000000000000000000 P fea6152429cc4e79a25b18e02aafae57 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5e9d6449ae824acab24c459a72075e88. Latest consensus state: current_term: 2 leader_uuid: "5e9d6449ae824acab24c459a72075e88" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fea6152429cc4e79a25b18e02aafae57" member_type: VOTER last_known_addr { host: "127.12.209.62" port: 39725 } } peers { permanent_uuid: "5e9d6449ae824acab24c459a72075e88" member_type: VOTER last_known_addr { host: "127.12.209.61" port: 44241 } } peers { permanent_uuid: "3ea183a890b84f408b20b55e9eb7c7ed" member_type: VOTER last_known_addr { host: "127.12.209.60" port: 43889 } } }
I20250830 07:54:30.459656 13743 sys_catalog.cc:455] T 00000000000000000000000000000000 P fea6152429cc4e79a25b18e02aafae57 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 2 leader_uuid: "5e9d6449ae824acab24c459a72075e88" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fea6152429cc4e79a25b18e02aafae57" member_type: VOTER last_known_addr { host: "127.12.209.62" port: 39725 } } peers { permanent_uuid: "5e9d6449ae824acab24c459a72075e88" member_type: VOTER last_known_addr { host: "127.12.209.61" port: 44241 } } peers { permanent_uuid: "3ea183a890b84f408b20b55e9eb7c7ed" member_type: VOTER last_known_addr { host: "127.12.209.60" port: 43889 } } }
I20250830 07:54:30.459919 13568 sys_catalog.cc:458] T 00000000000000000000000000000000 P fea6152429cc4e79a25b18e02aafae57 [sys.catalog]: This master's current role is: FOLLOWER
I20250830 07:54:30.459920 13743 sys_catalog.cc:458] T 00000000000000000000000000000000 P fea6152429cc4e79a25b18e02aafae57 [sys.catalog]: This master's current role is: FOLLOWER
I20250830 07:54:30.489418 13681 rpc_server.cc:307] RPC server started. Bound to: 127.12.209.3:38743
I20250830 07:54:30.489481 13819 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.12.209.3:38743 every 8 connection(s)
I20250830 07:54:30.490684 13681 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/ts-2/data/info.pb
I20250830 07:54:30.491120 13124 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskbivBUj/build/asan/bin/kudu as pid 13681
I20250830 07:54:30.491286 13124 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/ts-2/wal/instance
I20250830 07:54:30.514129 13820 heartbeater.cc:344] Connected to a master server at 127.12.209.60:43889
I20250830 07:54:30.514235 13821 heartbeater.cc:344] Connected to a master server at 127.12.209.62:39725
I20250830 07:54:30.514482 13821 heartbeater.cc:461] Registering TS with master...
I20250830 07:54:30.514479 13820 heartbeater.cc:461] Registering TS with master...
I20250830 07:54:30.514802 13822 heartbeater.cc:344] Connected to a master server at 127.12.209.61:44241
I20250830 07:54:30.514976 13822 heartbeater.cc:461] Registering TS with master...
I20250830 07:54:30.515575 13822 heartbeater.cc:507] Master 127.12.209.61:44241 requested a full tablet report, sending...
I20250830 07:54:30.515609 13820 heartbeater.cc:507] Master 127.12.209.60:43889 requested a full tablet report, sending...
I20250830 07:54:30.516708 13821 heartbeater.cc:507] Master 127.12.209.62:39725 requested a full tablet report, sending...
I20250830 07:54:30.516988 13234 ts_manager.cc:194] Registered new tserver with Master: 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:30.517055 13304 ts_manager.cc:194] Registered new tserver with Master: 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:30.517817 13163 ts_manager.cc:194] Registered new tserver with Master: 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:30.518646 13234 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.12.209.3:49453
I20250830 07:54:30.531919 13124 external_mini_cluster.cc:949] 3 TS(s) registered with all masters
I20250830 07:54:30.535665 13674 heartbeater.cc:499] Master 127.12.209.60:43889 was elected leader, sending a full tablet report...
I20250830 07:54:30.560724 13234 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_31cd493c4fb748a3819bb89f5329aeb8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:30.565523 13234 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_31cd493c4fb748a3819bb89f5329aeb8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:30.567175 13233 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_ccccf5a4891142f6987a843b244b5aa1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:30.568374 13233 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ccccf5a4891142f6987a843b244b5aa1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:30.568439 13231 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_562f9207631b4cb3a8fa27a25714214b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250830 07:54:30.568797 13227 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_d4fb8fef2f424647b0dae8c72425194d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:30.569056 13231 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_562f9207631b4cb3a8fa27a25714214b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250830 07:54:30.569612 13227 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d4fb8fef2f424647b0dae8c72425194d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:30.570209 13232 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_16d30f7ac7b149ee82f6f23408664faa"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250830 07:54:30.570369 13229 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_c08efc3cabba4f1b8cdef4c0895d6bf6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:30.570974 13229 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c08efc3cabba4f1b8cdef4c0895d6bf6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:30.571256 13230 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_ededac6642f941888c1070ed8a1774a7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:30.571810 13230 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ededac6642f941888c1070ed8a1774a7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:30.573405 13226 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_3e1ff871e911493980f552e97dc44ffe"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:30.574195 13226 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3e1ff871e911493980f552e97dc44ffe in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:30.574112 13228 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_a38a4c1d67c94450832256a479ecd6f0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250830 07:54:30.574151 13225 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_f19b73c39afa4dadb01941eade4f380b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:30.570976 13232 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_16d30f7ac7b149ee82f6f23408664faa in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250830 07:54:30.579972 13225 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f19b73c39afa4dadb01941eade4f380b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250830 07:54:30.581950 13228 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a38a4c1d67c94450832256a479ecd6f0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:30.589813 13847 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 2 leader_uuid: "5e9d6449ae824acab24c459a72075e88" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fea6152429cc4e79a25b18e02aafae57" member_type: VOTER last_known_addr { host: "127.12.209.62" port: 39725 } } peers { permanent_uuid: "5e9d6449ae824acab24c459a72075e88" member_type: VOTER last_known_addr { host: "127.12.209.61" port: 44241 } } peers { permanent_uuid: "3ea183a890b84f408b20b55e9eb7c7ed" member_type: VOTER last_known_addr { host: "127.12.209.60" port: 43889 } } }
I20250830 07:54:30.590852 13847 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88 [sys.catalog]: This master's current role is: LEADER
I20250830 07:54:30.593483 13538 heartbeater.cc:499] Master 127.12.209.61:44241 was elected leader, sending a full tablet report...
I20250830 07:54:30.611711 13233 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_562f9207631b4cb3a8fa27a25714214b" } new_table_name: "default.Table_ff52f3bbd91f46538ff26c0933cf8bb8" modify_external_catalogs: true
I20250830 07:54:30.613710 13231 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_ccccf5a4891142f6987a843b244b5aa1" } new_table_name: "default.Table_61aa8ba06da54659b9536cdb947db516" modify_external_catalogs: true
W20250830 07:54:30.657768 13233 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 50360492db824755a6de251436cab5c6 has no consensus state
W20250830 07:54:30.661350 13231 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 1ed2d20b0de14631ad8520f4cbd806c2 has no consensus state
I20250830 07:54:30.672228 13228 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_16d30f7ac7b149ee82f6f23408664faa" } modify_external_catalogs: true
I20250830 07:54:30.672544 13228 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_16d30f7ac7b149ee82f6f23408664faa" } modify_external_catalogs: true
I20250830 07:54:30.673568 13227 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_c08efc3cabba4f1b8cdef4c0895d6bf6" } new_table_name: "default.Table_d4322d6ba16f4c5ca8fceebd12becd8b" modify_external_catalogs: true
I20250830 07:54:30.674455 13226 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_3e1ff871e911493980f552e97dc44ffe" } modify_external_catalogs: true
I20250830 07:54:30.674665 13226 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_3e1ff871e911493980f552e97dc44ffe" } modify_external_catalogs: true
I20250830 07:54:30.675807 13229 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_d4fb8fef2f424647b0dae8c72425194d" } new_table_name: "default.Table_5224b75b4bc74fac9d4499094e8c006f" modify_external_catalogs: true
I20250830 07:54:30.675935 13230 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_ededac6642f941888c1070ed8a1774a7" } new_table_name: "default.Table_0454ed90557f4fac9911aad63bb396f3" modify_external_catalogs: true
I20250830 07:54:30.677515 13225 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_f19b73c39afa4dadb01941eade4f380b" } modify_external_catalogs: true
I20250830 07:54:30.677722 13225 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_f19b73c39afa4dadb01941eade4f380b" } modify_external_catalogs: true
I20250830 07:54:30.679153 13233 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_31cd493c4fb748a3819bb89f5329aeb8" } modify_external_catalogs: true
I20250830 07:54:30.679364 13233 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_31cd493c4fb748a3819bb89f5329aeb8" } modify_external_catalogs: true
I20250830 07:54:30.680684 13232 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_a38a4c1d67c94450832256a479ecd6f0" } modify_external_catalogs: true
I20250830 07:54:30.680891 13232 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_a38a4c1d67c94450832256a479ecd6f0" } modify_external_catalogs: true
I20250830 07:54:30.694197 13226 catalog_manager.cc:5864] Not sending DeleteTablet requests; no consensus state for tablet bd5f5b6a1586473d80233f5653ded646
I20250830 07:54:30.694516 13228 catalog_manager.cc:5864] Not sending DeleteTablet requests; no consensus state for tablet 8126b226ebe5472ebb6914399a4077c9
W20250830 07:54:30.694831 13227 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d0368ce5ffbd48dca5a6674f65f34ce4 has no consensus state
W20250830 07:54:30.694939 13229 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 9a0c96916f1d4680b8a04d97091384e9 has no consensus state
W20250830 07:54:30.695937 13220 catalog_manager.cc:4726] Async tablet task AlterTable RPC for tablet 50360492db824755a6de251436cab5c6 (table default.Table_ff52f3bbd91f46538ff26c0933cf8bb8 [id=b3a33553134d4583a4fd9ff4f08a2ed8], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 50360492db824755a6de251436cab5c6 consensus state has no leader
I20250830 07:54:30.698678 13225 catalog_manager.cc:5864] Not sending DeleteTablet requests; no consensus state for tablet ff880db817b544afb63db1804f2e173a
I20250830 07:54:30.699034 13233 catalog_manager.cc:5864] Not sending DeleteTablet requests; no consensus state for tablet 70a8d65479844275bba7449cedebeb17
I20250830 07:54:30.699415 13232 catalog_manager.cc:5864] Not sending DeleteTablet requests; no consensus state for tablet 57e53c968393490eba3d1730490d8632
W20250830 07:54:30.701844 13230 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 050e72b96c2d479896b3a54d85e6f6dd has no consensus state
I20250830 07:54:30.738844 13609 tablet_service.cc:1468] Processing CreateTablet for tablet 50360492db824755a6de251436cab5c6 (DEFAULT_TABLE table=default.Table_ff52f3bbd91f46538ff26c0933cf8bb8 [id=b3a33553134d4583a4fd9ff4f08a2ed8]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:30.742210 13609 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 50360492db824755a6de251436cab5c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:30.743675 13755 tablet_service.cc:1468] Processing CreateTablet for tablet 50360492db824755a6de251436cab5c6 (DEFAULT_TABLE table=default.Table_ff52f3bbd91f46538ff26c0933cf8bb8 [id=b3a33553134d4583a4fd9ff4f08a2ed8]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:30.745026 13755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 50360492db824755a6de251436cab5c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:30.745617 13754 tablet_service.cc:1468] Processing CreateTablet for tablet 1ed2d20b0de14631ad8520f4cbd806c2 (DEFAULT_TABLE table=default.Table_61aa8ba06da54659b9536cdb947db516 [id=903638fdb4e845769c8092fb6f5bead4]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:30.746206 13753 tablet_service.cc:1468] Processing CreateTablet for tablet 9a0c96916f1d4680b8a04d97091384e9 (DEFAULT_TABLE table=default.Table_5224b75b4bc74fac9d4499094e8c006f [id=fa1e5610a0034475a7e35699dd9bacf7]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:30.740716 13605 tablet_service.cc:1468] Processing CreateTablet for tablet 050e72b96c2d479896b3a54d85e6f6dd (DEFAULT_TABLE table=default.Table_0454ed90557f4fac9911aad63bb396f3 [id=d2dbb756d66b483ebe44d45ddfa5c17c]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:30.747262 13605 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 050e72b96c2d479896b3a54d85e6f6dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:30.747481 13752 tablet_service.cc:1468] Processing CreateTablet for tablet d0368ce5ffbd48dca5a6674f65f34ce4 (DEFAULT_TABLE table=default.Table_d4322d6ba16f4c5ca8fceebd12becd8b [id=1b7c141ed8af4dcab20683653fd59ee1]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:30.748066 13751 tablet_service.cc:1468] Processing CreateTablet for tablet 050e72b96c2d479896b3a54d85e6f6dd (DEFAULT_TABLE table=default.Table_0454ed90557f4fac9911aad63bb396f3 [id=d2dbb756d66b483ebe44d45ddfa5c17c]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:30.748878 13468 tablet_service.cc:1468] Processing CreateTablet for tablet 50360492db824755a6de251436cab5c6 (DEFAULT_TABLE table=default.Table_ff52f3bbd91f46538ff26c0933cf8bb8 [id=b3a33553134d4583a4fd9ff4f08a2ed8]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:30.749383 13465 tablet_service.cc:1468] Processing CreateTablet for tablet d0368ce5ffbd48dca5a6674f65f34ce4 (DEFAULT_TABLE table=default.Table_d4322d6ba16f4c5ca8fceebd12becd8b [id=1b7c141ed8af4dcab20683653fd59ee1]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:30.748600 13467 tablet_service.cc:1468] Processing CreateTablet for tablet 1ed2d20b0de14631ad8520f4cbd806c2 (DEFAULT_TABLE table=default.Table_61aa8ba06da54659b9536cdb947db516 [id=903638fdb4e845769c8092fb6f5bead4]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:30.750061 13468 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 50360492db824755a6de251436cab5c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:30.750519 13467 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ed2d20b0de14631ad8520f4cbd806c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:30.751124 13465 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0368ce5ffbd48dca5a6674f65f34ce4. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:30.751332 13466 tablet_service.cc:1468] Processing CreateTablet for tablet 9a0c96916f1d4680b8a04d97091384e9 (DEFAULT_TABLE table=default.Table_5224b75b4bc74fac9d4499094e8c006f [id=fa1e5610a0034475a7e35699dd9bacf7]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:30.751813 13466 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a0c96916f1d4680b8a04d97091384e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:30.755240 13464 tablet_service.cc:1468] Processing CreateTablet for tablet 050e72b96c2d479896b3a54d85e6f6dd (DEFAULT_TABLE table=default.Table_0454ed90557f4fac9911aad63bb396f3 [id=d2dbb756d66b483ebe44d45ddfa5c17c]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:30.755693 13464 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 050e72b96c2d479896b3a54d85e6f6dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:30.739915 13606 tablet_service.cc:1468] Processing CreateTablet for tablet d0368ce5ffbd48dca5a6674f65f34ce4 (DEFAULT_TABLE table=default.Table_d4322d6ba16f4c5ca8fceebd12becd8b [id=1b7c141ed8af4dcab20683653fd59ee1]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:30.757846 13606 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0368ce5ffbd48dca5a6674f65f34ce4. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:30.739601 13607 tablet_service.cc:1468] Processing CreateTablet for tablet 9a0c96916f1d4680b8a04d97091384e9 (DEFAULT_TABLE table=default.Table_5224b75b4bc74fac9d4499094e8c006f [id=fa1e5610a0034475a7e35699dd9bacf7]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:30.760118 13607 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a0c96916f1d4680b8a04d97091384e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:30.739264 13608 tablet_service.cc:1468] Processing CreateTablet for tablet 1ed2d20b0de14631ad8520f4cbd806c2 (DEFAULT_TABLE table=default.Table_61aa8ba06da54659b9536cdb947db516 [id=903638fdb4e845769c8092fb6f5bead4]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:30.763513 13608 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ed2d20b0de14631ad8520f4cbd806c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:30.770171 13754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ed2d20b0de14631ad8520f4cbd806c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:30.770510 13751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 050e72b96c2d479896b3a54d85e6f6dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:30.775123 13753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a0c96916f1d4680b8a04d97091384e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:30.776501 13752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0368ce5ffbd48dca5a6674f65f34ce4. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:30.798164 13230 master_service.cc:948] ReplaceTablet: received request to replace tablet 50360492db824755a6de251436cab5c6 from {username='slave'} at 127.0.0.1:42126
I20250830 07:54:30.800602 13232 master_service.cc:948] ReplaceTablet: received request to replace tablet 50360492db824755a6de251436cab5c6 from {username='slave'} at 127.0.0.1:42126
I20250830 07:54:30.802400 13233 master_service.cc:948] ReplaceTablet: received request to replace tablet 050e72b96c2d479896b3a54d85e6f6dd from {username='slave'} at 127.0.0.1:42126
I20250830 07:54:30.803408 13225 master_service.cc:948] ReplaceTablet: received request to replace tablet 050e72b96c2d479896b3a54d85e6f6dd from {username='slave'} at 127.0.0.1:42126
I20250830 07:54:30.805727 13227 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_13af3c7a57c44819a700083ac56fec5b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250830 07:54:30.805920 13229 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_fa4deee864594a2aa4987b24ae8e7c97"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:30.806367 13227 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_13af3c7a57c44819a700083ac56fec5b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250830 07:54:30.806442 13229 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fa4deee864594a2aa4987b24ae8e7c97 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:30.808502 13230 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet 50360492db824755a6de251436cab5c6
I20250830 07:54:30.809175 13230 catalog_manager.cc:6652] ReplaceTablet: tablet 50360492db824755a6de251436cab5c6 deleted and replaced by tablet ff0f9cccc8ed43b1a8cd38de0e9d4097
I20250830 07:54:30.809439 13608 tablet_service.cc:1515] Processing DeleteTablet for tablet 50360492db824755a6de251436cab5c6 with delete_type TABLET_DATA_DELETED (replaced by tablet ff0f9cccc8ed43b1a8cd38de0e9d4097) from {username='slave'} at 127.0.0.1:45306
I20250830 07:54:30.810019 13463 tablet_service.cc:1515] Processing DeleteTablet for tablet 50360492db824755a6de251436cab5c6 with delete_type TABLET_DATA_DELETED (replaced by tablet ff0f9cccc8ed43b1a8cd38de0e9d4097) from {username='slave'} at 127.0.0.1:37956
I20250830 07:54:30.812825 13750 tablet_service.cc:1515] Processing DeleteTablet for tablet 50360492db824755a6de251436cab5c6 with delete_type TABLET_DATA_DELETED (replaced by tablet ff0f9cccc8ed43b1a8cd38de0e9d4097) from {username='slave'} at 127.0.0.1:45460
I20250830 07:54:30.816905 13233 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet 050e72b96c2d479896b3a54d85e6f6dd
I20250830 07:54:30.817394 13233 catalog_manager.cc:6652] ReplaceTablet: tablet 050e72b96c2d479896b3a54d85e6f6dd deleted and replaced by tablet 9e055d6089f541f799eddb5778eb2148
I20250830 07:54:30.818077 13462 tablet_service.cc:1515] Processing DeleteTablet for tablet 050e72b96c2d479896b3a54d85e6f6dd with delete_type TABLET_DATA_DELETED (replaced by tablet 9e055d6089f541f799eddb5778eb2148) from {username='slave'} at 127.0.0.1:37956
I20250830 07:54:30.820441 13753 tablet_service.cc:1515] Processing DeleteTablet for tablet 050e72b96c2d479896b3a54d85e6f6dd with delete_type TABLET_DATA_DELETED (replaced by tablet 9e055d6089f541f799eddb5778eb2148) from {username='slave'} at 127.0.0.1:45460
I20250830 07:54:30.821512 13607 tablet_service.cc:1515] Processing DeleteTablet for tablet 050e72b96c2d479896b3a54d85e6f6dd with delete_type TABLET_DATA_DELETED (replaced by tablet 9e055d6089f541f799eddb5778eb2148) from {username='slave'} at 127.0.0.1:45306
I20250830 07:54:30.821907 13887 tablet_bootstrap.cc:492] T 9a0c96916f1d4680b8a04d97091384e9 P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:54:30.828325 13886 tablet_bootstrap.cc:492] T d0368ce5ffbd48dca5a6674f65f34ce4 P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
W20250830 07:54:30.829874 13219 catalog_manager.cc:4908] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): delete failed for tablet 50360492db824755a6de251436cab5c6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 50360492db824755a6de251436cab5c6 already in progress: creating tablet
I20250830 07:54:30.830605 13227 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_8afaf5e0feb749a59e6fef1f639f58c6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:30.831179 13227 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8afaf5e0feb749a59e6fef1f639f58c6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250830 07:54:30.832178 13220 catalog_manager.cc:4908] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet 50360492db824755a6de251436cab5c6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 50360492db824755a6de251436cab5c6 already in progress: creating tablet
W20250830 07:54:30.832500 13219 catalog_manager.cc:4908] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): delete failed for tablet 050e72b96c2d479896b3a54d85e6f6dd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 050e72b96c2d479896b3a54d85e6f6dd already in progress: creating tablet
W20250830 07:54:30.833346 13220 catalog_manager.cc:4908] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet 050e72b96c2d479896b3a54d85e6f6dd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 050e72b96c2d479896b3a54d85e6f6dd already in progress: creating tablet
I20250830 07:54:30.833611 13229 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_0056ec1a2d7541688b41c752533a7509"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250830 07:54:30.833766 13882 tablet_bootstrap.cc:492] T 050e72b96c2d479896b3a54d85e6f6dd P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
W20250830 07:54:30.834158 13229 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0056ec1a2d7541688b41c752533a7509 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250830 07:54:30.836162 13218 catalog_manager.cc:4908] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): delete failed for tablet 50360492db824755a6de251436cab5c6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 50360492db824755a6de251436cab5c6 already in progress: creating tablet
W20250830 07:54:30.836390 13218 catalog_manager.cc:4908] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): delete failed for tablet 050e72b96c2d479896b3a54d85e6f6dd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 050e72b96c2d479896b3a54d85e6f6dd already in progress: creating tablet
I20250830 07:54:30.837205 13882 tablet_bootstrap.cc:654] T 050e72b96c2d479896b3a54d85e6f6dd P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:30.837419 13887 tablet_bootstrap.cc:654] T 9a0c96916f1d4680b8a04d97091384e9 P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:30.838429 13225 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_b30c015c01cb40e3992286109ba71dfe"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250830 07:54:30.838699 13887 log.cc:826] T 9a0c96916f1d4680b8a04d97091384e9 P 2065c332f15a4739899af79f3669c3ba: Log is configured to *not* fsync() on all Append() calls
W20250830 07:54:30.839069 13225 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b30c015c01cb40e3992286109ba71dfe in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:30.841542 13886 tablet_bootstrap.cc:654] T d0368ce5ffbd48dca5a6674f65f34ce4 P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:30.843400 13882 log.cc:826] T 050e72b96c2d479896b3a54d85e6f6dd P 6b5e454d98894637b466ea27f1b647f9: Log is configured to *not* fsync() on all Append() calls
I20250830 07:54:30.843868 13608 tablet_service.cc:1468] Processing CreateTablet for tablet 9e055d6089f541f799eddb5778eb2148 (DEFAULT_TABLE table=default.Table_0454ed90557f4fac9911aad63bb396f3 [id=d2dbb756d66b483ebe44d45ddfa5c17c]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:30.844286 13608 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e055d6089f541f799eddb5778eb2148. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:30.845402 13232 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_8aff78c78ec94d468fe0c40a86496dca"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250830 07:54:30.845583 13750 tablet_service.cc:1468] Processing CreateTablet for tablet ff0f9cccc8ed43b1a8cd38de0e9d4097 (DEFAULT_TABLE table=default.Table_ff52f3bbd91f46538ff26c0933cf8bb8 [id=b3a33553134d4583a4fd9ff4f08a2ed8]), partition=RANGE (key) PARTITION UNBOUNDED
W20250830 07:54:30.845912 13232 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8aff78c78ec94d468fe0c40a86496dca in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:30.846128 13750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff0f9cccc8ed43b1a8cd38de0e9d4097. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:30.847633 13465 tablet_service.cc:1468] Processing CreateTablet for tablet 9e055d6089f541f799eddb5778eb2148 (DEFAULT_TABLE table=default.Table_0454ed90557f4fac9911aad63bb396f3 [id=d2dbb756d66b483ebe44d45ddfa5c17c]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:30.847704 13605 tablet_service.cc:1468] Processing CreateTablet for tablet ff0f9cccc8ed43b1a8cd38de0e9d4097 (DEFAULT_TABLE table=default.Table_ff52f3bbd91f46538ff26c0933cf8bb8 [id=b3a33553134d4583a4fd9ff4f08a2ed8]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:30.847992 13465 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e055d6089f541f799eddb5778eb2148. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:30.847930 13752 tablet_service.cc:1468] Processing CreateTablet for tablet 9e055d6089f541f799eddb5778eb2148 (DEFAULT_TABLE table=default.Table_0454ed90557f4fac9911aad63bb396f3 [id=d2dbb756d66b483ebe44d45ddfa5c17c]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:30.848060 13605 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff0f9cccc8ed43b1a8cd38de0e9d4097. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:30.848284 13752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e055d6089f541f799eddb5778eb2148. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:30.852846 13233 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_ad72ab205d394d6cbb86c3b34381e869"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:30.853240 13233 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ad72ab205d394d6cbb86c3b34381e869 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:30.847643 13463 tablet_service.cc:1468] Processing CreateTablet for tablet ff0f9cccc8ed43b1a8cd38de0e9d4097 (DEFAULT_TABLE table=default.Table_ff52f3bbd91f46538ff26c0933cf8bb8 [id=b3a33553134d4583a4fd9ff4f08a2ed8]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:30.855675 13463 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff0f9cccc8ed43b1a8cd38de0e9d4097. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:30.856783 13230 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_74f3c73d22574737b5f6a4bd256e423d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:30.857210 13230 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_74f3c73d22574737b5f6a4bd256e423d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:30.857457 13887 tablet_bootstrap.cc:492] T 9a0c96916f1d4680b8a04d97091384e9 P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:54:30.857759 13887 ts_tablet_manager.cc:1397] T 9a0c96916f1d4680b8a04d97091384e9 P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.036s user 0.007s sys 0.000s
I20250830 07:54:30.858915 13886 log.cc:826] T d0368ce5ffbd48dca5a6674f65f34ce4 P 9b057ade5dce45af9f8bf0bedf8b917f: Log is configured to *not* fsync() on all Append() calls
I20250830 07:54:30.860641 13228 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_d24e8e2f5130411cacb3241198c3669d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250830 07:54:30.860837 13226 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_5de39b3a49f54e41b06a8178dd641fd8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:30.861057 13228 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d24e8e2f5130411cacb3241198c3669d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250830 07:54:30.861428 13226 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5de39b3a49f54e41b06a8178dd641fd8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:30.863034 13231 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_d4322d6ba16f4c5ca8fceebd12becd8b" } new_table_name: "default.Table_73b4932d2b1249be9861511738a09a91" modify_external_catalogs: true
I20250830 07:54:30.866361 13229 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_61aa8ba06da54659b9536cdb947db516" } new_table_name: "default.Table_8bbc08cd77ea427688c017092c7c6dfe" modify_external_catalogs: true
I20250830 07:54:30.875360 13227 master_service.cc:948] ReplaceTablet: received request to replace tablet 9e055d6089f541f799eddb5778eb2148 from {username='slave'} at 127.0.0.1:42126
I20250830 07:54:30.885303 13124 external_mini_cluster.cc:1699] Attempting to check leaks for /tmp/dist-test-taskbivBUj/build/asan/bin/kudu pid 13272
I20250830 07:54:30.886554 13335 generic_service.cc:196] Checking for leaks (request via RPC)
I20250830 07:54:30.890327 13608 tablet_service.cc:1468] Processing CreateTablet for tablet bf170b1865094ba38ef8568259e34656 (DEFAULT_TABLE table=default.Table_fa4deee864594a2aa4987b24ae8e7c97 [id=2d16cc8010714d9381de323f97abbdca]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:30.890878 13608 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf170b1865094ba38ef8568259e34656. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:30.893523 13465 tablet_service.cc:1468] Processing CreateTablet for tablet bf170b1865094ba38ef8568259e34656 (DEFAULT_TABLE table=default.Table_fa4deee864594a2aa4987b24ae8e7c97 [id=2d16cc8010714d9381de323f97abbdca]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:30.893925 13465 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf170b1865094ba38ef8568259e34656. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:30.894130 13752 tablet_service.cc:1468] Processing CreateTablet for tablet bf170b1865094ba38ef8568259e34656 (DEFAULT_TABLE table=default.Table_fa4deee864594a2aa4987b24ae8e7c97 [id=2d16cc8010714d9381de323f97abbdca]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:30.894279 13751 tablet_service.cc:1468] Processing CreateTablet for tablet b4ab964a64a64e00a78ffd2b220aef46 (DEFAULT_TABLE table=default.Table_13af3c7a57c44819a700083ac56fec5b [id=ff5cff4d10c2454f9bae733a4d31e90c]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:30.894567 13752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf170b1865094ba38ef8568259e34656. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:30.894833 13751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4ab964a64a64e00a78ffd2b220aef46. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:30.895097 13605 tablet_service.cc:1468] Processing CreateTablet for tablet b4ab964a64a64e00a78ffd2b220aef46 (DEFAULT_TABLE table=default.Table_13af3c7a57c44819a700083ac56fec5b [id=ff5cff4d10c2454f9bae733a4d31e90c]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:30.895440 13605 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4ab964a64a64e00a78ffd2b220aef46. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:30.900507 13233 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_13af3c7a57c44819a700083ac56fec5b" } modify_external_catalogs: true
I20250830 07:54:30.900682 13233 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_13af3c7a57c44819a700083ac56fec5b" } modify_external_catalogs: true
I20250830 07:54:30.900735 13232 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_ff52f3bbd91f46538ff26c0933cf8bb8" } modify_external_catalogs: true
I20250830 07:54:30.900938 13232 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_ff52f3bbd91f46538ff26c0933cf8bb8" } modify_external_catalogs: true
I20250830 07:54:30.902474 13230 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_0056ec1a2d7541688b41c752533a7509" } new_table_name: "default.Table_d2ac5bc3c0c246c4bb6c797de6efedae" modify_external_catalogs: true
I20250830 07:54:30.902525 13234 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_8aff78c78ec94d468fe0c40a86496dca" } modify_external_catalogs: true
I20250830 07:54:30.902968 13234 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_8aff78c78ec94d468fe0c40a86496dca" } modify_external_catalogs: true
I20250830 07:54:30.904547 13225 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_ad72ab205d394d6cbb86c3b34381e869" } modify_external_catalogs: true
I20250830 07:54:30.904695 13225 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_ad72ab205d394d6cbb86c3b34381e869" } modify_external_catalogs: true
I20250830 07:54:30.908717 13463 tablet_service.cc:1468] Processing CreateTablet for tablet b4ab964a64a64e00a78ffd2b220aef46 (DEFAULT_TABLE table=default.Table_13af3c7a57c44819a700083ac56fec5b [id=ff5cff4d10c2454f9bae733a4d31e90c]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:30.909082 13463 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4ab964a64a64e00a78ffd2b220aef46. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:30.916879 13226 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_8afaf5e0feb749a59e6fef1f639f58c6" } modify_external_catalogs: true
I20250830 07:54:30.917093 13226 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_8afaf5e0feb749a59e6fef1f639f58c6" } modify_external_catalogs: true
W20250830 07:54:30.917678 13231 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d0368ce5ffbd48dca5a6674f65f34ce4 consensus state has no leader
I20250830 07:54:30.918140 13231 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_5224b75b4bc74fac9d4499094e8c006f" } new_table_name: "default.Table_72cd09b09afe4d318eea1f0371c4e823" modify_external_catalogs: true
W20250830 07:54:30.920516 13229 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 1ed2d20b0de14631ad8520f4cbd806c2 consensus state has no leader
I20250830 07:54:30.920929 13229 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_0454ed90557f4fac9911aad63bb396f3" } new_table_name: "default.Table_384b195b26da40b781813278ef6a8645" modify_external_catalogs: true
I20250830 07:54:30.931862 13887 raft_consensus.cc:357] T 9a0c96916f1d4680b8a04d97091384e9 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:30.934728 13887 raft_consensus.cc:383] T 9a0c96916f1d4680b8a04d97091384e9 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:30.934952 13887 raft_consensus.cc:738] T 9a0c96916f1d4680b8a04d97091384e9 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:54:30.935880 13882 tablet_bootstrap.cc:492] T 050e72b96c2d479896b3a54d85e6f6dd P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:54:30.936309 13882 ts_tablet_manager.cc:1397] T 050e72b96c2d479896b3a54d85e6f6dd P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.103s user 0.008s sys 0.003s
I20250830 07:54:30.937424 13887 consensus_queue.cc:260] T 9a0c96916f1d4680b8a04d97091384e9 P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:30.945487 13887 ts_tablet_manager.cc:1428] T 9a0c96916f1d4680b8a04d97091384e9 P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.088s user 0.010s sys 0.004s
I20250830 07:54:30.945837 13227 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet 9e055d6089f541f799eddb5778eb2148
I20250830 07:54:30.945928 13887 tablet_bootstrap.cc:492] T 050e72b96c2d479896b3a54d85e6f6dd P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:54:30.946354 13227 catalog_manager.cc:6652] ReplaceTablet: tablet 9e055d6089f541f799eddb5778eb2148 deleted and replaced by tablet 4d4b00bdadb24ec892d87c9be2ed7dd9
I20250830 07:54:30.946631 13608 tablet_service.cc:1515] Processing DeleteTablet for tablet 9e055d6089f541f799eddb5778eb2148 with delete_type TABLET_DATA_DELETED (replaced by tablet 4d4b00bdadb24ec892d87c9be2ed7dd9) from {username='slave'} at 127.0.0.1:45306
I20250830 07:54:30.947238 13750 tablet_service.cc:1515] Processing DeleteTablet for tablet 9e055d6089f541f799eddb5778eb2148 with delete_type TABLET_DATA_DELETED (replaced by tablet 4d4b00bdadb24ec892d87c9be2ed7dd9) from {username='slave'} at 127.0.0.1:45460
W20250830 07:54:30.947594 13230 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 778f6766c47f4a86b5dea60560f67d5c has no consensus state
I20250830 07:54:30.947671 13887 tablet_bootstrap.cc:654] T 050e72b96c2d479896b3a54d85e6f6dd P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:30.947952 13232 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet ff0f9cccc8ed43b1a8cd38de0e9d4097
W20250830 07:54:30.948019 13220 catalog_manager.cc:4908] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet 9e055d6089f541f799eddb5778eb2148 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9e055d6089f541f799eddb5778eb2148 already in progress: creating tablet
I20250830 07:54:30.948598 13234 catalog_manager.cc:5864] Not sending DeleteTablet requests; no consensus state for tablet e290b5b150f34bbe99222784a2d64866
I20250830 07:54:30.948866 13233 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet b4ab964a64a64e00a78ffd2b220aef46
I20250830 07:54:30.948954 13750 tablet_service.cc:1515] Processing DeleteTablet for tablet ff0f9cccc8ed43b1a8cd38de0e9d4097 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:30 UTC) from {username='slave'} at 127.0.0.1:45460
I20250830 07:54:30.949406 13225 catalog_manager.cc:5864] Not sending DeleteTablet requests; no consensus state for tablet f0511bd0634749749a452595b20c6005
W20250830 07:54:30.949510 13219 catalog_manager.cc:4908] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): delete failed for tablet 9e055d6089f541f799eddb5778eb2148 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9e055d6089f541f799eddb5778eb2148 already in progress: creating tablet
I20250830 07:54:30.950734 13605 tablet_service.cc:1515] Processing DeleteTablet for tablet b4ab964a64a64e00a78ffd2b220aef46 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:30 UTC) from {username='slave'} at 127.0.0.1:45306
I20250830 07:54:30.951460 13465 tablet_service.cc:1515] Processing DeleteTablet for tablet ff0f9cccc8ed43b1a8cd38de0e9d4097 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:30 UTC) from {username='slave'} at 127.0.0.1:37956
I20250830 07:54:30.951956 13467 tablet_service.cc:1515] Processing DeleteTablet for tablet b4ab964a64a64e00a78ffd2b220aef46 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:30 UTC) from {username='slave'} at 127.0.0.1:37956
I20250830 07:54:30.952262 13608 tablet_service.cc:1515] Processing DeleteTablet for tablet ff0f9cccc8ed43b1a8cd38de0e9d4097 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:30 UTC) from {username='slave'} at 127.0.0.1:45306
I20250830 07:54:30.953538 13750 tablet_service.cc:1515] Processing DeleteTablet for tablet b4ab964a64a64e00a78ffd2b220aef46 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:30 UTC) from {username='slave'} at 127.0.0.1:45460
W20250830 07:54:30.954272 13219 catalog_manager.cc:4908] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): delete failed for tablet ff0f9cccc8ed43b1a8cd38de0e9d4097 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ff0f9cccc8ed43b1a8cd38de0e9d4097 already in progress: creating tablet
W20250830 07:54:30.955538 13218 catalog_manager.cc:4908] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): delete failed for tablet ff0f9cccc8ed43b1a8cd38de0e9d4097 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ff0f9cccc8ed43b1a8cd38de0e9d4097 already in progress: creating tablet
W20250830 07:54:30.955850 13218 catalog_manager.cc:4908] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): delete failed for tablet b4ab964a64a64e00a78ffd2b220aef46 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b4ab964a64a64e00a78ffd2b220aef46 already in progress: creating tablet
W20250830 07:54:30.956339 13219 catalog_manager.cc:4908] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): delete failed for tablet b4ab964a64a64e00a78ffd2b220aef46 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b4ab964a64a64e00a78ffd2b220aef46 already in progress: creating tablet
W20250830 07:54:30.956562 13220 catalog_manager.cc:4908] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet b4ab964a64a64e00a78ffd2b220aef46 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b4ab964a64a64e00a78ffd2b220aef46 already in progress: creating tablet
W20250830 07:54:30.956811 13220 catalog_manager.cc:4908] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet ff0f9cccc8ed43b1a8cd38de0e9d4097 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ff0f9cccc8ed43b1a8cd38de0e9d4097 already in progress: creating tablet
I20250830 07:54:30.957126 13463 tablet_service.cc:1515] Processing DeleteTablet for tablet 9e055d6089f541f799eddb5778eb2148 with delete_type TABLET_DATA_DELETED (replaced by tablet 4d4b00bdadb24ec892d87c9be2ed7dd9) from {username='slave'} at 127.0.0.1:37956
W20250830 07:54:30.957824 13218 catalog_manager.cc:4908] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): delete failed for tablet 9e055d6089f541f799eddb5778eb2148 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9e055d6089f541f799eddb5778eb2148 already in progress: creating tablet
I20250830 07:54:30.961196 13887 tablet_bootstrap.cc:492] T 050e72b96c2d479896b3a54d85e6f6dd P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:54:30.961452 13887 ts_tablet_manager.cc:1397] T 050e72b96c2d479896b3a54d85e6f6dd P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.015s user 0.004s sys 0.011s
I20250830 07:54:30.969369 13887 raft_consensus.cc:357] T 050e72b96c2d479896b3a54d85e6f6dd P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:30.969544 13887 raft_consensus.cc:383] T 050e72b96c2d479896b3a54d85e6f6dd P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:30.969606 13887 raft_consensus.cc:738] T 050e72b96c2d479896b3a54d85e6f6dd P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:54:30.969877 13887 consensus_queue.cc:260] T 050e72b96c2d479896b3a54d85e6f6dd P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:30.970292 13887 ts_tablet_manager.cc:1428] T 050e72b96c2d479896b3a54d85e6f6dd P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20250830 07:54:30.970556 13887 tablet_bootstrap.cc:492] T 50360492db824755a6de251436cab5c6 P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
W20250830 07:54:30.971094 13229 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 4d4b00bdadb24ec892d87c9be2ed7dd9 has no consensus state
I20250830 07:54:30.972119 13887 tablet_bootstrap.cc:654] T 50360492db824755a6de251436cab5c6 P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:30.978242 13886 tablet_bootstrap.cc:492] T d0368ce5ffbd48dca5a6674f65f34ce4 P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:54:30.978570 13886 ts_tablet_manager.cc:1397] T d0368ce5ffbd48dca5a6674f65f34ce4 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.151s user 0.030s sys 0.018s
I20250830 07:54:30.979952 13463 tablet_service.cc:1468] Processing CreateTablet for tablet ab7196ca193348f5b4bb9193b731e04f (DEFAULT_TABLE table=default.Table_74f3c73d22574737b5f6a4bd256e423d [id=55f67297d5ac42c280ea932d74e3ad37]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:30.980157 13752 tablet_service.cc:1468] Processing CreateTablet for tablet 7ed22d9617024d55a8add137e7971061 (DEFAULT_TABLE table=default.Table_8afaf5e0feb749a59e6fef1f639f58c6 [id=ffffe504d11747cd84cb8c106323459e]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:30.980300 13463 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab7196ca193348f5b4bb9193b731e04f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:30.980242 13754 tablet_service.cc:1468] Processing CreateTablet for tablet b059069ed7eb433a9c54523bce21b4ad (DEFAULT_TABLE table=default.Table_b30c015c01cb40e3992286109ba71dfe [id=163edc59ef9846bfbe3c2c3f0b33e8cb]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:30.980504 13752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7ed22d9617024d55a8add137e7971061. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:30.980702 13754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b059069ed7eb433a9c54523bce21b4ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:30.983213 13467 tablet_service.cc:1468] Processing CreateTablet for tablet 778f6766c47f4a86b5dea60560f67d5c (DEFAULT_TABLE table=default.Table_d2ac5bc3c0c246c4bb6c797de6efedae [id=08a2c4f9b62b465cb1bf7983bc8b802d]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:30.983532 13467 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 778f6766c47f4a86b5dea60560f67d5c. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:30.987172 13465 tablet_service.cc:1468] Processing CreateTablet for tablet 7ed22d9617024d55a8add137e7971061 (DEFAULT_TABLE table=default.Table_8afaf5e0feb749a59e6fef1f639f58c6 [id=ffffe504d11747cd84cb8c106323459e]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:30.987550 13465 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7ed22d9617024d55a8add137e7971061. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:30.991165 13750 tablet_service.cc:1468] Processing CreateTablet for tablet ab7196ca193348f5b4bb9193b731e04f (DEFAULT_TABLE table=default.Table_74f3c73d22574737b5f6a4bd256e423d [id=55f67297d5ac42c280ea932d74e3ad37]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:30.991629 13468 tablet_service.cc:1468] Processing CreateTablet for tablet b059069ed7eb433a9c54523bce21b4ad (DEFAULT_TABLE table=default.Table_b30c015c01cb40e3992286109ba71dfe [id=163edc59ef9846bfbe3c2c3f0b33e8cb]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:30.991973 13468 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b059069ed7eb433a9c54523bce21b4ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:30.995219 13751 tablet_service.cc:1468] Processing CreateTablet for tablet 778f6766c47f4a86b5dea60560f67d5c (DEFAULT_TABLE table=default.Table_d2ac5bc3c0c246c4bb6c797de6efedae [id=08a2c4f9b62b465cb1bf7983bc8b802d]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:30.995661 13228 catalog_manager.cc:5674] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325) does not have the latest schema for tablet 9a0c96916f1d4680b8a04d97091384e9 (table default.Table_5224b75b4bc74fac9d4499094e8c006f [id=fa1e5610a0034475a7e35699dd9bacf7]). Expected version 1 got 0
I20250830 07:54:30.996234 13608 tablet_service.cc:1468] Processing CreateTablet for tablet ab7196ca193348f5b4bb9193b731e04f (DEFAULT_TABLE table=default.Table_74f3c73d22574737b5f6a4bd256e423d [id=55f67297d5ac42c280ea932d74e3ad37]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:30.996625 13608 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab7196ca193348f5b4bb9193b731e04f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:30.997000 13755 tablet_service.cc:1468] Processing CreateTablet for tablet 8f4567f30cc34f288463e4a92bd3edd5 (DEFAULT_TABLE table=default.Table_5de39b3a49f54e41b06a8178dd641fd8 [id=3c052a58caaa412f8d9d70063dcd97c0]), partition=RANGE (key) PARTITION UNBOUNDED
W20250830 07:54:30.997314 13231 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 9a0c96916f1d4680b8a04d97091384e9 consensus state has no leader
I20250830 07:54:30.998188 13604 tablet_service.cc:1468] Processing CreateTablet for tablet 8f4567f30cc34f288463e4a92bd3edd5 (DEFAULT_TABLE table=default.Table_5de39b3a49f54e41b06a8178dd641fd8 [id=3c052a58caaa412f8d9d70063dcd97c0]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:30.998759 13604 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8f4567f30cc34f288463e4a92bd3edd5. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:30.998998 13603 tablet_service.cc:1468] Processing CreateTablet for tablet 4d4b00bdadb24ec892d87c9be2ed7dd9 (DEFAULT_TABLE table=default.Table_384b195b26da40b781813278ef6a8645 [id=d2dbb756d66b483ebe44d45ddfa5c17c]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:30.999238 13605 tablet_service.cc:1468] Processing CreateTablet for tablet 778f6766c47f4a86b5dea60560f67d5c (DEFAULT_TABLE table=default.Table_d2ac5bc3c0c246c4bb6c797de6efedae [id=08a2c4f9b62b465cb1bf7983bc8b802d]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:30.999487 13603 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d4b00bdadb24ec892d87c9be2ed7dd9. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:30.999855 13606 tablet_service.cc:1468] Processing CreateTablet for tablet 7ed22d9617024d55a8add137e7971061 (DEFAULT_TABLE table=default.Table_8afaf5e0feb749a59e6fef1f639f58c6 [id=ffffe504d11747cd84cb8c106323459e]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:31.000162 13606 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7ed22d9617024d55a8add137e7971061. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:31.003187 13607 tablet_service.cc:1468] Processing CreateTablet for tablet b059069ed7eb433a9c54523bce21b4ad (DEFAULT_TABLE table=default.Table_b30c015c01cb40e3992286109ba71dfe [id=163edc59ef9846bfbe3c2c3f0b33e8cb]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:31.003497 13607 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b059069ed7eb433a9c54523bce21b4ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:31.004312 13886 raft_consensus.cc:357] T d0368ce5ffbd48dca5a6674f65f34ce4 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:31.004662 13886 raft_consensus.cc:383] T d0368ce5ffbd48dca5a6674f65f34ce4 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:31.004760 13886 raft_consensus.cc:738] T d0368ce5ffbd48dca5a6674f65f34ce4 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:54:31.005380 13886 consensus_queue.cc:260] T d0368ce5ffbd48dca5a6674f65f34ce4 P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:31.006171 13752 tablet_service.cc:1468] Processing CreateTablet for tablet 32c75568db9b4f00bb567d09dab3d45a (DEFAULT_TABLE table=default.Table_d24e8e2f5130411cacb3241198c3669d [id=e087454d345c40f1b809d0f4187f7212]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:31.007285 13609 tablet_service.cc:1468] Processing CreateTablet for tablet 32c75568db9b4f00bb567d09dab3d45a (DEFAULT_TABLE table=default.Table_d24e8e2f5130411cacb3241198c3669d [id=e087454d345c40f1b809d0f4187f7212]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:31.007484 13755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8f4567f30cc34f288463e4a92bd3edd5. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:31.007632 13609 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 32c75568db9b4f00bb567d09dab3d45a. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:31.007985 13466 tablet_service.cc:1468] Processing CreateTablet for tablet 32c75568db9b4f00bb567d09dab3d45a (DEFAULT_TABLE table=default.Table_d24e8e2f5130411cacb3241198c3669d [id=e087454d345c40f1b809d0f4187f7212]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:31.008330 13466 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 32c75568db9b4f00bb567d09dab3d45a. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:31.008951 13462 tablet_service.cc:1468] Processing CreateTablet for tablet 4d4b00bdadb24ec892d87c9be2ed7dd9 (DEFAULT_TABLE table=default.Table_384b195b26da40b781813278ef6a8645 [id=d2dbb756d66b483ebe44d45ddfa5c17c]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:31.009476 13462 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d4b00bdadb24ec892d87c9be2ed7dd9. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:31.011173 13464 tablet_service.cc:1468] Processing CreateTablet for tablet 8f4567f30cc34f288463e4a92bd3edd5 (DEFAULT_TABLE table=default.Table_5de39b3a49f54e41b06a8178dd641fd8 [id=3c052a58caaa412f8d9d70063dcd97c0]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:31.011920 13464 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8f4567f30cc34f288463e4a92bd3edd5. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:31.014107 13752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 32c75568db9b4f00bb567d09dab3d45a. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:31.014299 13751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 778f6766c47f4a86b5dea60560f67d5c. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:31.015471 13605 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 778f6766c47f4a86b5dea60560f67d5c. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:31.017894 13750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab7196ca193348f5b4bb9193b731e04f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:31.020730 13226 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet 7ed22d9617024d55a8add137e7971061
I20250830 07:54:31.021430 13822 heartbeater.cc:499] Master 127.12.209.61:44241 was elected leader, sending a full tablet report...
I20250830 07:54:31.023677 13461 tablet_service.cc:1515] Processing DeleteTablet for tablet 7ed22d9617024d55a8add137e7971061 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:30 UTC) from {username='slave'} at 127.0.0.1:37956
I20250830 07:54:31.024631 13229 master_service.cc:948] ReplaceTablet: received request to replace tablet ff0f9cccc8ed43b1a8cd38de0e9d4097 from {username='slave'} at 127.0.0.1:42126
I20250830 07:54:31.024837 13225 master_service.cc:948] ReplaceTablet: received request to replace tablet 1ed2d20b0de14631ad8520f4cbd806c2 from {username='slave'} at 127.0.0.1:42126
I20250830 07:54:31.025074 13233 master_service.cc:948] ReplaceTablet: received request to replace tablet 32c75568db9b4f00bb567d09dab3d45a from {username='slave'} at 127.0.0.1:42126
I20250830 07:54:31.025305 13231 master_service.cc:948] ReplaceTablet: received request to replace tablet 32c75568db9b4f00bb567d09dab3d45a from {username='slave'} at 127.0.0.1:42126
W20250830 07:54:31.029659 13218 catalog_manager.cc:4895] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): delete failed for tablet 7ed22d9617024d55a8add137e7971061 because the tablet was not found. No further retry: Not found: Tablet not found: 7ed22d9617024d55a8add137e7971061
I20250830 07:54:31.031147 13229 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_5bfb094fe761440791baa2854483575e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250830 07:54:31.031316 13234 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_0598a47b9b6b42108694e5826c8a404e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:31.031662 13229 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5bfb094fe761440791baa2854483575e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250830 07:54:31.031790 13234 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0598a47b9b6b42108694e5826c8a404e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:31.033146 13226 catalog_manager.cc:5674] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325) does not have the latest schema for tablet 9a0c96916f1d4680b8a04d97091384e9 (table default.Table_72cd09b09afe4d318eea1f0371c4e823 [id=fa1e5610a0034475a7e35699dd9bacf7]). Expected version 2 got 0
I20250830 07:54:31.033293 13755 tablet_service.cc:1515] Processing DeleteTablet for tablet 7ed22d9617024d55a8add137e7971061 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:30 UTC) from {username='slave'} at 127.0.0.1:45460
W20250830 07:54:31.034099 13219 catalog_manager.cc:4908] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): delete failed for tablet 7ed22d9617024d55a8add137e7971061 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7ed22d9617024d55a8add137e7971061 already in progress: creating tablet
I20250830 07:54:31.035836 13676 heartbeater.cc:499] Master 127.12.209.61:44241 was elected leader, sending a full tablet report...
I20250830 07:54:31.037802 13754 tablet_service.cc:1468] Processing CreateTablet for tablet 4d4b00bdadb24ec892d87c9be2ed7dd9 (DEFAULT_TABLE table=default.Table_384b195b26da40b781813278ef6a8645 [id=d2dbb756d66b483ebe44d45ddfa5c17c]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:31.038216 13754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d4b00bdadb24ec892d87c9be2ed7dd9. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:31.040225 13605 tablet_service.cc:1515] Processing DeleteTablet for tablet 7ed22d9617024d55a8add137e7971061 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:30 UTC) from {username='slave'} at 127.0.0.1:45306
W20250830 07:54:31.040982 13220 catalog_manager.cc:4895] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet 7ed22d9617024d55a8add137e7971061 because the tablet was not found. No further retry: Not found: Tablet not found: 7ed22d9617024d55a8add137e7971061
I20250830 07:54:31.041433 13466 tablet_service.cc:1515] Processing DeleteTablet for tablet 050e72b96c2d479896b3a54d85e6f6dd with delete_type TABLET_DATA_DELETED (replaced by tablet 9e055d6089f541f799eddb5778eb2148) from {username='slave'} at 127.0.0.1:37956
I20250830 07:54:31.041707 13883 tablet_replica.cc:331] T 050e72b96c2d479896b3a54d85e6f6dd P 2065c332f15a4739899af79f3669c3ba: stopping tablet replica
I20250830 07:54:31.042119 13883 raft_consensus.cc:2241] T 050e72b96c2d479896b3a54d85e6f6dd P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Raft consensus shutting down.
I20250830 07:54:31.042476 13883 raft_consensus.cc:2270] T 050e72b96c2d479896b3a54d85e6f6dd P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Raft consensus is shut down!
I20250830 07:54:31.044149 13883 ts_tablet_manager.cc:1905] T 050e72b96c2d479896b3a54d85e6f6dd P 2065c332f15a4739899af79f3669c3ba: Deleting tablet data with delete state TABLET_DATA_DELETED
W20250830 07:54:31.049923 13539 tablet.cc:2378] T 9a0c96916f1d4680b8a04d97091384e9 P 2065c332f15a4739899af79f3669c3ba: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20250830 07:54:31.055483 13883 ts_tablet_manager.cc:1918] T 050e72b96c2d479896b3a54d85e6f6dd P 2065c332f15a4739899af79f3669c3ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250830 07:54:31.055629 13883 log.cc:1199] T 050e72b96c2d479896b3a54d85e6f6dd P 2065c332f15a4739899af79f3669c3ba: Deleting WAL directory at /tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/ts-0/wal/wals/050e72b96c2d479896b3a54d85e6f6dd
I20250830 07:54:31.056120 13883 ts_tablet_manager.cc:1939] T 050e72b96c2d479896b3a54d85e6f6dd P 2065c332f15a4739899af79f3669c3ba: Deleting consensus metadata
I20250830 07:54:31.057008 13886 ts_tablet_manager.cc:1428] T d0368ce5ffbd48dca5a6674f65f34ce4 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.078s user 0.006s sys 0.003s
I20250830 07:54:31.057408 13886 tablet_bootstrap.cc:492] T 9a0c96916f1d4680b8a04d97091384e9 P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:54:31.057502 13882 raft_consensus.cc:357] T 050e72b96c2d479896b3a54d85e6f6dd P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:31.057917 13218 catalog_manager.cc:4928] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): tablet 050e72b96c2d479896b3a54d85e6f6dd (table default.Table_384b195b26da40b781813278ef6a8645 [id=d2dbb756d66b483ebe44d45ddfa5c17c]) successfully deleted
I20250830 07:54:31.059125 13886 tablet_bootstrap.cc:654] T 9a0c96916f1d4680b8a04d97091384e9 P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:31.062248 13882 raft_consensus.cc:383] T 050e72b96c2d479896b3a54d85e6f6dd P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:31.062386 13882 raft_consensus.cc:738] T 050e72b96c2d479896b3a54d85e6f6dd P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:54:31.062711 13225 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet 1ed2d20b0de14631ad8520f4cbd806c2
I20250830 07:54:31.063164 13225 catalog_manager.cc:6652] ReplaceTablet: tablet 1ed2d20b0de14631ad8520f4cbd806c2 deleted and replaced by tablet ff2267fb411942ff826e2a72bcb89cd7
I20250830 07:54:31.063500 13233 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet 32c75568db9b4f00bb567d09dab3d45a
I20250830 07:54:31.063849 13233 catalog_manager.cc:6652] ReplaceTablet: tablet 32c75568db9b4f00bb567d09dab3d45a deleted and replaced by tablet d2e5255f7bf7435bb8b93c42b42f603a
I20250830 07:54:31.063941 13228 catalog_manager.cc:5674] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743) does not have the latest schema for tablet d0368ce5ffbd48dca5a6674f65f34ce4 (table default.Table_73b4932d2b1249be9861511738a09a91 [id=1b7c141ed8af4dcab20683653fd59ee1]). Expected version 2 got 0
I20250830 07:54:31.064159 13228 catalog_manager.cc:5674] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743) does not have the latest schema for tablet 9a0c96916f1d4680b8a04d97091384e9 (table default.Table_72cd09b09afe4d318eea1f0371c4e823 [id=fa1e5610a0034475a7e35699dd9bacf7]). Expected version 2 got 0
I20250830 07:54:31.065583 13752 tablet_service.cc:1515] Processing DeleteTablet for tablet 32c75568db9b4f00bb567d09dab3d45a with delete_type TABLET_DATA_DELETED (replaced by tablet d2e5255f7bf7435bb8b93c42b42f603a) from {username='slave'} at 127.0.0.1:45460
I20250830 07:54:31.066008 13754 tablet_service.cc:1515] Processing DeleteTablet for tablet 1ed2d20b0de14631ad8520f4cbd806c2 with delete_type TABLET_DATA_DELETED (replaced by tablet ff2267fb411942ff826e2a72bcb89cd7) from {username='slave'} at 127.0.0.1:45460
I20250830 07:54:31.067551 13462 tablet_service.cc:1515] Processing DeleteTablet for tablet 1ed2d20b0de14631ad8520f4cbd806c2 with delete_type TABLET_DATA_DELETED (replaced by tablet ff2267fb411942ff826e2a72bcb89cd7) from {username='slave'} at 127.0.0.1:37956
I20250830 07:54:31.067776 13466 tablet_service.cc:1515] Processing DeleteTablet for tablet 32c75568db9b4f00bb567d09dab3d45a with delete_type TABLET_DATA_DELETED (replaced by tablet d2e5255f7bf7435bb8b93c42b42f603a) from {username='slave'} at 127.0.0.1:37956
I20250830 07:54:31.068488 13234 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_a4a92fab99e5433580288411b9610fb1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:31.069034 13234 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a4a92fab99e5433580288411b9610fb1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:31.070652 13231 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_bee6dfde82b1440fa69d12c01819a359"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:31.071190 13231 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bee6dfde82b1440fa69d12c01819a359 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:31.071213 13606 tablet_service.cc:1515] Processing DeleteTablet for tablet 1ed2d20b0de14631ad8520f4cbd806c2 with delete_type TABLET_DATA_DELETED (replaced by tablet ff2267fb411942ff826e2a72bcb89cd7) from {username='slave'} at 127.0.0.1:45306
W20250830 07:54:31.071452 13219 catalog_manager.cc:4908] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): delete failed for tablet 32c75568db9b4f00bb567d09dab3d45a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 32c75568db9b4f00bb567d09dab3d45a already in progress: creating tablet
W20250830 07:54:31.071691 13219 catalog_manager.cc:4908] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): delete failed for tablet 1ed2d20b0de14631ad8520f4cbd806c2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1ed2d20b0de14631ad8520f4cbd806c2 already in progress: creating tablet
W20250830 07:54:31.072223 13218 catalog_manager.cc:4908] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): delete failed for tablet 1ed2d20b0de14631ad8520f4cbd806c2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1ed2d20b0de14631ad8520f4cbd806c2 already in progress: creating tablet
W20250830 07:54:31.072453 13218 catalog_manager.cc:4908] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): delete failed for tablet 32c75568db9b4f00bb567d09dab3d45a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 32c75568db9b4f00bb567d09dab3d45a already in progress: creating tablet
I20250830 07:54:31.072923 13755 tablet_service.cc:1515] Processing DeleteTablet for tablet 050e72b96c2d479896b3a54d85e6f6dd with delete_type TABLET_DATA_DELETED (replaced by tablet 9e055d6089f541f799eddb5778eb2148) from {username='slave'} at 127.0.0.1:45460
I20250830 07:54:31.073134 13753 tablet_service.cc:1515] Processing DeleteTablet for tablet 7ed22d9617024d55a8add137e7971061 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:30 UTC) from {username='slave'} at 127.0.0.1:45460
I20250830 07:54:31.072957 13749 tablet_service.cc:1515] Processing DeleteTablet for tablet 1ed2d20b0de14631ad8520f4cbd806c2 with delete_type TABLET_DATA_DELETED (replaced by tablet ff2267fb411942ff826e2a72bcb89cd7) from {username='slave'} at 127.0.0.1:45460
I20250830 07:54:31.073078 13882 consensus_queue.cc:260] T 050e72b96c2d479896b3a54d85e6f6dd P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:31.073293 13752 tablet_service.cc:1515] Processing DeleteTablet for tablet 50360492db824755a6de251436cab5c6 with delete_type TABLET_DATA_DELETED (replaced by tablet ff0f9cccc8ed43b1a8cd38de0e9d4097) from {username='slave'} at 127.0.0.1:45460
W20250830 07:54:31.073323 13220 catalog_manager.cc:4908] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet 1ed2d20b0de14631ad8520f4cbd806c2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1ed2d20b0de14631ad8520f4cbd806c2 already in progress: creating tablet
W20250830 07:54:31.073890 13219 catalog_manager.cc:4908] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): delete failed for tablet 050e72b96c2d479896b3a54d85e6f6dd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 050e72b96c2d479896b3a54d85e6f6dd already in progress: creating tablet
W20250830 07:54:31.074093 13219 catalog_manager.cc:4908] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): delete failed for tablet 7ed22d9617024d55a8add137e7971061 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7ed22d9617024d55a8add137e7971061 already in progress: creating tablet
I20250830 07:54:31.074642 13754 tablet_service.cc:1515] Processing DeleteTablet for tablet 9e055d6089f541f799eddb5778eb2148 with delete_type TABLET_DATA_DELETED (replaced by tablet 4d4b00bdadb24ec892d87c9be2ed7dd9) from {username='slave'} at 127.0.0.1:45460
W20250830 07:54:31.075122 13219 catalog_manager.cc:4908] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): delete failed for tablet 1ed2d20b0de14631ad8520f4cbd806c2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1ed2d20b0de14631ad8520f4cbd806c2 already in progress: creating tablet
W20250830 07:54:31.075311 13219 catalog_manager.cc:4908] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): delete failed for tablet 50360492db824755a6de251436cab5c6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 50360492db824755a6de251436cab5c6 already in progress: creating tablet
W20250830 07:54:31.075506 13219 catalog_manager.cc:4908] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): delete failed for tablet 9e055d6089f541f799eddb5778eb2148 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9e055d6089f541f799eddb5778eb2148 already in progress: creating tablet
I20250830 07:54:31.076146 13887 tablet_bootstrap.cc:492] T 50360492db824755a6de251436cab5c6 P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:54:31.076331 13887 ts_tablet_manager.cc:1397] T 50360492db824755a6de251436cab5c6 P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.106s user 0.000s sys 0.019s
I20250830 07:54:31.077013 13750 tablet_service.cc:1515] Processing DeleteTablet for tablet b4ab964a64a64e00a78ffd2b220aef46 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:30 UTC) from {username='slave'} at 127.0.0.1:45460
I20250830 07:54:31.077206 13887 raft_consensus.cc:357] T 50360492db824755a6de251436cab5c6 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
W20250830 07:54:31.077673 13219 catalog_manager.cc:4908] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): delete failed for tablet b4ab964a64a64e00a78ffd2b220aef46 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b4ab964a64a64e00a78ffd2b220aef46 already in progress: creating tablet
I20250830 07:54:31.077895 13887 raft_consensus.cc:383] T 50360492db824755a6de251436cab5c6 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:31.078048 13887 raft_consensus.cc:738] T 50360492db824755a6de251436cab5c6 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:54:31.078315 13887 consensus_queue.cc:260] T 50360492db824755a6de251436cab5c6 P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:31.080052 13887 ts_tablet_manager.cc:1428] T 50360492db824755a6de251436cab5c6 P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.004s user 0.000s sys 0.001s
I20250830 07:54:31.080330 13887 tablet_bootstrap.cc:492] T 1ed2d20b0de14631ad8520f4cbd806c2 P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:54:31.081912 13887 tablet_bootstrap.cc:654] T 1ed2d20b0de14631ad8520f4cbd806c2 P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:31.083387 13882 ts_tablet_manager.cc:1428] T 050e72b96c2d479896b3a54d85e6f6dd P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.147s user 0.009s sys 0.004s
I20250830 07:54:31.083751 13882 tablet_bootstrap.cc:492] T 50360492db824755a6de251436cab5c6 P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:54:31.086561 13226 catalog_manager.cc:5674] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967) does not have the latest schema for tablet 9a0c96916f1d4680b8a04d97091384e9 (table default.Table_72cd09b09afe4d318eea1f0371c4e823 [id=fa1e5610a0034475a7e35699dd9bacf7]). Expected version 2 got 0
I20250830 07:54:31.086723 13226 catalog_manager.cc:5674] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967) does not have the latest schema for tablet d0368ce5ffbd48dca5a6674f65f34ce4 (table default.Table_73b4932d2b1249be9861511738a09a91 [id=1b7c141ed8af4dcab20683653fd59ee1]). Expected version 2 got 0
I20250830 07:54:31.086989 13226 catalog_manager.cc:5674] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967) does not have the latest schema for tablet 778f6766c47f4a86b5dea60560f67d5c (table default.Table_d2ac5bc3c0c246c4bb6c797de6efedae [id=08a2c4f9b62b465cb1bf7983bc8b802d]). Expected version 1 got 0
I20250830 07:54:31.089923 13887 tablet_bootstrap.cc:492] T 1ed2d20b0de14631ad8520f4cbd806c2 P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:54:31.090209 13887 ts_tablet_manager.cc:1397] T 1ed2d20b0de14631ad8520f4cbd806c2 P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.010s user 0.004s sys 0.001s
I20250830 07:54:31.091291 13887 raft_consensus.cc:357] T 1ed2d20b0de14631ad8520f4cbd806c2 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:31.091426 13886 tablet_bootstrap.cc:492] T 9a0c96916f1d4680b8a04d97091384e9 P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:54:31.091562 13887 raft_consensus.cc:383] T 1ed2d20b0de14631ad8520f4cbd806c2 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:31.091605 13886 ts_tablet_manager.cc:1397] T 9a0c96916f1d4680b8a04d97091384e9 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.034s user 0.005s sys 0.002s
I20250830 07:54:31.091665 13887 raft_consensus.cc:738] T 1ed2d20b0de14631ad8520f4cbd806c2 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:54:31.091979 13887 consensus_queue.cc:260] T 1ed2d20b0de14631ad8520f4cbd806c2 P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:31.092561 13886 raft_consensus.cc:357] T 9a0c96916f1d4680b8a04d97091384e9 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:31.092758 13886 raft_consensus.cc:383] T 9a0c96916f1d4680b8a04d97091384e9 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:31.092839 13886 raft_consensus.cc:738] T 9a0c96916f1d4680b8a04d97091384e9 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:54:31.093119 13886 consensus_queue.cc:260] T 9a0c96916f1d4680b8a04d97091384e9 P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:31.094539 13751 tablet_service.cc:1515] Processing DeleteTablet for tablet ff0f9cccc8ed43b1a8cd38de0e9d4097 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:30 UTC) from {username='slave'} at 127.0.0.1:45460
I20250830 07:54:31.094811 13887 ts_tablet_manager.cc:1428] T 1ed2d20b0de14631ad8520f4cbd806c2 P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20250830 07:54:31.095273 13886 ts_tablet_manager.cc:1428] T 9a0c96916f1d4680b8a04d97091384e9 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
W20250830 07:54:31.095358 13219 catalog_manager.cc:4908] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): delete failed for tablet ff0f9cccc8ed43b1a8cd38de0e9d4097 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ff0f9cccc8ed43b1a8cd38de0e9d4097 already in progress: creating tablet
I20250830 07:54:31.095705 13894 raft_consensus.cc:491] T 9a0c96916f1d4680b8a04d97091384e9 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:31.095865 13894 raft_consensus.cc:513] T 9a0c96916f1d4680b8a04d97091384e9 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:31.096210 13886 tablet_bootstrap.cc:492] T 050e72b96c2d479896b3a54d85e6f6dd P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:54:31.096767 13605 tablet_service.cc:1515] Processing DeleteTablet for tablet 32c75568db9b4f00bb567d09dab3d45a with delete_type TABLET_DATA_DELETED (replaced by tablet d2e5255f7bf7435bb8b93c42b42f603a) from {username='slave'} at 127.0.0.1:45306
W20250830 07:54:31.097334 13220 catalog_manager.cc:4908] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet 32c75568db9b4f00bb567d09dab3d45a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 32c75568db9b4f00bb567d09dab3d45a already in progress: creating tablet
I20250830 07:54:31.097599 13894 leader_election.cc:290] T 9a0c96916f1d4680b8a04d97091384e9 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:31.098534 13228 catalog_manager.cc:5674] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743) does not have the latest schema for tablet d0368ce5ffbd48dca5a6674f65f34ce4 (table default.Table_73b4932d2b1249be9861511738a09a91 [id=1b7c141ed8af4dcab20683653fd59ee1]). Expected version 2 got 0
I20250830 07:54:31.102455 13886 tablet_bootstrap.cc:654] T 050e72b96c2d479896b3a54d85e6f6dd P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:31.102636 13231 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_4797c3da60c948e78efc613061d25afe"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:31.103140 13231 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4797c3da60c948e78efc613061d25afe in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:31.105543 13229 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_7cd2cf22f208495c99ecc3c077dcbd4f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250830 07:54:31.106029 13882 tablet_bootstrap.cc:654] T 50360492db824755a6de251436cab5c6 P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
W20250830 07:54:31.106014 13229 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7cd2cf22f208495c99ecc3c077dcbd4f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:31.107414 13233 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_ca148790caf146b0b02b54ae9f70c339"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:31.110219 13233 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ca148790caf146b0b02b54ae9f70c339 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:31.111795 13225 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_bdd5e6bda36e44a18bbc179b5f0955d7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:31.112226 13225 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bdd5e6bda36e44a18bbc179b5f0955d7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:31.119057 13887 tablet_bootstrap.cc:492] T d0368ce5ffbd48dca5a6674f65f34ce4 P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:54:31.121421 13231 catalog_manager.cc:5674] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743) does not have the latest schema for tablet 9a0c96916f1d4680b8a04d97091384e9 (table default.Table_72cd09b09afe4d318eea1f0371c4e823 [id=fa1e5610a0034475a7e35699dd9bacf7]). Expected version 2 got 0
I20250830 07:54:31.122900 13231 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_384b195b26da40b781813278ef6a8645" } new_table_name: "default.Table_5efd2297916145a0b36358f1dc7dd1c4" modify_external_catalogs: true
I20250830 07:54:31.125432 13228 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_09e2fbb8a5854801a399af8b6a6782a3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:31.125944 13228 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_09e2fbb8a5854801a399af8b6a6782a3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:31.126832 13887 tablet_bootstrap.cc:654] T d0368ce5ffbd48dca5a6674f65f34ce4 P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:31.127748 13225 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_8bbc08cd77ea427688c017092c7c6dfe" } new_table_name: "default.Table_bbcc6dca6db246f6935808d28432e28c" modify_external_catalogs: true
I20250830 07:54:31.128995 13229 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_17839b351a2749998d2824da31f86c98"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:31.129426 13229 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_17839b351a2749998d2824da31f86c98 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250830 07:54:31.131675 13231 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 4d4b00bdadb24ec892d87c9be2ed7dd9 consensus state has no leader
I20250830 07:54:31.132864 13882 tablet_bootstrap.cc:492] T 50360492db824755a6de251436cab5c6 P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:54:31.133035 13882 ts_tablet_manager.cc:1397] T 50360492db824755a6de251436cab5c6 P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.049s user 0.004s sys 0.001s
I20250830 07:54:31.133960 13882 raft_consensus.cc:357] T 50360492db824755a6de251436cab5c6 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:31.135140 13882 raft_consensus.cc:383] T 50360492db824755a6de251436cab5c6 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:31.135224 13882 raft_consensus.cc:738] T 50360492db824755a6de251436cab5c6 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:54:31.135447 13882 consensus_queue.cc:260] T 50360492db824755a6de251436cab5c6 P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:31.135914 13882 ts_tablet_manager.cc:1428] T 50360492db824755a6de251436cab5c6 P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20250830 07:54:31.136196 13882 tablet_bootstrap.cc:492] T d0368ce5ffbd48dca5a6674f65f34ce4 P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:54:31.137719 13882 tablet_bootstrap.cc:654] T d0368ce5ffbd48dca5a6674f65f34ce4 P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
W20250830 07:54:31.138752 13225 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ff2267fb411942ff826e2a72bcb89cd7 has no consensus state
I20250830 07:54:31.139735 13886 tablet_bootstrap.cc:492] T 050e72b96c2d479896b3a54d85e6f6dd P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:54:31.143831 13886 ts_tablet_manager.cc:1397] T 050e72b96c2d479896b3a54d85e6f6dd P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.048s user 0.005s sys 0.000s
I20250830 07:54:31.145074 13886 raft_consensus.cc:357] T 050e72b96c2d479896b3a54d85e6f6dd P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:31.145416 13886 raft_consensus.cc:383] T 050e72b96c2d479896b3a54d85e6f6dd P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:31.145577 13886 raft_consensus.cc:738] T 050e72b96c2d479896b3a54d85e6f6dd P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:54:31.146215 13886 consensus_queue.cc:260] T 050e72b96c2d479896b3a54d85e6f6dd P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:31.148389 13886 ts_tablet_manager.cc:1428] T 050e72b96c2d479896b3a54d85e6f6dd P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20250830 07:54:31.148702 13886 tablet_bootstrap.cc:492] T 50360492db824755a6de251436cab5c6 P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
W20250830 07:54:31.152504 13229 catalog_manager.cc:5415] Ignoring report from unknown tablet 050e72b96c2d479896b3a54d85e6f6dd
W20250830 07:54:31.154745 13229 catalog_manager.cc:5415] Ignoring report from unknown tablet 050e72b96c2d479896b3a54d85e6f6dd
I20250830 07:54:31.155010 13228 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_fa4deee864594a2aa4987b24ae8e7c97" } modify_external_catalogs: true
I20250830 07:54:31.155220 13228 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_fa4deee864594a2aa4987b24ae8e7c97" } modify_external_catalogs: true
I20250830 07:54:31.155450 13225 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_7cd2cf22f208495c99ecc3c077dcbd4f" } modify_external_catalogs: true
I20250830 07:54:31.155661 13225 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_7cd2cf22f208495c99ecc3c077dcbd4f" } modify_external_catalogs: true
I20250830 07:54:31.156926 13233 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_5efd2297916145a0b36358f1dc7dd1c4" } new_table_name: "default.Table_d1d829ffa73f473ab5cef5ebc46d761f" modify_external_catalogs: true
I20250830 07:54:31.157673 13232 master_service.cc:948] ReplaceTablet: received request to replace tablet ab7196ca193348f5b4bb9193b731e04f from {username='slave'} at 127.0.0.1:42126
I20250830 07:54:31.158186 13229 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_d24e8e2f5130411cacb3241198c3669d" } modify_external_catalogs: true
I20250830 07:54:31.158363 13229 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_d24e8e2f5130411cacb3241198c3669d" } modify_external_catalogs: true
I20250830 07:54:31.158833 13231 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_bdd5e6bda36e44a18bbc179b5f0955d7" } modify_external_catalogs: true
I20250830 07:54:31.158984 13231 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_bdd5e6bda36e44a18bbc179b5f0955d7" } modify_external_catalogs: true
I20250830 07:54:31.173398 13228 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet bf170b1865094ba38ef8568259e34656
I20250830 07:54:31.173734 13886 tablet_bootstrap.cc:654] T 50360492db824755a6de251436cab5c6 P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:31.175666 13882 tablet_bootstrap.cc:492] T d0368ce5ffbd48dca5a6674f65f34ce4 P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:54:31.175806 13882 ts_tablet_manager.cc:1397] T d0368ce5ffbd48dca5a6674f65f34ce4 P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.040s user 0.010s sys 0.000s
I20250830 07:54:31.176090 13229 catalog_manager.cc:5864] Not sending DeleteTablet requests; no consensus state for tablet d2e5255f7bf7435bb8b93c42b42f603a
I20250830 07:54:31.176715 13751 tablet_service.cc:1515] Processing DeleteTablet for tablet bf170b1865094ba38ef8568259e34656 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:31 UTC) from {username='slave'} at 127.0.0.1:45460
I20250830 07:54:31.176685 13882 raft_consensus.cc:357] T d0368ce5ffbd48dca5a6674f65f34ce4 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:31.176857 13882 raft_consensus.cc:383] T d0368ce5ffbd48dca5a6674f65f34ce4 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:31.176967 13882 raft_consensus.cc:738] T d0368ce5ffbd48dca5a6674f65f34ce4 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:54:31.177263 13882 consensus_queue.cc:260] T d0368ce5ffbd48dca5a6674f65f34ce4 P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:31.177469 13232 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet ab7196ca193348f5b4bb9193b731e04f
I20250830 07:54:31.177636 13605 tablet_service.cc:1515] Processing DeleteTablet for tablet bf170b1865094ba38ef8568259e34656 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:31 UTC) from {username='slave'} at 127.0.0.1:45306
I20250830 07:54:31.177901 13232 catalog_manager.cc:6652] ReplaceTablet: tablet ab7196ca193348f5b4bb9193b731e04f deleted and replaced by tablet 9d00ee83780e4cf780ca92f1504d26b5
I20250830 07:54:31.178200 13882 ts_tablet_manager.cc:1428] T d0368ce5ffbd48dca5a6674f65f34ce4 P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.002s user 0.002s sys 0.001s
W20250830 07:54:31.178659 13233 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 4d4b00bdadb24ec892d87c9be2ed7dd9 consensus state has no leader
I20250830 07:54:31.178814 13751 tablet_service.cc:1515] Processing DeleteTablet for tablet ab7196ca193348f5b4bb9193b731e04f with delete_type TABLET_DATA_DELETED (replaced by tablet 9d00ee83780e4cf780ca92f1504d26b5) from {username='slave'} at 127.0.0.1:45460
I20250830 07:54:31.179062 13231 catalog_manager.cc:5864] Not sending DeleteTablet requests; no consensus state for tablet f9b9fe9f79e34e65a3f5554e2c47b9cb
I20250830 07:54:31.179713 13605 tablet_service.cc:1515] Processing DeleteTablet for tablet ab7196ca193348f5b4bb9193b731e04f with delete_type TABLET_DATA_DELETED (replaced by tablet 9d00ee83780e4cf780ca92f1504d26b5) from {username='slave'} at 127.0.0.1:45306
W20250830 07:54:31.180577 13219 catalog_manager.cc:4908] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): delete failed for tablet bf170b1865094ba38ef8568259e34656 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bf170b1865094ba38ef8568259e34656 already in progress: creating tablet
W20250830 07:54:31.180879 13219 catalog_manager.cc:4908] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): delete failed for tablet ab7196ca193348f5b4bb9193b731e04f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ab7196ca193348f5b4bb9193b731e04f already in progress: creating tablet
W20250830 07:54:31.181139 13220 catalog_manager.cc:4908] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet bf170b1865094ba38ef8568259e34656 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bf170b1865094ba38ef8568259e34656 already in progress: creating tablet
I20250830 07:54:31.183235 13225 catalog_manager.cc:5864] Not sending DeleteTablet requests; no consensus state for tablet 3565add96be64349a0f77400e59e2bec
I20250830 07:54:31.186233 13225 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_17839b351a2749998d2824da31f86c98" } new_table_name: "default.Table_f817d6b952384e64a8b6be555cc4db2f" modify_external_catalogs: true
W20250830 07:54:31.187093 13220 catalog_manager.cc:4908] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet ab7196ca193348f5b4bb9193b731e04f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ab7196ca193348f5b4bb9193b731e04f already in progress: creating tablet
I20250830 07:54:31.187527 13882 tablet_bootstrap.cc:492] T 1ed2d20b0de14631ad8520f4cbd806c2 P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:54:31.189610 13882 tablet_bootstrap.cc:654] T 1ed2d20b0de14631ad8520f4cbd806c2 P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:31.190798 13886 tablet_bootstrap.cc:492] T 50360492db824755a6de251436cab5c6 P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:54:31.191007 13886 ts_tablet_manager.cc:1397] T 50360492db824755a6de251436cab5c6 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.042s user 0.003s sys 0.012s
I20250830 07:54:31.191710 13886 raft_consensus.cc:357] T 50360492db824755a6de251436cab5c6 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:31.191895 13886 raft_consensus.cc:383] T 50360492db824755a6de251436cab5c6 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:31.191973 13886 raft_consensus.cc:738] T 50360492db824755a6de251436cab5c6 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:54:31.192189 13886 consensus_queue.cc:260] T 50360492db824755a6de251436cab5c6 P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:31.192679 13886 ts_tablet_manager.cc:1428] T 50360492db824755a6de251436cab5c6 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20250830 07:54:31.194439 13886 tablet_bootstrap.cc:492] T 1ed2d20b0de14631ad8520f4cbd806c2 P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:54:31.194615 13882 tablet_bootstrap.cc:492] T 1ed2d20b0de14631ad8520f4cbd806c2 P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:54:31.194766 13882 ts_tablet_manager.cc:1397] T 1ed2d20b0de14631ad8520f4cbd806c2 P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.007s user 0.003s sys 0.001s
W20250830 07:54:31.194993 13231 catalog_manager.cc:5415] Ignoring report from unknown tablet 50360492db824755a6de251436cab5c6
I20250830 07:54:31.195016 13466 tablet_service.cc:1515] Processing DeleteTablet for tablet bf170b1865094ba38ef8568259e34656 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:31 UTC) from {username='slave'} at 127.0.0.1:37956
I20250830 07:54:31.195363 13462 tablet_service.cc:1515] Processing DeleteTablet for tablet ab7196ca193348f5b4bb9193b731e04f with delete_type TABLET_DATA_DELETED (replaced by tablet 9d00ee83780e4cf780ca92f1504d26b5) from {username='slave'} at 127.0.0.1:37956
I20250830 07:54:31.195962 13886 tablet_bootstrap.cc:654] T 1ed2d20b0de14631ad8520f4cbd806c2 P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:31.195917 13882 raft_consensus.cc:357] T 1ed2d20b0de14631ad8520f4cbd806c2 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:31.196101 13882 raft_consensus.cc:383] T 1ed2d20b0de14631ad8520f4cbd806c2 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:31.196177 13882 raft_consensus.cc:738] T 1ed2d20b0de14631ad8520f4cbd806c2 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:54:31.196398 13882 consensus_queue.cc:260] T 1ed2d20b0de14631ad8520f4cbd806c2 P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:31.197528 13882 ts_tablet_manager.cc:1428] T 1ed2d20b0de14631ad8520f4cbd806c2 P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20250830 07:54:31.200394 13882 tablet_bootstrap.cc:492] T 9a0c96916f1d4680b8a04d97091384e9 P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:54:31.201866 13882 tablet_bootstrap.cc:654] T 9a0c96916f1d4680b8a04d97091384e9 P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
W20250830 07:54:31.205497 13231 catalog_manager.cc:5415] Ignoring report from unknown tablet 50360492db824755a6de251436cab5c6
I20250830 07:54:31.206022 13233 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_d1d829ffa73f473ab5cef5ebc46d761f" } new_table_name: "default.Table_851f951ca7b5408192a53cd2fa9ac396" modify_external_catalogs: true
W20250830 07:54:31.209654 13225 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a04bf79de30a42a98e71f622efc90c22 has no consensus state
I20250830 07:54:31.210422 13882 tablet_bootstrap.cc:492] T 9a0c96916f1d4680b8a04d97091384e9 P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:54:31.210574 13882 ts_tablet_manager.cc:1397] T 9a0c96916f1d4680b8a04d97091384e9 P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.010s user 0.000s sys 0.002s
W20250830 07:54:31.210752 13218 catalog_manager.cc:4908] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): delete failed for tablet bf170b1865094ba38ef8568259e34656 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bf170b1865094ba38ef8568259e34656 already in progress: creating tablet
W20250830 07:54:31.211093 13218 catalog_manager.cc:4908] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): delete failed for tablet ab7196ca193348f5b4bb9193b731e04f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ab7196ca193348f5b4bb9193b731e04f already in progress: creating tablet
I20250830 07:54:31.211333 13882 raft_consensus.cc:357] T 9a0c96916f1d4680b8a04d97091384e9 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:31.211576 13882 raft_consensus.cc:383] T 9a0c96916f1d4680b8a04d97091384e9 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:31.211685 13882 raft_consensus.cc:738] T 9a0c96916f1d4680b8a04d97091384e9 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:54:31.211951 13882 consensus_queue.cc:260] T 9a0c96916f1d4680b8a04d97091384e9 P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:31.212731 13882 ts_tablet_manager.cc:1428] T 9a0c96916f1d4680b8a04d97091384e9 P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20250830 07:54:31.213047 13882 tablet_bootstrap.cc:492] T 9e055d6089f541f799eddb5778eb2148 P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:54:31.213807 13897 raft_consensus.cc:491] T d0368ce5ffbd48dca5a6674f65f34ce4 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:31.214104 13897 raft_consensus.cc:513] T d0368ce5ffbd48dca5a6674f65f34ce4 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:31.216467 13897 leader_election.cc:290] T d0368ce5ffbd48dca5a6674f65f34ce4 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967)
I20250830 07:54:31.217162 13882 tablet_bootstrap.cc:654] T 9e055d6089f541f799eddb5778eb2148 P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
W20250830 07:54:31.220475 13233 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 4d4b00bdadb24ec892d87c9be2ed7dd9 consensus state has no leader
I20250830 07:54:31.225666 13233 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_09e2fbb8a5854801a399af8b6a6782a3" } modify_external_catalogs: true
I20250830 07:54:31.225857 13233 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_09e2fbb8a5854801a399af8b6a6782a3" } modify_external_catalogs: true
I20250830 07:54:31.230396 13225 master_service.cc:948] ReplaceTablet: received request to replace tablet d0368ce5ffbd48dca5a6674f65f34ce4 from {username='slave'} at 127.0.0.1:42126
I20250830 07:54:31.234961 13233 catalog_manager.cc:5864] Not sending DeleteTablet requests; no consensus state for tablet e7a308ebc0714bbdbbaf68e97bcfbd30
I20250830 07:54:31.236392 13462 tablet_service.cc:1515] Processing DeleteTablet for tablet 50360492db824755a6de251436cab5c6 with delete_type TABLET_DATA_DELETED (replaced by tablet ff0f9cccc8ed43b1a8cd38de0e9d4097) from {username='slave'} at 127.0.0.1:37956
I20250830 07:54:31.236626 13883 tablet_replica.cc:331] T 50360492db824755a6de251436cab5c6 P 2065c332f15a4739899af79f3669c3ba: stopping tablet replica
I20250830 07:54:31.236805 13883 raft_consensus.cc:2241] T 50360492db824755a6de251436cab5c6 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Raft consensus shutting down.
I20250830 07:54:31.236961 13883 raft_consensus.cc:2270] T 50360492db824755a6de251436cab5c6 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Raft consensus is shut down!
I20250830 07:54:31.237687 13883 ts_tablet_manager.cc:1905] T 50360492db824755a6de251436cab5c6 P 2065c332f15a4739899af79f3669c3ba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250830 07:54:31.239197 13605 tablet_service.cc:1515] Processing DeleteTablet for tablet 9e055d6089f541f799eddb5778eb2148 with delete_type TABLET_DATA_DELETED (replaced by tablet 4d4b00bdadb24ec892d87c9be2ed7dd9) from {username='slave'} at 127.0.0.1:45306
I20250830 07:54:31.239408 13606 tablet_service.cc:1515] Processing DeleteTablet for tablet 1ed2d20b0de14631ad8520f4cbd806c2 with delete_type TABLET_DATA_DELETED (replaced by tablet ff2267fb411942ff826e2a72bcb89cd7) from {username='slave'} at 127.0.0.1:45306
I20250830 07:54:31.239574 13609 tablet_service.cc:1515] Processing DeleteTablet for tablet 050e72b96c2d479896b3a54d85e6f6dd with delete_type TABLET_DATA_DELETED (replaced by tablet 9e055d6089f541f799eddb5778eb2148) from {username='slave'} at 127.0.0.1:45306
I20250830 07:54:31.239739 13603 tablet_service.cc:1515] Processing DeleteTablet for tablet 50360492db824755a6de251436cab5c6 with delete_type TABLET_DATA_DELETED (replaced by tablet ff0f9cccc8ed43b1a8cd38de0e9d4097) from {username='slave'} at 127.0.0.1:45306
I20250830 07:54:31.239912 13604 tablet_service.cc:1515] Processing DeleteTablet for tablet b4ab964a64a64e00a78ffd2b220aef46 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:30 UTC) from {username='slave'} at 127.0.0.1:45306
I20250830 07:54:31.240042 13607 tablet_service.cc:1515] Processing DeleteTablet for tablet ff0f9cccc8ed43b1a8cd38de0e9d4097 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:30 UTC) from {username='slave'} at 127.0.0.1:45306
I20250830 07:54:31.240168 13608 tablet_service.cc:1515] Processing DeleteTablet for tablet 32c75568db9b4f00bb567d09dab3d45a with delete_type TABLET_DATA_DELETED (replaced by tablet d2e5255f7bf7435bb8b93c42b42f603a) from {username='slave'} at 127.0.0.1:45306
I20250830 07:54:31.240554 13885 tablet_replica.cc:331] T 1ed2d20b0de14631ad8520f4cbd806c2 P 6b5e454d98894637b466ea27f1b647f9: stopping tablet replica
I20250830 07:54:31.241006 13885 raft_consensus.cc:2241] T 1ed2d20b0de14631ad8520f4cbd806c2 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250830 07:54:31.241389 13885 raft_consensus.cc:2270] T 1ed2d20b0de14631ad8520f4cbd806c2 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Raft consensus is shut down!
W20250830 07:54:31.242066 13220 catalog_manager.cc:4908] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet 9e055d6089f541f799eddb5778eb2148 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9e055d6089f541f799eddb5778eb2148 already in progress: creating tablet
W20250830 07:54:31.243630 13233 catalog_manager.cc:5415] Ignoring report from unknown tablet 50360492db824755a6de251436cab5c6
I20250830 07:54:31.245319 13885 ts_tablet_manager.cc:1905] T 1ed2d20b0de14631ad8520f4cbd806c2 P 6b5e454d98894637b466ea27f1b647f9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250830 07:54:31.245720 13462 tablet_service.cc:1515] Processing DeleteTablet for tablet 1ed2d20b0de14631ad8520f4cbd806c2 with delete_type TABLET_DATA_DELETED (replaced by tablet ff2267fb411942ff826e2a72bcb89cd7) from {username='slave'} at 127.0.0.1:37956
I20250830 07:54:31.245954 13897 raft_consensus.cc:491] T 050e72b96c2d479896b3a54d85e6f6dd P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:31.246156 13897 raft_consensus.cc:513] T 050e72b96c2d479896b3a54d85e6f6dd P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:31.247560 13225 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet d0368ce5ffbd48dca5a6674f65f34ce4
I20250830 07:54:31.248018 13225 catalog_manager.cc:6652] ReplaceTablet: tablet d0368ce5ffbd48dca5a6674f65f34ce4 deleted and replaced by tablet ccc90f6c867147cc9fe93c9ffa2e4802
I20250830 07:54:31.248163 13462 tablet_service.cc:1515] Processing DeleteTablet for tablet d0368ce5ffbd48dca5a6674f65f34ce4 with delete_type TABLET_DATA_DELETED (replaced by tablet ccc90f6c867147cc9fe93c9ffa2e4802) from {username='slave'} at 127.0.0.1:37956
I20250830 07:54:31.248528 13897 leader_election.cc:290] T 050e72b96c2d479896b3a54d85e6f6dd P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967)
I20250830 07:54:31.249632 13751 tablet_service.cc:1515] Processing DeleteTablet for tablet d0368ce5ffbd48dca5a6674f65f34ce4 with delete_type TABLET_DATA_DELETED (replaced by tablet ccc90f6c867147cc9fe93c9ffa2e4802) from {username='slave'} at 127.0.0.1:45460
I20250830 07:54:31.249912 13884 tablet_replica.cc:331] T d0368ce5ffbd48dca5a6674f65f34ce4 P 9b057ade5dce45af9f8bf0bedf8b917f: stopping tablet replica
I20250830 07:54:31.250316 13884 raft_consensus.cc:2241] T d0368ce5ffbd48dca5a6674f65f34ce4 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Raft consensus shutting down.
I20250830 07:54:31.250656 13884 raft_consensus.cc:2270] T d0368ce5ffbd48dca5a6674f65f34ce4 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Raft consensus is shut down!
W20250830 07:54:31.251579 13823 tablet.cc:2378] T 050e72b96c2d479896b3a54d85e6f6dd P 9b057ade5dce45af9f8bf0bedf8b917f: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20250830 07:54:31.251603 13608 tablet_service.cc:1515] Processing DeleteTablet for tablet d0368ce5ffbd48dca5a6674f65f34ce4 with delete_type TABLET_DATA_DELETED (replaced by tablet ccc90f6c867147cc9fe93c9ffa2e4802) from {username='slave'} at 127.0.0.1:45306
I20250830 07:54:31.252696 13884 ts_tablet_manager.cc:1905] T d0368ce5ffbd48dca5a6674f65f34ce4 P 9b057ade5dce45af9f8bf0bedf8b917f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250830 07:54:31.257515 13883 ts_tablet_manager.cc:1918] T 50360492db824755a6de251436cab5c6 P 2065c332f15a4739899af79f3669c3ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250830 07:54:31.257709 13883 log.cc:1199] T 50360492db824755a6de251436cab5c6 P 2065c332f15a4739899af79f3669c3ba: Deleting WAL directory at /tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/ts-0/wal/wals/50360492db824755a6de251436cab5c6
I20250830 07:54:31.258162 13883 ts_tablet_manager.cc:1939] T 50360492db824755a6de251436cab5c6 P 2065c332f15a4739899af79f3669c3ba: Deleting consensus metadata
I20250830 07:54:31.259132 13883 tablet_replica.cc:331] T 1ed2d20b0de14631ad8520f4cbd806c2 P 2065c332f15a4739899af79f3669c3ba: stopping tablet replica
I20250830 07:54:31.259171 13218 catalog_manager.cc:4928] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): tablet 50360492db824755a6de251436cab5c6 (table default.Table_ff52f3bbd91f46538ff26c0933cf8bb8 [id=b3a33553134d4583a4fd9ff4f08a2ed8]) successfully deleted
I20250830 07:54:31.259400 13883 raft_consensus.cc:2241] T 1ed2d20b0de14631ad8520f4cbd806c2 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Raft consensus shutting down.
I20250830 07:54:31.259611 13883 raft_consensus.cc:2270] T 1ed2d20b0de14631ad8520f4cbd806c2 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Raft consensus is shut down!
I20250830 07:54:31.260449 13883 ts_tablet_manager.cc:1905] T 1ed2d20b0de14631ad8520f4cbd806c2 P 2065c332f15a4739899af79f3669c3ba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250830 07:54:31.262596 13885 ts_tablet_manager.cc:1918] T 1ed2d20b0de14631ad8520f4cbd806c2 P 6b5e454d98894637b466ea27f1b647f9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250830 07:54:31.262741 13885 log.cc:1199] T 1ed2d20b0de14631ad8520f4cbd806c2 P 6b5e454d98894637b466ea27f1b647f9: Deleting WAL directory at /tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/ts-1/wal/wals/1ed2d20b0de14631ad8520f4cbd806c2
I20250830 07:54:31.265489 13629 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "9a0c96916f1d4680b8a04d97091384e9" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:31.265923 13629 raft_consensus.cc:2466] T 9a0c96916f1d4680b8a04d97091384e9 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2065c332f15a4739899af79f3669c3ba in term 0.
W20250830 07:54:31.266163 13677 tablet.cc:2378] T 050e72b96c2d479896b3a54d85e6f6dd P 6b5e454d98894637b466ea27f1b647f9: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20250830 07:54:31.266662 13423 leader_election.cc:304] T 9a0c96916f1d4680b8a04d97091384e9 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 6b5e454d98894637b466ea27f1b647f9; no voters:
I20250830 07:54:31.267038 13894 raft_consensus.cc:2802] T 9a0c96916f1d4680b8a04d97091384e9 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:54:31.267187 13894 raft_consensus.cc:491] T 9a0c96916f1d4680b8a04d97091384e9 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:54:31.267319 13894 raft_consensus.cc:3058] T 9a0c96916f1d4680b8a04d97091384e9 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:31.268338 13884 ts_tablet_manager.cc:1918] T d0368ce5ffbd48dca5a6674f65f34ce4 P 9b057ade5dce45af9f8bf0bedf8b917f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250830 07:54:31.268651 13884 log.cc:1199] T d0368ce5ffbd48dca5a6674f65f34ce4 P 9b057ade5dce45af9f8bf0bedf8b917f: Deleting WAL directory at /tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/ts-2/wal/wals/d0368ce5ffbd48dca5a6674f65f34ce4
I20250830 07:54:31.269100 13884 ts_tablet_manager.cc:1939] T d0368ce5ffbd48dca5a6674f65f34ce4 P 9b057ade5dce45af9f8bf0bedf8b917f: Deleting consensus metadata
I20250830 07:54:31.270084 13894 raft_consensus.cc:513] T 9a0c96916f1d4680b8a04d97091384e9 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:31.270339 13885 ts_tablet_manager.cc:1939] T 1ed2d20b0de14631ad8520f4cbd806c2 P 6b5e454d98894637b466ea27f1b647f9: Deleting consensus metadata
I20250830 07:54:31.270690 13219 catalog_manager.cc:4928] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): tablet d0368ce5ffbd48dca5a6674f65f34ce4 (table default.Table_73b4932d2b1249be9861511738a09a91 [id=1b7c141ed8af4dcab20683653fd59ee1]) successfully deleted
I20250830 07:54:31.270769 13894 leader_election.cc:290] T 9a0c96916f1d4680b8a04d97091384e9 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 election: Requested vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:31.271327 13629 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "9a0c96916f1d4680b8a04d97091384e9" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9"
I20250830 07:54:31.271503 13629 raft_consensus.cc:3058] T 9a0c96916f1d4680b8a04d97091384e9 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:31.272166 13220 catalog_manager.cc:4928] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): tablet 1ed2d20b0de14631ad8520f4cbd806c2 (table default.Table_bbcc6dca6db246f6935808d28432e28c [id=903638fdb4e845769c8092fb6f5bead4]) successfully deleted
I20250830 07:54:31.272541 13885 tablet_replica.cc:331] T 050e72b96c2d479896b3a54d85e6f6dd P 6b5e454d98894637b466ea27f1b647f9: stopping tablet replica
I20250830 07:54:31.273342 13234 master_service.cc:948] ReplaceTablet: received request to replace tablet bf170b1865094ba38ef8568259e34656 from {username='slave'} at 127.0.0.1:42126
I20250830 07:54:31.273451 13225 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_4b9f002c2a2948c8b913731aaba44e17"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:31.273937 13225 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4b9f002c2a2948c8b913731aaba44e17 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:31.274161 13629 raft_consensus.cc:2466] T 9a0c96916f1d4680b8a04d97091384e9 P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2065c332f15a4739899af79f3669c3ba in term 1.
I20250830 07:54:31.274726 13423 leader_election.cc:304] T 9a0c96916f1d4680b8a04d97091384e9 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 6b5e454d98894637b466ea27f1b647f9; no voters:
I20250830 07:54:31.275013 13894 raft_consensus.cc:2802] T 9a0c96916f1d4680b8a04d97091384e9 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election won for term 1
I20250830 07:54:31.280529 13886 tablet_bootstrap.cc:492] T 1ed2d20b0de14631ad8520f4cbd806c2 P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:54:31.280774 13886 ts_tablet_manager.cc:1397] T 1ed2d20b0de14631ad8520f4cbd806c2 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.086s user 0.014s sys 0.013s
I20250830 07:54:31.281214 13234 master_service.cc:948] ReplaceTablet: received request to replace tablet bf170b1865094ba38ef8568259e34656 from {username='slave'} at 127.0.0.1:42126
I20250830 07:54:31.283917 13234 master_service.cc:948] ReplaceTablet: received request to replace tablet ab7196ca193348f5b4bb9193b731e04f from {username='slave'} at 127.0.0.1:42126
I20250830 07:54:31.284803 13886 raft_consensus.cc:357] T 1ed2d20b0de14631ad8520f4cbd806c2 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:31.285324 13233 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_b4d9eb5b2f1546b7aa8219ee394f849e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250830 07:54:31.285495 13886 raft_consensus.cc:383] T 1ed2d20b0de14631ad8520f4cbd806c2 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20250830 07:54:31.286136 13233 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b4d9eb5b2f1546b7aa8219ee394f849e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:31.285732 13886 raft_consensus.cc:738] T 1ed2d20b0de14631ad8520f4cbd806c2 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:54:31.288214 13774 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "9a0c96916f1d4680b8a04d97091384e9" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f"
I20250830 07:54:31.288597 13775 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "9a0c96916f1d4680b8a04d97091384e9" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:31.288679 13774 raft_consensus.cc:3058] T 9a0c96916f1d4680b8a04d97091384e9 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:31.291019 13751 tablet_service.cc:1468] Processing CreateTablet for tablet 5ce773ce68f649b1bf51f0dd901cb04f (DEFAULT_TABLE table=default.Table_ca148790caf146b0b02b54ae9f70c339 [id=804faceb2bab448f957a78a208058464]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:31.291456 13751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ce773ce68f649b1bf51f0dd901cb04f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:31.292358 13774 raft_consensus.cc:2466] T 9a0c96916f1d4680b8a04d97091384e9 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2065c332f15a4739899af79f3669c3ba in term 1.
I20250830 07:54:31.293525 13886 consensus_queue.cc:260] T 1ed2d20b0de14631ad8520f4cbd806c2 P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:31.297255 13608 tablet_service.cc:1468] Processing CreateTablet for tablet 5ce773ce68f649b1bf51f0dd901cb04f (DEFAULT_TABLE table=default.Table_ca148790caf146b0b02b54ae9f70c339 [id=804faceb2bab448f957a78a208058464]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:31.297688 13608 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ce773ce68f649b1bf51f0dd901cb04f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:31.297923 13602 tablet_service.cc:1468] Processing CreateTablet for tablet f398e12cd9f543738d5163354f8a9d9d (DEFAULT_TABLE table=default.Table_0598a47b9b6b42108694e5826c8a404e [id=8bbfd80ea8444f64bf1c7f3454f10c1c]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:31.298051 13463 tablet_service.cc:1468] Processing CreateTablet for tablet 5aef6fd239ba43478cd978fa5d29b26e (DEFAULT_TABLE table=default.Table_5bfb094fe761440791baa2854483575e [id=2613df4d7a194a54bcce5d19996146f0]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:31.298345 13882 tablet_bootstrap.cc:492] T 9e055d6089f541f799eddb5778eb2148 P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:54:31.298424 13463 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5aef6fd239ba43478cd978fa5d29b26e. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:31.298471 13602 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f398e12cd9f543738d5163354f8a9d9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:31.298530 13882 ts_tablet_manager.cc:1397] T 9e055d6089f541f799eddb5778eb2148 P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.086s user 0.001s sys 0.020s
I20250830 07:54:31.299328 13607 tablet_service.cc:1468] Processing CreateTablet for tablet 4ab63ff59d4e4ec2b7b64d605545a870 (DEFAULT_TABLE table=default.Table_4797c3da60c948e78efc613061d25afe [id=caf15fe0ba094c2d97132c61a0dab864]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:31.299618 13607 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ab63ff59d4e4ec2b7b64d605545a870. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:31.300262 13604 tablet_service.cc:1468] Processing CreateTablet for tablet 0a7c368f47aa41d896f5a3c3c20918c6 (DEFAULT_TABLE table=default.Table_bee6dfde82b1440fa69d12c01819a359 [id=6285b1fe4aa14eef9358b69d114ef2ef]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:31.300581 13604 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a7c368f47aa41d896f5a3c3c20918c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:31.301074 13464 tablet_service.cc:1468] Processing CreateTablet for tablet a04bf79de30a42a98e71f622efc90c22 (DEFAULT_TABLE table=default.Table_f817d6b952384e64a8b6be555cc4db2f [id=320265dd7ec24f44acaec48bd44472db]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:31.301244 13603 tablet_service.cc:1468] Processing CreateTablet for tablet 9d00ee83780e4cf780ca92f1504d26b5 (DEFAULT_TABLE table=default.Table_74f3c73d22574737b5f6a4bd256e423d [id=55f67297d5ac42c280ea932d74e3ad37]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:31.301532 13603 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d00ee83780e4cf780ca92f1504d26b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:31.301532 13464 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a04bf79de30a42a98e71f622efc90c22. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:31.302188 13609 tablet_service.cc:1468] Processing CreateTablet for tablet ff2267fb411942ff826e2a72bcb89cd7 (DEFAULT_TABLE table=default.Table_bbcc6dca6db246f6935808d28432e28c [id=903638fdb4e845769c8092fb6f5bead4]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:31.302471 13609 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff2267fb411942ff826e2a72bcb89cd7. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:31.303135 13606 tablet_service.cc:1468] Processing CreateTablet for tablet a04bf79de30a42a98e71f622efc90c22 (DEFAULT_TABLE table=default.Table_f817d6b952384e64a8b6be555cc4db2f [id=320265dd7ec24f44acaec48bd44472db]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:31.303162 13461 tablet_service.cc:1468] Processing CreateTablet for tablet f398e12cd9f543738d5163354f8a9d9d (DEFAULT_TABLE table=default.Table_0598a47b9b6b42108694e5826c8a404e [id=8bbfd80ea8444f64bf1c7f3454f10c1c]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:31.303975 13461 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f398e12cd9f543738d5163354f8a9d9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:31.303998 13606 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a04bf79de30a42a98e71f622efc90c22. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:31.304677 13605 tablet_service.cc:1468] Processing CreateTablet for tablet 5aef6fd239ba43478cd978fa5d29b26e (DEFAULT_TABLE table=default.Table_5bfb094fe761440791baa2854483575e [id=2613df4d7a194a54bcce5d19996146f0]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:31.305114 13601 tablet_service.cc:1468] Processing CreateTablet for tablet 7ef98dbbdf5848038a2da6140e126301 (DEFAULT_TABLE table=default.Table_a4a92fab99e5433580288411b9610fb1 [id=b51964a7d7d14d6db2fd35783c905bbc]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:31.305528 13601 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7ef98dbbdf5848038a2da6140e126301. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:31.306308 13466 tablet_service.cc:1468] Processing CreateTablet for tablet 4ab63ff59d4e4ec2b7b64d605545a870 (DEFAULT_TABLE table=default.Table_4797c3da60c948e78efc613061d25afe [id=caf15fe0ba094c2d97132c61a0dab864]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:31.306633 13466 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ab63ff59d4e4ec2b7b64d605545a870. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:31.307508 13882 raft_consensus.cc:357] T 9e055d6089f541f799eddb5778eb2148 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:31.307699 13882 raft_consensus.cc:383] T 9e055d6089f541f799eddb5778eb2148 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:31.307773 13882 raft_consensus.cc:738] T 9e055d6089f541f799eddb5778eb2148 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:54:31.307998 13882 consensus_queue.cc:260] T 9e055d6089f541f799eddb5778eb2148 P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:31.308136 13462 tablet_service.cc:1468] Processing CreateTablet for tablet 5ce773ce68f649b1bf51f0dd901cb04f (DEFAULT_TABLE table=default.Table_ca148790caf146b0b02b54ae9f70c339 [id=804faceb2bab448f957a78a208058464]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:31.308458 13462 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ce773ce68f649b1bf51f0dd901cb04f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:31.308496 13882 ts_tablet_manager.cc:1428] T 9e055d6089f541f799eddb5778eb2148 P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.010s user 0.000s sys 0.001s
I20250830 07:54:31.308786 13882 tablet_bootstrap.cc:492] T ff0f9cccc8ed43b1a8cd38de0e9d4097 P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:54:31.310806 13882 tablet_bootstrap.cc:654] T ff0f9cccc8ed43b1a8cd38de0e9d4097 P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:31.311117 13467 tablet_service.cc:1468] Processing CreateTablet for tablet 0a7c368f47aa41d896f5a3c3c20918c6 (DEFAULT_TABLE table=default.Table_bee6dfde82b1440fa69d12c01819a359 [id=6285b1fe4aa14eef9358b69d114ef2ef]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:31.311470 13467 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a7c368f47aa41d896f5a3c3c20918c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:31.314517 13883 ts_tablet_manager.cc:1918] T 1ed2d20b0de14631ad8520f4cbd806c2 P 2065c332f15a4739899af79f3669c3ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250830 07:54:31.314646 13883 log.cc:1199] T 1ed2d20b0de14631ad8520f4cbd806c2 P 2065c332f15a4739899af79f3669c3ba: Deleting WAL directory at /tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/ts-0/wal/wals/1ed2d20b0de14631ad8520f4cbd806c2
I20250830 07:54:31.315043 13465 tablet_service.cc:1468] Processing CreateTablet for tablet 9d00ee83780e4cf780ca92f1504d26b5 (DEFAULT_TABLE table=default.Table_74f3c73d22574737b5f6a4bd256e423d [id=55f67297d5ac42c280ea932d74e3ad37]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:31.315379 13465 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d00ee83780e4cf780ca92f1504d26b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:31.316428 13124 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskbivBUj/build/asan/bin/kudu with pid 13272
I20250830 07:54:31.319173 13468 tablet_service.cc:1468] Processing CreateTablet for tablet ff2267fb411942ff826e2a72bcb89cd7 (DEFAULT_TABLE table=default.Table_bbcc6dca6db246f6935808d28432e28c [id=903638fdb4e845769c8092fb6f5bead4]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:31.319427 13885 raft_consensus.cc:2241] T 050e72b96c2d479896b3a54d85e6f6dd P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250830 07:54:31.319533 13468 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff2267fb411942ff826e2a72bcb89cd7. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:31.319624 13885 raft_consensus.cc:2270] T 050e72b96c2d479896b3a54d85e6f6dd P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250830 07:54:31.320031 13894 raft_consensus.cc:695] T 9a0c96916f1d4680b8a04d97091384e9 P 2065c332f15a4739899af79f3669c3ba [term 1 LEADER]: Becoming Leader. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Running, Role: LEADER
I20250830 07:54:31.320570 13885 ts_tablet_manager.cc:1905] T 050e72b96c2d479896b3a54d85e6f6dd P 6b5e454d98894637b466ea27f1b647f9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250830 07:54:31.320539 13894 consensus_queue.cc:237] T 9a0c96916f1d4680b8a04d97091384e9 P 2065c332f15a4739899af79f3669c3ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:31.320729 13488 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "d0368ce5ffbd48dca5a6674f65f34ce4" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:54:31.326880 13885 ts_tablet_manager.cc:1918] T 050e72b96c2d479896b3a54d85e6f6dd P 6b5e454d98894637b466ea27f1b647f9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250830 07:54:31.327054 13885 log.cc:1199] T 050e72b96c2d479896b3a54d85e6f6dd P 6b5e454d98894637b466ea27f1b647f9: Deleting WAL directory at /tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/ts-1/wal/wals/050e72b96c2d479896b3a54d85e6f6dd
I20250830 07:54:31.327622 13885 ts_tablet_manager.cc:1939] T 050e72b96c2d479896b3a54d85e6f6dd P 6b5e454d98894637b466ea27f1b647f9: Deleting consensus metadata
I20250830 07:54:31.327646 13883 ts_tablet_manager.cc:1939] T 1ed2d20b0de14631ad8520f4cbd806c2 P 2065c332f15a4739899af79f3669c3ba: Deleting consensus metadata
I20250830 07:54:31.307225 13460 tablet_service.cc:1468] Processing CreateTablet for tablet 7ef98dbbdf5848038a2da6140e126301 (DEFAULT_TABLE table=default.Table_a4a92fab99e5433580288411b9610fb1 [id=b51964a7d7d14d6db2fd35783c905bbc]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:31.328490 13460 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7ef98dbbdf5848038a2da6140e126301. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:31.328604 13885 tablet_replica.cc:331] T 50360492db824755a6de251436cab5c6 P 6b5e454d98894637b466ea27f1b647f9: stopping tablet replica
I20250830 07:54:31.328830 13885 raft_consensus.cc:2241] T 50360492db824755a6de251436cab5c6 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250830 07:54:31.329023 13885 raft_consensus.cc:2270] T 50360492db824755a6de251436cab5c6 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250830 07:54:31.295264 13750 tablet_service.cc:1468] Processing CreateTablet for tablet 4ab63ff59d4e4ec2b7b64d605545a870 (DEFAULT_TABLE table=default.Table_4797c3da60c948e78efc613061d25afe [id=caf15fe0ba094c2d97132c61a0dab864]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:31.329440 13750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ab63ff59d4e4ec2b7b64d605545a870. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:31.331645 13218 catalog_manager.cc:4928] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): tablet 1ed2d20b0de14631ad8520f4cbd806c2 (table default.Table_bbcc6dca6db246f6935808d28432e28c [id=903638fdb4e845769c8092fb6f5bead4]) successfully deleted
I20250830 07:54:31.331876 13882 tablet_bootstrap.cc:492] T ff0f9cccc8ed43b1a8cd38de0e9d4097 P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
W20250830 07:54:31.331890 13218 catalog_manager.cc:4908] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): delete failed for tablet d0368ce5ffbd48dca5a6674f65f34ce4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d0368ce5ffbd48dca5a6674f65f34ce4 already in progress: creating tablet
I20250830 07:54:31.332024 13882 ts_tablet_manager.cc:1397] T ff0f9cccc8ed43b1a8cd38de0e9d4097 P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.023s user 0.000s sys 0.003s
I20250830 07:54:31.332172 13220 catalog_manager.cc:4928] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): tablet 050e72b96c2d479896b3a54d85e6f6dd (table default.Table_851f951ca7b5408192a53cd2fa9ac396 [id=d2dbb756d66b483ebe44d45ddfa5c17c]) successfully deleted
I20250830 07:54:31.332912 13882 raft_consensus.cc:357] T ff0f9cccc8ed43b1a8cd38de0e9d4097 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:31.333112 13882 raft_consensus.cc:383] T ff0f9cccc8ed43b1a8cd38de0e9d4097 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:31.333662 13882 raft_consensus.cc:738] T ff0f9cccc8ed43b1a8cd38de0e9d4097 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:54:31.333923 13882 consensus_queue.cc:260] T ff0f9cccc8ed43b1a8cd38de0e9d4097 P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:31.297107 13754 tablet_service.cc:1468] Processing CreateTablet for tablet 0a7c368f47aa41d896f5a3c3c20918c6 (DEFAULT_TABLE table=default.Table_bee6dfde82b1440fa69d12c01819a359 [id=6285b1fe4aa14eef9358b69d114ef2ef]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:31.334636 13754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a7c368f47aa41d896f5a3c3c20918c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:31.335565 13882 ts_tablet_manager.cc:1428] T ff0f9cccc8ed43b1a8cd38de0e9d4097 P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20250830 07:54:31.335801 13231 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_9ad526f4ffd34dcab23696e310ec0e77"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:31.336381 13231 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9ad526f4ffd34dcab23696e310ec0e77 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:31.336462 13882 tablet_bootstrap.cc:492] T b4ab964a64a64e00a78ffd2b220aef46 P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:54:31.337664 13232 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_8aa66646279342caa1f1557d5b2c3fe3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:31.338104 13232 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8aa66646279342caa1f1557d5b2c3fe3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:31.299520 13752 tablet_service.cc:1468] Processing CreateTablet for tablet 9d00ee83780e4cf780ca92f1504d26b5 (DEFAULT_TABLE table=default.Table_74f3c73d22574737b5f6a4bd256e423d [id=55f67297d5ac42c280ea932d74e3ad37]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:31.338769 13752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d00ee83780e4cf780ca92f1504d26b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:31.339188 13229 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_e0f8d99dbe3946ada0b16f2b86531730"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:31.339573 13229 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e0f8d99dbe3946ada0b16f2b86531730 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:31.340651 13228 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_c22cc304586645d5b59c046388863abe"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:31.341074 13228 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c22cc304586645d5b59c046388863abe in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:31.341251 13882 tablet_bootstrap.cc:654] T b4ab964a64a64e00a78ffd2b220aef46 P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:31.342195 13230 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_6a92a1708f7e46089983abe2263370f8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:31.342610 13230 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6a92a1708f7e46089983abe2263370f8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:31.343114 13227 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_73b4932d2b1249be9861511738a09a91" } new_table_name: "default.Table_737f5bb11c3f4b8e8d26b08fd43afa45" modify_external_catalogs: true
I20250830 07:54:31.343194 13234 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_1b4013fe42164beba1712685c4269acd"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:31.343624 13234 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1b4013fe42164beba1712685c4269acd in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:31.300172 13753 tablet_service.cc:1468] Processing CreateTablet for tablet a04bf79de30a42a98e71f622efc90c22 (DEFAULT_TABLE table=default.Table_f817d6b952384e64a8b6be555cc4db2f [id=320265dd7ec24f44acaec48bd44472db]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:31.344921 13753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a04bf79de30a42a98e71f622efc90c22. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:31.300577 13755 tablet_service.cc:1468] Processing CreateTablet for tablet 5aef6fd239ba43478cd978fa5d29b26e (DEFAULT_TABLE table=default.Table_5bfb094fe761440791baa2854483575e [id=2613df4d7a194a54bcce5d19996146f0]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:31.347196 13755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5aef6fd239ba43478cd978fa5d29b26e. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:31.307205 13748 tablet_service.cc:1468] Processing CreateTablet for tablet f398e12cd9f543738d5163354f8a9d9d (DEFAULT_TABLE table=default.Table_0598a47b9b6b42108694e5826c8a404e [id=8bbfd80ea8444f64bf1c7f3454f10c1c]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:31.351267 13748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f398e12cd9f543738d5163354f8a9d9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:31.307634 13747 tablet_service.cc:1468] Processing CreateTablet for tablet 7ef98dbbdf5848038a2da6140e126301 (DEFAULT_TABLE table=default.Table_a4a92fab99e5433580288411b9610fb1 [id=b51964a7d7d14d6db2fd35783c905bbc]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:31.355288 13747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7ef98dbbdf5848038a2da6140e126301. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:31.308015 13749 tablet_service.cc:1468] Processing CreateTablet for tablet ff2267fb411942ff826e2a72bcb89cd7 (DEFAULT_TABLE table=default.Table_bbcc6dca6db246f6935808d28432e28c [id=903638fdb4e845769c8092fb6f5bead4]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:31.359292 13749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff2267fb411942ff826e2a72bcb89cd7. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:31.359292 13899 raft_consensus.cc:491] T d0368ce5ffbd48dca5a6674f65f34ce4 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:31.359488 13899 raft_consensus.cc:513] T d0368ce5ffbd48dca5a6674f65f34ce4 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:31.361621 13899 leader_election.cc:290] T d0368ce5ffbd48dca5a6674f65f34ce4 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
W20250830 07:54:31.321828 13701 leader_election.cc:343] T d0368ce5ffbd48dca5a6674f65f34ce4 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): Illegal state: must be running to vote when last-logged opid is not known
W20250830 07:54:31.364748 13701 leader_election.cc:343] T 050e72b96c2d479896b3a54d85e6f6dd P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): Not found: Tablet not found: 050e72b96c2d479896b3a54d85e6f6dd
I20250830 07:54:31.368476 13882 tablet_bootstrap.cc:492] T b4ab964a64a64e00a78ffd2b220aef46 P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:54:31.368700 13882 ts_tablet_manager.cc:1397] T b4ab964a64a64e00a78ffd2b220aef46 P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.033s user 0.000s sys 0.007s
I20250830 07:54:31.369757 13882 raft_consensus.cc:357] T b4ab964a64a64e00a78ffd2b220aef46 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:31.369990 13882 raft_consensus.cc:383] T b4ab964a64a64e00a78ffd2b220aef46 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:31.370080 13882 raft_consensus.cc:738] T b4ab964a64a64e00a78ffd2b220aef46 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:54:31.370389 13882 consensus_queue.cc:260] T b4ab964a64a64e00a78ffd2b220aef46 P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:31.371076 13882 ts_tablet_manager.cc:1428] T b4ab964a64a64e00a78ffd2b220aef46 P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.002s user 0.000s sys 0.003s
I20250830 07:54:31.371250 13605 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5aef6fd239ba43478cd978fa5d29b26e. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:31.371577 13882 tablet_bootstrap.cc:492] T bf170b1865094ba38ef8568259e34656 P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:54:31.375018 13882 tablet_bootstrap.cc:654] T bf170b1865094ba38ef8568259e34656 P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:31.379202 13885 ts_tablet_manager.cc:1905] T 50360492db824755a6de251436cab5c6 P 6b5e454d98894637b466ea27f1b647f9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250830 07:54:31.380594 13225 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_c493813f589c4cf98350d55f9223c63b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:31.381131 13225 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c493813f589c4cf98350d55f9223c63b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:31.386147 13882 tablet_bootstrap.cc:492] T bf170b1865094ba38ef8568259e34656 P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:54:31.386313 13882 ts_tablet_manager.cc:1397] T bf170b1865094ba38ef8568259e34656 P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.015s user 0.008s sys 0.004s
I20250830 07:54:31.387136 13882 raft_consensus.cc:357] T bf170b1865094ba38ef8568259e34656 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:31.387492 13882 raft_consensus.cc:383] T bf170b1865094ba38ef8568259e34656 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:31.387607 13882 raft_consensus.cc:738] T bf170b1865094ba38ef8568259e34656 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:54:31.387842 13882 consensus_queue.cc:260] T bf170b1865094ba38ef8568259e34656 P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:31.388937 13886 ts_tablet_manager.cc:1428] T 1ed2d20b0de14631ad8520f4cbd806c2 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.108s user 0.001s sys 0.001s
I20250830 07:54:31.389402 13882 ts_tablet_manager.cc:1428] T bf170b1865094ba38ef8568259e34656 P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20250830 07:54:31.389686 13882 tablet_bootstrap.cc:492] T 32c75568db9b4f00bb567d09dab3d45a P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:54:31.389992 13886 tablet_bootstrap.cc:492] T 9e055d6089f541f799eddb5778eb2148 P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:54:31.391353 13882 tablet_bootstrap.cc:654] T 32c75568db9b4f00bb567d09dab3d45a P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:31.393047 13886 tablet_bootstrap.cc:654] T 9e055d6089f541f799eddb5778eb2148 P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:31.393975 13885 ts_tablet_manager.cc:1918] T 50360492db824755a6de251436cab5c6 P 6b5e454d98894637b466ea27f1b647f9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250830 07:54:31.396895 13629 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "d0368ce5ffbd48dca5a6674f65f34ce4" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:31.397974 13629 raft_consensus.cc:2466] T d0368ce5ffbd48dca5a6674f65f34ce4 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 0.
I20250830 07:54:31.398372 13885 log.cc:1199] T 50360492db824755a6de251436cab5c6 P 6b5e454d98894637b466ea27f1b647f9: Deleting WAL directory at /tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/ts-1/wal/wals/50360492db824755a6de251436cab5c6
I20250830 07:54:31.398928 13885 ts_tablet_manager.cc:1939] T 50360492db824755a6de251436cab5c6 P 6b5e454d98894637b466ea27f1b647f9: Deleting consensus metadata
I20250830 07:54:31.400096 13882 tablet_bootstrap.cc:492] T 32c75568db9b4f00bb567d09dab3d45a P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
W20250830 07:54:31.397512 13703 leader_election.cc:343] T 050e72b96c2d479896b3a54d85e6f6dd P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Not found: Tablet not found: 050e72b96c2d479896b3a54d85e6f6dd
I20250830 07:54:31.400254 13882 ts_tablet_manager.cc:1397] T 32c75568db9b4f00bb567d09dab3d45a P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.011s user 0.007s sys 0.002s
I20250830 07:54:31.400336 13220 catalog_manager.cc:4928] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): tablet 50360492db824755a6de251436cab5c6 (table default.Table_ff52f3bbd91f46538ff26c0933cf8bb8 [id=b3a33553134d4583a4fd9ff4f08a2ed8]) successfully deleted
I20250830 07:54:31.400327 13703 leader_election.cc:304] T 050e72b96c2d479896b3a54d85e6f6dd P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 2065c332f15a4739899af79f3669c3ba, 6b5e454d98894637b466ea27f1b647f9
I20250830 07:54:31.401036 13703 leader_election.cc:304] T d0368ce5ffbd48dca5a6674f65f34ce4 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 2065c332f15a4739899af79f3669c3ba
I20250830 07:54:31.400986 13882 raft_consensus.cc:357] T 32c75568db9b4f00bb567d09dab3d45a P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:54:31.401162 13882 raft_consensus.cc:383] T 32c75568db9b4f00bb567d09dab3d45a P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20250830 07:54:31.401238 13703 raft_consensus.cc:2684] T d0368ce5ffbd48dca5a6674f65f34ce4 P 9b057ade5dce45af9f8bf0bedf8b917f: unable to run election callback: Service unavailable: Thread pool token was shut down
I20250830 07:54:31.401258 13882 raft_consensus.cc:738] T 32c75568db9b4f00bb567d09dab3d45a P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:54:31.401512 13882 consensus_queue.cc:260] T 32c75568db9b4f00bb567d09dab3d45a P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:54:31.402446 13897 raft_consensus.cc:2747] T 050e72b96c2d479896b3a54d85e6f6dd P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:54:31.403182 13882 ts_tablet_manager.cc:1428] T 32c75568db9b4f00bb567d09dab3d45a P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
W20250830 07:54:31.403330 13562 leader_election.cc:343] T d0368ce5ffbd48dca5a6674f65f34ce4 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Not found: Tablet not found: d0368ce5ffbd48dca5a6674f65f34ce4
I20250830 07:54:31.404726 13882 tablet_bootstrap.cc:492] T 778f6766c47f4a86b5dea60560f67d5c P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:54:31.405072 13885 tablet_replica.cc:331] T b4ab964a64a64e00a78ffd2b220aef46 P 6b5e454d98894637b466ea27f1b647f9: stopping tablet replica
I20250830 07:54:31.405498 13885 raft_consensus.cc:2241] T b4ab964a64a64e00a78ffd2b220aef46 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250830 07:54:31.406123 13885 raft_consensus.cc:2270] T b4ab964a64a64e00a78ffd2b220aef46 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250830 07:54:31.406841 13882 tablet_bootstrap.cc:654] T 778f6766c47f4a86b5dea60560f67d5c P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:31.414080 13233 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_5de39b3a49f54e41b06a8178dd641fd8" } new_table_name: "default.Table_1bad683bf46c49aa8c24cd18c2c2e990" modify_external_catalogs: true
I20250830 07:54:31.414942 13882 tablet_bootstrap.cc:492] T 778f6766c47f4a86b5dea60560f67d5c P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:54:31.415056 13882 ts_tablet_manager.cc:1397] T 778f6766c47f4a86b5dea60560f67d5c P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.010s user 0.009s sys 0.001s
I20250830 07:54:31.415378 13231 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_73583ac06db64766bc040f852a5a5fbe"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250830 07:54:31.415738 13882 raft_consensus.cc:357] T 778f6766c47f4a86b5dea60560f67d5c P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:54:31.415908 13882 raft_consensus.cc:383] T 778f6766c47f4a86b5dea60560f67d5c P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20250830 07:54:31.415925 13231 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_73583ac06db64766bc040f852a5a5fbe in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:31.415997 13882 raft_consensus.cc:738] T 778f6766c47f4a86b5dea60560f67d5c P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:54:31.416213 13882 consensus_queue.cc:260] T 778f6766c47f4a86b5dea60560f67d5c P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:54:31.417344 13232 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_bbcc6dca6db246f6935808d28432e28c" } modify_external_catalogs: true
I20250830 07:54:31.417550 13232 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_bbcc6dca6db246f6935808d28432e28c" } modify_external_catalogs: true
I20250830 07:54:31.417608 13882 ts_tablet_manager.cc:1428] T 778f6766c47f4a86b5dea60560f67d5c P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20250830 07:54:31.417853 13882 tablet_bootstrap.cc:492] T ab7196ca193348f5b4bb9193b731e04f P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:54:31.418452 13487 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "d0368ce5ffbd48dca5a6674f65f34ce4" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
W20250830 07:54:31.419086 13561 leader_election.cc:343] T d0368ce5ffbd48dca5a6674f65f34ce4 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:31.419261 13229 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_5bfb094fe761440791baa2854483575e" } modify_external_catalogs: true
I20250830 07:54:31.419221 13561 leader_election.cc:304] T d0368ce5ffbd48dca5a6674f65f34ce4 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b5e454d98894637b466ea27f1b647f9; no voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:54:31.419409 13229 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_5bfb094fe761440791baa2854483575e" } modify_external_catalogs: true
I20250830 07:54:31.419896 13899 raft_consensus.cc:2747] T d0368ce5ffbd48dca5a6674f65f34ce4 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:54:31.420586 13882 tablet_bootstrap.cc:654] T ab7196ca193348f5b4bb9193b731e04f P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:31.420929 13228 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_bee6dfde82b1440fa69d12c01819a359" } new_table_name: "default.Table_7267421303d148a581bd56208d51fc51" modify_external_catalogs: true
I20250830 07:54:31.421581 13885 ts_tablet_manager.cc:1905] T b4ab964a64a64e00a78ffd2b220aef46 P 6b5e454d98894637b466ea27f1b647f9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250830 07:54:31.422658 13234 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_4797c3da60c948e78efc613061d25afe" } modify_external_catalogs: true
I20250830 07:54:31.422806 13234 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_4797c3da60c948e78efc613061d25afe" } modify_external_catalogs: true
I20250830 07:54:31.423547 13230 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_72cd09b09afe4d318eea1f0371c4e823" } modify_external_catalogs: true
I20250830 07:54:31.423710 13230 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_72cd09b09afe4d318eea1f0371c4e823" } modify_external_catalogs: true
W20250830 07:54:31.428906 13227 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ccc90f6c867147cc9fe93c9ffa2e4802 has no consensus state
I20250830 07:54:31.429023 13882 tablet_bootstrap.cc:492] T ab7196ca193348f5b4bb9193b731e04f P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:54:31.429150 13882 ts_tablet_manager.cc:1397] T ab7196ca193348f5b4bb9193b731e04f P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.011s user 0.004s sys 0.004s
I20250830 07:54:31.429158 13227 master_service.cc:948] ReplaceTablet: received request to replace tablet a04bf79de30a42a98e71f622efc90c22 from {username='slave'} at 127.0.0.1:42126
I20250830 07:54:31.429894 13882 raft_consensus.cc:357] T ab7196ca193348f5b4bb9193b731e04f P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:54:31.430114 13882 raft_consensus.cc:383] T ab7196ca193348f5b4bb9193b731e04f P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:31.430186 13882 raft_consensus.cc:738] T ab7196ca193348f5b4bb9193b731e04f P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:54:31.430506 13882 consensus_queue.cc:260] T ab7196ca193348f5b4bb9193b731e04f P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:54:31.432116 13882 ts_tablet_manager.cc:1428] T ab7196ca193348f5b4bb9193b731e04f P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20250830 07:54:31.432396 13882 tablet_bootstrap.cc:492] T b059069ed7eb433a9c54523bce21b4ad P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:54:31.435984 13882 tablet_bootstrap.cc:654] T b059069ed7eb433a9c54523bce21b4ad P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:31.436286 13885 ts_tablet_manager.cc:1918] T b4ab964a64a64e00a78ffd2b220aef46 P 6b5e454d98894637b466ea27f1b647f9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250830 07:54:31.436444 13885 log.cc:1199] T b4ab964a64a64e00a78ffd2b220aef46 P 6b5e454d98894637b466ea27f1b647f9: Deleting WAL directory at /tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/ts-1/wal/wals/b4ab964a64a64e00a78ffd2b220aef46
I20250830 07:54:31.436823 13885 ts_tablet_manager.cc:1939] T b4ab964a64a64e00a78ffd2b220aef46 P 6b5e454d98894637b466ea27f1b647f9: Deleting consensus metadata
I20250830 07:54:31.445184 13885 tablet_replica.cc:331] T ff0f9cccc8ed43b1a8cd38de0e9d4097 P 6b5e454d98894637b466ea27f1b647f9: stopping tablet replica
I20250830 07:54:31.445425 13885 raft_consensus.cc:2241] T ff0f9cccc8ed43b1a8cd38de0e9d4097 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250830 07:54:31.445631 13885 raft_consensus.cc:2270] T ff0f9cccc8ed43b1a8cd38de0e9d4097 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250830 07:54:31.446437 13885 ts_tablet_manager.cc:1905] T ff0f9cccc8ed43b1a8cd38de0e9d4097 P 6b5e454d98894637b466ea27f1b647f9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250830 07:54:31.462368 13885 ts_tablet_manager.cc:1918] T ff0f9cccc8ed43b1a8cd38de0e9d4097 P 6b5e454d98894637b466ea27f1b647f9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250830 07:54:31.462523 13885 log.cc:1199] T ff0f9cccc8ed43b1a8cd38de0e9d4097 P 6b5e454d98894637b466ea27f1b647f9: Deleting WAL directory at /tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/ts-1/wal/wals/ff0f9cccc8ed43b1a8cd38de0e9d4097
I20250830 07:54:31.462965 13885 ts_tablet_manager.cc:1939] T ff0f9cccc8ed43b1a8cd38de0e9d4097 P 6b5e454d98894637b466ea27f1b647f9: Deleting consensus metadata
I20250830 07:54:31.465129 13882 tablet_bootstrap.cc:492] T b059069ed7eb433a9c54523bce21b4ad P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:54:31.465296 13882 ts_tablet_manager.cc:1397] T b059069ed7eb433a9c54523bce21b4ad P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.033s user 0.011s sys 0.018s
I20250830 07:54:31.467886 13754 tablet_service.cc:1515] Processing DeleteTablet for tablet 1ed2d20b0de14631ad8520f4cbd806c2 with delete_type TABLET_DATA_DELETED (replaced by tablet ff2267fb411942ff826e2a72bcb89cd7) from {username='slave'} at 127.0.0.1:45460
I20250830 07:54:31.468150 13884 tablet_replica.cc:331] T 1ed2d20b0de14631ad8520f4cbd806c2 P 9b057ade5dce45af9f8bf0bedf8b917f: stopping tablet replica
I20250830 07:54:31.468113 13882 raft_consensus.cc:357] T b059069ed7eb433a9c54523bce21b4ad P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:54:31.468330 13882 raft_consensus.cc:383] T b059069ed7eb433a9c54523bce21b4ad P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:31.468361 13884 raft_consensus.cc:2241] T 1ed2d20b0de14631ad8520f4cbd806c2 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Raft consensus shutting down.
I20250830 07:54:31.468438 13882 raft_consensus.cc:738] T b059069ed7eb433a9c54523bce21b4ad P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:54:31.468516 13884 raft_consensus.cc:2270] T 1ed2d20b0de14631ad8520f4cbd806c2 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Raft consensus is shut down!
I20250830 07:54:31.468715 13882 consensus_queue.cc:260] T b059069ed7eb433a9c54523bce21b4ad P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:54:31.469208 13884 ts_tablet_manager.cc:1905] T 1ed2d20b0de14631ad8520f4cbd806c2 P 9b057ade5dce45af9f8bf0bedf8b917f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250830 07:54:31.470893 13882 ts_tablet_manager.cc:1428] T b059069ed7eb433a9c54523bce21b4ad P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20250830 07:54:31.470995 13885 tablet_replica.cc:331] T 32c75568db9b4f00bb567d09dab3d45a P 6b5e454d98894637b466ea27f1b647f9: stopping tablet replica
I20250830 07:54:31.471169 13882 tablet_bootstrap.cc:492] T 8f4567f30cc34f288463e4a92bd3edd5 P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:54:31.471167 13885 raft_consensus.cc:2241] T 32c75568db9b4f00bb567d09dab3d45a P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250830 07:54:31.472905 13882 tablet_bootstrap.cc:654] T 8f4567f30cc34f288463e4a92bd3edd5 P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:31.472935 13885 raft_consensus.cc:2270] T 32c75568db9b4f00bb567d09dab3d45a P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250830 07:54:31.473771 13885 ts_tablet_manager.cc:1905] T 32c75568db9b4f00bb567d09dab3d45a P 6b5e454d98894637b466ea27f1b647f9: Deleting tablet data with delete state TABLET_DATA_DELETED
W20250830 07:54:31.476372 13228 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 0a7c368f47aa41d896f5a3c3c20918c6 consensus state has no leader
W20250830 07:54:31.477416 13228 catalog_manager.cc:5415] Ignoring report from unknown tablet 9e055d6089f541f799eddb5778eb2148
I20250830 07:54:31.477954 13227 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet a04bf79de30a42a98e71f622efc90c22
I20250830 07:54:31.478428 13227 catalog_manager.cc:6652] ReplaceTablet: tablet a04bf79de30a42a98e71f622efc90c22 deleted and replaced by tablet 0186504d9e4949179ce5b92b85f5b230
I20250830 07:54:31.478749 13227 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_b30c015c01cb40e3992286109ba71dfe" } new_table_name: "default.Table_80a0e1ec331a4abc8d2e28a89e89f537" modify_external_catalogs: true
I20250830 07:54:31.478859 13884 ts_tablet_manager.cc:1918] T 1ed2d20b0de14631ad8520f4cbd806c2 P 9b057ade5dce45af9f8bf0bedf8b917f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250830 07:54:31.479018 13884 log.cc:1199] T 1ed2d20b0de14631ad8520f4cbd806c2 P 9b057ade5dce45af9f8bf0bedf8b917f: Deleting WAL directory at /tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/ts-2/wal/wals/1ed2d20b0de14631ad8520f4cbd806c2
I20250830 07:54:31.479051 13754 tablet_service.cc:1515] Processing DeleteTablet for tablet a04bf79de30a42a98e71f622efc90c22 with delete_type TABLET_DATA_DELETED (replaced by tablet 0186504d9e4949179ce5b92b85f5b230) from {username='slave'} at 127.0.0.1:45460
I20250830 07:54:31.479328 13606 tablet_service.cc:1515] Processing DeleteTablet for tablet a04bf79de30a42a98e71f622efc90c22 with delete_type TABLET_DATA_DELETED (replaced by tablet 0186504d9e4949179ce5b92b85f5b230) from {username='slave'} at 127.0.0.1:45306
I20250830 07:54:31.479413 13884 ts_tablet_manager.cc:1939] T 1ed2d20b0de14631ad8520f4cbd806c2 P 9b057ade5dce45af9f8bf0bedf8b917f: Deleting consensus metadata
I20250830 07:54:31.480446 13219 catalog_manager.cc:4928] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): tablet 1ed2d20b0de14631ad8520f4cbd806c2 (table default.Table_bbcc6dca6db246f6935808d28432e28c [id=903638fdb4e845769c8092fb6f5bead4]) successfully deleted
I20250830 07:54:31.480530 13229 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet 5aef6fd239ba43478cd978fa5d29b26e
W20250830 07:54:31.481078 13219 catalog_manager.cc:4908] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): delete failed for tablet a04bf79de30a42a98e71f622efc90c22 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a04bf79de30a42a98e71f622efc90c22 already in progress: creating tablet
I20250830 07:54:31.481184 13606 tablet_service.cc:1515] Processing DeleteTablet for tablet 5aef6fd239ba43478cd978fa5d29b26e with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:31 UTC) from {username='slave'} at 127.0.0.1:45306
I20250830 07:54:31.481254 13229 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_851f951ca7b5408192a53cd2fa9ac396" } new_table_name: "default.Table_3d12ac4bedcf433aa345dda9066deb22" modify_external_catalogs: true
I20250830 07:54:31.481617 13754 tablet_service.cc:1515] Processing DeleteTablet for tablet 5aef6fd239ba43478cd978fa5d29b26e with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:31 UTC) from {username='slave'} at 127.0.0.1:45460
W20250830 07:54:31.482384 13219 catalog_manager.cc:4908] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): delete failed for tablet 5aef6fd239ba43478cd978fa5d29b26e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5aef6fd239ba43478cd978fa5d29b26e already in progress: creating tablet
I20250830 07:54:31.482565 13232 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet ff2267fb411942ff826e2a72bcb89cd7
I20250830 07:54:31.483166 13606 tablet_service.cc:1515] Processing DeleteTablet for tablet ff2267fb411942ff826e2a72bcb89cd7 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:31 UTC) from {username='slave'} at 127.0.0.1:45306
I20250830 07:54:31.483207 13232 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_8aa66646279342caa1f1557d5b2c3fe3" } modify_external_catalogs: true
I20250830 07:54:31.483377 13232 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_8aa66646279342caa1f1557d5b2c3fe3" } modify_external_catalogs: true
I20250830 07:54:31.483603 13750 tablet_service.cc:1515] Processing DeleteTablet for tablet ff2267fb411942ff826e2a72bcb89cd7 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:31 UTC) from {username='slave'} at 127.0.0.1:45460
I20250830 07:54:31.483783 13754 tablet_service.cc:1515] Processing DeleteTablet for tablet 1ed2d20b0de14631ad8520f4cbd806c2 with delete_type TABLET_DATA_DELETED (replaced by tablet ff2267fb411942ff826e2a72bcb89cd7) from {username='slave'} at 127.0.0.1:45460
I20250830 07:54:31.484102 13226 master_service.cc:948] ReplaceTablet: received request to replace tablet ab7196ca193348f5b4bb9193b731e04f from {username='slave'} at 127.0.0.1:42126
W20250830 07:54:31.485255 13219 catalog_manager.cc:4908] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): delete failed for tablet ff2267fb411942ff826e2a72bcb89cd7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ff2267fb411942ff826e2a72bcb89cd7 already in progress: creating tablet
W20250830 07:54:31.485836 13219 catalog_manager.cc:4895] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): delete failed for tablet 1ed2d20b0de14631ad8520f4cbd806c2 because the tablet was not found. No further retry: Not found: Tablet not found: 1ed2d20b0de14631ad8520f4cbd806c2
I20250830 07:54:31.487735 13228 catalog_manager.cc:5674] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967) does not have the latest schema for tablet 778f6766c47f4a86b5dea60560f67d5c (table default.Table_d2ac5bc3c0c246c4bb6c797de6efedae [id=08a2c4f9b62b465cb1bf7983bc8b802d]). Expected version 1 got 0
I20250830 07:54:31.488528 13230 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet 9a0c96916f1d4680b8a04d97091384e9
I20250830 07:54:31.489403 13754 tablet_service.cc:1515] Processing DeleteTablet for tablet 9a0c96916f1d4680b8a04d97091384e9 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:31 UTC) from {username='slave'} at 127.0.0.1:45460
I20250830 07:54:31.489635 13884 tablet_replica.cc:331] T 9a0c96916f1d4680b8a04d97091384e9 P 9b057ade5dce45af9f8bf0bedf8b917f: stopping tablet replica
W20250830 07:54:31.489794 13233 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 8f4567f30cc34f288463e4a92bd3edd5 consensus state has no leader
I20250830 07:54:31.489794 13606 tablet_service.cc:1515] Processing DeleteTablet for tablet 9a0c96916f1d4680b8a04d97091384e9 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:31 UTC) from {username='slave'} at 127.0.0.1:45306
I20250830 07:54:31.489840 13884 raft_consensus.cc:2241] T 9a0c96916f1d4680b8a04d97091384e9 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Raft consensus shutting down.
I20250830 07:54:31.490007 13884 raft_consensus.cc:2270] T 9a0c96916f1d4680b8a04d97091384e9 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Raft consensus is shut down!
I20250830 07:54:31.501089 13233 master_service.cc:948] ReplaceTablet: received request to replace tablet 9e055d6089f541f799eddb5778eb2148 from {username='slave'} at 127.0.0.1:42126
I20250830 07:54:31.501727 13233 master_service.cc:948] ReplaceTablet: received request to replace tablet bf170b1865094ba38ef8568259e34656 from {username='slave'} at 127.0.0.1:42126
I20250830 07:54:31.502760 13233 master_service.cc:948] ReplaceTablet: received request to replace tablet 5aef6fd239ba43478cd978fa5d29b26e from {username='slave'} at 127.0.0.1:42126
I20250830 07:54:31.503362 13466 tablet_service.cc:1515] Processing DeleteTablet for tablet 9a0c96916f1d4680b8a04d97091384e9 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:31 UTC) from {username='slave'} at 127.0.0.1:37956
I20250830 07:54:31.503475 13884 ts_tablet_manager.cc:1905] T 9a0c96916f1d4680b8a04d97091384e9 P 9b057ade5dce45af9f8bf0bedf8b917f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250830 07:54:31.503752 13883 tablet_replica.cc:331] T 9a0c96916f1d4680b8a04d97091384e9 P 2065c332f15a4739899af79f3669c3ba: stopping tablet replica
I20250830 07:54:31.508304 13467 tablet_service.cc:1515] Processing DeleteTablet for tablet ff2267fb411942ff826e2a72bcb89cd7 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:31 UTC) from {username='slave'} at 127.0.0.1:37956
I20250830 07:54:31.508700 13460 tablet_service.cc:1515] Processing DeleteTablet for tablet a04bf79de30a42a98e71f622efc90c22 with delete_type TABLET_DATA_DELETED (replaced by tablet 0186504d9e4949179ce5b92b85f5b230) from {username='slave'} at 127.0.0.1:37956
I20250830 07:54:31.508970 13462 tablet_service.cc:1515] Processing DeleteTablet for tablet 5aef6fd239ba43478cd978fa5d29b26e with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:31 UTC) from {username='slave'} at 127.0.0.1:37956
W20250830 07:54:31.511441 13229 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 4d4b00bdadb24ec892d87c9be2ed7dd9 consensus state has no leader
W20250830 07:54:31.511915 13227 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet b059069ed7eb433a9c54523bce21b4ad consensus state has no leader
I20250830 07:54:31.512565 13232 catalog_manager.cc:5864] Not sending DeleteTablet requests; no consensus state for tablet 948548afaa8a49098c1a19d9b4df9830
I20250830 07:54:31.514159 13606 tablet_service.cc:1515] Processing DeleteTablet for tablet ab7196ca193348f5b4bb9193b731e04f with delete_type TABLET_DATA_DELETED (replaced by tablet 9d00ee83780e4cf780ca92f1504d26b5) from {username='slave'} at 127.0.0.1:45306
I20250830 07:54:31.514387 13608 tablet_service.cc:1515] Processing DeleteTablet for tablet bf170b1865094ba38ef8568259e34656 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:31 UTC) from {username='slave'} at 127.0.0.1:45306
I20250830 07:54:31.516010 13885 ts_tablet_manager.cc:1918] T 32c75568db9b4f00bb567d09dab3d45a P 6b5e454d98894637b466ea27f1b647f9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250830 07:54:31.516191 13885 log.cc:1199] T 32c75568db9b4f00bb567d09dab3d45a P 6b5e454d98894637b466ea27f1b647f9: Deleting WAL directory at /tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/ts-1/wal/wals/32c75568db9b4f00bb567d09dab3d45a
I20250830 07:54:31.516633 13885 ts_tablet_manager.cc:1939] T 32c75568db9b4f00bb567d09dab3d45a P 6b5e454d98894637b466ea27f1b647f9: Deleting consensus metadata
I20250830 07:54:31.521754 13884 ts_tablet_manager.cc:1918] T 9a0c96916f1d4680b8a04d97091384e9 P 9b057ade5dce45af9f8bf0bedf8b917f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250830 07:54:31.521908 13884 log.cc:1199] T 9a0c96916f1d4680b8a04d97091384e9 P 9b057ade5dce45af9f8bf0bedf8b917f: Deleting WAL directory at /tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/ts-2/wal/wals/9a0c96916f1d4680b8a04d97091384e9
I20250830 07:54:31.522353 13884 ts_tablet_manager.cc:1939] T 9a0c96916f1d4680b8a04d97091384e9 P 9b057ade5dce45af9f8bf0bedf8b917f: Deleting consensus metadata
I20250830 07:54:31.527307 13885 tablet_replica.cc:331] T d0368ce5ffbd48dca5a6674f65f34ce4 P 6b5e454d98894637b466ea27f1b647f9: stopping tablet replica
I20250830 07:54:31.527388 13220 catalog_manager.cc:4928] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): tablet 32c75568db9b4f00bb567d09dab3d45a (table default.Table_d24e8e2f5130411cacb3241198c3669d [id=e087454d345c40f1b809d0f4187f7212]) successfully deleted
I20250830 07:54:31.527598 13885 raft_consensus.cc:2241] T d0368ce5ffbd48dca5a6674f65f34ce4 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250830 07:54:31.527832 13885 raft_consensus.cc:2270] T d0368ce5ffbd48dca5a6674f65f34ce4 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250830 07:54:31.528057 13608 tablet_service.cc:1468] Processing CreateTablet for tablet ccc90f6c867147cc9fe93c9ffa2e4802 (DEFAULT_TABLE table=default.Table_737f5bb11c3f4b8e8d26b08fd43afa45 [id=1b7c141ed8af4dcab20683653fd59ee1]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:31.528465 13608 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ccc90f6c867147cc9fe93c9ffa2e4802. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:31.528729 13885 ts_tablet_manager.cc:1905] T d0368ce5ffbd48dca5a6674f65f34ce4 P 6b5e454d98894637b466ea27f1b647f9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250830 07:54:31.529404 13462 tablet_service.cc:1468] Processing CreateTablet for tablet ccc90f6c867147cc9fe93c9ffa2e4802 (DEFAULT_TABLE table=default.Table_737f5bb11c3f4b8e8d26b08fd43afa45 [id=1b7c141ed8af4dcab20683653fd59ee1]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:31.529850 13462 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ccc90f6c867147cc9fe93c9ffa2e4802. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:31.531414 13754 tablet_service.cc:1468] Processing CreateTablet for tablet ccc90f6c867147cc9fe93c9ffa2e4802 (DEFAULT_TABLE table=default.Table_737f5bb11c3f4b8e8d26b08fd43afa45 [id=1b7c141ed8af4dcab20683653fd59ee1]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:31.531788 13754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ccc90f6c867147cc9fe93c9ffa2e4802. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:31.535171 13885 ts_tablet_manager.cc:1918] T d0368ce5ffbd48dca5a6674f65f34ce4 P 6b5e454d98894637b466ea27f1b647f9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250830 07:54:31.535305 13885 log.cc:1199] T d0368ce5ffbd48dca5a6674f65f34ce4 P 6b5e454d98894637b466ea27f1b647f9: Deleting WAL directory at /tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/ts-1/wal/wals/d0368ce5ffbd48dca5a6674f65f34ce4
I20250830 07:54:31.535686 13885 ts_tablet_manager.cc:1939] T d0368ce5ffbd48dca5a6674f65f34ce4 P 6b5e454d98894637b466ea27f1b647f9: Deleting consensus metadata
I20250830 07:54:31.536686 13220 catalog_manager.cc:4928] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): tablet d0368ce5ffbd48dca5a6674f65f34ce4 (table default.Table_737f5bb11c3f4b8e8d26b08fd43afa45 [id=1b7c141ed8af4dcab20683653fd59ee1]) successfully deleted
I20250830 07:54:31.537034 13885 tablet_replica.cc:331] T 9a0c96916f1d4680b8a04d97091384e9 P 6b5e454d98894637b466ea27f1b647f9: stopping tablet replica
W20250830 07:54:31.537155 13220 catalog_manager.cc:4908] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet a04bf79de30a42a98e71f622efc90c22 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a04bf79de30a42a98e71f622efc90c22 already in progress: creating tablet
I20250830 07:54:31.537235 13885 raft_consensus.cc:2241] T 9a0c96916f1d4680b8a04d97091384e9 P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250830 07:54:31.537319 13234 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet 4ab63ff59d4e4ec2b7b64d605545a870
I20250830 07:54:31.537390 13885 raft_consensus.cc:2270] T 9a0c96916f1d4680b8a04d97091384e9 P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Raft consensus is shut down!
W20250830 07:54:31.537392 13220 catalog_manager.cc:4908] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet 5aef6fd239ba43478cd978fa5d29b26e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5aef6fd239ba43478cd978fa5d29b26e already in progress: creating tablet
W20250830 07:54:31.537611 13220 catalog_manager.cc:4908] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet ff2267fb411942ff826e2a72bcb89cd7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ff2267fb411942ff826e2a72bcb89cd7 already in progress: creating tablet
I20250830 07:54:31.538132 13606 tablet_service.cc:1515] Processing DeleteTablet for tablet 4ab63ff59d4e4ec2b7b64d605545a870 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:31 UTC) from {username='slave'} at 127.0.0.1:45306
I20250830 07:54:31.538148 13885 ts_tablet_manager.cc:1905] T 9a0c96916f1d4680b8a04d97091384e9 P 6b5e454d98894637b466ea27f1b647f9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250830 07:54:31.538579 13750 tablet_service.cc:1515] Processing DeleteTablet for tablet 4ab63ff59d4e4ec2b7b64d605545a870 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:31 UTC) from {username='slave'} at 127.0.0.1:45460
I20250830 07:54:31.539047 13460 tablet_service.cc:1515] Processing DeleteTablet for tablet 4ab63ff59d4e4ec2b7b64d605545a870 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:31 UTC) from {username='slave'} at 127.0.0.1:37956
I20250830 07:54:31.539615 13882 tablet_bootstrap.cc:492] T 8f4567f30cc34f288463e4a92bd3edd5 P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:54:31.539775 13882 ts_tablet_manager.cc:1397] T 8f4567f30cc34f288463e4a92bd3edd5 P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.069s user 0.004s sys 0.043s
I20250830 07:54:31.540537 13882 raft_consensus.cc:357] T 8f4567f30cc34f288463e4a92bd3edd5 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:54:31.540714 13882 raft_consensus.cc:383] T 8f4567f30cc34f288463e4a92bd3edd5 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:31.540776 13882 raft_consensus.cc:738] T 8f4567f30cc34f288463e4a92bd3edd5 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:54:31.540987 13882 consensus_queue.cc:260] T 8f4567f30cc34f288463e4a92bd3edd5 P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:54:31.541399 13882 ts_tablet_manager.cc:1428] T 8f4567f30cc34f288463e4a92bd3edd5 P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20250830 07:54:31.541792 13882 tablet_bootstrap.cc:492] T 4d4b00bdadb24ec892d87c9be2ed7dd9 P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:54:31.542047 13219 catalog_manager.cc:4928] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): tablet 9a0c96916f1d4680b8a04d97091384e9 (table default.Table_72cd09b09afe4d318eea1f0371c4e823 [id=fa1e5610a0034475a7e35699dd9bacf7]) successfully deleted
W20250830 07:54:31.542702 13219 catalog_manager.cc:4908] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): delete failed for tablet 4ab63ff59d4e4ec2b7b64d605545a870 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4ab63ff59d4e4ec2b7b64d605545a870 already in progress: creating tablet
I20250830 07:54:31.543280 13882 tablet_bootstrap.cc:654] T 4d4b00bdadb24ec892d87c9be2ed7dd9 P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:31.551867 13885 ts_tablet_manager.cc:1918] T 9a0c96916f1d4680b8a04d97091384e9 P 6b5e454d98894637b466ea27f1b647f9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250830 07:54:31.552012 13885 log.cc:1199] T 9a0c96916f1d4680b8a04d97091384e9 P 6b5e454d98894637b466ea27f1b647f9: Deleting WAL directory at /tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/ts-1/wal/wals/9a0c96916f1d4680b8a04d97091384e9
I20250830 07:54:31.552373 13885 ts_tablet_manager.cc:1939] T 9a0c96916f1d4680b8a04d97091384e9 P 6b5e454d98894637b466ea27f1b647f9: Deleting consensus metadata
I20250830 07:54:31.552860 13883 raft_consensus.cc:2241] T 9a0c96916f1d4680b8a04d97091384e9 P 2065c332f15a4739899af79f3669c3ba [term 1 LEADER]: Raft consensus shutting down.
I20250830 07:54:31.553274 13885 tablet_replica.cc:331] T ab7196ca193348f5b4bb9193b731e04f P 6b5e454d98894637b466ea27f1b647f9: stopping tablet replica
I20250830 07:54:31.553491 13885 raft_consensus.cc:2241] T ab7196ca193348f5b4bb9193b731e04f P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250830 07:54:31.553555 13883 pending_rounds.cc:70] T 9a0c96916f1d4680b8a04d97091384e9 P 2065c332f15a4739899af79f3669c3ba: Trying to abort 1 pending ops.
I20250830 07:54:31.553675 13885 raft_consensus.cc:2270] T ab7196ca193348f5b4bb9193b731e04f P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250830 07:54:31.553727 13883 pending_rounds.cc:77] T 9a0c96916f1d4680b8a04d97091384e9 P 2065c332f15a4739899af79f3669c3ba: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7194789770556067840 op_type: NO_OP noop_request { }
I20250830 07:54:31.553925 13883 raft_consensus.cc:2887] T 9a0c96916f1d4680b8a04d97091384e9 P 2065c332f15a4739899af79f3669c3ba [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20250830 07:54:31.554082 13883 raft_consensus.cc:2270] T 9a0c96916f1d4680b8a04d97091384e9 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20250830 07:54:31.554420 13885 ts_tablet_manager.cc:1905] T ab7196ca193348f5b4bb9193b731e04f P 6b5e454d98894637b466ea27f1b647f9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250830 07:54:31.554544 13220 catalog_manager.cc:4928] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): tablet 9a0c96916f1d4680b8a04d97091384e9 (table default.Table_72cd09b09afe4d318eea1f0371c4e823 [id=fa1e5610a0034475a7e35699dd9bacf7]) successfully deleted
I20250830 07:54:31.560604 13883 ts_tablet_manager.cc:1905] T 9a0c96916f1d4680b8a04d97091384e9 P 2065c332f15a4739899af79f3669c3ba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250830 07:54:31.560917 13887 tablet_bootstrap.cc:492] T d0368ce5ffbd48dca5a6674f65f34ce4 P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:54:31.560873 13885 ts_tablet_manager.cc:1918] T ab7196ca193348f5b4bb9193b731e04f P 6b5e454d98894637b466ea27f1b647f9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250830 07:54:31.561029 13885 log.cc:1199] T ab7196ca193348f5b4bb9193b731e04f P 6b5e454d98894637b466ea27f1b647f9: Deleting WAL directory at /tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/ts-1/wal/wals/ab7196ca193348f5b4bb9193b731e04f
I20250830 07:54:31.561056 13887 ts_tablet_manager.cc:1397] T d0368ce5ffbd48dca5a6674f65f34ce4 P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.442s user 0.015s sys 0.009s
I20250830 07:54:31.561523 13885 ts_tablet_manager.cc:1939] T ab7196ca193348f5b4bb9193b731e04f P 6b5e454d98894637b466ea27f1b647f9: Deleting consensus metadata
I20250830 07:54:31.559976 13897 raft_consensus.cc:491] T 50360492db824755a6de251436cab5c6 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:31.561919 13887 raft_consensus.cc:357] T d0368ce5ffbd48dca5a6674f65f34ce4 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:31.562080 13887 raft_consensus.cc:383] T d0368ce5ffbd48dca5a6674f65f34ce4 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:31.562074 13897 raft_consensus.cc:513] T 50360492db824755a6de251436cab5c6 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:31.562182 13887 raft_consensus.cc:738] T d0368ce5ffbd48dca5a6674f65f34ce4 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:54:31.562533 13885 tablet_replica.cc:331] T bf170b1865094ba38ef8568259e34656 P 6b5e454d98894637b466ea27f1b647f9: stopping tablet replica
I20250830 07:54:31.562461 13887 consensus_queue.cc:260] T d0368ce5ffbd48dca5a6674f65f34ce4 P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:31.562647 13897 leader_election.cc:290] T 50360492db824755a6de251436cab5c6 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
I20250830 07:54:31.562726 13885 raft_consensus.cc:2241] T bf170b1865094ba38ef8568259e34656 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250830 07:54:31.562860 13885 raft_consensus.cc:2270] T bf170b1865094ba38ef8568259e34656 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250830 07:54:31.562985 13887 ts_tablet_manager.cc:1428] T d0368ce5ffbd48dca5a6674f65f34ce4 P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20250830 07:54:31.563277 13887 tablet_bootstrap.cc:492] T 9e055d6089f541f799eddb5778eb2148 P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:54:31.563655 13885 ts_tablet_manager.cc:1905] T bf170b1865094ba38ef8568259e34656 P 6b5e454d98894637b466ea27f1b647f9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250830 07:54:31.565135 13887 tablet_bootstrap.cc:654] T 9e055d6089f541f799eddb5778eb2148 P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:31.565615 13220 catalog_manager.cc:4928] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): tablet ab7196ca193348f5b4bb9193b731e04f (table default.Table_74f3c73d22574737b5f6a4bd256e423d [id=55f67297d5ac42c280ea932d74e3ad37]) successfully deleted
W20250830 07:54:31.566080 13701 leader_election.cc:343] T 50360492db824755a6de251436cab5c6 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): Not found: Tablet not found: 50360492db824755a6de251436cab5c6
W20250830 07:54:31.566607 13703 leader_election.cc:343] T 50360492db824755a6de251436cab5c6 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Not found: Tablet not found: 50360492db824755a6de251436cab5c6
I20250830 07:54:31.566706 13883 ts_tablet_manager.cc:1918] T 9a0c96916f1d4680b8a04d97091384e9 P 2065c332f15a4739899af79f3669c3ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250830 07:54:31.566701 13703 leader_election.cc:304] T 50360492db824755a6de251436cab5c6 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 2065c332f15a4739899af79f3669c3ba, 6b5e454d98894637b466ea27f1b647f9
I20250830 07:54:31.566798 13883 log.cc:1199] T 9a0c96916f1d4680b8a04d97091384e9 P 2065c332f15a4739899af79f3669c3ba: Deleting WAL directory at /tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/ts-0/wal/wals/9a0c96916f1d4680b8a04d97091384e9
I20250830 07:54:31.567621 13883 ts_tablet_manager.cc:1939] T 9a0c96916f1d4680b8a04d97091384e9 P 2065c332f15a4739899af79f3669c3ba: Deleting consensus metadata
I20250830 07:54:31.568719 13218 catalog_manager.cc:4928] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): tablet 9a0c96916f1d4680b8a04d97091384e9 (table default.Table_72cd09b09afe4d318eea1f0371c4e823 [id=fa1e5610a0034475a7e35699dd9bacf7]) successfully deleted
W20250830 07:54:31.569113 13218 catalog_manager.cc:4908] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): delete failed for tablet ff2267fb411942ff826e2a72bcb89cd7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ff2267fb411942ff826e2a72bcb89cd7 already in progress: creating tablet
W20250830 07:54:31.569612 13218 catalog_manager.cc:4908] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): delete failed for tablet a04bf79de30a42a98e71f622efc90c22 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a04bf79de30a42a98e71f622efc90c22 already in progress: creating tablet
I20250830 07:54:31.569937 13885 ts_tablet_manager.cc:1918] T bf170b1865094ba38ef8568259e34656 P 6b5e454d98894637b466ea27f1b647f9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250830 07:54:31.570061 13885 log.cc:1199] T bf170b1865094ba38ef8568259e34656 P 6b5e454d98894637b466ea27f1b647f9: Deleting WAL directory at /tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/ts-1/wal/wals/bf170b1865094ba38ef8568259e34656
I20250830 07:54:31.570231 13462 tablet_service.cc:1515] Processing DeleteTablet for tablet d0368ce5ffbd48dca5a6674f65f34ce4 with delete_type TABLET_DATA_DELETED (replaced by tablet ccc90f6c867147cc9fe93c9ffa2e4802) from {username='slave'} at 127.0.0.1:37956
W20250830 07:54:31.570235 13218 catalog_manager.cc:4908] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): delete failed for tablet 5aef6fd239ba43478cd978fa5d29b26e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5aef6fd239ba43478cd978fa5d29b26e already in progress: creating tablet
I20250830 07:54:31.570363 13885 ts_tablet_manager.cc:1939] T bf170b1865094ba38ef8568259e34656 P 6b5e454d98894637b466ea27f1b647f9: Deleting consensus metadata
I20250830 07:54:31.570437 13883 tablet_replica.cc:331] T d0368ce5ffbd48dca5a6674f65f34ce4 P 2065c332f15a4739899af79f3669c3ba: stopping tablet replica
W20250830 07:54:31.570461 13218 catalog_manager.cc:4908] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): delete failed for tablet 4ab63ff59d4e4ec2b7b64d605545a870 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4ab63ff59d4e4ec2b7b64d605545a870 already in progress: creating tablet
I20250830 07:54:31.570596 13883 raft_consensus.cc:2241] T d0368ce5ffbd48dca5a6674f65f34ce4 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Raft consensus shutting down.
I20250830 07:54:31.570734 13883 raft_consensus.cc:2270] T d0368ce5ffbd48dca5a6674f65f34ce4 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Raft consensus is shut down!
I20250830 07:54:31.570752 13897 raft_consensus.cc:2747] T 50360492db824755a6de251436cab5c6 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:54:31.571084 13886 tablet_bootstrap.cc:492] T 9e055d6089f541f799eddb5778eb2148 P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:54:31.571198 13220 catalog_manager.cc:4928] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): tablet bf170b1865094ba38ef8568259e34656 (table default.Table_fa4deee864594a2aa4987b24ae8e7c97 [id=2d16cc8010714d9381de323f97abbdca]) successfully deleted
I20250830 07:54:31.571375 13886 ts_tablet_manager.cc:1397] T 9e055d6089f541f799eddb5778eb2148 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.181s user 0.018s sys 0.037s
I20250830 07:54:31.571548 13883 ts_tablet_manager.cc:1905] T d0368ce5ffbd48dca5a6674f65f34ce4 P 2065c332f15a4739899af79f3669c3ba: Deleting tablet data with delete state TABLET_DATA_DELETED
W20250830 07:54:31.571943 13220 catalog_manager.cc:4908] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet 4ab63ff59d4e4ec2b7b64d605545a870 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4ab63ff59d4e4ec2b7b64d605545a870 already in progress: creating tablet
I20250830 07:54:31.572918 13882 tablet_bootstrap.cc:492] T 4d4b00bdadb24ec892d87c9be2ed7dd9 P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:54:31.573078 13882 ts_tablet_manager.cc:1397] T 4d4b00bdadb24ec892d87c9be2ed7dd9 P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.031s user 0.001s sys 0.005s
I20250830 07:54:31.573762 13882 raft_consensus.cc:357] T 4d4b00bdadb24ec892d87c9be2ed7dd9 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:31.573966 13882 raft_consensus.cc:383] T 4d4b00bdadb24ec892d87c9be2ed7dd9 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:31.574079 13882 raft_consensus.cc:738] T 4d4b00bdadb24ec892d87c9be2ed7dd9 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:54:31.574349 13882 consensus_queue.cc:260] T 4d4b00bdadb24ec892d87c9be2ed7dd9 P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:31.574859 13882 ts_tablet_manager.cc:1428] T 4d4b00bdadb24ec892d87c9be2ed7dd9 P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20250830 07:54:31.575294 13882 tablet_bootstrap.cc:492] T 7ed22d9617024d55a8add137e7971061 P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:54:31.575742 13886 raft_consensus.cc:357] T 9e055d6089f541f799eddb5778eb2148 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:31.575985 13886 raft_consensus.cc:383] T 9e055d6089f541f799eddb5778eb2148 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:31.576063 13886 raft_consensus.cc:738] T 9e055d6089f541f799eddb5778eb2148 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:54:31.576393 13886 consensus_queue.cc:260] T 9e055d6089f541f799eddb5778eb2148 P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:31.578698 13882 tablet_bootstrap.cc:654] T 7ed22d9617024d55a8add137e7971061 P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
W20250830 07:54:31.579005 13228 catalog_manager.cc:5415] Ignoring report from unknown tablet 9e055d6089f541f799eddb5778eb2148
I20250830 07:54:31.580516 13886 ts_tablet_manager.cc:1428] T 9e055d6089f541f799eddb5778eb2148 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.009s user 0.001s sys 0.001s
W20250830 07:54:31.582784 13228 catalog_manager.cc:5415] Ignoring report from unknown tablet 9e055d6089f541f799eddb5778eb2148
I20250830 07:54:31.583700 13886 tablet_bootstrap.cc:492] T b4ab964a64a64e00a78ffd2b220aef46 P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:54:31.585248 13886 tablet_bootstrap.cc:654] T b4ab964a64a64e00a78ffd2b220aef46 P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:31.586429 13887 tablet_bootstrap.cc:492] T 9e055d6089f541f799eddb5778eb2148 P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:54:31.586629 13887 ts_tablet_manager.cc:1397] T 9e055d6089f541f799eddb5778eb2148 P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.023s user 0.003s sys 0.000s
I20250830 07:54:31.587590 13887 raft_consensus.cc:357] T 9e055d6089f541f799eddb5778eb2148 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:31.587906 13887 raft_consensus.cc:383] T 9e055d6089f541f799eddb5778eb2148 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:31.588001 13887 raft_consensus.cc:738] T 9e055d6089f541f799eddb5778eb2148 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:54:31.588296 13887 consensus_queue.cc:260] T 9e055d6089f541f799eddb5778eb2148 P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
W20250830 07:54:31.590415 13228 catalog_manager.cc:5415] Ignoring report from unknown tablet 9e055d6089f541f799eddb5778eb2148
I20250830 07:54:31.592348 13887 ts_tablet_manager.cc:1428] T 9e055d6089f541f799eddb5778eb2148 P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.006s user 0.003s sys 0.000s
I20250830 07:54:31.592639 13228 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_79d48a151e96435f8e695e3b288057ee"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250830 07:54:31.592784 13234 catalog_manager.cc:5674] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967) does not have the latest schema for tablet 8f4567f30cc34f288463e4a92bd3edd5 (table default.Table_1bad683bf46c49aa8c24cd18c2c2e990 [id=3c052a58caaa412f8d9d70063dcd97c0]). Expected version 1 got 0
W20250830 07:54:31.593251 13228 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_79d48a151e96435f8e695e3b288057ee in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:31.594059 13887 tablet_bootstrap.cc:492] T ff0f9cccc8ed43b1a8cd38de0e9d4097 P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:54:31.595566 13887 tablet_bootstrap.cc:654] T ff0f9cccc8ed43b1a8cd38de0e9d4097 P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:31.596191 13232 catalog_manager.cc:5674] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967) does not have the latest schema for tablet 8f4567f30cc34f288463e4a92bd3edd5 (table default.Table_1bad683bf46c49aa8c24cd18c2c2e990 [id=3c052a58caaa412f8d9d70063dcd97c0]). Expected version 1 got 0
I20250830 07:54:31.596405 13232 catalog_manager.cc:5674] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967) does not have the latest schema for tablet 4d4b00bdadb24ec892d87c9be2ed7dd9 (table default.Table_3d12ac4bedcf433aa345dda9066deb22 [id=d2dbb756d66b483ebe44d45ddfa5c17c]). Expected version 6 got 0
I20250830 07:54:31.598763 13886 tablet_bootstrap.cc:492] T b4ab964a64a64e00a78ffd2b220aef46 P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:54:31.598908 13886 ts_tablet_manager.cc:1397] T b4ab964a64a64e00a78ffd2b220aef46 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.015s user 0.006s sys 0.002s
W20250830 07:54:31.599545 13234 catalog_manager.cc:5415] Ignoring report from unknown tablet 9e055d6089f541f799eddb5778eb2148
I20250830 07:54:31.599828 13886 raft_consensus.cc:357] T b4ab964a64a64e00a78ffd2b220aef46 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:31.600009 13886 raft_consensus.cc:383] T b4ab964a64a64e00a78ffd2b220aef46 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:31.600104 13886 raft_consensus.cc:738] T b4ab964a64a64e00a78ffd2b220aef46 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:54:31.600517 13886 consensus_queue.cc:260] T b4ab964a64a64e00a78ffd2b220aef46 P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:31.603650 13462 tablet_service.cc:1468] Processing CreateTablet for tablet 4b7eff24965f4f3ebfbf70dc82b7cce3 (DEFAULT_TABLE table=default.Table_73583ac06db64766bc040f852a5a5fbe [id=72109f2615294992b8bad894134edce8]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:31.604192 13462 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b7eff24965f4f3ebfbf70dc82b7cce3. 1 dirs total, 0 dirs full, 0 dirs failed
W20250830 07:54:31.605051 13234 catalog_manager.cc:5415] Ignoring report from unknown tablet b4ab964a64a64e00a78ffd2b220aef46
I20250830 07:54:31.605927 13886 ts_tablet_manager.cc:1428] T b4ab964a64a64e00a78ffd2b220aef46 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.007s user 0.000s sys 0.002s
W20250830 07:54:31.607743 13234 catalog_manager.cc:5415] Ignoring report from unknown tablet b4ab964a64a64e00a78ffd2b220aef46
I20250830 07:54:31.608793 13886 tablet_bootstrap.cc:492] T bf170b1865094ba38ef8568259e34656 P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:54:31.610767 13886 tablet_bootstrap.cc:654] T bf170b1865094ba38ef8568259e34656 P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:31.612057 13882 tablet_bootstrap.cc:492] T 7ed22d9617024d55a8add137e7971061 P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:54:31.612207 13882 ts_tablet_manager.cc:1397] T 7ed22d9617024d55a8add137e7971061 P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.037s user 0.012s sys 0.020s
I20250830 07:54:31.612713 13883 ts_tablet_manager.cc:1918] T d0368ce5ffbd48dca5a6674f65f34ce4 P 2065c332f15a4739899af79f3669c3ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250830 07:54:31.612860 13883 log.cc:1199] T d0368ce5ffbd48dca5a6674f65f34ce4 P 2065c332f15a4739899af79f3669c3ba: Deleting WAL directory at /tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/ts-0/wal/wals/d0368ce5ffbd48dca5a6674f65f34ce4
I20250830 07:54:31.612970 13882 raft_consensus.cc:357] T 7ed22d9617024d55a8add137e7971061 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:54:31.613188 13882 raft_consensus.cc:383] T 7ed22d9617024d55a8add137e7971061 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:31.613245 13883 ts_tablet_manager.cc:1939] T d0368ce5ffbd48dca5a6674f65f34ce4 P 2065c332f15a4739899af79f3669c3ba: Deleting consensus metadata
I20250830 07:54:31.613271 13882 raft_consensus.cc:738] T 7ed22d9617024d55a8add137e7971061 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:54:31.613516 13882 consensus_queue.cc:260] T 7ed22d9617024d55a8add137e7971061 P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:54:31.614018 13882 ts_tablet_manager.cc:1428] T 7ed22d9617024d55a8add137e7971061 P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20250830 07:54:31.614109 13218 catalog_manager.cc:4928] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): tablet d0368ce5ffbd48dca5a6674f65f34ce4 (table default.Table_737f5bb11c3f4b8e8d26b08fd43afa45 [id=1b7c141ed8af4dcab20683653fd59ee1]) successfully deleted
I20250830 07:54:31.614312 13882 tablet_bootstrap.cc:492] T f398e12cd9f543738d5163354f8a9d9d P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
W20250830 07:54:31.615887 13234 catalog_manager.cc:5415] Ignoring report from unknown tablet 7ed22d9617024d55a8add137e7971061
I20250830 07:54:31.616037 13882 tablet_bootstrap.cc:654] T f398e12cd9f543738d5163354f8a9d9d P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:31.619825 13754 tablet_service.cc:1468] Processing CreateTablet for tablet 4b7eff24965f4f3ebfbf70dc82b7cce3 (DEFAULT_TABLE table=default.Table_73583ac06db64766bc040f852a5a5fbe [id=72109f2615294992b8bad894134edce8]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:31.620319 13754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b7eff24965f4f3ebfbf70dc82b7cce3. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:31.622949 13886 tablet_bootstrap.cc:492] T bf170b1865094ba38ef8568259e34656 P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:54:31.623201 13886 ts_tablet_manager.cc:1397] T bf170b1865094ba38ef8568259e34656 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.014s user 0.004s sys 0.006s
I20250830 07:54:31.624123 13886 raft_consensus.cc:357] T bf170b1865094ba38ef8568259e34656 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:31.624410 13886 raft_consensus.cc:383] T bf170b1865094ba38ef8568259e34656 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:31.624532 13886 raft_consensus.cc:738] T bf170b1865094ba38ef8568259e34656 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:54:31.624859 13886 consensus_queue.cc:260] T bf170b1865094ba38ef8568259e34656 P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:31.628479 13750 tablet_service.cc:1515] Processing DeleteTablet for tablet bf170b1865094ba38ef8568259e34656 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:31 UTC) from {username='slave'} at 127.0.0.1:45460
I20250830 07:54:31.628522 13886 ts_tablet_manager.cc:1428] T bf170b1865094ba38ef8568259e34656 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.005s user 0.000s sys 0.002s
I20250830 07:54:31.629096 13886 tablet_bootstrap.cc:492] T ff0f9cccc8ed43b1a8cd38de0e9d4097 P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
W20250830 07:54:31.630086 13219 catalog_manager.cc:4908] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): delete failed for tablet bf170b1865094ba38ef8568259e34656 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bf170b1865094ba38ef8568259e34656 already in progress: creating tablet
I20250830 07:54:31.631980 13750 tablet_service.cc:1515] Processing DeleteTablet for tablet bf170b1865094ba38ef8568259e34656 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:31 UTC) from {username='slave'} at 127.0.0.1:45460
I20250830 07:54:31.632305 13884 tablet_replica.cc:331] T bf170b1865094ba38ef8568259e34656 P 9b057ade5dce45af9f8bf0bedf8b917f: stopping tablet replica
I20250830 07:54:31.632593 13884 raft_consensus.cc:2241] T bf170b1865094ba38ef8568259e34656 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Raft consensus shutting down.
I20250830 07:54:31.632795 13884 raft_consensus.cc:2270] T bf170b1865094ba38ef8568259e34656 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Raft consensus is shut down!
I20250830 07:54:31.633697 13886 tablet_bootstrap.cc:654] T ff0f9cccc8ed43b1a8cd38de0e9d4097 P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:31.634984 13884 ts_tablet_manager.cc:1905] T bf170b1865094ba38ef8568259e34656 P 9b057ade5dce45af9f8bf0bedf8b917f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250830 07:54:31.640147 13234 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_b191fbefc0754d688f765e6a4b62e6d6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:31.640758 13234 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b191fbefc0754d688f765e6a4b62e6d6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:31.640996 13227 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_d6a143c247c7430e9f454c4f0d896f45"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:31.641606 13227 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d6a143c247c7430e9f454c4f0d896f45 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:31.642033 13228 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_452b4395b710434591ea426b1e2432ba"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:31.642532 13228 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_452b4395b710434591ea426b1e2432ba in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:31.642776 13229 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_6e51d6d3fc4647cdaae81d6337a6b42a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:31.643193 13229 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6e51d6d3fc4647cdaae81d6337a6b42a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:31.644173 13233 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_786defd496fb44dc9ca518cadbc85db8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:31.644604 13233 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_786defd496fb44dc9ca518cadbc85db8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:31.645617 13230 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_0598a47b9b6b42108694e5826c8a404e" } new_table_name: "default.Table_a0428733949a4fd2926ca07d54b90aa5" modify_external_catalogs: true
I20250830 07:54:31.646582 13225 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_b07dd682fc9f4bab8406e11384e37c3c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:31.646981 13225 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b07dd682fc9f4bab8406e11384e37c3c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:31.648180 13232 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_cc801c47c3694a8ba8b360c304c6258d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:31.648535 13232 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_cc801c47c3694a8ba8b360c304c6258d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:31.665171 13886 tablet_bootstrap.cc:492] T ff0f9cccc8ed43b1a8cd38de0e9d4097 P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:54:31.665323 13886 ts_tablet_manager.cc:1397] T ff0f9cccc8ed43b1a8cd38de0e9d4097 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.036s user 0.008s sys 0.004s
I20250830 07:54:31.666356 13886 raft_consensus.cc:357] T ff0f9cccc8ed43b1a8cd38de0e9d4097 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:31.666574 13886 raft_consensus.cc:383] T ff0f9cccc8ed43b1a8cd38de0e9d4097 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:31.666669 13886 raft_consensus.cc:738] T ff0f9cccc8ed43b1a8cd38de0e9d4097 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:54:31.666942 13886 consensus_queue.cc:260] T ff0f9cccc8ed43b1a8cd38de0e9d4097 P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:31.668416 13886 ts_tablet_manager.cc:1428] T ff0f9cccc8ed43b1a8cd38de0e9d4097 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20250830 07:54:31.668762 13886 tablet_bootstrap.cc:492] T 7ed22d9617024d55a8add137e7971061 P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
W20250830 07:54:31.669379 13227 catalog_manager.cc:5415] Ignoring report from unknown tablet ff0f9cccc8ed43b1a8cd38de0e9d4097
I20250830 07:54:31.670500 13886 tablet_bootstrap.cc:654] T 7ed22d9617024d55a8add137e7971061 P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
W20250830 07:54:31.672675 13227 catalog_manager.cc:5415] Ignoring report from unknown tablet ff0f9cccc8ed43b1a8cd38de0e9d4097
W20250830 07:54:31.679595 13230 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f398e12cd9f543738d5163354f8a9d9d consensus state has no leader
I20250830 07:54:31.683636 13886 tablet_bootstrap.cc:492] T 7ed22d9617024d55a8add137e7971061 P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:54:31.683804 13886 ts_tablet_manager.cc:1397] T 7ed22d9617024d55a8add137e7971061 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.015s user 0.002s sys 0.001s
I20250830 07:54:31.684648 13886 raft_consensus.cc:357] T 7ed22d9617024d55a8add137e7971061 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:54:31.684844 13886 raft_consensus.cc:383] T 7ed22d9617024d55a8add137e7971061 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:31.684912 13886 raft_consensus.cc:738] T 7ed22d9617024d55a8add137e7971061 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:54:31.685144 13886 consensus_queue.cc:260] T 7ed22d9617024d55a8add137e7971061 P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:54:31.685601 13886 ts_tablet_manager.cc:1428] T 7ed22d9617024d55a8add137e7971061 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
W20250830 07:54:31.686724 13225 catalog_manager.cc:5415] Ignoring report from unknown tablet 7ed22d9617024d55a8add137e7971061
I20250830 07:54:31.688766 13886 tablet_bootstrap.cc:492] T b059069ed7eb433a9c54523bce21b4ad P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:54:31.689715 13608 tablet_service.cc:1468] Processing CreateTablet for tablet 4b7eff24965f4f3ebfbf70dc82b7cce3 (DEFAULT_TABLE table=default.Table_73583ac06db64766bc040f852a5a5fbe [id=72109f2615294992b8bad894134edce8]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:31.689883 13460 tablet_service.cc:1468] Processing CreateTablet for tablet c12cf30cc2aa4e12a20b9492af08a6f8 (DEFAULT_TABLE table=default.Table_1b4013fe42164beba1712685c4269acd [id=4976f023f31746a884cb610d757b94cd]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:31.690203 13608 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b7eff24965f4f3ebfbf70dc82b7cce3. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:31.690222 13886 tablet_bootstrap.cc:654] T b059069ed7eb433a9c54523bce21b4ad P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:31.690258 13460 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c12cf30cc2aa4e12a20b9492af08a6f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:31.699434 13884 ts_tablet_manager.cc:1918] T bf170b1865094ba38ef8568259e34656 P 9b057ade5dce45af9f8bf0bedf8b917f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250830 07:54:31.699553 13884 log.cc:1199] T bf170b1865094ba38ef8568259e34656 P 9b057ade5dce45af9f8bf0bedf8b917f: Deleting WAL directory at /tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/ts-2/wal/wals/bf170b1865094ba38ef8568259e34656
I20250830 07:54:31.700418 13884 ts_tablet_manager.cc:1939] T bf170b1865094ba38ef8568259e34656 P 9b057ade5dce45af9f8bf0bedf8b917f: Deleting consensus metadata
I20250830 07:54:31.706346 13897 raft_consensus.cc:491] T b4ab964a64a64e00a78ffd2b220aef46 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:31.706552 13897 raft_consensus.cc:513] T b4ab964a64a64e00a78ffd2b220aef46 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:31.707327 13897 leader_election.cc:290] T b4ab964a64a64e00a78ffd2b220aef46 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967)
I20250830 07:54:31.708356 13606 tablet_service.cc:1468] Processing CreateTablet for tablet c12cf30cc2aa4e12a20b9492af08a6f8 (DEFAULT_TABLE table=default.Table_1b4013fe42164beba1712685c4269acd [id=4976f023f31746a884cb610d757b94cd]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:31.708825 13606 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c12cf30cc2aa4e12a20b9492af08a6f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:31.708756 13487 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "b4ab964a64a64e00a78ffd2b220aef46" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
W20250830 07:54:31.709357 13703 leader_election.cc:343] T b4ab964a64a64e00a78ffd2b220aef46 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Not found: Tablet not found: b4ab964a64a64e00a78ffd2b220aef46
W20250830 07:54:31.709774 13701 leader_election.cc:343] T b4ab964a64a64e00a78ffd2b220aef46 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:31.709911 13701 leader_election.cc:304] T b4ab964a64a64e00a78ffd2b220aef46 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 2065c332f15a4739899af79f3669c3ba, 6b5e454d98894637b466ea27f1b647f9
I20250830 07:54:31.710784 13897 raft_consensus.cc:2747] T b4ab964a64a64e00a78ffd2b220aef46 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:54:31.718552 13606 tablet_service.cc:1468] Processing CreateTablet for tablet ef16b9e2d444489699f4db1ac26d5f6c (DEFAULT_TABLE table=default.Table_6a92a1708f7e46089983abe2263370f8 [id=bbebbf5262b94461a70235809d9a09eb]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:31.718971 13606 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef16b9e2d444489699f4db1ac26d5f6c. 1 dirs total, 0 dirs full, 0 dirs failed
W20250830 07:54:31.689005 13225 catalog_manager.cc:5415] Ignoring report from unknown tablet 7ed22d9617024d55a8add137e7971061
I20250830 07:54:31.723228 13230 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_9ad526f4ffd34dcab23696e310ec0e77" } modify_external_catalogs: true
I20250830 07:54:31.723425 13230 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_9ad526f4ffd34dcab23696e310ec0e77" } modify_external_catalogs: true
I20250830 07:54:31.706272 13219 catalog_manager.cc:4928] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): tablet bf170b1865094ba38ef8568259e34656 (table default.Table_fa4deee864594a2aa4987b24ae8e7c97 [id=2d16cc8010714d9381de323f97abbdca]) successfully deleted
W20250830 07:54:31.724279 13219 catalog_manager.cc:4726] Async tablet task AlterTable RPC for tablet 4d4b00bdadb24ec892d87c9be2ed7dd9 (table default.Table_3d12ac4bedcf433aa345dda9066deb22 [id=d2dbb756d66b483ebe44d45ddfa5c17c], current schema version=6) failed: Not found: failed to reset TS proxy: No leader found: Tablet 4d4b00bdadb24ec892d87c9be2ed7dd9 consensus state has no leader
I20250830 07:54:31.726155 13750 tablet_service.cc:1468] Processing CreateTablet for tablet ef16b9e2d444489699f4db1ac26d5f6c (DEFAULT_TABLE table=default.Table_6a92a1708f7e46089983abe2263370f8 [id=bbebbf5262b94461a70235809d9a09eb]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:31.726568 13750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef16b9e2d444489699f4db1ac26d5f6c. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:31.729298 13228 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_e0f8d99dbe3946ada0b16f2b86531730" } modify_external_catalogs: true
I20250830 07:54:31.731043 13228 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_e0f8d99dbe3946ada0b16f2b86531730" } modify_external_catalogs: true
I20250830 07:54:31.731824 13226 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_c22cc304586645d5b59c046388863abe" } new_table_name: "default.Table_0314a4797f194c43b900f374d7dcfeee" modify_external_catalogs: true
I20250830 07:54:31.732389 13233 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_c493813f589c4cf98350d55f9223c63b" } modify_external_catalogs: true
I20250830 07:54:31.733098 13460 tablet_service.cc:1468] Processing CreateTablet for tablet ef16b9e2d444489699f4db1ac26d5f6c (DEFAULT_TABLE table=default.Table_6a92a1708f7e46089983abe2263370f8 [id=bbebbf5262b94461a70235809d9a09eb]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:31.733323 13233 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_c493813f589c4cf98350d55f9223c63b" } modify_external_catalogs: true
I20250830 07:54:31.733572 13460 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef16b9e2d444489699f4db1ac26d5f6c. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:31.734457 13231 master_service.cc:948] ReplaceTablet: received request to replace tablet 7ef98dbbdf5848038a2da6140e126301 from {username='slave'} at 127.0.0.1:42126
I20250830 07:54:31.736171 13234 master_service.cc:948] ReplaceTablet: received request to replace tablet 5ce773ce68f649b1bf51f0dd901cb04f from {username='slave'} at 127.0.0.1:42126
I20250830 07:54:31.736462 13229 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_d6a143c247c7430e9f454c4f0d896f45" } new_table_name: "default.Table_4c6d1bab88bc42c294678202db2f736c" modify_external_catalogs: true
I20250830 07:54:31.737426 13232 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_b07dd682fc9f4bab8406e11384e37c3c" } new_table_name: "default.Table_17a2e182c79d4c13bc1ce3f53f9ba765" modify_external_catalogs: true
I20250830 07:54:31.743801 13227 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_6926264c97ae4af4a25f0bffa385688f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:31.744395 13227 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6926264c97ae4af4a25f0bffa385688f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:31.751251 13225 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_53cf6bab348a4b3c84bac9d533c27d25"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:31.751776 13225 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_53cf6bab348a4b3c84bac9d533c27d25 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:31.752154 13886 tablet_bootstrap.cc:492] T b059069ed7eb433a9c54523bce21b4ad P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:54:31.752306 13886 ts_tablet_manager.cc:1397] T b059069ed7eb433a9c54523bce21b4ad P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.064s user 0.006s sys 0.024s
I20250830 07:54:31.753059 13886 raft_consensus.cc:357] T b059069ed7eb433a9c54523bce21b4ad P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:54:31.753242 13886 raft_consensus.cc:383] T b059069ed7eb433a9c54523bce21b4ad P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:31.753352 13886 raft_consensus.cc:738] T b059069ed7eb433a9c54523bce21b4ad P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:54:31.753567 13886 consensus_queue.cc:260] T b059069ed7eb433a9c54523bce21b4ad P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:54:31.755944 13886 ts_tablet_manager.cc:1428] T b059069ed7eb433a9c54523bce21b4ad P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20250830 07:54:31.756227 13886 tablet_bootstrap.cc:492] T 8f4567f30cc34f288463e4a92bd3edd5 P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:54:31.759469 13886 tablet_bootstrap.cc:654] T 8f4567f30cc34f288463e4a92bd3edd5 P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:31.762411 13230 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet d876f6259bd94799a4e37dc9d14b8efe
I20250830 07:54:31.763471 13752 tablet_service.cc:1515] Processing DeleteTablet for tablet d876f6259bd94799a4e37dc9d14b8efe with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:31 UTC) from {username='slave'} at 127.0.0.1:45460
I20250830 07:54:31.763679 13608 tablet_service.cc:1515] Processing DeleteTablet for tablet d876f6259bd94799a4e37dc9d14b8efe with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:31 UTC) from {username='slave'} at 127.0.0.1:45306
W20250830 07:54:31.763998 13219 catalog_manager.cc:4895] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): delete failed for tablet d876f6259bd94799a4e37dc9d14b8efe because the tablet was not found. No further retry: Not found: Tablet not found: d876f6259bd94799a4e37dc9d14b8efe
W20250830 07:54:31.764452 13220 catalog_manager.cc:4895] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet d876f6259bd94799a4e37dc9d14b8efe because the tablet was not found. No further retry: Not found: Tablet not found: d876f6259bd94799a4e37dc9d14b8efe
I20250830 07:54:31.765156 13460 tablet_service.cc:1515] Processing DeleteTablet for tablet d876f6259bd94799a4e37dc9d14b8efe with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:31 UTC) from {username='slave'} at 127.0.0.1:37956
I20250830 07:54:31.765457 13230 catalog_manager.cc:5674] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743) does not have the latest schema for tablet b059069ed7eb433a9c54523bce21b4ad (table default.Table_80a0e1ec331a4abc8d2e28a89e89f537 [id=163edc59ef9846bfbe3c2c3f0b33e8cb]). Expected version 1 got 0
I20250830 07:54:31.766779 13230 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_79d48a151e96435f8e695e3b288057ee" } new_table_name: "default.Table_83fc86674acf4abca8bfc1fc039656c2" modify_external_catalogs: true
I20250830 07:54:31.771242 13754 tablet_service.cc:1468] Processing CreateTablet for tablet c12cf30cc2aa4e12a20b9492af08a6f8 (DEFAULT_TABLE table=default.Table_1b4013fe42164beba1712685c4269acd [id=4976f023f31746a884cb610d757b94cd]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:31.771763 13754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c12cf30cc2aa4e12a20b9492af08a6f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:31.778736 13231 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet 7ef98dbbdf5848038a2da6140e126301
I20250830 07:54:31.779313 13231 catalog_manager.cc:6652] ReplaceTablet: tablet 7ef98dbbdf5848038a2da6140e126301 deleted and replaced by tablet 1fa571e9490e499792225d7b786e8658
I20250830 07:54:31.779531 13608 tablet_service.cc:1515] Processing DeleteTablet for tablet 7ef98dbbdf5848038a2da6140e126301 with delete_type TABLET_DATA_DELETED (replaced by tablet 1fa571e9490e499792225d7b786e8658) from {username='slave'} at 127.0.0.1:45306
I20250830 07:54:31.780325 13231 catalog_manager.cc:5674] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743) does not have the latest schema for tablet b059069ed7eb433a9c54523bce21b4ad (table default.Table_80a0e1ec331a4abc8d2e28a89e89f537 [id=163edc59ef9846bfbe3c2c3f0b33e8cb]). Expected version 1 got 0
I20250830 07:54:31.781100 13231 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_73583ac06db64766bc040f852a5a5fbe" } modify_external_catalogs: true
W20250830 07:54:31.781220 13220 catalog_manager.cc:4908] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet 7ef98dbbdf5848038a2da6140e126301 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7ef98dbbdf5848038a2da6140e126301 already in progress: creating tablet
I20250830 07:54:31.781296 13231 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_73583ac06db64766bc040f852a5a5fbe" } modify_external_catalogs: true
I20250830 07:54:31.783135 13752 tablet_service.cc:1515] Processing DeleteTablet for tablet 7ef98dbbdf5848038a2da6140e126301 with delete_type TABLET_DATA_DELETED (replaced by tablet 1fa571e9490e499792225d7b786e8658) from {username='slave'} at 127.0.0.1:45460
W20250830 07:54:31.783716 13219 catalog_manager.cc:4908] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): delete failed for tablet 7ef98dbbdf5848038a2da6140e126301 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7ef98dbbdf5848038a2da6140e126301 already in progress: creating tablet
I20250830 07:54:31.783805 13460 tablet_service.cc:1515] Processing DeleteTablet for tablet 7ef98dbbdf5848038a2da6140e126301 with delete_type TABLET_DATA_DELETED (replaced by tablet 1fa571e9490e499792225d7b786e8658) from {username='slave'} at 127.0.0.1:37956
W20250830 07:54:31.783910 13229 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 29192c1c997e4ab59f0fc077476d8974 has no consensus state
I20250830 07:54:31.784196 13229 master_service.cc:948] ReplaceTablet: received request to replace tablet f398e12cd9f543738d5163354f8a9d9d from {username='slave'} at 127.0.0.1:42126
W20250830 07:54:31.785920 13226 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d33a5d107c6849aca6eb48ffdf8a5463 consensus state has no leader
I20250830 07:54:31.786159 13226 master_service.cc:948] ReplaceTablet: received request to replace tablet 4d4b00bdadb24ec892d87c9be2ed7dd9 from {username='slave'} at 127.0.0.1:42126
I20250830 07:54:31.787755 13233 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet 508ce3cc87734e5b8cec40e74522549a
I20250830 07:54:31.788455 13233 master_service.cc:948] ReplaceTablet: received request to replace tablet 778f6766c47f4a86b5dea60560f67d5c from {username='slave'} at 127.0.0.1:42126
I20250830 07:54:31.788877 13608 tablet_service.cc:1515] Processing DeleteTablet for tablet 508ce3cc87734e5b8cec40e74522549a with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:31 UTC) from {username='slave'} at 127.0.0.1:45306
W20250830 07:54:31.789599 13220 catalog_manager.cc:4895] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet 508ce3cc87734e5b8cec40e74522549a because the tablet was not found. No further retry: Not found: Tablet not found: 508ce3cc87734e5b8cec40e74522549a
I20250830 07:54:31.789850 13752 tablet_service.cc:1515] Processing DeleteTablet for tablet 508ce3cc87734e5b8cec40e74522549a with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:31 UTC) from {username='slave'} at 127.0.0.1:45460
I20250830 07:54:31.789995 13460 tablet_service.cc:1515] Processing DeleteTablet for tablet 508ce3cc87734e5b8cec40e74522549a with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:31 UTC) from {username='slave'} at 127.0.0.1:37956
I20250830 07:54:31.790335 13234 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet 5ce773ce68f649b1bf51f0dd901cb04f
I20250830 07:54:31.790808 13234 catalog_manager.cc:6652] ReplaceTablet: tablet 5ce773ce68f649b1bf51f0dd901cb04f deleted and replaced by tablet e134ab64aa1b4ce89e295b43cbc3fffb
I20250830 07:54:31.791115 13234 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_a0428733949a4fd2926ca07d54b90aa5" } modify_external_catalogs: true
I20250830 07:54:31.791306 13234 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_a0428733949a4fd2926ca07d54b90aa5" } modify_external_catalogs: true
W20250830 07:54:31.790356 13219 catalog_manager.cc:4895] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): delete failed for tablet 508ce3cc87734e5b8cec40e74522549a because the tablet was not found. No further retry: Not found: Tablet not found: 508ce3cc87734e5b8cec40e74522549a
I20250830 07:54:31.792215 13608 tablet_service.cc:1515] Processing DeleteTablet for tablet 5ce773ce68f649b1bf51f0dd901cb04f with delete_type TABLET_DATA_DELETED (replaced by tablet e134ab64aa1b4ce89e295b43cbc3fffb) from {username='slave'} at 127.0.0.1:45306
I20250830 07:54:31.792531 13460 tablet_service.cc:1515] Processing DeleteTablet for tablet 5ce773ce68f649b1bf51f0dd901cb04f with delete_type TABLET_DATA_DELETED (replaced by tablet e134ab64aa1b4ce89e295b43cbc3fffb) from {username='slave'} at 127.0.0.1:37956
I20250830 07:54:31.792665 13752 tablet_service.cc:1515] Processing DeleteTablet for tablet 5ce773ce68f649b1bf51f0dd901cb04f with delete_type TABLET_DATA_DELETED (replaced by tablet e134ab64aa1b4ce89e295b43cbc3fffb) from {username='slave'} at 127.0.0.1:45460
W20250830 07:54:31.793198 13220 catalog_manager.cc:4908] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet 5ce773ce68f649b1bf51f0dd901cb04f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5ce773ce68f649b1bf51f0dd901cb04f already in progress: creating tablet
W20250830 07:54:31.793593 13219 catalog_manager.cc:4908] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): delete failed for tablet 5ce773ce68f649b1bf51f0dd901cb04f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5ce773ce68f649b1bf51f0dd901cb04f already in progress: creating tablet
I20250830 07:54:31.793929 13228 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet a78c522b9fa945e2879fb965d82fb359
I20250830 07:54:31.794836 13608 tablet_service.cc:1515] Processing DeleteTablet for tablet a78c522b9fa945e2879fb965d82fb359 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:31 UTC) from {username='slave'} at 127.0.0.1:45306
I20250830 07:54:31.795136 13460 tablet_service.cc:1515] Processing DeleteTablet for tablet a78c522b9fa945e2879fb965d82fb359 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:31 UTC) from {username='slave'} at 127.0.0.1:37956
I20250830 07:54:31.795500 13752 tablet_service.cc:1515] Processing DeleteTablet for tablet a78c522b9fa945e2879fb965d82fb359 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:31 UTC) from {username='slave'} at 127.0.0.1:45460
W20250830 07:54:31.795960 13220 catalog_manager.cc:4895] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet a78c522b9fa945e2879fb965d82fb359 because the tablet was not found. No further retry: Not found: Tablet not found: a78c522b9fa945e2879fb965d82fb359
W20250830 07:54:31.796084 13219 catalog_manager.cc:4895] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): delete failed for tablet a78c522b9fa945e2879fb965d82fb359 because the tablet was not found. No further retry: Not found: Tablet not found: a78c522b9fa945e2879fb965d82fb359
W20250830 07:54:31.796540 13232 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 6f4c400c0e5e43319fa521b5cab694b4 has no consensus state
I20250830 07:54:31.806663 13227 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_c14e6b9a7bb54c8dbbc1d2e31e446971"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:31.807276 13227 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c14e6b9a7bb54c8dbbc1d2e31e446971 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250830 07:54:31.820013 13230 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d3b47314f7cd4e969d973c0a340137f1 has no consensus state
I20250830 07:54:31.830324 13460 tablet_service.cc:1468] Processing CreateTablet for tablet d33a5d107c6849aca6eb48ffdf8a5463 (DEFAULT_TABLE table=default.Table_0314a4797f194c43b900f374d7dcfeee [id=b7dcb14885434162aac95c78a5a70ba9]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:31.830793 13460 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d33a5d107c6849aca6eb48ffdf8a5463. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:31.839972 13887 tablet_bootstrap.cc:492] T ff0f9cccc8ed43b1a8cd38de0e9d4097 P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:54:31.840137 13887 ts_tablet_manager.cc:1397] T ff0f9cccc8ed43b1a8cd38de0e9d4097 P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.246s user 0.078s sys 0.093s
I20250830 07:54:31.841049 13887 raft_consensus.cc:357] T ff0f9cccc8ed43b1a8cd38de0e9d4097 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:31.841233 13887 raft_consensus.cc:383] T ff0f9cccc8ed43b1a8cd38de0e9d4097 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:31.841320 13229 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet f398e12cd9f543738d5163354f8a9d9d
I20250830 07:54:31.841334 13887 raft_consensus.cc:738] T ff0f9cccc8ed43b1a8cd38de0e9d4097 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:54:31.841583 13887 consensus_queue.cc:260] T ff0f9cccc8ed43b1a8cd38de0e9d4097 P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:31.842020 13608 tablet_service.cc:1515] Processing DeleteTablet for tablet f398e12cd9f543738d5163354f8a9d9d with delete_type TABLET_DATA_DELETED (replaced by tablet e4d99a96c9864aafbd8d3abcf328349f) from {username='slave'} at 127.0.0.1:45306
I20250830 07:54:31.841842 13229 catalog_manager.cc:6652] ReplaceTablet: tablet f398e12cd9f543738d5163354f8a9d9d deleted and replaced by tablet e4d99a96c9864aafbd8d3abcf328349f
W20250830 07:54:31.842651 13220 catalog_manager.cc:4908] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet f398e12cd9f543738d5163354f8a9d9d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f398e12cd9f543738d5163354f8a9d9d already in progress: creating tablet
I20250830 07:54:31.843160 13887 ts_tablet_manager.cc:1428] T ff0f9cccc8ed43b1a8cd38de0e9d4097 P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20250830 07:54:31.843439 13887 tablet_bootstrap.cc:492] T bf170b1865094ba38ef8568259e34656 P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:54:31.845139 13887 tablet_bootstrap.cc:654] T bf170b1865094ba38ef8568259e34656 P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:31.846099 13231 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet 4b7eff24965f4f3ebfbf70dc82b7cce3
W20250830 07:54:31.846109 13229 catalog_manager.cc:5415] Ignoring report from unknown tablet ff0f9cccc8ed43b1a8cd38de0e9d4097
I20250830 07:54:31.846963 13467 tablet_service.cc:1515] Processing DeleteTablet for tablet 4b7eff24965f4f3ebfbf70dc82b7cce3 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:31 UTC) from {username='slave'} at 127.0.0.1:37956
W20250830 07:54:31.848738 13229 catalog_manager.cc:5415] Ignoring report from unknown tablet ff0f9cccc8ed43b1a8cd38de0e9d4097
I20250830 07:54:31.848807 13752 tablet_service.cc:1515] Processing DeleteTablet for tablet 4b7eff24965f4f3ebfbf70dc82b7cce3 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:31 UTC) from {username='slave'} at 127.0.0.1:45460
W20250830 07:54:31.849642 13219 catalog_manager.cc:4908] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): delete failed for tablet 4b7eff24965f4f3ebfbf70dc82b7cce3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4b7eff24965f4f3ebfbf70dc82b7cce3 already in progress: creating tablet
I20250830 07:54:31.850504 13460 tablet_service.cc:1515] Processing DeleteTablet for tablet f398e12cd9f543738d5163354f8a9d9d with delete_type TABLET_DATA_DELETED (replaced by tablet e4d99a96c9864aafbd8d3abcf328349f) from {username='slave'} at 127.0.0.1:37956
I20250830 07:54:31.850705 13750 tablet_service.cc:1515] Processing DeleteTablet for tablet f398e12cd9f543738d5163354f8a9d9d with delete_type TABLET_DATA_DELETED (replaced by tablet e4d99a96c9864aafbd8d3abcf328349f) from {username='slave'} at 127.0.0.1:45460
I20250830 07:54:31.850768 13887 tablet_bootstrap.cc:492] T bf170b1865094ba38ef8568259e34656 P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:54:31.850922 13887 ts_tablet_manager.cc:1397] T bf170b1865094ba38ef8568259e34656 P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.008s user 0.004s sys 0.001s
W20250830 07:54:31.851277 13219 catalog_manager.cc:4908] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): delete failed for tablet f398e12cd9f543738d5163354f8a9d9d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f398e12cd9f543738d5163354f8a9d9d already in progress: creating tablet
I20250830 07:54:31.851670 13887 raft_consensus.cc:357] T bf170b1865094ba38ef8568259e34656 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:31.851859 13887 raft_consensus.cc:383] T bf170b1865094ba38ef8568259e34656 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:31.851931 13887 raft_consensus.cc:738] T bf170b1865094ba38ef8568259e34656 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:54:31.852125 13887 consensus_queue.cc:260] T bf170b1865094ba38ef8568259e34656 P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:31.852576 13887 ts_tablet_manager.cc:1428] T bf170b1865094ba38ef8568259e34656 P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20250830 07:54:31.852839 13887 tablet_bootstrap.cc:492] T b4ab964a64a64e00a78ffd2b220aef46 P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:54:31.854267 13887 tablet_bootstrap.cc:654] T b4ab964a64a64e00a78ffd2b220aef46 P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:31.855054 13608 tablet_service.cc:1515] Processing DeleteTablet for tablet 4b7eff24965f4f3ebfbf70dc82b7cce3 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:31 UTC) from {username='slave'} at 127.0.0.1:45306
W20250830 07:54:31.855734 13220 catalog_manager.cc:4908] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet 4b7eff24965f4f3ebfbf70dc82b7cce3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4b7eff24965f4f3ebfbf70dc82b7cce3 already in progress: creating tablet
W20250830 07:54:31.863436 13218 catalog_manager.cc:4895] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): delete failed for tablet d876f6259bd94799a4e37dc9d14b8efe because the tablet was not found. No further retry: Not found: Tablet not found: d876f6259bd94799a4e37dc9d14b8efe
W20250830 07:54:31.864006 13218 catalog_manager.cc:4908] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): delete failed for tablet 7ef98dbbdf5848038a2da6140e126301 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7ef98dbbdf5848038a2da6140e126301 already in progress: creating tablet
I20250830 07:54:31.864159 13229 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_f6365a8a7d034d06824a36d2f6033caf"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250830 07:54:31.864441 13230 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_83ef88343cbe43eba0c492ac3eb87e9f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:31.864780 13229 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f6365a8a7d034d06824a36d2f6033caf in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250830 07:54:31.865022 13230 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_83ef88343cbe43eba0c492ac3eb87e9f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:31.865728 13225 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_f775fcdfec41458982af59832f3e10a2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:31.866204 13225 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f775fcdfec41458982af59832f3e10a2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:31.868068 13231 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_307276a7da514840af7d3a3c90634e05"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:31.868718 13231 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_307276a7da514840af7d3a3c90634e05 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:31.870843 13887 tablet_bootstrap.cc:492] T b4ab964a64a64e00a78ffd2b220aef46 P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:54:31.871001 13887 ts_tablet_manager.cc:1397] T b4ab964a64a64e00a78ffd2b220aef46 P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.018s user 0.005s sys 0.000s
I20250830 07:54:31.871268 13608 tablet_service.cc:1468] Processing CreateTablet for tablet d33a5d107c6849aca6eb48ffdf8a5463 (DEFAULT_TABLE table=default.Table_0314a4797f194c43b900f374d7dcfeee [id=b7dcb14885434162aac95c78a5a70ba9]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:31.871652 13608 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d33a5d107c6849aca6eb48ffdf8a5463. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:31.871711 13887 raft_consensus.cc:357] T b4ab964a64a64e00a78ffd2b220aef46 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:31.871853 13887 raft_consensus.cc:383] T b4ab964a64a64e00a78ffd2b220aef46 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:31.871937 13887 raft_consensus.cc:738] T b4ab964a64a64e00a78ffd2b220aef46 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:54:31.872187 13887 consensus_queue.cc:260] T b4ab964a64a64e00a78ffd2b220aef46 P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:31.872578 13752 tablet_service.cc:1468] Processing CreateTablet for tablet a78c522b9fa945e2879fb965d82fb359 (DEFAULT_TABLE table=default.Table_e0f8d99dbe3946ada0b16f2b86531730 [id=d0356c98bbc04cfd830f1a0a0c2044a9]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:31.872970 13752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a78c522b9fa945e2879fb965d82fb359. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:31.874191 13887 ts_tablet_manager.cc:1428] T b4ab964a64a64e00a78ffd2b220aef46 P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20250830 07:54:31.875972 13887 tablet_bootstrap.cc:492] T ab7196ca193348f5b4bb9193b731e04f P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
W20250830 07:54:31.876473 13232 catalog_manager.cc:5415] Ignoring report from unknown tablet b4ab964a64a64e00a78ffd2b220aef46
I20250830 07:54:31.877571 13887 tablet_bootstrap.cc:654] T ab7196ca193348f5b4bb9193b731e04f P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:31.883136 13232 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_3dd99f1f4e8e4a2e987bd7fbfbee50d1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:31.883800 13232 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3dd99f1f4e8e4a2e987bd7fbfbee50d1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:31.887382 13460 tablet_service.cc:1468] Processing CreateTablet for tablet a78c522b9fa945e2879fb965d82fb359 (DEFAULT_TABLE table=default.Table_e0f8d99dbe3946ada0b16f2b86531730 [id=d0356c98bbc04cfd830f1a0a0c2044a9]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:31.887810 13460 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a78c522b9fa945e2879fb965d82fb359. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:31.888967 13228 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_a4a92fab99e5433580288411b9610fb1" } new_table_name: "default.Table_12c9ea9f75c24214838d600088c31bcf" modify_external_catalogs: true
I20250830 07:54:31.889885 13887 tablet_bootstrap.cc:492] T ab7196ca193348f5b4bb9193b731e04f P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:54:31.890048 13887 ts_tablet_manager.cc:1397] T ab7196ca193348f5b4bb9193b731e04f P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.014s user 0.002s sys 0.003s
I20250830 07:54:31.887305 13750 tablet_service.cc:1468] Processing CreateTablet for tablet d33a5d107c6849aca6eb48ffdf8a5463 (DEFAULT_TABLE table=default.Table_0314a4797f194c43b900f374d7dcfeee [id=b7dcb14885434162aac95c78a5a70ba9]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:31.890767 13750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d33a5d107c6849aca6eb48ffdf8a5463. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:31.890882 13887 raft_consensus.cc:357] T ab7196ca193348f5b4bb9193b731e04f P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:54:31.891172 13887 raft_consensus.cc:383] T ab7196ca193348f5b4bb9193b731e04f P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:31.891266 13887 raft_consensus.cc:738] T ab7196ca193348f5b4bb9193b731e04f P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:54:31.891580 13887 consensus_queue.cc:260] T ab7196ca193348f5b4bb9193b731e04f P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:54:31.893527 13887 ts_tablet_manager.cc:1428] T ab7196ca193348f5b4bb9193b731e04f P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20250830 07:54:31.893839 13887 tablet_bootstrap.cc:492] T 8f4567f30cc34f288463e4a92bd3edd5 P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:54:31.899358 13226 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet 4d4b00bdadb24ec892d87c9be2ed7dd9
W20250830 07:54:31.899449 13218 catalog_manager.cc:4895] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): delete failed for tablet 508ce3cc87734e5b8cec40e74522549a because the tablet was not found. No further retry: Not found: Tablet not found: 508ce3cc87734e5b8cec40e74522549a
I20250830 07:54:31.899781 13226 catalog_manager.cc:6652] ReplaceTablet: tablet 4d4b00bdadb24ec892d87c9be2ed7dd9 deleted and replaced by tablet c9a8f144d50c4d3d81fbf43ce29a2ad2
I20250830 07:54:31.900051 13467 tablet_service.cc:1515] Processing DeleteTablet for tablet 4d4b00bdadb24ec892d87c9be2ed7dd9 with delete_type TABLET_DATA_DELETED (replaced by tablet c9a8f144d50c4d3d81fbf43ce29a2ad2) from {username='slave'} at 127.0.0.1:37956
W20250830 07:54:31.900652 13218 catalog_manager.cc:4908] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): delete failed for tablet 5ce773ce68f649b1bf51f0dd901cb04f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5ce773ce68f649b1bf51f0dd901cb04f already in progress: creating tablet
I20250830 07:54:31.901244 13226 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_599e4e4a8de24cd78bdd1c5d1c726b50"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:31.901701 13226 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_599e4e4a8de24cd78bdd1c5d1c726b50 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:31.901959 13887 tablet_bootstrap.cc:654] T 8f4567f30cc34f288463e4a92bd3edd5 P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:31.902168 13462 tablet_service.cc:1515] Processing DeleteTablet for tablet bf170b1865094ba38ef8568259e34656 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:31 UTC) from {username='slave'} at 127.0.0.1:37956
I20250830 07:54:31.904397 13608 tablet_service.cc:1515] Processing DeleteTablet for tablet 4d4b00bdadb24ec892d87c9be2ed7dd9 with delete_type TABLET_DATA_DELETED (replaced by tablet c9a8f144d50c4d3d81fbf43ce29a2ad2) from {username='slave'} at 127.0.0.1:45306
I20250830 07:54:31.904790 13601 tablet_service.cc:1468] Processing CreateTablet for tablet a78c522b9fa945e2879fb965d82fb359 (DEFAULT_TABLE table=default.Table_e0f8d99dbe3946ada0b16f2b86531730 [id=d0356c98bbc04cfd830f1a0a0c2044a9]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:31.905098 13601 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a78c522b9fa945e2879fb965d82fb359. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:31.907049 13885 tablet_replica.cc:331] T 4d4b00bdadb24ec892d87c9be2ed7dd9 P 6b5e454d98894637b466ea27f1b647f9: stopping tablet replica
I20250830 07:54:31.907064 13883 tablet_replica.cc:331] T bf170b1865094ba38ef8568259e34656 P 2065c332f15a4739899af79f3669c3ba: stopping tablet replica
I20250830 07:54:31.907239 13885 raft_consensus.cc:2241] T 4d4b00bdadb24ec892d87c9be2ed7dd9 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250830 07:54:31.907279 13883 raft_consensus.cc:2241] T bf170b1865094ba38ef8568259e34656 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Raft consensus shutting down.
I20250830 07:54:31.907390 13885 raft_consensus.cc:2270] T 4d4b00bdadb24ec892d87c9be2ed7dd9 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250830 07:54:31.907464 13883 raft_consensus.cc:2270] T bf170b1865094ba38ef8568259e34656 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Raft consensus is shut down!
I20250830 07:54:31.908299 13885 ts_tablet_manager.cc:1905] T 4d4b00bdadb24ec892d87c9be2ed7dd9 P 6b5e454d98894637b466ea27f1b647f9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250830 07:54:31.908639 13608 tablet_service.cc:1468] Processing CreateTablet for tablet f846a23f0be046028cc2472de88b71c4 (DEFAULT_TABLE table=default.Table_b4d9eb5b2f1546b7aa8219ee394f849e [id=66b40d7668914309b6bd8eaf8994d9ac]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:31.908977 13608 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f846a23f0be046028cc2472de88b71c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:31.912180 13747 tablet_service.cc:1468] Processing CreateTablet for tablet f846a23f0be046028cc2472de88b71c4 (DEFAULT_TABLE table=default.Table_b4d9eb5b2f1546b7aa8219ee394f849e [id=66b40d7668914309b6bd8eaf8994d9ac]), partition=RANGE (key) PARTITION UNBOUNDED
W20250830 07:54:31.912290 13218 catalog_manager.cc:4895] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): delete failed for tablet a78c522b9fa945e2879fb965d82fb359 because the tablet was not found. No further retry: Not found: Tablet not found: a78c522b9fa945e2879fb965d82fb359
I20250830 07:54:31.912526 13747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f846a23f0be046028cc2472de88b71c4. 1 dirs total, 0 dirs full, 0 dirs failed
W20250830 07:54:31.912528 13218 catalog_manager.cc:4908] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): delete failed for tablet 4b7eff24965f4f3ebfbf70dc82b7cce3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4b7eff24965f4f3ebfbf70dc82b7cce3 already in progress: creating tablet
W20250830 07:54:31.912775 13218 catalog_manager.cc:4908] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): delete failed for tablet f398e12cd9f543738d5163354f8a9d9d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f398e12cd9f543738d5163354f8a9d9d already in progress: creating tablet
W20250830 07:54:31.913000 13218 catalog_manager.cc:4908] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): delete failed for tablet 4d4b00bdadb24ec892d87c9be2ed7dd9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4d4b00bdadb24ec892d87c9be2ed7dd9 already in progress: creating tablet
I20250830 07:54:31.914144 13467 tablet_service.cc:1468] Processing CreateTablet for tablet 18afeddd2c0642028f93a16323b6e849 (DEFAULT_TABLE table=default.Table_4b9f002c2a2948c8b913731aaba44e17 [id=e454812e8c134d41a3a47464ac56b059]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:31.914487 13467 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18afeddd2c0642028f93a16323b6e849. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:31.914767 13752 tablet_service.cc:1515] Processing DeleteTablet for tablet 4d4b00bdadb24ec892d87c9be2ed7dd9 with delete_type TABLET_DATA_DELETED (replaced by tablet c9a8f144d50c4d3d81fbf43ce29a2ad2) from {username='slave'} at 127.0.0.1:45460
I20250830 07:54:31.915189 13748 tablet_service.cc:1468] Processing CreateTablet for tablet 18afeddd2c0642028f93a16323b6e849 (DEFAULT_TABLE table=default.Table_4b9f002c2a2948c8b913731aaba44e17 [id=e454812e8c134d41a3a47464ac56b059]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:31.915509 13748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18afeddd2c0642028f93a16323b6e849. 1 dirs total, 0 dirs full, 0 dirs failed
W20250830 07:54:31.917865 13219 catalog_manager.cc:4908] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): delete failed for tablet 4d4b00bdadb24ec892d87c9be2ed7dd9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4d4b00bdadb24ec892d87c9be2ed7dd9 already in progress: creating tablet
I20250830 07:54:31.920991 13233 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet 778f6766c47f4a86b5dea60560f67d5c
I20250830 07:54:31.921978 13233 catalog_manager.cc:6652] ReplaceTablet: tablet 778f6766c47f4a86b5dea60560f67d5c deleted and replaced by tablet 4c2c85732d454cd98efc2646af9450ed
I20250830 07:54:31.922024 13747 tablet_service.cc:1515] Processing DeleteTablet for tablet 778f6766c47f4a86b5dea60560f67d5c with delete_type TABLET_DATA_DELETED (replaced by tablet 4c2c85732d454cd98efc2646af9450ed) from {username='slave'} at 127.0.0.1:45460
I20250830 07:54:31.922256 13602 tablet_service.cc:1468] Processing CreateTablet for tablet 18afeddd2c0642028f93a16323b6e849 (DEFAULT_TABLE table=default.Table_4b9f002c2a2948c8b913731aaba44e17 [id=e454812e8c134d41a3a47464ac56b059]), partition=RANGE (key) PARTITION UNBOUNDED
W20250830 07:54:31.922513 13219 catalog_manager.cc:4908] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): delete failed for tablet 778f6766c47f4a86b5dea60560f67d5c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 778f6766c47f4a86b5dea60560f67d5c already in progress: creating tablet
I20250830 07:54:31.922588 13602 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18afeddd2c0642028f93a16323b6e849. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:31.923071 13604 tablet_service.cc:1515] Processing DeleteTablet for tablet 778f6766c47f4a86b5dea60560f67d5c with delete_type TABLET_DATA_DELETED (replaced by tablet 4c2c85732d454cd98efc2646af9450ed) from {username='slave'} at 127.0.0.1:45306
I20250830 07:54:31.924193 13233 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_68a8222fb01847ca88079ba1dead8d71"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:31.924721 13233 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_68a8222fb01847ca88079ba1dead8d71 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:31.932821 13885 ts_tablet_manager.cc:1918] T 4d4b00bdadb24ec892d87c9be2ed7dd9 P 6b5e454d98894637b466ea27f1b647f9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250830 07:54:31.932971 13885 log.cc:1199] T 4d4b00bdadb24ec892d87c9be2ed7dd9 P 6b5e454d98894637b466ea27f1b647f9: Deleting WAL directory at /tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/ts-1/wal/wals/4d4b00bdadb24ec892d87c9be2ed7dd9
I20250830 07:54:31.933454 13885 ts_tablet_manager.cc:1939] T 4d4b00bdadb24ec892d87c9be2ed7dd9 P 6b5e454d98894637b466ea27f1b647f9: Deleting consensus metadata
I20250830 07:54:31.934497 13220 catalog_manager.cc:4928] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): tablet 4d4b00bdadb24ec892d87c9be2ed7dd9 (table default.Table_3d12ac4bedcf433aa345dda9066deb22 [id=d2dbb756d66b483ebe44d45ddfa5c17c]) successfully deleted
I20250830 07:54:31.934883 13885 tablet_replica.cc:331] T 778f6766c47f4a86b5dea60560f67d5c P 6b5e454d98894637b466ea27f1b647f9: stopping tablet replica
I20250830 07:54:31.935223 13885 raft_consensus.cc:2241] T 778f6766c47f4a86b5dea60560f67d5c P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250830 07:54:31.935437 13885 raft_consensus.cc:2270] T 778f6766c47f4a86b5dea60560f67d5c P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250830 07:54:31.935985 13885 ts_tablet_manager.cc:1905] T 778f6766c47f4a86b5dea60560f67d5c P 6b5e454d98894637b466ea27f1b647f9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250830 07:54:31.939014 13466 tablet_service.cc:1515] Processing DeleteTablet for tablet 778f6766c47f4a86b5dea60560f67d5c with delete_type TABLET_DATA_DELETED (replaced by tablet 4c2c85732d454cd98efc2646af9450ed) from {username='slave'} at 127.0.0.1:37956
I20250830 07:54:31.939256 13460 tablet_service.cc:1515] Processing DeleteTablet for tablet ab7196ca193348f5b4bb9193b731e04f with delete_type TABLET_DATA_DELETED (replaced by tablet 9d00ee83780e4cf780ca92f1504d26b5) from {username='slave'} at 127.0.0.1:37956
I20250830 07:54:31.943251 13462 tablet_service.cc:1468] Processing CreateTablet for tablet f846a23f0be046028cc2472de88b71c4 (DEFAULT_TABLE table=default.Table_b4d9eb5b2f1546b7aa8219ee394f849e [id=66b40d7668914309b6bd8eaf8994d9ac]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:31.943761 13462 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f846a23f0be046028cc2472de88b71c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:31.944237 13885 ts_tablet_manager.cc:1918] T 778f6766c47f4a86b5dea60560f67d5c P 6b5e454d98894637b466ea27f1b647f9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250830 07:54:31.944398 13885 log.cc:1199] T 778f6766c47f4a86b5dea60560f67d5c P 6b5e454d98894637b466ea27f1b647f9: Deleting WAL directory at /tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/ts-1/wal/wals/778f6766c47f4a86b5dea60560f67d5c
I20250830 07:54:31.944783 13885 ts_tablet_manager.cc:1939] T 778f6766c47f4a86b5dea60560f67d5c P 6b5e454d98894637b466ea27f1b647f9: Deleting consensus metadata
I20250830 07:54:31.946254 13220 catalog_manager.cc:4928] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): tablet 778f6766c47f4a86b5dea60560f67d5c (table default.Table_d2ac5bc3c0c246c4bb6c797de6efedae [id=08a2c4f9b62b465cb1bf7983bc8b802d]) successfully deleted
I20250830 07:54:31.946386 13887 tablet_bootstrap.cc:492] T 8f4567f30cc34f288463e4a92bd3edd5 P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:54:31.946532 13887 ts_tablet_manager.cc:1397] T 8f4567f30cc34f288463e4a92bd3edd5 P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.053s user 0.006s sys 0.003s
I20250830 07:54:31.947302 13887 raft_consensus.cc:357] T 8f4567f30cc34f288463e4a92bd3edd5 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:54:31.947502 13887 raft_consensus.cc:383] T 8f4567f30cc34f288463e4a92bd3edd5 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:31.947614 13887 raft_consensus.cc:738] T 8f4567f30cc34f288463e4a92bd3edd5 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:54:31.947878 13887 consensus_queue.cc:260] T 8f4567f30cc34f288463e4a92bd3edd5 P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:54:31.950747 13887 ts_tablet_manager.cc:1428] T 8f4567f30cc34f288463e4a92bd3edd5 P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20250830 07:54:31.951525 13883 ts_tablet_manager.cc:1905] T bf170b1865094ba38ef8568259e34656 P 2065c332f15a4739899af79f3669c3ba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250830 07:54:31.955060 13887 tablet_bootstrap.cc:492] T 32c75568db9b4f00bb567d09dab3d45a P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:54:31.957068 13887 tablet_bootstrap.cc:654] T 32c75568db9b4f00bb567d09dab3d45a P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:31.961365 13462 tablet_service.cc:1468] Processing CreateTablet for tablet 508ce3cc87734e5b8cec40e74522549a (DEFAULT_TABLE table=default.Table_c493813f589c4cf98350d55f9223c63b [id=50769b81daac4401991c99dd33da256d]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:31.962060 13602 tablet_service.cc:1468] Processing CreateTablet for tablet 508ce3cc87734e5b8cec40e74522549a (DEFAULT_TABLE table=default.Table_c493813f589c4cf98350d55f9223c63b [id=50769b81daac4401991c99dd33da256d]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:31.962426 13602 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 508ce3cc87734e5b8cec40e74522549a. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:31.962528 13467 tablet_service.cc:1468] Processing CreateTablet for tablet d876f6259bd94799a4e37dc9d14b8efe (DEFAULT_TABLE table=default.Table_9ad526f4ffd34dcab23696e310ec0e77 [id=030e4a66e573418fa728fc2a3df7d4dd]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:31.963717 13608 tablet_service.cc:1468] Processing CreateTablet for tablet d876f6259bd94799a4e37dc9d14b8efe (DEFAULT_TABLE table=default.Table_9ad526f4ffd34dcab23696e310ec0e77 [id=030e4a66e573418fa728fc2a3df7d4dd]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:31.964088 13608 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d876f6259bd94799a4e37dc9d14b8efe. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:31.965796 13887 tablet_bootstrap.cc:492] T 32c75568db9b4f00bb567d09dab3d45a P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:54:31.965950 13887 ts_tablet_manager.cc:1397] T 32c75568db9b4f00bb567d09dab3d45a P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.014s user 0.002s sys 0.008s
I20250830 07:54:31.966150 13601 tablet_service.cc:1468] Processing CreateTablet for tablet 0186504d9e4949179ce5b92b85f5b230 (DEFAULT_TABLE table=default.Table_f817d6b952384e64a8b6be555cc4db2f [id=320265dd7ec24f44acaec48bd44472db]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:31.966485 13601 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0186504d9e4949179ce5b92b85f5b230. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:31.966599 13887 raft_consensus.cc:357] T 32c75568db9b4f00bb567d09dab3d45a P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:54:31.966760 13887 raft_consensus.cc:383] T 32c75568db9b4f00bb567d09dab3d45a P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:31.966813 13887 raft_consensus.cc:738] T 32c75568db9b4f00bb567d09dab3d45a P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:54:31.967029 13887 consensus_queue.cc:260] T 32c75568db9b4f00bb567d09dab3d45a P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:54:31.967259 13460 tablet_service.cc:1468] Processing CreateTablet for tablet 0186504d9e4949179ce5b92b85f5b230 (DEFAULT_TABLE table=default.Table_f817d6b952384e64a8b6be555cc4db2f [id=320265dd7ec24f44acaec48bd44472db]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:31.967568 13747 tablet_service.cc:1468] Processing CreateTablet for tablet d876f6259bd94799a4e37dc9d14b8efe (DEFAULT_TABLE table=default.Table_9ad526f4ffd34dcab23696e310ec0e77 [id=030e4a66e573418fa728fc2a3df7d4dd]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:31.967983 13747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d876f6259bd94799a4e37dc9d14b8efe. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:31.969348 13887 ts_tablet_manager.cc:1428] T 32c75568db9b4f00bb567d09dab3d45a P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20250830 07:54:31.971220 13887 tablet_bootstrap.cc:492] T b059069ed7eb433a9c54523bce21b4ad P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:54:31.973284 13887 tablet_bootstrap.cc:654] T b059069ed7eb433a9c54523bce21b4ad P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:31.975453 13227 catalog_manager.cc:5674] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325) does not have the latest schema for tablet 8f4567f30cc34f288463e4a92bd3edd5 (table default.Table_1bad683bf46c49aa8c24cd18c2c2e990 [id=3c052a58caaa412f8d9d70063dcd97c0]). Expected version 1 got 0
I20250830 07:54:31.976187 13227 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_4b9f002c2a2948c8b913731aaba44e17" } modify_external_catalogs: true
I20250830 07:54:31.976397 13234 catalog_manager.cc:5864] Not sending DeleteTablet requests; no consensus state for tablet e4d99a96c9864aafbd8d3abcf328349f
I20250830 07:54:31.976362 13227 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_4b9f002c2a2948c8b913731aaba44e17" } modify_external_catalogs: true
I20250830 07:54:31.977139 13754 tablet_service.cc:1468] Processing CreateTablet for tablet 508ce3cc87734e5b8cec40e74522549a (DEFAULT_TABLE table=default.Table_c493813f589c4cf98350d55f9223c63b [id=50769b81daac4401991c99dd33da256d]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:31.977494 13754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 508ce3cc87734e5b8cec40e74522549a. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:31.979875 13747 tablet_service.cc:1468] Processing CreateTablet for tablet 0186504d9e4949179ce5b92b85f5b230 (DEFAULT_TABLE table=default.Table_f817d6b952384e64a8b6be555cc4db2f [id=320265dd7ec24f44acaec48bd44472db]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:31.980261 13747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0186504d9e4949179ce5b92b85f5b230. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:31.989169 13886 tablet_bootstrap.cc:492] T 8f4567f30cc34f288463e4a92bd3edd5 P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:54:31.989355 13886 ts_tablet_manager.cc:1397] T 8f4567f30cc34f288463e4a92bd3edd5 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.233s user 0.013s sys 0.073s
I20250830 07:54:31.990124 13886 raft_consensus.cc:357] T 8f4567f30cc34f288463e4a92bd3edd5 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:54:31.990331 13886 raft_consensus.cc:383] T 8f4567f30cc34f288463e4a92bd3edd5 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:31.990406 13886 raft_consensus.cc:738] T 8f4567f30cc34f288463e4a92bd3edd5 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:54:31.990628 13467 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d876f6259bd94799a4e37dc9d14b8efe. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:31.990670 13886 consensus_queue.cc:260] T 8f4567f30cc34f288463e4a92bd3edd5 P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:54:31.990870 13460 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0186504d9e4949179ce5b92b85f5b230. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:31.991075 13225 master_service.cc:948] ReplaceTablet: received request to replace tablet d876f6259bd94799a4e37dc9d14b8efe from {username='slave'} at 127.0.0.1:42126
I20250830 07:54:31.992805 13886 ts_tablet_manager.cc:1428] T 8f4567f30cc34f288463e4a92bd3edd5 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20250830 07:54:31.995249 13882 tablet_bootstrap.cc:492] T f398e12cd9f543738d5163354f8a9d9d P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:54:31.995383 13882 ts_tablet_manager.cc:1397] T f398e12cd9f543738d5163354f8a9d9d P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.381s user 0.073s sys 0.110s
I20250830 07:54:31.995774 13462 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 508ce3cc87734e5b8cec40e74522549a. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:31.996100 13882 raft_consensus.cc:357] T f398e12cd9f543738d5163354f8a9d9d P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:31.996251 13882 raft_consensus.cc:383] T f398e12cd9f543738d5163354f8a9d9d P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:31.996414 13882 raft_consensus.cc:738] T f398e12cd9f543738d5163354f8a9d9d P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:54:31.996645 13882 consensus_queue.cc:260] T f398e12cd9f543738d5163354f8a9d9d P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:31.997153 13882 ts_tablet_manager.cc:1428] T f398e12cd9f543738d5163354f8a9d9d P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20250830 07:54:31.997458 13882 tablet_bootstrap.cc:492] T a04bf79de30a42a98e71f622efc90c22 P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
W20250830 07:54:32.001416 13422 connection.cc:537] client connection to 127.12.209.60:43889 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20250830 07:54:32.001894 13536 heartbeater.cc:646] Failed to heartbeat to 127.12.209.60:43889 (0 consecutive failures): Network error: Failed to send heartbeat to master: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20250830 07:54:32.001976 13229 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_cc801c47c3694a8ba8b360c304c6258d" } new_table_name: "default.Table_fc298c4951614456914be830598a020a" modify_external_catalogs: true
I20250830 07:54:32.003304 13234 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_0314a4797f194c43b900f374d7dcfeee" } new_table_name: "default.Table_3797e2a45c3146938c3d05485ce19f5d" modify_external_catalogs: true
I20250830 07:54:32.006457 13232 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_4c6d1bab88bc42c294678202db2f736c" } modify_external_catalogs: true
I20250830 07:54:32.006621 13232 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_4c6d1bab88bc42c294678202db2f736c" } modify_external_catalogs: true
W20250830 07:54:32.007716 13228 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 1fa571e9490e499792225d7b786e8658 has no consensus state
I20250830 07:54:32.008076 13228 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_b191fbefc0754d688f765e6a4b62e6d6" } modify_external_catalogs: true
I20250830 07:54:32.008230 13228 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_b191fbefc0754d688f765e6a4b62e6d6" } modify_external_catalogs: true
I20250830 07:54:32.009553 13226 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_f775fcdfec41458982af59832f3e10a2" } new_table_name: "default.Table_9820075fa56348c883f2c302ec3b6adf" modify_external_catalogs: true
I20250830 07:54:32.011694 13883 ts_tablet_manager.cc:1918] T bf170b1865094ba38ef8568259e34656 P 2065c332f15a4739899af79f3669c3ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250830 07:54:32.011798 13883 log.cc:1199] T bf170b1865094ba38ef8568259e34656 P 2065c332f15a4739899af79f3669c3ba: Deleting WAL directory at /tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/ts-0/wal/wals/bf170b1865094ba38ef8568259e34656
I20250830 07:54:32.012149 13883 ts_tablet_manager.cc:1939] T bf170b1865094ba38ef8568259e34656 P 2065c332f15a4739899af79f3669c3ba: Deleting consensus metadata
I20250830 07:54:32.013110 13883 tablet_replica.cc:331] T ab7196ca193348f5b4bb9193b731e04f P 2065c332f15a4739899af79f3669c3ba: stopping tablet replica
I20250830 07:54:32.013296 13883 raft_consensus.cc:2241] T ab7196ca193348f5b4bb9193b731e04f P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Raft consensus shutting down.
I20250830 07:54:32.013428 13883 raft_consensus.cc:2270] T ab7196ca193348f5b4bb9193b731e04f P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Raft consensus is shut down!
I20250830 07:54:32.013645 13231 catalog_manager.cc:5674] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743) does not have the latest schema for tablet 8f4567f30cc34f288463e4a92bd3edd5 (table default.Table_1bad683bf46c49aa8c24cd18c2c2e990 [id=3c052a58caaa412f8d9d70063dcd97c0]). Expected version 1 got 0
I20250830 07:54:32.014225 13883 ts_tablet_manager.cc:1905] T ab7196ca193348f5b4bb9193b731e04f P 2065c332f15a4739899af79f3669c3ba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250830 07:54:32.014317 13231 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_dd774f7d4e734781863c6a40c156e3e7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:32.014792 13231 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_dd774f7d4e734781863c6a40c156e3e7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:32.016517 13887 tablet_bootstrap.cc:492] T b059069ed7eb433a9c54523bce21b4ad P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:54:32.016647 13887 ts_tablet_manager.cc:1397] T b059069ed7eb433a9c54523bce21b4ad P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.046s user 0.005s sys 0.005s
I20250830 07:54:31.993084 13886 tablet_bootstrap.cc:492] T 778f6766c47f4a86b5dea60560f67d5c P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
W20250830 07:54:32.001865 13820 heartbeater.cc:646] Failed to heartbeat to 127.12.209.60:43889 (0 consecutive failures): Network error: Failed to send heartbeat to master: recv got EOF from 127.12.209.60:43889 (error 108)
I20250830 07:54:32.017563 13887 raft_consensus.cc:357] T b059069ed7eb433a9c54523bce21b4ad P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:54:32.017750 13887 raft_consensus.cc:383] T b059069ed7eb433a9c54523bce21b4ad P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:32.017957 13887 raft_consensus.cc:738] T b059069ed7eb433a9c54523bce21b4ad P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:54:32.019269 13886 tablet_bootstrap.cc:654] T 778f6766c47f4a86b5dea60560f67d5c P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:32.023535 13227 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet 18afeddd2c0642028f93a16323b6e849
W20250830 07:54:32.023595 13229 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 1933d49d319b4bd7b717dda2b83859f3 has no consensus state
I20250830 07:54:32.024107 13227 master_service.cc:948] ReplaceTablet: received request to replace tablet 18afeddd2c0642028f93a16323b6e849 from {username='slave'} at 127.0.0.1:42126
I20250830 07:54:32.024467 13229 catalog_manager.cc:5674] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743) does not have the latest schema for tablet 8f4567f30cc34f288463e4a92bd3edd5 (table default.Table_1bad683bf46c49aa8c24cd18c2c2e990 [id=3c052a58caaa412f8d9d70063dcd97c0]). Expected version 1 got 0
I20250830 07:54:32.024746 13227 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_fd6941613dcf424583ca9f728fd345dd"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:32.025202 13227 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fd6941613dcf424583ca9f728fd345dd in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:32.025135 13229 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_1b4013fe42164beba1712685c4269acd" } new_table_name: "default.Table_f95d862caa7944469f67bcf46893fa07" modify_external_catalogs: true
W20250830 07:54:32.026762 13234 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d33a5d107c6849aca6eb48ffdf8a5463 consensus state has no leader
I20250830 07:54:32.027154 13232 catalog_manager.cc:5864] Not sending DeleteTablet requests; no consensus state for tablet 29192c1c997e4ab59f0fc077476d8974
I20250830 07:54:32.027532 13228 catalog_manager.cc:5864] Not sending DeleteTablet requests; no consensus state for tablet 24dcdb5680164bd5aa11017e2953ea0c
W20250830 07:54:32.027889 13226 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d1ae3812d72b419798736328da64b53c has no consensus state
I20250830 07:54:32.031075 13882 tablet_bootstrap.cc:654] T a04bf79de30a42a98e71f622efc90c22 P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:32.031147 13606 tablet_service.cc:1515] Processing DeleteTablet for tablet 18afeddd2c0642028f93a16323b6e849 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:31 UTC) from {username='slave'} at 127.0.0.1:45306
W20250830 07:54:32.031103 13674 heartbeater.cc:646] Failed to heartbeat to 127.12.209.60:43889 (0 consecutive failures): Network error: Failed to send heartbeat to master: recv got EOF from 127.12.209.60:43889 (error 108)
W20250830 07:54:32.032524 13220 catalog_manager.cc:4908] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet 18afeddd2c0642028f93a16323b6e849 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 18afeddd2c0642028f93a16323b6e849 already in progress: creating tablet
I20250830 07:54:32.033023 13606 tablet_service.cc:1515] Processing DeleteTablet for tablet f398e12cd9f543738d5163354f8a9d9d with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:31 UTC) from {username='slave'} at 127.0.0.1:45306
I20250830 07:54:32.033308 13885 tablet_replica.cc:331] T f398e12cd9f543738d5163354f8a9d9d P 6b5e454d98894637b466ea27f1b647f9: stopping tablet replica
I20250830 07:54:32.033528 13885 raft_consensus.cc:2241] T f398e12cd9f543738d5163354f8a9d9d P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250830 07:54:32.033610 13230 catalog_manager.cc:5674] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325) does not have the latest schema for tablet 8f4567f30cc34f288463e4a92bd3edd5 (table default.Table_1bad683bf46c49aa8c24cd18c2c2e990 [id=3c052a58caaa412f8d9d70063dcd97c0]). Expected version 1 got 0
I20250830 07:54:32.033727 13885 raft_consensus.cc:2270] T f398e12cd9f543738d5163354f8a9d9d P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250830 07:54:32.036653 13885 ts_tablet_manager.cc:1905] T f398e12cd9f543738d5163354f8a9d9d P 6b5e454d98894637b466ea27f1b647f9: Deleting tablet data with delete state TABLET_DATA_DELETED
W20250830 07:54:32.038064 13948 negotiation.cc:337] Failed RPC negotiation. Trace:
0830 07:54:32.019850 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.209.60:43889 (local address 127.12.209.3:33357)
0830 07:54:32.036924 (+ 17074us) negotiation.cc:107] Waiting for socket to connect
0830 07:54:32.037076 (+ 152us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.209.60:43889: connect: Connection reset by peer (error 104)
Metrics: {"client-negotiator.queue_time_us":16004,"thread_start_us":15869,"threads_started":1}
I20250830 07:54:32.039196 13886 tablet_bootstrap.cc:492] T 778f6766c47f4a86b5dea60560f67d5c P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:54:32.039342 13886 ts_tablet_manager.cc:1397] T 778f6766c47f4a86b5dea60560f67d5c P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.046s user 0.005s sys 0.006s
I20250830 07:54:32.039530 13754 tablet_service.cc:1515] Processing DeleteTablet for tablet 18afeddd2c0642028f93a16323b6e849 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:31 UTC) from {username='slave'} at 127.0.0.1:45460
I20250830 07:54:32.040120 13886 raft_consensus.cc:357] T 778f6766c47f4a86b5dea60560f67d5c P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:54:32.040302 13886 raft_consensus.cc:383] T 778f6766c47f4a86b5dea60560f67d5c P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:32.040390 13886 raft_consensus.cc:738] T 778f6766c47f4a86b5dea60560f67d5c P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:54:32.043083 13887 consensus_queue.cc:260] T b059069ed7eb433a9c54523bce21b4ad P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:54:32.044198 13886 consensus_queue.cc:260] T 778f6766c47f4a86b5dea60560f67d5c P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:54:32.047173 13886 ts_tablet_manager.cc:1428] T 778f6766c47f4a86b5dea60560f67d5c P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.008s user 0.000s sys 0.002s
I20250830 07:54:32.049221 13886 tablet_bootstrap.cc:492] T ab7196ca193348f5b4bb9193b731e04f P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:54:32.051882 13227 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_6a92a1708f7e46089983abe2263370f8" } modify_external_catalogs: true
I20250830 07:54:32.052114 13227 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_6a92a1708f7e46089983abe2263370f8" } modify_external_catalogs: true
I20250830 07:54:32.054005 13886 tablet_bootstrap.cc:654] T ab7196ca193348f5b4bb9193b731e04f P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:32.054507 13887 ts_tablet_manager.cc:1428] T b059069ed7eb433a9c54523bce21b4ad P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.038s user 0.001s sys 0.001s
I20250830 07:54:32.054791 13887 tablet_bootstrap.cc:492] T 7ed22d9617024d55a8add137e7971061 P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:54:32.055979 13894 raft_consensus.cc:491] T 8f4567f30cc34f288463e4a92bd3edd5 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:32.056295 13894 raft_consensus.cc:513] T 8f4567f30cc34f288463e4a92bd3edd5 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:54:32.056885 13894 leader_election.cc:290] T 8f4567f30cc34f288463e4a92bd3edd5 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
W20250830 07:54:32.058347 13229 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet c12cf30cc2aa4e12a20b9492af08a6f8 consensus state has no leader
I20250830 07:54:32.061420 13897 raft_consensus.cc:491] T 9e055d6089f541f799eddb5778eb2148 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:32.061630 13897 raft_consensus.cc:513] T 9e055d6089f541f799eddb5778eb2148 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:32.062368 13897 leader_election.cc:290] T 9e055d6089f541f799eddb5778eb2148 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967)
W20250830 07:54:32.066476 13947 negotiation.cc:337] Failed RPC negotiation. Trace:
0830 07:54:32.016189 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.209.60:43889 (local address 127.12.209.1:59343)
0830 07:54:32.065499 (+ 49310us) negotiation.cc:107] Waiting for socket to connect
0830 07:54:32.065619 (+ 120us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.209.60:43889: connect: Connection reset by peer (error 104)
Metrics: {"client-negotiator.queue_time_us":49217,"threads_started":1}
I20250830 07:54:32.067543 13887 tablet_bootstrap.cc:654] T 7ed22d9617024d55a8add137e7971061 P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:32.067951 13606 tablet_service.cc:1468] Processing CreateTablet for tablet dfccff3bd0cb4c7d998633b015de3cfa (DEFAULT_TABLE table=default.Table_3dd99f1f4e8e4a2e987bd7fbfbee50d1 [id=5c8baaf0da15426794d2336d4863324f]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:32.068367 13606 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dfccff3bd0cb4c7d998633b015de3cfa. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:32.071478 13227 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet ef16b9e2d444489699f4db1ac26d5f6c
I20250830 07:54:32.071579 13229 master_service.cc:948] ReplaceTablet: received request to replace tablet d33a5d107c6849aca6eb48ffdf8a5463 from {username='slave'} at 127.0.0.1:42126
I20250830 07:54:32.074343 13602 tablet_service.cc:1515] Processing DeleteTablet for tablet ef16b9e2d444489699f4db1ac26d5f6c with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:32 UTC) from {username='slave'} at 127.0.0.1:45306
I20250830 07:54:32.078610 13229 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet d33a5d107c6849aca6eb48ffdf8a5463
I20250830 07:54:32.079125 13229 catalog_manager.cc:6652] ReplaceTablet: tablet d33a5d107c6849aca6eb48ffdf8a5463 deleted and replaced by tablet 6492bd11e50d4900927db0de3757aa24
I20250830 07:54:32.079341 13883 ts_tablet_manager.cc:1918] T ab7196ca193348f5b4bb9193b731e04f P 2065c332f15a4739899af79f3669c3ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250830 07:54:32.079450 13606 tablet_service.cc:1515] Processing DeleteTablet for tablet d33a5d107c6849aca6eb48ffdf8a5463 with delete_type TABLET_DATA_DELETED (replaced by tablet 6492bd11e50d4900927db0de3757aa24) from {username='slave'} at 127.0.0.1:45306
I20250830 07:54:32.080318 13606 tablet_service.cc:1468] Processing CreateTablet for tablet d0238794efb14150af6138b0d8bd80ec (DEFAULT_TABLE table=default.Table_83ef88343cbe43eba0c492ac3eb87e9f [id=8628f6e9686d43b6aa84cd3202db8e80]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:32.080761 13606 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0238794efb14150af6138b0d8bd80ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:32.081730 13883 log.cc:1199] T ab7196ca193348f5b4bb9193b731e04f P 2065c332f15a4739899af79f3669c3ba: Deleting WAL directory at /tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/ts-0/wal/wals/ab7196ca193348f5b4bb9193b731e04f
I20250830 07:54:32.082194 13883 ts_tablet_manager.cc:1939] T ab7196ca193348f5b4bb9193b731e04f P 2065c332f15a4739899af79f3669c3ba: Deleting consensus metadata
I20250830 07:54:32.083572 13602 tablet_service.cc:1468] Processing CreateTablet for tablet 252cc8fed9624222b26976bf54db68fb (DEFAULT_TABLE table=default.Table_f6365a8a7d034d06824a36d2f6033caf [id=2cc2255be4a84bf08dc5cb0b33234b85]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:32.084061 13602 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 252cc8fed9624222b26976bf54db68fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:32.088778 13601 tablet_service.cc:1468] Processing CreateTablet for tablet f53e7423d1f54566a667195f7cf5e1ce (DEFAULT_TABLE table=default.Table_c14e6b9a7bb54c8dbbc1d2e31e446971 [id=b90dee2687554113beeb470074c7695e]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:32.089185 13601 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f53e7423d1f54566a667195f7cf5e1ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:32.097877 13899 raft_consensus.cc:491] T 9e055d6089f541f799eddb5778eb2148 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:32.098028 13899 raft_consensus.cc:513] T 9e055d6089f541f799eddb5778eb2148 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:32.098934 13608 tablet_service.cc:1468] Processing CreateTablet for tablet c82ac0102b4442449073e44d8a3d9065 (DEFAULT_TABLE table=default.Table_6926264c97ae4af4a25f0bffa385688f [id=30726ce588f24d4fa6ac32c99070ca46]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:32.099242 13608 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c82ac0102b4442449073e44d8a3d9065. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:32.099722 13487 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "9e055d6089f541f799eddb5778eb2148" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:54:32.099932 13487 raft_consensus.cc:2466] T 9e055d6089f541f799eddb5778eb2148 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b5e454d98894637b466ea27f1b647f9 in term 0.
I20250830 07:54:32.100452 13899 leader_election.cc:290] T 9e055d6089f541f799eddb5778eb2148 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:32.101466 13561 leader_election.cc:304] T 9e055d6089f541f799eddb5778eb2148 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 6b5e454d98894637b466ea27f1b647f9; no voters:
I20250830 07:54:32.102417 13218 catalog_manager.cc:4928] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): tablet bf170b1865094ba38ef8568259e34656 (table default.Table_fa4deee864594a2aa4987b24ae8e7c97 [id=2d16cc8010714d9381de323f97abbdca]) successfully deleted
W20250830 07:54:32.102802 13218 catalog_manager.cc:4908] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): delete failed for tablet 778f6766c47f4a86b5dea60560f67d5c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 778f6766c47f4a86b5dea60560f67d5c already in progress: creating tablet
I20250830 07:54:32.103049 13604 tablet_service.cc:1468] Processing CreateTablet for tablet 6f4c400c0e5e43319fa521b5cab694b4 (DEFAULT_TABLE table=default.Table_17a2e182c79d4c13bc1ce3f53f9ba765 [id=d48de709ec8e401caf2bf98160c5beda]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:32.105225 13604 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f4c400c0e5e43319fa521b5cab694b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:32.105823 13899 raft_consensus.cc:2802] T 9e055d6089f541f799eddb5778eb2148 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:54:32.106207 13899 raft_consensus.cc:491] T 9e055d6089f541f799eddb5778eb2148 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:54:32.106334 13899 raft_consensus.cc:3058] T 9e055d6089f541f799eddb5778eb2148 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:32.107103 13601 tablet_service.cc:1468] Processing CreateTablet for tablet 1933d49d319b4bd7b717dda2b83859f3 (DEFAULT_TABLE table=default.Table_fc298c4951614456914be830598a020a [id=e946db3cd3504a69a61a7ed2cabcada7]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:32.107496 13601 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1933d49d319b4bd7b717dda2b83859f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:32.110340 13754 tablet_service.cc:1515] Processing DeleteTablet for tablet 778f6766c47f4a86b5dea60560f67d5c with delete_type TABLET_DATA_DELETED (replaced by tablet 4c2c85732d454cd98efc2646af9450ed) from {username='slave'} at 127.0.0.1:45460
I20250830 07:54:32.110646 13884 tablet_replica.cc:331] T 778f6766c47f4a86b5dea60560f67d5c P 9b057ade5dce45af9f8bf0bedf8b917f: stopping tablet replica
I20250830 07:54:32.110869 13884 raft_consensus.cc:2241] T 778f6766c47f4a86b5dea60560f67d5c P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Raft consensus shutting down.
I20250830 07:54:32.111116 13884 raft_consensus.cc:2270] T 778f6766c47f4a86b5dea60560f67d5c P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Raft consensus is shut down!
I20250830 07:54:32.111824 13884 ts_tablet_manager.cc:1905] T 778f6766c47f4a86b5dea60560f67d5c P 9b057ade5dce45af9f8bf0bedf8b917f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250830 07:54:32.111980 13775 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "8f4567f30cc34f288463e4a92bd3edd5" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:32.111999 13774 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "9e055d6089f541f799eddb5778eb2148" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:32.112242 13775 raft_consensus.cc:2466] T 8f4567f30cc34f288463e4a92bd3edd5 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2065c332f15a4739899af79f3669c3ba in term 0.
I20250830 07:54:32.112318 13774 raft_consensus.cc:2466] T 9e055d6089f541f799eddb5778eb2148 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b5e454d98894637b466ea27f1b647f9 in term 0.
I20250830 07:54:32.113134 13218 catalog_manager.cc:4928] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): tablet ab7196ca193348f5b4bb9193b731e04f (table default.Table_74f3c73d22574737b5f6a4bd256e423d [id=55f67297d5ac42c280ea932d74e3ad37]) successfully deleted
I20250830 07:54:32.113740 13487 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "9e055d6089f541f799eddb5778eb2148" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:54:32.113953 13487 raft_consensus.cc:2466] T 9e055d6089f541f799eddb5778eb2148 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 0.
W20250830 07:54:32.115944 13219 consensus_peers.cc:489] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88 -> Peer 3ea183a890b84f408b20b55e9eb7c7ed (127.12.209.60:43889): Couldn't send request to peer 3ea183a890b84f408b20b55e9eb7c7ed. Status: Network error: Client connection negotiation failed: client connection to 127.12.209.60:43889: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20250830 07:54:32.116772 13747 tablet_service.cc:1468] Processing CreateTablet for tablet dfccff3bd0cb4c7d998633b015de3cfa (DEFAULT_TABLE table=default.Table_3dd99f1f4e8e4a2e987bd7fbfbee50d1 [id=5c8baaf0da15426794d2336d4863324f]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:32.117192 13747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dfccff3bd0cb4c7d998633b015de3cfa. 1 dirs total, 0 dirs full, 0 dirs failed
W20250830 07:54:32.118145 13219 catalog_manager.cc:4908] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): delete failed for tablet 18afeddd2c0642028f93a16323b6e849 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 18afeddd2c0642028f93a16323b6e849 already in progress: creating tablet
I20250830 07:54:32.118506 13629 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "8f4567f30cc34f288463e4a92bd3edd5" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:32.118942 13885 ts_tablet_manager.cc:1918] T f398e12cd9f543738d5163354f8a9d9d P 6b5e454d98894637b466ea27f1b647f9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250830 07:54:32.119350 13750 tablet_service.cc:1515] Processing DeleteTablet for tablet d33a5d107c6849aca6eb48ffdf8a5463 with delete_type TABLET_DATA_DELETED (replaced by tablet 6492bd11e50d4900927db0de3757aa24) from {username='slave'} at 127.0.0.1:45460
I20250830 07:54:32.119562 13629 raft_consensus.cc:2466] T 8f4567f30cc34f288463e4a92bd3edd5 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2065c332f15a4739899af79f3669c3ba in term 0.
I20250830 07:54:32.119730 13752 tablet_service.cc:1468] Processing CreateTablet for tablet 252cc8fed9624222b26976bf54db68fb (DEFAULT_TABLE table=default.Table_f6365a8a7d034d06824a36d2f6033caf [id=2cc2255be4a84bf08dc5cb0b33234b85]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:32.120389 13460 tablet_service.cc:1515] Processing DeleteTablet for tablet 18afeddd2c0642028f93a16323b6e849 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:31 UTC) from {username='slave'} at 127.0.0.1:37956
I20250830 07:54:32.120543 13752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 252cc8fed9624222b26976bf54db68fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:32.120874 13423 leader_election.cc:304] T 8f4567f30cc34f288463e4a92bd3edd5 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 6b5e454d98894637b466ea27f1b647f9; no voters:
I20250830 07:54:32.121026 13462 tablet_service.cc:1515] Processing DeleteTablet for tablet 32c75568db9b4f00bb567d09dab3d45a with delete_type TABLET_DATA_DELETED (replaced by tablet d2e5255f7bf7435bb8b93c42b42f603a) from {username='slave'} at 127.0.0.1:37956
I20250830 07:54:32.121160 13628 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "9e055d6089f541f799eddb5778eb2148" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:32.121385 13462 tablet_service.cc:1515] Processing DeleteTablet for tablet ef16b9e2d444489699f4db1ac26d5f6c with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:32 UTC) from {username='slave'} at 127.0.0.1:37956
I20250830 07:54:32.121866 13462 tablet_service.cc:1468] Processing CreateTablet for tablet dfccff3bd0cb4c7d998633b015de3cfa (DEFAULT_TABLE table=default.Table_3dd99f1f4e8e4a2e987bd7fbfbee50d1 [id=5c8baaf0da15426794d2336d4863324f]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:32.122057 13755 tablet_service.cc:1468] Processing CreateTablet for tablet c82ac0102b4442449073e44d8a3d9065 (DEFAULT_TABLE table=default.Table_6926264c97ae4af4a25f0bffa385688f [id=30726ce588f24d4fa6ac32c99070ca46]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:32.122201 13462 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dfccff3bd0cb4c7d998633b015de3cfa. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:32.122417 13755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c82ac0102b4442449073e44d8a3d9065. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:32.122548 13883 tablet_replica.cc:331] T 32c75568db9b4f00bb567d09dab3d45a P 2065c332f15a4739899af79f3669c3ba: stopping tablet replica
I20250830 07:54:32.122772 13883 raft_consensus.cc:2241] T 32c75568db9b4f00bb567d09dab3d45a P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Raft consensus shutting down.
I20250830 07:54:32.122828 13753 tablet_service.cc:1468] Processing CreateTablet for tablet 1933d49d319b4bd7b717dda2b83859f3 (DEFAULT_TABLE table=default.Table_fc298c4951614456914be830598a020a [id=e946db3cd3504a69a61a7ed2cabcada7]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:32.122985 13883 raft_consensus.cc:2270] T 32c75568db9b4f00bb567d09dab3d45a P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Raft consensus is shut down!
I20250830 07:54:32.123196 13753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1933d49d319b4bd7b717dda2b83859f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:32.123529 13754 tablet_service.cc:1515] Processing DeleteTablet for tablet ef16b9e2d444489699f4db1ac26d5f6c with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:32 UTC) from {username='slave'} at 127.0.0.1:45460
I20250830 07:54:32.123884 13748 tablet_service.cc:1468] Processing CreateTablet for tablet d0238794efb14150af6138b0d8bd80ec (DEFAULT_TABLE table=default.Table_83ef88343cbe43eba0c492ac3eb87e9f [id=8628f6e9686d43b6aa84cd3202db8e80]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:32.124255 13748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0238794efb14150af6138b0d8bd80ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:32.124375 13883 ts_tablet_manager.cc:1905] T 32c75568db9b4f00bb567d09dab3d45a P 2065c332f15a4739899af79f3669c3ba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250830 07:54:32.124676 13749 tablet_service.cc:1468] Processing CreateTablet for tablet f53e7423d1f54566a667195f7cf5e1ce (DEFAULT_TABLE table=default.Table_c14e6b9a7bb54c8dbbc1d2e31e446971 [id=b90dee2687554113beeb470074c7695e]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:32.125265 13749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f53e7423d1f54566a667195f7cf5e1ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:32.127492 13229 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_8b504248201347288df9b3fcd2be2d2d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:32.128021 13229 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8b504248201347288df9b3fcd2be2d2d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:32.128736 13462 tablet_service.cc:1515] Processing DeleteTablet for tablet d33a5d107c6849aca6eb48ffdf8a5463 with delete_type TABLET_DATA_DELETED (replaced by tablet 6492bd11e50d4900927db0de3757aa24) from {username='slave'} at 127.0.0.1:37956
I20250830 07:54:32.129104 13460 tablet_service.cc:1468] Processing CreateTablet for tablet d0238794efb14150af6138b0d8bd80ec (DEFAULT_TABLE table=default.Table_83ef88343cbe43eba0c492ac3eb87e9f [id=8628f6e9686d43b6aa84cd3202db8e80]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:32.129429 13460 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0238794efb14150af6138b0d8bd80ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:32.131443 13883 ts_tablet_manager.cc:1918] T 32c75568db9b4f00bb567d09dab3d45a P 2065c332f15a4739899af79f3669c3ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250830 07:54:32.131554 13883 log.cc:1199] T 32c75568db9b4f00bb567d09dab3d45a P 2065c332f15a4739899af79f3669c3ba: Deleting WAL directory at /tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/ts-0/wal/wals/32c75568db9b4f00bb567d09dab3d45a
I20250830 07:54:32.131865 13883 ts_tablet_manager.cc:1939] T 32c75568db9b4f00bb567d09dab3d45a P 2065c332f15a4739899af79f3669c3ba: Deleting consensus metadata
I20250830 07:54:32.133317 13885 log.cc:1199] T f398e12cd9f543738d5163354f8a9d9d P 6b5e454d98894637b466ea27f1b647f9: Deleting WAL directory at /tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/ts-1/wal/wals/f398e12cd9f543738d5163354f8a9d9d
I20250830 07:54:32.139860 13885 ts_tablet_manager.cc:1939] T f398e12cd9f543738d5163354f8a9d9d P 6b5e454d98894637b466ea27f1b647f9: Deleting consensus metadata
I20250830 07:54:32.139961 13460 tablet_service.cc:1468] Processing CreateTablet for tablet 252cc8fed9624222b26976bf54db68fb (DEFAULT_TABLE table=default.Table_f6365a8a7d034d06824a36d2f6033caf [id=2cc2255be4a84bf08dc5cb0b33234b85]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:32.140441 13220 catalog_manager.cc:4928] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): tablet f398e12cd9f543738d5163354f8a9d9d (table default.Table_a0428733949a4fd2926ca07d54b90aa5 [id=8bbfd80ea8444f64bf1c7f3454f10c1c]) successfully deleted
W20250830 07:54:32.140889 13220 catalog_manager.cc:4908] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet ef16b9e2d444489699f4db1ac26d5f6c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ef16b9e2d444489699f4db1ac26d5f6c already in progress: creating tablet
W20250830 07:54:32.141249 13220 catalog_manager.cc:4908] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet d33a5d107c6849aca6eb48ffdf8a5463 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d33a5d107c6849aca6eb48ffdf8a5463 already in progress: creating tablet
I20250830 07:54:32.142625 13460 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 252cc8fed9624222b26976bf54db68fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:32.142720 13954 raft_consensus.cc:2802] T 8f4567f30cc34f288463e4a92bd3edd5 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:54:32.142829 13954 raft_consensus.cc:491] T 8f4567f30cc34f288463e4a92bd3edd5 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:54:32.143524 13897 raft_consensus.cc:491] T b059069ed7eb433a9c54523bce21b4ad P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:32.143666 13897 raft_consensus.cc:513] T b059069ed7eb433a9c54523bce21b4ad P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:54:32.143793 13954 raft_consensus.cc:3058] T 8f4567f30cc34f288463e4a92bd3edd5 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:32.144318 13897 leader_election.cc:290] T b059069ed7eb433a9c54523bce21b4ad P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
I20250830 07:54:32.147151 13462 tablet_service.cc:1468] Processing CreateTablet for tablet f53e7423d1f54566a667195f7cf5e1ce (DEFAULT_TABLE table=default.Table_c14e6b9a7bb54c8dbbc1d2e31e446971 [id=b90dee2687554113beeb470074c7695e]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:32.147552 13462 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f53e7423d1f54566a667195f7cf5e1ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:32.155157 13884 ts_tablet_manager.cc:1918] T 778f6766c47f4a86b5dea60560f67d5c P 9b057ade5dce45af9f8bf0bedf8b917f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250830 07:54:32.155277 13884 log.cc:1199] T 778f6766c47f4a86b5dea60560f67d5c P 9b057ade5dce45af9f8bf0bedf8b917f: Deleting WAL directory at /tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/ts-2/wal/wals/778f6766c47f4a86b5dea60560f67d5c
I20250830 07:54:32.155620 13884 ts_tablet_manager.cc:1939] T 778f6766c47f4a86b5dea60560f67d5c P 9b057ade5dce45af9f8bf0bedf8b917f: Deleting consensus metadata
I20250830 07:54:32.156699 13219 catalog_manager.cc:4928] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): tablet 778f6766c47f4a86b5dea60560f67d5c (table default.Table_d2ac5bc3c0c246c4bb6c797de6efedae [id=08a2c4f9b62b465cb1bf7983bc8b802d]) successfully deleted
I20250830 07:54:32.156741 13899 raft_consensus.cc:513] T 9e055d6089f541f799eddb5778eb2148 P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:32.157524 13894 raft_consensus.cc:491] T b059069ed7eb433a9c54523bce21b4ad P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:32.157737 13894 raft_consensus.cc:513] T b059069ed7eb433a9c54523bce21b4ad P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:54:32.158491 13894 leader_election.cc:290] T b059069ed7eb433a9c54523bce21b4ad P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:32.159086 13628 raft_consensus.cc:2391] T 9e055d6089f541f799eddb5778eb2148 P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b057ade5dce45af9f8bf0bedf8b917f in current term 1: Already voted for candidate 6b5e454d98894637b466ea27f1b647f9 in this term.
I20250830 07:54:32.159278 13899 leader_election.cc:290] T 9e055d6089f541f799eddb5778eb2148 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 election: Requested vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:32.159641 13629 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "b059069ed7eb433a9c54523bce21b4ad" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:32.160221 13774 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "9e055d6089f541f799eddb5778eb2148" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f"
I20250830 07:54:32.160439 13774 raft_consensus.cc:3058] T 9e055d6089f541f799eddb5778eb2148 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:32.160861 13954 raft_consensus.cc:513] T 8f4567f30cc34f288463e4a92bd3edd5 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:54:32.161548 13954 leader_election.cc:290] T 8f4567f30cc34f288463e4a92bd3edd5 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 election: Requested vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:32.163069 13487 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "9e055d6089f541f799eddb5778eb2148" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba"
W20250830 07:54:32.163130 13219 catalog_manager.cc:4908] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): delete failed for tablet d33a5d107c6849aca6eb48ffdf8a5463 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d33a5d107c6849aca6eb48ffdf8a5463 already in progress: creating tablet
I20250830 07:54:32.163218 13487 raft_consensus.cc:3058] T 9e055d6089f541f799eddb5778eb2148 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
W20250830 07:54:32.163666 13219 catalog_manager.cc:4908] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): delete failed for tablet ef16b9e2d444489699f4db1ac26d5f6c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ef16b9e2d444489699f4db1ac26d5f6c already in progress: creating tablet
I20250830 07:54:32.166124 13487 raft_consensus.cc:2466] T 9e055d6089f541f799eddb5778eb2148 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b5e454d98894637b466ea27f1b647f9 in term 1.
I20250830 07:54:32.166589 13629 raft_consensus.cc:2466] T b059069ed7eb433a9c54523bce21b4ad P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 0.
I20250830 07:54:32.171164 13561 leader_election.cc:304] T 9e055d6089f541f799eddb5778eb2148 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 6b5e454d98894637b466ea27f1b647f9; no voters:
I20250830 07:54:32.162851 13774 raft_consensus.cc:2466] T 9e055d6089f541f799eddb5778eb2148 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b5e454d98894637b466ea27f1b647f9 in term 1.
I20250830 07:54:32.174237 13229 master_service.cc:948] ReplaceTablet: received request to replace tablet 4ab63ff59d4e4ec2b7b64d605545a870 from {username='slave'} at 127.0.0.1:42126
I20250830 07:54:32.174631 13629 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "b059069ed7eb433a9c54523bce21b4ad" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:32.174711 13231 master_service.cc:948] ReplaceTablet: received request to replace tablet ef16b9e2d444489699f4db1ac26d5f6c from {username='slave'} at 127.0.0.1:42126
I20250830 07:54:32.174850 13629 raft_consensus.cc:2466] T b059069ed7eb433a9c54523bce21b4ad P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2065c332f15a4739899af79f3669c3ba in term 0.
I20250830 07:54:32.175305 13629 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "8f4567f30cc34f288463e4a92bd3edd5" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9"
I20250830 07:54:32.175472 13629 raft_consensus.cc:3058] T 8f4567f30cc34f288463e4a92bd3edd5 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:32.178145 13882 tablet_bootstrap.cc:492] T a04bf79de30a42a98e71f622efc90c22 P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:54:32.178331 13882 ts_tablet_manager.cc:1397] T a04bf79de30a42a98e71f622efc90c22 P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.181s user 0.011s sys 0.039s
I20250830 07:54:32.178871 13629 raft_consensus.cc:2466] T 8f4567f30cc34f288463e4a92bd3edd5 P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2065c332f15a4739899af79f3669c3ba in term 1.
I20250830 07:54:32.179100 13882 raft_consensus.cc:357] T a04bf79de30a42a98e71f622efc90c22 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:32.179322 13882 raft_consensus.cc:383] T a04bf79de30a42a98e71f622efc90c22 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:32.179409 13231 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_3af4480a9af740f598919322e7fc5efc"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250830 07:54:32.179672 13703 leader_election.cc:304] T b059069ed7eb433a9c54523bce21b4ad P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f; no voters:
W20250830 07:54:32.179896 13231 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3af4480a9af740f598919322e7fc5efc in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:32.179919 13897 raft_consensus.cc:2802] T b059069ed7eb433a9c54523bce21b4ad P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:54:32.180022 13897 raft_consensus.cc:491] T b059069ed7eb433a9c54523bce21b4ad P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:54:32.180100 13897 raft_consensus.cc:3058] T b059069ed7eb433a9c54523bce21b4ad P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:32.180405 13882 raft_consensus.cc:738] T a04bf79de30a42a98e71f622efc90c22 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:54:32.180739 13882 consensus_queue.cc:260] T a04bf79de30a42a98e71f622efc90c22 P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:32.181674 13229 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_17a2e182c79d4c13bc1ce3f53f9ba765" } modify_external_catalogs: true
I20250830 07:54:32.181818 13229 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_17a2e182c79d4c13bc1ce3f53f9ba765" } modify_external_catalogs: true
I20250830 07:54:32.182961 13230 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_1122e7555f184245b03157a9e3996e7c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:32.183394 13230 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1122e7555f184245b03157a9e3996e7c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:32.188136 13227 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_ee2734eae1204d188a3c3e1aade9d7ec"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250830 07:54:32.188558 13899 raft_consensus.cc:2802] T 9e055d6089f541f799eddb5778eb2148 P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Leader election won for term 1
W20250830 07:54:32.188760 13227 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ee2734eae1204d188a3c3e1aade9d7ec in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:32.192819 13897 raft_consensus.cc:513] T b059069ed7eb433a9c54523bce21b4ad P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:54:32.193720 13897 leader_election.cc:290] T b059069ed7eb433a9c54523bce21b4ad P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Requested vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
I20250830 07:54:32.193913 13899 raft_consensus.cc:695] T 9e055d6089f541f799eddb5778eb2148 P 6b5e454d98894637b466ea27f1b647f9 [term 1 LEADER]: Becoming Leader. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Running, Role: LEADER
I20250830 07:54:32.194391 13899 consensus_queue.cc:237] T 9e055d6089f541f799eddb5778eb2148 P 6b5e454d98894637b466ea27f1b647f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:32.199759 13423 leader_election.cc:304] T b059069ed7eb433a9c54523bce21b4ad P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 6b5e454d98894637b466ea27f1b647f9; no voters:
I20250830 07:54:32.200114 13954 raft_consensus.cc:2802] T b059069ed7eb433a9c54523bce21b4ad P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:54:32.200235 13954 raft_consensus.cc:491] T b059069ed7eb433a9c54523bce21b4ad P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:54:32.200345 13954 raft_consensus.cc:3058] T b059069ed7eb433a9c54523bce21b4ad P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:32.200433 13423 leader_election.cc:304] T 8f4567f30cc34f288463e4a92bd3edd5 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 6b5e454d98894637b466ea27f1b647f9; no voters:
I20250830 07:54:32.203315 13954 raft_consensus.cc:513] T b059069ed7eb433a9c54523bce21b4ad P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:54:32.203847 13954 leader_election.cc:290] T b059069ed7eb433a9c54523bce21b4ad P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 election: Requested vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:32.204080 13954 raft_consensus.cc:2802] T 8f4567f30cc34f288463e4a92bd3edd5 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election won for term 1
I20250830 07:54:32.204243 13954 raft_consensus.cc:695] T 8f4567f30cc34f288463e4a92bd3edd5 P 2065c332f15a4739899af79f3669c3ba [term 1 LEADER]: Becoming Leader. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Running, Role: LEADER
I20250830 07:54:32.204499 13954 consensus_queue.cc:237] T 8f4567f30cc34f288463e4a92bd3edd5 P 2065c332f15a4739899af79f3669c3ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:54:32.204567 13467 tablet_service.cc:1468] Processing CreateTablet for tablet c82ac0102b4442449073e44d8a3d9065 (DEFAULT_TABLE table=default.Table_6926264c97ae4af4a25f0bffa385688f [id=30726ce588f24d4fa6ac32c99070ca46]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:32.204912 13467 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c82ac0102b4442449073e44d8a3d9065. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:32.205777 13887 tablet_bootstrap.cc:492] T 7ed22d9617024d55a8add137e7971061 P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:54:32.205960 13887 ts_tablet_manager.cc:1397] T 7ed22d9617024d55a8add137e7971061 P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.151s user 0.007s sys 0.003s
I20250830 07:54:32.206718 13887 raft_consensus.cc:357] T 7ed22d9617024d55a8add137e7971061 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:54:32.206933 13887 raft_consensus.cc:383] T 7ed22d9617024d55a8add137e7971061 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:32.207017 13887 raft_consensus.cc:738] T 7ed22d9617024d55a8add137e7971061 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:54:32.207269 13887 consensus_queue.cc:260] T 7ed22d9617024d55a8add137e7971061 P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:54:32.207777 13887 ts_tablet_manager.cc:1428] T 7ed22d9617024d55a8add137e7971061 P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20250830 07:54:32.208575 13887 tablet_bootstrap.cc:492] T 778f6766c47f4a86b5dea60560f67d5c P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:54:32.211274 13887 tablet_bootstrap.cc:654] T 778f6766c47f4a86b5dea60560f67d5c P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:32.215768 13701 leader_election.cc:304] T 9e055d6089f541f799eddb5778eb2148 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:54:32.216614 13897 raft_consensus.cc:2762] T 9e055d6089f541f799eddb5778eb2148 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20250830 07:54:32.217121 13467 tablet_service.cc:1468] Processing CreateTablet for tablet 1933d49d319b4bd7b717dda2b83859f3 (DEFAULT_TABLE table=default.Table_fc298c4951614456914be830598a020a [id=e946db3cd3504a69a61a7ed2cabcada7]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:32.217572 13467 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1933d49d319b4bd7b717dda2b83859f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:32.224761 13897 raft_consensus.cc:491] T ff0f9cccc8ed43b1a8cd38de0e9d4097 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:32.224836 13753 tablet_service.cc:1468] Processing CreateTablet for tablet 6f4c400c0e5e43319fa521b5cab694b4 (DEFAULT_TABLE table=default.Table_17a2e182c79d4c13bc1ce3f53f9ba765 [id=d48de709ec8e401caf2bf98160c5beda]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:32.224965 13897 raft_consensus.cc:513] T ff0f9cccc8ed43b1a8cd38de0e9d4097 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:32.225306 13753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f4c400c0e5e43319fa521b5cab694b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:32.226625 13897 leader_election.cc:290] T ff0f9cccc8ed43b1a8cd38de0e9d4097 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967)
I20250830 07:54:32.227020 13887 tablet_bootstrap.cc:492] T 778f6766c47f4a86b5dea60560f67d5c P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:54:32.227144 13887 ts_tablet_manager.cc:1397] T 778f6766c47f4a86b5dea60560f67d5c P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.019s user 0.006s sys 0.002s
W20250830 07:54:32.227947 13218 catalog_manager.cc:4908] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): delete failed for tablet 18afeddd2c0642028f93a16323b6e849 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 18afeddd2c0642028f93a16323b6e849 already in progress: creating tablet
I20250830 07:54:32.227901 13887 raft_consensus.cc:357] T 778f6766c47f4a86b5dea60560f67d5c P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:54:32.228382 13887 raft_consensus.cc:383] T 778f6766c47f4a86b5dea60560f67d5c P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:32.228535 13887 raft_consensus.cc:738] T 778f6766c47f4a86b5dea60560f67d5c P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:54:32.228785 13887 consensus_queue.cc:260] T 778f6766c47f4a86b5dea60560f67d5c P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:54:32.229336 13887 ts_tablet_manager.cc:1428] T 778f6766c47f4a86b5dea60560f67d5c P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20250830 07:54:32.229648 13887 tablet_bootstrap.cc:492] T 4d4b00bdadb24ec892d87c9be2ed7dd9 P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:54:32.229679 13229 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet 6f4c400c0e5e43319fa521b5cab694b4
I20250830 07:54:32.230868 13747 tablet_service.cc:1515] Processing DeleteTablet for tablet 6f4c400c0e5e43319fa521b5cab694b4 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:32 UTC) from {username='slave'} at 127.0.0.1:45460
W20250830 07:54:32.231490 13219 catalog_manager.cc:4895] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): delete failed for tablet 6f4c400c0e5e43319fa521b5cab694b4 because the tablet was not found. No further retry: Not found: Tablet not found: 6f4c400c0e5e43319fa521b5cab694b4
I20250830 07:54:32.231657 13887 tablet_bootstrap.cc:654] T 4d4b00bdadb24ec892d87c9be2ed7dd9 P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:32.232039 13218 catalog_manager.cc:4928] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): tablet 32c75568db9b4f00bb567d09dab3d45a (table default.Table_d24e8e2f5130411cacb3241198c3669d [id=e087454d345c40f1b809d0f4187f7212]) successfully deleted
W20250830 07:54:32.232976 13218 catalog_manager.cc:4908] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): delete failed for tablet ef16b9e2d444489699f4db1ac26d5f6c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ef16b9e2d444489699f4db1ac26d5f6c already in progress: creating tablet
I20250830 07:54:32.233521 13602 tablet_service.cc:1515] Processing DeleteTablet for tablet 6f4c400c0e5e43319fa521b5cab694b4 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:32 UTC) from {username='slave'} at 127.0.0.1:45306
I20250830 07:54:32.233954 13606 tablet_service.cc:1468] Processing CreateTablet for tablet 2afb1e75cfcc4e1abd265fbadb4170fa (DEFAULT_TABLE table=default.Table_53cf6bab348a4b3c84bac9d533c27d25 [id=098befd08500427bbe1077d47a843e84]), partition=RANGE (key) PARTITION UNBOUNDED
W20250830 07:54:32.234858 13218 catalog_manager.cc:4908] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): delete failed for tablet d33a5d107c6849aca6eb48ffdf8a5463 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d33a5d107c6849aca6eb48ffdf8a5463 already in progress: creating tablet
I20250830 07:54:32.234990 13606 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2afb1e75cfcc4e1abd265fbadb4170fa. 1 dirs total, 0 dirs full, 0 dirs failed
W20250830 07:54:32.235867 13220 catalog_manager.cc:4908] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet 6f4c400c0e5e43319fa521b5cab694b4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6f4c400c0e5e43319fa521b5cab694b4 already in progress: creating tablet
I20250830 07:54:32.244626 13887 tablet_bootstrap.cc:492] T 4d4b00bdadb24ec892d87c9be2ed7dd9 P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:54:32.245306 13887 ts_tablet_manager.cc:1397] T 4d4b00bdadb24ec892d87c9be2ed7dd9 P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.016s user 0.004s sys 0.003s
I20250830 07:54:32.247598 13887 raft_consensus.cc:357] T 4d4b00bdadb24ec892d87c9be2ed7dd9 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:32.248675 13887 raft_consensus.cc:383] T 4d4b00bdadb24ec892d87c9be2ed7dd9 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:32.249037 13887 raft_consensus.cc:738] T 4d4b00bdadb24ec892d87c9be2ed7dd9 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:54:32.249620 13887 consensus_queue.cc:260] T 4d4b00bdadb24ec892d87c9be2ed7dd9 P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:32.250867 13887 ts_tablet_manager.cc:1428] T 4d4b00bdadb24ec892d87c9be2ed7dd9 P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20250830 07:54:32.251916 13887 tablet_bootstrap.cc:492] T f398e12cd9f543738d5163354f8a9d9d P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:54:32.254065 13887 tablet_bootstrap.cc:654] T f398e12cd9f543738d5163354f8a9d9d P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:32.261010 13887 tablet_bootstrap.cc:492] T f398e12cd9f543738d5163354f8a9d9d P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:54:32.261169 13887 ts_tablet_manager.cc:1397] T f398e12cd9f543738d5163354f8a9d9d P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.009s user 0.003s sys 0.000s
I20250830 07:54:32.262050 13887 raft_consensus.cc:357] T f398e12cd9f543738d5163354f8a9d9d P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:32.262239 13887 raft_consensus.cc:383] T f398e12cd9f543738d5163354f8a9d9d P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:32.262342 13887 raft_consensus.cc:738] T f398e12cd9f543738d5163354f8a9d9d P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:54:32.262566 13887 consensus_queue.cc:260] T f398e12cd9f543738d5163354f8a9d9d P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:32.263170 13887 ts_tablet_manager.cc:1428] T f398e12cd9f543738d5163354f8a9d9d P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20250830 07:54:32.263463 13887 tablet_bootstrap.cc:492] T 5aef6fd239ba43478cd978fa5d29b26e P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:54:32.265071 13629 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "b059069ed7eb433a9c54523bce21b4ad" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9"
I20250830 07:54:32.265305 13629 raft_consensus.cc:3058] T b059069ed7eb433a9c54523bce21b4ad P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:32.265421 13887 tablet_bootstrap.cc:654] T 5aef6fd239ba43478cd978fa5d29b26e P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:32.265547 13954 raft_consensus.cc:491] T 4d4b00bdadb24ec892d87c9be2ed7dd9 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:32.265713 13954 raft_consensus.cc:513] T 4d4b00bdadb24ec892d87c9be2ed7dd9 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:32.266440 13954 leader_election.cc:290] T 4d4b00bdadb24ec892d87c9be2ed7dd9 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:32.269173 13629 raft_consensus.cc:2466] T b059069ed7eb433a9c54523bce21b4ad P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 1.
I20250830 07:54:32.269932 13703 leader_election.cc:304] T b059069ed7eb433a9c54523bce21b4ad P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f; no voters:
I20250830 07:54:32.270473 13897 raft_consensus.cc:2802] T b059069ed7eb433a9c54523bce21b4ad P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election won for term 1
I20250830 07:54:32.275161 13897 raft_consensus.cc:695] T b059069ed7eb433a9c54523bce21b4ad P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 LEADER]: Becoming Leader. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Running, Role: LEADER
I20250830 07:54:32.275619 13897 consensus_queue.cc:237] T b059069ed7eb433a9c54523bce21b4ad P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:54:32.277809 13965 raft_consensus.cc:491] T 7ed22d9617024d55a8add137e7971061 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:32.277963 13965 raft_consensus.cc:513] T 7ed22d9617024d55a8add137e7971061 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:54:32.279007 13965 leader_election.cc:290] T 7ed22d9617024d55a8add137e7971061 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
I20250830 07:54:32.282578 13954 raft_consensus.cc:491] T ff0f9cccc8ed43b1a8cd38de0e9d4097 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:32.282608 13775 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "8f4567f30cc34f288463e4a92bd3edd5" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f"
I20250830 07:54:32.282784 13775 raft_consensus.cc:3058] T 8f4567f30cc34f288463e4a92bd3edd5 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:32.282770 13954 raft_consensus.cc:513] T ff0f9cccc8ed43b1a8cd38de0e9d4097 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:32.283202 13487 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "b059069ed7eb433a9c54523bce21b4ad" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:54:32.283486 13487 raft_consensus.cc:2391] T b059069ed7eb433a9c54523bce21b4ad P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b057ade5dce45af9f8bf0bedf8b917f in current term 1: Already voted for candidate 2065c332f15a4739899af79f3669c3ba in this term.
I20250830 07:54:32.283614 13954 leader_election.cc:290] T ff0f9cccc8ed43b1a8cd38de0e9d4097 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:32.284041 13487 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "b059069ed7eb433a9c54523bce21b4ad" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba"
I20250830 07:54:32.284009 13773 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "b059069ed7eb433a9c54523bce21b4ad" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f"
I20250830 07:54:32.284250 13487 raft_consensus.cc:2391] T b059069ed7eb433a9c54523bce21b4ad P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 9b057ade5dce45af9f8bf0bedf8b917f in current term 1: Already voted for candidate 2065c332f15a4739899af79f3669c3ba in this term.
I20250830 07:54:32.284642 13487 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "ff0f9cccc8ed43b1a8cd38de0e9d4097" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:54:32.284826 13487 raft_consensus.cc:2466] T ff0f9cccc8ed43b1a8cd38de0e9d4097 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 0.
I20250830 07:54:32.285658 13775 raft_consensus.cc:2466] T 8f4567f30cc34f288463e4a92bd3edd5 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2065c332f15a4739899af79f3669c3ba in term 1.
I20250830 07:54:32.286619 13774 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "b059069ed7eb433a9c54523bce21b4ad" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:32.286829 13753 tablet_service.cc:1468] Processing CreateTablet for tablet 2afb1e75cfcc4e1abd265fbadb4170fa (DEFAULT_TABLE table=default.Table_53cf6bab348a4b3c84bac9d533c27d25 [id=098befd08500427bbe1077d47a843e84]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:32.287339 13753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2afb1e75cfcc4e1abd265fbadb4170fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:32.287705 13747 tablet_service.cc:1468] Processing CreateTablet for tablet 4c2c85732d454cd98efc2646af9450ed (DEFAULT_TABLE table=default.Table_d2ac5bc3c0c246c4bb6c797de6efedae [id=08a2c4f9b62b465cb1bf7983bc8b802d]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:32.288090 13747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4c2c85732d454cd98efc2646af9450ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:32.295806 13887 tablet_bootstrap.cc:492] T 5aef6fd239ba43478cd978fa5d29b26e P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:54:32.295950 13887 ts_tablet_manager.cc:1397] T 5aef6fd239ba43478cd978fa5d29b26e P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.033s user 0.010s sys 0.012s
I20250830 07:54:32.296664 13887 raft_consensus.cc:357] T 5aef6fd239ba43478cd978fa5d29b26e P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:32.296842 13887 raft_consensus.cc:383] T 5aef6fd239ba43478cd978fa5d29b26e P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:32.296906 13887 raft_consensus.cc:738] T 5aef6fd239ba43478cd978fa5d29b26e P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:54:32.297111 13887 consensus_queue.cc:260] T 5aef6fd239ba43478cd978fa5d29b26e P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:32.297645 13887 ts_tablet_manager.cc:1428] T 5aef6fd239ba43478cd978fa5d29b26e P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20250830 07:54:32.299168 13887 tablet_bootstrap.cc:492] T a04bf79de30a42a98e71f622efc90c22 P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:54:32.300128 13886 tablet_bootstrap.cc:492] T ab7196ca193348f5b4bb9193b731e04f P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:54:32.300303 13886 ts_tablet_manager.cc:1397] T ab7196ca193348f5b4bb9193b731e04f P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.251s user 0.024s sys 0.058s
I20250830 07:54:32.301090 13886 raft_consensus.cc:357] T ab7196ca193348f5b4bb9193b731e04f P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:54:32.301285 13886 raft_consensus.cc:383] T ab7196ca193348f5b4bb9193b731e04f P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:32.301368 13886 raft_consensus.cc:738] T ab7196ca193348f5b4bb9193b731e04f P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:54:32.301651 13886 consensus_queue.cc:260] T ab7196ca193348f5b4bb9193b731e04f P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:54:32.302186 13886 ts_tablet_manager.cc:1428] T ab7196ca193348f5b4bb9193b731e04f P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20250830 07:54:32.301215 13887 tablet_bootstrap.cc:654] T a04bf79de30a42a98e71f622efc90c22 P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:32.303547 13886 tablet_bootstrap.cc:492] T 32c75568db9b4f00bb567d09dab3d45a P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:54:32.307737 13847 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 2 leader_uuid: "5e9d6449ae824acab24c459a72075e88" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fea6152429cc4e79a25b18e02aafae57" member_type: VOTER last_known_addr { host: "127.12.209.62" port: 39725 } } peers { permanent_uuid: "5e9d6449ae824acab24c459a72075e88" member_type: VOTER last_known_addr { host: "127.12.209.61" port: 44241 } } peers { permanent_uuid: "3ea183a890b84f408b20b55e9eb7c7ed" member_type: VOTER last_known_addr { host: "127.12.209.60" port: 43889 } } }
I20250830 07:54:32.308012 13847 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88 [sys.catalog]: This master's current role is: LEADER
I20250830 07:54:32.308827 13487 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "7ed22d9617024d55a8add137e7971061" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:54:32.309037 13487 raft_consensus.cc:2466] T 7ed22d9617024d55a8add137e7971061 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 0.
I20250830 07:54:32.309224 13887 tablet_bootstrap.cc:492] T a04bf79de30a42a98e71f622efc90c22 P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:54:32.309356 13887 ts_tablet_manager.cc:1397] T a04bf79de30a42a98e71f622efc90c22 P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.010s user 0.004s sys 0.000s
I20250830 07:54:32.309947 13232 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_80a0e1ec331a4abc8d2e28a89e89f537" } modify_external_catalogs: true
I20250830 07:54:32.310132 13232 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_80a0e1ec331a4abc8d2e28a89e89f537" } modify_external_catalogs: true
I20250830 07:54:32.310109 13887 raft_consensus.cc:357] T a04bf79de30a42a98e71f622efc90c22 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:32.310264 13886 tablet_bootstrap.cc:654] T 32c75568db9b4f00bb567d09dab3d45a P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:32.310253 13887 raft_consensus.cc:383] T a04bf79de30a42a98e71f622efc90c22 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:32.310359 13887 raft_consensus.cc:738] T a04bf79de30a42a98e71f622efc90c22 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:54:32.311520 13602 tablet_service.cc:1468] Processing CreateTablet for tablet c9a8f144d50c4d3d81fbf43ce29a2ad2 (DEFAULT_TABLE table=default.Table_3d12ac4bedcf433aa345dda9066deb22 [id=d2dbb756d66b483ebe44d45ddfa5c17c]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:32.311911 13226 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_d020e7f838c24eb58a679947a81cf706"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250830 07:54:32.312383 13887 consensus_queue.cc:260] T a04bf79de30a42a98e71f622efc90c22 P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
W20250830 07:54:32.312477 13226 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d020e7f838c24eb58a679947a81cf706 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:32.312848 13887 ts_tablet_manager.cc:1428] T a04bf79de30a42a98e71f622efc90c22 P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20250830 07:54:32.313097 13887 tablet_bootstrap.cc:492] T ff2267fb411942ff826e2a72bcb89cd7 P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:54:32.313531 13747 tablet_service.cc:1468] Processing CreateTablet for tablet c9a8f144d50c4d3d81fbf43ce29a2ad2 (DEFAULT_TABLE table=default.Table_3d12ac4bedcf433aa345dda9066deb22 [id=d2dbb756d66b483ebe44d45ddfa5c17c]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:32.313807 13602 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c9a8f144d50c4d3d81fbf43ce29a2ad2. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:32.313863 13747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c9a8f144d50c4d3d81fbf43ce29a2ad2. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:32.314460 13887 tablet_bootstrap.cc:654] T ff2267fb411942ff826e2a72bcb89cd7 P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:32.318608 13233 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_6f9916f363e643e6a35574bb88e74729"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250830 07:54:32.319217 13231 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_c31365a39be74e47b45faf638fcce13b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:32.319752 13231 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c31365a39be74e47b45faf638fcce13b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:32.321306 13606 tablet_service.cc:1468] Processing CreateTablet for tablet 4c2c85732d454cd98efc2646af9450ed (DEFAULT_TABLE table=default.Table_d2ac5bc3c0c246c4bb6c797de6efedae [id=08a2c4f9b62b465cb1bf7983bc8b802d]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:32.321744 13606 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4c2c85732d454cd98efc2646af9450ed. 1 dirs total, 0 dirs full, 0 dirs failed
W20250830 07:54:32.323607 13703 leader_election.cc:343] T ff0f9cccc8ed43b1a8cd38de0e9d4097 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Not found: Tablet not found: ff0f9cccc8ed43b1a8cd38de0e9d4097
W20250830 07:54:32.324134 13423 leader_election.cc:343] T 4d4b00bdadb24ec892d87c9be2ed7dd9 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Not found: Tablet not found: 4d4b00bdadb24ec892d87c9be2ed7dd9
W20250830 07:54:32.324705 13423 leader_election.cc:343] T ff0f9cccc8ed43b1a8cd38de0e9d4097 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Not found: Tablet not found: ff0f9cccc8ed43b1a8cd38de0e9d4097
I20250830 07:54:32.325322 13628 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "7ed22d9617024d55a8add137e7971061" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:32.325546 13628 raft_consensus.cc:2466] T 7ed22d9617024d55a8add137e7971061 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 0.
I20250830 07:54:32.326200 13703 leader_election.cc:304] T 7ed22d9617024d55a8add137e7971061 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f; no voters:
I20250830 07:54:32.326581 13897 raft_consensus.cc:2802] T 7ed22d9617024d55a8add137e7971061 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:54:32.326707 13897 raft_consensus.cc:491] T 7ed22d9617024d55a8add137e7971061 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:54:32.326809 13897 raft_consensus.cc:3058] T 7ed22d9617024d55a8add137e7971061 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:32.327096 13629 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "b059069ed7eb433a9c54523bce21b4ad" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9"
I20250830 07:54:32.327385 13629 raft_consensus.cc:2391] T b059069ed7eb433a9c54523bce21b4ad P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 2065c332f15a4739899af79f3669c3ba in current term 1: Already voted for candidate 9b057ade5dce45af9f8bf0bedf8b917f in this term.
I20250830 07:54:32.328073 13228 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_2e5a498fef4b463a8870af0d4cf30509"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:32.328703 13228 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2e5a498fef4b463a8870af0d4cf30509 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:32.329916 13225 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_599e4e4a8de24cd78bdd1c5d1c726b50" } new_table_name: "default.Table_4619d7810c174ac08026c2279c246788" modify_external_catalogs: true
I20250830 07:54:32.330256 13897 raft_consensus.cc:513] T 7ed22d9617024d55a8add137e7971061 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:54:32.332137 13897 leader_election.cc:290] T 7ed22d9617024d55a8add137e7971061 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Requested vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
I20250830 07:54:32.332823 13229 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_3dd99f1f4e8e4a2e987bd7fbfbee50d1" } modify_external_catalogs: true
I20250830 07:54:32.333009 13229 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_3dd99f1f4e8e4a2e987bd7fbfbee50d1" } modify_external_catalogs: true
W20250830 07:54:32.334594 13233 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6f9916f363e643e6a35574bb88e74729 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:32.343037 13604 tablet_service.cc:1515] Processing DeleteTablet for tablet a04bf79de30a42a98e71f622efc90c22 with delete_type TABLET_DATA_DELETED (replaced by tablet 0186504d9e4949179ce5b92b85f5b230) from {username='slave'} at 127.0.0.1:45306
W20250830 07:54:32.343756 13220 catalog_manager.cc:4908] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet a04bf79de30a42a98e71f622efc90c22 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a04bf79de30a42a98e71f622efc90c22 already in progress: creating tablet
I20250830 07:54:32.346081 13227 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_c14e6b9a7bb54c8dbbc1d2e31e446971" } modify_external_catalogs: true
I20250830 07:54:32.346269 13227 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_c14e6b9a7bb54c8dbbc1d2e31e446971" } modify_external_catalogs: true
I20250830 07:54:32.348647 13882 ts_tablet_manager.cc:1428] T a04bf79de30a42a98e71f622efc90c22 P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.170s user 0.024s sys 0.036s
I20250830 07:54:32.348759 13629 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "7ed22d9617024d55a8add137e7971061" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9"
I20250830 07:54:32.348934 13629 raft_consensus.cc:3058] T 7ed22d9617024d55a8add137e7971061 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:32.349224 13882 tablet_bootstrap.cc:492] T 5aef6fd239ba43478cd978fa5d29b26e P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:54:32.350852 13774 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "4d4b00bdadb24ec892d87c9be2ed7dd9" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:32.350965 13882 tablet_bootstrap.cc:654] T 5aef6fd239ba43478cd978fa5d29b26e P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:32.352619 13629 raft_consensus.cc:2466] T 7ed22d9617024d55a8add137e7971061 P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 1.
I20250830 07:54:32.353392 13774 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "ff0f9cccc8ed43b1a8cd38de0e9d4097" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:32.353627 13774 raft_consensus.cc:2466] T ff0f9cccc8ed43b1a8cd38de0e9d4097 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2065c332f15a4739899af79f3669c3ba in term 0.
I20250830 07:54:32.357544 13701 leader_election.cc:304] T ff0f9cccc8ed43b1a8cd38de0e9d4097 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:54:32.358150 13897 raft_consensus.cc:2802] T ff0f9cccc8ed43b1a8cd38de0e9d4097 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:54:32.358353 13897 raft_consensus.cc:491] T ff0f9cccc8ed43b1a8cd38de0e9d4097 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:54:32.358749 13897 raft_consensus.cc:3058] T ff0f9cccc8ed43b1a8cd38de0e9d4097 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:32.365933 13897 raft_consensus.cc:513] T ff0f9cccc8ed43b1a8cd38de0e9d4097 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:32.366760 13232 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet b059069ed7eb433a9c54523bce21b4ad
I20250830 07:54:32.367115 13897 leader_election.cc:290] T ff0f9cccc8ed43b1a8cd38de0e9d4097 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Requested vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967)
I20250830 07:54:32.367659 13232 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_74f3c73d22574737b5f6a4bd256e423d" } new_table_name: "default.Table_690616d54f014a969bb63de44038e18b" modify_external_catalogs: true
I20250830 07:54:32.370347 13234 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_b4d9eb5b2f1546b7aa8219ee394f849e" } new_table_name: "default.Table_e3a02594cc004665a46fa35a486ad4fc" modify_external_catalogs: true
I20250830 07:54:32.372416 13230 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_1bad683bf46c49aa8c24cd18c2c2e990" } new_table_name: "default.Table_7ebf4c4ec5524ee2a9e9c13971eb178f" modify_external_catalogs: true
I20250830 07:54:32.377899 13703 leader_election.cc:304] T 7ed22d9617024d55a8add137e7971061 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f; no voters:
W20250830 07:54:32.379642 13703 leader_election.cc:343] T ff0f9cccc8ed43b1a8cd38de0e9d4097 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Not found: Tablet not found: ff0f9cccc8ed43b1a8cd38de0e9d4097
I20250830 07:54:32.379989 13606 tablet_service.cc:1515] Processing DeleteTablet for tablet b059069ed7eb433a9c54523bce21b4ad with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:32 UTC) from {username='slave'} at 127.0.0.1:45306
I20250830 07:54:32.380285 13885 tablet_replica.cc:331] T b059069ed7eb433a9c54523bce21b4ad P 6b5e454d98894637b466ea27f1b647f9: stopping tablet replica
I20250830 07:54:32.380524 13885 raft_consensus.cc:2241] T b059069ed7eb433a9c54523bce21b4ad P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250830 07:54:32.380697 13885 raft_consensus.cc:2270] T b059069ed7eb433a9c54523bce21b4ad P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250830 07:54:32.381322 13885 ts_tablet_manager.cc:1905] T b059069ed7eb433a9c54523bce21b4ad P 6b5e454d98894637b466ea27f1b647f9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250830 07:54:32.389183 13885 ts_tablet_manager.cc:1918] T b059069ed7eb433a9c54523bce21b4ad P 6b5e454d98894637b466ea27f1b647f9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250830 07:54:32.389360 13885 log.cc:1199] T b059069ed7eb433a9c54523bce21b4ad P 6b5e454d98894637b466ea27f1b647f9: Deleting WAL directory at /tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/ts-1/wal/wals/b059069ed7eb433a9c54523bce21b4ad
I20250830 07:54:32.389819 13885 ts_tablet_manager.cc:1939] T b059069ed7eb433a9c54523bce21b4ad P 6b5e454d98894637b466ea27f1b647f9: Deleting consensus metadata
I20250830 07:54:32.390358 13220 catalog_manager.cc:4928] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): tablet b059069ed7eb433a9c54523bce21b4ad (table default.Table_80a0e1ec331a4abc8d2e28a89e89f537 [id=163edc59ef9846bfbe3c2c3f0b33e8cb]) successfully deleted
I20250830 07:54:32.390758 13747 tablet_service.cc:1515] Processing DeleteTablet for tablet b059069ed7eb433a9c54523bce21b4ad with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:32 UTC) from {username='slave'} at 127.0.0.1:45460
I20250830 07:54:32.391067 13884 tablet_replica.cc:331] T b059069ed7eb433a9c54523bce21b4ad P 9b057ade5dce45af9f8bf0bedf8b917f: stopping tablet replica
I20250830 07:54:32.391275 13884 raft_consensus.cc:2241] T b059069ed7eb433a9c54523bce21b4ad P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 LEADER]: Raft consensus shutting down.
I20250830 07:54:32.391654 13884 pending_rounds.cc:70] T b059069ed7eb433a9c54523bce21b4ad P 9b057ade5dce45af9f8bf0bedf8b917f: Trying to abort 1 pending ops.
I20250830 07:54:32.391865 13884 pending_rounds.cc:77] T b059069ed7eb433a9c54523bce21b4ad P 9b057ade5dce45af9f8bf0bedf8b917f: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7194789774450073600 op_type: NO_OP noop_request { }
I20250830 07:54:32.392066 13884 raft_consensus.cc:2887] T b059069ed7eb433a9c54523bce21b4ad P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20250830 07:54:32.392206 13884 raft_consensus.cc:2270] T b059069ed7eb433a9c54523bce21b4ad P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Raft consensus is shut down!
I20250830 07:54:32.393148 13884 ts_tablet_manager.cc:1905] T b059069ed7eb433a9c54523bce21b4ad P 9b057ade5dce45af9f8bf0bedf8b917f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250830 07:54:32.396358 13897 raft_consensus.cc:2802] T 7ed22d9617024d55a8add137e7971061 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election won for term 1
I20250830 07:54:32.396596 13897 raft_consensus.cc:695] T 7ed22d9617024d55a8add137e7971061 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 LEADER]: Becoming Leader. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Running, Role: LEADER
I20250830 07:54:32.397804 13897 consensus_queue.cc:237] T 7ed22d9617024d55a8add137e7971061 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:54:32.399369 13884 ts_tablet_manager.cc:1918] T b059069ed7eb433a9c54523bce21b4ad P 9b057ade5dce45af9f8bf0bedf8b917f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250830 07:54:32.399473 13884 log.cc:1199] T b059069ed7eb433a9c54523bce21b4ad P 9b057ade5dce45af9f8bf0bedf8b917f: Deleting WAL directory at /tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/ts-2/wal/wals/b059069ed7eb433a9c54523bce21b4ad
I20250830 07:54:32.399838 13884 ts_tablet_manager.cc:1939] T b059069ed7eb433a9c54523bce21b4ad P 9b057ade5dce45af9f8bf0bedf8b917f: Deleting consensus metadata
I20250830 07:54:32.400852 13219 catalog_manager.cc:4928] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): tablet b059069ed7eb433a9c54523bce21b4ad (table default.Table_80a0e1ec331a4abc8d2e28a89e89f537 [id=163edc59ef9846bfbe3c2c3f0b33e8cb]) successfully deleted
I20250830 07:54:32.411053 13886 tablet_bootstrap.cc:492] T 32c75568db9b4f00bb567d09dab3d45a P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:54:32.411211 13886 ts_tablet_manager.cc:1397] T 32c75568db9b4f00bb567d09dab3d45a P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.108s user 0.038s sys 0.045s
I20250830 07:54:32.411960 13886 raft_consensus.cc:357] T 32c75568db9b4f00bb567d09dab3d45a P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:54:32.412170 13886 raft_consensus.cc:383] T 32c75568db9b4f00bb567d09dab3d45a P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:32.412273 13886 raft_consensus.cc:738] T 32c75568db9b4f00bb567d09dab3d45a P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:54:32.412519 13886 consensus_queue.cc:260] T 32c75568db9b4f00bb567d09dab3d45a P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:54:32.413506 13886 ts_tablet_manager.cc:1428] T 32c75568db9b4f00bb567d09dab3d45a P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20250830 07:54:32.413789 13886 tablet_bootstrap.cc:492] T 4d4b00bdadb24ec892d87c9be2ed7dd9 P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:54:32.415362 13229 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet dfccff3bd0cb4c7d998633b015de3cfa
I20250830 07:54:32.415393 13886 tablet_bootstrap.cc:654] T 4d4b00bdadb24ec892d87c9be2ed7dd9 P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:32.416170 13882 tablet_bootstrap.cc:492] T 5aef6fd239ba43478cd978fa5d29b26e P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:54:32.416920 13887 tablet_bootstrap.cc:492] T ff2267fb411942ff826e2a72bcb89cd7 P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:54:32.417117 13887 ts_tablet_manager.cc:1397] T ff2267fb411942ff826e2a72bcb89cd7 P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.104s user 0.023s sys 0.023s
I20250830 07:54:32.418043 13887 raft_consensus.cc:357] T ff2267fb411942ff826e2a72bcb89cd7 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:32.418421 13882 ts_tablet_manager.cc:1397] T 5aef6fd239ba43478cd978fa5d29b26e P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.069s user 0.017s sys 0.017s
I20250830 07:54:32.418556 13747 tablet_service.cc:1515] Processing DeleteTablet for tablet dfccff3bd0cb4c7d998633b015de3cfa with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:32 UTC) from {username='slave'} at 127.0.0.1:45460
I20250830 07:54:32.418725 13887 raft_consensus.cc:383] T ff2267fb411942ff826e2a72bcb89cd7 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20250830 07:54:32.419265 13219 catalog_manager.cc:4908] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): delete failed for tablet dfccff3bd0cb4c7d998633b015de3cfa because tablet deleting was already in progress. No further retry: Already present: State transition of tablet dfccff3bd0cb4c7d998633b015de3cfa already in progress: creating tablet
I20250830 07:54:32.418445 13606 tablet_service.cc:1515] Processing DeleteTablet for tablet dfccff3bd0cb4c7d998633b015de3cfa with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:32 UTC) from {username='slave'} at 127.0.0.1:45306
I20250830 07:54:32.419590 13887 raft_consensus.cc:738] T ff2267fb411942ff826e2a72bcb89cd7 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:54:32.419859 13887 consensus_queue.cc:260] T ff2267fb411942ff826e2a72bcb89cd7 P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
W20250830 07:54:32.420065 13220 catalog_manager.cc:4908] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet dfccff3bd0cb4c7d998633b015de3cfa because tablet deleting was already in progress. No further retry: Already present: State transition of tablet dfccff3bd0cb4c7d998633b015de3cfa already in progress: creating tablet
I20250830 07:54:32.421826 13887 ts_tablet_manager.cc:1428] T ff2267fb411942ff826e2a72bcb89cd7 P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20250830 07:54:32.422029 13882 raft_consensus.cc:357] T 5aef6fd239ba43478cd978fa5d29b26e P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:32.422224 13882 raft_consensus.cc:383] T 5aef6fd239ba43478cd978fa5d29b26e P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:32.422585 13887 tablet_bootstrap.cc:492] T 7ef98dbbdf5848038a2da6140e126301 P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
W20250830 07:54:32.422714 13225 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 29d492735cd14bb6b4a2a9a3929f62f3 consensus state has no leader
I20250830 07:54:32.422693 13882 raft_consensus.cc:738] T 5aef6fd239ba43478cd978fa5d29b26e P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:54:32.422961 13882 consensus_queue.cc:260] T 5aef6fd239ba43478cd978fa5d29b26e P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:32.424474 13227 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet f53e7423d1f54566a667195f7cf5e1ce
I20250830 07:54:32.425149 13882 ts_tablet_manager.cc:1428] T 5aef6fd239ba43478cd978fa5d29b26e P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.007s user 0.001s sys 0.000s
I20250830 07:54:32.425473 13882 tablet_bootstrap.cc:492] T ff2267fb411942ff826e2a72bcb89cd7 P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:54:32.427122 13882 tablet_bootstrap.cc:654] T ff2267fb411942ff826e2a72bcb89cd7 P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:32.427356 13887 tablet_bootstrap.cc:654] T 7ef98dbbdf5848038a2da6140e126301 P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:32.427740 13747 tablet_service.cc:1515] Processing DeleteTablet for tablet f53e7423d1f54566a667195f7cf5e1ce with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:32 UTC) from {username='slave'} at 127.0.0.1:45460
W20250830 07:54:32.428359 13219 catalog_manager.cc:4908] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): delete failed for tablet f53e7423d1f54566a667195f7cf5e1ce because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f53e7423d1f54566a667195f7cf5e1ce already in progress: creating tablet
I20250830 07:54:32.427505 13606 tablet_service.cc:1515] Processing DeleteTablet for tablet f53e7423d1f54566a667195f7cf5e1ce with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:32 UTC) from {username='slave'} at 127.0.0.1:45306
W20250830 07:54:32.430439 13220 catalog_manager.cc:4908] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet f53e7423d1f54566a667195f7cf5e1ce because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f53e7423d1f54566a667195f7cf5e1ce already in progress: creating tablet
W20250830 07:54:32.431871 13232 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 9d00ee83780e4cf780ca92f1504d26b5 consensus state has no leader
I20250830 07:54:32.432140 13232 master_service.cc:948] ReplaceTablet: received request to replace tablet 9d00ee83780e4cf780ca92f1504d26b5 from {username='slave'} at 127.0.0.1:42126
I20250830 07:54:32.432994 13226 master_service.cc:948] ReplaceTablet: received request to replace tablet 7ed22d9617024d55a8add137e7971061 from {username='slave'} at 127.0.0.1:42126
I20250830 07:54:32.435117 13747 tablet_service.cc:1515] Processing DeleteTablet for tablet ab7196ca193348f5b4bb9193b731e04f with delete_type TABLET_DATA_DELETED (replaced by tablet 9d00ee83780e4cf780ca92f1504d26b5) from {username='slave'} at 127.0.0.1:45460
I20250830 07:54:32.435374 13884 tablet_replica.cc:331] T ab7196ca193348f5b4bb9193b731e04f P 9b057ade5dce45af9f8bf0bedf8b917f: stopping tablet replica
I20250830 07:54:32.435639 13884 raft_consensus.cc:2241] T ab7196ca193348f5b4bb9193b731e04f P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Raft consensus shutting down.
I20250830 07:54:32.435806 13884 raft_consensus.cc:2270] T ab7196ca193348f5b4bb9193b731e04f P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Raft consensus is shut down!
I20250830 07:54:32.435760 13467 tablet_service.cc:1515] Processing DeleteTablet for tablet 6f4c400c0e5e43319fa521b5cab694b4 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:32 UTC) from {username='slave'} at 127.0.0.1:37956
I20250830 07:54:32.436779 13884 ts_tablet_manager.cc:1905] T ab7196ca193348f5b4bb9193b731e04f P 9b057ade5dce45af9f8bf0bedf8b917f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250830 07:54:32.440478 13604 tablet_service.cc:1468] Processing CreateTablet for tablet 29d492735cd14bb6b4a2a9a3929f62f3 (DEFAULT_TABLE table=default.Table_4619d7810c174ac08026c2279c246788 [id=b99c31c3fed04fe49f754545ab66b02c]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:32.440941 13604 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 29d492735cd14bb6b4a2a9a3929f62f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:32.441821 13462 tablet_service.cc:1468] Processing CreateTablet for tablet 6f4c400c0e5e43319fa521b5cab694b4 (DEFAULT_TABLE table=default.Table_17a2e182c79d4c13bc1ce3f53f9ba765 [id=d48de709ec8e401caf2bf98160c5beda]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:32.442296 13462 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f4c400c0e5e43319fa521b5cab694b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:32.443238 13608 tablet_service.cc:1468] Processing CreateTablet for tablet 62cf192967d94ecf954d3e965a4d9c9b (DEFAULT_TABLE table=default.Table_6e51d6d3fc4647cdaae81d6337a6b42a [id=b983c24ca8174434b0e2c276a9b93495]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:32.443641 13608 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62cf192967d94ecf954d3e965a4d9c9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:32.443627 13467 tablet_service.cc:1468] Processing CreateTablet for tablet 4c2c85732d454cd98efc2646af9450ed (DEFAULT_TABLE table=default.Table_d2ac5bc3c0c246c4bb6c797de6efedae [id=08a2c4f9b62b465cb1bf7983bc8b802d]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:32.444223 13467 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4c2c85732d454cd98efc2646af9450ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:32.447341 13899 raft_consensus.cc:491] T 5aef6fd239ba43478cd978fa5d29b26e P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:32.447571 13899 raft_consensus.cc:513] T 5aef6fd239ba43478cd978fa5d29b26e P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:32.448742 13487 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "5aef6fd239ba43478cd978fa5d29b26e" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:54:32.449000 13487 raft_consensus.cc:2466] T 5aef6fd239ba43478cd978fa5d29b26e P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b5e454d98894637b466ea27f1b647f9 in term 0.
I20250830 07:54:32.449529 13561 leader_election.cc:304] T 5aef6fd239ba43478cd978fa5d29b26e P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 6b5e454d98894637b466ea27f1b647f9; no voters:
I20250830 07:54:32.449832 13956 raft_consensus.cc:2802] T 5aef6fd239ba43478cd978fa5d29b26e P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:54:32.449923 13956 raft_consensus.cc:491] T 5aef6fd239ba43478cd978fa5d29b26e P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:54:32.450052 13956 raft_consensus.cc:3058] T 5aef6fd239ba43478cd978fa5d29b26e P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:32.450098 13899 leader_election.cc:290] T 5aef6fd239ba43478cd978fa5d29b26e P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:32.451304 13753 tablet_service.cc:1468] Processing CreateTablet for tablet e134ab64aa1b4ce89e295b43cbc3fffb (DEFAULT_TABLE table=default.Table_ca148790caf146b0b02b54ae9f70c339 [id=804faceb2bab448f957a78a208058464]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:32.451723 13753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e134ab64aa1b4ce89e295b43cbc3fffb. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:32.452867 13956 raft_consensus.cc:513] T 5aef6fd239ba43478cd978fa5d29b26e P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:32.453467 13956 leader_election.cc:290] T 5aef6fd239ba43478cd978fa5d29b26e P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 election: Requested vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:32.453770 13487 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "5aef6fd239ba43478cd978fa5d29b26e" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba"
I20250830 07:54:32.453823 13603 tablet_service.cc:1468] Processing CreateTablet for tablet 6cf10b7011d444cba0ac758add292477 (DEFAULT_TABLE table=default.Table_68a8222fb01847ca88079ba1dead8d71 [id=f15ded59e09140d1a284a41572e297a0]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:32.453959 13487 raft_consensus.cc:3058] T 5aef6fd239ba43478cd978fa5d29b26e P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:32.454216 13603 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6cf10b7011d444cba0ac758add292477. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:32.455246 13755 tablet_service.cc:1468] Processing CreateTablet for tablet 29d492735cd14bb6b4a2a9a3929f62f3 (DEFAULT_TABLE table=default.Table_4619d7810c174ac08026c2279c246788 [id=b99c31c3fed04fe49f754545ab66b02c]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:32.455616 13755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 29d492735cd14bb6b4a2a9a3929f62f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:32.456686 13487 raft_consensus.cc:2466] T 5aef6fd239ba43478cd978fa5d29b26e P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b5e454d98894637b466ea27f1b647f9 in term 1.
I20250830 07:54:32.457067 13561 leader_election.cc:304] T 5aef6fd239ba43478cd978fa5d29b26e P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 6b5e454d98894637b466ea27f1b647f9; no voters:
I20250830 07:54:32.457717 13460 tablet_service.cc:1468] Processing CreateTablet for tablet 2afb1e75cfcc4e1abd265fbadb4170fa (DEFAULT_TABLE table=default.Table_53cf6bab348a4b3c84bac9d533c27d25 [id=098befd08500427bbe1077d47a843e84]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:32.458103 13460 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2afb1e75cfcc4e1abd265fbadb4170fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:32.459226 13607 tablet_service.cc:1468] Processing CreateTablet for tablet bcdac588f7c24d9d8572949e09b80a23 (DEFAULT_TABLE table=default.Table_307276a7da514840af7d3a3c90634e05 [id=4678375d8d3d474290ad1a254de14054]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:32.459583 13607 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bcdac588f7c24d9d8572949e09b80a23. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:32.460938 13748 tablet_service.cc:1468] Processing CreateTablet for tablet 6cf10b7011d444cba0ac758add292477 (DEFAULT_TABLE table=default.Table_68a8222fb01847ca88079ba1dead8d71 [id=f15ded59e09140d1a284a41572e297a0]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:32.461318 13748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6cf10b7011d444cba0ac758add292477. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:32.461741 13468 tablet_service.cc:1515] Processing DeleteTablet for tablet dfccff3bd0cb4c7d998633b015de3cfa with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:32 UTC) from {username='slave'} at 127.0.0.1:37956
I20250830 07:54:32.462751 13468 tablet_service.cc:1515] Processing DeleteTablet for tablet f53e7423d1f54566a667195f7cf5e1ce with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:32 UTC) from {username='slave'} at 127.0.0.1:37956
I20250830 07:54:32.463160 13609 tablet_service.cc:1468] Processing CreateTablet for tablet d3b47314f7cd4e969d973c0a340137f1 (DEFAULT_TABLE table=default.Table_83fc86674acf4abca8bfc1fc039656c2 [id=f516bb93bd754dc79a78d13a6ac0ddfa]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:32.463253 13749 tablet_service.cc:1468] Processing CreateTablet for tablet bcdac588f7c24d9d8572949e09b80a23 (DEFAULT_TABLE table=default.Table_307276a7da514840af7d3a3c90634e05 [id=4678375d8d3d474290ad1a254de14054]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:32.463511 13609 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3b47314f7cd4e969d973c0a340137f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:32.463527 13468 tablet_service.cc:1468] Processing CreateTablet for tablet d1ae3812d72b419798736328da64b53c (DEFAULT_TABLE table=default.Table_9820075fa56348c883f2c302ec3b6adf [id=cb36c38dc252417e8a428287d4c469e6]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:32.463636 13749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bcdac588f7c24d9d8572949e09b80a23. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:32.463824 13468 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1ae3812d72b419798736328da64b53c. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:32.467195 13752 tablet_service.cc:1468] Processing CreateTablet for tablet 62cf192967d94ecf954d3e965a4d9c9b (DEFAULT_TABLE table=default.Table_6e51d6d3fc4647cdaae81d6337a6b42a [id=b983c24ca8174434b0e2c276a9b93495]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:32.467285 13754 tablet_service.cc:1468] Processing CreateTablet for tablet d3b47314f7cd4e969d973c0a340137f1 (DEFAULT_TABLE table=default.Table_83fc86674acf4abca8bfc1fc039656c2 [id=f516bb93bd754dc79a78d13a6ac0ddfa]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:32.467558 13752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62cf192967d94ecf954d3e965a4d9c9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:32.467952 13466 tablet_service.cc:1468] Processing CreateTablet for tablet c9a8f144d50c4d3d81fbf43ce29a2ad2 (DEFAULT_TABLE table=default.Table_3d12ac4bedcf433aa345dda9066deb22 [id=d2dbb756d66b483ebe44d45ddfa5c17c]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:32.468421 13466 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c9a8f144d50c4d3d81fbf43ce29a2ad2. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:32.470600 13464 tablet_service.cc:1468] Processing CreateTablet for tablet 29d492735cd14bb6b4a2a9a3929f62f3 (DEFAULT_TABLE table=default.Table_4619d7810c174ac08026c2279c246788 [id=b99c31c3fed04fe49f754545ab66b02c]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:32.470952 13464 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 29d492735cd14bb6b4a2a9a3929f62f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:32.471045 13465 tablet_service.cc:1515] Processing DeleteTablet for tablet b059069ed7eb433a9c54523bce21b4ad with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:32 UTC) from {username='slave'} at 127.0.0.1:37956
I20250830 07:54:32.471066 13754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3b47314f7cd4e969d973c0a340137f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:32.471334 13883 tablet_replica.cc:331] T b059069ed7eb433a9c54523bce21b4ad P 2065c332f15a4739899af79f3669c3ba: stopping tablet replica
I20250830 07:54:32.471546 13883 raft_consensus.cc:2241] T b059069ed7eb433a9c54523bce21b4ad P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Raft consensus shutting down.
I20250830 07:54:32.471746 13883 raft_consensus.cc:2270] T b059069ed7eb433a9c54523bce21b4ad P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20250830 07:54:32.472133 13956 raft_consensus.cc:2802] T 5aef6fd239ba43478cd978fa5d29b26e P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Leader election won for term 1
I20250830 07:54:32.472326 13956 raft_consensus.cc:695] T 5aef6fd239ba43478cd978fa5d29b26e P 6b5e454d98894637b466ea27f1b647f9 [term 1 LEADER]: Becoming Leader. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Running, Role: LEADER
I20250830 07:54:32.472529 13883 ts_tablet_manager.cc:1905] T b059069ed7eb433a9c54523bce21b4ad P 2065c332f15a4739899af79f3669c3ba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250830 07:54:32.472697 13956 consensus_queue.cc:237] T 5aef6fd239ba43478cd978fa5d29b26e P 6b5e454d98894637b466ea27f1b647f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:32.477636 13464 tablet_service.cc:1468] Processing CreateTablet for tablet 62cf192967d94ecf954d3e965a4d9c9b (DEFAULT_TABLE table=default.Table_6e51d6d3fc4647cdaae81d6337a6b42a [id=b983c24ca8174434b0e2c276a9b93495]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:32.477972 13464 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62cf192967d94ecf954d3e965a4d9c9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:32.479096 13883 ts_tablet_manager.cc:1918] T b059069ed7eb433a9c54523bce21b4ad P 2065c332f15a4739899af79f3669c3ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250830 07:54:32.479228 13883 log.cc:1199] T b059069ed7eb433a9c54523bce21b4ad P 2065c332f15a4739899af79f3669c3ba: Deleting WAL directory at /tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/ts-0/wal/wals/b059069ed7eb433a9c54523bce21b4ad
I20250830 07:54:32.479650 13883 ts_tablet_manager.cc:1939] T b059069ed7eb433a9c54523bce21b4ad P 2065c332f15a4739899af79f3669c3ba: Deleting consensus metadata
I20250830 07:54:32.480628 13606 tablet_service.cc:1468] Processing CreateTablet for tablet d1ae3812d72b419798736328da64b53c (DEFAULT_TABLE table=default.Table_9820075fa56348c883f2c302ec3b6adf [id=cb36c38dc252417e8a428287d4c469e6]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:32.481067 13606 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1ae3812d72b419798736328da64b53c. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:32.483196 13468 tablet_service.cc:1468] Processing CreateTablet for tablet e134ab64aa1b4ce89e295b43cbc3fffb (DEFAULT_TABLE table=default.Table_ca148790caf146b0b02b54ae9f70c339 [id=804faceb2bab448f957a78a208058464]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:32.483587 13468 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e134ab64aa1b4ce89e295b43cbc3fffb. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:32.495590 13747 tablet_service.cc:1468] Processing CreateTablet for tablet d1ae3812d72b419798736328da64b53c (DEFAULT_TABLE table=default.Table_9820075fa56348c883f2c302ec3b6adf [id=cb36c38dc252417e8a428287d4c469e6]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:32.495988 13747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1ae3812d72b419798736328da64b53c. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:32.498757 13465 tablet_service.cc:1468] Processing CreateTablet for tablet 6cf10b7011d444cba0ac758add292477 (DEFAULT_TABLE table=default.Table_68a8222fb01847ca88079ba1dead8d71 [id=f15ded59e09140d1a284a41572e297a0]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:32.499183 13465 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6cf10b7011d444cba0ac758add292477. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:32.500175 13774 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "5aef6fd239ba43478cd978fa5d29b26e" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:32.500980 13774 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "5aef6fd239ba43478cd978fa5d29b26e" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f"
W20250830 07:54:32.502355 13562 leader_election.cc:343] T 5aef6fd239ba43478cd978fa5d29b26e P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Illegal state: must be running to vote when last-logged opid is not known
W20250830 07:54:32.502879 13562 leader_election.cc:343] T 5aef6fd239ba43478cd978fa5d29b26e P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:32.507622 13461 tablet_service.cc:1468] Processing CreateTablet for tablet d3b47314f7cd4e969d973c0a340137f1 (DEFAULT_TABLE table=default.Table_83fc86674acf4abca8bfc1fc039656c2 [id=f516bb93bd754dc79a78d13a6ac0ddfa]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:32.508071 13461 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3b47314f7cd4e969d973c0a340137f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:32.512239 13422 leader_election.cc:304] T b059069ed7eb433a9c54523bce21b4ad P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba; no voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f
W20250830 07:54:32.512522 13422 raft_consensus.cc:2684] T b059069ed7eb433a9c54523bce21b4ad P 2065c332f15a4739899af79f3669c3ba: unable to run election callback: Service unavailable: Thread pool token was shut down
I20250830 07:54:32.513911 13465 tablet_service.cc:1468] Processing CreateTablet for tablet bcdac588f7c24d9d8572949e09b80a23 (DEFAULT_TABLE table=default.Table_307276a7da514840af7d3a3c90634e05 [id=4678375d8d3d474290ad1a254de14054]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:32.514286 13465 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bcdac588f7c24d9d8572949e09b80a23. 1 dirs total, 0 dirs full, 0 dirs failed
W20250830 07:54:32.525928 13422 leader_election.cc:343] T 4d4b00bdadb24ec892d87c9be2ed7dd9 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:32.526103 13422 leader_election.cc:304] T 4d4b00bdadb24ec892d87c9be2ed7dd9 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba; no voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:54:32.530377 13954 raft_consensus.cc:2747] T 4d4b00bdadb24ec892d87c9be2ed7dd9 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:54:32.530896 13422 leader_election.cc:304] T ff0f9cccc8ed43b1a8cd38de0e9d4097 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:54:32.531852 13603 tablet_service.cc:1468] Processing CreateTablet for tablet 02be33dc658d428fa55e59784a2342f6 (DEFAULT_TABLE table=default.Table_786defd496fb44dc9ca518cadbc85db8 [id=761247d93d9f4f788ecceabebf1de486]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:32.532232 13603 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 02be33dc658d428fa55e59784a2342f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:32.533262 13954 raft_consensus.cc:2802] T ff0f9cccc8ed43b1a8cd38de0e9d4097 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:54:32.533361 13954 raft_consensus.cc:491] T ff0f9cccc8ed43b1a8cd38de0e9d4097 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:54:32.533452 13954 raft_consensus.cc:3058] T ff0f9cccc8ed43b1a8cd38de0e9d4097 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:32.535121 13752 tablet_service.cc:1468] Processing CreateTablet for tablet 02be33dc658d428fa55e59784a2342f6 (DEFAULT_TABLE table=default.Table_786defd496fb44dc9ca518cadbc85db8 [id=761247d93d9f4f788ecceabebf1de486]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:32.535372 13609 tablet_service.cc:1468] Processing CreateTablet for tablet 1fa571e9490e499792225d7b786e8658 (DEFAULT_TABLE table=default.Table_12c9ea9f75c24214838d600088c31bcf [id=b51964a7d7d14d6db2fd35783c905bbc]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:32.535583 13752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 02be33dc658d428fa55e59784a2342f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:32.535746 13609 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1fa571e9490e499792225d7b786e8658. 1 dirs total, 0 dirs full, 0 dirs failed
W20250830 07:54:32.535705 13218 catalog_manager.cc:4895] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): delete failed for tablet 6f4c400c0e5e43319fa521b5cab694b4 because the tablet was not found. No further retry: Not found: Tablet not found: 6f4c400c0e5e43319fa521b5cab694b4
W20250830 07:54:32.536319 13218 catalog_manager.cc:4908] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): delete failed for tablet dfccff3bd0cb4c7d998633b015de3cfa because tablet deleting was already in progress. No further retry: Already present: State transition of tablet dfccff3bd0cb4c7d998633b015de3cfa already in progress: creating tablet
W20250830 07:54:32.537165 13218 catalog_manager.cc:4908] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): delete failed for tablet f53e7423d1f54566a667195f7cf5e1ce because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f53e7423d1f54566a667195f7cf5e1ce already in progress: creating tablet
I20250830 07:54:32.538905 13218 catalog_manager.cc:4928] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): tablet b059069ed7eb433a9c54523bce21b4ad (table default.Table_80a0e1ec331a4abc8d2e28a89e89f537 [id=163edc59ef9846bfbe3c2c3f0b33e8cb]) successfully deleted
I20250830 07:54:32.539418 13607 tablet_service.cc:1468] Processing CreateTablet for tablet 69f2105c5eeb47e9a848ae7bf8779996 (DEFAULT_TABLE table=default.Table_452b4395b710434591ea426b1e2432ba [id=504758a50ce541e0935fdd94da5c3239]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:32.539757 13607 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 69f2105c5eeb47e9a848ae7bf8779996. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:32.543336 13750 tablet_service.cc:1468] Processing CreateTablet for tablet 1fa571e9490e499792225d7b786e8658 (DEFAULT_TABLE table=default.Table_12c9ea9f75c24214838d600088c31bcf [id=b51964a7d7d14d6db2fd35783c905bbc]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:32.543684 13750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1fa571e9490e499792225d7b786e8658. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:32.543788 13751 tablet_service.cc:1468] Processing CreateTablet for tablet 69f2105c5eeb47e9a848ae7bf8779996 (DEFAULT_TABLE table=default.Table_452b4395b710434591ea426b1e2432ba [id=504758a50ce541e0935fdd94da5c3239]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:32.544143 13751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 69f2105c5eeb47e9a848ae7bf8779996. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:32.544202 13487 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "7ed22d9617024d55a8add137e7971061" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba"
I20250830 07:54:32.544371 13487 raft_consensus.cc:3058] T 7ed22d9617024d55a8add137e7971061 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:32.544848 13488 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "ff0f9cccc8ed43b1a8cd38de0e9d4097" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba"
I20250830 07:54:32.545563 13463 tablet_service.cc:1468] Processing CreateTablet for tablet 02be33dc658d428fa55e59784a2342f6 (DEFAULT_TABLE table=default.Table_786defd496fb44dc9ca518cadbc85db8 [id=761247d93d9f4f788ecceabebf1de486]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:32.545926 13463 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 02be33dc658d428fa55e59784a2342f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:32.546965 13602 tablet_service.cc:1468] Processing CreateTablet for tablet e134ab64aa1b4ce89e295b43cbc3fffb (DEFAULT_TABLE table=default.Table_ca148790caf146b0b02b54ae9f70c339 [id=804faceb2bab448f957a78a208058464]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:32.547320 13602 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e134ab64aa1b4ce89e295b43cbc3fffb. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:32.550555 13459 tablet_service.cc:1468] Processing CreateTablet for tablet 1fa571e9490e499792225d7b786e8658 (DEFAULT_TABLE table=default.Table_12c9ea9f75c24214838d600088c31bcf [id=b51964a7d7d14d6db2fd35783c905bbc]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:32.551060 13459 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1fa571e9490e499792225d7b786e8658. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:32.554909 13458 tablet_service.cc:1468] Processing CreateTablet for tablet 69f2105c5eeb47e9a848ae7bf8779996 (DEFAULT_TABLE table=default.Table_452b4395b710434591ea426b1e2432ba [id=504758a50ce541e0935fdd94da5c3239]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:32.555392 13458 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 69f2105c5eeb47e9a848ae7bf8779996. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:32.558204 13884 ts_tablet_manager.cc:1918] T ab7196ca193348f5b4bb9193b731e04f P 9b057ade5dce45af9f8bf0bedf8b917f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250830 07:54:32.558359 13884 log.cc:1199] T ab7196ca193348f5b4bb9193b731e04f P 9b057ade5dce45af9f8bf0bedf8b917f: Deleting WAL directory at /tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/ts-2/wal/wals/ab7196ca193348f5b4bb9193b731e04f
I20250830 07:54:32.558780 13884 ts_tablet_manager.cc:1939] T ab7196ca193348f5b4bb9193b731e04f P 9b057ade5dce45af9f8bf0bedf8b917f: Deleting consensus metadata
I20250830 07:54:32.562129 13886 tablet_bootstrap.cc:492] T 4d4b00bdadb24ec892d87c9be2ed7dd9 P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:54:32.562353 13886 ts_tablet_manager.cc:1397] T 4d4b00bdadb24ec892d87c9be2ed7dd9 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.149s user 0.020s sys 0.042s
I20250830 07:54:32.563208 13886 raft_consensus.cc:357] T 4d4b00bdadb24ec892d87c9be2ed7dd9 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:32.563493 13886 raft_consensus.cc:383] T 4d4b00bdadb24ec892d87c9be2ed7dd9 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:32.563691 13886 raft_consensus.cc:738] T 4d4b00bdadb24ec892d87c9be2ed7dd9 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:54:32.564069 13886 consensus_queue.cc:260] T 4d4b00bdadb24ec892d87c9be2ed7dd9 P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:32.566846 13886 ts_tablet_manager.cc:1428] T 4d4b00bdadb24ec892d87c9be2ed7dd9 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20250830 07:54:32.567373 13886 tablet_bootstrap.cc:492] T 5ce773ce68f649b1bf51f0dd901cb04f P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
W20250830 07:54:32.568070 13234 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f846a23f0be046028cc2472de88b71c4 consensus state has no leader
I20250830 07:54:32.569157 13886 tablet_bootstrap.cc:654] T 5ce773ce68f649b1bf51f0dd901cb04f P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
W20250830 07:54:32.570104 13231 catalog_manager.cc:5415] Ignoring report from unknown tablet 9e055d6089f541f799eddb5778eb2148
I20250830 07:54:32.571323 13886 tablet_bootstrap.cc:492] T 5ce773ce68f649b1bf51f0dd901cb04f P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:54:32.571440 13886 ts_tablet_manager.cc:1397] T 5ce773ce68f649b1bf51f0dd901cb04f P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.002s
W20250830 07:54:32.571650 13231 catalog_manager.cc:5415] Ignoring report from unknown tablet 7ed22d9617024d55a8add137e7971061
I20250830 07:54:32.572161 13886 raft_consensus.cc:357] T 5ce773ce68f649b1bf51f0dd901cb04f P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:32.572140 13228 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_0de9806941924437ab41de35e3e2eeaa"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250830 07:54:32.572329 13886 raft_consensus.cc:383] T 5ce773ce68f649b1bf51f0dd901cb04f P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:32.572410 13886 raft_consensus.cc:738] T 5ce773ce68f649b1bf51f0dd901cb04f P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:54:32.572569 13886 consensus_queue.cc:260] T 5ce773ce68f649b1bf51f0dd901cb04f P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
W20250830 07:54:32.572737 13228 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0de9806941924437ab41de35e3e2eeaa in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:32.572999 13886 ts_tablet_manager.cc:1428] T 5ce773ce68f649b1bf51f0dd901cb04f P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20250830 07:54:32.573375 13886 tablet_bootstrap.cc:492] T 0a7c368f47aa41d896f5a3c3c20918c6 P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:54:32.574537 13233 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_53cf6bab348a4b3c84bac9d533c27d25" } new_table_name: "default.Table_9f030036c0c840a18e8d877d724be6b5" modify_external_catalogs: true
I20250830 07:54:32.575031 13886 tablet_bootstrap.cc:654] T 0a7c368f47aa41d896f5a3c3c20918c6 P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:32.576251 13227 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_c971df90450b4c17821d0f0a51ae48a3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:32.576893 13227 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c971df90450b4c17821d0f0a51ae48a3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250830 07:54:32.579263 13234 catalog_manager.cc:5415] Ignoring report from unknown tablet 7ed22d9617024d55a8add137e7971061
I20250830 07:54:32.582710 13886 tablet_bootstrap.cc:492] T 0a7c368f47aa41d896f5a3c3c20918c6 P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:54:32.582629 13225 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_dd774f7d4e734781863c6a40c156e3e7" } modify_external_catalogs: true
I20250830 07:54:32.582818 13886 ts_tablet_manager.cc:1397] T 0a7c368f47aa41d896f5a3c3c20918c6 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.010s user 0.001s sys 0.007s
I20250830 07:54:32.582820 13225 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_dd774f7d4e734781863c6a40c156e3e7" } modify_external_catalogs: true
I20250830 07:54:32.583319 13886 raft_consensus.cc:357] T 0a7c368f47aa41d896f5a3c3c20918c6 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:32.583446 13886 raft_consensus.cc:383] T 0a7c368f47aa41d896f5a3c3c20918c6 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:32.583495 13886 raft_consensus.cc:738] T 0a7c368f47aa41d896f5a3c3c20918c6 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:54:32.583644 13886 consensus_queue.cc:260] T 0a7c368f47aa41d896f5a3c3c20918c6 P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:32.584084 13886 ts_tablet_manager.cc:1428] T 0a7c368f47aa41d896f5a3c3c20918c6 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250830 07:54:32.584533 13886 tablet_bootstrap.cc:492] T a04bf79de30a42a98e71f622efc90c22 P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:54:32.586350 13886 tablet_bootstrap.cc:654] T a04bf79de30a42a98e71f622efc90c22 P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:32.586524 13229 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_ed86b365cefe4412bcc0629921f39f3b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:32.587139 13229 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ed86b365cefe4412bcc0629921f39f3b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:32.591805 13886 tablet_bootstrap.cc:492] T a04bf79de30a42a98e71f622efc90c22 P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:54:32.591950 13886 ts_tablet_manager.cc:1397] T a04bf79de30a42a98e71f622efc90c22 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.008s user 0.005s sys 0.002s
I20250830 07:54:32.592679 13886 raft_consensus.cc:357] T a04bf79de30a42a98e71f622efc90c22 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:32.592852 13886 raft_consensus.cc:383] T a04bf79de30a42a98e71f622efc90c22 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:32.592957 13886 raft_consensus.cc:738] T a04bf79de30a42a98e71f622efc90c22 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:54:32.593179 13886 consensus_queue.cc:260] T a04bf79de30a42a98e71f622efc90c22 P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:32.594677 13886 ts_tablet_manager.cc:1428] T a04bf79de30a42a98e71f622efc90c22 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20250830 07:54:32.594949 13886 tablet_bootstrap.cc:492] T 5aef6fd239ba43478cd978fa5d29b26e P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:54:32.596472 13886 tablet_bootstrap.cc:654] T 5aef6fd239ba43478cd978fa5d29b26e P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:32.599651 13886 tablet_bootstrap.cc:492] T 5aef6fd239ba43478cd978fa5d29b26e P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:54:32.599749 13886 ts_tablet_manager.cc:1397] T 5aef6fd239ba43478cd978fa5d29b26e P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20250830 07:54:32.600315 13886 raft_consensus.cc:357] T 5aef6fd239ba43478cd978fa5d29b26e P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:32.600535 13886 raft_consensus.cc:383] T 5aef6fd239ba43478cd978fa5d29b26e P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:32.600625 13886 raft_consensus.cc:738] T 5aef6fd239ba43478cd978fa5d29b26e P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:54:32.600862 13886 consensus_queue.cc:260] T 5aef6fd239ba43478cd978fa5d29b26e P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:32.603021 13886 ts_tablet_manager.cc:1428] T 5aef6fd239ba43478cd978fa5d29b26e P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20250830 07:54:32.603417 13886 tablet_bootstrap.cc:492] T ff2267fb411942ff826e2a72bcb89cd7 P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:54:32.605108 13886 tablet_bootstrap.cc:654] T ff2267fb411942ff826e2a72bcb89cd7 P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:32.605321 13228 master_service.cc:948] ReplaceTablet: received request to replace tablet f53e7423d1f54566a667195f7cf5e1ce from {username='slave'} at 127.0.0.1:42126
I20250830 07:54:32.606750 13228 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_77b02efa7d514f4291acb38f6f870ff9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:32.607501 13228 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_77b02efa7d514f4291acb38f6f870ff9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:32.611661 13231 catalog_manager.cc:5582] T 8f4567f30cc34f288463e4a92bd3edd5 P 2065c332f15a4739899af79f3669c3ba reported cstate change: term changed from 0 to 1, leader changed from <none> to 2065c332f15a4739899af79f3669c3ba (127.12.209.1). New cstate: current_term: 1 leader_uuid: "2065c332f15a4739899af79f3669c3ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } health_report { overall_health: HEALTHY } } }
I20250830 07:54:32.613122 13886 tablet_bootstrap.cc:492] T ff2267fb411942ff826e2a72bcb89cd7 P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:54:32.613238 13886 ts_tablet_manager.cc:1397] T ff2267fb411942ff826e2a72bcb89cd7 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.010s user 0.002s sys 0.006s
I20250830 07:54:32.613874 13886 raft_consensus.cc:357] T ff2267fb411942ff826e2a72bcb89cd7 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:32.614037 13886 raft_consensus.cc:383] T ff2267fb411942ff826e2a72bcb89cd7 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:32.614118 13886 raft_consensus.cc:738] T ff2267fb411942ff826e2a72bcb89cd7 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:54:32.614429 13886 consensus_queue.cc:260] T ff2267fb411942ff826e2a72bcb89cd7 P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:32.615214 13886 ts_tablet_manager.cc:1428] T ff2267fb411942ff826e2a72bcb89cd7 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20250830 07:54:32.615469 13886 tablet_bootstrap.cc:492] T f398e12cd9f543738d5163354f8a9d9d P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:54:32.617133 13954 raft_consensus.cc:513] T ff0f9cccc8ed43b1a8cd38de0e9d4097 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:32.617600 13488 raft_consensus.cc:2391] T ff0f9cccc8ed43b1a8cd38de0e9d4097 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 9b057ade5dce45af9f8bf0bedf8b917f in current term 1: Already voted for candidate 2065c332f15a4739899af79f3669c3ba in this term.
I20250830 07:54:32.617693 13886 tablet_bootstrap.cc:654] T f398e12cd9f543738d5163354f8a9d9d P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:32.617833 13487 raft_consensus.cc:2466] T 7ed22d9617024d55a8add137e7971061 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 1.
I20250830 07:54:32.620239 13954 leader_election.cc:290] T ff0f9cccc8ed43b1a8cd38de0e9d4097 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 election: Requested vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:32.622717 13701 leader_election.cc:304] T ff0f9cccc8ed43b1a8cd38de0e9d4097 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 2065c332f15a4739899af79f3669c3ba, 6b5e454d98894637b466ea27f1b647f9
I20250830 07:54:32.623448 13897 raft_consensus.cc:2747] T ff0f9cccc8ed43b1a8cd38de0e9d4097 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20250830 07:54:32.635847 13882 tablet_bootstrap.cc:492] T ff2267fb411942ff826e2a72bcb89cd7 P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:54:32.635999 13882 ts_tablet_manager.cc:1397] T ff2267fb411942ff826e2a72bcb89cd7 P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.211s user 0.022s sys 0.076s
I20250830 07:54:32.636693 13882 raft_consensus.cc:357] T ff2267fb411942ff826e2a72bcb89cd7 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:32.636902 13882 raft_consensus.cc:383] T ff2267fb411942ff826e2a72bcb89cd7 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:32.636973 13882 raft_consensus.cc:738] T ff2267fb411942ff826e2a72bcb89cd7 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:54:32.637195 13882 consensus_queue.cc:260] T ff2267fb411942ff826e2a72bcb89cd7 P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:32.637713 13882 ts_tablet_manager.cc:1428] T ff2267fb411942ff826e2a72bcb89cd7 P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20250830 07:54:32.638053 13882 tablet_bootstrap.cc:492] T 4ab63ff59d4e4ec2b7b64d605545a870 P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:54:32.638876 13887 tablet_bootstrap.cc:492] T 7ef98dbbdf5848038a2da6140e126301 P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:54:32.639016 13887 ts_tablet_manager.cc:1397] T 7ef98dbbdf5848038a2da6140e126301 P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.217s user 0.033s sys 0.066s
W20250830 07:54:32.639183 13423 leader_election.cc:343] T ff0f9cccc8ed43b1a8cd38de0e9d4097 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Not found: Tablet not found: ff0f9cccc8ed43b1a8cd38de0e9d4097
I20250830 07:54:32.639559 13774 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "ff0f9cccc8ed43b1a8cd38de0e9d4097" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f"
I20250830 07:54:32.639636 13887 raft_consensus.cc:357] T 7ef98dbbdf5848038a2da6140e126301 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:32.639776 13887 raft_consensus.cc:383] T 7ef98dbbdf5848038a2da6140e126301 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:32.639856 13887 raft_consensus.cc:738] T 7ef98dbbdf5848038a2da6140e126301 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:54:32.639868 13774 raft_consensus.cc:2391] T ff0f9cccc8ed43b1a8cd38de0e9d4097 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 2065c332f15a4739899af79f3669c3ba in current term 1: Already voted for candidate 9b057ade5dce45af9f8bf0bedf8b917f in this term.
I20250830 07:54:32.640051 13887 consensus_queue.cc:260] T 7ef98dbbdf5848038a2da6140e126301 P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:32.640602 13887 ts_tablet_manager.cc:1428] T 7ef98dbbdf5848038a2da6140e126301 P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20250830 07:54:32.640836 13887 tablet_bootstrap.cc:492] T 9d00ee83780e4cf780ca92f1504d26b5 P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:54:32.642257 13887 tablet_bootstrap.cc:654] T 9d00ee83780e4cf780ca92f1504d26b5 P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:32.644163 13882 tablet_bootstrap.cc:654] T 4ab63ff59d4e4ec2b7b64d605545a870 P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:32.645356 13219 catalog_manager.cc:4928] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): tablet ab7196ca193348f5b4bb9193b731e04f (table default.Table_690616d54f014a969bb63de44038e18b [id=55f67297d5ac42c280ea932d74e3ad37]) successfully deleted
I20250830 07:54:32.647262 13422 leader_election.cc:304] T ff0f9cccc8ed43b1a8cd38de0e9d4097 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba; no voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:54:32.647590 13954 raft_consensus.cc:2747] T ff0f9cccc8ed43b1a8cd38de0e9d4097 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20250830 07:54:32.653173 13882 tablet_bootstrap.cc:492] T 4ab63ff59d4e4ec2b7b64d605545a870 P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:54:32.653319 13882 ts_tablet_manager.cc:1397] T 4ab63ff59d4e4ec2b7b64d605545a870 P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.015s user 0.002s sys 0.004s
I20250830 07:54:32.653983 13882 raft_consensus.cc:357] T 4ab63ff59d4e4ec2b7b64d605545a870 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:32.654136 13882 raft_consensus.cc:383] T 4ab63ff59d4e4ec2b7b64d605545a870 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:32.654217 13882 raft_consensus.cc:738] T 4ab63ff59d4e4ec2b7b64d605545a870 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:54:32.654436 13882 consensus_queue.cc:260] T 4ab63ff59d4e4ec2b7b64d605545a870 P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:32.654976 13882 ts_tablet_manager.cc:1428] T 4ab63ff59d4e4ec2b7b64d605545a870 P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20250830 07:54:32.655225 13882 tablet_bootstrap.cc:492] T 9d00ee83780e4cf780ca92f1504d26b5 P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:54:32.656627 13882 tablet_bootstrap.cc:654] T 9d00ee83780e4cf780ca92f1504d26b5 P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:32.657665 13954 raft_consensus.cc:491] T f398e12cd9f543738d5163354f8a9d9d P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:32.657881 13954 raft_consensus.cc:513] T f398e12cd9f543738d5163354f8a9d9d P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:32.658100 13887 tablet_bootstrap.cc:492] T 9d00ee83780e4cf780ca92f1504d26b5 P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:54:32.658259 13887 ts_tablet_manager.cc:1397] T 9d00ee83780e4cf780ca92f1504d26b5 P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.017s user 0.000s sys 0.006s
I20250830 07:54:32.658757 13954 leader_election.cc:290] T f398e12cd9f543738d5163354f8a9d9d P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:32.659082 13887 raft_consensus.cc:357] T 9d00ee83780e4cf780ca92f1504d26b5 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:32.659247 13887 raft_consensus.cc:383] T 9d00ee83780e4cf780ca92f1504d26b5 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:32.659324 13887 raft_consensus.cc:738] T 9d00ee83780e4cf780ca92f1504d26b5 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:54:32.659507 13954 raft_consensus.cc:491] T b4ab964a64a64e00a78ffd2b220aef46 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:32.659576 13887 consensus_queue.cc:260] T 9d00ee83780e4cf780ca92f1504d26b5 P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:32.659736 13954 raft_consensus.cc:513] T b4ab964a64a64e00a78ffd2b220aef46 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:32.660246 13887 ts_tablet_manager.cc:1428] T 9d00ee83780e4cf780ca92f1504d26b5 P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20250830 07:54:32.660511 13954 leader_election.cc:290] T b4ab964a64a64e00a78ffd2b220aef46 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:32.660585 13887 tablet_bootstrap.cc:492] T 4ab63ff59d4e4ec2b7b64d605545a870 P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:54:32.661943 13887 tablet_bootstrap.cc:654] T 4ab63ff59d4e4ec2b7b64d605545a870 P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:32.663506 13775 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "b4ab964a64a64e00a78ffd2b220aef46" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:32.663756 13775 raft_consensus.cc:2466] T b4ab964a64a64e00a78ffd2b220aef46 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2065c332f15a4739899af79f3669c3ba in term 0.
I20250830 07:54:32.664165 13774 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f398e12cd9f543738d5163354f8a9d9d" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
W20250830 07:54:32.664960 13423 leader_election.cc:343] T b4ab964a64a64e00a78ffd2b220aef46 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Not found: Tablet not found: b4ab964a64a64e00a78ffd2b220aef46
W20250830 07:54:32.665233 13423 leader_election.cc:343] T f398e12cd9f543738d5163354f8a9d9d P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Not found: Tablet not found: f398e12cd9f543738d5163354f8a9d9d
I20250830 07:54:32.665743 13422 leader_election.cc:304] T b4ab964a64a64e00a78ffd2b220aef46 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:54:32.666057 13882 tablet_bootstrap.cc:492] T 9d00ee83780e4cf780ca92f1504d26b5 P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:54:32.666198 13882 ts_tablet_manager.cc:1397] T 9d00ee83780e4cf780ca92f1504d26b5 P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.011s user 0.002s sys 0.002s
W20250830 07:54:32.666210 13422 leader_election.cc:343] T f398e12cd9f543738d5163354f8a9d9d P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:32.666344 13422 leader_election.cc:304] T f398e12cd9f543738d5163354f8a9d9d P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba; no voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:54:32.666613 13894 raft_consensus.cc:2802] T b4ab964a64a64e00a78ffd2b220aef46 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:54:32.666731 13894 raft_consensus.cc:491] T b4ab964a64a64e00a78ffd2b220aef46 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:54:32.666832 13894 raft_consensus.cc:3058] T b4ab964a64a64e00a78ffd2b220aef46 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:32.666839 13882 raft_consensus.cc:357] T 9d00ee83780e4cf780ca92f1504d26b5 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:32.667026 13882 raft_consensus.cc:383] T 9d00ee83780e4cf780ca92f1504d26b5 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:32.667095 13882 raft_consensus.cc:738] T 9d00ee83780e4cf780ca92f1504d26b5 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:54:32.667342 13882 consensus_queue.cc:260] T 9d00ee83780e4cf780ca92f1504d26b5 P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:32.667874 13882 ts_tablet_manager.cc:1428] T 9d00ee83780e4cf780ca92f1504d26b5 P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20250830 07:54:32.668143 13882 tablet_bootstrap.cc:492] T 0a7c368f47aa41d896f5a3c3c20918c6 P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:54:32.669467 13882 tablet_bootstrap.cc:654] T 0a7c368f47aa41d896f5a3c3c20918c6 P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:32.670440 13894 raft_consensus.cc:513] T b4ab964a64a64e00a78ffd2b220aef46 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:32.671211 13954 raft_consensus.cc:2747] T f398e12cd9f543738d5163354f8a9d9d P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:54:32.673081 13882 tablet_bootstrap.cc:492] T 0a7c368f47aa41d896f5a3c3c20918c6 P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:54:32.673199 13882 ts_tablet_manager.cc:1397] T 0a7c368f47aa41d896f5a3c3c20918c6 P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
W20250830 07:54:32.673568 13423 leader_election.cc:343] T b4ab964a64a64e00a78ffd2b220aef46 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Not found: Tablet not found: b4ab964a64a64e00a78ffd2b220aef46
I20250830 07:54:32.673774 13882 raft_consensus.cc:357] T 0a7c368f47aa41d896f5a3c3c20918c6 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:32.673930 13882 raft_consensus.cc:383] T 0a7c368f47aa41d896f5a3c3c20918c6 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:32.673907 13894 leader_election.cc:290] T b4ab964a64a64e00a78ffd2b220aef46 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 election: Requested vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:32.674015 13882 raft_consensus.cc:738] T 0a7c368f47aa41d896f5a3c3c20918c6 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:54:32.675151 13887 tablet_bootstrap.cc:492] T 4ab63ff59d4e4ec2b7b64d605545a870 P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:54:32.675269 13887 ts_tablet_manager.cc:1397] T 4ab63ff59d4e4ec2b7b64d605545a870 P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.015s user 0.000s sys 0.006s
I20250830 07:54:32.675264 13774 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "b4ab964a64a64e00a78ffd2b220aef46" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f"
I20250830 07:54:32.675508 13774 raft_consensus.cc:3058] T b4ab964a64a64e00a78ffd2b220aef46 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:32.675866 13887 raft_consensus.cc:357] T 4ab63ff59d4e4ec2b7b64d605545a870 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:32.676020 13887 raft_consensus.cc:383] T 4ab63ff59d4e4ec2b7b64d605545a870 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:32.676106 13887 raft_consensus.cc:738] T 4ab63ff59d4e4ec2b7b64d605545a870 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:54:32.676319 13887 consensus_queue.cc:260] T 4ab63ff59d4e4ec2b7b64d605545a870 P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:32.677248 13887 ts_tablet_manager.cc:1428] T 4ab63ff59d4e4ec2b7b64d605545a870 P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20250830 07:54:32.677551 13887 tablet_bootstrap.cc:492] T 0a7c368f47aa41d896f5a3c3c20918c6 P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:54:32.679028 13887 tablet_bootstrap.cc:654] T 0a7c368f47aa41d896f5a3c3c20918c6 P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:32.679785 13882 consensus_queue.cc:260] T 0a7c368f47aa41d896f5a3c3c20918c6 P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:32.680255 13882 ts_tablet_manager.cc:1428] T 0a7c368f47aa41d896f5a3c3c20918c6 P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.007s user 0.001s sys 0.001s
I20250830 07:54:32.680598 13882 tablet_bootstrap.cc:492] T 7ef98dbbdf5848038a2da6140e126301 P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:54:32.681560 13887 tablet_bootstrap.cc:492] T 0a7c368f47aa41d896f5a3c3c20918c6 P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:54:32.681736 13887 ts_tablet_manager.cc:1397] T 0a7c368f47aa41d896f5a3c3c20918c6 P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.003s
I20250830 07:54:32.682144 13882 tablet_bootstrap.cc:654] T 7ef98dbbdf5848038a2da6140e126301 P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:32.682497 13887 raft_consensus.cc:357] T 0a7c368f47aa41d896f5a3c3c20918c6 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:32.682730 13887 raft_consensus.cc:383] T 0a7c368f47aa41d896f5a3c3c20918c6 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:32.682832 13887 raft_consensus.cc:738] T 0a7c368f47aa41d896f5a3c3c20918c6 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:54:32.683173 13887 consensus_queue.cc:260] T 0a7c368f47aa41d896f5a3c3c20918c6 P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:32.683766 13887 ts_tablet_manager.cc:1428] T 0a7c368f47aa41d896f5a3c3c20918c6 P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20250830 07:54:32.684195 13887 tablet_bootstrap.cc:492] T 5ce773ce68f649b1bf51f0dd901cb04f P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:54:32.685851 13774 raft_consensus.cc:2466] T b4ab964a64a64e00a78ffd2b220aef46 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2065c332f15a4739899af79f3669c3ba in term 1.
I20250830 07:54:32.686647 13887 tablet_bootstrap.cc:654] T 5ce773ce68f649b1bf51f0dd901cb04f P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
W20250830 07:54:32.711843 13233 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 2afb1e75cfcc4e1abd265fbadb4170fa consensus state has no leader
I20250830 07:54:32.712244 13233 master_service.cc:948] ReplaceTablet: received request to replace tablet 0a7c368f47aa41d896f5a3c3c20918c6 from {username='slave'} at 127.0.0.1:42126
I20250830 07:54:32.713222 13227 master_service.cc:948] ReplaceTablet: received request to replace tablet 1933d49d319b4bd7b717dda2b83859f3 from {username='slave'} at 127.0.0.1:42126
I20250830 07:54:32.713258 13232 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet 9d00ee83780e4cf780ca92f1504d26b5
I20250830 07:54:32.713816 13232 catalog_manager.cc:6652] ReplaceTablet: tablet 9d00ee83780e4cf780ca92f1504d26b5 deleted and replaced by tablet 91ab8c468c8143b9ae11b839a95a26fd
I20250830 07:54:32.714926 13602 tablet_service.cc:1515] Processing DeleteTablet for tablet 9d00ee83780e4cf780ca92f1504d26b5 with delete_type TABLET_DATA_DELETED (replaced by tablet 91ab8c468c8143b9ae11b839a95a26fd) from {username='slave'} at 127.0.0.1:45306
I20250830 07:54:32.715276 13885 tablet_replica.cc:331] T 9d00ee83780e4cf780ca92f1504d26b5 P 6b5e454d98894637b466ea27f1b647f9: stopping tablet replica
I20250830 07:54:32.715510 13885 raft_consensus.cc:2241] T 9d00ee83780e4cf780ca92f1504d26b5 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250830 07:54:32.715706 13885 raft_consensus.cc:2270] T 9d00ee83780e4cf780ca92f1504d26b5 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250830 07:54:32.716284 13225 catalog_manager.cc:5864] Not sending DeleteTablet requests; no consensus state for tablet 9b2516c61fe64bbb928b39554ef20dad
I20250830 07:54:32.716922 13885 ts_tablet_manager.cc:1905] T 9d00ee83780e4cf780ca92f1504d26b5 P 6b5e454d98894637b466ea27f1b647f9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250830 07:54:32.717566 13747 tablet_service.cc:1515] Processing DeleteTablet for tablet 9d00ee83780e4cf780ca92f1504d26b5 with delete_type TABLET_DATA_DELETED (replaced by tablet 91ab8c468c8143b9ae11b839a95a26fd) from {username='slave'} at 127.0.0.1:45460
W20250830 07:54:32.718578 13219 catalog_manager.cc:4908] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): delete failed for tablet 9d00ee83780e4cf780ca92f1504d26b5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9d00ee83780e4cf780ca92f1504d26b5 already in progress: creating tablet
I20250830 07:54:32.725328 13885 ts_tablet_manager.cc:1918] T 9d00ee83780e4cf780ca92f1504d26b5 P 6b5e454d98894637b466ea27f1b647f9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250830 07:54:32.725556 13885 log.cc:1199] T 9d00ee83780e4cf780ca92f1504d26b5 P 6b5e454d98894637b466ea27f1b647f9: Deleting WAL directory at /tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/ts-1/wal/wals/9d00ee83780e4cf780ca92f1504d26b5
I20250830 07:54:32.726044 13885 ts_tablet_manager.cc:1939] T 9d00ee83780e4cf780ca92f1504d26b5 P 6b5e454d98894637b466ea27f1b647f9: Deleting consensus metadata
I20250830 07:54:32.726408 13894 raft_consensus.cc:491] T 9d00ee83780e4cf780ca92f1504d26b5 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:32.726604 13894 raft_consensus.cc:513] T 9d00ee83780e4cf780ca92f1504d26b5 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:32.727586 13894 leader_election.cc:290] T 9d00ee83780e4cf780ca92f1504d26b5 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:32.728716 13629 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "9d00ee83780e4cf780ca92f1504d26b5" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
W20250830 07:54:32.729377 13423 leader_election.cc:343] T 9d00ee83780e4cf780ca92f1504d26b5 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: Tablet not RUNNING: STOPPED
I20250830 07:54:32.730590 13220 catalog_manager.cc:4928] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): tablet 9d00ee83780e4cf780ca92f1504d26b5 (table default.Table_690616d54f014a969bb63de44038e18b [id=55f67297d5ac42c280ea932d74e3ad37]) successfully deleted
I20250830 07:54:32.733698 13463 tablet_service.cc:1515] Processing DeleteTablet for tablet 9d00ee83780e4cf780ca92f1504d26b5 with delete_type TABLET_DATA_DELETED (replaced by tablet 91ab8c468c8143b9ae11b839a95a26fd) from {username='slave'} at 127.0.0.1:37956
I20250830 07:54:32.733987 13883 tablet_replica.cc:331] T 9d00ee83780e4cf780ca92f1504d26b5 P 2065c332f15a4739899af79f3669c3ba: stopping tablet replica
I20250830 07:54:32.734230 13883 raft_consensus.cc:2241] T 9d00ee83780e4cf780ca92f1504d26b5 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Raft consensus shutting down.
I20250830 07:54:32.734450 13883 raft_consensus.cc:2270] T 9d00ee83780e4cf780ca92f1504d26b5 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Raft consensus is shut down!
I20250830 07:54:32.735360 13883 ts_tablet_manager.cc:1905] T 9d00ee83780e4cf780ca92f1504d26b5 P 2065c332f15a4739899af79f3669c3ba: Deleting tablet data with delete state TABLET_DATA_DELETED
W20250830 07:54:32.740583 13218 catalog_manager.cc:4726] Async tablet task AlterTable RPC for tablet 29d492735cd14bb6b4a2a9a3929f62f3 (table default.Table_4619d7810c174ac08026c2279c246788 [id=b99c31c3fed04fe49f754545ab66b02c], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 29d492735cd14bb6b4a2a9a3929f62f3 consensus state has no leader
I20250830 07:54:32.744961 13774 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "9d00ee83780e4cf780ca92f1504d26b5" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:32.745795 13231 catalog_manager.cc:5674] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325) does not have the latest schema for tablet 8f4567f30cc34f288463e4a92bd3edd5 (table default.Table_1bad683bf46c49aa8c24cd18c2c2e990 [id=3c052a58caaa412f8d9d70063dcd97c0]). Expected version 1 got 0
W20250830 07:54:32.746420 13230 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 8f4567f30cc34f288463e4a92bd3edd5 consensus state has no leader
I20250830 07:54:32.749027 13422 leader_election.cc:304] T b4ab964a64a64e00a78ffd2b220aef46 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:54:32.749600 13894 raft_consensus.cc:2802] T b4ab964a64a64e00a78ffd2b220aef46 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election won for term 1
I20250830 07:54:32.749779 13894 raft_consensus.cc:695] T b4ab964a64a64e00a78ffd2b220aef46 P 2065c332f15a4739899af79f3669c3ba [term 1 LEADER]: Becoming Leader. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Running, Role: LEADER
I20250830 07:54:32.750099 13894 consensus_queue.cc:237] T b4ab964a64a64e00a78ffd2b220aef46 P 2065c332f15a4739899af79f3669c3ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
W20250830 07:54:32.756024 13422 leader_election.cc:343] T 9d00ee83780e4cf780ca92f1504d26b5 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:32.756295 13422 leader_election.cc:304] T 9d00ee83780e4cf780ca92f1504d26b5 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba; no voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f
W20250830 07:54:32.756561 13422 raft_consensus.cc:2684] T 9d00ee83780e4cf780ca92f1504d26b5 P 2065c332f15a4739899af79f3669c3ba: unable to run election callback: Service unavailable: Thread pool token was shut down
I20250830 07:54:32.761747 13883 ts_tablet_manager.cc:1918] T 9d00ee83780e4cf780ca92f1504d26b5 P 2065c332f15a4739899af79f3669c3ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250830 07:54:32.761965 13883 log.cc:1199] T 9d00ee83780e4cf780ca92f1504d26b5 P 2065c332f15a4739899af79f3669c3ba: Deleting WAL directory at /tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/ts-0/wal/wals/9d00ee83780e4cf780ca92f1504d26b5
I20250830 07:54:32.762650 13883 ts_tablet_manager.cc:1939] T 9d00ee83780e4cf780ca92f1504d26b5 P 2065c332f15a4739899af79f3669c3ba: Deleting consensus metadata
I20250830 07:54:32.764284 13218 catalog_manager.cc:4928] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): tablet 9d00ee83780e4cf780ca92f1504d26b5 (table default.Table_690616d54f014a969bb63de44038e18b [id=55f67297d5ac42c280ea932d74e3ad37]) successfully deleted
I20250830 07:54:32.781319 13232 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_ca148790caf146b0b02b54ae9f70c339" } modify_external_catalogs: true
I20250830 07:54:32.781535 13232 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_ca148790caf146b0b02b54ae9f70c339" } modify_external_catalogs: true
I20250830 07:54:32.783131 13230 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_2bad9e8dcdba4b8f89ab6ef5686d1270"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:32.783851 13230 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2bad9e8dcdba4b8f89ab6ef5686d1270 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:32.785719 13225 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_ad824ae7601a4c6b9e756946853e09c7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:32.786368 13225 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ad824ae7601a4c6b9e756946853e09c7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:32.801635 13229 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_d2ac5bc3c0c246c4bb6c797de6efedae" } modify_external_catalogs: true
I20250830 07:54:32.801859 13229 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_d2ac5bc3c0c246c4bb6c797de6efedae" } modify_external_catalogs: true
I20250830 07:54:32.829092 13228 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_e5d449720821486c8b3a39fd7f7661f4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:32.829748 13228 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e5d449720821486c8b3a39fd7f7661f4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:32.831195 13233 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet 0a7c368f47aa41d896f5a3c3c20918c6
I20250830 07:54:32.831804 13233 catalog_manager.cc:6652] ReplaceTablet: tablet 0a7c368f47aa41d896f5a3c3c20918c6 deleted and replaced by tablet 27da527d9fe045ae8c17f193d034f5ac
I20250830 07:54:32.832193 13233 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_2d4c0acd17bb40aaa870225e92053ae8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:32.832813 13233 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2d4c0acd17bb40aaa870225e92053ae8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:32.834183 13232 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet e134ab64aa1b4ce89e295b43cbc3fffb
I20250830 07:54:32.834944 13232 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_33e47ed000c24372ac8f1b89c5fc38cb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:32.835541 13232 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_33e47ed000c24372ac8f1b89c5fc38cb in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:32.837134 13230 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_4619d7810c174ac08026c2279c246788" } modify_external_catalogs: true
I20250830 07:54:32.837345 13230 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_4619d7810c174ac08026c2279c246788" } modify_external_catalogs: true
I20250830 07:54:32.838904 13227 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet 1933d49d319b4bd7b717dda2b83859f3
I20250830 07:54:32.839401 13227 catalog_manager.cc:6652] ReplaceTablet: tablet 1933d49d319b4bd7b717dda2b83859f3 deleted and replaced by tablet d4e35395930f4c37b34649da5718aa1f
I20250830 07:54:32.839776 13227 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_b272b07ca0614cafb8c14f4e2132d255"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:32.840256 13227 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b272b07ca0614cafb8c14f4e2132d255 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:32.841862 13229 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet 4c2c85732d454cd98efc2646af9450ed
I20250830 07:54:32.842615 13229 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_2e5a498fef4b463a8870af0d4cf30509" } new_table_name: "default.Table_08edc8805a67477588ae6df3db03fcff" modify_external_catalogs: true
I20250830 07:54:32.846285 13606 tablet_service.cc:1515] Processing DeleteTablet for tablet e134ab64aa1b4ce89e295b43cbc3fffb with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:32 UTC) from {username='slave'} at 127.0.0.1:45306
I20250830 07:54:32.846483 13603 tablet_service.cc:1515] Processing DeleteTablet for tablet 4c2c85732d454cd98efc2646af9450ed with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:32 UTC) from {username='slave'} at 127.0.0.1:45306
I20250830 07:54:32.846614 13604 tablet_service.cc:1515] Processing DeleteTablet for tablet 1933d49d319b4bd7b717dda2b83859f3 with delete_type TABLET_DATA_DELETED (replaced by tablet d4e35395930f4c37b34649da5718aa1f) from {username='slave'} at 127.0.0.1:45306
I20250830 07:54:32.847193 13602 tablet_service.cc:1515] Processing DeleteTablet for tablet 0a7c368f47aa41d896f5a3c3c20918c6 with delete_type TABLET_DATA_DELETED (replaced by tablet 27da527d9fe045ae8c17f193d034f5ac) from {username='slave'} at 127.0.0.1:45306
I20250830 07:54:32.847437 13885 tablet_replica.cc:331] T 0a7c368f47aa41d896f5a3c3c20918c6 P 6b5e454d98894637b466ea27f1b647f9: stopping tablet replica
I20250830 07:54:32.847484 13747 tablet_service.cc:1515] Processing DeleteTablet for tablet 0a7c368f47aa41d896f5a3c3c20918c6 with delete_type TABLET_DATA_DELETED (replaced by tablet 27da527d9fe045ae8c17f193d034f5ac) from {username='slave'} at 127.0.0.1:45460
I20250830 07:54:32.847723 13885 raft_consensus.cc:2241] T 0a7c368f47aa41d896f5a3c3c20918c6 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250830 07:54:32.847838 13884 tablet_replica.cc:331] T 0a7c368f47aa41d896f5a3c3c20918c6 P 9b057ade5dce45af9f8bf0bedf8b917f: stopping tablet replica
I20250830 07:54:32.847913 13885 raft_consensus.cc:2270] T 0a7c368f47aa41d896f5a3c3c20918c6 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250830 07:54:32.848075 13884 raft_consensus.cc:2241] T 0a7c368f47aa41d896f5a3c3c20918c6 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Raft consensus shutting down.
I20250830 07:54:32.848259 13753 tablet_service.cc:1515] Processing DeleteTablet for tablet e134ab64aa1b4ce89e295b43cbc3fffb with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:32 UTC) from {username='slave'} at 127.0.0.1:45460
I20250830 07:54:32.848322 13884 raft_consensus.cc:2270] T 0a7c368f47aa41d896f5a3c3c20918c6 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Raft consensus is shut down!
I20250830 07:54:32.848531 13755 tablet_service.cc:1515] Processing DeleteTablet for tablet 1933d49d319b4bd7b717dda2b83859f3 with delete_type TABLET_DATA_DELETED (replaced by tablet d4e35395930f4c37b34649da5718aa1f) from {username='slave'} at 127.0.0.1:45460
I20250830 07:54:32.848753 13749 tablet_service.cc:1515] Processing DeleteTablet for tablet 4c2c85732d454cd98efc2646af9450ed with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:32 UTC) from {username='slave'} at 127.0.0.1:45460
I20250830 07:54:32.849272 13225 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_83fc86674acf4abca8bfc1fc039656c2" } modify_external_catalogs: true
I20250830 07:54:32.849485 13225 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_83fc86674acf4abca8bfc1fc039656c2" } modify_external_catalogs: true
I20250830 07:54:32.850304 13885 ts_tablet_manager.cc:1905] T 0a7c368f47aa41d896f5a3c3c20918c6 P 6b5e454d98894637b466ea27f1b647f9: Deleting tablet data with delete state TABLET_DATA_DELETED
W20250830 07:54:32.853093 13220 catalog_manager.cc:4908] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet e134ab64aa1b4ce89e295b43cbc3fffb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e134ab64aa1b4ce89e295b43cbc3fffb already in progress: creating tablet
W20250830 07:54:32.853421 13220 catalog_manager.cc:4908] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet 4c2c85732d454cd98efc2646af9450ed because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4c2c85732d454cd98efc2646af9450ed already in progress: creating tablet
W20250830 07:54:32.853638 13220 catalog_manager.cc:4908] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet 1933d49d319b4bd7b717dda2b83859f3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1933d49d319b4bd7b717dda2b83859f3 already in progress: creating tablet
I20250830 07:54:32.854745 13884 ts_tablet_manager.cc:1905] T 0a7c368f47aa41d896f5a3c3c20918c6 P 9b057ade5dce45af9f8bf0bedf8b917f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250830 07:54:32.856139 13885 ts_tablet_manager.cc:1918] T 0a7c368f47aa41d896f5a3c3c20918c6 P 6b5e454d98894637b466ea27f1b647f9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250830 07:54:32.856246 13885 log.cc:1199] T 0a7c368f47aa41d896f5a3c3c20918c6 P 6b5e454d98894637b466ea27f1b647f9: Deleting WAL directory at /tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/ts-1/wal/wals/0a7c368f47aa41d896f5a3c3c20918c6
I20250830 07:54:32.856544 13885 ts_tablet_manager.cc:1939] T 0a7c368f47aa41d896f5a3c3c20918c6 P 6b5e454d98894637b466ea27f1b647f9: Deleting consensus metadata
I20250830 07:54:32.857344 13220 catalog_manager.cc:4928] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): tablet 0a7c368f47aa41d896f5a3c3c20918c6 (table default.Table_7267421303d148a581bd56208d51fc51 [id=6285b1fe4aa14eef9358b69d114ef2ef]) successfully deleted
I20250830 07:54:32.860613 13463 tablet_service.cc:1515] Processing DeleteTablet for tablet 0a7c368f47aa41d896f5a3c3c20918c6 with delete_type TABLET_DATA_DELETED (replaced by tablet 27da527d9fe045ae8c17f193d034f5ac) from {username='slave'} at 127.0.0.1:37956
I20250830 07:54:32.861102 13463 tablet_service.cc:1515] Processing DeleteTablet for tablet e134ab64aa1b4ce89e295b43cbc3fffb with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:32 UTC) from {username='slave'} at 127.0.0.1:37956
I20250830 07:54:32.861558 13463 tablet_service.cc:1515] Processing DeleteTablet for tablet 1933d49d319b4bd7b717dda2b83859f3 with delete_type TABLET_DATA_DELETED (replaced by tablet d4e35395930f4c37b34649da5718aa1f) from {username='slave'} at 127.0.0.1:37956
I20250830 07:54:32.861948 13463 tablet_service.cc:1515] Processing DeleteTablet for tablet 4c2c85732d454cd98efc2646af9450ed with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:32 UTC) from {username='slave'} at 127.0.0.1:37956
I20250830 07:54:32.863862 13884 ts_tablet_manager.cc:1918] T 0a7c368f47aa41d896f5a3c3c20918c6 P 9b057ade5dce45af9f8bf0bedf8b917f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250830 07:54:32.864166 13883 tablet_replica.cc:331] T 0a7c368f47aa41d896f5a3c3c20918c6 P 2065c332f15a4739899af79f3669c3ba: stopping tablet replica
I20250830 07:54:32.864727 13883 raft_consensus.cc:2241] T 0a7c368f47aa41d896f5a3c3c20918c6 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Raft consensus shutting down.
I20250830 07:54:32.864980 13883 raft_consensus.cc:2270] T 0a7c368f47aa41d896f5a3c3c20918c6 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Raft consensus is shut down!
I20250830 07:54:32.865259 13882 tablet_bootstrap.cc:492] T 7ef98dbbdf5848038a2da6140e126301 P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:54:32.865430 13882 ts_tablet_manager.cc:1397] T 7ef98dbbdf5848038a2da6140e126301 P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.185s user 0.053s sys 0.082s
I20250830 07:54:32.865939 13883 ts_tablet_manager.cc:1905] T 0a7c368f47aa41d896f5a3c3c20918c6 P 2065c332f15a4739899af79f3669c3ba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250830 07:54:32.865981 13886 tablet_bootstrap.cc:492] T f398e12cd9f543738d5163354f8a9d9d P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:54:32.866180 13886 ts_tablet_manager.cc:1397] T f398e12cd9f543738d5163354f8a9d9d P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.251s user 0.086s sys 0.138s
I20250830 07:54:32.866192 13882 raft_consensus.cc:357] T 7ef98dbbdf5848038a2da6140e126301 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:32.866385 13882 raft_consensus.cc:383] T 7ef98dbbdf5848038a2da6140e126301 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:32.866457 13882 raft_consensus.cc:738] T 7ef98dbbdf5848038a2da6140e126301 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:54:32.866324 13884 log.cc:1199] T 0a7c368f47aa41d896f5a3c3c20918c6 P 9b057ade5dce45af9f8bf0bedf8b917f: Deleting WAL directory at /tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/ts-2/wal/wals/0a7c368f47aa41d896f5a3c3c20918c6
I20250830 07:54:32.866879 13884 ts_tablet_manager.cc:1939] T 0a7c368f47aa41d896f5a3c3c20918c6 P 9b057ade5dce45af9f8bf0bedf8b917f: Deleting consensus metadata
I20250830 07:54:32.867297 13887 tablet_bootstrap.cc:492] T 5ce773ce68f649b1bf51f0dd901cb04f P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:54:32.867432 13887 ts_tablet_manager.cc:1397] T 5ce773ce68f649b1bf51f0dd901cb04f P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.183s user 0.047s sys 0.096s
I20250830 07:54:32.866834 13886 raft_consensus.cc:357] T f398e12cd9f543738d5163354f8a9d9d P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:32.868223 13887 raft_consensus.cc:357] T 5ce773ce68f649b1bf51f0dd901cb04f P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:32.868326 13886 raft_consensus.cc:383] T f398e12cd9f543738d5163354f8a9d9d P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:32.868414 13886 raft_consensus.cc:738] T f398e12cd9f543738d5163354f8a9d9d P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:54:32.868417 13887 raft_consensus.cc:383] T 5ce773ce68f649b1bf51f0dd901cb04f P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:32.868511 13887 raft_consensus.cc:738] T 5ce773ce68f649b1bf51f0dd901cb04f P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:54:32.868559 13219 catalog_manager.cc:4928] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): tablet 0a7c368f47aa41d896f5a3c3c20918c6 (table default.Table_7267421303d148a581bd56208d51fc51 [id=6285b1fe4aa14eef9358b69d114ef2ef]) successfully deleted
I20250830 07:54:32.868640 13886 consensus_queue.cc:260] T f398e12cd9f543738d5163354f8a9d9d P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:32.869135 13886 ts_tablet_manager.cc:1428] T f398e12cd9f543738d5163354f8a9d9d P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20250830 07:54:32.868777 13887 consensus_queue.cc:260] T 5ce773ce68f649b1bf51f0dd901cb04f P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:32.871461 13886 tablet_bootstrap.cc:492] T 7ef98dbbdf5848038a2da6140e126301 P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
W20250830 07:54:32.875263 13219 catalog_manager.cc:4908] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): delete failed for tablet e134ab64aa1b4ce89e295b43cbc3fffb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e134ab64aa1b4ce89e295b43cbc3fffb already in progress: creating tablet
W20250830 07:54:32.875684 13219 catalog_manager.cc:4908] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): delete failed for tablet 1933d49d319b4bd7b717dda2b83859f3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1933d49d319b4bd7b717dda2b83859f3 already in progress: creating tablet
W20250830 07:54:32.875939 13219 catalog_manager.cc:4908] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): delete failed for tablet 4c2c85732d454cd98efc2646af9450ed because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4c2c85732d454cd98efc2646af9450ed already in progress: creating tablet
I20250830 07:54:32.876268 13886 tablet_bootstrap.cc:654] T 7ef98dbbdf5848038a2da6140e126301 P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:32.876574 13887 ts_tablet_manager.cc:1428] T 5ce773ce68f649b1bf51f0dd901cb04f P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.009s user 0.000s sys 0.002s
I20250830 07:54:32.877254 13228 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_737f5bb11c3f4b8e8d26b08fd43afa45" } new_table_name: "default.Table_586f78d6113c48a3ab0fdbcba030e199" modify_external_catalogs: true
I20250830 07:54:32.880791 13230 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet 29d492735cd14bb6b4a2a9a3929f62f3
I20250830 07:54:32.881668 13230 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_3d12ac4bedcf433aa345dda9066deb22" } new_table_name: "default.Table_e3c92a53cb994620a7bf2072b4aefa05" modify_external_catalogs: true
I20250830 07:54:32.883252 13463 tablet_service.cc:1515] Processing DeleteTablet for tablet 29d492735cd14bb6b4a2a9a3929f62f3 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:32 UTC) from {username='slave'} at 127.0.0.1:37956
I20250830 07:54:32.882875 13887 tablet_bootstrap.cc:492] T ccc90f6c867147cc9fe93c9ffa2e4802 P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:54:32.883491 13225 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet d3b47314f7cd4e969d973c0a340137f1
I20250830 07:54:32.883910 13602 tablet_service.cc:1515] Processing DeleteTablet for tablet 29d492735cd14bb6b4a2a9a3929f62f3 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:32 UTC) from {username='slave'} at 127.0.0.1:45306
I20250830 07:54:32.884049 13225 master_service.cc:948] ReplaceTablet: received request to replace tablet 1933d49d319b4bd7b717dda2b83859f3 from {username='slave'} at 127.0.0.1:42126
I20250830 07:54:32.884688 13225 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_10c5ebac55c2421b969807cc555eaba8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:32.884948 13220 catalog_manager.cc:4908] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet 29d492735cd14bb6b4a2a9a3929f62f3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 29d492735cd14bb6b4a2a9a3929f62f3 already in progress: creating tablet
I20250830 07:54:32.885085 13887 tablet_bootstrap.cc:654] T ccc90f6c867147cc9fe93c9ffa2e4802 P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
W20250830 07:54:32.885221 13225 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_10c5ebac55c2421b969807cc555eaba8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:32.885231 13602 tablet_service.cc:1515] Processing DeleteTablet for tablet d3b47314f7cd4e969d973c0a340137f1 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:32 UTC) from {username='slave'} at 127.0.0.1:45306
I20250830 07:54:32.886421 13463 tablet_service.cc:1515] Processing DeleteTablet for tablet d3b47314f7cd4e969d973c0a340137f1 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:32 UTC) from {username='slave'} at 127.0.0.1:37956
W20250830 07:54:32.886595 13220 catalog_manager.cc:4908] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet d3b47314f7cd4e969d973c0a340137f1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d3b47314f7cd4e969d973c0a340137f1 already in progress: creating tablet
W20250830 07:54:32.887167 13229 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 9696d8531a174585b8fd83a2391c02f7 has no consensus state
I20250830 07:54:32.887101 13882 consensus_queue.cc:260] T 7ef98dbbdf5848038a2da6140e126301 P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:32.887442 13229 master_service.cc:948] ReplaceTablet: received request to replace tablet bcdac588f7c24d9d8572949e09b80a23 from {username='slave'} at 127.0.0.1:42126
I20250830 07:54:32.888494 13124 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskbivBUj/build/asan/bin/kudu
/tmp/dist-test-taskbivBUj/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.209.60:43889
--webserver_interface=127.12.209.60
--webserver_port=32915
--builtin_ntp_servers=127.12.209.20:33943
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.209.62:39725,127.12.209.61:44241,127.12.209.60:43889
--hive_metastore_notification_log_poll_period_seconds=1
--enable_metadata_cleanup_for_deleted_tables_and_tablets=true
--catalog_manager_bg_task_wait_ms=10
--metadata_for_deleted_table_and_tablet_reserved_secs=0
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
I20250830 07:54:32.888685 13882 ts_tablet_manager.cc:1428] T 7ef98dbbdf5848038a2da6140e126301 P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.023s user 0.001s sys 0.001s
I20250830 07:54:32.889006 13882 tablet_bootstrap.cc:492] T 5ce773ce68f649b1bf51f0dd901cb04f P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:54:32.890234 13749 tablet_service.cc:1515] Processing DeleteTablet for tablet 29d492735cd14bb6b4a2a9a3929f62f3 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:32 UTC) from {username='slave'} at 127.0.0.1:45460
I20250830 07:54:32.890470 13755 tablet_service.cc:1515] Processing DeleteTablet for tablet d3b47314f7cd4e969d973c0a340137f1 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:32 UTC) from {username='slave'} at 127.0.0.1:45460
I20250830 07:54:32.890591 13882 tablet_bootstrap.cc:654] T 5ce773ce68f649b1bf51f0dd901cb04f P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
W20250830 07:54:32.892181 13219 catalog_manager.cc:4908] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): delete failed for tablet 29d492735cd14bb6b4a2a9a3929f62f3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 29d492735cd14bb6b4a2a9a3929f62f3 already in progress: creating tablet
W20250830 07:54:32.892827 13219 catalog_manager.cc:4908] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): delete failed for tablet d3b47314f7cd4e969d973c0a340137f1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d3b47314f7cd4e969d973c0a340137f1 already in progress: creating tablet
W20250830 07:54:32.896646 13228 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ccc90f6c867147cc9fe93c9ffa2e4802 consensus state has no leader
I20250830 07:54:32.897053 13883 ts_tablet_manager.cc:1918] T 0a7c368f47aa41d896f5a3c3c20918c6 P 2065c332f15a4739899af79f3669c3ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250830 07:54:32.897194 13883 log.cc:1199] T 0a7c368f47aa41d896f5a3c3c20918c6 P 2065c332f15a4739899af79f3669c3ba: Deleting WAL directory at /tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/ts-0/wal/wals/0a7c368f47aa41d896f5a3c3c20918c6
I20250830 07:54:32.897531 13883 ts_tablet_manager.cc:1939] T 0a7c368f47aa41d896f5a3c3c20918c6 P 2065c332f15a4739899af79f3669c3ba: Deleting consensus metadata
I20250830 07:54:32.898607 13218 catalog_manager.cc:4928] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): tablet 0a7c368f47aa41d896f5a3c3c20918c6 (table default.Table_7267421303d148a581bd56208d51fc51 [id=6285b1fe4aa14eef9358b69d114ef2ef]) successfully deleted
I20250830 07:54:32.899519 13882 tablet_bootstrap.cc:492] T 5ce773ce68f649b1bf51f0dd901cb04f P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:54:32.899668 13882 ts_tablet_manager.cc:1397] T 5ce773ce68f649b1bf51f0dd901cb04f P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.011s user 0.000s sys 0.004s
I20250830 07:54:32.900523 13882 raft_consensus.cc:357] T 5ce773ce68f649b1bf51f0dd901cb04f P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:32.900730 13882 raft_consensus.cc:383] T 5ce773ce68f649b1bf51f0dd901cb04f P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:32.900841 13882 raft_consensus.cc:738] T 5ce773ce68f649b1bf51f0dd901cb04f P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
W20250830 07:54:32.902881 13218 catalog_manager.cc:4908] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): delete failed for tablet e134ab64aa1b4ce89e295b43cbc3fffb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e134ab64aa1b4ce89e295b43cbc3fffb already in progress: creating tablet
I20250830 07:54:32.903167 13887 tablet_bootstrap.cc:492] T ccc90f6c867147cc9fe93c9ffa2e4802 P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:54:32.903348 13887 ts_tablet_manager.cc:1397] T ccc90f6c867147cc9fe93c9ffa2e4802 P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.021s user 0.003s sys 0.003s
W20250830 07:54:32.904062 13218 catalog_manager.cc:4908] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): delete failed for tablet 1933d49d319b4bd7b717dda2b83859f3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1933d49d319b4bd7b717dda2b83859f3 already in progress: creating tablet
I20250830 07:54:32.904125 13887 raft_consensus.cc:357] T ccc90f6c867147cc9fe93c9ffa2e4802 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:32.904316 13887 raft_consensus.cc:383] T ccc90f6c867147cc9fe93c9ffa2e4802 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:32.904403 13887 raft_consensus.cc:738] T ccc90f6c867147cc9fe93c9ffa2e4802 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:54:32.904682 13887 consensus_queue.cc:260] T ccc90f6c867147cc9fe93c9ffa2e4802 P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
W20250830 07:54:32.905129 13218 catalog_manager.cc:4908] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): delete failed for tablet 4c2c85732d454cd98efc2646af9450ed because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4c2c85732d454cd98efc2646af9450ed already in progress: creating tablet
I20250830 07:54:32.906481 13229 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet bcdac588f7c24d9d8572949e09b80a23
I20250830 07:54:32.906985 13229 catalog_manager.cc:6652] ReplaceTablet: tablet bcdac588f7c24d9d8572949e09b80a23 deleted and replaced by tablet cada6410e2884c508bb7dd38bea438ae
W20250830 07:54:32.907864 13230 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet c9a8f144d50c4d3d81fbf43ce29a2ad2 consensus state has no leader
I20250830 07:54:32.908382 13602 tablet_service.cc:1515] Processing DeleteTablet for tablet bcdac588f7c24d9d8572949e09b80a23 with delete_type TABLET_DATA_DELETED (replaced by tablet cada6410e2884c508bb7dd38bea438ae) from {username='slave'} at 127.0.0.1:45306
I20250830 07:54:32.910678 13755 tablet_service.cc:1515] Processing DeleteTablet for tablet bcdac588f7c24d9d8572949e09b80a23 with delete_type TABLET_DATA_DELETED (replaced by tablet cada6410e2884c508bb7dd38bea438ae) from {username='slave'} at 127.0.0.1:45460
I20250830 07:54:32.911257 13886 tablet_bootstrap.cc:492] T 7ef98dbbdf5848038a2da6140e126301 P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:54:32.911468 13886 ts_tablet_manager.cc:1397] T 7ef98dbbdf5848038a2da6140e126301 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.040s user 0.004s sys 0.002s
W20250830 07:54:32.911763 13218 catalog_manager.cc:4908] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): delete failed for tablet 29d492735cd14bb6b4a2a9a3929f62f3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 29d492735cd14bb6b4a2a9a3929f62f3 already in progress: creating tablet
W20250830 07:54:32.912042 13218 catalog_manager.cc:4908] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): delete failed for tablet d3b47314f7cd4e969d973c0a340137f1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d3b47314f7cd4e969d973c0a340137f1 already in progress: creating tablet
W20250830 07:54:32.912076 13220 catalog_manager.cc:4908] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet bcdac588f7c24d9d8572949e09b80a23 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bcdac588f7c24d9d8572949e09b80a23 already in progress: creating tablet
I20250830 07:54:32.912287 13463 tablet_service.cc:1515] Processing DeleteTablet for tablet bcdac588f7c24d9d8572949e09b80a23 with delete_type TABLET_DATA_DELETED (replaced by tablet cada6410e2884c508bb7dd38bea438ae) from {username='slave'} at 127.0.0.1:37956
I20250830 07:54:32.913007 13887 ts_tablet_manager.cc:1428] T ccc90f6c867147cc9fe93c9ffa2e4802 P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.010s user 0.002s sys 0.000s
I20250830 07:54:32.913028 13886 raft_consensus.cc:357] T 7ef98dbbdf5848038a2da6140e126301 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
W20250830 07:54:32.913157 13219 catalog_manager.cc:4908] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): delete failed for tablet bcdac588f7c24d9d8572949e09b80a23 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bcdac588f7c24d9d8572949e09b80a23 already in progress: creating tablet
I20250830 07:54:32.913343 13886 raft_consensus.cc:383] T 7ef98dbbdf5848038a2da6140e126301 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:32.913493 13886 raft_consensus.cc:738] T 7ef98dbbdf5848038a2da6140e126301 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:54:32.913784 13886 consensus_queue.cc:260] T 7ef98dbbdf5848038a2da6140e126301 P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:32.915655 13886 ts_tablet_manager.cc:1428] T 7ef98dbbdf5848038a2da6140e126301 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20250830 07:54:32.917455 13886 tablet_bootstrap.cc:492] T 9d00ee83780e4cf780ca92f1504d26b5 P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:54:32.919835 13886 tablet_bootstrap.cc:654] T 9d00ee83780e4cf780ca92f1504d26b5 P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:32.920682 13225 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_6e51d6d3fc4647cdaae81d6337a6b42a" } new_table_name: "default.Table_fd3757ba203b43c79e3fa0b6f899fb90" modify_external_catalogs: true
I20250830 07:54:32.921778 13887 tablet_bootstrap.cc:492] T c12cf30cc2aa4e12a20b9492af08a6f8 P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:54:32.921958 13230 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_6926264c97ae4af4a25f0bffa385688f" } modify_external_catalogs: true
I20250830 07:54:32.922104 13230 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_6926264c97ae4af4a25f0bffa385688f" } modify_external_catalogs: true
I20250830 07:54:32.924322 13229 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_10f15bfc3b994681be0b939c3ae9d19d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:32.924896 13229 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_10f15bfc3b994681be0b939c3ae9d19d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:32.925333 13882 consensus_queue.cc:260] T 5ce773ce68f649b1bf51f0dd901cb04f P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:32.926692 13228 master_service.cc:948] ReplaceTablet: received request to replace tablet 2afb1e75cfcc4e1abd265fbadb4170fa from {username='slave'} at 127.0.0.1:42126
W20250830 07:54:32.927098 13218 catalog_manager.cc:4908] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): delete failed for tablet bcdac588f7c24d9d8572949e09b80a23 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bcdac588f7c24d9d8572949e09b80a23 already in progress: creating tablet
I20250830 07:54:32.927711 13887 tablet_bootstrap.cc:654] T c12cf30cc2aa4e12a20b9492af08a6f8 P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:32.928412 13882 ts_tablet_manager.cc:1428] T 5ce773ce68f649b1bf51f0dd901cb04f P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.029s user 0.002s sys 0.001s
I20250830 07:54:32.929531 13882 tablet_bootstrap.cc:492] T ccc90f6c867147cc9fe93c9ffa2e4802 P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:54:32.935173 13882 tablet_bootstrap.cc:654] T ccc90f6c867147cc9fe93c9ffa2e4802 P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
W20250830 07:54:32.939014 13225 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 62cf192967d94ecf954d3e965a4d9c9b consensus state has no leader
I20250830 07:54:32.939610 13230 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet c82ac0102b4442449073e44d8a3d9065
I20250830 07:54:32.942137 13463 tablet_service.cc:1515] Processing DeleteTablet for tablet c82ac0102b4442449073e44d8a3d9065 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:32 UTC) from {username='slave'} at 127.0.0.1:37956
I20250830 07:54:32.942401 13755 tablet_service.cc:1515] Processing DeleteTablet for tablet c82ac0102b4442449073e44d8a3d9065 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:32 UTC) from {username='slave'} at 127.0.0.1:45460
I20250830 07:54:32.942567 13602 tablet_service.cc:1515] Processing DeleteTablet for tablet c82ac0102b4442449073e44d8a3d9065 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:32 UTC) from {username='slave'} at 127.0.0.1:45306
W20250830 07:54:32.943379 13218 catalog_manager.cc:4908] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): delete failed for tablet c82ac0102b4442449073e44d8a3d9065 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c82ac0102b4442449073e44d8a3d9065 already in progress: creating tablet
W20250830 07:54:32.943851 13219 catalog_manager.cc:4908] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): delete failed for tablet c82ac0102b4442449073e44d8a3d9065 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c82ac0102b4442449073e44d8a3d9065 already in progress: creating tablet
W20250830 07:54:32.943851 13220 catalog_manager.cc:4908] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet c82ac0102b4442449073e44d8a3d9065 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c82ac0102b4442449073e44d8a3d9065 already in progress: creating tablet
I20250830 07:54:32.945098 13882 tablet_bootstrap.cc:492] T ccc90f6c867147cc9fe93c9ffa2e4802 P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:54:32.945271 13882 ts_tablet_manager.cc:1397] T ccc90f6c867147cc9fe93c9ffa2e4802 P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.016s user 0.000s sys 0.008s
I20250830 07:54:32.946462 13882 raft_consensus.cc:357] T ccc90f6c867147cc9fe93c9ffa2e4802 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:32.946692 13882 raft_consensus.cc:383] T ccc90f6c867147cc9fe93c9ffa2e4802 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:32.946776 13882 raft_consensus.cc:738] T ccc90f6c867147cc9fe93c9ffa2e4802 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:54:32.946810 13774 raft_consensus.cc:1273] T 8f4567f30cc34f288463e4a92bd3edd5 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Refusing update from remote peer 2065c332f15a4739899af79f3669c3ba: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250830 07:54:32.947059 13629 raft_consensus.cc:1273] T 8f4567f30cc34f288463e4a92bd3edd5 P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Refusing update from remote peer 2065c332f15a4739899af79f3669c3ba: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250830 07:54:32.947695 13894 consensus_queue.cc:1035] T 8f4567f30cc34f288463e4a92bd3edd5 P 2065c332f15a4739899af79f3669c3ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:54:32.947068 13882 consensus_queue.cc:260] T ccc90f6c867147cc9fe93c9ffa2e4802 P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:32.948405 13954 consensus_queue.cc:1035] T 8f4567f30cc34f288463e4a92bd3edd5 P 2065c332f15a4739899af79f3669c3ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:54:32.949743 13882 ts_tablet_manager.cc:1428] T ccc90f6c867147cc9fe93c9ffa2e4802 P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20250830 07:54:32.950191 13882 tablet_bootstrap.cc:492] T c12cf30cc2aa4e12a20b9492af08a6f8 P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:54:32.950599 13229 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_3797e2a45c3146938c3d05485ce19f5d" } new_table_name: "default.Table_90b2c2eb01e1430aae108708d2feb0de" modify_external_catalogs: true
I20250830 07:54:32.951838 13882 tablet_bootstrap.cc:654] T c12cf30cc2aa4e12a20b9492af08a6f8 P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:32.953079 13228 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet 2afb1e75cfcc4e1abd265fbadb4170fa
I20250830 07:54:32.953594 13228 catalog_manager.cc:6652] ReplaceTablet: tablet 2afb1e75cfcc4e1abd265fbadb4170fa deleted and replaced by tablet afb132e8a5b14a029e005e375f276348
I20250830 07:54:32.953866 13602 tablet_service.cc:1515] Processing DeleteTablet for tablet 2afb1e75cfcc4e1abd265fbadb4170fa with delete_type TABLET_DATA_DELETED (replaced by tablet afb132e8a5b14a029e005e375f276348) from {username='slave'} at 127.0.0.1:45306
W20250830 07:54:32.954566 13220 catalog_manager.cc:4908] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet 2afb1e75cfcc4e1abd265fbadb4170fa because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2afb1e75cfcc4e1abd265fbadb4170fa already in progress: creating tablet
I20250830 07:54:32.954603 13463 tablet_service.cc:1515] Processing DeleteTablet for tablet 2afb1e75cfcc4e1abd265fbadb4170fa with delete_type TABLET_DATA_DELETED (replaced by tablet afb132e8a5b14a029e005e375f276348) from {username='slave'} at 127.0.0.1:37956
I20250830 07:54:32.954989 13755 tablet_service.cc:1515] Processing DeleteTablet for tablet 2afb1e75cfcc4e1abd265fbadb4170fa with delete_type TABLET_DATA_DELETED (replaced by tablet afb132e8a5b14a029e005e375f276348) from {username='slave'} at 127.0.0.1:45460
W20250830 07:54:32.955168 13218 catalog_manager.cc:4908] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): delete failed for tablet 2afb1e75cfcc4e1abd265fbadb4170fa because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2afb1e75cfcc4e1abd265fbadb4170fa already in progress: creating tablet
W20250830 07:54:32.955638 13219 catalog_manager.cc:4908] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): delete failed for tablet 2afb1e75cfcc4e1abd265fbadb4170fa because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2afb1e75cfcc4e1abd265fbadb4170fa already in progress: creating tablet
I20250830 07:54:32.960295 13886 tablet_bootstrap.cc:492] T 9d00ee83780e4cf780ca92f1504d26b5 P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:54:32.960455 13886 ts_tablet_manager.cc:1397] T 9d00ee83780e4cf780ca92f1504d26b5 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.044s user 0.004s sys 0.002s
I20250830 07:54:32.960739 13887 tablet_bootstrap.cc:492] T c12cf30cc2aa4e12a20b9492af08a6f8 P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:54:32.960850 13887 ts_tablet_manager.cc:1397] T c12cf30cc2aa4e12a20b9492af08a6f8 P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.039s user 0.005s sys 0.008s
I20250830 07:54:32.961166 13886 raft_consensus.cc:357] T 9d00ee83780e4cf780ca92f1504d26b5 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:32.961366 13886 raft_consensus.cc:383] T 9d00ee83780e4cf780ca92f1504d26b5 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:32.961447 13886 raft_consensus.cc:738] T 9d00ee83780e4cf780ca92f1504d26b5 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:54:32.961585 13887 raft_consensus.cc:357] T c12cf30cc2aa4e12a20b9492af08a6f8 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } }
I20250830 07:54:32.961745 13887 raft_consensus.cc:383] T c12cf30cc2aa4e12a20b9492af08a6f8 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:32.961668 13886 consensus_queue.cc:260] T 9d00ee83780e4cf780ca92f1504d26b5 P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:32.961827 13887 raft_consensus.cc:738] T c12cf30cc2aa4e12a20b9492af08a6f8 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:54:32.963778 13887 consensus_queue.cc:260] T c12cf30cc2aa4e12a20b9492af08a6f8 P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } }
I20250830 07:54:32.968016 13887 ts_tablet_manager.cc:1428] T c12cf30cc2aa4e12a20b9492af08a6f8 P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.007s user 0.001s sys 0.001s
W20250830 07:54:32.971071 13229 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 6492bd11e50d4900927db0de3757aa24 has no consensus state
I20250830 07:54:32.972711 13887 tablet_bootstrap.cc:492] T ef16b9e2d444489699f4db1ac26d5f6c P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:54:32.974254 13887 tablet_bootstrap.cc:654] T ef16b9e2d444489699f4db1ac26d5f6c P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:32.978183 13956 raft_consensus.cc:491] T a04bf79de30a42a98e71f622efc90c22 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:32.978334 13956 raft_consensus.cc:513] T a04bf79de30a42a98e71f622efc90c22 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:32.979501 13488 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "a04bf79de30a42a98e71f622efc90c22" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:54:32.979705 13488 raft_consensus.cc:2466] T a04bf79de30a42a98e71f622efc90c22 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b5e454d98894637b466ea27f1b647f9 in term 0.
I20250830 07:54:32.980376 13561 leader_election.cc:304] T a04bf79de30a42a98e71f622efc90c22 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 6b5e454d98894637b466ea27f1b647f9; no voters:
I20250830 07:54:32.980650 13899 raft_consensus.cc:2802] T a04bf79de30a42a98e71f622efc90c22 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:54:32.980739 13899 raft_consensus.cc:491] T a04bf79de30a42a98e71f622efc90c22 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:54:32.980839 13899 raft_consensus.cc:3058] T a04bf79de30a42a98e71f622efc90c22 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:32.983552 13899 raft_consensus.cc:513] T a04bf79de30a42a98e71f622efc90c22 P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:32.984450 13899 leader_election.cc:290] T a04bf79de30a42a98e71f622efc90c22 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 election: Requested vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:32.984448 13488 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "a04bf79de30a42a98e71f622efc90c22" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba"
I20250830 07:54:32.984628 13488 raft_consensus.cc:3058] T a04bf79de30a42a98e71f622efc90c22 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:32.984740 13956 leader_election.cc:290] T a04bf79de30a42a98e71f622efc90c22 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:32.988832 13882 tablet_bootstrap.cc:492] T c12cf30cc2aa4e12a20b9492af08a6f8 P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:54:32.988963 13882 ts_tablet_manager.cc:1397] T c12cf30cc2aa4e12a20b9492af08a6f8 P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.039s user 0.020s sys 0.008s
I20250830 07:54:32.989675 13882 raft_consensus.cc:357] T c12cf30cc2aa4e12a20b9492af08a6f8 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } }
I20250830 07:54:32.989831 13882 raft_consensus.cc:383] T c12cf30cc2aa4e12a20b9492af08a6f8 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:32.989908 13882 raft_consensus.cc:738] T c12cf30cc2aa4e12a20b9492af08a6f8 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:54:32.990137 13882 consensus_queue.cc:260] T c12cf30cc2aa4e12a20b9492af08a6f8 P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } }
I20250830 07:54:32.991958 13882 ts_tablet_manager.cc:1428] T c12cf30cc2aa4e12a20b9492af08a6f8 P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20250830 07:54:32.992796 13775 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "a04bf79de30a42a98e71f622efc90c22" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f"
I20250830 07:54:32.992985 13775 raft_consensus.cc:3058] T a04bf79de30a42a98e71f622efc90c22 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:32.993427 13882 tablet_bootstrap.cc:492] T 4b7eff24965f4f3ebfbf70dc82b7cce3 P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:54:32.995154 13882 tablet_bootstrap.cc:654] T 4b7eff24965f4f3ebfbf70dc82b7cce3 P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:32.996717 13488 raft_consensus.cc:2466] T a04bf79de30a42a98e71f622efc90c22 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b5e454d98894637b466ea27f1b647f9 in term 1.
I20250830 07:54:32.997798 13561 leader_election.cc:304] T a04bf79de30a42a98e71f622efc90c22 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 6b5e454d98894637b466ea27f1b647f9; no voters:
I20250830 07:54:32.998055 13956 raft_consensus.cc:2802] T a04bf79de30a42a98e71f622efc90c22 P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Leader election won for term 1
I20250830 07:54:32.998229 13956 raft_consensus.cc:695] T a04bf79de30a42a98e71f622efc90c22 P 6b5e454d98894637b466ea27f1b647f9 [term 1 LEADER]: Becoming Leader. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Running, Role: LEADER
I20250830 07:54:32.998256 14005 mvcc.cc:204] Tried to move back new op lower bound from 7194789777133535232 to 7194789774165487616. Current Snapshot: MvccSnapshot[applied={T|T < 7194789777133535232}]
I20250830 07:54:32.998519 13956 consensus_queue.cc:237] T a04bf79de30a42a98e71f622efc90c22 P 6b5e454d98894637b466ea27f1b647f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:33.002221 13229 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_b7206189e63e4520aac9b721c0597352"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:33.002887 13229 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b7206189e63e4520aac9b721c0597352 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:33.009007 14009 tablet.cc:1722] T 8f4567f30cc34f288463e4a92bd3edd5 P 2065c332f15a4739899af79f3669c3ba: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20250830 07:54:33.010713 13882 tablet_bootstrap.cc:492] T 4b7eff24965f4f3ebfbf70dc82b7cce3 P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:54:33.010936 13882 ts_tablet_manager.cc:1397] T 4b7eff24965f4f3ebfbf70dc82b7cce3 P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.018s user 0.004s sys 0.011s
I20250830 07:54:33.011655 13882 raft_consensus.cc:357] T 4b7eff24965f4f3ebfbf70dc82b7cce3 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } }
I20250830 07:54:33.011838 13882 raft_consensus.cc:383] T 4b7eff24965f4f3ebfbf70dc82b7cce3 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:33.011919 13882 raft_consensus.cc:738] T 4b7eff24965f4f3ebfbf70dc82b7cce3 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:54:33.012135 13882 consensus_queue.cc:260] T 4b7eff24965f4f3ebfbf70dc82b7cce3 P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } }
I20250830 07:54:33.012693 13882 ts_tablet_manager.cc:1428] T 4b7eff24965f4f3ebfbf70dc82b7cce3 P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20250830 07:54:33.012979 13882 tablet_bootstrap.cc:492] T d33a5d107c6849aca6eb48ffdf8a5463 P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:54:33.014392 13886 ts_tablet_manager.cc:1428] T 9d00ee83780e4cf780ca92f1504d26b5 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.019s user 0.001s sys 0.002s
I20250830 07:54:33.014775 13886 tablet_bootstrap.cc:492] T 4ab63ff59d4e4ec2b7b64d605545a870 P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:54:33.015336 13773 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "a04bf79de30a42a98e71f622efc90c22" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:33.015527 13882 tablet_bootstrap.cc:654] T d33a5d107c6849aca6eb48ffdf8a5463 P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:33.020470 14011 tablet.cc:1722] T 8f4567f30cc34f288463e4a92bd3edd5 P 6b5e454d98894637b466ea27f1b647f9: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20250830 07:54:33.024243 13882 tablet_bootstrap.cc:492] T d33a5d107c6849aca6eb48ffdf8a5463 P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:54:33.024389 13882 ts_tablet_manager.cc:1397] T d33a5d107c6849aca6eb48ffdf8a5463 P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.011s user 0.006s sys 0.003s
I20250830 07:54:33.025148 13882 raft_consensus.cc:357] T d33a5d107c6849aca6eb48ffdf8a5463 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } }
I20250830 07:54:33.028498 13882 raft_consensus.cc:383] T d33a5d107c6849aca6eb48ffdf8a5463 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:33.028607 13882 raft_consensus.cc:738] T d33a5d107c6849aca6eb48ffdf8a5463 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:54:33.028844 13882 consensus_queue.cc:260] T d33a5d107c6849aca6eb48ffdf8a5463 P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } }
I20250830 07:54:33.029640 13882 ts_tablet_manager.cc:1428] T d33a5d107c6849aca6eb48ffdf8a5463 P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20250830 07:54:33.029919 13882 tablet_bootstrap.cc:492] T a78c522b9fa945e2879fb965d82fb359 P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:54:33.032791 13886 tablet_bootstrap.cc:654] T 4ab63ff59d4e4ec2b7b64d605545a870 P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:33.035979 13775 raft_consensus.cc:2466] T a04bf79de30a42a98e71f622efc90c22 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b5e454d98894637b466ea27f1b647f9 in term 1.
I20250830 07:54:33.043663 13463 tablet_service.cc:1515] Processing DeleteTablet for tablet 4d4b00bdadb24ec892d87c9be2ed7dd9 with delete_type TABLET_DATA_DELETED (replaced by tablet c9a8f144d50c4d3d81fbf43ce29a2ad2) from {username='slave'} at 127.0.0.1:37956
I20250830 07:54:33.043921 13461 tablet_service.cc:1515] Processing DeleteTablet for tablet a04bf79de30a42a98e71f622efc90c22 with delete_type TABLET_DATA_DELETED (replaced by tablet 0186504d9e4949179ce5b92b85f5b230) from {username='slave'} at 127.0.0.1:37956
I20250830 07:54:33.044433 13460 tablet_service.cc:1515] Processing DeleteTablet for tablet 778f6766c47f4a86b5dea60560f67d5c with delete_type TABLET_DATA_DELETED (replaced by tablet 4c2c85732d454cd98efc2646af9450ed) from {username='slave'} at 127.0.0.1:37956
I20250830 07:54:33.044634 13465 tablet_service.cc:1515] Processing DeleteTablet for tablet ff2267fb411942ff826e2a72bcb89cd7 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:31 UTC) from {username='slave'} at 127.0.0.1:37956
I20250830 07:54:33.044910 13459 tablet_service.cc:1515] Processing DeleteTablet for tablet f398e12cd9f543738d5163354f8a9d9d with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:31 UTC) from {username='slave'} at 127.0.0.1:37956
I20250830 07:54:33.045187 13883 tablet_replica.cc:331] T 4d4b00bdadb24ec892d87c9be2ed7dd9 P 2065c332f15a4739899af79f3669c3ba: stopping tablet replica
I20250830 07:54:33.045445 13883 raft_consensus.cc:2241] T 4d4b00bdadb24ec892d87c9be2ed7dd9 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Raft consensus shutting down.
I20250830 07:54:33.045644 13883 raft_consensus.cc:2270] T 4d4b00bdadb24ec892d87c9be2ed7dd9 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Raft consensus is shut down!
I20250830 07:54:33.046226 13883 ts_tablet_manager.cc:1905] T 4d4b00bdadb24ec892d87c9be2ed7dd9 P 2065c332f15a4739899af79f3669c3ba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250830 07:54:33.047046 13755 tablet_service.cc:1515] Processing DeleteTablet for tablet 32c75568db9b4f00bb567d09dab3d45a with delete_type TABLET_DATA_DELETED (replaced by tablet d2e5255f7bf7435bb8b93c42b42f603a) from {username='slave'} at 127.0.0.1:45460
I20250830 07:54:33.047082 13466 tablet_service.cc:1515] Processing DeleteTablet for tablet 5aef6fd239ba43478cd978fa5d29b26e with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:31 UTC) from {username='slave'} at 127.0.0.1:37956
I20250830 07:54:33.047295 13887 tablet_bootstrap.cc:492] T ef16b9e2d444489699f4db1ac26d5f6c P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:54:33.047853 13884 tablet_replica.cc:331] T 32c75568db9b4f00bb567d09dab3d45a P 9b057ade5dce45af9f8bf0bedf8b917f: stopping tablet replica
I20250830 07:54:33.048027 13884 raft_consensus.cc:2241] T 32c75568db9b4f00bb567d09dab3d45a P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Raft consensus shutting down.
I20250830 07:54:33.048144 13884 raft_consensus.cc:2270] T 32c75568db9b4f00bb567d09dab3d45a P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Raft consensus is shut down!
I20250830 07:54:33.048522 13884 ts_tablet_manager.cc:1905] T 32c75568db9b4f00bb567d09dab3d45a P 9b057ade5dce45af9f8bf0bedf8b917f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250830 07:54:33.055186 13228 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_c64f059e861d4ae6a3715d763aeaefdf"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250830 07:54:33.055375 13230 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_b7206189e63e4520aac9b721c0597352" } modify_external_catalogs: true
I20250830 07:54:33.055579 13230 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_b7206189e63e4520aac9b721c0597352" } modify_external_catalogs: true
W20250830 07:54:33.055758 13228 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c64f059e861d4ae6a3715d763aeaefdf in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:33.056151 13226 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_ed13c678c1c84e3595147954bedbeb49"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:33.056651 13226 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ed13c678c1c84e3595147954bedbeb49 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:33.057672 13225 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_652e111209f64061ba5aa3eb3126c5f2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:33.058121 13225 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_652e111209f64061ba5aa3eb3126c5f2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:33.059128 13229 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_690616d54f014a969bb63de44038e18b" } modify_external_catalogs: true
I20250830 07:54:33.059315 13229 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_690616d54f014a969bb63de44038e18b" } modify_external_catalogs: true
I20250830 07:54:33.060448 13884 ts_tablet_manager.cc:1918] T 32c75568db9b4f00bb567d09dab3d45a P 9b057ade5dce45af9f8bf0bedf8b917f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250830 07:54:33.060598 13884 log.cc:1199] T 32c75568db9b4f00bb567d09dab3d45a P 9b057ade5dce45af9f8bf0bedf8b917f: Deleting WAL directory at /tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/ts-2/wal/wals/32c75568db9b4f00bb567d09dab3d45a
I20250830 07:54:33.060959 13884 ts_tablet_manager.cc:1939] T 32c75568db9b4f00bb567d09dab3d45a P 9b057ade5dce45af9f8bf0bedf8b917f: Deleting consensus metadata
I20250830 07:54:33.062052 13887 ts_tablet_manager.cc:1397] T ef16b9e2d444489699f4db1ac26d5f6c P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.075s user 0.010s sys 0.001s
I20250830 07:54:33.063076 13887 raft_consensus.cc:357] T ef16b9e2d444489699f4db1ac26d5f6c P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } }
I20250830 07:54:33.063275 13887 raft_consensus.cc:383] T ef16b9e2d444489699f4db1ac26d5f6c P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:33.063359 13887 raft_consensus.cc:738] T ef16b9e2d444489699f4db1ac26d5f6c P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:54:33.063619 13887 consensus_queue.cc:260] T ef16b9e2d444489699f4db1ac26d5f6c P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } }
I20250830 07:54:33.069995 13883 ts_tablet_manager.cc:1918] T 4d4b00bdadb24ec892d87c9be2ed7dd9 P 2065c332f15a4739899af79f3669c3ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250830 07:54:33.070245 13883 log.cc:1199] T 4d4b00bdadb24ec892d87c9be2ed7dd9 P 2065c332f15a4739899af79f3669c3ba: Deleting WAL directory at /tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/ts-0/wal/wals/4d4b00bdadb24ec892d87c9be2ed7dd9
I20250830 07:54:33.071273 13883 ts_tablet_manager.cc:1939] T 4d4b00bdadb24ec892d87c9be2ed7dd9 P 2065c332f15a4739899af79f3669c3ba: Deleting consensus metadata
W20250830 07:54:33.071822 13226 catalog_manager.cc:5415] Ignoring report from unknown tablet 7ef98dbbdf5848038a2da6140e126301
W20250830 07:54:33.071916 13226 catalog_manager.cc:5415] Ignoring report from unknown tablet f398e12cd9f543738d5163354f8a9d9d
I20250830 07:54:33.071949 13887 ts_tablet_manager.cc:1428] T ef16b9e2d444489699f4db1ac26d5f6c P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.010s user 0.002s sys 0.000s
W20250830 07:54:33.071979 13226 catalog_manager.cc:5415] Ignoring report from unknown tablet ff2267fb411942ff826e2a72bcb89cd7
W20250830 07:54:33.072058 13226 catalog_manager.cc:5415] Ignoring report from unknown tablet 5aef6fd239ba43478cd978fa5d29b26e
W20250830 07:54:33.072100 13226 catalog_manager.cc:5415] Ignoring report from unknown tablet 4d4b00bdadb24ec892d87c9be2ed7dd9
W20250830 07:54:33.072177 13226 catalog_manager.cc:5415] Ignoring report from unknown tablet 5ce773ce68f649b1bf51f0dd901cb04f
W20250830 07:54:33.072217 13226 catalog_manager.cc:5415] Ignoring report from unknown tablet a04bf79de30a42a98e71f622efc90c22
I20250830 07:54:33.072394 13218 catalog_manager.cc:4928] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): tablet 4d4b00bdadb24ec892d87c9be2ed7dd9 (table default.Table_e3c92a53cb994620a7bf2072b4aefa05 [id=d2dbb756d66b483ebe44d45ddfa5c17c]) successfully deleted
I20250830 07:54:33.072234 13883 tablet_replica.cc:331] T a04bf79de30a42a98e71f622efc90c22 P 2065c332f15a4739899af79f3669c3ba: stopping tablet replica
I20250830 07:54:33.072571 13226 catalog_manager.cc:5674] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743) does not have the latest schema for tablet 8f4567f30cc34f288463e4a92bd3edd5 (table default.Table_7ebf4c4ec5524ee2a9e9c13971eb178f [id=3c052a58caaa412f8d9d70063dcd97c0]). Expected version 2 got 0
I20250830 07:54:33.072737 13883 raft_consensus.cc:2241] T a04bf79de30a42a98e71f622efc90c22 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Raft consensus shutting down.
I20250830 07:54:33.072887 13883 raft_consensus.cc:2270] T a04bf79de30a42a98e71f622efc90c22 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20250830 07:54:33.073381 13883 ts_tablet_manager.cc:1905] T a04bf79de30a42a98e71f622efc90c22 P 2065c332f15a4739899af79f3669c3ba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250830 07:54:33.075748 13887 tablet_bootstrap.cc:492] T d33a5d107c6849aca6eb48ffdf8a5463 P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:54:33.078032 13887 tablet_bootstrap.cc:654] T d33a5d107c6849aca6eb48ffdf8a5463 P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:33.079721 13882 tablet_bootstrap.cc:654] T a78c522b9fa945e2879fb965d82fb359 P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:33.080461 13225 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_ecd15d3b53054346bac8edc58a21639b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:33.080950 13225 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ecd15d3b53054346bac8edc58a21639b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:33.083999 13883 ts_tablet_manager.cc:1918] T a04bf79de30a42a98e71f622efc90c22 P 2065c332f15a4739899af79f3669c3ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250830 07:54:33.084177 13883 log.cc:1199] T a04bf79de30a42a98e71f622efc90c22 P 2065c332f15a4739899af79f3669c3ba: Deleting WAL directory at /tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/ts-0/wal/wals/a04bf79de30a42a98e71f622efc90c22
I20250830 07:54:33.084733 13234 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_8b504248201347288df9b3fcd2be2d2d" } modify_external_catalogs: true
I20250830 07:54:33.084921 13234 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_8b504248201347288df9b3fcd2be2d2d" } modify_external_catalogs: true
I20250830 07:54:33.084537 13883 ts_tablet_manager.cc:1939] T a04bf79de30a42a98e71f622efc90c22 P 2065c332f15a4739899af79f3669c3ba: Deleting consensus metadata
I20250830 07:54:33.085629 13954 raft_consensus.cc:491] T c12cf30cc2aa4e12a20b9492af08a6f8 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:33.085759 13954 raft_consensus.cc:513] T c12cf30cc2aa4e12a20b9492af08a6f8 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } }
I20250830 07:54:33.086450 13954 leader_election.cc:290] T c12cf30cc2aa4e12a20b9492af08a6f8 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743), 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967)
I20250830 07:54:33.087855 13218 catalog_manager.cc:4928] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): tablet a04bf79de30a42a98e71f622efc90c22 (table default.Table_f817d6b952384e64a8b6be555cc4db2f [id=320265dd7ec24f44acaec48bd44472db]) successfully deleted
I20250830 07:54:33.086392 14017 tablet.cc:1722] T 8f4567f30cc34f288463e4a92bd3edd5 P 9b057ade5dce45af9f8bf0bedf8b917f: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20250830 07:54:33.088364 13228 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_452b4395b710434591ea426b1e2432ba" } modify_external_catalogs: true
I20250830 07:54:33.088538 13228 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_452b4395b710434591ea426b1e2432ba" } modify_external_catalogs: true
I20250830 07:54:33.088981 13883 tablet_replica.cc:331] T 778f6766c47f4a86b5dea60560f67d5c P 2065c332f15a4739899af79f3669c3ba: stopping tablet replica
I20250830 07:54:33.088995 13775 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "c12cf30cc2aa4e12a20b9492af08a6f8" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:33.089417 13232 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_0de9806941924437ab41de35e3e2eeaa" } new_table_name: "default.Table_3ada97cf95b64b1fb2324762c4800a9a" modify_external_catalogs: true
I20250830 07:54:33.089486 13883 raft_consensus.cc:2241] T 778f6766c47f4a86b5dea60560f67d5c P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Raft consensus shutting down.
I20250830 07:54:33.089656 13883 raft_consensus.cc:2270] T 778f6766c47f4a86b5dea60560f67d5c P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Raft consensus is shut down!
I20250830 07:54:33.090137 13883 ts_tablet_manager.cc:1905] T 778f6766c47f4a86b5dea60560f67d5c P 2065c332f15a4739899af79f3669c3ba: Deleting tablet data with delete state TABLET_DATA_DELETED
W20250830 07:54:33.090693 13422 leader_election.cc:343] T c12cf30cc2aa4e12a20b9492af08a6f8 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:33.091776 14004 mvcc.cc:204] Tried to move back new op lower bound from 7194789777133535232 to 7194789774165487616. Current Snapshot: MvccSnapshot[applied={T|T < 7194789777133535232}]
I20250830 07:54:33.095427 13899 raft_consensus.cc:491] T ccc90f6c867147cc9fe93c9ffa2e4802 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20250830 07:54:33.095511 13232 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 861809cc50764aa89140e587489e2d88 has no consensus state
I20250830 07:54:33.099615 13233 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_8be35b5f21ba4070a2f65a64315b9ae6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250830 07:54:33.099793 13232 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_6036df2e3fa041e1afd177e14f9c2cf4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:33.100109 13233 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8be35b5f21ba4070a2f65a64315b9ae6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250830 07:54:33.100248 13232 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6036df2e3fa041e1afd177e14f9c2cf4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:33.101315 13225 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_3e83417f25834382bd64da7edd1a18cb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:33.101717 13225 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3e83417f25834382bd64da7edd1a18cb in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:33.102252 13899 raft_consensus.cc:513] T ccc90f6c867147cc9fe93c9ffa2e4802 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:33.103447 13488 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "ccc90f6c867147cc9fe93c9ffa2e4802" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:54:33.103644 13488 raft_consensus.cc:2466] T ccc90f6c867147cc9fe93c9ffa2e4802 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b5e454d98894637b466ea27f1b647f9 in term 0.
I20250830 07:54:33.105008 13774 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "ccc90f6c867147cc9fe93c9ffa2e4802" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:33.105520 13602 tablet_service.cc:1515] Processing DeleteTablet for tablet a04bf79de30a42a98e71f622efc90c22 with delete_type TABLET_DATA_DELETED (replaced by tablet 0186504d9e4949179ce5b92b85f5b230) from {username='slave'} at 127.0.0.1:45306
I20250830 07:54:33.106315 13227 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_10c5ebac55c2421b969807cc555eaba8" } new_table_name: "default.Table_9961dc66c9e44ac280c4a5502d5c8010" modify_external_catalogs: true
I20250830 07:54:33.107363 13899 leader_election.cc:290] T ccc90f6c867147cc9fe93c9ffa2e4802 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:33.107986 13604 tablet_service.cc:1515] Processing DeleteTablet for tablet 5aef6fd239ba43478cd978fa5d29b26e with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:31 UTC) from {username='slave'} at 127.0.0.1:45306
I20250830 07:54:33.110836 13887 tablet_bootstrap.cc:492] T d33a5d107c6849aca6eb48ffdf8a5463 P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:54:33.111624 13887 ts_tablet_manager.cc:1397] T d33a5d107c6849aca6eb48ffdf8a5463 P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.036s user 0.003s sys 0.001s
I20250830 07:54:33.112615 13232 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_4b551ee739314e368cb0bb6426c77318"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250830 07:54:33.113109 13886 tablet_bootstrap.cc:492] T 4ab63ff59d4e4ec2b7b64d605545a870 P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:54:33.113277 13886 ts_tablet_manager.cc:1397] T 4ab63ff59d4e4ec2b7b64d605545a870 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.099s user 0.005s sys 0.005s
I20250830 07:54:33.113739 13561 leader_election.cc:304] T ccc90f6c867147cc9fe93c9ffa2e4802 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 6b5e454d98894637b466ea27f1b647f9; no voters:
I20250830 07:54:33.113732 13233 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_586f78d6113c48a3ab0fdbcba030e199" } new_table_name: "default.Table_89fb50934e7f4289bbb16b05a52a3af4" modify_external_catalogs: true
W20250830 07:54:33.113933 13562 leader_election.cc:343] T ccc90f6c867147cc9fe93c9ffa2e4802 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:33.114034 13885 tablet_replica.cc:331] T a04bf79de30a42a98e71f622efc90c22 P 6b5e454d98894637b466ea27f1b647f9: stopping tablet replica
I20250830 07:54:33.114241 13885 raft_consensus.cc:2241] T a04bf79de30a42a98e71f622efc90c22 P 6b5e454d98894637b466ea27f1b647f9 [term 1 LEADER]: Raft consensus shutting down.
I20250830 07:54:33.114629 13885 pending_rounds.cc:70] T a04bf79de30a42a98e71f622efc90c22 P 6b5e454d98894637b466ea27f1b647f9: Trying to abort 1 pending ops.
I20250830 07:54:33.114753 13885 pending_rounds.cc:77] T a04bf79de30a42a98e71f622efc90c22 P 6b5e454d98894637b466ea27f1b647f9: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7194789777404874752 op_type: NO_OP noop_request { }
I20250830 07:54:33.114957 13885 raft_consensus.cc:2887] T a04bf79de30a42a98e71f622efc90c22 P 6b5e454d98894637b466ea27f1b647f9 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20250830 07:54:33.115097 13885 raft_consensus.cc:2270] T a04bf79de30a42a98e71f622efc90c22 P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Raft consensus is shut down!
W20250830 07:54:33.115100 13232 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4b551ee739314e368cb0bb6426c77318 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:33.115566 13629 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "c12cf30cc2aa4e12a20b9492af08a6f8" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:33.115759 13629 raft_consensus.cc:2466] T c12cf30cc2aa4e12a20b9492af08a6f8 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2065c332f15a4739899af79f3669c3ba in term 0.
I20250830 07:54:33.117368 13886 raft_consensus.cc:357] T 4ab63ff59d4e4ec2b7b64d605545a870 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:33.117540 13886 raft_consensus.cc:383] T 4ab63ff59d4e4ec2b7b64d605545a870 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:33.117641 13886 raft_consensus.cc:738] T 4ab63ff59d4e4ec2b7b64d605545a870 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:54:33.117978 13886 consensus_queue.cc:260] T 4ab63ff59d4e4ec2b7b64d605545a870 P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:33.119195 13899 raft_consensus.cc:491] T 5ce773ce68f649b1bf51f0dd901cb04f P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:33.119323 13899 raft_consensus.cc:513] T 5ce773ce68f649b1bf51f0dd901cb04f P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:33.119884 13899 leader_election.cc:290] T 5ce773ce68f649b1bf51f0dd901cb04f P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:33.120040 13899 raft_consensus.cc:2802] T ccc90f6c867147cc9fe93c9ffa2e4802 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:54:33.120133 13899 raft_consensus.cc:491] T ccc90f6c867147cc9fe93c9ffa2e4802 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:54:33.120219 13899 raft_consensus.cc:3058] T ccc90f6c867147cc9fe93c9ffa2e4802 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Advancing to term 1
W20250830 07:54:33.120504 13227 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ed87c6793dd149a6a363f1977d816628 has no consensus state
I20250830 07:54:33.119041 13956 consensus_queue.cc:1035] T 9e055d6089f541f799eddb5778eb2148 P 6b5e454d98894637b466ea27f1b647f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.025s
I20250830 07:54:33.122570 13886 ts_tablet_manager.cc:1428] T 4ab63ff59d4e4ec2b7b64d605545a870 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.009s user 0.001s sys 0.002s
I20250830 07:54:33.125461 13886 tablet_bootstrap.cc:492] T ccc90f6c867147cc9fe93c9ffa2e4802 P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
W20250830 07:54:33.126821 13233 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ccc90f6c867147cc9fe93c9ffa2e4802 consensus state has no leader
I20250830 07:54:33.129040 13899 raft_consensus.cc:513] T ccc90f6c867147cc9fe93c9ffa2e4802 P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:33.130162 13487 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "ccc90f6c867147cc9fe93c9ffa2e4802" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba"
I20250830 07:54:33.131570 13885 ts_tablet_manager.cc:1905] T a04bf79de30a42a98e71f622efc90c22 P 6b5e454d98894637b466ea27f1b647f9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250830 07:54:33.132768 13234 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet 05da843c0fe4482a926e410e06b22461
I20250830 07:54:33.134009 13604 tablet_service.cc:1515] Processing DeleteTablet for tablet 05da843c0fe4482a926e410e06b22461 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:33 UTC) from {username='slave'} at 127.0.0.1:45306
I20250830 07:54:33.125667 13774 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "5ce773ce68f649b1bf51f0dd901cb04f" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:33.134644 13774 raft_consensus.cc:2466] T 5ce773ce68f649b1bf51f0dd901cb04f P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b5e454d98894637b466ea27f1b647f9 in term 0.
I20250830 07:54:33.133625 13755 tablet_service.cc:1515] Processing DeleteTablet for tablet 05da843c0fe4482a926e410e06b22461 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:33 UTC) from {username='slave'} at 127.0.0.1:45460
I20250830 07:54:33.135344 13562 leader_election.cc:304] T 5ce773ce68f649b1bf51f0dd901cb04f P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f; no voters:
W20250830 07:54:33.135694 13234 catalog_manager.cc:5415] Ignoring report from unknown tablet 4b7eff24965f4f3ebfbf70dc82b7cce3
I20250830 07:54:33.135694 13956 raft_consensus.cc:2802] T 5ce773ce68f649b1bf51f0dd901cb04f P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:54:33.135792 13956 raft_consensus.cc:491] T 5ce773ce68f649b1bf51f0dd901cb04f P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20250830 07:54:33.135843 13234 catalog_manager.cc:5415] Ignoring report from unknown tablet 5ce773ce68f649b1bf51f0dd901cb04f
I20250830 07:54:33.135883 13956 raft_consensus.cc:3058] T 5ce773ce68f649b1bf51f0dd901cb04f P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Advancing to term 1
W20250830 07:54:33.135936 13234 catalog_manager.cc:5415] Ignoring report from unknown tablet 7ef98dbbdf5848038a2da6140e126301
W20250830 07:54:33.135982 13234 catalog_manager.cc:5415] Ignoring report from unknown tablet 4ab63ff59d4e4ec2b7b64d605545a870
W20250830 07:54:33.136092 13234 catalog_manager.cc:5415] Ignoring report from unknown tablet ff2267fb411942ff826e2a72bcb89cd7
W20250830 07:54:33.136147 13234 catalog_manager.cc:5415] Ignoring report from unknown tablet a04bf79de30a42a98e71f622efc90c22
I20250830 07:54:33.137714 13228 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet 69f2105c5eeb47e9a848ae7bf8779996
I20250830 07:54:33.138489 13459 tablet_service.cc:1515] Processing DeleteTablet for tablet 69f2105c5eeb47e9a848ae7bf8779996 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:33 UTC) from {username='slave'} at 127.0.0.1:37956
I20250830 07:54:33.138821 13604 tablet_service.cc:1515] Processing DeleteTablet for tablet 69f2105c5eeb47e9a848ae7bf8779996 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:33 UTC) from {username='slave'} at 127.0.0.1:45306
I20250830 07:54:33.139290 13956 raft_consensus.cc:513] T 5ce773ce68f649b1bf51f0dd901cb04f P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:33.139896 13755 tablet_service.cc:1515] Processing DeleteTablet for tablet 69f2105c5eeb47e9a848ae7bf8779996 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:33 UTC) from {username='slave'} at 127.0.0.1:45460
I20250830 07:54:33.140538 13956 leader_election.cc:290] T 5ce773ce68f649b1bf51f0dd901cb04f P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 election: Requested vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:33.141067 13774 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "5ce773ce68f649b1bf51f0dd901cb04f" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f"
I20250830 07:54:33.141286 13774 raft_consensus.cc:3058] T 5ce773ce68f649b1bf51f0dd901cb04f P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:33.142020 13404 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet 05da843c0fe4482a926e410e06b22461
I20250830 07:54:33.143924 13774 raft_consensus.cc:2466] T 5ce773ce68f649b1bf51f0dd901cb04f P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b5e454d98894637b466ea27f1b647f9 in term 1.
I20250830 07:54:33.145244 13228 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_fa57cb9f83e84e42b79e2f78096a8c78"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:33.145787 13228 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fa57cb9f83e84e42b79e2f78096a8c78 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:33.146725 13749 tablet_service.cc:1468] Processing CreateTablet for tablet 6f2d855ab3c04123b2f9ea22cda6ef04 (DEFAULT_TABLE table=default.Table_b7206189e63e4520aac9b721c0597352 [id=477a533ffa67456eb73d40d6fbf236f9]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:33.147181 13233 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_1122e7555f184245b03157a9e3996e7c" } modify_external_catalogs: true
I20250830 07:54:33.147315 13233 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_1122e7555f184245b03157a9e3996e7c" } modify_external_catalogs: true
I20250830 07:54:33.147462 13749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f2d855ab3c04123b2f9ea22cda6ef04. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:33.148433 13232 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_7267421303d148a581bd56208d51fc51" } new_table_name: "default.Table_9b3c1b8da52e44d8a8215a004afb6f4a" modify_external_catalogs: true
I20250830 07:54:33.150520 13753 tablet_service.cc:1468] Processing CreateTablet for tablet c2f5f79547184009a0863b695a833694 (DEFAULT_TABLE table=default.Table_10f15bfc3b994681be0b939c3ae9d19d [id=768d7e569197455bb092328ca1b32ed0]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:33.150813 13234 catalog_manager.cc:5674] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967) does not have the latest schema for tablet ccc90f6c867147cc9fe93c9ffa2e4802 (table default.Table_89fb50934e7f4289bbb16b05a52a3af4 [id=1b7c141ed8af4dcab20683653fd59ee1]). Expected version 5 got 0
I20250830 07:54:33.150941 13753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c2f5f79547184009a0863b695a833694. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:33.151149 13234 catalog_manager.cc:5674] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967) does not have the latest schema for tablet c12cf30cc2aa4e12a20b9492af08a6f8 (table default.Table_f95d862caa7944469f67bcf46893fa07 [id=4976f023f31746a884cb610d757b94cd]). Expected version 1 got 0
I20250830 07:54:33.151147 13755 tablet_service.cc:1515] Processing DeleteTablet for tablet 05da843c0fe4482a926e410e06b22461 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:33 UTC) from {username='slave'} at 127.0.0.1:45460
W20250830 07:54:33.157341 13219 catalog_manager.cc:4895] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): delete failed for tablet 05da843c0fe4482a926e410e06b22461 because the tablet was not found. No further retry: Not found: Tablet not found: 05da843c0fe4482a926e410e06b22461
W20250830 07:54:33.157613 13219 catalog_manager.cc:4908] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): delete failed for tablet 69f2105c5eeb47e9a848ae7bf8779996 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 69f2105c5eeb47e9a848ae7bf8779996 already in progress: creating tablet
W20250830 07:54:33.157812 13219 catalog_manager.cc:4895] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): delete failed for tablet 05da843c0fe4482a926e410e06b22461 because the tablet was not found. No further retry: Not found: Tablet not found: 05da843c0fe4482a926e410e06b22461
I20250830 07:54:33.142685 13604 tablet_service.cc:1515] Processing DeleteTablet for tablet 05da843c0fe4482a926e410e06b22461 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:33 UTC) from {username='slave'} at 127.0.0.1:45306
I20250830 07:54:33.145138 13603 tablet_service.cc:1468] Processing CreateTablet for tablet c2f5f79547184009a0863b695a833694 (DEFAULT_TABLE table=default.Table_10f15bfc3b994681be0b939c3ae9d19d [id=768d7e569197455bb092328ca1b32ed0]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:33.162631 13603 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c2f5f79547184009a0863b695a833694. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:33.145587 13602 tablet_service.cc:1468] Processing CreateTablet for tablet 6f2d855ab3c04123b2f9ea22cda6ef04 (DEFAULT_TABLE table=default.Table_b7206189e63e4520aac9b721c0597352 [id=477a533ffa67456eb73d40d6fbf236f9]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:33.156316 13562 leader_election.cc:304] T 5ce773ce68f649b1bf51f0dd901cb04f P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f; no voters:
I20250830 07:54:33.160446 13899 leader_election.cc:290] T ccc90f6c867147cc9fe93c9ffa2e4802 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 election: Requested vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:33.164350 13886 tablet_bootstrap.cc:654] T ccc90f6c867147cc9fe93c9ffa2e4802 P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:33.164721 13229 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet 91ab8c468c8143b9ae11b839a95a26fd
I20250830 07:54:33.165907 13423 leader_election.cc:304] T c12cf30cc2aa4e12a20b9492af08a6f8 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 6b5e454d98894637b466ea27f1b647f9; no voters: 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:54:33.167066 13230 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet 6f2d855ab3c04123b2f9ea22cda6ef04
W20250830 07:54:33.166491 13423 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.209.2:38967, user_credentials={real_user=slave}} blocked reactor thread for 50267.2us
I20250830 07:54:33.170289 13755 tablet_service.cc:1515] Processing DeleteTablet for tablet 6f2d855ab3c04123b2f9ea22cda6ef04 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:33 UTC) from {username='slave'} at 127.0.0.1:45460
I20250830 07:54:33.170363 13899 raft_consensus.cc:2802] T 5ce773ce68f649b1bf51f0dd901cb04f P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Leader election won for term 1
I20250830 07:54:33.170485 13899 raft_consensus.cc:695] T 5ce773ce68f649b1bf51f0dd901cb04f P 6b5e454d98894637b466ea27f1b647f9 [term 1 LEADER]: Becoming Leader. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Running, Role: LEADER
I20250830 07:54:33.170650 13604 tablet_service.cc:1515] Processing DeleteTablet for tablet 91ab8c468c8143b9ae11b839a95a26fd with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:33 UTC) from {username='slave'} at 127.0.0.1:45306
I20250830 07:54:33.170785 13899 consensus_queue.cc:237] T 5ce773ce68f649b1bf51f0dd901cb04f P 6b5e454d98894637b466ea27f1b647f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:33.173105 13465 tablet_service.cc:1468] Processing CreateTablet for tablet 6f2d855ab3c04123b2f9ea22cda6ef04 (DEFAULT_TABLE table=default.Table_b7206189e63e4520aac9b721c0597352 [id=477a533ffa67456eb73d40d6fbf236f9]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:33.173617 13486 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "5ce773ce68f649b1bf51f0dd901cb04f" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba"
I20250830 07:54:33.174348 13486 raft_consensus.cc:3058] T 5ce773ce68f649b1bf51f0dd901cb04f P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:33.177650 13487 raft_consensus.cc:3058] T ccc90f6c867147cc9fe93c9ffa2e4802 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:33.177953 13954 raft_consensus.cc:2802] T c12cf30cc2aa4e12a20b9492af08a6f8 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:54:33.179172 13604 tablet_service.cc:1515] Processing DeleteTablet for tablet 6f2d855ab3c04123b2f9ea22cda6ef04 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:33 UTC) from {username='slave'} at 127.0.0.1:45306
I20250830 07:54:33.180784 13602 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f2d855ab3c04123b2f9ea22cda6ef04. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:33.181077 13233 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet c3b35ea656db4741a02e6746e1b049ec
W20250830 07:54:33.182248 13232 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 27da527d9fe045ae8c17f193d034f5ac consensus state has no leader
I20250830 07:54:33.182672 13755 tablet_service.cc:1515] Processing DeleteTablet for tablet c3b35ea656db4741a02e6746e1b049ec with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:33 UTC) from {username='slave'} at 127.0.0.1:45460
I20250830 07:54:33.182663 13230 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_ecd15d3b53054346bac8edc58a21639b" } new_table_name: "default.Table_e416a7a3bb404b1faa035579e6375156" modify_external_catalogs: true
I20250830 07:54:33.183089 13897 raft_consensus.cc:491] T 4d4b00bdadb24ec892d87c9be2ed7dd9 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:33.183244 13897 raft_consensus.cc:513] T 4d4b00bdadb24ec892d87c9be2ed7dd9 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:33.183604 13774 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "ccc90f6c867147cc9fe93c9ffa2e4802" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f"
I20250830 07:54:33.183848 13897 leader_election.cc:290] T 4d4b00bdadb24ec892d87c9be2ed7dd9 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967)
W20250830 07:54:33.184892 13219 catalog_manager.cc:4908] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): delete failed for tablet 6f2d855ab3c04123b2f9ea22cda6ef04 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6f2d855ab3c04123b2f9ea22cda6ef04 already in progress: creating tablet
W20250830 07:54:33.185159 13219 catalog_manager.cc:4895] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): delete failed for tablet c3b35ea656db4741a02e6746e1b049ec because the tablet was not found. No further retry: Not found: Tablet not found: c3b35ea656db4741a02e6746e1b049ec
I20250830 07:54:33.187017 13466 tablet_service.cc:1515] Processing DeleteTablet for tablet 05da843c0fe4482a926e410e06b22461 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:33 UTC) from {username='slave'} at 127.0.0.1:37956
I20250830 07:54:33.187460 13488 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "5ce773ce68f649b1bf51f0dd901cb04f" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:54:33.188082 13459 tablet_service.cc:1515] Processing DeleteTablet for tablet 05da843c0fe4482a926e410e06b22461 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:33 UTC) from {username='slave'} at 127.0.0.1:37956
I20250830 07:54:33.188920 13465 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f2d855ab3c04123b2f9ea22cda6ef04. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:33.189113 13753 tablet_service.cc:1515] Processing DeleteTablet for tablet 9d00ee83780e4cf780ca92f1504d26b5 with delete_type TABLET_DATA_DELETED (replaced by tablet 91ab8c468c8143b9ae11b839a95a26fd) from {username='slave'} at 127.0.0.1:45460
I20250830 07:54:33.191165 13749 tablet_service.cc:1515] Processing DeleteTablet for tablet 91ab8c468c8143b9ae11b839a95a26fd with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:33 UTC) from {username='slave'} at 127.0.0.1:45460
I20250830 07:54:33.193132 13884 tablet_replica.cc:331] T 9d00ee83780e4cf780ca92f1504d26b5 P 9b057ade5dce45af9f8bf0bedf8b917f: stopping tablet replica
I20250830 07:54:33.193353 13884 raft_consensus.cc:2241] T 9d00ee83780e4cf780ca92f1504d26b5 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Raft consensus shutting down.
I20250830 07:54:33.193534 13884 raft_consensus.cc:2270] T 9d00ee83780e4cf780ca92f1504d26b5 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Raft consensus is shut down!
W20250830 07:54:33.194159 13230 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 44313f1a11b74e6d996cafd3c03d1836 has no consensus state
I20250830 07:54:33.194882 13459 tablet_service.cc:1515] Processing DeleteTablet for tablet 91ab8c468c8143b9ae11b839a95a26fd with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:33 UTC) from {username='slave'} at 127.0.0.1:37956
I20250830 07:54:33.194986 13487 raft_consensus.cc:2466] T ccc90f6c867147cc9fe93c9ffa2e4802 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b5e454d98894637b466ea27f1b647f9 in term 1.
I20250830 07:54:33.194877 13466 tablet_service.cc:1515] Processing DeleteTablet for tablet 6f2d855ab3c04123b2f9ea22cda6ef04 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:33 UTC) from {username='slave'} at 127.0.0.1:37956
I20250830 07:54:33.195863 13234 catalog_manager.cc:6127] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: default.Table_7ebf4c4ec5524ee2a9e9c13971eb178f [id=3c052a58caaa412f8d9d70063dcd97c0] alter complete (version 2)
I20250830 07:54:33.197484 13884 ts_tablet_manager.cc:1905] T 9d00ee83780e4cf780ca92f1504d26b5 P 9b057ade5dce45af9f8bf0bedf8b917f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250830 07:54:33.201072 13749 tablet_service.cc:1468] Processing CreateTablet for tablet ed87c6793dd149a6a363f1977d816628 (DEFAULT_TABLE table=default.Table_9961dc66c9e44ac280c4a5502d5c8010 [id=fdac911d311c4424bda97cca1acbc5d5]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:33.201514 13749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed87c6793dd149a6a363f1977d816628. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:33.203855 13954 raft_consensus.cc:491] T c12cf30cc2aa4e12a20b9492af08a6f8 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:54:33.203999 13954 raft_consensus.cc:3058] T c12cf30cc2aa4e12a20b9492af08a6f8 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
W20250830 07:54:33.204057 13562 leader_election.cc:343] T ccc90f6c867147cc9fe93c9ffa2e4802 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:33.206301 13561 leader_election.cc:304] T ccc90f6c867147cc9fe93c9ffa2e4802 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 6b5e454d98894637b466ea27f1b647f9; no voters: 9b057ade5dce45af9f8bf0bedf8b917f
W20250830 07:54:33.206966 13703 leader_election.cc:343] T 4d4b00bdadb24ec892d87c9be2ed7dd9 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Not found: Tablet not found: 4d4b00bdadb24ec892d87c9be2ed7dd9
I20250830 07:54:33.207012 13466 tablet_service.cc:1515] Processing DeleteTablet for tablet c3b35ea656db4741a02e6746e1b049ec with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:33 UTC) from {username='slave'} at 127.0.0.1:37956
I20250830 07:54:33.207644 13459 tablet_service.cc:1468] Processing CreateTablet for tablet c2f5f79547184009a0863b695a833694 (DEFAULT_TABLE table=default.Table_10f15bfc3b994681be0b939c3ae9d19d [id=768d7e569197455bb092328ca1b32ed0]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:33.208014 13459 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c2f5f79547184009a0863b695a833694. 1 dirs total, 0 dirs full, 0 dirs failed
W20250830 07:54:33.211128 13701 leader_election.cc:343] T 4d4b00bdadb24ec892d87c9be2ed7dd9 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): Not found: Tablet not found: 4d4b00bdadb24ec892d87c9be2ed7dd9
W20250830 07:54:33.211187 13234 catalog_manager.cc:5415] Ignoring report from unknown tablet 9e055d6089f541f799eddb5778eb2148
W20250830 07:54:33.211301 13234 catalog_manager.cc:5415] Ignoring report from unknown tablet 4ab63ff59d4e4ec2b7b64d605545a870
I20250830 07:54:33.211269 13701 leader_election.cc:304] T 4d4b00bdadb24ec892d87c9be2ed7dd9 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 2065c332f15a4739899af79f3669c3ba, 6b5e454d98894637b466ea27f1b647f9
I20250830 07:54:33.211719 13897 raft_consensus.cc:2747] T 4d4b00bdadb24ec892d87c9be2ed7dd9 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:54:33.215014 13486 raft_consensus.cc:2466] T 5ce773ce68f649b1bf51f0dd901cb04f P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b5e454d98894637b466ea27f1b647f9 in term 1.
I20250830 07:54:33.218739 13466 tablet_service.cc:1468] Processing CreateTablet for tablet ed87c6793dd149a6a363f1977d816628 (DEFAULT_TABLE table=default.Table_9961dc66c9e44ac280c4a5502d5c8010 [id=fdac911d311c4424bda97cca1acbc5d5]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:33.218806 13749 tablet_service.cc:1468] Processing CreateTablet for tablet 1476bb480bf747838613948875001c30 (DEFAULT_TABLE table=default.Table_33e47ed000c24372ac8f1b89c5fc38cb [id=9c9207d3b60e4781b1cc610cff92c8e6]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:33.219151 13466 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed87c6793dd149a6a363f1977d816628. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:33.219269 13749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1476bb480bf747838613948875001c30. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:33.221342 13609 tablet_service.cc:1468] Processing CreateTablet for tablet ed87c6793dd149a6a363f1977d816628 (DEFAULT_TABLE table=default.Table_9961dc66c9e44ac280c4a5502d5c8010 [id=fdac911d311c4424bda97cca1acbc5d5]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:33.221438 13234 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_bdc97b774a964703b3868baf74306f10"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:33.222118 13234 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bdc97b774a964703b3868baf74306f10 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:33.222479 13604 tablet_service.cc:1515] Processing DeleteTablet for tablet c3b35ea656db4741a02e6746e1b049ec with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:33 UTC) from {username='slave'} at 127.0.0.1:45306
I20250830 07:54:33.222676 13606 tablet_service.cc:1515] Processing DeleteTablet for tablet d33a5d107c6849aca6eb48ffdf8a5463 with delete_type TABLET_DATA_DELETED (replaced by tablet 6492bd11e50d4900927db0de3757aa24) from {username='slave'} at 127.0.0.1:45306
I20250830 07:54:33.222968 13609 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed87c6793dd149a6a363f1977d816628. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:33.224228 13460 tablet_service.cc:1468] Processing CreateTablet for tablet 1476bb480bf747838613948875001c30 (DEFAULT_TABLE table=default.Table_33e47ed000c24372ac8f1b89c5fc38cb [id=9c9207d3b60e4781b1cc610cff92c8e6]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:33.224608 13460 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1476bb480bf747838613948875001c30. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:33.224912 13607 tablet_service.cc:1468] Processing CreateTablet for tablet 1476bb480bf747838613948875001c30 (DEFAULT_TABLE table=default.Table_33e47ed000c24372ac8f1b89c5fc38cb [id=9c9207d3b60e4781b1cc610cff92c8e6]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:33.225248 13607 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1476bb480bf747838613948875001c30. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:33.226097 13956 raft_consensus.cc:2802] T ccc90f6c867147cc9fe93c9ffa2e4802 P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Leader election won for term 1
I20250830 07:54:33.228209 13954 raft_consensus.cc:513] T c12cf30cc2aa4e12a20b9492af08a6f8 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } }
I20250830 07:54:33.229938 13753 tablet_service.cc:1468] Processing CreateTablet for tablet 7c8e248d938f4651ae13199122b08768 (DEFAULT_TABLE table=default.Table_b272b07ca0614cafb8c14f4e2132d255 [id=957201242ea748618cc610a5002a8684]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:33.230129 13629 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "c12cf30cc2aa4e12a20b9492af08a6f8" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9"
I20250830 07:54:33.230307 13753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c8e248d938f4651ae13199122b08768. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:33.230298 13629 raft_consensus.cc:3058] T c12cf30cc2aa4e12a20b9492af08a6f8 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:33.231153 13606 tablet_service.cc:1468] Processing CreateTablet for tablet 7c8e248d938f4651ae13199122b08768 (DEFAULT_TABLE table=default.Table_b272b07ca0614cafb8c14f4e2132d255 [id=957201242ea748618cc610a5002a8684]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:33.231455 13606 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c8e248d938f4651ae13199122b08768. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:33.237286 13604 tablet_service.cc:1468] Processing CreateTablet for tablet 05697181c0c149c79a395ff7525ea2af (DEFAULT_TABLE table=default.Table_ad824ae7601a4c6b9e756946853e09c7 [id=a2376c0724aa49b8b9545d111f12e1e6]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:33.237736 13604 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 05697181c0c149c79a395ff7525ea2af. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:33.238056 13954 leader_election.cc:290] T c12cf30cc2aa4e12a20b9492af08a6f8 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 election: Requested vote from peers 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743), 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967)
I20250830 07:54:33.243223 13755 tablet_service.cc:1468] Processing CreateTablet for tablet 05697181c0c149c79a395ff7525ea2af (DEFAULT_TABLE table=default.Table_ad824ae7601a4c6b9e756946853e09c7 [id=a2376c0724aa49b8b9545d111f12e1e6]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:33.243573 13755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 05697181c0c149c79a395ff7525ea2af. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:33.244968 13604 tablet_service.cc:1468] Processing CreateTablet for tablet 9b9c2ae8805a48f7959d6745677a96f2 (DEFAULT_TABLE table=default.Table_ed86b365cefe4412bcc0629921f39f3b [id=caf655ebda6a46eebb1e01c23b4cb8ca]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:33.245316 13604 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b9c2ae8805a48f7959d6745677a96f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:33.247829 13629 raft_consensus.cc:2466] T c12cf30cc2aa4e12a20b9492af08a6f8 P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2065c332f15a4739899af79f3669c3ba in term 1.
I20250830 07:54:33.248723 13750 tablet_service.cc:1468] Processing CreateTablet for tablet 5dac49aebcfa476d81547636cd4c6986 (DEFAULT_TABLE table=default.Table_c971df90450b4c17821d0f0a51ae48a3 [id=5be1411ad9f548f8b84fa170596c4cf5]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:33.249069 13750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5dac49aebcfa476d81547636cd4c6986. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:33.251190 13747 tablet_service.cc:1468] Processing CreateTablet for tablet 9b9c2ae8805a48f7959d6745677a96f2 (DEFAULT_TABLE table=default.Table_ed86b365cefe4412bcc0629921f39f3b [id=caf655ebda6a46eebb1e01c23b4cb8ca]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:33.251505 13747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b9c2ae8805a48f7959d6745677a96f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:33.253479 13753 tablet_service.cc:1468] Processing CreateTablet for tablet 861809cc50764aa89140e587489e2d88 (DEFAULT_TABLE table=default.Table_3ada97cf95b64b1fb2324762c4800a9a [id=80acb888dfc143c8a5927dcf693abb8f]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:33.253885 13753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 861809cc50764aa89140e587489e2d88. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:33.255600 13461 tablet_service.cc:1468] Processing CreateTablet for tablet 05697181c0c149c79a395ff7525ea2af (DEFAULT_TABLE table=default.Table_ad824ae7601a4c6b9e756946853e09c7 [id=a2376c0724aa49b8b9545d111f12e1e6]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:33.255940 13461 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 05697181c0c149c79a395ff7525ea2af. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:33.257658 13423 leader_election.cc:304] T c12cf30cc2aa4e12a20b9492af08a6f8 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 6b5e454d98894637b466ea27f1b647f9; no voters:
I20250830 07:54:33.259433 13463 tablet_service.cc:1468] Processing CreateTablet for tablet 9b9c2ae8805a48f7959d6745677a96f2 (DEFAULT_TABLE table=default.Table_ed86b365cefe4412bcc0629921f39f3b [id=caf655ebda6a46eebb1e01c23b4cb8ca]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:33.259752 13463 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b9c2ae8805a48f7959d6745677a96f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:33.260241 13754 tablet_service.cc:1468] Processing CreateTablet for tablet 8ab12188dddc4de69ac73dffb01d51a9 (DEFAULT_TABLE table=default.Table_e5d449720821486c8b3a39fd7f7661f4 [id=388ffc0a7b884c26811aab0ec8eccf71]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:33.260578 13754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ab12188dddc4de69ac73dffb01d51a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:33.261812 13608 tablet_service.cc:1468] Processing CreateTablet for tablet 8ab12188dddc4de69ac73dffb01d51a9 (DEFAULT_TABLE table=default.Table_e5d449720821486c8b3a39fd7f7661f4 [id=388ffc0a7b884c26811aab0ec8eccf71]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:33.262138 13608 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ab12188dddc4de69ac73dffb01d51a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:33.263144 13462 tablet_service.cc:1468] Processing CreateTablet for tablet 5dac49aebcfa476d81547636cd4c6986 (DEFAULT_TABLE table=default.Table_c971df90450b4c17821d0f0a51ae48a3 [id=5be1411ad9f548f8b84fa170596c4cf5]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:33.263458 13462 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5dac49aebcfa476d81547636cd4c6986. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:33.267174 13468 tablet_service.cc:1468] Processing CreateTablet for tablet 861809cc50764aa89140e587489e2d88 (DEFAULT_TABLE table=default.Table_3ada97cf95b64b1fb2324762c4800a9a [id=80acb888dfc143c8a5927dcf693abb8f]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:33.267504 13468 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 861809cc50764aa89140e587489e2d88. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:33.267985 13230 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_468e5a28c56b4b0c918d95fa29579a3f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:33.268530 13230 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_468e5a28c56b4b0c918d95fa29579a3f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:33.271166 13228 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_0ad9565d4f894c8ab1ac0aac02496e55"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250830 07:54:33.272027 13232 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_bbc2aa8f56d24f0d93b02e8e41950d1d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:33.272122 13228 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0ad9565d4f894c8ab1ac0aac02496e55 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250830 07:54:33.272500 13232 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bbc2aa8f56d24f0d93b02e8e41950d1d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:33.275261 13602 tablet_service.cc:1468] Processing CreateTablet for tablet 861809cc50764aa89140e587489e2d88 (DEFAULT_TABLE table=default.Table_3ada97cf95b64b1fb2324762c4800a9a [id=80acb888dfc143c8a5927dcf693abb8f]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:33.275601 13602 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 861809cc50764aa89140e587489e2d88. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:33.287499 13606 tablet_service.cc:1468] Processing CreateTablet for tablet 3167b609ed184decb4ccdb4945933ebb (DEFAULT_TABLE table=default.Table_6f9916f363e643e6a35574bb88e74729 [id=37a468bf42d2445d9fa2eab817a52b9f]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:33.287878 13606 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3167b609ed184decb4ccdb4945933ebb. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:33.288815 13749 tablet_service.cc:1468] Processing CreateTablet for tablet 9696d8531a174585b8fd83a2391c02f7 (DEFAULT_TABLE table=default.Table_08edc8805a67477588ae6df3db03fcff [id=740093c9d19a460287feb704a39a3de3]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:33.289202 13749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9696d8531a174585b8fd83a2391c02f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:33.292343 13607 tablet_service.cc:1468] Processing CreateTablet for tablet 9696d8531a174585b8fd83a2391c02f7 (DEFAULT_TABLE table=default.Table_08edc8805a67477588ae6df3db03fcff [id=740093c9d19a460287feb704a39a3de3]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:33.292672 13607 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9696d8531a174585b8fd83a2391c02f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:33.292647 13228 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_decad1c6025c4be0aa3aa8fea4ca31be"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:33.293102 13228 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_decad1c6025c4be0aa3aa8fea4ca31be in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:33.293475 13461 tablet_service.cc:1468] Processing CreateTablet for tablet 9696d8531a174585b8fd83a2391c02f7 (DEFAULT_TABLE table=default.Table_08edc8805a67477588ae6df3db03fcff [id=740093c9d19a460287feb704a39a3de3]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:33.294416 13775 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "c12cf30cc2aa4e12a20b9492af08a6f8" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f"
I20250830 07:54:33.296085 13609 tablet_service.cc:1468] Processing CreateTablet for tablet 5dac49aebcfa476d81547636cd4c6986 (DEFAULT_TABLE table=default.Table_c971df90450b4c17821d0f0a51ae48a3 [id=5be1411ad9f548f8b84fa170596c4cf5]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:33.296463 13609 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5dac49aebcfa476d81547636cd4c6986. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:33.297338 13461 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9696d8531a174585b8fd83a2391c02f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:33.295178 13750 tablet_service.cc:1468] Processing CreateTablet for tablet 3167b609ed184decb4ccdb4945933ebb (DEFAULT_TABLE table=default.Table_6f9916f363e643e6a35574bb88e74729 [id=37a468bf42d2445d9fa2eab817a52b9f]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:33.299551 13750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3167b609ed184decb4ccdb4945933ebb. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:33.300124 13232 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_90b2c2eb01e1430aae108708d2feb0de" } new_table_name: "default.Table_87aae2d576474fc19d521579db07906c" modify_external_catalogs: true
I20250830 07:54:33.302474 13885 ts_tablet_manager.cc:1918] T a04bf79de30a42a98e71f622efc90c22 P 6b5e454d98894637b466ea27f1b647f9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250830 07:54:33.302620 13885 log.cc:1199] T a04bf79de30a42a98e71f622efc90c22 P 6b5e454d98894637b466ea27f1b647f9: Deleting WAL directory at /tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/ts-1/wal/wals/a04bf79de30a42a98e71f622efc90c22
I20250830 07:54:33.294144 13463 tablet_service.cc:1468] Processing CreateTablet for tablet 3167b609ed184decb4ccdb4945933ebb (DEFAULT_TABLE table=default.Table_6f9916f363e643e6a35574bb88e74729 [id=37a468bf42d2445d9fa2eab817a52b9f]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:33.303104 13885 ts_tablet_manager.cc:1939] T a04bf79de30a42a98e71f622efc90c22 P 6b5e454d98894637b466ea27f1b647f9: Deleting consensus metadata
I20250830 07:54:33.303242 13463 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3167b609ed184decb4ccdb4945933ebb. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:33.304369 13220 catalog_manager.cc:4928] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): tablet a04bf79de30a42a98e71f622efc90c22 (table default.Table_f817d6b952384e64a8b6be555cc4db2f [id=320265dd7ec24f44acaec48bd44472db]) successfully deleted
W20250830 07:54:33.296995 13422 leader_election.cc:343] T c12cf30cc2aa4e12a20b9492af08a6f8 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:33.293932 13468 tablet_service.cc:1468] Processing CreateTablet for tablet 8ab12188dddc4de69ac73dffb01d51a9 (DEFAULT_TABLE table=default.Table_e5d449720821486c8b3a39fd7f7661f4 [id=388ffc0a7b884c26811aab0ec8eccf71]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:33.305347 13468 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ab12188dddc4de69ac73dffb01d51a9. 1 dirs total, 0 dirs full, 0 dirs failed
W20250830 07:54:33.307210 13232 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 6492bd11e50d4900927db0de3757aa24 consensus state has no leader
I20250830 07:54:33.310765 13232 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_a0fec9fe1cad48f6a9c37d2b76075510"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:33.311272 13232 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a0fec9fe1cad48f6a9c37d2b76075510 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:33.314477 13233 master_service.cc:948] ReplaceTablet: received request to replace tablet 02be33dc658d428fa55e59784a2342f6 from {username='slave'} at 127.0.0.1:42126
I20250830 07:54:33.314448 13230 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_ab15c29b389643c5a0603f49cc80372e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:33.314877 13230 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ab15c29b389643c5a0603f49cc80372e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:33.316748 13226 master_service.cc:948] ReplaceTablet: received request to replace tablet d1ae3812d72b419798736328da64b53c from {username='slave'} at 127.0.0.1:42126
I20250830 07:54:33.319037 13882 tablet_bootstrap.cc:492] T a78c522b9fa945e2879fb965d82fb359 P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:54:33.319195 13882 ts_tablet_manager.cc:1397] T a78c522b9fa945e2879fb965d82fb359 P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.289s user 0.007s sys 0.010s
I20250830 07:54:33.319202 13459 tablet_service.cc:1468] Processing CreateTablet for tablet 7c8e248d938f4651ae13199122b08768 (DEFAULT_TABLE table=default.Table_b272b07ca0614cafb8c14f4e2132d255 [id=957201242ea748618cc610a5002a8684]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:33.319509 13459 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c8e248d938f4651ae13199122b08768. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:33.319916 13882 raft_consensus.cc:357] T a78c522b9fa945e2879fb965d82fb359 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } }
I20250830 07:54:33.320091 13882 raft_consensus.cc:383] T a78c522b9fa945e2879fb965d82fb359 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:33.320149 13882 raft_consensus.cc:738] T a78c522b9fa945e2879fb965d82fb359 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:54:33.320343 13882 consensus_queue.cc:260] T a78c522b9fa945e2879fb965d82fb359 P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } }
I20250830 07:54:33.321132 13228 master_service.cc:948] ReplaceTablet: received request to replace tablet ff2267fb411942ff826e2a72bcb89cd7 from {username='slave'} at 127.0.0.1:42126
I20250830 07:54:33.322953 13229 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_c2c6c57d30d440d691f87632feae3633"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:33.323455 13229 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c2c6c57d30d440d691f87632feae3633 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:33.325726 13228 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_e5d449720821486c8b3a39fd7f7661f4" } new_table_name: "default.Table_941683cb836e4df7a4f2cf11c6b54f0e" modify_external_catalogs: true
I20250830 07:54:33.328658 13234 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_10f15bfc3b994681be0b939c3ae9d19d" } new_table_name: "default.Table_184b4720e5104a2888c109f1c0c273b9" modify_external_catalogs: true
I20250830 07:54:33.330338 13225 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_f61db5d7fd4a41d19d96612681e52b96"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:33.330861 13225 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f61db5d7fd4a41d19d96612681e52b96 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250830 07:54:33.333087 13423 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.209.2:38967, user_credentials={real_user=slave}} blocked reactor thread for 72745.9us
I20250830 07:54:33.335757 13897 raft_consensus.cc:491] T f398e12cd9f543738d5163354f8a9d9d P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:33.335935 13897 raft_consensus.cc:513] T f398e12cd9f543738d5163354f8a9d9d P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:33.336644 13897 leader_election.cc:290] T f398e12cd9f543738d5163354f8a9d9d P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
I20250830 07:54:33.337174 13486 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f398e12cd9f543738d5163354f8a9d9d" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
W20250830 07:54:33.337291 13703 leader_election.cc:343] T f398e12cd9f543738d5163354f8a9d9d P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Not found: Tablet not found: f398e12cd9f543738d5163354f8a9d9d
I20250830 07:54:33.342511 13227 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_2bad9e8dcdba4b8f89ab6ef5686d1270" } modify_external_catalogs: true
I20250830 07:54:33.342571 13954 raft_consensus.cc:2802] T c12cf30cc2aa4e12a20b9492af08a6f8 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election won for term 1
I20250830 07:54:33.342669 13227 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_2bad9e8dcdba4b8f89ab6ef5686d1270" } modify_external_catalogs: true
I20250830 07:54:33.342213 14024 consensus_queue.cc:1035] T 9e055d6089f541f799eddb5778eb2148 P 6b5e454d98894637b466ea27f1b647f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20250830 07:54:33.346616 13887 raft_consensus.cc:357] T d33a5d107c6849aca6eb48ffdf8a5463 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } }
I20250830 07:54:33.346802 13887 raft_consensus.cc:383] T d33a5d107c6849aca6eb48ffdf8a5463 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:33.346899 13887 raft_consensus.cc:738] T d33a5d107c6849aca6eb48ffdf8a5463 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:54:33.347172 13887 consensus_queue.cc:260] T d33a5d107c6849aca6eb48ffdf8a5463 P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } }
I20250830 07:54:33.348095 13486 raft_consensus.cc:2466] T f398e12cd9f543738d5163354f8a9d9d P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 0.
I20250830 07:54:33.348956 13701 leader_election.cc:304] T f398e12cd9f543738d5163354f8a9d9d P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:54:33.349668 13897 raft_consensus.cc:2802] T f398e12cd9f543738d5163354f8a9d9d P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:54:33.349764 13897 raft_consensus.cc:491] T f398e12cd9f543738d5163354f8a9d9d P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:54:33.349869 13897 raft_consensus.cc:3058] T f398e12cd9f543738d5163354f8a9d9d P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:33.352630 13897 raft_consensus.cc:513] T f398e12cd9f543738d5163354f8a9d9d P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
W20250830 07:54:33.354851 13703 leader_election.cc:343] T f398e12cd9f543738d5163354f8a9d9d P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Not found: Tablet not found: f398e12cd9f543738d5163354f8a9d9d
I20250830 07:54:33.356037 13486 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f398e12cd9f543738d5163354f8a9d9d" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba"
I20250830 07:54:33.356213 13486 raft_consensus.cc:3058] T f398e12cd9f543738d5163354f8a9d9d P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:33.356828 13897 leader_election.cc:290] T f398e12cd9f543738d5163354f8a9d9d P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Requested vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
I20250830 07:54:33.357268 13884 ts_tablet_manager.cc:1918] T 9d00ee83780e4cf780ca92f1504d26b5 P 9b057ade5dce45af9f8bf0bedf8b917f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250830 07:54:33.357398 13884 log.cc:1199] T 9d00ee83780e4cf780ca92f1504d26b5 P 9b057ade5dce45af9f8bf0bedf8b917f: Deleting WAL directory at /tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/ts-2/wal/wals/9d00ee83780e4cf780ca92f1504d26b5
I20250830 07:54:33.357836 13884 ts_tablet_manager.cc:1939] T 9d00ee83780e4cf780ca92f1504d26b5 P 9b057ade5dce45af9f8bf0bedf8b917f: Deleting consensus metadata
I20250830 07:54:33.359122 13219 catalog_manager.cc:4928] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): tablet 9d00ee83780e4cf780ca92f1504d26b5 (table default.Table_690616d54f014a969bb63de44038e18b [id=55f67297d5ac42c280ea932d74e3ad37]) successfully deleted
I20250830 07:54:33.360386 13954 raft_consensus.cc:695] T c12cf30cc2aa4e12a20b9492af08a6f8 P 2065c332f15a4739899af79f3669c3ba [term 1 LEADER]: Becoming Leader. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Running, Role: LEADER
I20250830 07:54:33.361105 13954 consensus_queue.cc:237] T c12cf30cc2aa4e12a20b9492af08a6f8 P 2065c332f15a4739899af79f3669c3ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } }
I20250830 07:54:33.361397 13233 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet 02be33dc658d428fa55e59784a2342f6
I20250830 07:54:33.361900 13233 catalog_manager.cc:6652] ReplaceTablet: tablet 02be33dc658d428fa55e59784a2342f6 deleted and replaced by tablet 69d6daeb7c774fd48ed296f52ed7c6a6
I20250830 07:54:33.363132 13226 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet d1ae3812d72b419798736328da64b53c
I20250830 07:54:33.363590 13226 catalog_manager.cc:6652] ReplaceTablet: tablet d1ae3812d72b419798736328da64b53c deleted and replaced by tablet e6491d149c0646848680cfdadb6fc76c
I20250830 07:54:33.364375 13755 tablet_service.cc:1515] Processing DeleteTablet for tablet d1ae3812d72b419798736328da64b53c with delete_type TABLET_DATA_DELETED (replaced by tablet e6491d149c0646848680cfdadb6fc76c) from {username='slave'} at 127.0.0.1:45460
I20250830 07:54:33.364528 13602 tablet_service.cc:1515] Processing DeleteTablet for tablet d1ae3812d72b419798736328da64b53c with delete_type TABLET_DATA_DELETED (replaced by tablet e6491d149c0646848680cfdadb6fc76c) from {username='slave'} at 127.0.0.1:45306
I20250830 07:54:33.364746 13227 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet b480f5eb03804baeb61cd0424d70faf5
I20250830 07:54:33.365717 13755 tablet_service.cc:1515] Processing DeleteTablet for tablet b480f5eb03804baeb61cd0424d70faf5 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:33 UTC) from {username='slave'} at 127.0.0.1:45460
I20250830 07:54:33.365995 13465 tablet_service.cc:1515] Processing DeleteTablet for tablet d1ae3812d72b419798736328da64b53c with delete_type TABLET_DATA_DELETED (replaced by tablet e6491d149c0646848680cfdadb6fc76c) from {username='slave'} at 127.0.0.1:37956
I20250830 07:54:33.365995 13602 tablet_service.cc:1515] Processing DeleteTablet for tablet b480f5eb03804baeb61cd0424d70faf5 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:33 UTC) from {username='slave'} at 127.0.0.1:45306
I20250830 07:54:33.367071 13232 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_d020e7f838c24eb58a679947a81cf706" } modify_external_catalogs: true
I20250830 07:54:33.367274 13232 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_d020e7f838c24eb58a679947a81cf706" } modify_external_catalogs: true
W20250830 07:54:33.368729 13228 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 8ab12188dddc4de69ac73dffb01d51a9 consensus state has no leader
I20250830 07:54:33.368784 13465 tablet_service.cc:1515] Processing DeleteTablet for tablet b480f5eb03804baeb61cd0424d70faf5 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:33 UTC) from {username='slave'} at 127.0.0.1:37956
I20250830 07:54:33.369096 13461 tablet_service.cc:1515] Processing DeleteTablet for tablet 02be33dc658d428fa55e59784a2342f6 with delete_type TABLET_DATA_DELETED (replaced by tablet 69d6daeb7c774fd48ed296f52ed7c6a6) from {username='slave'} at 127.0.0.1:37956
W20250830 07:54:33.369143 13234 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet c2f5f79547184009a0863b695a833694 consensus state has no leader
I20250830 07:54:33.372016 13228 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_9961dc66c9e44ac280c4a5502d5c8010" } modify_external_catalogs: true
I20250830 07:54:33.372203 13228 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_9961dc66c9e44ac280c4a5502d5c8010" } modify_external_catalogs: true
I20250830 07:54:33.373489 13234 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_9f030036c0c840a18e8d877d724be6b5" } modify_external_catalogs: true
I20250830 07:54:33.373709 13234 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_9f030036c0c840a18e8d877d724be6b5" } modify_external_catalogs: true
I20250830 07:54:33.376119 13486 raft_consensus.cc:2466] T f398e12cd9f543738d5163354f8a9d9d P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 1.
I20250830 07:54:33.376652 13701 leader_election.cc:304] T f398e12cd9f543738d5163354f8a9d9d P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
W20250830 07:54:33.377360 13219 catalog_manager.cc:4895] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): delete failed for tablet 91ab8c468c8143b9ae11b839a95a26fd because the tablet was not found. No further retry: Not found: Tablet not found: 91ab8c468c8143b9ae11b839a95a26fd
I20250830 07:54:33.377526 13897 raft_consensus.cc:2802] T f398e12cd9f543738d5163354f8a9d9d P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election won for term 1
W20250830 07:54:33.378351 13219 catalog_manager.cc:4908] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): delete failed for tablet d1ae3812d72b419798736328da64b53c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d1ae3812d72b419798736328da64b53c already in progress: creating tablet
I20250830 07:54:33.378670 14026 consensus_queue.cc:1035] T 5aef6fd239ba43478cd978fa5d29b26e P 6b5e454d98894637b466ea27f1b647f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20250830 07:54:33.380756 13219 catalog_manager.cc:4895] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): delete failed for tablet b480f5eb03804baeb61cd0424d70faf5 because the tablet was not found. No further retry: Not found: Tablet not found: b480f5eb03804baeb61cd0424d70faf5
I20250830 07:54:33.381979 13883 ts_tablet_manager.cc:1918] T 778f6766c47f4a86b5dea60560f67d5c P 2065c332f15a4739899af79f3669c3ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250830 07:54:33.382179 13883 log.cc:1199] T 778f6766c47f4a86b5dea60560f67d5c P 2065c332f15a4739899af79f3669c3ba: Deleting WAL directory at /tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/ts-0/wal/wals/778f6766c47f4a86b5dea60560f67d5c
I20250830 07:54:33.382558 13883 ts_tablet_manager.cc:1939] T 778f6766c47f4a86b5dea60560f67d5c P 2065c332f15a4739899af79f3669c3ba: Deleting consensus metadata
I20250830 07:54:33.382694 13747 tablet_service.cc:1468] Processing CreateTablet for tablet 48b422b125154fbdbb9c995dc372d128 (DEFAULT_TABLE table=default.Table_ee2734eae1204d188a3c3e1aade9d7ec [id=ee5e5b17ad024d64bef5883d6d68e559]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:33.383090 13747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 48b422b125154fbdbb9c995dc372d128. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:33.383445 13883 tablet_replica.cc:331] T ff2267fb411942ff826e2a72bcb89cd7 P 2065c332f15a4739899af79f3669c3ba: stopping tablet replica
I20250830 07:54:33.383641 13883 raft_consensus.cc:2241] T ff2267fb411942ff826e2a72bcb89cd7 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Raft consensus shutting down.
I20250830 07:54:33.383776 13883 raft_consensus.cc:2270] T ff2267fb411942ff826e2a72bcb89cd7 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Raft consensus is shut down!
I20250830 07:54:33.383816 13607 tablet_service.cc:1515] Processing DeleteTablet for tablet 02be33dc658d428fa55e59784a2342f6 with delete_type TABLET_DATA_DELETED (replaced by tablet 69d6daeb7c774fd48ed296f52ed7c6a6) from {username='slave'} at 127.0.0.1:45306
I20250830 07:54:33.384322 13883 ts_tablet_manager.cc:1905] T ff2267fb411942ff826e2a72bcb89cd7 P 2065c332f15a4739899af79f3669c3ba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250830 07:54:33.385221 13229 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_f6365a8a7d034d06824a36d2f6033caf" } modify_external_catalogs: true
I20250830 07:54:33.385336 13229 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_f6365a8a7d034d06824a36d2f6033caf" } modify_external_catalogs: true
I20250830 07:54:33.386234 14026 raft_consensus.cc:491] T d33a5d107c6849aca6eb48ffdf8a5463 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:33.386386 13218 catalog_manager.cc:4928] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): tablet 778f6766c47f4a86b5dea60560f67d5c (table default.Table_d2ac5bc3c0c246c4bb6c797de6efedae [id=08a2c4f9b62b465cb1bf7983bc8b802d]) successfully deleted
I20250830 07:54:33.386405 14026 raft_consensus.cc:513] T d33a5d107c6849aca6eb48ffdf8a5463 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } }
I20250830 07:54:33.386576 13755 tablet_service.cc:1468] Processing CreateTablet for tablet 008827b3d09d464b9182fb42dc2170d5 (DEFAULT_TABLE table=default.Table_c31365a39be74e47b45faf638fcce13b [id=30523f1b52984b3a82b807d718278255]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:33.386796 13754 tablet_service.cc:1468] Processing CreateTablet for tablet 2009012fddc24e4fb7ad0fab33a1103b (DEFAULT_TABLE table=default.Table_3af4480a9af740f598919322e7fc5efc [id=b3fced981b2a4b44a8eab43675699ba5]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:33.386947 13755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 008827b3d09d464b9182fb42dc2170d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:33.387158 13754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2009012fddc24e4fb7ad0fab33a1103b. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:33.387136 14026 leader_election.cc:290] T d33a5d107c6849aca6eb48ffdf8a5463 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:33.388089 13775 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "d33a5d107c6849aca6eb48ffdf8a5463" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
W20250830 07:54:33.388629 13562 leader_election.cc:343] T d33a5d107c6849aca6eb48ffdf8a5463 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:33.389032 13609 tablet_service.cc:1468] Processing CreateTablet for tablet 48b422b125154fbdbb9c995dc372d128 (DEFAULT_TABLE table=default.Table_ee2734eae1204d188a3c3e1aade9d7ec [id=ee5e5b17ad024d64bef5883d6d68e559]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:33.389441 13609 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 48b422b125154fbdbb9c995dc372d128. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:33.393483 13225 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_184b4720e5104a2888c109f1c0c273b9" } new_table_name: "default.Table_4abf499bcf8a4fd88fd739d3a1daee3a" modify_external_catalogs: true
I20250830 07:54:33.394804 13606 tablet_service.cc:1468] Processing CreateTablet for tablet 008827b3d09d464b9182fb42dc2170d5 (DEFAULT_TABLE table=default.Table_c31365a39be74e47b45faf638fcce13b [id=30523f1b52984b3a82b807d718278255]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:33.394918 13227 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_b31f9b26da3445538f49f6cdb78f802c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250830 07:54:33.395339 13606 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 008827b3d09d464b9182fb42dc2170d5. 1 dirs total, 0 dirs full, 0 dirs failed
W20250830 07:54:33.395437 13227 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b31f9b26da3445538f49f6cdb78f802c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:33.397233 14024 raft_consensus.cc:491] T 7ef98dbbdf5848038a2da6140e126301 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:33.397348 13226 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_2d4c0acd17bb40aaa870225e92053ae8" } new_table_name: "default.Table_f8d97639ebb343a398aade2f1182b5d7" modify_external_catalogs: true
I20250830 07:54:33.397446 14024 raft_consensus.cc:513] T 7ef98dbbdf5848038a2da6140e126301 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:33.398852 13775 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "7ef98dbbdf5848038a2da6140e126301" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:33.399036 13775 raft_consensus.cc:2466] T 7ef98dbbdf5848038a2da6140e126301 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b5e454d98894637b466ea27f1b647f9 in term 0.
I20250830 07:54:33.399442 13562 leader_election.cc:304] T 7ef98dbbdf5848038a2da6140e126301 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f; no voters:
I20250830 07:54:33.399693 14026 raft_consensus.cc:2802] T 7ef98dbbdf5848038a2da6140e126301 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:54:33.399770 14026 raft_consensus.cc:491] T 7ef98dbbdf5848038a2da6140e126301 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:54:33.399857 14026 raft_consensus.cc:3058] T 7ef98dbbdf5848038a2da6140e126301 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:33.401276 13607 tablet_service.cc:1468] Processing CreateTablet for tablet 2009012fddc24e4fb7ad0fab33a1103b (DEFAULT_TABLE table=default.Table_3af4480a9af740f598919322e7fc5efc [id=b3fced981b2a4b44a8eab43675699ba5]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:33.401599 13607 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2009012fddc24e4fb7ad0fab33a1103b. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:33.402246 14026 raft_consensus.cc:513] T 7ef98dbbdf5848038a2da6140e126301 P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:33.403445 14026 leader_election.cc:290] T 7ef98dbbdf5848038a2da6140e126301 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 election: Requested vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:33.403697 13775 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "7ef98dbbdf5848038a2da6140e126301" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f"
I20250830 07:54:33.403842 13775 raft_consensus.cc:3058] T 7ef98dbbdf5848038a2da6140e126301 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:33.406786 13775 raft_consensus.cc:2466] T 7ef98dbbdf5848038a2da6140e126301 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b5e454d98894637b466ea27f1b647f9 in term 1.
I20250830 07:54:33.407209 13562 leader_election.cc:304] T 7ef98dbbdf5848038a2da6140e126301 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f; no voters:
I20250830 07:54:33.407577 14026 raft_consensus.cc:2802] T 7ef98dbbdf5848038a2da6140e126301 P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Leader election won for term 1
I20250830 07:54:33.407719 14026 raft_consensus.cc:695] T 7ef98dbbdf5848038a2da6140e126301 P 6b5e454d98894637b466ea27f1b647f9 [term 1 LEADER]: Becoming Leader. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Running, Role: LEADER
I20250830 07:54:33.407984 14026 consensus_queue.cc:237] T 7ef98dbbdf5848038a2da6140e126301 P 6b5e454d98894637b466ea27f1b647f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:33.409960 13232 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet e4f1ff6026bb45e28e63c27c83399d72
I20250830 07:54:33.411486 13750 tablet_service.cc:1515] Processing DeleteTablet for tablet 02be33dc658d428fa55e59784a2342f6 with delete_type TABLET_DATA_DELETED (replaced by tablet 69d6daeb7c774fd48ed296f52ed7c6a6) from {username='slave'} at 127.0.0.1:45460
I20250830 07:54:33.411255 13602 tablet_service.cc:1515] Processing DeleteTablet for tablet e4f1ff6026bb45e28e63c27c83399d72 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:33 UTC) from {username='slave'} at 127.0.0.1:45306
I20250830 07:54:33.411906 13228 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet ed87c6793dd149a6a363f1977d816628
W20250830 07:54:33.412191 13219 catalog_manager.cc:4908] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): delete failed for tablet 02be33dc658d428fa55e59784a2342f6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 02be33dc658d428fa55e59784a2342f6 already in progress: creating tablet
I20250830 07:54:33.412506 13885 tablet_replica.cc:331] T 5aef6fd239ba43478cd978fa5d29b26e P 6b5e454d98894637b466ea27f1b647f9: stopping tablet replica
I20250830 07:54:33.412685 13885 raft_consensus.cc:2241] T 5aef6fd239ba43478cd978fa5d29b26e P 6b5e454d98894637b466ea27f1b647f9 [term 1 LEADER]: Raft consensus shutting down.
I20250830 07:54:33.412885 13885 pending_rounds.cc:70] T 5aef6fd239ba43478cd978fa5d29b26e P 6b5e454d98894637b466ea27f1b647f9: Trying to abort 1 pending ops.
I20250830 07:54:33.412596 13602 tablet_service.cc:1515] Processing DeleteTablet for tablet ed87c6793dd149a6a363f1977d816628 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:33 UTC) from {username='slave'} at 127.0.0.1:45306
I20250830 07:54:33.412951 13885 pending_rounds.cc:77] T 5aef6fd239ba43478cd978fa5d29b26e P 6b5e454d98894637b466ea27f1b647f9: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7194789775250452480 op_type: NO_OP noop_request { }
I20250830 07:54:33.413072 13885 raft_consensus.cc:2887] T 5aef6fd239ba43478cd978fa5d29b26e P 6b5e454d98894637b466ea27f1b647f9 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20250830 07:54:33.413204 13885 raft_consensus.cc:2270] T 5aef6fd239ba43478cd978fa5d29b26e P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250830 07:54:33.413318 13234 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet afb132e8a5b14a029e005e375f276348
I20250830 07:54:33.414065 13885 ts_tablet_manager.cc:1905] T 5aef6fd239ba43478cd978fa5d29b26e P 6b5e454d98894637b466ea27f1b647f9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250830 07:54:33.414172 13602 tablet_service.cc:1515] Processing DeleteTablet for tablet afb132e8a5b14a029e005e375f276348 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:33 UTC) from {username='slave'} at 127.0.0.1:45306
I20250830 07:54:33.415628 14024 leader_election.cc:290] T 7ef98dbbdf5848038a2da6140e126301 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:33.417055 13897 raft_consensus.cc:695] T f398e12cd9f543738d5163354f8a9d9d P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 LEADER]: Becoming Leader. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Running, Role: LEADER
I20250830 07:54:33.417397 13897 consensus_queue.cc:237] T f398e12cd9f543738d5163354f8a9d9d P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:33.418609 13750 tablet_service.cc:1515] Processing DeleteTablet for tablet ed87c6793dd149a6a363f1977d816628 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:33 UTC) from {username='slave'} at 127.0.0.1:45460
W20250830 07:54:33.419456 13219 catalog_manager.cc:4908] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): delete failed for tablet ed87c6793dd149a6a363f1977d816628 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ed87c6793dd149a6a363f1977d816628 already in progress: creating tablet
I20250830 07:54:33.419925 13882 ts_tablet_manager.cc:1428] T a78c522b9fa945e2879fb965d82fb359 P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.101s user 0.002s sys 0.000s
I20250830 07:54:33.421223 13882 tablet_bootstrap.cc:492] T f846a23f0be046028cc2472de88b71c4 P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:54:33.424777 13229 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet 252cc8fed9624222b26976bf54db68fb
W20250830 07:54:33.426208 13225 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet c2f5f79547184009a0863b695a833694 consensus state has no leader
I20250830 07:54:33.426250 13750 tablet_service.cc:1515] Processing DeleteTablet for tablet 252cc8fed9624222b26976bf54db68fb with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:33 UTC) from {username='slave'} at 127.0.0.1:45460
I20250830 07:54:33.426492 13602 tablet_service.cc:1515] Processing DeleteTablet for tablet 252cc8fed9624222b26976bf54db68fb with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:33 UTC) from {username='slave'} at 127.0.0.1:45306
W20250830 07:54:33.427356 13219 catalog_manager.cc:4908] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): delete failed for tablet 252cc8fed9624222b26976bf54db68fb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 252cc8fed9624222b26976bf54db68fb already in progress: creating tablet
I20250830 07:54:33.427764 13956 raft_consensus.cc:695] T ccc90f6c867147cc9fe93c9ffa2e4802 P 6b5e454d98894637b466ea27f1b647f9 [term 1 LEADER]: Becoming Leader. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Running, Role: LEADER
I20250830 07:54:33.428072 13956 consensus_queue.cc:237] T ccc90f6c867147cc9fe93c9ffa2e4802 P 6b5e454d98894637b466ea27f1b647f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:33.430294 13894 raft_consensus.cc:491] T 7ef98dbbdf5848038a2da6140e126301 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:33.430533 13465 tablet_service.cc:1468] Processing CreateTablet for tablet 2009012fddc24e4fb7ad0fab33a1103b (DEFAULT_TABLE table=default.Table_3af4480a9af740f598919322e7fc5efc [id=b3fced981b2a4b44a8eab43675699ba5]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:33.432056 13461 tablet_service.cc:1468] Processing CreateTablet for tablet 48b422b125154fbdbb9c995dc372d128 (DEFAULT_TABLE table=default.Table_ee2734eae1204d188a3c3e1aade9d7ec [id=ee5e5b17ad024d64bef5883d6d68e559]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:33.432596 13463 tablet_service.cc:1468] Processing CreateTablet for tablet 008827b3d09d464b9182fb42dc2170d5 (DEFAULT_TABLE table=default.Table_c31365a39be74e47b45faf638fcce13b [id=30523f1b52984b3a82b807d718278255]), partition=RANGE (key) PARTITION UNBOUNDED
W20250830 07:54:33.432706 13225 catalog_manager.cc:5415] Ignoring report from unknown tablet 5ce773ce68f649b1bf51f0dd901cb04f
I20250830 07:54:33.433189 13894 raft_consensus.cc:513] T 7ef98dbbdf5848038a2da6140e126301 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:33.433773 13894 leader_election.cc:290] T 7ef98dbbdf5848038a2da6140e126301 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:33.433828 13886 tablet_bootstrap.cc:492] T ccc90f6c867147cc9fe93c9ffa2e4802 P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:54:33.433974 13886 ts_tablet_manager.cc:1397] T ccc90f6c867147cc9fe93c9ffa2e4802 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.309s user 0.003s sys 0.000s
I20250830 07:54:33.434283 13488 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "d33a5d107c6849aca6eb48ffdf8a5463" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:54:33.434692 13886 raft_consensus.cc:357] T ccc90f6c867147cc9fe93c9ffa2e4802 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:33.434872 13886 raft_consensus.cc:383] T ccc90f6c867147cc9fe93c9ffa2e4802 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:33.434870 13629 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "7ef98dbbdf5848038a2da6140e126301" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:33.434976 13886 raft_consensus.cc:738] T ccc90f6c867147cc9fe93c9ffa2e4802 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:54:33.435199 13886 consensus_queue.cc:260] T ccc90f6c867147cc9fe93c9ffa2e4802 P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:33.435832 13886 ts_tablet_manager.cc:1428] T ccc90f6c867147cc9fe93c9ffa2e4802 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20250830 07:54:33.436107 13886 tablet_bootstrap.cc:492] T 4b7eff24965f4f3ebfbf70dc82b7cce3 P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:54:33.436136 13488 raft_consensus.cc:2466] T d33a5d107c6849aca6eb48ffdf8a5463 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b5e454d98894637b466ea27f1b647f9 in term 0.
I20250830 07:54:33.436764 13460 tablet_service.cc:1515] Processing DeleteTablet for tablet e4f1ff6026bb45e28e63c27c83399d72 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:33 UTC) from {username='slave'} at 127.0.0.1:37956
W20250830 07:54:33.436872 13226 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet bee1b5f6f04740dba64cdcb094e26113 consensus state has no leader
I20250830 07:54:33.437119 13561 leader_election.cc:304] T d33a5d107c6849aca6eb48ffdf8a5463 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 6b5e454d98894637b466ea27f1b647f9; no voters: 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:54:33.438191 13894 raft_consensus.cc:491] T 4ab63ff59d4e4ec2b7b64d605545a870 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:33.438252 13886 tablet_bootstrap.cc:654] T 4b7eff24965f4f3ebfbf70dc82b7cce3 P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:33.438323 13894 raft_consensus.cc:513] T 4ab63ff59d4e4ec2b7b64d605545a870 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:33.439093 14030 raft_consensus.cc:491] T 5aef6fd239ba43478cd978fa5d29b26e P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:33.439208 14030 raft_consensus.cc:513] T 5aef6fd239ba43478cd978fa5d29b26e P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:33.439350 13899 raft_consensus.cc:2802] T d33a5d107c6849aca6eb48ffdf8a5463 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:54:33.439456 13899 raft_consensus.cc:491] T d33a5d107c6849aca6eb48ffdf8a5463 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:54:33.439684 13899 raft_consensus.cc:3058] T d33a5d107c6849aca6eb48ffdf8a5463 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:33.439805 14023 raft_consensus.cc:491] T ff2267fb411942ff826e2a72bcb89cd7 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:33.440124 14030 leader_election.cc:290] T 5aef6fd239ba43478cd978fa5d29b26e P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
I20250830 07:54:33.440120 13628 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "5aef6fd239ba43478cd978fa5d29b26e" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:33.439980 14023 raft_consensus.cc:513] T ff2267fb411942ff826e2a72bcb89cd7 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
W20250830 07:54:33.440577 13703 leader_election.cc:343] T 5aef6fd239ba43478cd978fa5d29b26e P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: Tablet not RUNNING: STOPPED
I20250830 07:54:33.440877 13754 tablet_service.cc:1515] Processing DeleteTablet for tablet e4f1ff6026bb45e28e63c27c83399d72 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:33 UTC) from {username='slave'} at 127.0.0.1:45460
I20250830 07:54:33.440846 13629 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "4ab63ff59d4e4ec2b7b64d605545a870" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:33.441040 13629 raft_consensus.cc:2466] T 4ab63ff59d4e4ec2b7b64d605545a870 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2065c332f15a4739899af79f3669c3ba in term 0.
W20250830 07:54:33.441337 13219 catalog_manager.cc:4895] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): delete failed for tablet e4f1ff6026bb45e28e63c27c83399d72 because the tablet was not found. No further retry: Not found: Tablet not found: e4f1ff6026bb45e28e63c27c83399d72
I20250830 07:54:33.442057 13894 leader_election.cc:290] T 4ab63ff59d4e4ec2b7b64d605545a870 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:33.438057 13466 tablet_service.cc:1515] Processing DeleteTablet for tablet ed87c6793dd149a6a363f1977d816628 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:33 UTC) from {username='slave'} at 127.0.0.1:37956
I20250830 07:54:33.442447 13602 tablet_service.cc:1468] Processing CreateTablet for tablet 7238db7e31484201a30cf4c035d82aff (DEFAULT_TABLE table=default.Table_77b02efa7d514f4291acb38f6f870ff9 [id=0e4bba403b27442cb6e7f5b50ff4a39f]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:33.442775 13602 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7238db7e31484201a30cf4c035d82aff. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:33.442938 13754 tablet_service.cc:1468] Processing CreateTablet for tablet 7238db7e31484201a30cf4c035d82aff (DEFAULT_TABLE table=default.Table_77b02efa7d514f4291acb38f6f870ff9 [id=0e4bba403b27442cb6e7f5b50ff4a39f]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:33.442880 13485 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "7ef98dbbdf5848038a2da6140e126301" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba"
I20250830 07:54:33.443286 13754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7238db7e31484201a30cf4c035d82aff. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:33.443305 13485 raft_consensus.cc:3058] T 7ef98dbbdf5848038a2da6140e126301 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:33.446108 13423 leader_election.cc:304] T 4ab63ff59d4e4ec2b7b64d605545a870 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 6b5e454d98894637b466ea27f1b647f9; no voters:
I20250830 07:54:33.446410 13488 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "7ef98dbbdf5848038a2da6140e126301" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:54:33.446952 13604 tablet_service.cc:1468] Processing CreateTablet for tablet 05da843c0fe4482a926e410e06b22461 (DEFAULT_TABLE table=default.Table_8b504248201347288df9b3fcd2be2d2d [id=1c6a6eb2049745af8613285392d2c2e9]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:33.447346 13604 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 05da843c0fe4482a926e410e06b22461. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:33.447337 13775 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "7ef98dbbdf5848038a2da6140e126301" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:33.447535 13775 raft_consensus.cc:2391] T 7ef98dbbdf5848038a2da6140e126301 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2065c332f15a4739899af79f3669c3ba in current term 1: Already voted for candidate 6b5e454d98894637b466ea27f1b647f9 in this term.
I20250830 07:54:33.447849 13774 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "4ab63ff59d4e4ec2b7b64d605545a870" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:33.448036 13774 raft_consensus.cc:2466] T 4ab63ff59d4e4ec2b7b64d605545a870 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2065c332f15a4739899af79f3669c3ba in term 0.
I20250830 07:54:33.448043 13488 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "ff2267fb411942ff826e2a72bcb89cd7" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
W20250830 07:54:33.448772 13561 leader_election.cc:343] T ff2267fb411942ff826e2a72bcb89cd7 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): Illegal state: Tablet not RUNNING: STOPPED
I20250830 07:54:33.448995 13755 tablet_service.cc:1515] Processing DeleteTablet for tablet afb132e8a5b14a029e005e375f276348 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:33 UTC) from {username='slave'} at 127.0.0.1:45460
I20250830 07:54:33.449209 13466 tablet_service.cc:1515] Processing DeleteTablet for tablet 252cc8fed9624222b26976bf54db68fb with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:33 UTC) from {username='slave'} at 127.0.0.1:37956
I20250830 07:54:33.449599 13465 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2009012fddc24e4fb7ad0fab33a1103b. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:33.450363 13775 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "ff2267fb411942ff826e2a72bcb89cd7" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
W20250830 07:54:33.450522 13219 catalog_manager.cc:4895] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): delete failed for tablet afb132e8a5b14a029e005e375f276348 because the tablet was not found. No further retry: Not found: Tablet not found: afb132e8a5b14a029e005e375f276348
I20250830 07:54:33.450528 13775 raft_consensus.cc:2466] T ff2267fb411942ff826e2a72bcb89cd7 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b5e454d98894637b466ea27f1b647f9 in term 0.
I20250830 07:54:33.450789 14023 leader_election.cc:290] T ff2267fb411942ff826e2a72bcb89cd7 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:33.450855 13562 leader_election.cc:304] T ff2267fb411942ff826e2a72bcb89cd7 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 2065c332f15a4739899af79f3669c3ba
I20250830 07:54:33.451895 13755 tablet_service.cc:1468] Processing CreateTablet for tablet 05da843c0fe4482a926e410e06b22461 (DEFAULT_TABLE table=default.Table_8b504248201347288df9b3fcd2be2d2d [id=1c6a6eb2049745af8613285392d2c2e9]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:33.454723 14023 raft_consensus.cc:2802] T ff2267fb411942ff826e2a72bcb89cd7 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:54:33.455235 14023 raft_consensus.cc:491] T ff2267fb411942ff826e2a72bcb89cd7 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:54:33.452647 14030 consensus_queue.cc:1035] T 7ed22d9617024d55a8add137e7971061 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:54:33.456141 13755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 05da843c0fe4482a926e410e06b22461. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:33.456291 14023 raft_consensus.cc:3058] T ff2267fb411942ff826e2a72bcb89cd7 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:33.456585 13485 raft_consensus.cc:2466] T 7ef98dbbdf5848038a2da6140e126301 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b5e454d98894637b466ea27f1b647f9 in term 1.
I20250830 07:54:33.456848 13488 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "5aef6fd239ba43478cd978fa5d29b26e" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:54:33.459890 13886 tablet_bootstrap.cc:492] T 4b7eff24965f4f3ebfbf70dc82b7cce3 P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:54:33.460041 13886 ts_tablet_manager.cc:1397] T 4b7eff24965f4f3ebfbf70dc82b7cce3 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.024s user 0.006s sys 0.000s
I20250830 07:54:33.460194 13899 raft_consensus.cc:513] T d33a5d107c6849aca6eb48ffdf8a5463 P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } }
I20250830 07:54:33.460742 13886 raft_consensus.cc:357] T 4b7eff24965f4f3ebfbf70dc82b7cce3 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } }
I20250830 07:54:33.460919 13886 raft_consensus.cc:383] T 4b7eff24965f4f3ebfbf70dc82b7cce3 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:33.461014 13886 raft_consensus.cc:738] T 4b7eff24965f4f3ebfbf70dc82b7cce3 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:54:33.461107 13887 ts_tablet_manager.cc:1428] T d33a5d107c6849aca6eb48ffdf8a5463 P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.345s user 0.000s sys 0.009s
I20250830 07:54:33.461226 13886 consensus_queue.cc:260] T 4b7eff24965f4f3ebfbf70dc82b7cce3 P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } }
I20250830 07:54:33.461426 13462 tablet_service.cc:1515] Processing DeleteTablet for tablet afb132e8a5b14a029e005e375f276348 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:33 UTC) from {username='slave'} at 127.0.0.1:37956
I20250830 07:54:33.461577 13461 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 48b422b125154fbdbb9c995dc372d128. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:33.461866 13886 ts_tablet_manager.cc:1428] T 4b7eff24965f4f3ebfbf70dc82b7cce3 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20250830 07:54:33.462144 13886 tablet_bootstrap.cc:492] T ef16b9e2d444489699f4db1ac26d5f6c P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:54:33.463253 13608 tablet_service.cc:1468] Processing CreateTablet for tablet bee1b5f6f04740dba64cdcb094e26113 (DEFAULT_TABLE table=default.Table_f8d97639ebb343a398aade2f1182b5d7 [id=f98275692d824c13a75bb752d399d7dd]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:33.463634 13608 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bee1b5f6f04740dba64cdcb094e26113. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:33.464190 13886 tablet_bootstrap.cc:654] T ef16b9e2d444489699f4db1ac26d5f6c P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:33.467410 13603 tablet_service.cc:1468] Processing CreateTablet for tablet d912c69d8722403aa56cbbde4ce59782 (DEFAULT_TABLE table=default.Table_fd6941613dcf424583ca9f728fd345dd [id=1b6e4f675c3749ac94e3e7a84d1cf5da]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:33.467840 13603 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d912c69d8722403aa56cbbde4ce59782. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:33.468084 13750 tablet_service.cc:1468] Processing CreateTablet for tablet b480f5eb03804baeb61cd0424d70faf5 (DEFAULT_TABLE table=default.Table_2bad9e8dcdba4b8f89ab6ef5686d1270 [id=2dee3b2170954de4b08f70150ac7d006]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:33.468420 13750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b480f5eb03804baeb61cd0424d70faf5. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:33.470552 13601 tablet_service.cc:1468] Processing CreateTablet for tablet d4e35395930f4c37b34649da5718aa1f (DEFAULT_TABLE table=default.Table_fc298c4951614456914be830598a020a [id=e946db3cd3504a69a61a7ed2cabcada7]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:33.470857 13601 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d4e35395930f4c37b34649da5718aa1f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:33.472179 13749 tablet_service.cc:1468] Processing CreateTablet for tablet bee1b5f6f04740dba64cdcb094e26113 (DEFAULT_TABLE table=default.Table_f8d97639ebb343a398aade2f1182b5d7 [id=f98275692d824c13a75bb752d399d7dd]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:33.472487 13749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bee1b5f6f04740dba64cdcb094e26113. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:33.474404 13605 tablet_service.cc:1468] Processing CreateTablet for tablet afb132e8a5b14a029e005e375f276348 (DEFAULT_TABLE table=default.Table_9f030036c0c840a18e8d877d724be6b5 [id=098befd08500427bbe1077d47a843e84]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:33.474761 13605 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet afb132e8a5b14a029e005e375f276348. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:33.478144 13753 tablet_service.cc:1468] Processing CreateTablet for tablet d912c69d8722403aa56cbbde4ce59782 (DEFAULT_TABLE table=default.Table_fd6941613dcf424583ca9f728fd345dd [id=1b6e4f675c3749ac94e3e7a84d1cf5da]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:33.478473 13753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d912c69d8722403aa56cbbde4ce59782. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:33.479158 13747 tablet_service.cc:1468] Processing CreateTablet for tablet d4e35395930f4c37b34649da5718aa1f (DEFAULT_TABLE table=default.Table_fc298c4951614456914be830598a020a [id=e946db3cd3504a69a61a7ed2cabcada7]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:33.479439 13747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d4e35395930f4c37b34649da5718aa1f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:33.481551 13226 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_79eac01717044a179c06e461fe6f82bb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:33.482121 13226 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_79eac01717044a179c06e461fe6f82bb in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:33.461426 13887 tablet_bootstrap.cc:492] T 4b7eff24965f4f3ebfbf70dc82b7cce3 P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:54:33.482334 13422 leader_election.cc:304] T 7ef98dbbdf5848038a2da6140e126301 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba; no voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:54:33.484194 14023 raft_consensus.cc:513] T ff2267fb411942ff826e2a72bcb89cd7 P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:33.484539 13463 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 008827b3d09d464b9182fb42dc2170d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:33.485572 14027 raft_consensus.cc:2802] T 4ab63ff59d4e4ec2b7b64d605545a870 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:54:33.485678 14027 raft_consensus.cc:491] T 4ab63ff59d4e4ec2b7b64d605545a870 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:54:33.485702 13225 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_dc8706b84cd24906a5a3aae9f96e909e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250830 07:54:33.485831 14027 raft_consensus.cc:3058] T 4ab63ff59d4e4ec2b7b64d605545a870 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
W20250830 07:54:33.486260 13225 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_dc8706b84cd24906a5a3aae9f96e909e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:33.488044 13462 tablet_service.cc:1468] Processing CreateTablet for tablet b480f5eb03804baeb61cd0424d70faf5 (DEFAULT_TABLE table=default.Table_2bad9e8dcdba4b8f89ab6ef5686d1270 [id=2dee3b2170954de4b08f70150ac7d006]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:33.488468 13462 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b480f5eb03804baeb61cd0424d70faf5. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:33.489810 13466 tablet_service.cc:1468] Processing CreateTablet for tablet bee1b5f6f04740dba64cdcb094e26113 (DEFAULT_TABLE table=default.Table_f8d97639ebb343a398aade2f1182b5d7 [id=f98275692d824c13a75bb752d399d7dd]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:33.490521 13887 tablet_bootstrap.cc:654] T 4b7eff24965f4f3ebfbf70dc82b7cce3 P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:33.490840 13466 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bee1b5f6f04740dba64cdcb094e26113. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:33.491457 13460 tablet_service.cc:1468] Processing CreateTablet for tablet d912c69d8722403aa56cbbde4ce59782 (DEFAULT_TABLE table=default.Table_fd6941613dcf424583ca9f728fd345dd [id=1b6e4f675c3749ac94e3e7a84d1cf5da]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:33.491796 13460 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d912c69d8722403aa56cbbde4ce59782. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:33.492348 13468 tablet_service.cc:1468] Processing CreateTablet for tablet 7238db7e31484201a30cf4c035d82aff (DEFAULT_TABLE table=default.Table_77b02efa7d514f4291acb38f6f870ff9 [id=0e4bba403b27442cb6e7f5b50ff4a39f]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:33.492653 13468 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7238db7e31484201a30cf4c035d82aff. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:33.492779 13467 tablet_service.cc:1468] Processing CreateTablet for tablet afb132e8a5b14a029e005e375f276348 (DEFAULT_TABLE table=default.Table_9f030036c0c840a18e8d877d724be6b5 [id=098befd08500427bbe1077d47a843e84]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:33.493095 13467 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet afb132e8a5b14a029e005e375f276348. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:33.493161 13602 tablet_service.cc:1468] Processing CreateTablet for tablet b480f5eb03804baeb61cd0424d70faf5 (DEFAULT_TABLE table=default.Table_2bad9e8dcdba4b8f89ab6ef5686d1270 [id=2dee3b2170954de4b08f70150ac7d006]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:33.493476 13602 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b480f5eb03804baeb61cd0424d70faf5. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:33.494000 13701 leader_election.cc:304] T 5aef6fd239ba43478cd978fa5d29b26e P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 2065c332f15a4739899af79f3669c3ba, 6b5e454d98894637b466ea27f1b647f9
I20250830 07:54:33.494410 14030 raft_consensus.cc:2747] T 5aef6fd239ba43478cd978fa5d29b26e P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:54:33.495061 13464 tablet_service.cc:1468] Processing CreateTablet for tablet d4e35395930f4c37b34649da5718aa1f (DEFAULT_TABLE table=default.Table_fc298c4951614456914be830598a020a [id=e946db3cd3504a69a61a7ed2cabcada7]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:33.495391 13464 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d4e35395930f4c37b34649da5718aa1f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:33.495502 14030 consensus_queue.cc:1035] T 7ed22d9617024d55a8add137e7971061 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:54:33.495589 13459 tablet_service.cc:1468] Processing CreateTablet for tablet 05da843c0fe4482a926e410e06b22461 (DEFAULT_TABLE table=default.Table_8b504248201347288df9b3fcd2be2d2d [id=1c6a6eb2049745af8613285392d2c2e9]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:33.495882 13459 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 05da843c0fe4482a926e410e06b22461. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:33.498446 13485 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "d33a5d107c6849aca6eb48ffdf8a5463" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba"
I20250830 07:54:33.498502 13775 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "d33a5d107c6849aca6eb48ffdf8a5463" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f"
I20250830 07:54:33.498644 13485 raft_consensus.cc:3058] T d33a5d107c6849aca6eb48ffdf8a5463 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:33.499037 13775 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "ff2267fb411942ff826e2a72bcb89cd7" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f"
I20250830 07:54:33.499235 13775 raft_consensus.cc:3058] T ff2267fb411942ff826e2a72bcb89cd7 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:33.499403 13484 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "ff2267fb411942ff826e2a72bcb89cd7" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba"
I20250830 07:54:33.501642 13226 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_71e753273a2447a98b3b3a1a12a1e720"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:33.502162 13226 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_71e753273a2447a98b3b3a1a12a1e720 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:33.502641 13775 raft_consensus.cc:2466] T ff2267fb411942ff826e2a72bcb89cd7 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b5e454d98894637b466ea27f1b647f9 in term 1.
W20250830 07:54:33.504042 13562 leader_election.cc:343] T d33a5d107c6849aca6eb48ffdf8a5463 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:33.504292 13562 leader_election.cc:304] T ff2267fb411942ff826e2a72bcb89cd7 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f; no voters:
I20250830 07:54:33.504583 14026 raft_consensus.cc:2802] T ff2267fb411942ff826e2a72bcb89cd7 P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Leader election won for term 1
I20250830 07:54:33.504633 13899 leader_election.cc:290] T d33a5d107c6849aca6eb48ffdf8a5463 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 election: Requested vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:33.504711 14026 raft_consensus.cc:695] T ff2267fb411942ff826e2a72bcb89cd7 P 6b5e454d98894637b466ea27f1b647f9 [term 1 LEADER]: Becoming Leader. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Running, Role: LEADER
I20250830 07:54:33.504894 14023 leader_election.cc:290] T ff2267fb411942ff826e2a72bcb89cd7 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 election: Requested vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:33.506013 14026 consensus_queue.cc:237] T ff2267fb411942ff826e2a72bcb89cd7 P 6b5e454d98894637b466ea27f1b647f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:33.507154 13227 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_14aee7781209444194ef305d8eab1ef1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:33.507804 13227 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_14aee7781209444194ef305d8eab1ef1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:33.509627 13229 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_fd3757ba203b43c79e3fa0b6f899fb90" } new_table_name: "default.Table_fc6a95f74a1d457d9b5b3b6a6345b834" modify_external_catalogs: true
W20250830 07:54:33.511868 13234 catalog_manager.cc:5415] Ignoring report from unknown tablet f398e12cd9f543738d5163354f8a9d9d
I20250830 07:54:33.482568 13894 raft_consensus.cc:2747] T 7ef98dbbdf5848038a2da6140e126301 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20250830 07:54:33.513250 13561 leader_election.cc:343] T ff2267fb411942ff826e2a72bcb89cd7 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): Illegal state: Tablet not RUNNING: STOPPED
W20250830 07:54:33.515512 13234 catalog_manager.cc:5415] Ignoring report from unknown tablet 4b7eff24965f4f3ebfbf70dc82b7cce3
W20250830 07:54:33.515609 13234 catalog_manager.cc:5415] Ignoring report from unknown tablet 9e055d6089f541f799eddb5778eb2148
I20250830 07:54:33.515873 13234 catalog_manager.cc:5674] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743) does not have the latest schema for tablet ccc90f6c867147cc9fe93c9ffa2e4802 (table default.Table_89fb50934e7f4289bbb16b05a52a3af4 [id=1b7c141ed8af4dcab20683653fd59ee1]). Expected version 5 got 0
I20250830 07:54:33.527127 13225 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_dbf6976f77eb4356804f13774a4e533c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:33.527627 13225 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_dbf6976f77eb4356804f13774a4e533c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250830 07:54:33.539300 13229 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 62cf192967d94ecf954d3e965a4d9c9b consensus state has no leader
I20250830 07:54:33.545056 13747 tablet_service.cc:1468] Processing CreateTablet for tablet afb132e8a5b14a029e005e375f276348 (DEFAULT_TABLE table=default.Table_9f030036c0c840a18e8d877d724be6b5 [id=098befd08500427bbe1077d47a843e84]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:33.545517 13747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet afb132e8a5b14a029e005e375f276348. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:33.546813 13882 tablet_bootstrap.cc:700] T f846a23f0be046028cc2472de88b71c4 P 6b5e454d98894637b466ea27f1b647f9: Time spent opening tablet: real 0.124s user 0.002s sys 0.000s
I20250830 07:54:33.547145 13882 tablet_bootstrap.cc:654] T f846a23f0be046028cc2472de88b71c4 P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:33.547844 13226 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_0333c6737081432b8064661a28804d23"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:33.548282 13226 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0333c6737081432b8064661a28804d23 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250830 07:54:33.553138 13999 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20250830 07:54:33.553522 13999 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20250830 07:54:33.553624 13999 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20250830 07:54:33.555912 13219 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.12.209.60:43889: connect: Connection refused (error 111) [suppressed 8 similar messages]
I20250830 07:54:33.555949 13753 tablet_service.cc:1468] Processing CreateTablet for tablet 91ab8c468c8143b9ae11b839a95a26fd (DEFAULT_TABLE table=default.Table_690616d54f014a969bb63de44038e18b [id=55f67297d5ac42c280ea932d74e3ad37]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:33.556255 13753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 91ab8c468c8143b9ae11b839a95a26fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:33.560896 13602 tablet_service.cc:1468] Processing CreateTablet for tablet 91ab8c468c8143b9ae11b839a95a26fd (DEFAULT_TABLE table=default.Table_690616d54f014a969bb63de44038e18b [id=55f67297d5ac42c280ea932d74e3ad37]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:33.566241 13749 tablet_service.cc:1468] Processing CreateTablet for tablet 27da527d9fe045ae8c17f193d034f5ac (DEFAULT_TABLE table=default.Table_9b3c1b8da52e44d8a8215a004afb6f4a [id=6285b1fe4aa14eef9358b69d114ef2ef]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:33.566644 13749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 27da527d9fe045ae8c17f193d034f5ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:33.568934 13887 tablet_bootstrap.cc:492] T 4b7eff24965f4f3ebfbf70dc82b7cce3 P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:54:33.569554 13751 tablet_service.cc:1468] Processing CreateTablet for tablet 6492bd11e50d4900927db0de3757aa24 (DEFAULT_TABLE table=default.Table_87aae2d576474fc19d521579db07906c [id=b7dcb14885434162aac95c78a5a70ba9]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:33.570534 13887 ts_tablet_manager.cc:1397] T 4b7eff24965f4f3ebfbf70dc82b7cce3 P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.108s user 0.001s sys 0.003s
I20250830 07:54:33.571264 13887 raft_consensus.cc:357] T 4b7eff24965f4f3ebfbf70dc82b7cce3 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } }
I20250830 07:54:33.572218 13226 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_3041c77b19f5443ea4437fda4fdf0799"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250830 07:54:33.572665 13751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6492bd11e50d4900927db0de3757aa24. 1 dirs total, 0 dirs full, 0 dirs failed
W20250830 07:54:33.572921 13226 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3041c77b19f5443ea4437fda4fdf0799 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:33.574065 13225 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_d007eeaa41bd463da0496053226ce68d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:33.574525 13225 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d007eeaa41bd463da0496053226ce68d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:33.574771 14027 raft_consensus.cc:513] T 4ab63ff59d4e4ec2b7b64d605545a870 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:33.575803 13227 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_6036df2e3fa041e1afd177e14f9c2cf4" } modify_external_catalogs: true
I20250830 07:54:33.575971 13227 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_6036df2e3fa041e1afd177e14f9c2cf4" } modify_external_catalogs: true
I20250830 07:54:33.577108 13229 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_378bc8a57a1d461abd6da90d53bd2be3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:33.577544 13229 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_378bc8a57a1d461abd6da90d53bd2be3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:33.577687 13458 tablet_service.cc:1468] Processing CreateTablet for tablet 91ab8c468c8143b9ae11b839a95a26fd (DEFAULT_TABLE table=default.Table_690616d54f014a969bb63de44038e18b [id=55f67297d5ac42c280ea932d74e3ad37]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:33.578073 13458 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 91ab8c468c8143b9ae11b839a95a26fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:33.578763 13234 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_bdc97b774a964703b3868baf74306f10" } new_table_name: "default.Table_d601d7d0f55744e5b227aa7b31516c20" modify_external_catalogs: true
I20250830 07:54:33.580261 13228 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_6f9916f363e643e6a35574bb88e74729" } new_table_name: "default.Table_4285c0443c5848eeb9cddb335be79aab" modify_external_catalogs: true
I20250830 07:54:33.580590 13775 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "4ab63ff59d4e4ec2b7b64d605545a870" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f"
I20250830 07:54:33.580765 13775 raft_consensus.cc:3058] T 4ab63ff59d4e4ec2b7b64d605545a870 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:33.580801 13887 raft_consensus.cc:383] T 4b7eff24965f4f3ebfbf70dc82b7cce3 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:33.580924 13887 raft_consensus.cc:738] T 4b7eff24965f4f3ebfbf70dc82b7cce3 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:54:33.581744 13887 consensus_queue.cc:260] T 4b7eff24965f4f3ebfbf70dc82b7cce3 P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } }
I20250830 07:54:33.583302 13775 raft_consensus.cc:2466] T 4ab63ff59d4e4ec2b7b64d605545a870 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2065c332f15a4739899af79f3669c3ba in term 1.
I20250830 07:54:33.584040 13607 tablet_service.cc:1468] Processing CreateTablet for tablet 6492bd11e50d4900927db0de3757aa24 (DEFAULT_TABLE table=default.Table_87aae2d576474fc19d521579db07906c [id=b7dcb14885434162aac95c78a5a70ba9]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:33.585289 13886 tablet_bootstrap.cc:492] T ef16b9e2d444489699f4db1ac26d5f6c P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:54:33.585466 13886 ts_tablet_manager.cc:1397] T ef16b9e2d444489699f4db1ac26d5f6c P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.123s user 0.007s sys 0.029s
I20250830 07:54:33.586237 13886 raft_consensus.cc:357] T ef16b9e2d444489699f4db1ac26d5f6c P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } }
I20250830 07:54:33.586423 13886 raft_consensus.cc:383] T ef16b9e2d444489699f4db1ac26d5f6c P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:33.586521 13886 raft_consensus.cc:738] T ef16b9e2d444489699f4db1ac26d5f6c P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:54:33.586768 13886 consensus_queue.cc:260] T ef16b9e2d444489699f4db1ac26d5f6c P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } }
I20250830 07:54:33.587261 13886 ts_tablet_manager.cc:1428] T ef16b9e2d444489699f4db1ac26d5f6c P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20250830 07:54:33.589532 13232 master_service.cc:948] ReplaceTablet: received request to replace tablet 69f2105c5eeb47e9a848ae7bf8779996 from {username='slave'} at 127.0.0.1:42126
I20250830 07:54:33.589681 13886 tablet_bootstrap.cc:492] T a78c522b9fa945e2879fb965d82fb359 P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:54:33.591995 13886 tablet_bootstrap.cc:654] T a78c522b9fa945e2879fb965d82fb359 P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:33.592234 13456 tablet_service.cc:1468] Processing CreateTablet for tablet 6492bd11e50d4900927db0de3757aa24 (DEFAULT_TABLE table=default.Table_87aae2d576474fc19d521579db07906c [id=b7dcb14885434162aac95c78a5a70ba9]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:33.592708 13456 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6492bd11e50d4900927db0de3757aa24. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:33.594502 13750 tablet_service.cc:1515] Processing DeleteTablet for tablet ef16b9e2d444489699f4db1ac26d5f6c with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:32 UTC) from {username='slave'} at 127.0.0.1:45460
I20250830 07:54:33.594823 13884 tablet_replica.cc:331] T ef16b9e2d444489699f4db1ac26d5f6c P 9b057ade5dce45af9f8bf0bedf8b917f: stopping tablet replica
I20250830 07:54:33.595024 13884 raft_consensus.cc:2241] T ef16b9e2d444489699f4db1ac26d5f6c P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Raft consensus shutting down.
I20250830 07:54:33.595165 13884 raft_consensus.cc:2270] T ef16b9e2d444489699f4db1ac26d5f6c P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Raft consensus is shut down!
I20250830 07:54:33.595384 13422 leader_election.cc:304] T 4ab63ff59d4e4ec2b7b64d605545a870 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters:
I20250830 07:54:33.595991 13884 ts_tablet_manager.cc:1905] T ef16b9e2d444489699f4db1ac26d5f6c P 9b057ade5dce45af9f8bf0bedf8b917f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250830 07:54:33.596632 13628 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "4ab63ff59d4e4ec2b7b64d605545a870" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9"
I20250830 07:54:33.598366 13887 ts_tablet_manager.cc:1428] T 4b7eff24965f4f3ebfbf70dc82b7cce3 P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.024s user 0.002s sys 0.000s
I20250830 07:54:33.597836 13455 tablet_service.cc:1468] Processing CreateTablet for tablet cada6410e2884c508bb7dd38bea438ae (DEFAULT_TABLE table=default.Table_307276a7da514840af7d3a3c90634e05 [id=4678375d8d3d474290ad1a254de14054]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:33.601260 13628 raft_consensus.cc:3058] T 4ab63ff59d4e4ec2b7b64d605545a870 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:33.601928 13604 tablet_service.cc:1468] Processing CreateTablet for tablet 27da527d9fe045ae8c17f193d034f5ac (DEFAULT_TABLE table=default.Table_9b3c1b8da52e44d8a8215a004afb6f4a [id=6285b1fe4aa14eef9358b69d114ef2ef]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:33.602556 13226 master_service.cc:948] ReplaceTablet: received request to replace tablet 5aef6fd239ba43478cd978fa5d29b26e from {username='slave'} at 127.0.0.1:42126
I20250830 07:54:33.603024 13754 tablet_service.cc:1468] Processing CreateTablet for tablet cada6410e2884c508bb7dd38bea438ae (DEFAULT_TABLE table=default.Table_307276a7da514840af7d3a3c90634e05 [id=4678375d8d3d474290ad1a254de14054]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:33.603360 13884 ts_tablet_manager.cc:1918] T ef16b9e2d444489699f4db1ac26d5f6c P 9b057ade5dce45af9f8bf0bedf8b917f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250830 07:54:33.603536 13884 log.cc:1199] T ef16b9e2d444489699f4db1ac26d5f6c P 9b057ade5dce45af9f8bf0bedf8b917f: Deleting WAL directory at /tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/ts-2/wal/wals/ef16b9e2d444489699f4db1ac26d5f6c
I20250830 07:54:33.603979 13884 ts_tablet_manager.cc:1939] T ef16b9e2d444489699f4db1ac26d5f6c P 9b057ade5dce45af9f8bf0bedf8b917f: Deleting consensus metadata
W20250830 07:54:33.604909 13232 catalog_manager.cc:5415] Ignoring report from unknown tablet 9e055d6089f541f799eddb5778eb2148
W20250830 07:54:33.605021 13232 catalog_manager.cc:5415] Ignoring report from unknown tablet 7ef98dbbdf5848038a2da6140e126301
W20250830 07:54:33.605252 13232 catalog_manager.cc:5415] Ignoring report from unknown tablet a78c522b9fa945e2879fb965d82fb359
I20250830 07:54:33.605401 13219 catalog_manager.cc:4928] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): tablet ef16b9e2d444489699f4db1ac26d5f6c (table default.Table_6a92a1708f7e46089983abe2263370f8 [id=bbebbf5262b94461a70235809d9a09eb]) successfully deleted
I20250830 07:54:33.603435 13754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cada6410e2884c508bb7dd38bea438ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:33.605538 13485 raft_consensus.cc:2466] T d33a5d107c6849aca6eb48ffdf8a5463 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b5e454d98894637b466ea27f1b647f9 in term 1.
I20250830 07:54:33.605613 13232 catalog_manager.cc:5582] T ccc90f6c867147cc9fe93c9ffa2e4802 P 6b5e454d98894637b466ea27f1b647f9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2). New cstate: current_term: 1 leader_uuid: "6b5e454d98894637b466ea27f1b647f9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } health_report { overall_health: UNKNOWN } } }
I20250830 07:54:33.605983 13232 catalog_manager.cc:5674] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967) does not have the latest schema for tablet ccc90f6c867147cc9fe93c9ffa2e4802 (table default.Table_89fb50934e7f4289bbb16b05a52a3af4 [id=1b7c141ed8af4dcab20683653fd59ee1]). Expected version 5 got 0
I20250830 07:54:33.607497 13455 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cada6410e2884c508bb7dd38bea438ae. 1 dirs total, 0 dirs full, 0 dirs failed
W20250830 07:54:33.608052 13999 flags.cc:425] Enabled experimental flag: --enable_metadata_cleanup_for_deleted_tables_and_tablets=true
W20250830 07:54:33.608132 13999 flags.cc:425] Enabled experimental flag: --metadata_for_deleted_table_and_tablet_reserved_secs=0
W20250830 07:54:33.608209 13999 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20250830 07:54:33.608263 13999 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20250830 07:54:33.608342 13999 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20250830 07:54:33.608402 13999 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20250830 07:54:33.608739 13628 raft_consensus.cc:2466] T 4ab63ff59d4e4ec2b7b64d605545a870 P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2065c332f15a4739899af79f3669c3ba in term 1.
I20250830 07:54:33.608951 13602 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 91ab8c468c8143b9ae11b839a95a26fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:33.609444 13755 tablet_service.cc:1468] Processing CreateTablet for tablet e4f1ff6026bb45e28e63c27c83399d72 (DEFAULT_TABLE table=default.Table_d020e7f838c24eb58a679947a81cf706 [id=e33103725b5b4754bf924d1c69dec482]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:33.609728 13755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e4f1ff6026bb45e28e63c27c83399d72. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:33.616747 13225 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_ed13c678c1c84e3595147954bedbeb49" } modify_external_catalogs: true
I20250830 07:54:33.616930 13225 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_ed13c678c1c84e3595147954bedbeb49" } modify_external_catalogs: true
I20250830 07:54:33.618182 13561 leader_election.cc:304] T d33a5d107c6849aca6eb48ffdf8a5463 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 6b5e454d98894637b466ea27f1b647f9; no voters: 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:54:33.618305 13886 tablet_bootstrap.cc:492] T a78c522b9fa945e2879fb965d82fb359 P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:54:33.618440 13886 ts_tablet_manager.cc:1397] T a78c522b9fa945e2879fb965d82fb359 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.029s user 0.003s sys 0.000s
I20250830 07:54:33.618395 13233 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_f817d6b952384e64a8b6be555cc4db2f" } modify_external_catalogs: true
I20250830 07:54:33.618533 13233 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_f817d6b952384e64a8b6be555cc4db2f" } modify_external_catalogs: true
I20250830 07:54:33.619257 13886 raft_consensus.cc:357] T a78c522b9fa945e2879fb965d82fb359 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } }
I20250830 07:54:33.619415 13886 raft_consensus.cc:383] T a78c522b9fa945e2879fb965d82fb359 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:33.619496 13886 raft_consensus.cc:738] T a78c522b9fa945e2879fb965d82fb359 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:54:33.619850 13226 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_4b551ee739314e368cb0bb6426c77318" } modify_external_catalogs: true
I20250830 07:54:33.620064 13226 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_4b551ee739314e368cb0bb6426c77318" } modify_external_catalogs: true
I20250830 07:54:33.620196 13606 tablet_service.cc:1468] Processing CreateTablet for tablet cada6410e2884c508bb7dd38bea438ae (DEFAULT_TABLE table=default.Table_307276a7da514840af7d3a3c90634e05 [id=4678375d8d3d474290ad1a254de14054]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:33.620344 13609 tablet_service.cc:1468] Processing CreateTablet for tablet e4f1ff6026bb45e28e63c27c83399d72 (DEFAULT_TABLE table=default.Table_d020e7f838c24eb58a679947a81cf706 [id=e33103725b5b4754bf924d1c69dec482]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:33.621084 13607 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6492bd11e50d4900927db0de3757aa24. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:33.622164 13457 tablet_service.cc:1468] Processing CreateTablet for tablet 27da527d9fe045ae8c17f193d034f5ac (DEFAULT_TABLE table=default.Table_9b3c1b8da52e44d8a8215a004afb6f4a [id=6285b1fe4aa14eef9358b69d114ef2ef]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:33.625676 14026 raft_consensus.cc:2802] T d33a5d107c6849aca6eb48ffdf8a5463 P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Leader election won for term 1
I20250830 07:54:33.626950 14026 raft_consensus.cc:695] T d33a5d107c6849aca6eb48ffdf8a5463 P 6b5e454d98894637b466ea27f1b647f9 [term 1 LEADER]: Becoming Leader. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Running, Role: LEADER
I20250830 07:54:33.627393 13999 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.209.20:33943
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/master-2/wal
--catalog_manager_bg_task_wait_ms=10
--enable_metadata_cleanup_for_deleted_tables_and_tablets=true
--metadata_for_deleted_table_and_tablet_reserved_secs=0
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.12.209.62:39725,127.12.209.61:44241,127.12.209.60:43889
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.209.60:43889
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.12.209.60
--webserver_port=32915
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.19.0-SNAPSHOT
revision 06466b25e294b4d7d455e6c56263318dc34a80ef
build type FASTDEBUG
built by None at 30 Aug 2025 07:43:23 UTC on 24a791456cd2
build id 7812
ASAN enabled
I20250830 07:54:33.629221 13609 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e4f1ff6026bb45e28e63c27c83399d72. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:33.629530 13999 env_posix.cc:2264] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20250830 07:54:33.631003 13606 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cada6410e2884c508bb7dd38bea438ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:33.631094 13886 consensus_queue.cc:260] T a78c522b9fa945e2879fb965d82fb359 P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } }
I20250830 07:54:33.634099 13886 ts_tablet_manager.cc:1428] T a78c522b9fa945e2879fb965d82fb359 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.016s user 0.002s sys 0.000s
I20250830 07:54:33.634406 13886 tablet_bootstrap.cc:492] T 18afeddd2c0642028f93a16323b6e849 P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:54:33.636780 13886 tablet_bootstrap.cc:654] T 18afeddd2c0642028f93a16323b6e849 P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:33.638753 13605 tablet_service.cc:1468] Processing CreateTablet for tablet c3b35ea656db4741a02e6746e1b049ec (DEFAULT_TABLE table=default.Table_1122e7555f184245b03157a9e3996e7c [id=deeba064ff4c4e4f8c6b7c0c28f5c435]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:33.639238 13605 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c3b35ea656db4741a02e6746e1b049ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:33.639770 13227 catalog_manager.cc:5864] Not sending DeleteTablet requests; no consensus state for tablet c931894354af44c5850dfec22444f0ce
W20250830 07:54:33.640974 13227 catalog_manager.cc:5415] Ignoring report from unknown tablet a78c522b9fa945e2879fb965d82fb359
I20250830 07:54:33.641446 13227 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_8be35b5f21ba4070a2f65a64315b9ae6" } new_table_name: "default.Table_fa378b7e7c574b23b77d462d15d5313e" modify_external_catalogs: true
I20250830 07:54:33.641711 14027 leader_election.cc:290] T 4ab63ff59d4e4ec2b7b64d605545a870 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 election: Requested vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:33.641924 13954 raft_consensus.cc:2802] T 4ab63ff59d4e4ec2b7b64d605545a870 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election won for term 1
I20250830 07:54:33.642192 13999 file_cache.cc:492] Constructed file cache file cache with capacity 419430
I20250830 07:54:33.642407 13883 ts_tablet_manager.cc:1918] T ff2267fb411942ff826e2a72bcb89cd7 P 2065c332f15a4739899af79f3669c3ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250830 07:54:33.642992 13229 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_33ea1b44cf33490a86254fee9a48f5b4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:33.643441 13229 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_33ea1b44cf33490a86254fee9a48f5b4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:33.644553 13230 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_c31365a39be74e47b45faf638fcce13b" } modify_external_catalogs: true
I20250830 07:54:33.644690 13230 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_c31365a39be74e47b45faf638fcce13b" } modify_external_catalogs: true
I20250830 07:54:33.649958 13750 tablet_service.cc:1468] Processing CreateTablet for tablet c3b35ea656db4741a02e6746e1b049ec (DEFAULT_TABLE table=default.Table_1122e7555f184245b03157a9e3996e7c [id=deeba064ff4c4e4f8c6b7c0c28f5c435]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:33.650326 13750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c3b35ea656db4741a02e6746e1b049ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:33.653919 13883 log.cc:1199] T ff2267fb411942ff826e2a72bcb89cd7 P 2065c332f15a4739899af79f3669c3ba: Deleting WAL directory at /tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/ts-0/wal/wals/ff2267fb411942ff826e2a72bcb89cd7
I20250830 07:54:33.654343 13883 ts_tablet_manager.cc:1939] T ff2267fb411942ff826e2a72bcb89cd7 P 2065c332f15a4739899af79f3669c3ba: Deleting consensus metadata
I20250830 07:54:33.654846 13883 tablet_replica.cc:331] T f398e12cd9f543738d5163354f8a9d9d P 2065c332f15a4739899af79f3669c3ba: stopping tablet replica
I20250830 07:54:33.655084 13883 raft_consensus.cc:2241] T f398e12cd9f543738d5163354f8a9d9d P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Raft consensus shutting down.
I20250830 07:54:33.655309 13883 raft_consensus.cc:2270] T f398e12cd9f543738d5163354f8a9d9d P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20250830 07:54:33.655907 13883 ts_tablet_manager.cc:1905] T f398e12cd9f543738d5163354f8a9d9d P 2065c332f15a4739899af79f3669c3ba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250830 07:54:33.659663 13954 raft_consensus.cc:695] T 4ab63ff59d4e4ec2b7b64d605545a870 P 2065c332f15a4739899af79f3669c3ba [term 1 LEADER]: Becoming Leader. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Running, Role: LEADER
I20250830 07:54:33.660038 13954 consensus_queue.cc:237] T 4ab63ff59d4e4ec2b7b64d605545a870 P 2065c332f15a4739899af79f3669c3ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
W20250830 07:54:33.660274 13234 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 53a933afa4b74095baf0f54736d99bf0 has no consensus state
W20250830 07:54:33.665266 13234 catalog_manager.cc:5415] Ignoring report from unknown tablet a78c522b9fa945e2879fb965d82fb359
I20250830 07:54:33.665716 13883 ts_tablet_manager.cc:1918] T f398e12cd9f543738d5163354f8a9d9d P 2065c332f15a4739899af79f3669c3ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250830 07:54:33.665841 13883 log.cc:1199] T f398e12cd9f543738d5163354f8a9d9d P 2065c332f15a4739899af79f3669c3ba: Deleting WAL directory at /tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/ts-0/wal/wals/f398e12cd9f543738d5163354f8a9d9d
I20250830 07:54:33.665992 13234 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_87aae2d576474fc19d521579db07906c" } new_table_name: "default.Table_af246199afc44640a062e3f1e440b09d" modify_external_catalogs: true
W20250830 07:54:33.674928 13228 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 3167b609ed184decb4ccdb4945933ebb consensus state has no leader
W20250830 07:54:33.675830 14050 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20250830 07:54:33.681591 13882 tablet_bootstrap.cc:492] T f846a23f0be046028cc2472de88b71c4 P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
W20250830 07:54:33.681877 14051 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20250830 07:54:33.683784 13885 ts_tablet_manager.cc:1918] T 5aef6fd239ba43478cd978fa5d29b26e P 6b5e454d98894637b466ea27f1b647f9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250830 07:54:33.692611 13225 catalog_manager.cc:5864] Not sending DeleteTablet requests; no consensus state for tablet 3d117a08cb4e4ac398bc5889ca468923
I20250830 07:54:33.699185 13882 ts_tablet_manager.cc:1397] T f846a23f0be046028cc2472de88b71c4 P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.261s user 0.005s sys 0.000s
I20250830 07:54:33.699831 13233 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet 0186504d9e4949179ce5b92b85f5b230
I20250830 07:54:33.700098 13882 raft_consensus.cc:357] T f846a23f0be046028cc2472de88b71c4 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } }
I20250830 07:54:33.700301 13882 raft_consensus.cc:383] T f846a23f0be046028cc2472de88b71c4 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:33.700372 13882 raft_consensus.cc:738] T f846a23f0be046028cc2472de88b71c4 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:54:33.700616 13882 consensus_queue.cc:260] T f846a23f0be046028cc2472de88b71c4 P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } }
I20250830 07:54:33.700989 13750 tablet_service.cc:1515] Processing DeleteTablet for tablet 0186504d9e4949179ce5b92b85f5b230 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:33 UTC) from {username='slave'} at 127.0.0.1:45460
I20250830 07:54:33.701121 13882 ts_tablet_manager.cc:1428] T f846a23f0be046028cc2472de88b71c4 P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20250830 07:54:33.701421 13882 tablet_bootstrap.cc:492] T ef16b9e2d444489699f4db1ac26d5f6c P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
W20250830 07:54:33.701862 13219 catalog_manager.cc:4908] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): delete failed for tablet 0186504d9e4949179ce5b92b85f5b230 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0186504d9e4949179ce5b92b85f5b230 already in progress: creating tablet
I20250830 07:54:33.703688 13885 log.cc:1199] T 5aef6fd239ba43478cd978fa5d29b26e P 6b5e454d98894637b466ea27f1b647f9: Deleting WAL directory at /tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/ts-1/wal/wals/5aef6fd239ba43478cd978fa5d29b26e
I20250830 07:54:33.704123 13885 ts_tablet_manager.cc:1939] T 5aef6fd239ba43478cd978fa5d29b26e P 6b5e454d98894637b466ea27f1b647f9: Deleting consensus metadata
I20250830 07:54:33.705073 13885 tablet_replica.cc:331] T d33a5d107c6849aca6eb48ffdf8a5463 P 6b5e454d98894637b466ea27f1b647f9: stopping tablet replica
I20250830 07:54:33.705523 13457 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 27da527d9fe045ae8c17f193d034f5ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:33.705884 13220 catalog_manager.cc:4928] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): tablet 5aef6fd239ba43478cd978fa5d29b26e (table default.Table_5bfb094fe761440791baa2854483575e [id=2613df4d7a194a54bcce5d19996146f0]) successfully deleted
W20250830 07:54:33.706146 13220 catalog_manager.cc:4908] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet 05da843c0fe4482a926e410e06b22461 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 05da843c0fe4482a926e410e06b22461 already in progress: creating tablet
W20250830 07:54:33.706370 13220 catalog_manager.cc:4908] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet 69f2105c5eeb47e9a848ae7bf8779996 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 69f2105c5eeb47e9a848ae7bf8779996 already in progress: creating tablet
W20250830 07:54:33.706565 13220 catalog_manager.cc:4908] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet 05da843c0fe4482a926e410e06b22461 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 05da843c0fe4482a926e410e06b22461 already in progress: creating tablet
W20250830 07:54:33.706751 13220 catalog_manager.cc:4908] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet 91ab8c468c8143b9ae11b839a95a26fd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 91ab8c468c8143b9ae11b839a95a26fd already in progress: creating tablet
I20250830 07:54:33.706858 13887 tablet_bootstrap.cc:492] T a78c522b9fa945e2879fb965d82fb359 P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
W20250830 07:54:33.706964 13220 catalog_manager.cc:4908] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet 6f2d855ab3c04123b2f9ea22cda6ef04 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6f2d855ab3c04123b2f9ea22cda6ef04 already in progress: creating tablet
W20250830 07:54:33.707170 13220 catalog_manager.cc:4908] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet c3b35ea656db4741a02e6746e1b049ec because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c3b35ea656db4741a02e6746e1b049ec already in progress: creating tablet
I20250830 07:54:33.707530 13225 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_dc8dc313f9fb46d3bd2a8e79c8d2102f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:33.708189 13225 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_dc8dc313f9fb46d3bd2a8e79c8d2102f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:33.708408 13606 tablet_service.cc:1515] Processing DeleteTablet for tablet 0186504d9e4949179ce5b92b85f5b230 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:33 UTC) from {username='slave'} at 127.0.0.1:45306
I20250830 07:54:33.709612 13886 tablet_bootstrap.cc:492] T 18afeddd2c0642028f93a16323b6e849 P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:54:33.709738 13886 ts_tablet_manager.cc:1397] T 18afeddd2c0642028f93a16323b6e849 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.075s user 0.010s sys 0.021s
I20250830 07:54:33.709842 13604 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 27da527d9fe045ae8c17f193d034f5ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:33.710192 13464 tablet_service.cc:1468] Processing CreateTablet for tablet c3b35ea656db4741a02e6746e1b049ec (DEFAULT_TABLE table=default.Table_1122e7555f184245b03157a9e3996e7c [id=deeba064ff4c4e4f8c6b7c0c28f5c435]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:33.710459 13886 raft_consensus.cc:357] T 18afeddd2c0642028f93a16323b6e849 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } }
I20250830 07:54:33.710577 13464 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c3b35ea656db4741a02e6746e1b049ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:33.710649 13886 raft_consensus.cc:383] T 18afeddd2c0642028f93a16323b6e849 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:33.710709 13886 raft_consensus.cc:738] T 18afeddd2c0642028f93a16323b6e849 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:54:33.710902 13886 consensus_queue.cc:260] T 18afeddd2c0642028f93a16323b6e849 P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } }
I20250830 07:54:33.711427 13886 ts_tablet_manager.cc:1428] T 18afeddd2c0642028f93a16323b6e849 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20250830 07:54:33.714726 13882 tablet_bootstrap.cc:654] T ef16b9e2d444489699f4db1ac26d5f6c P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:33.719420 13886 tablet_bootstrap.cc:492] T f846a23f0be046028cc2472de88b71c4 P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:54:33.719470 13466 tablet_service.cc:1468] Processing CreateTablet for tablet e4f1ff6026bb45e28e63c27c83399d72 (DEFAULT_TABLE table=default.Table_d020e7f838c24eb58a679947a81cf706 [id=e33103725b5b4754bf924d1c69dec482]), partition=RANGE (key) PARTITION UNBOUNDED
W20250830 07:54:33.719830 14034 log.cc:927] Time spent T 5aef6fd239ba43478cd978fa5d29b26e P 2065c332f15a4739899af79f3669c3ba: Append to log took a long time: real 0.062s user 0.000s sys 0.000s
I20250830 07:54:33.720963 13886 tablet_bootstrap.cc:654] T f846a23f0be046028cc2472de88b71c4 P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
W20250830 07:54:33.723191 13233 catalog_manager.cc:5415] Ignoring report from unknown tablet 18afeddd2c0642028f93a16323b6e849
I20250830 07:54:33.727474 13132 master_runner.cc:186] Error getting master registration for 127.12.209.60:43889: Network error: Client connection negotiation failed: client connection to 127.12.209.60:43889: connect: Connection refused (error 111),
I20250830 07:54:33.727708 13132 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20250830 07:54:33.727949 13956 raft_consensus.cc:491] T a78c522b9fa945e2879fb965d82fb359 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:33.728006 13897 raft_consensus.cc:491] T ccc90f6c867147cc9fe93c9ffa2e4802 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:33.728163 13897 raft_consensus.cc:513] T ccc90f6c867147cc9fe93c9ffa2e4802 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:33.728633 13897 leader_election.cc:290] T ccc90f6c867147cc9fe93c9ffa2e4802 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967)
I20250830 07:54:33.728797 13956 raft_consensus.cc:513] T a78c522b9fa945e2879fb965d82fb359 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } }
I20250830 07:54:33.729449 13628 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "ccc90f6c867147cc9fe93c9ffa2e4802" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:33.730015 13775 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "a78c522b9fa945e2879fb965d82fb359" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:33.730167 13956 leader_election.cc:290] T a78c522b9fa945e2879fb965d82fb359 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:33.730202 13775 raft_consensus.cc:2466] T a78c522b9fa945e2879fb965d82fb359 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b5e454d98894637b466ea27f1b647f9 in term 0.
I20250830 07:54:33.730583 13233 master_service.cc:948] ReplaceTablet: received request to replace tablet 62cf192967d94ecf954d3e965a4d9c9b from {username='slave'} at 127.0.0.1:42126
I20250830 07:54:33.730579 13562 leader_election.cc:304] T a78c522b9fa945e2879fb965d82fb359 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f; no voters:
I20250830 07:54:33.730928 13956 raft_consensus.cc:2802] T a78c522b9fa945e2879fb965d82fb359 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:54:33.731040 13956 raft_consensus.cc:491] T a78c522b9fa945e2879fb965d82fb359 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:54:33.731149 13956 raft_consensus.cc:3058] T a78c522b9fa945e2879fb965d82fb359 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:33.732095 13232 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_8bc1b4ff2943449a8181e5d31f6f4672"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250830 07:54:33.732304 13486 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "a78c522b9fa945e2879fb965d82fb359" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
W20250830 07:54:33.732609 13232 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8bc1b4ff2943449a8181e5d31f6f4672 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:33.733714 13956 raft_consensus.cc:513] T a78c522b9fa945e2879fb965d82fb359 P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } }
I20250830 07:54:33.733844 13228 master_service.cc:948] ReplaceTablet: received request to replace tablet 7ef98dbbdf5848038a2da6140e126301 from {username='slave'} at 127.0.0.1:42126
I20250830 07:54:33.734720 13228 master_service.cc:948] ReplaceTablet: received request to replace tablet bee1b5f6f04740dba64cdcb094e26113 from {username='slave'} at 127.0.0.1:42126
I20250830 07:54:33.734755 13775 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "a78c522b9fa945e2879fb965d82fb359" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f"
I20250830 07:54:33.734920 13775 raft_consensus.cc:3058] T a78c522b9fa945e2879fb965d82fb359 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:33.737349 13775 raft_consensus.cc:2466] T a78c522b9fa945e2879fb965d82fb359 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b5e454d98894637b466ea27f1b647f9 in term 1.
I20250830 07:54:33.737803 13562 leader_election.cc:304] T a78c522b9fa945e2879fb965d82fb359 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f; no voters:
W20250830 07:54:33.737922 13561 leader_election.cc:343] T a78c522b9fa945e2879fb965d82fb359 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:33.738078 14018 raft_consensus.cc:2802] T a78c522b9fa945e2879fb965d82fb359 P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Leader election won for term 1
I20250830 07:54:33.738204 14018 raft_consensus.cc:695] T a78c522b9fa945e2879fb965d82fb359 P 6b5e454d98894637b466ea27f1b647f9 [term 1 LEADER]: Becoming Leader. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Running, Role: LEADER
I20250830 07:54:33.738505 14018 consensus_queue.cc:237] T a78c522b9fa945e2879fb965d82fb359 P 6b5e454d98894637b466ea27f1b647f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } }
I20250830 07:54:33.739065 13486 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "a78c522b9fa945e2879fb965d82fb359" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba"
W20250830 07:54:33.739894 13561 leader_election.cc:343] T a78c522b9fa945e2879fb965d82fb359 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:33.740716 13466 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e4f1ff6026bb45e28e63c27c83399d72. 1 dirs total, 0 dirs full, 0 dirs failed
W20250830 07:54:33.740713 13218 catalog_manager.cc:4726] Async tablet task AlterTable RPC for tablet 861809cc50764aa89140e587489e2d88 (table default.Table_3ada97cf95b64b1fb2324762c4800a9a [id=80acb888dfc143c8a5927dcf693abb8f], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 861809cc50764aa89140e587489e2d88 consensus state has no leader
I20250830 07:54:33.741492 13886 tablet_bootstrap.cc:492] T f846a23f0be046028cc2472de88b71c4 P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:54:33.741613 13886 ts_tablet_manager.cc:1397] T f846a23f0be046028cc2472de88b71c4 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.024s user 0.003s sys 0.002s
I20250830 07:54:33.742132 13226 catalog_manager.cc:5864] Not sending DeleteTablet requests; no consensus state for tablet 9196c74fb4c64c74a333ac9871e9509c
I20250830 07:54:33.742354 13886 raft_consensus.cc:357] T f846a23f0be046028cc2472de88b71c4 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } }
I20250830 07:54:33.742516 13886 raft_consensus.cc:383] T f846a23f0be046028cc2472de88b71c4 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:33.742594 13886 raft_consensus.cc:738] T f846a23f0be046028cc2472de88b71c4 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:54:33.744797 13956 leader_election.cc:290] T a78c522b9fa945e2879fb965d82fb359 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 election: Requested vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:33.745978 13886 consensus_queue.cc:260] T f846a23f0be046028cc2472de88b71c4 P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } }
I20250830 07:54:33.746551 13886 ts_tablet_manager.cc:1428] T f846a23f0be046028cc2472de88b71c4 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20250830 07:54:33.746634 13226 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_652e111209f64061ba5aa3eb3126c5f2" } new_table_name: "default.Table_4e2c5e0840fe4d3398519818e193f4dd" modify_external_catalogs: true
I20250830 07:54:33.746834 13886 tablet_bootstrap.cc:492] T c12cf30cc2aa4e12a20b9492af08a6f8 P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:54:33.748538 13886 tablet_bootstrap.cc:654] T c12cf30cc2aa4e12a20b9492af08a6f8 P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:33.753734 14026 consensus_queue.cc:237] T d33a5d107c6849aca6eb48ffdf8a5463 P 6b5e454d98894637b466ea27f1b647f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } }
W20250830 07:54:33.768417 13227 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d3f207cee78a43a1b5e030c09752c78c has no consensus state
I20250830 07:54:33.773427 13227 catalog_manager.cc:5674] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743) does not have the latest schema for tablet f846a23f0be046028cc2472de88b71c4 (table default.Table_e3a02594cc004665a46fa35a486ad4fc [id=66b40d7668914309b6bd8eaf8994d9ac]). Expected version 1 got 0
I20250830 07:54:33.774320 13227 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_ee3b720242cc477ca9273d73d1199ac3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250830 07:54:33.777318 13486 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "ccc90f6c867147cc9fe93c9ffa2e4802" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
W20250830 07:54:33.774891 13227 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ee3b720242cc477ca9273d73d1199ac3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:33.777642 13486 raft_consensus.cc:2391] T ccc90f6c867147cc9fe93c9ffa2e4802 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b057ade5dce45af9f8bf0bedf8b917f in current term 1: Already voted for candidate 6b5e454d98894637b466ea27f1b647f9 in this term.
I20250830 07:54:33.778050 13701 leader_election.cc:304] T ccc90f6c867147cc9fe93c9ffa2e4802 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 2065c332f15a4739899af79f3669c3ba, 6b5e454d98894637b466ea27f1b647f9
I20250830 07:54:33.778555 13897 raft_consensus.cc:3058] T ccc90f6c867147cc9fe93c9ffa2e4802 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:33.782069 13897 raft_consensus.cc:2747] T ccc90f6c867147cc9fe93c9ffa2e4802 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:54:33.790747 13887 tablet_bootstrap.cc:654] T a78c522b9fa945e2879fb965d82fb359 P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:33.791457 13229 catalog_manager.cc:5674] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743) does not have the latest schema for tablet f846a23f0be046028cc2472de88b71c4 (table default.Table_e3a02594cc004665a46fa35a486ad4fc [id=66b40d7668914309b6bd8eaf8994d9ac]). Expected version 1 got 0
I20250830 07:54:33.792339 13229 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_bbe8362d528c4f07a0a2736e8c7bcfec"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:33.792917 13229 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bbe8362d528c4f07a0a2736e8c7bcfec in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:33.797763 13775 raft_consensus.cc:1273] T ccc90f6c867147cc9fe93c9ffa2e4802 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Refusing update from remote peer 6b5e454d98894637b466ea27f1b647f9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250830 07:54:33.798393 14023 consensus_queue.cc:1035] T ccc90f6c867147cc9fe93c9ffa2e4802 P 6b5e454d98894637b466ea27f1b647f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:54:33.798871 13487 raft_consensus.cc:1273] T ccc90f6c867147cc9fe93c9ffa2e4802 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Refusing update from remote peer 6b5e454d98894637b466ea27f1b647f9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250830 07:54:33.799392 14023 consensus_queue.cc:1035] T ccc90f6c867147cc9fe93c9ffa2e4802 P 6b5e454d98894637b466ea27f1b647f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:54:33.800405 13230 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet 008827b3d09d464b9182fb42dc2170d5
I20250830 07:54:33.804270 13754 tablet_service.cc:1515] Processing DeleteTablet for tablet 008827b3d09d464b9182fb42dc2170d5 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:33 UTC) from {username='slave'} at 127.0.0.1:45460
W20250830 07:54:33.805143 13219 catalog_manager.cc:4908] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): delete failed for tablet 008827b3d09d464b9182fb42dc2170d5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 008827b3d09d464b9182fb42dc2170d5 already in progress: creating tablet
I20250830 07:54:33.808938 13230 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_878c1e8976de49e599d6240552c2efb8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:33.809552 13230 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_878c1e8976de49e599d6240552c2efb8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:33.810678 13457 tablet_service.cc:1515] Processing DeleteTablet for tablet 008827b3d09d464b9182fb42dc2170d5 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:33 UTC) from {username='slave'} at 127.0.0.1:37956
I20250830 07:54:33.810923 13459 tablet_service.cc:1515] Processing DeleteTablet for tablet 0186504d9e4949179ce5b92b85f5b230 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:33 UTC) from {username='slave'} at 127.0.0.1:37956
I20250830 07:54:33.815970 13883 ts_tablet_manager.cc:1939] T f398e12cd9f543738d5163354f8a9d9d P 2065c332f15a4739899af79f3669c3ba: Deleting consensus metadata
W20250830 07:54:33.815984 13234 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 6492bd11e50d4900927db0de3757aa24 consensus state has no leader
I20250830 07:54:33.821403 13883 tablet_replica.cc:331] T 5aef6fd239ba43478cd978fa5d29b26e P 2065c332f15a4739899af79f3669c3ba: stopping tablet replica
I20250830 07:54:33.821729 13883 raft_consensus.cc:2241] T 5aef6fd239ba43478cd978fa5d29b26e P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Raft consensus shutting down.
I20250830 07:54:33.821944 13883 pending_rounds.cc:70] T 5aef6fd239ba43478cd978fa5d29b26e P 2065c332f15a4739899af79f3669c3ba: Trying to abort 1 pending ops.
I20250830 07:54:33.822070 13883 pending_rounds.cc:77] T 5aef6fd239ba43478cd978fa5d29b26e P 2065c332f15a4739899af79f3669c3ba: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7194789775250452480 op_type: NO_OP noop_request { }
I20250830 07:54:33.822268 13883 raft_consensus.cc:2887] T 5aef6fd239ba43478cd978fa5d29b26e P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20250830 07:54:33.822443 13883 raft_consensus.cc:2270] T 5aef6fd239ba43478cd978fa5d29b26e P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20250830 07:54:33.823212 13234 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_6e4493316525486e83d2db0082831718"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:33.823689 13234 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6e4493316525486e83d2db0082831718 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:33.823814 13899 raft_consensus.cc:491] T 4b7eff24965f4f3ebfbf70dc82b7cce3 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:33.823979 13899 raft_consensus.cc:513] T 4b7eff24965f4f3ebfbf70dc82b7cce3 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } }
I20250830 07:54:33.824622 13899 leader_election.cc:290] T 4b7eff24965f4f3ebfbf70dc82b7cce3 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:33.825312 13897 raft_consensus.cc:491] T 18afeddd2c0642028f93a16323b6e849 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:33.825525 13897 raft_consensus.cc:513] T 18afeddd2c0642028f93a16323b6e849 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } }
I20250830 07:54:33.826102 13897 leader_election.cc:290] T 18afeddd2c0642028f93a16323b6e849 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967)
I20250830 07:54:33.826725 13774 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "4b7eff24965f4f3ebfbf70dc82b7cce3" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:33.826936 13774 raft_consensus.cc:2466] T 4b7eff24965f4f3ebfbf70dc82b7cce3 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b5e454d98894637b466ea27f1b647f9 in term 0.
I20250830 07:54:33.827507 13562 leader_election.cc:304] T 4b7eff24965f4f3ebfbf70dc82b7cce3 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f; no voters:
I20250830 07:54:33.827775 13899 raft_consensus.cc:2802] T 4b7eff24965f4f3ebfbf70dc82b7cce3 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:54:33.827891 13899 raft_consensus.cc:491] T 4b7eff24965f4f3ebfbf70dc82b7cce3 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:54:33.827994 13899 raft_consensus.cc:3058] T 4b7eff24965f4f3ebfbf70dc82b7cce3 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:33.832988 13629 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "18afeddd2c0642028f93a16323b6e849" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
W20250830 07:54:33.833456 13703 leader_election.cc:343] T 18afeddd2c0642028f93a16323b6e849 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:33.835150 13605 tablet_service.cc:1515] Processing DeleteTablet for tablet 008827b3d09d464b9182fb42dc2170d5 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:33 UTC) from {username='slave'} at 127.0.0.1:45306
I20250830 07:54:33.837721 13882 tablet_bootstrap.cc:492] T ef16b9e2d444489699f4db1ac26d5f6c P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:54:33.839447 14067 tablet.cc:1722] T ccc90f6c867147cc9fe93c9ffa2e4802 P 9b057ade5dce45af9f8bf0bedf8b917f: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 5
I20250830 07:54:33.837879 13882 ts_tablet_manager.cc:1397] T ef16b9e2d444489699f4db1ac26d5f6c P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.137s user 0.013s sys 0.018s
I20250830 07:54:33.841794 13882 raft_consensus.cc:357] T ef16b9e2d444489699f4db1ac26d5f6c P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } }
I20250830 07:54:33.841961 13882 raft_consensus.cc:383] T ef16b9e2d444489699f4db1ac26d5f6c P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:33.842053 13882 raft_consensus.cc:738] T ef16b9e2d444489699f4db1ac26d5f6c P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:54:33.847119 13882 consensus_queue.cc:260] T ef16b9e2d444489699f4db1ac26d5f6c P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } }
I20250830 07:54:33.847633 13882 ts_tablet_manager.cc:1428] T ef16b9e2d444489699f4db1ac26d5f6c P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.007s user 0.001s sys 0.001s
I20250830 07:54:33.848081 13899 raft_consensus.cc:513] T 4b7eff24965f4f3ebfbf70dc82b7cce3 P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } }
I20250830 07:54:33.849145 13899 leader_election.cc:290] T 4b7eff24965f4f3ebfbf70dc82b7cce3 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 election: Requested vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:33.850167 13775 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "4b7eff24965f4f3ebfbf70dc82b7cce3" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f"
I20250830 07:54:33.850430 13775 raft_consensus.cc:3058] T 4b7eff24965f4f3ebfbf70dc82b7cce3 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:33.853238 13885 raft_consensus.cc:2241] T d33a5d107c6849aca6eb48ffdf8a5463 P 6b5e454d98894637b466ea27f1b647f9 [term 1 LEADER]: Raft consensus shutting down.
I20250830 07:54:33.854143 13775 raft_consensus.cc:2466] T 4b7eff24965f4f3ebfbf70dc82b7cce3 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b5e454d98894637b466ea27f1b647f9 in term 1.
I20250830 07:54:33.854292 13885 pending_rounds.cc:70] T d33a5d107c6849aca6eb48ffdf8a5463 P 6b5e454d98894637b466ea27f1b647f9: Trying to abort 1 pending ops.
I20250830 07:54:33.854367 13885 pending_rounds.cc:77] T d33a5d107c6849aca6eb48ffdf8a5463 P 6b5e454d98894637b466ea27f1b647f9: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7194789780508692480 op_type: NO_OP noop_request { }
I20250830 07:54:33.854480 13885 raft_consensus.cc:2887] T d33a5d107c6849aca6eb48ffdf8a5463 P 6b5e454d98894637b466ea27f1b647f9 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20250830 07:54:33.854569 13562 leader_election.cc:304] T 4b7eff24965f4f3ebfbf70dc82b7cce3 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f; no voters:
I20250830 07:54:33.854579 13885 raft_consensus.cc:2270] T d33a5d107c6849aca6eb48ffdf8a5463 P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250830 07:54:33.855439 14018 raft_consensus.cc:2802] T 4b7eff24965f4f3ebfbf70dc82b7cce3 P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Leader election won for term 1
I20250830 07:54:33.859192 13882 tablet_bootstrap.cc:492] T 18afeddd2c0642028f93a16323b6e849 P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:54:33.859251 14066 tablet.cc:1722] T ccc90f6c867147cc9fe93c9ffa2e4802 P 6b5e454d98894637b466ea27f1b647f9: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 5
I20250830 07:54:33.859084 14018 raft_consensus.cc:695] T 4b7eff24965f4f3ebfbf70dc82b7cce3 P 6b5e454d98894637b466ea27f1b647f9 [term 1 LEADER]: Becoming Leader. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Running, Role: LEADER
I20250830 07:54:33.860374 14018 consensus_queue.cc:237] T 4b7eff24965f4f3ebfbf70dc82b7cce3 P 6b5e454d98894637b466ea27f1b647f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } }
I20250830 07:54:33.861130 13882 tablet_bootstrap.cc:654] T 18afeddd2c0642028f93a16323b6e849 P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:33.866255 13225 catalog_manager.cc:5674] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743) does not have the latest schema for tablet ccc90f6c867147cc9fe93c9ffa2e4802 (table default.Table_89fb50934e7f4289bbb16b05a52a3af4 [id=1b7c141ed8af4dcab20683653fd59ee1]). Expected version 5 got 0
I20250830 07:54:33.867244 13885 ts_tablet_manager.cc:1905] T d33a5d107c6849aca6eb48ffdf8a5463 P 6b5e454d98894637b466ea27f1b647f9: Deleting tablet data with delete state TABLET_DATA_DELETED
W20250830 07:54:33.867985 13225 catalog_manager.cc:5415] Ignoring report from unknown tablet d33a5d107c6849aca6eb48ffdf8a5463
W20250830 07:54:33.868098 13225 catalog_manager.cc:5415] Ignoring report from unknown tablet 9e055d6089f541f799eddb5778eb2148
W20250830 07:54:33.868153 13225 catalog_manager.cc:5415] Ignoring report from unknown tablet ef16b9e2d444489699f4db1ac26d5f6c
W20250830 07:54:33.868220 13225 catalog_manager.cc:5415] Ignoring report from unknown tablet 7ed22d9617024d55a8add137e7971061
W20250830 07:54:33.868273 13225 catalog_manager.cc:5415] Ignoring report from unknown tablet f398e12cd9f543738d5163354f8a9d9d
W20250830 07:54:33.868338 13225 catalog_manager.cc:5415] Ignoring report from unknown tablet 5ce773ce68f649b1bf51f0dd901cb04f
W20250830 07:54:33.868389 13225 catalog_manager.cc:5415] Ignoring report from unknown tablet 5aef6fd239ba43478cd978fa5d29b26e
W20250830 07:54:33.868455 13225 catalog_manager.cc:5415] Ignoring report from unknown tablet b4ab964a64a64e00a78ffd2b220aef46
W20250830 07:54:33.868547 13225 catalog_manager.cc:5415] Ignoring report from unknown tablet ff2267fb411942ff826e2a72bcb89cd7
W20250830 07:54:33.868613 13225 catalog_manager.cc:5415] Ignoring report from unknown tablet 7ef98dbbdf5848038a2da6140e126301
W20250830 07:54:33.868698 13225 catalog_manager.cc:5415] Ignoring report from unknown tablet 4ab63ff59d4e4ec2b7b64d605545a870
I20250830 07:54:33.869303 13225 catalog_manager.cc:5582] T c12cf30cc2aa4e12a20b9492af08a6f8 P 2065c332f15a4739899af79f3669c3ba reported cstate change: term changed from 0 to 1, leader changed from <none> to 2065c332f15a4739899af79f3669c3ba (127.12.209.1). New cstate: current_term: 1 leader_uuid: "2065c332f15a4739899af79f3669c3ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } health_report { overall_health: UNKNOWN } } }
I20250830 07:54:33.869823 13225 catalog_manager.cc:5674] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325) does not have the latest schema for tablet c12cf30cc2aa4e12a20b9492af08a6f8 (table default.Table_f95d862caa7944469f67bcf46893fa07 [id=4976f023f31746a884cb610d757b94cd]). Expected version 1 got 0
I20250830 07:54:33.870188 13225 catalog_manager.cc:5674] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325) does not have the latest schema for tablet ccc90f6c867147cc9fe93c9ffa2e4802 (table default.Table_89fb50934e7f4289bbb16b05a52a3af4 [id=1b7c141ed8af4dcab20683653fd59ee1]). Expected version 5 got 0
I20250830 07:54:33.829447 13488 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "18afeddd2c0642028f93a16323b6e849" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:54:33.848964 13485 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "4b7eff24965f4f3ebfbf70dc82b7cce3" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba"
I20250830 07:54:33.872054 13485 raft_consensus.cc:3058] T 4b7eff24965f4f3ebfbf70dc82b7cce3 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:33.874367 13885 ts_tablet_manager.cc:1918] T d33a5d107c6849aca6eb48ffdf8a5463 P 6b5e454d98894637b466ea27f1b647f9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250830 07:54:33.874567 13885 log.cc:1199] T d33a5d107c6849aca6eb48ffdf8a5463 P 6b5e454d98894637b466ea27f1b647f9: Deleting WAL directory at /tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/ts-1/wal/wals/d33a5d107c6849aca6eb48ffdf8a5463
I20250830 07:54:33.874631 13485 raft_consensus.cc:2466] T 4b7eff24965f4f3ebfbf70dc82b7cce3 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b5e454d98894637b466ea27f1b647f9 in term 1.
W20250830 07:54:33.875209 13423 consensus_peers.cc:489] T b4ab964a64a64e00a78ffd2b220aef46 P 2065c332f15a4739899af79f3669c3ba -> Peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Couldn't send request to peer 6b5e454d98894637b466ea27f1b647f9. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b4ab964a64a64e00a78ffd2b220aef46. This is attempt 1: this message will repeat every 5th retry.
W20250830 07:54:33.875500 13701 leader_election.cc:343] T 18afeddd2c0642028f93a16323b6e849 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:33.875617 13701 leader_election.cc:304] T 18afeddd2c0642028f93a16323b6e849 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 2065c332f15a4739899af79f3669c3ba, 6b5e454d98894637b466ea27f1b647f9
I20250830 07:54:33.876041 13897 raft_consensus.cc:2747] T 18afeddd2c0642028f93a16323b6e849 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:54:33.831854 13487 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "4b7eff24965f4f3ebfbf70dc82b7cce3" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:54:33.876387 13885 ts_tablet_manager.cc:1939] T d33a5d107c6849aca6eb48ffdf8a5463 P 6b5e454d98894637b466ea27f1b647f9: Deleting consensus metadata
I20250830 07:54:33.876442 13487 raft_consensus.cc:2374] T 4b7eff24965f4f3ebfbf70dc82b7cce3 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 6b5e454d98894637b466ea27f1b647f9 in term 1. Re-sending same reply.
I20250830 07:54:33.823613 13883 ts_tablet_manager.cc:1905] T 5aef6fd239ba43478cd978fa5d29b26e P 2065c332f15a4739899af79f3669c3ba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250830 07:54:33.878304 13220 catalog_manager.cc:4928] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): tablet d33a5d107c6849aca6eb48ffdf8a5463 (table default.Table_af246199afc44640a062e3f1e440b09d [id=b7dcb14885434162aac95c78a5a70ba9]) successfully deleted
W20250830 07:54:33.878561 13220 catalog_manager.cc:4908] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet d1ae3812d72b419798736328da64b53c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d1ae3812d72b419798736328da64b53c already in progress: creating tablet
W20250830 07:54:33.878823 13220 catalog_manager.cc:4908] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet b480f5eb03804baeb61cd0424d70faf5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b480f5eb03804baeb61cd0424d70faf5 already in progress: creating tablet
W20250830 07:54:33.879038 13220 catalog_manager.cc:4908] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet 02be33dc658d428fa55e59784a2342f6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 02be33dc658d428fa55e59784a2342f6 already in progress: creating tablet
W20250830 07:54:33.879236 13220 catalog_manager.cc:4908] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet e4f1ff6026bb45e28e63c27c83399d72 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e4f1ff6026bb45e28e63c27c83399d72 already in progress: creating tablet
W20250830 07:54:33.879420 13220 catalog_manager.cc:4908] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet ed87c6793dd149a6a363f1977d816628 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ed87c6793dd149a6a363f1977d816628 already in progress: creating tablet
W20250830 07:54:33.879604 13220 catalog_manager.cc:4908] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet afb132e8a5b14a029e005e375f276348 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet afb132e8a5b14a029e005e375f276348 already in progress: creating tablet
W20250830 07:54:33.879771 13220 catalog_manager.cc:4908] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet 252cc8fed9624222b26976bf54db68fb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 252cc8fed9624222b26976bf54db68fb already in progress: creating tablet
W20250830 07:54:33.879976 13220 catalog_manager.cc:4908] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet 0186504d9e4949179ce5b92b85f5b230 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0186504d9e4949179ce5b92b85f5b230 already in progress: creating tablet
W20250830 07:54:33.880208 13220 catalog_manager.cc:4908] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet 008827b3d09d464b9182fb42dc2170d5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 008827b3d09d464b9182fb42dc2170d5 already in progress: creating tablet
I20250830 07:54:33.883857 13233 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet 62cf192967d94ecf954d3e965a4d9c9b
I20250830 07:54:33.884402 13233 catalog_manager.cc:6652] ReplaceTablet: tablet 62cf192967d94ecf954d3e965a4d9c9b deleted and replaced by tablet 73853894da074ecd8147a94ac28bfab8
I20250830 07:54:33.885407 14040 raft_consensus.cc:491] T ef16b9e2d444489699f4db1ac26d5f6c P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:33.885551 14040 raft_consensus.cc:513] T ef16b9e2d444489699f4db1ac26d5f6c P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } }
I20250830 07:54:33.886085 13754 tablet_service.cc:1515] Processing DeleteTablet for tablet 62cf192967d94ecf954d3e965a4d9c9b with delete_type TABLET_DATA_DELETED (replaced by tablet 73853894da074ecd8147a94ac28bfab8) from {username='slave'} at 127.0.0.1:45460
I20250830 07:54:33.886237 14040 leader_election.cc:290] T ef16b9e2d444489699f4db1ac26d5f6c P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743), 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967)
I20250830 07:54:33.886852 13466 tablet_service.cc:1515] Processing DeleteTablet for tablet 62cf192967d94ecf954d3e965a4d9c9b with delete_type TABLET_DATA_DELETED (replaced by tablet 73853894da074ecd8147a94ac28bfab8) from {username='slave'} at 127.0.0.1:37956
W20250830 07:54:33.886965 13219 catalog_manager.cc:4908] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): delete failed for tablet 62cf192967d94ecf954d3e965a4d9c9b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 62cf192967d94ecf954d3e965a4d9c9b already in progress: creating tablet
I20250830 07:54:33.887881 13629 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "ef16b9e2d444489699f4db1ac26d5f6c" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:33.888463 13629 raft_consensus.cc:2466] T ef16b9e2d444489699f4db1ac26d5f6c P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2065c332f15a4739899af79f3669c3ba in term 0.
I20250830 07:54:33.888648 13604 tablet_service.cc:1515] Processing DeleteTablet for tablet 62cf192967d94ecf954d3e965a4d9c9b with delete_type TABLET_DATA_DELETED (replaced by tablet 73853894da074ecd8147a94ac28bfab8) from {username='slave'} at 127.0.0.1:45306
I20250830 07:54:33.888865 13423 leader_election.cc:304] T ef16b9e2d444489699f4db1ac26d5f6c P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 6b5e454d98894637b466ea27f1b647f9; no voters:
I20250830 07:54:33.889168 14040 raft_consensus.cc:2802] T ef16b9e2d444489699f4db1ac26d5f6c P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:54:33.889182 13886 tablet_bootstrap.cc:492] T c12cf30cc2aa4e12a20b9492af08a6f8 P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:54:33.889271 14040 raft_consensus.cc:491] T ef16b9e2d444489699f4db1ac26d5f6c P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:54:33.889353 13886 ts_tablet_manager.cc:1397] T c12cf30cc2aa4e12a20b9492af08a6f8 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.143s user 0.006s sys 0.023s
I20250830 07:54:33.889369 14040 raft_consensus.cc:3058] T ef16b9e2d444489699f4db1ac26d5f6c P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
W20250830 07:54:33.889372 13220 catalog_manager.cc:4908] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet 62cf192967d94ecf954d3e965a4d9c9b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 62cf192967d94ecf954d3e965a4d9c9b already in progress: creating tablet
I20250830 07:54:33.890067 13886 raft_consensus.cc:357] T c12cf30cc2aa4e12a20b9492af08a6f8 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } }
I20250830 07:54:33.890241 13886 raft_consensus.cc:383] T c12cf30cc2aa4e12a20b9492af08a6f8 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:33.890328 13886 raft_consensus.cc:738] T c12cf30cc2aa4e12a20b9492af08a6f8 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:54:33.890571 13886 consensus_queue.cc:260] T c12cf30cc2aa4e12a20b9492af08a6f8 P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } }
I20250830 07:54:33.890821 13887 tablet_bootstrap.cc:492] T a78c522b9fa945e2879fb965d82fb359 P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:54:33.890978 13887 ts_tablet_manager.cc:1397] T a78c522b9fa945e2879fb965d82fb359 P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.224s user 0.008s sys 0.002s
I20250830 07:54:33.891088 13886 ts_tablet_manager.cc:1428] T c12cf30cc2aa4e12a20b9492af08a6f8 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
W20250830 07:54:33.891718 13233 catalog_manager.cc:5415] Ignoring report from unknown tablet d33a5d107c6849aca6eb48ffdf8a5463
W20250830 07:54:33.891795 13233 catalog_manager.cc:5415] Ignoring report from unknown tablet ff2267fb411942ff826e2a72bcb89cd7
W20250830 07:54:33.891836 13233 catalog_manager.cc:5415] Ignoring report from unknown tablet 7ed22d9617024d55a8add137e7971061
I20250830 07:54:33.891827 13887 raft_consensus.cc:357] T a78c522b9fa945e2879fb965d82fb359 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } }
I20250830 07:54:33.892055 14040 raft_consensus.cc:513] T ef16b9e2d444489699f4db1ac26d5f6c P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } }
I20250830 07:54:33.892148 13887 raft_consensus.cc:383] T a78c522b9fa945e2879fb965d82fb359 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:33.892236 13887 raft_consensus.cc:738] T a78c522b9fa945e2879fb965d82fb359 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:54:33.892350 13886 tablet_bootstrap.cc:492] T d876f6259bd94799a4e37dc9d14b8efe P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:54:33.892468 13887 consensus_queue.cc:260] T a78c522b9fa945e2879fb965d82fb359 P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } }
W20250830 07:54:33.893014 13233 catalog_manager.cc:5415] Ignoring report from unknown tablet 7ed22d9617024d55a8add137e7971061
I20250830 07:54:33.893555 13628 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "ef16b9e2d444489699f4db1ac26d5f6c" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9"
I20250830 07:54:33.893751 13628 raft_consensus.cc:3058] T ef16b9e2d444489699f4db1ac26d5f6c P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:33.894802 14040 leader_election.cc:290] T ef16b9e2d444489699f4db1ac26d5f6c P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 election: Requested vote from peers 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743), 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967)
I20250830 07:54:33.895573 13886 tablet_bootstrap.cc:654] T d876f6259bd94799a4e37dc9d14b8efe P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:33.896262 13628 raft_consensus.cc:2466] T ef16b9e2d444489699f4db1ac26d5f6c P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2065c332f15a4739899af79f3669c3ba in term 1.
I20250830 07:54:33.896600 13423 leader_election.cc:304] T ef16b9e2d444489699f4db1ac26d5f6c P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 6b5e454d98894637b466ea27f1b647f9; no voters:
W20250830 07:54:33.898298 13422 leader_election.cc:343] T ef16b9e2d444489699f4db1ac26d5f6c P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Not found: Tablet not found: ef16b9e2d444489699f4db1ac26d5f6c
W20250830 07:54:33.898600 13422 leader_election.cc:343] T ef16b9e2d444489699f4db1ac26d5f6c P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Not found: Tablet not found: ef16b9e2d444489699f4db1ac26d5f6c
I20250830 07:54:33.899842 13954 raft_consensus.cc:2802] T ef16b9e2d444489699f4db1ac26d5f6c P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election won for term 1
I20250830 07:54:33.900077 14027 consensus_queue.cc:1035] T b4ab964a64a64e00a78ffd2b220aef46 P 2065c332f15a4739899af79f3669c3ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:54:33.902192 13954 raft_consensus.cc:695] T ef16b9e2d444489699f4db1ac26d5f6c P 2065c332f15a4739899af79f3669c3ba [term 1 LEADER]: Becoming Leader. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Running, Role: LEADER
I20250830 07:54:33.902505 13954 consensus_queue.cc:237] T ef16b9e2d444489699f4db1ac26d5f6c P 2065c332f15a4739899af79f3669c3ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } }
I20250830 07:54:33.904443 14001 mvcc.cc:204] Tried to move back new op lower bound from 7194789780670603264 to 7194789779165696000. Current Snapshot: MvccSnapshot[applied={T|T < 7194789780670603264}]
I20250830 07:54:33.905066 13887 ts_tablet_manager.cc:1428] T a78c522b9fa945e2879fb965d82fb359 P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.014s user 0.002s sys 0.000s
I20250830 07:54:33.905331 13887 tablet_bootstrap.cc:492] T 18afeddd2c0642028f93a16323b6e849 P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:54:33.909425 13232 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_89b4b1b127ef49c1ad0bdff27ca49888"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250830 07:54:33.909847 13887 tablet_bootstrap.cc:654] T 18afeddd2c0642028f93a16323b6e849 P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
W20250830 07:54:33.910073 13232 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_89b4b1b127ef49c1ad0bdff27ca49888 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:33.911703 13999 server_base.cc:1047] running on GCE node
I20250830 07:54:33.916952 14073 tablet.cc:1722] T ccc90f6c867147cc9fe93c9ffa2e4802 P 2065c332f15a4739899af79f3669c3ba: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 5
W20250830 07:54:33.920157 14056 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20250830 07:54:33.921319 13999 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20250830 07:54:33.925123 13882 tablet_bootstrap.cc:492] T 18afeddd2c0642028f93a16323b6e849 P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:54:33.932965 13228 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet bee1b5f6f04740dba64cdcb094e26113
I20250830 07:54:33.933573 13228 catalog_manager.cc:6652] ReplaceTablet: tablet bee1b5f6f04740dba64cdcb094e26113 deleted and replaced by tablet 38d091245a85471480e3450923ca8409
W20250830 07:54:33.934851 13228 catalog_manager.cc:5415] Ignoring report from unknown tablet 4b7eff24965f4f3ebfbf70dc82b7cce3
I20250830 07:54:33.925314 13882 ts_tablet_manager.cc:1397] T 18afeddd2c0642028f93a16323b6e849 P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.068s user 0.005s sys 0.001s
W20250830 07:54:33.935011 13228 catalog_manager.cc:5415] Ignoring report from unknown tablet ef16b9e2d444489699f4db1ac26d5f6c
W20250830 07:54:33.935099 13228 catalog_manager.cc:5415] Ignoring report from unknown tablet a78c522b9fa945e2879fb965d82fb359
W20250830 07:54:33.935190 13228 catalog_manager.cc:5415] Ignoring report from unknown tablet 7ed22d9617024d55a8add137e7971061
W20250830 07:54:33.935477 13226 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 99f307a8cbb34addaafab82b3ed18241 has no consensus state
I20250830 07:54:33.935824 13887 tablet_bootstrap.cc:492] T 18afeddd2c0642028f93a16323b6e849 P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:54:33.935926 13999 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20250830 07:54:33.935849 13226 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_ffd69d78c4a046b99417e3d71227e851"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250830 07:54:33.935979 13887 ts_tablet_manager.cc:1397] T 18afeddd2c0642028f93a16323b6e849 P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.031s user 0.002s sys 0.001s
W20250830 07:54:33.936424 13226 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ffd69d78c4a046b99417e3d71227e851 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:33.936472 13882 raft_consensus.cc:357] T 18afeddd2c0642028f93a16323b6e849 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } }
I20250830 07:54:33.936743 13882 raft_consensus.cc:383] T 18afeddd2c0642028f93a16323b6e849 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:33.936911 13882 raft_consensus.cc:738] T 18afeddd2c0642028f93a16323b6e849 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:54:33.937139 13882 consensus_queue.cc:260] T 18afeddd2c0642028f93a16323b6e849 P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } }
I20250830 07:54:33.938186 13882 ts_tablet_manager.cc:1428] T 18afeddd2c0642028f93a16323b6e849 P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20250830 07:54:33.939042 13882 tablet_bootstrap.cc:492] T d876f6259bd94799a4e37dc9d14b8efe P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:54:33.939221 13999 hybrid_clock.cc:648] HybridClock initialized: now 1756540473939135 us; error 69 us; skew 500 ppm
I20250830 07:54:33.939749 13466 tablet_service.cc:1515] Processing DeleteTablet for tablet bee1b5f6f04740dba64cdcb094e26113 with delete_type TABLET_DATA_DELETED (replaced by tablet 38d091245a85471480e3450923ca8409) from {username='slave'} at 127.0.0.1:37956
I20250830 07:54:33.941229 13883 ts_tablet_manager.cc:1918] T 5aef6fd239ba43478cd978fa5d29b26e P 2065c332f15a4739899af79f3669c3ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250830 07:54:33.942018 13604 tablet_service.cc:1515] Processing DeleteTablet for tablet bee1b5f6f04740dba64cdcb094e26113 with delete_type TABLET_DATA_DELETED (replaced by tablet 38d091245a85471480e3450923ca8409) from {username='slave'} at 127.0.0.1:45306
W20250830 07:54:33.943357 13220 catalog_manager.cc:4908] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet bee1b5f6f04740dba64cdcb094e26113 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bee1b5f6f04740dba64cdcb094e26113 already in progress: creating tablet
I20250830 07:54:33.944517 13883 log.cc:1199] T 5aef6fd239ba43478cd978fa5d29b26e P 2065c332f15a4739899af79f3669c3ba: Deleting WAL directory at /tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/ts-0/wal/wals/5aef6fd239ba43478cd978fa5d29b26e
I20250830 07:54:33.945030 13883 ts_tablet_manager.cc:1939] T 5aef6fd239ba43478cd978fa5d29b26e P 2065c332f15a4739899af79f3669c3ba: Deleting consensus metadata
I20250830 07:54:33.949111 13882 tablet_bootstrap.cc:654] T d876f6259bd94799a4e37dc9d14b8efe P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:33.944298 13887 raft_consensus.cc:357] T 18afeddd2c0642028f93a16323b6e849 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } }
I20250830 07:54:33.949549 13887 raft_consensus.cc:383] T 18afeddd2c0642028f93a16323b6e849 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:33.949664 13887 raft_consensus.cc:738] T 18afeddd2c0642028f93a16323b6e849 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:54:33.949929 13887 consensus_queue.cc:260] T 18afeddd2c0642028f93a16323b6e849 P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } }
I20250830 07:54:33.950121 13227 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_68a8222fb01847ca88079ba1dead8d71" } modify_external_catalogs: true
I20250830 07:54:33.939646 13999 server_base.cc:847] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20250830 07:54:33.950313 13227 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_68a8222fb01847ca88079ba1dead8d71" } modify_external_catalogs: true
I20250830 07:54:33.951359 13887 ts_tablet_manager.cc:1428] T 18afeddd2c0642028f93a16323b6e849 P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.015s user 0.001s sys 0.001s
I20250830 07:54:33.952704 13754 tablet_service.cc:1515] Processing DeleteTablet for tablet bee1b5f6f04740dba64cdcb094e26113 with delete_type TABLET_DATA_DELETED (replaced by tablet 38d091245a85471480e3450923ca8409) from {username='slave'} at 127.0.0.1:45460
I20250830 07:54:33.953119 13887 tablet_bootstrap.cc:492] T f846a23f0be046028cc2472de88b71c4 P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
W20250830 07:54:33.954164 13219 catalog_manager.cc:4908] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): delete failed for tablet bee1b5f6f04740dba64cdcb094e26113 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bee1b5f6f04740dba64cdcb094e26113 already in progress: creating tablet
W20250830 07:54:33.957798 13231 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.12.209.1:41421 (request call id 22) took 1398 ms (client timeout 1000 ms). Trace:
W20250830 07:54:33.957950 13231 rpcz_store.cc:269] 0830 07:54:32.559269 (+ 0us) service_pool.cc:168] Inserting onto call queue
0830 07:54:32.570481 (+ 11212us) service_pool.cc:225] Handling call
0830 07:54:33.957712 (+1387231us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0830 07:54:32.791027 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0830 07:54:32.791153 (+ 126us) write_op.cc:432] Acquiring schema lock in shared mode
0830 07:54:32.791161 (+ 8us) write_op.cc:435] Acquired schema lock
0830 07:54:32.791166 (+ 5us) tablet.cc:660] Decoding operations
0830 07:54:32.791280 (+ 114us) write_op.cc:620] Acquiring the partition lock for write op
0830 07:54:32.791303 (+ 23us) write_op.cc:641] Partition lock acquired for write op
0830 07:54:32.791310 (+ 7us) tablet.cc:683] Acquiring locks for 1 operations
0830 07:54:32.791384 (+ 74us) tablet.cc:699] Row locks acquired
0830 07:54:32.791388 (+ 4us) write_op.cc:260] PREPARE: finished
0830 07:54:32.791440 (+ 52us) write_op.cc:270] Start()
0830 07:54:32.791474 (+ 34us) write_op.cc:276] Timestamp: P: 1756540472791358 usec, L: 0
0830 07:54:32.791480 (+ 6us) op_driver.cc:348] REPLICATION: starting
0830 07:54:32.791651 (+ 171us) log.cc:844] Serialized 530 byte log entry
0830 07:54:32.822536 (+ 30885us) op_driver.cc:464] REPLICATION: finished
0830 07:54:32.823697 (+ 1161us) write_op.cc:301] APPLY: starting
0830 07:54:32.823706 (+ 9us) tablet.cc:1365] starting BulkCheckPresence
0830 07:54:32.823754 (+ 48us) tablet.cc:1368] finished BulkCheckPresence
0830 07:54:32.823800 (+ 46us) tablet.cc:1370] starting ApplyRowOperation cycle
0830 07:54:32.823849 (+ 49us) tablet.cc:1381] finished ApplyRowOperation cycle
0830 07:54:32.823907 (+ 58us) tablet_metrics.cc:563] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0830 07:54:32.823918 (+ 11us) write_op.cc:312] APPLY: finished
0830 07:54:32.823982 (+ 64us) log.cc:844] Serialized 23 byte log entry
0830 07:54:32.824046 (+ 64us) write_op.cc:489] Releasing partition, row and schema locks
0830 07:54:32.824063 (+ 17us) write_op.cc:454] Released schema lock
0830 07:54:32.824070 (+ 7us) write_op.cc:341] FINISH: Updating metrics
0830 07:54:32.824144 (+ 74us) write_op.cc:489] Releasing partition, row and schema locks
0830 07:54:32.824150 (+ 6us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":8,"child_traces":[["op",{"apply.queue_time_us":1128,"apply.run_cpu_time_us":433,"apply.run_wall_time_us":433,"num_ops":1,"prepare.queue_time_us":42774,"prepare.run_cpu_time_us":732,"prepare.run_wall_time_us":1124,"raft.queue_time_us":36,"raft.run_cpu_time_us":5,"raft.run_wall_time_us":5,"replication_time_us":31031}]]}
I20250830 07:54:33.959944 13231 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_041ceda2433746918526d2219fd68f8e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:33.960618 13231 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_041ceda2433746918526d2219fd68f8e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:33.962636 13229 master_service.cc:948] ReplaceTablet: received request to replace tablet 6f4c400c0e5e43319fa521b5cab694b4 from {username='slave'} at 127.0.0.1:42126
I20250830 07:54:33.963101 13229 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_786defd496fb44dc9ca518cadbc85db8" } new_table_name: "default.Table_03bb7288095a48a1a01062818220b7c4" modify_external_catalogs: true
W20250830 07:54:33.964398 13218 catalog_manager.cc:4908] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): delete failed for tablet 69f2105c5eeb47e9a848ae7bf8779996 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 69f2105c5eeb47e9a848ae7bf8779996 already in progress: creating tablet
W20250830 07:54:33.964643 13218 catalog_manager.cc:4908] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): delete failed for tablet 05da843c0fe4482a926e410e06b22461 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 05da843c0fe4482a926e410e06b22461 already in progress: creating tablet
I20250830 07:54:33.964685 13887 tablet_bootstrap.cc:654] T f846a23f0be046028cc2472de88b71c4 P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
W20250830 07:54:33.966542 13218 catalog_manager.cc:4908] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): delete failed for tablet 05da843c0fe4482a926e410e06b22461 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 05da843c0fe4482a926e410e06b22461 already in progress: creating tablet
W20250830 07:54:33.966768 13218 catalog_manager.cc:4908] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): delete failed for tablet 91ab8c468c8143b9ae11b839a95a26fd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 91ab8c468c8143b9ae11b839a95a26fd already in progress: creating tablet
W20250830 07:54:33.966971 13218 catalog_manager.cc:4908] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): delete failed for tablet 6f2d855ab3c04123b2f9ea22cda6ef04 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6f2d855ab3c04123b2f9ea22cda6ef04 already in progress: creating tablet
W20250830 07:54:33.967171 13218 catalog_manager.cc:4908] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): delete failed for tablet c3b35ea656db4741a02e6746e1b049ec because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c3b35ea656db4741a02e6746e1b049ec already in progress: creating tablet
W20250830 07:54:33.967353 13218 catalog_manager.cc:4908] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): delete failed for tablet d1ae3812d72b419798736328da64b53c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d1ae3812d72b419798736328da64b53c already in progress: creating tablet
W20250830 07:54:33.967537 13218 catalog_manager.cc:4908] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): delete failed for tablet b480f5eb03804baeb61cd0424d70faf5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b480f5eb03804baeb61cd0424d70faf5 already in progress: creating tablet
W20250830 07:54:33.967753 13218 catalog_manager.cc:4908] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): delete failed for tablet 02be33dc658d428fa55e59784a2342f6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 02be33dc658d428fa55e59784a2342f6 already in progress: creating tablet
W20250830 07:54:33.967960 13218 catalog_manager.cc:4908] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): delete failed for tablet e4f1ff6026bb45e28e63c27c83399d72 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e4f1ff6026bb45e28e63c27c83399d72 already in progress: creating tablet
W20250830 07:54:33.968456 13218 catalog_manager.cc:4908] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): delete failed for tablet ed87c6793dd149a6a363f1977d816628 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ed87c6793dd149a6a363f1977d816628 already in progress: creating tablet
W20250830 07:54:33.968708 13218 catalog_manager.cc:4908] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): delete failed for tablet 252cc8fed9624222b26976bf54db68fb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 252cc8fed9624222b26976bf54db68fb already in progress: creating tablet
W20250830 07:54:33.968930 13218 catalog_manager.cc:4908] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): delete failed for tablet afb132e8a5b14a029e005e375f276348 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet afb132e8a5b14a029e005e375f276348 already in progress: creating tablet
W20250830 07:54:33.969151 13218 catalog_manager.cc:4908] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): delete failed for tablet 008827b3d09d464b9182fb42dc2170d5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 008827b3d09d464b9182fb42dc2170d5 already in progress: creating tablet
W20250830 07:54:33.969375 13218 catalog_manager.cc:4908] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): delete failed for tablet 0186504d9e4949179ce5b92b85f5b230 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0186504d9e4949179ce5b92b85f5b230 already in progress: creating tablet
W20250830 07:54:33.971396 13218 catalog_manager.cc:4908] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): delete failed for tablet 62cf192967d94ecf954d3e965a4d9c9b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 62cf192967d94ecf954d3e965a4d9c9b already in progress: creating tablet
W20250830 07:54:33.971720 13218 catalog_manager.cc:4908] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): delete failed for tablet bee1b5f6f04740dba64cdcb094e26113 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bee1b5f6f04740dba64cdcb094e26113 already in progress: creating tablet
I20250830 07:54:33.973076 13230 master_service.cc:948] ReplaceTablet: received request to replace tablet ccc90f6c867147cc9fe93c9ffa2e4802 from {username='slave'} at 127.0.0.1:42126
I20250830 07:54:33.979883 13887 tablet_bootstrap.cc:492] T f846a23f0be046028cc2472de88b71c4 P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:54:33.980034 13887 ts_tablet_manager.cc:1397] T f846a23f0be046028cc2472de88b71c4 P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.028s user 0.003s sys 0.000s
I20250830 07:54:33.980054 13234 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_bbc2aa8f56d24f0d93b02e8e41950d1d" } new_table_name: "default.Table_fcf6d8285a8a4759b22a5038eb349f72" modify_external_catalogs: true
I20250830 07:54:33.981087 13887 raft_consensus.cc:357] T f846a23f0be046028cc2472de88b71c4 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } }
I20250830 07:54:33.981295 13887 raft_consensus.cc:383] T f846a23f0be046028cc2472de88b71c4 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:33.981391 13887 raft_consensus.cc:738] T f846a23f0be046028cc2472de88b71c4 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:54:33.981679 13887 consensus_queue.cc:260] T f846a23f0be046028cc2472de88b71c4 P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } }
I20250830 07:54:33.984642 13887 ts_tablet_manager.cc:1428] T f846a23f0be046028cc2472de88b71c4 P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20250830 07:54:33.984911 13887 tablet_bootstrap.cc:492] T d876f6259bd94799a4e37dc9d14b8efe P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:54:33.987210 13887 tablet_bootstrap.cc:654] T d876f6259bd94799a4e37dc9d14b8efe P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:33.990211 13225 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_71e753273a2447a98b3b3a1a12a1e720" } modify_external_catalogs: true
I20250830 07:54:33.990423 13225 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_71e753273a2447a98b3b3a1a12a1e720" } modify_external_catalogs: true
I20250830 07:54:33.993216 13228 catalog_manager.cc:5674] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967) does not have the latest schema for tablet f846a23f0be046028cc2472de88b71c4 (table default.Table_e3a02594cc004665a46fa35a486ad4fc [id=66b40d7668914309b6bd8eaf8994d9ac]). Expected version 1 got 0
I20250830 07:54:34.003181 13882 tablet_bootstrap.cc:492] T d876f6259bd94799a4e37dc9d14b8efe P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:54:34.003335 13882 ts_tablet_manager.cc:1397] T d876f6259bd94799a4e37dc9d14b8efe P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.065s user 0.015s sys 0.027s
I20250830 07:54:34.003469 13887 tablet_bootstrap.cc:492] T d876f6259bd94799a4e37dc9d14b8efe P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:54:34.003625 13887 ts_tablet_manager.cc:1397] T d876f6259bd94799a4e37dc9d14b8efe P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.019s user 0.002s sys 0.000s
I20250830 07:54:34.004434 13887 raft_consensus.cc:357] T d876f6259bd94799a4e37dc9d14b8efe P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } }
I20250830 07:54:34.004628 13887 raft_consensus.cc:383] T d876f6259bd94799a4e37dc9d14b8efe P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:34.004734 13887 raft_consensus.cc:738] T d876f6259bd94799a4e37dc9d14b8efe P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:54:34.004679 13882 raft_consensus.cc:357] T d876f6259bd94799a4e37dc9d14b8efe P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } }
I20250830 07:54:34.004863 13882 raft_consensus.cc:383] T d876f6259bd94799a4e37dc9d14b8efe P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:34.004958 13882 raft_consensus.cc:738] T d876f6259bd94799a4e37dc9d14b8efe P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:54:34.004997 13887 consensus_queue.cc:260] T d876f6259bd94799a4e37dc9d14b8efe P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } }
I20250830 07:54:34.005206 13882 consensus_queue.cc:260] T d876f6259bd94799a4e37dc9d14b8efe P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } }
I20250830 07:54:34.006884 13882 ts_tablet_manager.cc:1428] T d876f6259bd94799a4e37dc9d14b8efe P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20250830 07:54:34.007750 13887 ts_tablet_manager.cc:1428] T d876f6259bd94799a4e37dc9d14b8efe P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20250830 07:54:34.007920 13886 tablet_bootstrap.cc:492] T d876f6259bd94799a4e37dc9d14b8efe P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:54:34.008036 13887 tablet_bootstrap.cc:492] T 508ce3cc87734e5b8cec40e74522549a P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:54:34.008157 13886 ts_tablet_manager.cc:1397] T d876f6259bd94799a4e37dc9d14b8efe P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.116s user 0.009s sys 0.028s
I20250830 07:54:34.009568 13887 tablet_bootstrap.cc:654] T 508ce3cc87734e5b8cec40e74522549a P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
W20250830 07:54:34.011664 13232 catalog_manager.cc:5415] Ignoring report from unknown tablet 4b7eff24965f4f3ebfbf70dc82b7cce3
W20250830 07:54:34.011739 13232 catalog_manager.cc:5415] Ignoring report from unknown tablet ef16b9e2d444489699f4db1ac26d5f6c
W20250830 07:54:34.011806 13232 catalog_manager.cc:5415] Ignoring report from unknown tablet 7ed22d9617024d55a8add137e7971061
W20250830 07:54:34.011850 13232 catalog_manager.cc:5415] Ignoring report from unknown tablet 18afeddd2c0642028f93a16323b6e849
W20250830 07:54:34.011924 13232 catalog_manager.cc:5415] Ignoring report from unknown tablet b4ab964a64a64e00a78ffd2b220aef46
W20250830 07:54:34.011963 13232 catalog_manager.cc:5415] Ignoring report from unknown tablet a78c522b9fa945e2879fb965d82fb359
I20250830 07:54:34.011916 13886 raft_consensus.cc:357] T d876f6259bd94799a4e37dc9d14b8efe P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } }
W20250830 07:54:34.012055 13232 catalog_manager.cc:5415] Ignoring report from unknown tablet 4ab63ff59d4e4ec2b7b64d605545a870
I20250830 07:54:34.012072 13886 raft_consensus.cc:383] T d876f6259bd94799a4e37dc9d14b8efe P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:34.012146 13886 raft_consensus.cc:738] T d876f6259bd94799a4e37dc9d14b8efe P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:54:34.007184 13882 tablet_bootstrap.cc:492] T 0186504d9e4949179ce5b92b85f5b230 P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:54:34.014546 13226 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_08edc8805a67477588ae6df3db03fcff" } modify_external_catalogs: true
I20250830 07:54:34.014693 13226 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_08edc8805a67477588ae6df3db03fcff" } modify_external_catalogs: true
I20250830 07:54:34.015077 13882 tablet_bootstrap.cc:654] T 0186504d9e4949179ce5b92b85f5b230 P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:34.015532 13886 consensus_queue.cc:260] T d876f6259bd94799a4e37dc9d14b8efe P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } }
I20250830 07:54:34.016006 13886 ts_tablet_manager.cc:1428] T d876f6259bd94799a4e37dc9d14b8efe P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.008s user 0.000s sys 0.001s
I20250830 07:54:34.016297 13886 tablet_bootstrap.cc:492] T d33a5d107c6849aca6eb48ffdf8a5463 P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:54:34.017133 13227 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet 6cf10b7011d444cba0ac758add292477
I20250830 07:54:34.017849 13227 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_9b3c1b8da52e44d8a8215a004afb6f4a" } modify_external_catalogs: true
I20250830 07:54:34.018062 13227 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_9b3c1b8da52e44d8a8215a004afb6f4a" } modify_external_catalogs: true
I20250830 07:54:34.020030 13886 tablet_bootstrap.cc:654] T d33a5d107c6849aca6eb48ffdf8a5463 P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:34.020758 13466 tablet_service.cc:1515] Processing DeleteTablet for tablet 6cf10b7011d444cba0ac758add292477 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:33 UTC) from {username='slave'} at 127.0.0.1:37956
I20250830 07:54:34.021044 13754 tablet_service.cc:1515] Processing DeleteTablet for tablet 6cf10b7011d444cba0ac758add292477 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:33 UTC) from {username='slave'} at 127.0.0.1:45460
W20250830 07:54:34.021955 13218 catalog_manager.cc:4908] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): delete failed for tablet 6cf10b7011d444cba0ac758add292477 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6cf10b7011d444cba0ac758add292477 already in progress: creating tablet
I20250830 07:54:34.022817 13999 webserver.cc:480] Webserver started at http://127.12.209.60:32915/ using document root <none> and password file <none>
W20250830 07:54:34.023068 13219 catalog_manager.cc:4908] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): delete failed for tablet 6cf10b7011d444cba0ac758add292477 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6cf10b7011d444cba0ac758add292477 already in progress: creating tablet
I20250830 07:54:34.024045 13999 fs_manager.cc:362] Metadata directory not provided
I20250830 07:54:34.024247 13999 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20250830 07:54:34.024895 13604 tablet_service.cc:1515] Processing DeleteTablet for tablet 6cf10b7011d444cba0ac758add292477 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:33 UTC) from {username='slave'} at 127.0.0.1:45306
W20250830 07:54:34.025470 13220 catalog_manager.cc:4908] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet 6cf10b7011d444cba0ac758add292477 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6cf10b7011d444cba0ac758add292477 already in progress: creating tablet
I20250830 07:54:34.027143 13882 tablet_bootstrap.cc:492] T 0186504d9e4949179ce5b92b85f5b230 P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:54:34.027280 13882 ts_tablet_manager.cc:1397] T 0186504d9e4949179ce5b92b85f5b230 P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.020s user 0.004s sys 0.006s
I20250830 07:54:34.027889 13882 raft_consensus.cc:357] T 0186504d9e4949179ce5b92b85f5b230 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:34.028065 13882 raft_consensus.cc:383] T 0186504d9e4949179ce5b92b85f5b230 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:34.028132 13882 raft_consensus.cc:738] T 0186504d9e4949179ce5b92b85f5b230 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:54:34.028363 13882 consensus_queue.cc:260] T 0186504d9e4949179ce5b92b85f5b230 P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:34.030066 13882 ts_tablet_manager.cc:1428] T 0186504d9e4949179ce5b92b85f5b230 P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20250830 07:54:34.030346 13882 tablet_bootstrap.cc:492] T 508ce3cc87734e5b8cec40e74522549a P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:54:34.032239 13887 tablet_bootstrap.cc:492] T 508ce3cc87734e5b8cec40e74522549a P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:54:34.032378 13887 ts_tablet_manager.cc:1397] T 508ce3cc87734e5b8cec40e74522549a P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.024s user 0.002s sys 0.002s
I20250830 07:54:34.033138 13887 raft_consensus.cc:357] T 508ce3cc87734e5b8cec40e74522549a P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } }
I20250830 07:54:34.033315 13887 raft_consensus.cc:383] T 508ce3cc87734e5b8cec40e74522549a P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:34.033416 13887 raft_consensus.cc:738] T 508ce3cc87734e5b8cec40e74522549a P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:54:34.033674 13887 consensus_queue.cc:260] T 508ce3cc87734e5b8cec40e74522549a P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } }
I20250830 07:54:34.035354 13882 tablet_bootstrap.cc:654] T 508ce3cc87734e5b8cec40e74522549a P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:34.037133 13887 ts_tablet_manager.cc:1428] T 508ce3cc87734e5b8cec40e74522549a P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20250830 07:54:34.038242 13887 tablet_bootstrap.cc:492] T 0186504d9e4949179ce5b92b85f5b230 P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:54:34.039846 13886 tablet_bootstrap.cc:492] T d33a5d107c6849aca6eb48ffdf8a5463 P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:54:34.040035 13886 ts_tablet_manager.cc:1397] T d33a5d107c6849aca6eb48ffdf8a5463 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.024s user 0.003s sys 0.000s
I20250830 07:54:34.040164 13231 master_service.cc:948] ReplaceTablet: received request to replace tablet 5ce773ce68f649b1bf51f0dd901cb04f from {username='slave'} at 127.0.0.1:42126
I20250830 07:54:34.040566 13231 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_bbe8362d528c4f07a0a2736e8c7bcfec" } new_table_name: "default.Table_aaa473768ea54b76aa309b0ce75757fa" modify_external_catalogs: true
I20250830 07:54:34.041742 13886 raft_consensus.cc:357] T d33a5d107c6849aca6eb48ffdf8a5463 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } }
I20250830 07:54:34.041977 13886 raft_consensus.cc:383] T d33a5d107c6849aca6eb48ffdf8a5463 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:34.042075 13886 raft_consensus.cc:738] T d33a5d107c6849aca6eb48ffdf8a5463 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:54:34.042295 13886 consensus_queue.cc:260] T d33a5d107c6849aca6eb48ffdf8a5463 P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } }
I20250830 07:54:34.043483 13886 ts_tablet_manager.cc:1428] T d33a5d107c6849aca6eb48ffdf8a5463 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.003s user 0.002s sys 0.001s
I20250830 07:54:34.043748 13886 tablet_bootstrap.cc:492] T 0186504d9e4949179ce5b92b85f5b230 P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
W20250830 07:54:34.045125 13229 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 69d6daeb7c774fd48ed296f52ed7c6a6 has no consensus state
I20250830 07:54:34.045504 13229 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_c02d944178e54c07946be5f4f5e4e0f5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:34.046043 13229 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c02d944178e54c07946be5f4f5e4e0f5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:34.046078 14018 consensus_queue.cc:1035] T 5ce773ce68f649b1bf51f0dd901cb04f P 6b5e454d98894637b466ea27f1b647f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:54:34.050779 13886 tablet_bootstrap.cc:654] T 0186504d9e4949179ce5b92b85f5b230 P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:34.052451 13887 tablet_bootstrap.cc:654] T 0186504d9e4949179ce5b92b85f5b230 P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:34.053994 13886 tablet_bootstrap.cc:492] T 0186504d9e4949179ce5b92b85f5b230 P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:54:34.054107 13886 ts_tablet_manager.cc:1397] T 0186504d9e4949179ce5b92b85f5b230 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.010s user 0.001s sys 0.002s
W20250830 07:54:34.054776 13234 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 4828280e6fec4338b35422917966ac8c has no consensus state
I20250830 07:54:34.054795 13886 raft_consensus.cc:357] T 0186504d9e4949179ce5b92b85f5b230 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:34.054965 13886 raft_consensus.cc:383] T 0186504d9e4949179ce5b92b85f5b230 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:34.055040 13886 raft_consensus.cc:738] T 0186504d9e4949179ce5b92b85f5b230 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:54:34.055167 13234 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_b31f9b26da3445538f49f6cdb78f802c" } modify_external_catalogs: true
I20250830 07:54:34.055364 13234 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_b31f9b26da3445538f49f6cdb78f802c" } modify_external_catalogs: true
I20250830 07:54:34.055233 13886 consensus_queue.cc:260] T 0186504d9e4949179ce5b92b85f5b230 P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:34.055828 13886 ts_tablet_manager.cc:1428] T 0186504d9e4949179ce5b92b85f5b230 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20250830 07:54:34.056053 13886 tablet_bootstrap.cc:492] T 508ce3cc87734e5b8cec40e74522549a P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:54:34.058089 13886 tablet_bootstrap.cc:654] T 508ce3cc87734e5b8cec40e74522549a P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:34.063712 13887 tablet_bootstrap.cc:492] T 0186504d9e4949179ce5b92b85f5b230 P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:54:34.063889 13887 ts_tablet_manager.cc:1397] T 0186504d9e4949179ce5b92b85f5b230 P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.026s user 0.000s sys 0.003s
I20250830 07:54:34.064800 13887 raft_consensus.cc:357] T 0186504d9e4949179ce5b92b85f5b230 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:34.065043 13887 raft_consensus.cc:383] T 0186504d9e4949179ce5b92b85f5b230 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:34.065142 13887 raft_consensus.cc:738] T 0186504d9e4949179ce5b92b85f5b230 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:54:34.065448 13887 consensus_queue.cc:260] T 0186504d9e4949179ce5b92b85f5b230 P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:34.066426 13225 catalog_manager.cc:5864] Not sending DeleteTablet requests; no consensus state for tablet 2ecfffa4650f470394aceb8254aea4a4
I20250830 07:54:34.066761 13225 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_e3c92a53cb994620a7bf2072b4aefa05" } new_table_name: "default.Table_739e22d6e6554d3d8859e047e088514f" modify_external_catalogs: true
I20250830 07:54:34.068285 13887 ts_tablet_manager.cc:1428] T 0186504d9e4949179ce5b92b85f5b230 P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.004s user 0.001s sys 0.002s
I20250830 07:54:34.072353 13887 tablet_bootstrap.cc:492] T dfccff3bd0cb4c7d998633b015de3cfa P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:54:34.078217 13956 consensus_queue.cc:1035] T 5ce773ce68f649b1bf51f0dd901cb04f P 6b5e454d98894637b466ea27f1b647f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:54:34.074105 13887 tablet_bootstrap.cc:654] T dfccff3bd0cb4c7d998633b015de3cfa P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:34.087487 13230 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet ccc90f6c867147cc9fe93c9ffa2e4802
I20250830 07:54:34.087977 13230 catalog_manager.cc:6652] ReplaceTablet: tablet ccc90f6c867147cc9fe93c9ffa2e4802 deleted and replaced by tablet 66d59910b4b2451a851e9d2728d50f42
I20250830 07:54:34.088800 13232 catalog_manager.cc:5674] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325) does not have the latest schema for tablet f846a23f0be046028cc2472de88b71c4 (table default.Table_e3a02594cc004665a46fa35a486ad4fc [id=66b40d7668914309b6bd8eaf8994d9ac]). Expected version 1 got 0
I20250830 07:54:34.090195 13466 tablet_service.cc:1515] Processing DeleteTablet for tablet ccc90f6c867147cc9fe93c9ffa2e4802 with delete_type TABLET_DATA_DELETED (replaced by tablet 66d59910b4b2451a851e9d2728d50f42) from {username='slave'} at 127.0.0.1:37956
I20250830 07:54:34.090464 13883 tablet_replica.cc:331] T ccc90f6c867147cc9fe93c9ffa2e4802 P 2065c332f15a4739899af79f3669c3ba: stopping tablet replica
I20250830 07:54:34.090705 13883 raft_consensus.cc:2241] T ccc90f6c867147cc9fe93c9ffa2e4802 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Raft consensus shutting down.
I20250830 07:54:34.090929 13883 raft_consensus.cc:2270] T ccc90f6c867147cc9fe93c9ffa2e4802 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20250830 07:54:34.091203 13233 catalog_manager.cc:6127] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: default.Table_89fb50934e7f4289bbb16b05a52a3af4 [id=1b7c141ed8af4dcab20683653fd59ee1] alter complete (version 5)
I20250830 07:54:34.091888 13883 ts_tablet_manager.cc:1905] T ccc90f6c867147cc9fe93c9ffa2e4802 P 2065c332f15a4739899af79f3669c3ba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250830 07:54:34.094059 13604 tablet_service.cc:1515] Processing DeleteTablet for tablet ccc90f6c867147cc9fe93c9ffa2e4802 with delete_type TABLET_DATA_DELETED (replaced by tablet 66d59910b4b2451a851e9d2728d50f42) from {username='slave'} at 127.0.0.1:45306
I20250830 07:54:34.094370 13754 tablet_service.cc:1515] Processing DeleteTablet for tablet ccc90f6c867147cc9fe93c9ffa2e4802 with delete_type TABLET_DATA_DELETED (replaced by tablet 66d59910b4b2451a851e9d2728d50f42) from {username='slave'} at 127.0.0.1:45460
I20250830 07:54:34.095358 13885 tablet_replica.cc:331] T ccc90f6c867147cc9fe93c9ffa2e4802 P 6b5e454d98894637b466ea27f1b647f9: stopping tablet replica
I20250830 07:54:34.095588 13885 raft_consensus.cc:2241] T ccc90f6c867147cc9fe93c9ffa2e4802 P 6b5e454d98894637b466ea27f1b647f9 [term 1 LEADER]: Raft consensus shutting down.
I20250830 07:54:34.096007 13885 raft_consensus.cc:2270] T ccc90f6c867147cc9fe93c9ffa2e4802 P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250830 07:54:34.096338 13884 tablet_replica.cc:331] T ccc90f6c867147cc9fe93c9ffa2e4802 P 9b057ade5dce45af9f8bf0bedf8b917f: stopping tablet replica
I20250830 07:54:34.096591 13884 raft_consensus.cc:2241] T ccc90f6c867147cc9fe93c9ffa2e4802 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Raft consensus shutting down.
I20250830 07:54:34.096904 13884 raft_consensus.cc:2270] T ccc90f6c867147cc9fe93c9ffa2e4802 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Raft consensus is shut down!
I20250830 07:54:34.100070 13883 ts_tablet_manager.cc:1918] T ccc90f6c867147cc9fe93c9ffa2e4802 P 2065c332f15a4739899af79f3669c3ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250830 07:54:34.100206 13883 log.cc:1199] T ccc90f6c867147cc9fe93c9ffa2e4802 P 2065c332f15a4739899af79f3669c3ba: Deleting WAL directory at /tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/ts-0/wal/wals/ccc90f6c867147cc9fe93c9ffa2e4802
I20250830 07:54:34.100610 13883 ts_tablet_manager.cc:1939] T ccc90f6c867147cc9fe93c9ffa2e4802 P 2065c332f15a4739899af79f3669c3ba: Deleting consensus metadata
I20250830 07:54:34.107347 13887 tablet_bootstrap.cc:492] T dfccff3bd0cb4c7d998633b015de3cfa P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:54:34.107506 13887 ts_tablet_manager.cc:1397] T dfccff3bd0cb4c7d998633b015de3cfa P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.039s user 0.002s sys 0.002s
I20250830 07:54:34.108088 13999 fs_manager.cc:714] Time spent opening directory manager: real 0.081s user 0.010s sys 0.000s
I20250830 07:54:34.108445 13887 raft_consensus.cc:357] T dfccff3bd0cb4c7d998633b015de3cfa P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:34.108649 13887 raft_consensus.cc:383] T dfccff3bd0cb4c7d998633b015de3cfa P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:34.108745 13887 raft_consensus.cc:738] T dfccff3bd0cb4c7d998633b015de3cfa P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:54:34.108971 13218 catalog_manager.cc:4928] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): tablet ccc90f6c867147cc9fe93c9ffa2e4802 (table default.Table_89fb50934e7f4289bbb16b05a52a3af4 [id=1b7c141ed8af4dcab20683653fd59ee1]) successfully deleted
I20250830 07:54:34.109042 13887 consensus_queue.cc:260] T dfccff3bd0cb4c7d998633b015de3cfa P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:34.112187 13884 ts_tablet_manager.cc:1905] T ccc90f6c867147cc9fe93c9ffa2e4802 P 9b057ade5dce45af9f8bf0bedf8b917f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250830 07:54:34.115312 13887 ts_tablet_manager.cc:1428] T dfccff3bd0cb4c7d998633b015de3cfa P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.008s user 0.003s sys 0.000s
I20250830 07:54:34.117821 13887 tablet_bootstrap.cc:492] T d0238794efb14150af6138b0d8bd80ec P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:54:34.119481 13466 tablet_service.cc:1515] Processing DeleteTablet for tablet ccc90f6c867147cc9fe93c9ffa2e4802 with delete_type TABLET_DATA_DELETED (replaced by tablet 66d59910b4b2451a851e9d2728d50f42) from {username='slave'} at 127.0.0.1:37956
I20250830 07:54:34.121572 13887 tablet_bootstrap.cc:654] T d0238794efb14150af6138b0d8bd80ec P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:34.123412 13885 ts_tablet_manager.cc:1905] T ccc90f6c867147cc9fe93c9ffa2e4802 P 6b5e454d98894637b466ea27f1b647f9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250830 07:54:34.126637 13954 raft_consensus.cc:491] T d876f6259bd94799a4e37dc9d14b8efe P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:34.126837 13954 raft_consensus.cc:513] T d876f6259bd94799a4e37dc9d14b8efe P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } }
W20250830 07:54:34.127274 13218 catalog_manager.cc:4895] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): delete failed for tablet ccc90f6c867147cc9fe93c9ffa2e4802 because the tablet was not found. No further retry: Not found: Tablet not found: ccc90f6c867147cc9fe93c9ffa2e4802
I20250830 07:54:34.127609 13954 leader_election.cc:290] T d876f6259bd94799a4e37dc9d14b8efe P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743), 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967)
I20250830 07:54:34.128535 13775 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "d876f6259bd94799a4e37dc9d14b8efe" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:34.128755 13775 raft_consensus.cc:2466] T d876f6259bd94799a4e37dc9d14b8efe P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2065c332f15a4739899af79f3669c3ba in term 0.
I20250830 07:54:34.129143 13628 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "d876f6259bd94799a4e37dc9d14b8efe" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:34.129333 13628 raft_consensus.cc:2466] T d876f6259bd94799a4e37dc9d14b8efe P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2065c332f15a4739899af79f3669c3ba in term 0.
I20250830 07:54:34.129752 13423 leader_election.cc:304] T d876f6259bd94799a4e37dc9d14b8efe P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 6b5e454d98894637b466ea27f1b647f9; no voters:
I20250830 07:54:34.130313 13954 raft_consensus.cc:2802] T d876f6259bd94799a4e37dc9d14b8efe P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:54:34.130396 13954 raft_consensus.cc:491] T d876f6259bd94799a4e37dc9d14b8efe P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:54:34.130475 13954 raft_consensus.cc:3058] T d876f6259bd94799a4e37dc9d14b8efe P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:34.133005 13954 raft_consensus.cc:513] T d876f6259bd94799a4e37dc9d14b8efe P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } }
I20250830 07:54:34.134238 13775 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "d876f6259bd94799a4e37dc9d14b8efe" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f"
I20250830 07:54:34.134459 13775 raft_consensus.cc:3058] T d876f6259bd94799a4e37dc9d14b8efe P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:34.137200 13775 raft_consensus.cc:2466] T d876f6259bd94799a4e37dc9d14b8efe P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2065c332f15a4739899af79f3669c3ba in term 1.
I20250830 07:54:34.137630 13422 leader_election.cc:304] T d876f6259bd94799a4e37dc9d14b8efe P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters:
I20250830 07:54:34.137866 13887 tablet_bootstrap.cc:492] T d0238794efb14150af6138b0d8bd80ec P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:54:34.137957 14038 raft_consensus.cc:2802] T d876f6259bd94799a4e37dc9d14b8efe P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election won for term 1
I20250830 07:54:34.137979 13884 ts_tablet_manager.cc:1918] T ccc90f6c867147cc9fe93c9ffa2e4802 P 9b057ade5dce45af9f8bf0bedf8b917f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250830 07:54:34.138032 13887 ts_tablet_manager.cc:1397] T d0238794efb14150af6138b0d8bd80ec P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.020s user 0.003s sys 0.000s
I20250830 07:54:34.138087 13884 log.cc:1199] T ccc90f6c867147cc9fe93c9ffa2e4802 P 9b057ade5dce45af9f8bf0bedf8b917f: Deleting WAL directory at /tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/ts-2/wal/wals/ccc90f6c867147cc9fe93c9ffa2e4802
I20250830 07:54:34.138105 14038 raft_consensus.cc:695] T d876f6259bd94799a4e37dc9d14b8efe P 2065c332f15a4739899af79f3669c3ba [term 1 LEADER]: Becoming Leader. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Running, Role: LEADER
I20250830 07:54:34.138528 13884 ts_tablet_manager.cc:1939] T ccc90f6c867147cc9fe93c9ffa2e4802 P 9b057ade5dce45af9f8bf0bedf8b917f: Deleting consensus metadata
I20250830 07:54:34.138481 14038 consensus_queue.cc:237] T d876f6259bd94799a4e37dc9d14b8efe P 2065c332f15a4739899af79f3669c3ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } }
I20250830 07:54:34.138748 13628 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "d876f6259bd94799a4e37dc9d14b8efe" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9"
I20250830 07:54:34.138931 13628 raft_consensus.cc:3058] T d876f6259bd94799a4e37dc9d14b8efe P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:34.138880 13887 raft_consensus.cc:357] T d0238794efb14150af6138b0d8bd80ec P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:34.139082 13887 raft_consensus.cc:383] T d0238794efb14150af6138b0d8bd80ec P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:34.139163 13887 raft_consensus.cc:738] T d0238794efb14150af6138b0d8bd80ec P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:54:34.139415 13887 consensus_queue.cc:260] T d0238794efb14150af6138b0d8bd80ec P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:34.139783 13219 catalog_manager.cc:4928] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): tablet ccc90f6c867147cc9fe93c9ffa2e4802 (table default.Table_89fb50934e7f4289bbb16b05a52a3af4 [id=1b7c141ed8af4dcab20683653fd59ee1]) successfully deleted
I20250830 07:54:34.140317 13954 leader_election.cc:290] T d876f6259bd94799a4e37dc9d14b8efe P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 election: Requested vote from peers 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743), 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967)
I20250830 07:54:34.141525 13887 ts_tablet_manager.cc:1428] T d0238794efb14150af6138b0d8bd80ec P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20250830 07:54:34.142498 13887 tablet_bootstrap.cc:492] T f53e7423d1f54566a667195f7cf5e1ce P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:54:34.142475 13628 raft_consensus.cc:2466] T d876f6259bd94799a4e37dc9d14b8efe P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2065c332f15a4739899af79f3669c3ba in term 1.
I20250830 07:54:34.144225 13887 tablet_bootstrap.cc:654] T f53e7423d1f54566a667195f7cf5e1ce P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:34.147387 13882 tablet_bootstrap.cc:492] T 508ce3cc87734e5b8cec40e74522549a P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:54:34.147536 13882 ts_tablet_manager.cc:1397] T 508ce3cc87734e5b8cec40e74522549a P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.117s user 0.009s sys 0.032s
I20250830 07:54:34.148324 13882 raft_consensus.cc:357] T 508ce3cc87734e5b8cec40e74522549a P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } }
I20250830 07:54:34.148491 13882 raft_consensus.cc:383] T 508ce3cc87734e5b8cec40e74522549a P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:34.148572 13882 raft_consensus.cc:738] T 508ce3cc87734e5b8cec40e74522549a P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:54:34.148773 13882 consensus_queue.cc:260] T 508ce3cc87734e5b8cec40e74522549a P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } }
I20250830 07:54:34.149261 13882 ts_tablet_manager.cc:1428] T 508ce3cc87734e5b8cec40e74522549a P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20250830 07:54:34.149545 13882 tablet_bootstrap.cc:492] T dfccff3bd0cb4c7d998633b015de3cfa P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:54:34.151868 13882 tablet_bootstrap.cc:654] T dfccff3bd0cb4c7d998633b015de3cfa P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:34.158767 13226 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet 9696d8531a174585b8fd83a2391c02f7
I20250830 07:54:34.159155 13227 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet 27da527d9fe045ae8c17f193d034f5ac
I20250830 07:54:34.159927 14030 raft_consensus.cc:491] T d33a5d107c6849aca6eb48ffdf8a5463 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:34.160094 14030 raft_consensus.cc:513] T d33a5d107c6849aca6eb48ffdf8a5463 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } }
I20250830 07:54:34.160292 13887 tablet_bootstrap.cc:492] T f53e7423d1f54566a667195f7cf5e1ce P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
W20250830 07:54:34.160491 13231 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 007435e198b9440db055711a98e3148a has no consensus state
I20250830 07:54:34.160600 13954 raft_consensus.cc:491] T 508ce3cc87734e5b8cec40e74522549a P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:34.160727 13231 master_service.cc:948] ReplaceTablet: received request to replace tablet d876f6259bd94799a4e37dc9d14b8efe from {username='slave'} at 127.0.0.1:42126
I20250830 07:54:34.160754 14030 leader_election.cc:290] T d33a5d107c6849aca6eb48ffdf8a5463 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967)
I20250830 07:54:34.160768 13954 raft_consensus.cc:513] T 508ce3cc87734e5b8cec40e74522549a P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } }
I20250830 07:54:34.161454 13487 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "d33a5d107c6849aca6eb48ffdf8a5463" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:54:34.161705 13487 raft_consensus.cc:2391] T d33a5d107c6849aca6eb48ffdf8a5463 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b057ade5dce45af9f8bf0bedf8b917f in current term 1: Already voted for candidate 6b5e454d98894637b466ea27f1b647f9 in this term.
I20250830 07:54:34.161984 13954 leader_election.cc:290] T 508ce3cc87734e5b8cec40e74522549a P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743), 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967)
I20250830 07:54:34.162137 13887 ts_tablet_manager.cc:1397] T f53e7423d1f54566a667195f7cf5e1ce P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.020s user 0.004s sys 0.000s
I20250830 07:54:34.162505 13605 tablet_service.cc:1515] Processing DeleteTablet for tablet 9696d8531a174585b8fd83a2391c02f7 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:34 UTC) from {username='slave'} at 127.0.0.1:45306
I20250830 07:54:34.162771 13604 tablet_service.cc:1515] Processing DeleteTablet for tablet 27da527d9fe045ae8c17f193d034f5ac with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:34 UTC) from {username='slave'} at 127.0.0.1:45306
W20250830 07:54:34.163226 13703 leader_election.cc:343] T d33a5d107c6849aca6eb48ffdf8a5463 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Not found: Tablet not found: d33a5d107c6849aca6eb48ffdf8a5463
I20250830 07:54:34.163344 13703 leader_election.cc:304] T d33a5d107c6849aca6eb48ffdf8a5463 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 2065c332f15a4739899af79f3669c3ba, 6b5e454d98894637b466ea27f1b647f9
I20250830 07:54:34.163868 14030 raft_consensus.cc:3058] T d33a5d107c6849aca6eb48ffdf8a5463 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:34.165076 13466 tablet_service.cc:1515] Processing DeleteTablet for tablet 27da527d9fe045ae8c17f193d034f5ac with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:34 UTC) from {username='slave'} at 127.0.0.1:37956
I20250830 07:54:34.165306 13459 tablet_service.cc:1515] Processing DeleteTablet for tablet 9696d8531a174585b8fd83a2391c02f7 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:34 UTC) from {username='slave'} at 127.0.0.1:37956
W20250830 07:54:34.165979 13218 catalog_manager.cc:4908] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): delete failed for tablet 27da527d9fe045ae8c17f193d034f5ac because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 27da527d9fe045ae8c17f193d034f5ac already in progress: creating tablet
W20250830 07:54:34.166225 13218 catalog_manager.cc:4908] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): delete failed for tablet 9696d8531a174585b8fd83a2391c02f7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9696d8531a174585b8fd83a2391c02f7 already in progress: creating tablet
I20250830 07:54:34.166195 13887 raft_consensus.cc:357] T f53e7423d1f54566a667195f7cf5e1ce P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:34.166388 13887 raft_consensus.cc:383] T f53e7423d1f54566a667195f7cf5e1ce P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:34.166478 13887 raft_consensus.cc:738] T f53e7423d1f54566a667195f7cf5e1ce P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:54:34.166662 13887 consensus_queue.cc:260] T f53e7423d1f54566a667195f7cf5e1ce P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:34.167639 13775 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "508ce3cc87734e5b8cec40e74522549a" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
W20250830 07:54:34.168255 13422 leader_election.cc:343] T 508ce3cc87734e5b8cec40e74522549a P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:34.168457 13628 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "508ce3cc87734e5b8cec40e74522549a" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:34.169126 13887 ts_tablet_manager.cc:1428] T f53e7423d1f54566a667195f7cf5e1ce P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.007s user 0.002s sys 0.000s
I20250830 07:54:34.169409 13628 raft_consensus.cc:2466] T 508ce3cc87734e5b8cec40e74522549a P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2065c332f15a4739899af79f3669c3ba in term 0.
I20250830 07:54:34.170069 13423 leader_election.cc:304] T 508ce3cc87734e5b8cec40e74522549a P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 6b5e454d98894637b466ea27f1b647f9; no voters: 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:54:34.170764 14030 raft_consensus.cc:2747] T d33a5d107c6849aca6eb48ffdf8a5463 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:54:34.171274 14040 raft_consensus.cc:2802] T 508ce3cc87734e5b8cec40e74522549a P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:54:34.171387 14040 raft_consensus.cc:491] T 508ce3cc87734e5b8cec40e74522549a P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:54:34.171766 13882 tablet_bootstrap.cc:492] T dfccff3bd0cb4c7d998633b015de3cfa P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:54:34.171922 13882 ts_tablet_manager.cc:1397] T dfccff3bd0cb4c7d998633b015de3cfa P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.022s user 0.006s sys 0.004s
I20250830 07:54:34.172698 13882 raft_consensus.cc:357] T dfccff3bd0cb4c7d998633b015de3cfa P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:34.172874 13882 raft_consensus.cc:383] T dfccff3bd0cb4c7d998633b015de3cfa P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:34.172940 13882 raft_consensus.cc:738] T dfccff3bd0cb4c7d998633b015de3cfa P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:54:34.173573 13886 tablet_bootstrap.cc:492] T 508ce3cc87734e5b8cec40e74522549a P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:54:34.173708 13886 ts_tablet_manager.cc:1397] T 508ce3cc87734e5b8cec40e74522549a P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.118s user 0.025s sys 0.025s
I20250830 07:54:34.174336 13886 raft_consensus.cc:357] T 508ce3cc87734e5b8cec40e74522549a P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } }
I20250830 07:54:34.174513 13886 raft_consensus.cc:383] T 508ce3cc87734e5b8cec40e74522549a P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:34.174582 13886 raft_consensus.cc:738] T 508ce3cc87734e5b8cec40e74522549a P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:54:34.174774 14040 raft_consensus.cc:3058] T 508ce3cc87734e5b8cec40e74522549a P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:34.175324 13887 tablet_bootstrap.cc:492] T c82ac0102b4442449073e44d8a3d9065 P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:54:34.175145 13885 ts_tablet_manager.cc:1918] T ccc90f6c867147cc9fe93c9ffa2e4802 P 6b5e454d98894637b466ea27f1b647f9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250830 07:54:34.175485 13954 raft_consensus.cc:491] T f846a23f0be046028cc2472de88b71c4 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:34.175621 13954 raft_consensus.cc:513] T f846a23f0be046028cc2472de88b71c4 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } }
I20250830 07:54:34.175714 13885 log.cc:1199] T ccc90f6c867147cc9fe93c9ffa2e4802 P 6b5e454d98894637b466ea27f1b647f9: Deleting WAL directory at /tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/ts-1/wal/wals/ccc90f6c867147cc9fe93c9ffa2e4802
I20250830 07:54:34.175856 13886 consensus_queue.cc:260] T 508ce3cc87734e5b8cec40e74522549a P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } }
I20250830 07:54:34.176193 13882 consensus_queue.cc:260] T dfccff3bd0cb4c7d998633b015de3cfa P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:34.176607 13775 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f846a23f0be046028cc2472de88b71c4" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:34.176741 13954 leader_election.cc:290] T f846a23f0be046028cc2472de88b71c4 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743), 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967)
I20250830 07:54:34.176822 13775 raft_consensus.cc:2466] T f846a23f0be046028cc2472de88b71c4 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2065c332f15a4739899af79f3669c3ba in term 0.
I20250830 07:54:34.177857 13886 ts_tablet_manager.cc:1428] T 508ce3cc87734e5b8cec40e74522549a P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20250830 07:54:34.178164 13886 tablet_bootstrap.cc:492] T f53e7423d1f54566a667195f7cf5e1ce P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:54:34.179011 13882 ts_tablet_manager.cc:1428] T dfccff3bd0cb4c7d998633b015de3cfa P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.007s user 0.002s sys 0.000s
I20250830 07:54:34.179200 13885 ts_tablet_manager.cc:1939] T ccc90f6c867147cc9fe93c9ffa2e4802 P 6b5e454d98894637b466ea27f1b647f9: Deleting consensus metadata
I20250830 07:54:34.179495 14040 raft_consensus.cc:513] T 508ce3cc87734e5b8cec40e74522549a P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } }
I20250830 07:54:34.180637 13220 catalog_manager.cc:4928] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): tablet ccc90f6c867147cc9fe93c9ffa2e4802 (table default.Table_89fb50934e7f4289bbb16b05a52a3af4 [id=1b7c141ed8af4dcab20683653fd59ee1]) successfully deleted
I20250830 07:54:34.179314 13882 tablet_bootstrap.cc:492] T f53e7423d1f54566a667195f7cf5e1ce P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:54:34.180912 14040 leader_election.cc:290] T 508ce3cc87734e5b8cec40e74522549a P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 election: Requested vote from peers 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743), 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967)
W20250830 07:54:34.181178 13220 catalog_manager.cc:4908] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet 9696d8531a174585b8fd83a2391c02f7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9696d8531a174585b8fd83a2391c02f7 already in progress: creating tablet
I20250830 07:54:34.181326 13422 leader_election.cc:304] T f846a23f0be046028cc2472de88b71c4 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters:
W20250830 07:54:34.181445 13220 catalog_manager.cc:4908] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet 27da527d9fe045ae8c17f193d034f5ac because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 27da527d9fe045ae8c17f193d034f5ac already in progress: creating tablet
I20250830 07:54:34.181730 13775 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "508ce3cc87734e5b8cec40e74522549a" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f"
I20250830 07:54:34.181906 13886 tablet_bootstrap.cc:654] T f53e7423d1f54566a667195f7cf5e1ce P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:34.182232 14040 raft_consensus.cc:2802] T f846a23f0be046028cc2472de88b71c4 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:54:34.182334 14040 raft_consensus.cc:491] T f846a23f0be046028cc2472de88b71c4 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:54:34.182408 14040 raft_consensus.cc:3058] T f846a23f0be046028cc2472de88b71c4 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:34.182462 13775 raft_consensus.cc:3058] T 508ce3cc87734e5b8cec40e74522549a P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:34.185042 14040 raft_consensus.cc:513] T f846a23f0be046028cc2472de88b71c4 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } }
I20250830 07:54:34.185281 13775 raft_consensus.cc:2466] T 508ce3cc87734e5b8cec40e74522549a P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2065c332f15a4739899af79f3669c3ba in term 1.
I20250830 07:54:34.185606 13422 leader_election.cc:304] T 508ce3cc87734e5b8cec40e74522549a P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters:
I20250830 07:54:34.185860 13954 raft_consensus.cc:2802] T 508ce3cc87734e5b8cec40e74522549a P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election won for term 1
I20250830 07:54:34.186010 13954 raft_consensus.cc:695] T 508ce3cc87734e5b8cec40e74522549a P 2065c332f15a4739899af79f3669c3ba [term 1 LEADER]: Becoming Leader. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Running, Role: LEADER
I20250830 07:54:34.186070 13629 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "508ce3cc87734e5b8cec40e74522549a" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9"
I20250830 07:54:34.186264 13629 raft_consensus.cc:3058] T 508ce3cc87734e5b8cec40e74522549a P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:34.186235 13954 consensus_queue.cc:237] T 508ce3cc87734e5b8cec40e74522549a P 2065c332f15a4739899af79f3669c3ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } }
I20250830 07:54:34.189240 13629 raft_consensus.cc:2466] T 508ce3cc87734e5b8cec40e74522549a P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2065c332f15a4739899af79f3669c3ba in term 1.
I20250830 07:54:34.189567 13887 tablet_bootstrap.cc:654] T c82ac0102b4442449073e44d8a3d9065 P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:34.193892 13774 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f846a23f0be046028cc2472de88b71c4" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f"
I20250830 07:54:34.193938 14040 leader_election.cc:290] T f846a23f0be046028cc2472de88b71c4 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 election: Requested vote from peers 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743), 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967)
I20250830 07:54:34.195875 13774 raft_consensus.cc:3058] T f846a23f0be046028cc2472de88b71c4 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:34.196074 13887 tablet_bootstrap.cc:492] T c82ac0102b4442449073e44d8a3d9065 P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:54:34.196209 13887 ts_tablet_manager.cc:1397] T c82ac0102b4442449073e44d8a3d9065 P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.027s user 0.004s sys 0.000s
I20250830 07:54:34.196892 13887 raft_consensus.cc:357] T c82ac0102b4442449073e44d8a3d9065 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:34.197052 13887 raft_consensus.cc:383] T c82ac0102b4442449073e44d8a3d9065 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:34.197114 13887 raft_consensus.cc:738] T c82ac0102b4442449073e44d8a3d9065 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:54:34.197338 13887 consensus_queue.cc:260] T c82ac0102b4442449073e44d8a3d9065 P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:34.198066 13887 ts_tablet_manager.cc:1428] T c82ac0102b4442449073e44d8a3d9065 P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20250830 07:54:34.198506 13887 tablet_bootstrap.cc:492] T 1933d49d319b4bd7b717dda2b83859f3 P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:54:34.198702 13774 raft_consensus.cc:2466] T f846a23f0be046028cc2472de88b71c4 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2065c332f15a4739899af79f3669c3ba in term 1.
I20250830 07:54:34.199502 13422 leader_election.cc:304] T f846a23f0be046028cc2472de88b71c4 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters:
I20250830 07:54:34.199723 13629 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f846a23f0be046028cc2472de88b71c4" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9"
I20250830 07:54:34.199941 13629 raft_consensus.cc:3058] T f846a23f0be046028cc2472de88b71c4 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:34.200111 14040 raft_consensus.cc:2802] T f846a23f0be046028cc2472de88b71c4 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election won for term 1
I20250830 07:54:34.200254 14040 raft_consensus.cc:695] T f846a23f0be046028cc2472de88b71c4 P 2065c332f15a4739899af79f3669c3ba [term 1 LEADER]: Becoming Leader. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Running, Role: LEADER
I20250830 07:54:34.200814 13887 tablet_bootstrap.cc:654] T 1933d49d319b4bd7b717dda2b83859f3 P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:34.200971 14093 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20250830 07:54:34.201159 14040 consensus_queue.cc:237] T f846a23f0be046028cc2472de88b71c4 P 2065c332f15a4739899af79f3669c3ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } }
I20250830 07:54:34.203580 13629 raft_consensus.cc:2466] T f846a23f0be046028cc2472de88b71c4 P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2065c332f15a4739899af79f3669c3ba in term 1.
I20250830 07:54:34.204368 13628 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f846a23f0be046028cc2472de88b71c4" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:34.204679 13628 raft_consensus.cc:2374] T f846a23f0be046028cc2472de88b71c4 P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 2065c332f15a4739899af79f3669c3ba in term 1. Re-sending same reply.
I20250830 07:54:34.208505 13882 tablet_bootstrap.cc:654] T f53e7423d1f54566a667195f7cf5e1ce P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:34.209921 13999 fs_manager.cc:730] Time spent opening block manager: real 0.100s user 0.012s sys 0.011s
I20250830 07:54:34.211516 13999 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/master-2/data,/tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/master-2/wal
uuid: "3ea183a890b84f408b20b55e9eb7c7ed"
format_stamp: "Formatted at 2025-08-30 07:54:28 on dist-test-slave-g8n5"
I20250830 07:54:34.214568 13234 catalog_manager.cc:5864] Not sending DeleteTablet requests; no consensus state for tablet ffd15888f9ac43a7b426178921c60a43
I20250830 07:54:34.214797 13234 master_service.cc:948] ReplaceTablet: received request to replace tablet 1476bb480bf747838613948875001c30 from {username='slave'} at 127.0.0.1:42126
W20250830 07:54:34.219218 13225 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet c9a8f144d50c4d3d81fbf43ce29a2ad2 consensus state has no leader
I20250830 07:54:34.219491 13754 tablet_service.cc:1515] Processing DeleteTablet for tablet 27da527d9fe045ae8c17f193d034f5ac with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:34 UTC) from {username='slave'} at 127.0.0.1:45460
I20250830 07:54:34.220446 13754 tablet_service.cc:1515] Processing DeleteTablet for tablet 9696d8531a174585b8fd83a2391c02f7 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:34 UTC) from {username='slave'} at 127.0.0.1:45460
I20250830 07:54:34.221182 13999 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
W20250830 07:54:34.222404 13232 catalog_manager.cc:5415] Ignoring report from unknown tablet 5ce773ce68f649b1bf51f0dd901cb04f
I20250830 07:54:34.223932 13886 tablet_bootstrap.cc:492] T f53e7423d1f54566a667195f7cf5e1ce P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:54:34.224143 13886 ts_tablet_manager.cc:1397] T f53e7423d1f54566a667195f7cf5e1ce P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.046s user 0.002s sys 0.007s
W20250830 07:54:34.224691 13233 catalog_manager.cc:5415] Ignoring report from unknown tablet d876f6259bd94799a4e37dc9d14b8efe
W20250830 07:54:34.225070 13233 catalog_manager.cc:5415] Ignoring report from unknown tablet 18afeddd2c0642028f93a16323b6e849
I20250830 07:54:34.225136 13886 raft_consensus.cc:357] T f53e7423d1f54566a667195f7cf5e1ce P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:34.225311 13886 raft_consensus.cc:383] T f53e7423d1f54566a667195f7cf5e1ce P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:34.225410 13886 raft_consensus.cc:738] T f53e7423d1f54566a667195f7cf5e1ce P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:54:34.225629 13886 consensus_queue.cc:260] T f53e7423d1f54566a667195f7cf5e1ce P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
W20250830 07:54:34.225906 13232 catalog_manager.cc:5415] Ignoring report from unknown tablet d33a5d107c6849aca6eb48ffdf8a5463
W20250830 07:54:34.226132 13233 catalog_manager.cc:5415] Ignoring report from unknown tablet 5ce773ce68f649b1bf51f0dd901cb04f
I20250830 07:54:34.226445 13882 tablet_bootstrap.cc:492] T f53e7423d1f54566a667195f7cf5e1ce P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:54:34.226483 13886 ts_tablet_manager.cc:1428] T f53e7423d1f54566a667195f7cf5e1ce P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20250830 07:54:34.226593 13882 ts_tablet_manager.cc:1397] T f53e7423d1f54566a667195f7cf5e1ce P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.047s user 0.007s sys 0.000s
I20250830 07:54:34.226754 13886 tablet_bootstrap.cc:492] T dfccff3bd0cb4c7d998633b015de3cfa P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:54:34.227394 13882 raft_consensus.cc:357] T f53e7423d1f54566a667195f7cf5e1ce P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:34.227384 13230 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_57d9ce41d0254969ae072b4c6936f7f2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250830 07:54:34.227569 13882 raft_consensus.cc:383] T f53e7423d1f54566a667195f7cf5e1ce P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:34.227672 13882 raft_consensus.cc:738] T f53e7423d1f54566a667195f7cf5e1ce P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:54:34.228681 13886 tablet_bootstrap.cc:654] T dfccff3bd0cb4c7d998633b015de3cfa P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:34.229552 13225 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_2e8460bb8bf84662b02eb6dd0cb94f40"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250830 07:54:34.230005 13956 raft_consensus.cc:491] T 18afeddd2c0642028f93a16323b6e849 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:34.230156 13956 raft_consensus.cc:513] T 18afeddd2c0642028f93a16323b6e849 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } }
I20250830 07:54:34.230520 13228 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_510bdb6808fa48948663ba929c792917"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250830 07:54:34.230794 13956 leader_election.cc:290] T 18afeddd2c0642028f93a16323b6e849 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:34.230932 13226 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_9820075fa56348c883f2c302ec3b6adf" } new_table_name: "default.Table_b4d7f806dfc640eeb8c6468a8ec88e14" modify_external_catalogs: true
I20250830 07:54:34.231376 13229 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_9b6234585c0042ba812e260dbbe5752b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250830 07:54:34.231434 13487 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "18afeddd2c0642028f93a16323b6e849" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:54:34.231630 13487 raft_consensus.cc:2466] T 18afeddd2c0642028f93a16323b6e849 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b5e454d98894637b466ea27f1b647f9 in term 0.
W20250830 07:54:34.231981 13232 catalog_manager.cc:5415] Ignoring report from unknown tablet d876f6259bd94799a4e37dc9d14b8efe
W20250830 07:54:34.232064 13232 catalog_manager.cc:5415] Ignoring report from unknown tablet b4ab964a64a64e00a78ffd2b220aef46
I20250830 07:54:34.232019 13561 leader_election.cc:304] T 18afeddd2c0642028f93a16323b6e849 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 6b5e454d98894637b466ea27f1b647f9; no voters:
I20250830 07:54:34.232331 13956 raft_consensus.cc:2802] T 18afeddd2c0642028f93a16323b6e849 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:54:34.232445 13956 raft_consensus.cc:491] T 18afeddd2c0642028f93a16323b6e849 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:54:34.232553 13956 raft_consensus.cc:3058] T 18afeddd2c0642028f93a16323b6e849 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Advancing to term 1
W20250830 07:54:34.232899 13232 catalog_manager.cc:5415] Ignoring report from unknown tablet 7ed22d9617024d55a8add137e7971061
I20250830 07:54:34.233258 13232 catalog_manager.cc:5674] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743) does not have the latest schema for tablet c12cf30cc2aa4e12a20b9492af08a6f8 (table default.Table_f95d862caa7944469f67bcf46893fa07 [id=4976f023f31746a884cb610d757b94cd]). Expected version 1 got 0
I20250830 07:54:34.229835 13882 consensus_queue.cc:260] T f53e7423d1f54566a667195f7cf5e1ce P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:34.234447 13775 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "18afeddd2c0642028f93a16323b6e849" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:34.234620 13775 raft_consensus.cc:2466] T 18afeddd2c0642028f93a16323b6e849 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b5e454d98894637b466ea27f1b647f9 in term 0.
I20250830 07:54:34.235335 13232 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_bb7373773a224aeda09e03bdc97470e6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250830 07:54:34.236027 13956 raft_consensus.cc:513] T 18afeddd2c0642028f93a16323b6e849 P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } }
W20250830 07:54:34.236377 13230 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_57d9ce41d0254969ae072b4c6936f7f2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:34.236894 13487 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "18afeddd2c0642028f93a16323b6e849" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba"
I20250830 07:54:34.237072 13487 raft_consensus.cc:3058] T 18afeddd2c0642028f93a16323b6e849 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:34.237190 13882 ts_tablet_manager.cc:1428] T f53e7423d1f54566a667195f7cf5e1ce P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.010s user 0.002s sys 0.000s
W20250830 07:54:34.237644 13227 catalog_manager.cc:5415] Ignoring report from unknown tablet dfccff3bd0cb4c7d998633b015de3cfa
W20250830 07:54:34.237742 13227 catalog_manager.cc:5415] Ignoring report from unknown tablet 5ce773ce68f649b1bf51f0dd901cb04f
W20250830 07:54:34.238161 13227 catalog_manager.cc:5415] Ignoring report from unknown tablet 508ce3cc87734e5b8cec40e74522549a
W20250830 07:54:34.238271 13227 catalog_manager.cc:5415] Ignoring report from unknown tablet d876f6259bd94799a4e37dc9d14b8efe
I20250830 07:54:34.238255 13882 tablet_bootstrap.cc:492] T c82ac0102b4442449073e44d8a3d9065 P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:54:34.239638 13459 tablet_service.cc:1515] Processing DeleteTablet for tablet 0186504d9e4949179ce5b92b85f5b230 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:33 UTC) from {username='slave'} at 127.0.0.1:37956
I20250830 07:54:34.239876 13883 tablet_replica.cc:331] T 0186504d9e4949179ce5b92b85f5b230 P 2065c332f15a4739899af79f3669c3ba: stopping tablet replica
I20250830 07:54:34.240051 13883 raft_consensus.cc:2241] T 0186504d9e4949179ce5b92b85f5b230 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Raft consensus shutting down.
I20250830 07:54:34.240209 13883 raft_consensus.cc:2270] T 0186504d9e4949179ce5b92b85f5b230 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Raft consensus is shut down!
W20250830 07:54:34.240607 13228 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_510bdb6808fa48948663ba929c792917 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250830 07:54:34.241575 13225 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2e8460bb8bf84662b02eb6dd0cb94f40 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:34.243369 13883 ts_tablet_manager.cc:1905] T 0186504d9e4949179ce5b92b85f5b230 P 2065c332f15a4739899af79f3669c3ba: Deleting tablet data with delete state TABLET_DATA_DELETED
W20250830 07:54:34.244195 13232 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bb7373773a224aeda09e03bdc97470e6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250830 07:54:34.247038 13229 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9b6234585c0042ba812e260dbbe5752b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:34.247774 13231 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_3e347dcde734493486c0340c2d4d7101"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:34.248260 13231 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3e347dcde734493486c0340c2d4d7101 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:34.250308 13754 tablet_service.cc:1515] Processing DeleteTablet for tablet 0186504d9e4949179ce5b92b85f5b230 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:33 UTC) from {username='slave'} at 127.0.0.1:45460
W20250830 07:54:34.250339 13219 catalog_manager.cc:4908] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): delete failed for tablet 27da527d9fe045ae8c17f193d034f5ac because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 27da527d9fe045ae8c17f193d034f5ac already in progress: creating tablet
I20250830 07:54:34.250564 13884 tablet_replica.cc:331] T 0186504d9e4949179ce5b92b85f5b230 P 9b057ade5dce45af9f8bf0bedf8b917f: stopping tablet replica
I20250830 07:54:34.250744 13884 raft_consensus.cc:2241] T 0186504d9e4949179ce5b92b85f5b230 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Raft consensus shutting down.
I20250830 07:54:34.250876 13884 raft_consensus.cc:2270] T 0186504d9e4949179ce5b92b85f5b230 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Raft consensus is shut down!
I20250830 07:54:34.251554 13487 raft_consensus.cc:2466] T 18afeddd2c0642028f93a16323b6e849 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b5e454d98894637b466ea27f1b647f9 in term 1.
I20250830 07:54:34.251614 13884 ts_tablet_manager.cc:1905] T 0186504d9e4949179ce5b92b85f5b230 P 9b057ade5dce45af9f8bf0bedf8b917f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250830 07:54:34.252111 13561 leader_election.cc:304] T 18afeddd2c0642028f93a16323b6e849 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 6b5e454d98894637b466ea27f1b647f9; no voters:
I20250830 07:54:34.252516 14026 raft_consensus.cc:2802] T 18afeddd2c0642028f93a16323b6e849 P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Leader election won for term 1
I20250830 07:54:34.252656 14026 raft_consensus.cc:695] T 18afeddd2c0642028f93a16323b6e849 P 6b5e454d98894637b466ea27f1b647f9 [term 1 LEADER]: Becoming Leader. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Running, Role: LEADER
I20250830 07:54:34.252978 14026 consensus_queue.cc:237] T 18afeddd2c0642028f93a16323b6e849 P 6b5e454d98894637b466ea27f1b647f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } }
W20250830 07:54:34.255234 13219 catalog_manager.cc:4908] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): delete failed for tablet 9696d8531a174585b8fd83a2391c02f7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9696d8531a174585b8fd83a2391c02f7 already in progress: creating tablet
I20250830 07:54:34.255669 13956 leader_election.cc:290] T 18afeddd2c0642028f93a16323b6e849 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 election: Requested vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:34.255769 13775 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "18afeddd2c0642028f93a16323b6e849" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f"
I20250830 07:54:34.255919 13775 raft_consensus.cc:3058] T 18afeddd2c0642028f93a16323b6e849 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:34.256466 13883 ts_tablet_manager.cc:1918] T 0186504d9e4949179ce5b92b85f5b230 P 2065c332f15a4739899af79f3669c3ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250830 07:54:34.256578 13883 log.cc:1199] T 0186504d9e4949179ce5b92b85f5b230 P 2065c332f15a4739899af79f3669c3ba: Deleting WAL directory at /tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/ts-0/wal/wals/0186504d9e4949179ce5b92b85f5b230
I20250830 07:54:34.256917 13883 ts_tablet_manager.cc:1939] T 0186504d9e4949179ce5b92b85f5b230 P 2065c332f15a4739899af79f3669c3ba: Deleting consensus metadata
I20250830 07:54:34.258419 13775 raft_consensus.cc:2466] T 18afeddd2c0642028f93a16323b6e849 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b5e454d98894637b466ea27f1b647f9 in term 1.
W20250830 07:54:34.259678 13233 catalog_manager.cc:5415] Ignoring report from unknown tablet f53e7423d1f54566a667195f7cf5e1ce
I20250830 07:54:34.259842 13882 tablet_bootstrap.cc:654] T c82ac0102b4442449073e44d8a3d9065 P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:34.260677 13604 tablet_service.cc:1515] Processing DeleteTablet for tablet ccc90f6c867147cc9fe93c9ffa2e4802 with delete_type TABLET_DATA_DELETED (replaced by tablet 66d59910b4b2451a851e9d2728d50f42) from {username='slave'} at 127.0.0.1:45306
W20250830 07:54:34.261107 13233 catalog_manager.cc:5415] Ignoring report from unknown tablet c82ac0102b4442449073e44d8a3d9065
W20250830 07:54:34.261193 13233 catalog_manager.cc:5415] Ignoring report from unknown tablet dfccff3bd0cb4c7d998633b015de3cfa
I20250830 07:54:34.261478 13605 tablet_service.cc:1515] Processing DeleteTablet for tablet 0186504d9e4949179ce5b92b85f5b230 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:33 UTC) from {username='slave'} at 127.0.0.1:45306
W20250830 07:54:34.261626 13233 catalog_manager.cc:5415] Ignoring report from unknown tablet 508ce3cc87734e5b8cec40e74522549a
W20250830 07:54:34.261694 13233 catalog_manager.cc:5415] Ignoring report from unknown tablet d876f6259bd94799a4e37dc9d14b8efe
I20250830 07:54:34.261978 13885 tablet_replica.cc:331] T 0186504d9e4949179ce5b92b85f5b230 P 6b5e454d98894637b466ea27f1b647f9: stopping tablet replica
I20250830 07:54:34.262256 13885 raft_consensus.cc:2241] T 0186504d9e4949179ce5b92b85f5b230 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250830 07:54:34.262445 13885 raft_consensus.cc:2270] T 0186504d9e4949179ce5b92b85f5b230 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250830 07:54:34.264386 13885 ts_tablet_manager.cc:1905] T 0186504d9e4949179ce5b92b85f5b230 P 6b5e454d98894637b466ea27f1b647f9: Deleting tablet data with delete state TABLET_DATA_DELETED
W20250830 07:54:34.267177 13220 catalog_manager.cc:4895] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet ccc90f6c867147cc9fe93c9ffa2e4802 because the tablet was not found. No further retry: Not found: Tablet not found: ccc90f6c867147cc9fe93c9ffa2e4802
I20250830 07:54:34.268153 13887 tablet_bootstrap.cc:492] T 1933d49d319b4bd7b717dda2b83859f3 P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:54:34.268357 13887 ts_tablet_manager.cc:1397] T 1933d49d319b4bd7b717dda2b83859f3 P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.070s user 0.013s sys 0.010s
W20250830 07:54:34.269104 13227 catalog_manager.cc:5415] Ignoring report from unknown tablet 508ce3cc87734e5b8cec40e74522549a
W20250830 07:54:34.269179 13227 catalog_manager.cc:5415] Ignoring report from unknown tablet f53e7423d1f54566a667195f7cf5e1ce
I20250830 07:54:34.269171 13887 raft_consensus.cc:357] T 1933d49d319b4bd7b717dda2b83859f3 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:34.269342 13887 raft_consensus.cc:383] T 1933d49d319b4bd7b717dda2b83859f3 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:34.269423 13887 raft_consensus.cc:738] T 1933d49d319b4bd7b717dda2b83859f3 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:54:34.269645 13887 consensus_queue.cc:260] T 1933d49d319b4bd7b717dda2b83859f3 P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:34.271464 13887 ts_tablet_manager.cc:1428] T 1933d49d319b4bd7b717dda2b83859f3 P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20250830 07:54:34.271741 13887 tablet_bootstrap.cc:492] T 252cc8fed9624222b26976bf54db68fb P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:54:34.273465 13887 tablet_bootstrap.cc:654] T 252cc8fed9624222b26976bf54db68fb P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:34.277568 13218 catalog_manager.cc:4928] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): tablet 0186504d9e4949179ce5b92b85f5b230 (table default.Table_f817d6b952384e64a8b6be555cc4db2f [id=320265dd7ec24f44acaec48bd44472db]) successfully deleted
I20250830 07:54:34.262881 13233 catalog_manager.cc:5582] T f846a23f0be046028cc2472de88b71c4 P 2065c332f15a4739899af79f3669c3ba reported cstate change: term changed from 0 to 1, leader changed from <none> to 2065c332f15a4739899af79f3669c3ba (127.12.209.1). New cstate: current_term: 1 leader_uuid: "2065c332f15a4739899af79f3669c3ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } health_report { overall_health: UNKNOWN } } }
I20250830 07:54:34.280042 13227 master_service.cc:948] ReplaceTablet: received request to replace tablet 9e055d6089f541f799eddb5778eb2148 from {username='slave'} at 127.0.0.1:42126
W20250830 07:54:34.280259 13219 consensus_peers.cc:489] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88 -> Peer 3ea183a890b84f408b20b55e9eb7c7ed (127.12.209.60:43889): Couldn't send request to peer 3ea183a890b84f408b20b55e9eb7c7ed. Status: Network error: Client connection negotiation failed: client connection to 127.12.209.60:43889: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20250830 07:54:34.281541 13227 catalog_manager.cc:5415] Ignoring report from unknown tablet dfccff3bd0cb4c7d998633b015de3cfa
I20250830 07:54:34.281953 13887 tablet_bootstrap.cc:492] T 252cc8fed9624222b26976bf54db68fb P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:54:34.282142 13887 ts_tablet_manager.cc:1397] T 252cc8fed9624222b26976bf54db68fb P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.010s user 0.002s sys 0.002s
W20250830 07:54:34.283435 13227 catalog_manager.cc:5415] Ignoring report from unknown tablet f53e7423d1f54566a667195f7cf5e1ce
W20250830 07:54:34.283519 13227 catalog_manager.cc:5415] Ignoring report from unknown tablet 18afeddd2c0642028f93a16323b6e849
I20250830 07:54:34.284173 13886 tablet_bootstrap.cc:492] T dfccff3bd0cb4c7d998633b015de3cfa P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:54:34.284389 13886 ts_tablet_manager.cc:1397] T dfccff3bd0cb4c7d998633b015de3cfa P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.058s user 0.006s sys 0.002s
W20250830 07:54:34.284587 13227 catalog_manager.cc:5415] Ignoring report from unknown tablet 508ce3cc87734e5b8cec40e74522549a
I20250830 07:54:34.285198 13886 raft_consensus.cc:357] T dfccff3bd0cb4c7d998633b015de3cfa P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:34.285385 13886 raft_consensus.cc:383] T dfccff3bd0cb4c7d998633b015de3cfa P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:34.285449 13886 raft_consensus.cc:738] T dfccff3bd0cb4c7d998633b015de3cfa P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:54:34.285727 13886 consensus_queue.cc:260] T dfccff3bd0cb4c7d998633b015de3cfa P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:34.286301 13886 ts_tablet_manager.cc:1428] T dfccff3bd0cb4c7d998633b015de3cfa P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20250830 07:54:34.286613 13886 tablet_bootstrap.cc:492] T c82ac0102b4442449073e44d8a3d9065 P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:54:34.288846 13884 ts_tablet_manager.cc:1918] T 0186504d9e4949179ce5b92b85f5b230 P 9b057ade5dce45af9f8bf0bedf8b917f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250830 07:54:34.285647 13228 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_3df6aa8b06e8480fa6b6b860ec57fa7d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:34.291474 13228 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3df6aa8b06e8480fa6b6b860ec57fa7d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:34.293648 13628 raft_consensus.cc:1273] T c12cf30cc2aa4e12a20b9492af08a6f8 P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Refusing update from remote peer 2065c332f15a4739899af79f3669c3ba: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250830 07:54:34.294309 14040 consensus_queue.cc:1035] T c12cf30cc2aa4e12a20b9492af08a6f8 P 2065c332f15a4739899af79f3669c3ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:54:34.295956 13233 catalog_manager.cc:5674] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325) does not have the latest schema for tablet f846a23f0be046028cc2472de88b71c4 (table default.Table_e3a02594cc004665a46fa35a486ad4fc [id=66b40d7668914309b6bd8eaf8994d9ac]). Expected version 1 got 0
I20250830 07:54:34.297200 13227 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_dbf6976f77eb4356804f13774a4e533c" } modify_external_catalogs: true
I20250830 07:54:34.298084 13885 ts_tablet_manager.cc:1918] T 0186504d9e4949179ce5b92b85f5b230 P 6b5e454d98894637b466ea27f1b647f9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250830 07:54:34.298244 13885 log.cc:1199] T 0186504d9e4949179ce5b92b85f5b230 P 6b5e454d98894637b466ea27f1b647f9: Deleting WAL directory at /tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/ts-1/wal/wals/0186504d9e4949179ce5b92b85f5b230
W20250830 07:54:34.298380 13231 catalog_manager.cc:5415] Ignoring report from unknown tablet dfccff3bd0cb4c7d998633b015de3cfa
I20250830 07:54:34.298667 13885 ts_tablet_manager.cc:1939] T 0186504d9e4949179ce5b92b85f5b230 P 6b5e454d98894637b466ea27f1b647f9: Deleting consensus metadata
I20250830 07:54:34.299005 13231 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_60f119819df04220a5c92c823e344beb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250830 07:54:34.300104 13887 raft_consensus.cc:357] T 252cc8fed9624222b26976bf54db68fb P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:34.300349 13887 raft_consensus.cc:383] T 252cc8fed9624222b26976bf54db68fb P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:34.300447 13887 raft_consensus.cc:738] T 252cc8fed9624222b26976bf54db68fb P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:54:34.300704 13887 consensus_queue.cc:260] T 252cc8fed9624222b26976bf54db68fb P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
W20250830 07:54:34.301151 13231 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_60f119819df04220a5c92c823e344beb in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:34.301293 13887 ts_tablet_manager.cc:1428] T 252cc8fed9624222b26976bf54db68fb P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.019s user 0.002s sys 0.000s
I20250830 07:54:34.301641 13887 tablet_bootstrap.cc:492] T d1ae3812d72b419798736328da64b53c P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:54:34.302238 13220 catalog_manager.cc:4928] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): tablet 0186504d9e4949179ce5b92b85f5b230 (table default.Table_f817d6b952384e64a8b6be555cc4db2f [id=320265dd7ec24f44acaec48bd44472db]) successfully deleted
I20250830 07:54:34.303714 13232 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_fcd3d99bd5da4461be0a68789d51d740"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:34.304656 13232 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fcd3d99bd5da4461be0a68789d51d740 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:34.305704 13882 tablet_bootstrap.cc:492] T c82ac0102b4442449073e44d8a3d9065 P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:54:34.305864 13882 ts_tablet_manager.cc:1397] T c82ac0102b4442449073e44d8a3d9065 P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.068s user 0.004s sys 0.007s
I20250830 07:54:34.306653 13882 raft_consensus.cc:357] T c82ac0102b4442449073e44d8a3d9065 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:34.306854 13882 raft_consensus.cc:383] T c82ac0102b4442449073e44d8a3d9065 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:34.306802 13227 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_dbf6976f77eb4356804f13774a4e533c" } modify_external_catalogs: true
I20250830 07:54:34.306938 13882 raft_consensus.cc:738] T c82ac0102b4442449073e44d8a3d9065 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:54:34.307165 13882 consensus_queue.cc:260] T c82ac0102b4442449073e44d8a3d9065 P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:34.307904 13882 ts_tablet_manager.cc:1428] T c82ac0102b4442449073e44d8a3d9065 P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20250830 07:54:34.308547 13882 tablet_bootstrap.cc:492] T 6f4c400c0e5e43319fa521b5cab694b4 P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:54:34.310369 13882 tablet_bootstrap.cc:654] T 6f4c400c0e5e43319fa521b5cab694b4 P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:34.311982 13887 tablet_bootstrap.cc:654] T d1ae3812d72b419798736328da64b53c P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:34.323594 13884 log.cc:1199] T 0186504d9e4949179ce5b92b85f5b230 P 9b057ade5dce45af9f8bf0bedf8b917f: Deleting WAL directory at /tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/ts-2/wal/wals/0186504d9e4949179ce5b92b85f5b230
I20250830 07:54:34.323633 13234 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet 1476bb480bf747838613948875001c30
I20250830 07:54:34.324236 13234 catalog_manager.cc:6652] ReplaceTablet: tablet 1476bb480bf747838613948875001c30 deleted and replaced by tablet acca1a8240454b889c63c82d3c75087e
I20250830 07:54:34.324216 13775 raft_consensus.cc:3058] T c12cf30cc2aa4e12a20b9492af08a6f8 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
W20250830 07:54:34.324930 13226 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet e6491d149c0646848680cfdadb6fc76c has no consensus state
I20250830 07:54:34.326125 13230 master_service.cc:948] ReplaceTablet: received request to replace tablet ef16b9e2d444489699f4db1ac26d5f6c from {username='slave'} at 127.0.0.1:42126
I20250830 07:54:34.327179 13605 tablet_service.cc:1515] Processing DeleteTablet for tablet 1476bb480bf747838613948875001c30 with delete_type TABLET_DATA_DELETED (replaced by tablet acca1a8240454b889c63c82d3c75087e) from {username='slave'} at 127.0.0.1:45306
W20250830 07:54:34.328130 13220 catalog_manager.cc:4908] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet 1476bb480bf747838613948875001c30 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1476bb480bf747838613948875001c30 already in progress: creating tablet
I20250830 07:54:34.328385 13884 ts_tablet_manager.cc:1939] T 0186504d9e4949179ce5b92b85f5b230 P 9b057ade5dce45af9f8bf0bedf8b917f: Deleting consensus metadata
I20250830 07:54:34.329491 13219 catalog_manager.cc:4928] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): tablet 0186504d9e4949179ce5b92b85f5b230 (table default.Table_f817d6b952384e64a8b6be555cc4db2f [id=320265dd7ec24f44acaec48bd44472db]) successfully deleted
I20250830 07:54:34.329756 13754 tablet_service.cc:1515] Processing DeleteTablet for tablet 1476bb480bf747838613948875001c30 with delete_type TABLET_DATA_DELETED (replaced by tablet acca1a8240454b889c63c82d3c75087e) from {username='slave'} at 127.0.0.1:45460
I20250830 07:54:34.334787 13459 tablet_service.cc:1515] Processing DeleteTablet for tablet 1476bb480bf747838613948875001c30 with delete_type TABLET_DATA_DELETED (replaced by tablet acca1a8240454b889c63c82d3c75087e) from {username='slave'} at 127.0.0.1:37956
W20250830 07:54:34.336587 13219 catalog_manager.cc:4908] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): delete failed for tablet 1476bb480bf747838613948875001c30 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1476bb480bf747838613948875001c30 already in progress: creating tablet
W20250830 07:54:34.337018 13218 catalog_manager.cc:4908] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): delete failed for tablet 1476bb480bf747838613948875001c30 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1476bb480bf747838613948875001c30 already in progress: creating tablet
I20250830 07:54:34.339983 13775 raft_consensus.cc:1273] T c12cf30cc2aa4e12a20b9492af08a6f8 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Refusing update from remote peer 2065c332f15a4739899af79f3669c3ba: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250830 07:54:34.340569 14040 consensus_queue.cc:1035] T c12cf30cc2aa4e12a20b9492af08a6f8 P 2065c332f15a4739899af79f3669c3ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:54:34.345546 14023 consensus_queue.cc:1035] T ff2267fb411942ff826e2a72bcb89cd7 P 6b5e454d98894637b466ea27f1b647f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:54:34.352803 14040 raft_consensus.cc:491] T f53e7423d1f54566a667195f7cf5e1ce P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:34.353004 14040 raft_consensus.cc:513] T f53e7423d1f54566a667195f7cf5e1ce P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:34.353617 14040 leader_election.cc:290] T f53e7423d1f54566a667195f7cf5e1ce P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:34.354207 13629 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f53e7423d1f54566a667195f7cf5e1ce" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:34.354405 13629 raft_consensus.cc:2466] T f53e7423d1f54566a667195f7cf5e1ce P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2065c332f15a4739899af79f3669c3ba in term 0.
I20250830 07:54:34.354830 13423 leader_election.cc:304] T f53e7423d1f54566a667195f7cf5e1ce P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 6b5e454d98894637b466ea27f1b647f9; no voters:
W20250830 07:54:34.355665 13703 consensus_peers.cc:489] T f398e12cd9f543738d5163354f8a9d9d P 9b057ade5dce45af9f8bf0bedf8b917f -> Peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Couldn't send request to peer 6b5e454d98894637b466ea27f1b647f9. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f398e12cd9f543738d5163354f8a9d9d. This is attempt 1: this message will repeat every 5th retry.
I20250830 07:54:34.355827 13775 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f53e7423d1f54566a667195f7cf5e1ce" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:34.355957 14040 raft_consensus.cc:2802] T f53e7423d1f54566a667195f7cf5e1ce P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:54:34.356060 14040 raft_consensus.cc:491] T f53e7423d1f54566a667195f7cf5e1ce P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:54:34.356047 13775 raft_consensus.cc:2466] T f53e7423d1f54566a667195f7cf5e1ce P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2065c332f15a4739899af79f3669c3ba in term 0.
I20250830 07:54:34.356153 14040 raft_consensus.cc:3058] T f53e7423d1f54566a667195f7cf5e1ce P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:34.359777 14040 raft_consensus.cc:513] T f53e7423d1f54566a667195f7cf5e1ce P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:34.360708 13629 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f53e7423d1f54566a667195f7cf5e1ce" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9"
I20250830 07:54:34.360914 13629 raft_consensus.cc:3058] T f53e7423d1f54566a667195f7cf5e1ce P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:34.363699 13629 raft_consensus.cc:2466] T f53e7423d1f54566a667195f7cf5e1ce P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2065c332f15a4739899af79f3669c3ba in term 1.
I20250830 07:54:34.364162 13423 leader_election.cc:304] T f53e7423d1f54566a667195f7cf5e1ce P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 6b5e454d98894637b466ea27f1b647f9; no voters:
I20250830 07:54:34.364454 13954 raft_consensus.cc:2802] T f53e7423d1f54566a667195f7cf5e1ce P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election won for term 1
I20250830 07:54:34.364580 13954 raft_consensus.cc:695] T f53e7423d1f54566a667195f7cf5e1ce P 2065c332f15a4739899af79f3669c3ba [term 1 LEADER]: Becoming Leader. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Running, Role: LEADER
I20250830 07:54:34.364876 13954 consensus_queue.cc:237] T f53e7423d1f54566a667195f7cf5e1ce P 2065c332f15a4739899af79f3669c3ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
W20250830 07:54:34.366264 13561 consensus_peers.cc:489] T ff2267fb411942ff826e2a72bcb89cd7 P 6b5e454d98894637b466ea27f1b647f9 -> Peer 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): Couldn't send request to peer 2065c332f15a4739899af79f3669c3ba. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ff2267fb411942ff826e2a72bcb89cd7. This is attempt 1: this message will repeat every 5th retry.
I20250830 07:54:34.366564 13230 master_service.cc:948] ReplaceTablet: received request to replace tablet 9b9c2ae8805a48f7959d6745677a96f2 from {username='slave'} at 127.0.0.1:42126
I20250830 07:54:34.368011 13225 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_ffd69d78c4a046b99417e3d71227e851" } modify_external_catalogs: true
I20250830 07:54:34.368263 13225 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_ffd69d78c4a046b99417e3d71227e851" } modify_external_catalogs: true
I20250830 07:54:34.369364 14073 tablet.cc:1722] T c12cf30cc2aa4e12a20b9492af08a6f8 P 2065c332f15a4739899af79f3669c3ba: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250830 07:54:34.369769 13234 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_03bb7288095a48a1a01062818220b7c4" } new_table_name: "default.Table_1dd3362d92834f4584155f93d68e8734" modify_external_catalogs: true
I20250830 07:54:34.371255 13226 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_d007eeaa41bd463da0496053226ce68d" } new_table_name: "default.Table_da489b0caa4241ce9aeabe907212bd0b" modify_external_catalogs: true
I20250830 07:54:34.373564 14040 leader_election.cc:290] T f53e7423d1f54566a667195f7cf5e1ce P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 election: Requested vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:34.375116 13774 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f53e7423d1f54566a667195f7cf5e1ce" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f"
I20250830 07:54:34.375416 13774 raft_consensus.cc:3058] T f53e7423d1f54566a667195f7cf5e1ce P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:34.387203 14123 tablet.cc:1722] T c12cf30cc2aa4e12a20b9492af08a6f8 P 9b057ade5dce45af9f8bf0bedf8b917f: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250830 07:54:34.393100 13229 catalog_manager.cc:5674] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743) does not have the latest schema for tablet c12cf30cc2aa4e12a20b9492af08a6f8 (table default.Table_f95d862caa7944469f67bcf46893fa07 [id=4976f023f31746a884cb610d757b94cd]). Expected version 1 got 0
W20250830 07:54:34.393167 13701 consensus_peers.cc:489] T f398e12cd9f543738d5163354f8a9d9d P 9b057ade5dce45af9f8bf0bedf8b917f -> Peer 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): Couldn't send request to peer 2065c332f15a4739899af79f3669c3ba. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f398e12cd9f543738d5163354f8a9d9d. This is attempt 1: this message will repeat every 5th retry.
W20250830 07:54:34.395773 13229 catalog_manager.cc:5415] Ignoring report from unknown tablet 1933d49d319b4bd7b717dda2b83859f3
W20250830 07:54:34.395915 13229 catalog_manager.cc:5415] Ignoring report from unknown tablet f53e7423d1f54566a667195f7cf5e1ce
I20250830 07:54:34.397027 13774 raft_consensus.cc:2466] T f53e7423d1f54566a667195f7cf5e1ce P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2065c332f15a4739899af79f3669c3ba in term 1.
I20250830 07:54:34.397445 13231 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_7ebf4c4ec5524ee2a9e9c13971eb178f" } modify_external_catalogs: true
I20250830 07:54:34.397769 13231 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_7ebf4c4ec5524ee2a9e9c13971eb178f" } modify_external_catalogs: true
I20250830 07:54:34.400430 13232 catalog_manager.cc:5674] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967) does not have the latest schema for tablet c12cf30cc2aa4e12a20b9492af08a6f8 (table default.Table_f95d862caa7944469f67bcf46893fa07 [id=4976f023f31746a884cb610d757b94cd]). Expected version 1 got 0
W20250830 07:54:34.402343 13232 catalog_manager.cc:5415] Ignoring report from unknown tablet ff2267fb411942ff826e2a72bcb89cd7
I20250830 07:54:34.404428 13228 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_f8d97639ebb343a398aade2f1182b5d7" } modify_external_catalogs: true
I20250830 07:54:34.404695 13228 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_f8d97639ebb343a398aade2f1182b5d7" } modify_external_catalogs: true
I20250830 07:54:34.406160 13233 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_468e5a28c56b4b0c918d95fa29579a3f" } new_table_name: "default.Table_f5718c63775946638bc63cf7e8708669" modify_external_catalogs: true
I20250830 07:54:34.412762 13886 tablet_bootstrap.cc:654] T c82ac0102b4442449073e44d8a3d9065 P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:34.416826 14124 tablet.cc:1722] T c12cf30cc2aa4e12a20b9492af08a6f8 P 6b5e454d98894637b466ea27f1b647f9: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250830 07:54:34.427763 13886 tablet_bootstrap.cc:492] T c82ac0102b4442449073e44d8a3d9065 P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:54:34.428025 13886 ts_tablet_manager.cc:1397] T c82ac0102b4442449073e44d8a3d9065 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.141s user 0.004s sys 0.000s
I20250830 07:54:34.428826 13886 raft_consensus.cc:357] T c82ac0102b4442449073e44d8a3d9065 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:34.429081 13886 raft_consensus.cc:383] T c82ac0102b4442449073e44d8a3d9065 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:34.429200 13886 raft_consensus.cc:738] T c82ac0102b4442449073e44d8a3d9065 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:54:34.429563 13886 consensus_queue.cc:260] T c82ac0102b4442449073e44d8a3d9065 P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:34.432286 13886 ts_tablet_manager.cc:1428] T c82ac0102b4442449073e44d8a3d9065 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.004s user 0.001s sys 0.000s
I20250830 07:54:34.432657 13886 tablet_bootstrap.cc:492] T d0238794efb14150af6138b0d8bd80ec P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:54:34.434247 13886 tablet_bootstrap.cc:654] T d0238794efb14150af6138b0d8bd80ec P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:34.434882 13230 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet 9b9c2ae8805a48f7959d6745677a96f2
I20250830 07:54:34.435550 13230 catalog_manager.cc:6652] ReplaceTablet: tablet 9b9c2ae8805a48f7959d6745677a96f2 deleted and replaced by tablet 2b4ce50fbd26484faba3faa2ec5115c0
I20250830 07:54:34.436030 13459 tablet_service.cc:1515] Processing DeleteTablet for tablet 9b9c2ae8805a48f7959d6745677a96f2 with delete_type TABLET_DATA_DELETED (replaced by tablet 2b4ce50fbd26484faba3faa2ec5115c0) from {username='slave'} at 127.0.0.1:37956
W20250830 07:54:34.436756 13218 catalog_manager.cc:4908] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): delete failed for tablet 9b9c2ae8805a48f7959d6745677a96f2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9b9c2ae8805a48f7959d6745677a96f2 already in progress: creating tablet
W20250830 07:54:34.437065 13230 catalog_manager.cc:5415] Ignoring report from unknown tablet ff2267fb411942ff826e2a72bcb89cd7
W20250830 07:54:34.437158 13230 catalog_manager.cc:5415] Ignoring report from unknown tablet c82ac0102b4442449073e44d8a3d9065
W20250830 07:54:34.437239 13230 catalog_manager.cc:5415] Ignoring report from unknown tablet 9e055d6089f541f799eddb5778eb2148
I20250830 07:54:34.437637 13230 catalog_manager.cc:5674] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967) does not have the latest schema for tablet c12cf30cc2aa4e12a20b9492af08a6f8 (table default.Table_f95d862caa7944469f67bcf46893fa07 [id=4976f023f31746a884cb610d757b94cd]). Expected version 1 got 0
I20250830 07:54:34.438202 13225 catalog_manager.cc:5864] Not sending DeleteTablet requests; no consensus state for tablet 19eb362c66574b6bb5f10a697b0ff51a
I20250830 07:54:34.438557 13225 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_3df6aa8b06e8480fa6b6b860ec57fa7d" } modify_external_catalogs: true
I20250830 07:54:34.438782 13225 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_3df6aa8b06e8480fa6b6b860ec57fa7d" } modify_external_catalogs: true
W20250830 07:54:34.440388 13234 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 69d6daeb7c774fd48ed296f52ed7c6a6 has no consensus state
I20250830 07:54:34.440806 13234 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_ebee83f51b6446a8afbf7c1f94b926a2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:34.441524 13234 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ebee83f51b6446a8afbf7c1f94b926a2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250830 07:54:34.443065 13226 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 29f0695563854e45965a1cc36ac54138 has no consensus state
I20250830 07:54:34.443452 13226 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_c64f059e861d4ae6a3715d763aeaefdf" } new_table_name: "default.Table_d72b020da8b34ec291b8c8dcd8e0d459" modify_external_catalogs: true
I20250830 07:54:34.445991 13754 tablet_service.cc:1515] Processing DeleteTablet for tablet 9b9c2ae8805a48f7959d6745677a96f2 with delete_type TABLET_DATA_DELETED (replaced by tablet 2b4ce50fbd26484faba3faa2ec5115c0) from {username='slave'} at 127.0.0.1:45460
I20250830 07:54:34.446134 13227 catalog_manager.cc:5864] Not sending DeleteTablet requests; no consensus state for tablet 8400cd2280ca4ba7a3ac77dfd066bf1f
W20250830 07:54:34.446738 13219 catalog_manager.cc:4908] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): delete failed for tablet 9b9c2ae8805a48f7959d6745677a96f2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9b9c2ae8805a48f7959d6745677a96f2 already in progress: creating tablet
I20250830 07:54:34.461480 13886 tablet_bootstrap.cc:492] T d0238794efb14150af6138b0d8bd80ec P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:54:34.461687 13886 ts_tablet_manager.cc:1397] T d0238794efb14150af6138b0d8bd80ec P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.029s user 0.003s sys 0.002s
I20250830 07:54:34.462531 13228 catalog_manager.cc:5864] Not sending DeleteTablet requests; no consensus state for tablet 38d091245a85471480e3450923ca8409
I20250830 07:54:34.462469 13886 raft_consensus.cc:357] T d0238794efb14150af6138b0d8bd80ec P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:34.462666 13886 raft_consensus.cc:383] T d0238794efb14150af6138b0d8bd80ec P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:34.462746 13886 raft_consensus.cc:738] T d0238794efb14150af6138b0d8bd80ec P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:54:34.463059 13886 consensus_queue.cc:260] T d0238794efb14150af6138b0d8bd80ec P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
W20250830 07:54:34.463320 13233 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 8eb010d7955d47a89ff1d01be1b5b01e has no consensus state
I20250830 07:54:34.463881 13231 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet 8f4567f30cc34f288463e4a92bd3edd5
I20250830 07:54:34.464939 13232 catalog_manager.cc:6127] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: default.Table_f95d862caa7944469f67bcf46893fa07 [id=4976f023f31746a884cb610d757b94cd] alter complete (version 1)
I20250830 07:54:34.465108 13459 tablet_service.cc:1515] Processing DeleteTablet for tablet 8f4567f30cc34f288463e4a92bd3edd5 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:34 UTC) from {username='slave'} at 127.0.0.1:37956
I20250830 07:54:34.465417 13883 tablet_replica.cc:331] T 8f4567f30cc34f288463e4a92bd3edd5 P 2065c332f15a4739899af79f3669c3ba: stopping tablet replica
I20250830 07:54:34.465627 13883 raft_consensus.cc:2241] T 8f4567f30cc34f288463e4a92bd3edd5 P 2065c332f15a4739899af79f3669c3ba [term 1 LEADER]: Raft consensus shutting down.
I20250830 07:54:34.465997 13883 raft_consensus.cc:2270] T 8f4567f30cc34f288463e4a92bd3edd5 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20250830 07:54:34.466569 13883 ts_tablet_manager.cc:1905] T 8f4567f30cc34f288463e4a92bd3edd5 P 2065c332f15a4739899af79f3669c3ba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250830 07:54:34.469609 13230 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_7cae72f2a8a94b11b5ed4b050f5592a7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:34.470283 13230 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7cae72f2a8a94b11b5ed4b050f5592a7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:34.474501 13887 tablet_bootstrap.cc:492] T d1ae3812d72b419798736328da64b53c P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:54:34.474673 13887 ts_tablet_manager.cc:1397] T d1ae3812d72b419798736328da64b53c P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.173s user 0.003s sys 0.045s
I20250830 07:54:34.474879 13754 tablet_service.cc:1515] Processing DeleteTablet for tablet 8f4567f30cc34f288463e4a92bd3edd5 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:34 UTC) from {username='slave'} at 127.0.0.1:45460
I20250830 07:54:34.475143 13884 tablet_replica.cc:331] T 8f4567f30cc34f288463e4a92bd3edd5 P 9b057ade5dce45af9f8bf0bedf8b917f: stopping tablet replica
I20250830 07:54:34.475307 13884 raft_consensus.cc:2241] T 8f4567f30cc34f288463e4a92bd3edd5 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Raft consensus shutting down.
I20250830 07:54:34.475493 13884 raft_consensus.cc:2270] T 8f4567f30cc34f288463e4a92bd3edd5 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Raft consensus is shut down!
I20250830 07:54:34.475520 13887 raft_consensus.cc:357] T d1ae3812d72b419798736328da64b53c P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:34.475695 13887 raft_consensus.cc:383] T d1ae3812d72b419798736328da64b53c P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:34.475795 13887 raft_consensus.cc:738] T d1ae3812d72b419798736328da64b53c P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:54:34.475988 13884 ts_tablet_manager.cc:1905] T 8f4567f30cc34f288463e4a92bd3edd5 P 9b057ade5dce45af9f8bf0bedf8b917f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250830 07:54:34.476035 13887 consensus_queue.cc:260] T d1ae3812d72b419798736328da64b53c P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:34.476619 13887 ts_tablet_manager.cc:1428] T d1ae3812d72b419798736328da64b53c P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20250830 07:54:34.476939 13887 tablet_bootstrap.cc:492] T 29d492735cd14bb6b4a2a9a3929f62f3 P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:54:34.478408 13225 catalog_manager.cc:5864] Not sending DeleteTablet requests; no consensus state for tablet 8a168c8014b443378c0e9665766ac001
I20250830 07:54:34.479358 13887 tablet_bootstrap.cc:654] T 29d492735cd14bb6b4a2a9a3929f62f3 P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
W20250830 07:54:34.483613 13225 catalog_manager.cc:5415] Ignoring report from unknown tablet c82ac0102b4442449073e44d8a3d9065
I20250830 07:54:34.484985 14040 raft_consensus.cc:491] T c82ac0102b4442449073e44d8a3d9065 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:34.485158 14040 raft_consensus.cc:513] T c82ac0102b4442449073e44d8a3d9065 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:34.485438 13886 ts_tablet_manager.cc:1428] T d0238794efb14150af6138b0d8bd80ec P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.024s user 0.002s sys 0.000s
I20250830 07:54:34.485783 14040 leader_election.cc:290] T c82ac0102b4442449073e44d8a3d9065 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:34.486202 13883 ts_tablet_manager.cc:1918] T 8f4567f30cc34f288463e4a92bd3edd5 P 2065c332f15a4739899af79f3669c3ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250830 07:54:34.486351 13883 log.cc:1199] T 8f4567f30cc34f288463e4a92bd3edd5 P 2065c332f15a4739899af79f3669c3ba: Deleting WAL directory at /tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/ts-0/wal/wals/8f4567f30cc34f288463e4a92bd3edd5
I20250830 07:54:34.486814 13883 ts_tablet_manager.cc:1939] T 8f4567f30cc34f288463e4a92bd3edd5 P 2065c332f15a4739899af79f3669c3ba: Deleting consensus metadata
I20250830 07:54:34.488188 13886 tablet_bootstrap.cc:492] T 1933d49d319b4bd7b717dda2b83859f3 P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:54:34.489645 13774 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "c82ac0102b4442449073e44d8a3d9065" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:34.489869 13774 raft_consensus.cc:2466] T c82ac0102b4442449073e44d8a3d9065 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2065c332f15a4739899af79f3669c3ba in term 0.
I20250830 07:54:34.490172 13218 catalog_manager.cc:4928] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): tablet 8f4567f30cc34f288463e4a92bd3edd5 (table default.Table_7ebf4c4ec5524ee2a9e9c13971eb178f [id=3c052a58caaa412f8d9d70063dcd97c0]) successfully deleted
I20250830 07:54:34.492915 13886 tablet_bootstrap.cc:654] T 1933d49d319b4bd7b717dda2b83859f3 P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:34.493510 13422 leader_election.cc:304] T c82ac0102b4442449073e44d8a3d9065 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters:
I20250830 07:54:34.493979 14040 raft_consensus.cc:2802] T c82ac0102b4442449073e44d8a3d9065 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:54:34.494063 14040 raft_consensus.cc:491] T c82ac0102b4442449073e44d8a3d9065 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:54:34.494151 14040 raft_consensus.cc:3058] T c82ac0102b4442449073e44d8a3d9065 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:34.494727 13232 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_fc37190c24f34b8e86db55435a3b658e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:34.495349 13232 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fc37190c24f34b8e86db55435a3b658e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:34.496951 14040 raft_consensus.cc:513] T c82ac0102b4442449073e44d8a3d9065 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:34.498813 14040 leader_election.cc:290] T c82ac0102b4442449073e44d8a3d9065 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 election: Requested vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:34.499323 13231 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_4004f71ffe6442a1a90ef09cae4b9d5c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250830 07:54:34.499473 13774 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "c82ac0102b4442449073e44d8a3d9065" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f"
I20250830 07:54:34.499689 13774 raft_consensus.cc:3058] T c82ac0102b4442449073e44d8a3d9065 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
W20250830 07:54:34.499825 13231 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4004f71ffe6442a1a90ef09cae4b9d5c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:34.502492 13774 raft_consensus.cc:2466] T c82ac0102b4442449073e44d8a3d9065 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2065c332f15a4739899af79f3669c3ba in term 1.
I20250830 07:54:34.504379 13605 tablet_service.cc:1515] Processing DeleteTablet for tablet 9b9c2ae8805a48f7959d6745677a96f2 with delete_type TABLET_DATA_DELETED (replaced by tablet 2b4ce50fbd26484faba3faa2ec5115c0) from {username='slave'} at 127.0.0.1:45306
I20250830 07:54:34.504781 13629 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "c82ac0102b4442449073e44d8a3d9065" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:34.504902 13605 tablet_service.cc:1515] Processing DeleteTablet for tablet 8f4567f30cc34f288463e4a92bd3edd5 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:34 UTC) from {username='slave'} at 127.0.0.1:45306
I20250830 07:54:34.505092 13629 raft_consensus.cc:2466] T c82ac0102b4442449073e44d8a3d9065 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2065c332f15a4739899af79f3669c3ba in term 0.
I20250830 07:54:34.506244 13628 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "c82ac0102b4442449073e44d8a3d9065" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9"
I20250830 07:54:34.506433 13628 raft_consensus.cc:3058] T c82ac0102b4442449073e44d8a3d9065 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:34.506575 13882 tablet_bootstrap.cc:492] T 6f4c400c0e5e43319fa521b5cab694b4 P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:54:34.506721 13882 ts_tablet_manager.cc:1397] T 6f4c400c0e5e43319fa521b5cab694b4 P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.199s user 0.015s sys 0.016s
I20250830 07:54:34.507499 13882 raft_consensus.cc:357] T 6f4c400c0e5e43319fa521b5cab694b4 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:34.507666 13882 raft_consensus.cc:383] T 6f4c400c0e5e43319fa521b5cab694b4 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:34.507797 13882 raft_consensus.cc:738] T 6f4c400c0e5e43319fa521b5cab694b4 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:54:34.508020 13882 consensus_queue.cc:260] T 6f4c400c0e5e43319fa521b5cab694b4 P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:34.508553 13882 ts_tablet_manager.cc:1428] T 6f4c400c0e5e43319fa521b5cab694b4 P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20250830 07:54:34.508875 13882 tablet_bootstrap.cc:492] T d0238794efb14150af6138b0d8bd80ec P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:54:34.510738 13882 tablet_bootstrap.cc:654] T d0238794efb14150af6138b0d8bd80ec P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:34.512773 14026 consensus_queue.cc:1035] T 7ef98dbbdf5848038a2da6140e126301 P 6b5e454d98894637b466ea27f1b647f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20250830 07:54:34.515439 13233 master_service.cc:948] ReplaceTablet: received request to replace tablet a78c522b9fa945e2879fb965d82fb359 from {username='slave'} at 127.0.0.1:42126
I20250830 07:54:34.516660 13885 tablet_replica.cc:331] T 8f4567f30cc34f288463e4a92bd3edd5 P 6b5e454d98894637b466ea27f1b647f9: stopping tablet replica
I20250830 07:54:34.516842 13885 raft_consensus.cc:2241] T 8f4567f30cc34f288463e4a92bd3edd5 P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250830 07:54:34.517055 13885 raft_consensus.cc:2270] T 8f4567f30cc34f288463e4a92bd3edd5 P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250830 07:54:34.517585 13885 ts_tablet_manager.cc:1905] T 8f4567f30cc34f288463e4a92bd3edd5 P 6b5e454d98894637b466ea27f1b647f9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250830 07:54:34.517777 13422 leader_election.cc:304] T c82ac0102b4442449073e44d8a3d9065 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters:
I20250830 07:54:34.518219 13954 raft_consensus.cc:2802] T c82ac0102b4442449073e44d8a3d9065 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election won for term 1
I20250830 07:54:34.518399 13954 raft_consensus.cc:695] T c82ac0102b4442449073e44d8a3d9065 P 2065c332f15a4739899af79f3669c3ba [term 1 LEADER]: Becoming Leader. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Running, Role: LEADER
I20250830 07:54:34.518846 13954 consensus_queue.cc:237] T c82ac0102b4442449073e44d8a3d9065 P 2065c332f15a4739899af79f3669c3ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:34.525871 13885 ts_tablet_manager.cc:1918] T 8f4567f30cc34f288463e4a92bd3edd5 P 6b5e454d98894637b466ea27f1b647f9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
W20250830 07:54:34.526177 13220 catalog_manager.cc:4908] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet 9b9c2ae8805a48f7959d6745677a96f2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9b9c2ae8805a48f7959d6745677a96f2 already in progress: creating tablet
I20250830 07:54:34.528535 13885 log.cc:1199] T 8f4567f30cc34f288463e4a92bd3edd5 P 6b5e454d98894637b466ea27f1b647f9: Deleting WAL directory at /tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/ts-1/wal/wals/8f4567f30cc34f288463e4a92bd3edd5
I20250830 07:54:34.510877 13628 raft_consensus.cc:2466] T c82ac0102b4442449073e44d8a3d9065 P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2065c332f15a4739899af79f3669c3ba in term 1.
I20250830 07:54:34.529621 13885 ts_tablet_manager.cc:1939] T 8f4567f30cc34f288463e4a92bd3edd5 P 6b5e454d98894637b466ea27f1b647f9: Deleting consensus metadata
I20250830 07:54:34.530375 13220 catalog_manager.cc:4928] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): tablet 8f4567f30cc34f288463e4a92bd3edd5 (table default.Table_7ebf4c4ec5524ee2a9e9c13971eb178f [id=3c052a58caaa412f8d9d70063dcd97c0]) successfully deleted
W20250830 07:54:34.530803 13226 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 01771fa171374e92892345e7402c33d1 has no consensus state
I20250830 07:54:34.537794 13233 master_service.cc:948] ReplaceTablet: received request to replace tablet 3167b609ed184decb4ccdb4945933ebb from {username='slave'} at 127.0.0.1:42126
I20250830 07:54:34.542428 13884 ts_tablet_manager.cc:1918] T 8f4567f30cc34f288463e4a92bd3edd5 P 9b057ade5dce45af9f8bf0bedf8b917f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250830 07:54:34.542579 13884 log.cc:1199] T 8f4567f30cc34f288463e4a92bd3edd5 P 9b057ade5dce45af9f8bf0bedf8b917f: Deleting WAL directory at /tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/ts-2/wal/wals/8f4567f30cc34f288463e4a92bd3edd5
I20250830 07:54:34.543002 13884 ts_tablet_manager.cc:1939] T 8f4567f30cc34f288463e4a92bd3edd5 P 9b057ade5dce45af9f8bf0bedf8b917f: Deleting consensus metadata
I20250830 07:54:34.543188 13226 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_af246199afc44640a062e3f1e440b09d" } new_table_name: "default.Table_d625e110b8414c8a8eb7e08d8ccc3270" modify_external_catalogs: true
I20250830 07:54:34.546686 13225 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_717ec99a6275426ba7651552b70962f3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250830 07:54:34.546994 13228 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_a39e6bb297b74c8aa91039717c6ff1d4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:34.547441 13225 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_717ec99a6275426ba7651552b70962f3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250830 07:54:34.547595 13228 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a39e6bb297b74c8aa91039717c6ff1d4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:34.548355 13219 catalog_manager.cc:4928] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): tablet 8f4567f30cc34f288463e4a92bd3edd5 (table default.Table_7ebf4c4ec5524ee2a9e9c13971eb178f [id=3c052a58caaa412f8d9d70063dcd97c0]) successfully deleted
W20250830 07:54:34.546722 13234 catalog_manager.cc:5415] Ignoring report from unknown tablet 6f4c400c0e5e43319fa521b5cab694b4
I20250830 07:54:34.557030 14026 consensus_queue.cc:1035] T 7ef98dbbdf5848038a2da6140e126301 P 6b5e454d98894637b466ea27f1b647f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:54:34.559651 13234 master_service.cc:948] ReplaceTablet: received request to replace tablet 1fa571e9490e499792225d7b786e8658 from {username='slave'} at 127.0.0.1:42126
I20250830 07:54:34.562369 13999 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20250830 07:54:34.566571 13999 env_posix.cc:2264] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20250830 07:54:34.569927 13999 kserver.cc:163] Server-wide thread pool size limit: 3276
W20250830 07:54:34.580088 13227 catalog_manager.cc:5415] Ignoring report from unknown tablet 7ef98dbbdf5848038a2da6140e126301
I20250830 07:54:34.585501 13232 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_dab1da9ac1584d11b0b0ac9e81748758"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:34.586258 13232 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_dab1da9ac1584d11b0b0ac9e81748758 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:34.587597 13230 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_3566feeff7cd468093b299f2cc07abd6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:34.588212 13230 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3566feeff7cd468093b299f2cc07abd6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250830 07:54:34.591933 13227 catalog_manager.cc:5415] Ignoring report from unknown tablet 7ef98dbbdf5848038a2da6140e126301
I20250830 07:54:34.593909 13227 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_c9397e64edef4d31a5a4eded8ebe365c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:34.594605 13227 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c9397e64edef4d31a5a4eded8ebe365c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:34.595131 13882 tablet_bootstrap.cc:492] T d0238794efb14150af6138b0d8bd80ec P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:54:34.595340 13882 ts_tablet_manager.cc:1397] T d0238794efb14150af6138b0d8bd80ec P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.087s user 0.012s sys 0.014s
I20250830 07:54:34.596131 13882 raft_consensus.cc:357] T d0238794efb14150af6138b0d8bd80ec P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:34.596369 13882 raft_consensus.cc:383] T d0238794efb14150af6138b0d8bd80ec P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:34.596439 13882 raft_consensus.cc:738] T d0238794efb14150af6138b0d8bd80ec P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:54:34.596693 13882 consensus_queue.cc:260] T d0238794efb14150af6138b0d8bd80ec P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:34.598188 13887 tablet_bootstrap.cc:492] T 29d492735cd14bb6b4a2a9a3929f62f3 P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:54:34.598364 13887 ts_tablet_manager.cc:1397] T 29d492735cd14bb6b4a2a9a3929f62f3 P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.121s user 0.018s sys 0.010s
I20250830 07:54:34.600184 14030 raft_consensus.cc:491] T 050e72b96c2d479896b3a54d85e6f6dd P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:34.601099 13882 ts_tablet_manager.cc:1428] T d0238794efb14150af6138b0d8bd80ec P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
I20250830 07:54:34.601047 14030 raft_consensus.cc:513] T 050e72b96c2d479896b3a54d85e6f6dd P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:34.601394 13882 tablet_bootstrap.cc:492] T 252cc8fed9624222b26976bf54db68fb P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:54:34.601692 14030 leader_election.cc:290] T 050e72b96c2d479896b3a54d85e6f6dd P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967)
I20250830 07:54:34.603634 13882 tablet_bootstrap.cc:654] T 252cc8fed9624222b26976bf54db68fb P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
W20250830 07:54:34.603657 13701 leader_election.cc:343] T 050e72b96c2d479896b3a54d85e6f6dd P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): Not found: Tablet not found: 050e72b96c2d479896b3a54d85e6f6dd
W20250830 07:54:34.604826 13703 leader_election.cc:343] T 050e72b96c2d479896b3a54d85e6f6dd P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Not found: Tablet not found: 050e72b96c2d479896b3a54d85e6f6dd
I20250830 07:54:34.604954 13703 leader_election.cc:304] T 050e72b96c2d479896b3a54d85e6f6dd P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 2065c332f15a4739899af79f3669c3ba, 6b5e454d98894637b466ea27f1b647f9
I20250830 07:54:34.605412 14030 raft_consensus.cc:2747] T 050e72b96c2d479896b3a54d85e6f6dd P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:54:34.612694 13887 raft_consensus.cc:357] T 29d492735cd14bb6b4a2a9a3929f62f3 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:34.612924 13887 raft_consensus.cc:383] T 29d492735cd14bb6b4a2a9a3929f62f3 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:34.613016 13887 raft_consensus.cc:738] T 29d492735cd14bb6b4a2a9a3929f62f3 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:54:34.613319 13886 tablet_bootstrap.cc:492] T 1933d49d319b4bd7b717dda2b83859f3 P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:54:34.613307 13887 consensus_queue.cc:260] T 29d492735cd14bb6b4a2a9a3929f62f3 P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:34.613485 13886 ts_tablet_manager.cc:1397] T 1933d49d319b4bd7b717dda2b83859f3 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.126s user 0.019s sys 0.023s
I20250830 07:54:34.613883 13887 ts_tablet_manager.cc:1428] T 29d492735cd14bb6b4a2a9a3929f62f3 P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.015s user 0.003s sys 0.000s
I20250830 07:54:34.614243 13887 tablet_bootstrap.cc:492] T 6cf10b7011d444cba0ac758add292477 P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:54:34.614302 13886 raft_consensus.cc:357] T 1933d49d319b4bd7b717dda2b83859f3 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:34.614500 13886 raft_consensus.cc:383] T 1933d49d319b4bd7b717dda2b83859f3 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:34.614595 13886 raft_consensus.cc:738] T 1933d49d319b4bd7b717dda2b83859f3 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:54:34.614791 13886 consensus_queue.cc:260] T 1933d49d319b4bd7b717dda2b83859f3 P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:34.615309 13886 ts_tablet_manager.cc:1428] T 1933d49d319b4bd7b717dda2b83859f3 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20250830 07:54:34.615613 13886 tablet_bootstrap.cc:492] T 252cc8fed9624222b26976bf54db68fb P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:54:34.616549 13887 tablet_bootstrap.cc:654] T 6cf10b7011d444cba0ac758add292477 P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:34.617272 13886 tablet_bootstrap.cc:654] T 252cc8fed9624222b26976bf54db68fb P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:34.619963 14023 raft_consensus.cc:491] T d0238794efb14150af6138b0d8bd80ec P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:34.620165 14023 raft_consensus.cc:513] T d0238794efb14150af6138b0d8bd80ec P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:34.620863 14023 leader_election.cc:290] T d0238794efb14150af6138b0d8bd80ec P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:34.623633 13774 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "d0238794efb14150af6138b0d8bd80ec" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:34.623843 13774 raft_consensus.cc:2466] T d0238794efb14150af6138b0d8bd80ec P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b5e454d98894637b466ea27f1b647f9 in term 0.
I20250830 07:54:34.624133 13882 tablet_bootstrap.cc:492] T 252cc8fed9624222b26976bf54db68fb P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:54:34.624305 13882 ts_tablet_manager.cc:1397] T 252cc8fed9624222b26976bf54db68fb P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.023s user 0.004s sys 0.003s
I20250830 07:54:34.625125 13562 leader_election.cc:304] T d0238794efb14150af6138b0d8bd80ec P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f; no voters:
I20250830 07:54:34.625154 13954 consensus_queue.cc:1035] T 4ab63ff59d4e4ec2b7b64d605545a870 P 2065c332f15a4739899af79f3669c3ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:54:34.625427 14023 raft_consensus.cc:2802] T d0238794efb14150af6138b0d8bd80ec P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:54:34.625515 14023 raft_consensus.cc:491] T d0238794efb14150af6138b0d8bd80ec P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:54:34.625610 14023 raft_consensus.cc:3058] T d0238794efb14150af6138b0d8bd80ec P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:34.625774 13487 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "d0238794efb14150af6138b0d8bd80ec" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:54:34.625990 13487 raft_consensus.cc:2466] T d0238794efb14150af6138b0d8bd80ec P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b5e454d98894637b466ea27f1b647f9 in term 0.
I20250830 07:54:34.627446 13886 tablet_bootstrap.cc:492] T 252cc8fed9624222b26976bf54db68fb P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:54:34.627585 13886 ts_tablet_manager.cc:1397] T 252cc8fed9624222b26976bf54db68fb P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.012s user 0.003s sys 0.002s
I20250830 07:54:34.628268 14023 raft_consensus.cc:513] T d0238794efb14150af6138b0d8bd80ec P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:34.628412 13886 raft_consensus.cc:357] T 252cc8fed9624222b26976bf54db68fb P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:34.628589 13886 raft_consensus.cc:383] T 252cc8fed9624222b26976bf54db68fb P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:34.628655 13886 raft_consensus.cc:738] T 252cc8fed9624222b26976bf54db68fb P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:54:34.628873 13886 consensus_queue.cc:260] T 252cc8fed9624222b26976bf54db68fb P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:34.629303 13486 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "d0238794efb14150af6138b0d8bd80ec" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba"
I20250830 07:54:34.629469 13486 raft_consensus.cc:3058] T d0238794efb14150af6138b0d8bd80ec P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:34.629549 14023 leader_election.cc:290] T d0238794efb14150af6138b0d8bd80ec P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 election: Requested vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:34.629781 13886 ts_tablet_manager.cc:1428] T 252cc8fed9624222b26976bf54db68fb P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20250830 07:54:34.630064 13886 tablet_bootstrap.cc:492] T 6f4c400c0e5e43319fa521b5cab694b4 P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:54:34.632040 13486 raft_consensus.cc:2466] T d0238794efb14150af6138b0d8bd80ec P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b5e454d98894637b466ea27f1b647f9 in term 1.
I20250830 07:54:34.632361 13561 leader_election.cc:304] T d0238794efb14150af6138b0d8bd80ec P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 6b5e454d98894637b466ea27f1b647f9; no voters:
I20250830 07:54:34.632465 13886 tablet_bootstrap.cc:654] T 6f4c400c0e5e43319fa521b5cab694b4 P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:34.632604 14023 raft_consensus.cc:2802] T d0238794efb14150af6138b0d8bd80ec P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Leader election won for term 1
I20250830 07:54:34.632736 14023 raft_consensus.cc:695] T d0238794efb14150af6138b0d8bd80ec P 6b5e454d98894637b466ea27f1b647f9 [term 1 LEADER]: Becoming Leader. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Running, Role: LEADER
I20250830 07:54:34.633010 14023 consensus_queue.cc:237] T d0238794efb14150af6138b0d8bd80ec P 6b5e454d98894637b466ea27f1b647f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:34.635483 13887 tablet_bootstrap.cc:492] T 6cf10b7011d444cba0ac758add292477 P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:54:34.625103 13882 raft_consensus.cc:357] T 252cc8fed9624222b26976bf54db68fb P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:34.636250 13882 raft_consensus.cc:383] T 252cc8fed9624222b26976bf54db68fb P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:34.636340 13882 raft_consensus.cc:738] T 252cc8fed9624222b26976bf54db68fb P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:54:34.635624 13887 ts_tablet_manager.cc:1397] T 6cf10b7011d444cba0ac758add292477 P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.022s user 0.002s sys 0.004s
I20250830 07:54:34.637673 13887 raft_consensus.cc:357] T 6cf10b7011d444cba0ac758add292477 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:34.637867 13887 raft_consensus.cc:383] T 6cf10b7011d444cba0ac758add292477 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:34.637948 13887 raft_consensus.cc:738] T 6cf10b7011d444cba0ac758add292477 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:54:34.638134 13887 consensus_queue.cc:260] T 6cf10b7011d444cba0ac758add292477 P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:34.638556 13882 consensus_queue.cc:260] T 252cc8fed9624222b26976bf54db68fb P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:34.639084 13882 ts_tablet_manager.cc:1428] T 252cc8fed9624222b26976bf54db68fb P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.015s user 0.000s sys 0.002s
I20250830 07:54:34.639369 13882 tablet_bootstrap.cc:492] T 2afb1e75cfcc4e1abd265fbadb4170fa P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:54:34.640847 13882 tablet_bootstrap.cc:654] T 2afb1e75cfcc4e1abd265fbadb4170fa P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:34.640969 14030 raft_consensus.cc:491] T 252cc8fed9624222b26976bf54db68fb P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:34.641115 14030 raft_consensus.cc:513] T 252cc8fed9624222b26976bf54db68fb P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:34.641644 14030 leader_election.cc:290] T 252cc8fed9624222b26976bf54db68fb P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
I20250830 07:54:34.642652 13774 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "d0238794efb14150af6138b0d8bd80ec" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f"
I20250830 07:54:34.642823 13774 raft_consensus.cc:3058] T d0238794efb14150af6138b0d8bd80ec P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:34.645776 13774 raft_consensus.cc:2466] T d0238794efb14150af6138b0d8bd80ec P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b5e454d98894637b466ea27f1b647f9 in term 1.
I20250830 07:54:34.646528 13887 ts_tablet_manager.cc:1428] T 6cf10b7011d444cba0ac758add292477 P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.009s user 0.001s sys 0.000s
I20250830 07:54:34.646829 13887 tablet_bootstrap.cc:492] T 69f2105c5eeb47e9a848ae7bf8779996 P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:54:34.649091 13887 tablet_bootstrap.cc:654] T 69f2105c5eeb47e9a848ae7bf8779996 P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:34.649317 13886 tablet_bootstrap.cc:492] T 6f4c400c0e5e43319fa521b5cab694b4 P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:54:34.649439 13886 ts_tablet_manager.cc:1397] T 6f4c400c0e5e43319fa521b5cab694b4 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.019s user 0.004s sys 0.000s
I20250830 07:54:34.650179 13886 raft_consensus.cc:357] T 6f4c400c0e5e43319fa521b5cab694b4 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:34.650331 13886 raft_consensus.cc:383] T 6f4c400c0e5e43319fa521b5cab694b4 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:34.650418 13886 raft_consensus.cc:738] T 6f4c400c0e5e43319fa521b5cab694b4 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:54:34.650645 13886 consensus_queue.cc:260] T 6f4c400c0e5e43319fa521b5cab694b4 P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:34.653254 13886 ts_tablet_manager.cc:1428] T 6f4c400c0e5e43319fa521b5cab694b4 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20250830 07:54:34.654206 13886 tablet_bootstrap.cc:492] T 2afb1e75cfcc4e1abd265fbadb4170fa P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:54:34.655942 13882 tablet_bootstrap.cc:492] T 2afb1e75cfcc4e1abd265fbadb4170fa P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:54:34.656109 13882 ts_tablet_manager.cc:1397] T 2afb1e75cfcc4e1abd265fbadb4170fa P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.017s user 0.002s sys 0.000s
I20250830 07:54:34.656836 13882 raft_consensus.cc:357] T 2afb1e75cfcc4e1abd265fbadb4170fa P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:34.657011 13882 raft_consensus.cc:383] T 2afb1e75cfcc4e1abd265fbadb4170fa P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:34.657068 13882 raft_consensus.cc:738] T 2afb1e75cfcc4e1abd265fbadb4170fa P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:54:34.657264 13882 consensus_queue.cc:260] T 2afb1e75cfcc4e1abd265fbadb4170fa P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:34.657687 13882 ts_tablet_manager.cc:1428] T 2afb1e75cfcc4e1abd265fbadb4170fa P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20250830 07:54:34.658030 13882 tablet_bootstrap.cc:492] T c9a8f144d50c4d3d81fbf43ce29a2ad2 P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:54:34.662091 13886 tablet_bootstrap.cc:654] T 2afb1e75cfcc4e1abd265fbadb4170fa P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:34.664407 13487 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "252cc8fed9624222b26976bf54db68fb" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:54:34.664702 13487 raft_consensus.cc:2466] T 252cc8fed9624222b26976bf54db68fb P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 0.
I20250830 07:54:34.665200 13701 leader_election.cc:304] T 252cc8fed9624222b26976bf54db68fb P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters:
I20250830 07:54:34.665518 14030 raft_consensus.cc:2802] T 252cc8fed9624222b26976bf54db68fb P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:54:34.665592 14030 raft_consensus.cc:491] T 252cc8fed9624222b26976bf54db68fb P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:54:34.665681 14030 raft_consensus.cc:3058] T 252cc8fed9624222b26976bf54db68fb P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:34.667263 13882 tablet_bootstrap.cc:654] T c9a8f144d50c4d3d81fbf43ce29a2ad2 P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:34.668409 14030 raft_consensus.cc:513] T 252cc8fed9624222b26976bf54db68fb P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:34.670171 14030 leader_election.cc:290] T 252cc8fed9624222b26976bf54db68fb P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Requested vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
I20250830 07:54:34.670596 13486 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "252cc8fed9624222b26976bf54db68fb" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba"
I20250830 07:54:34.670835 13486 raft_consensus.cc:3058] T 252cc8fed9624222b26976bf54db68fb P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:34.671043 13887 tablet_bootstrap.cc:492] T 69f2105c5eeb47e9a848ae7bf8779996 P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:54:34.671200 13887 ts_tablet_manager.cc:1397] T 69f2105c5eeb47e9a848ae7bf8779996 P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.024s user 0.001s sys 0.010s
I20250830 07:54:34.671949 13887 raft_consensus.cc:357] T 69f2105c5eeb47e9a848ae7bf8779996 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:34.672144 13887 raft_consensus.cc:383] T 69f2105c5eeb47e9a848ae7bf8779996 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:34.672219 13887 raft_consensus.cc:738] T 69f2105c5eeb47e9a848ae7bf8779996 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:54:34.673838 13887 consensus_queue.cc:260] T 69f2105c5eeb47e9a848ae7bf8779996 P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:34.674216 13486 raft_consensus.cc:2466] T 252cc8fed9624222b26976bf54db68fb P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 1.
I20250830 07:54:34.674465 13886 tablet_bootstrap.cc:492] T 2afb1e75cfcc4e1abd265fbadb4170fa P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:54:34.674685 13886 ts_tablet_manager.cc:1397] T 2afb1e75cfcc4e1abd265fbadb4170fa P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.021s user 0.000s sys 0.004s
I20250830 07:54:34.674836 13887 ts_tablet_manager.cc:1428] T 69f2105c5eeb47e9a848ae7bf8779996 P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20250830 07:54:34.674612 13701 leader_election.cc:304] T 252cc8fed9624222b26976bf54db68fb P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters:
I20250830 07:54:34.675168 13887 tablet_bootstrap.cc:492] T 4c2c85732d454cd98efc2646af9450ed P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:54:34.675422 13886 raft_consensus.cc:357] T 2afb1e75cfcc4e1abd265fbadb4170fa P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:34.675585 14030 raft_consensus.cc:2802] T 252cc8fed9624222b26976bf54db68fb P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election won for term 1
I20250830 07:54:34.676677 13887 tablet_bootstrap.cc:654] T 4c2c85732d454cd98efc2646af9450ed P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:34.678588 13629 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "252cc8fed9624222b26976bf54db68fb" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:34.678802 13629 raft_consensus.cc:2466] T 252cc8fed9624222b26976bf54db68fb P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 0.
I20250830 07:54:34.680187 13629 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "252cc8fed9624222b26976bf54db68fb" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9"
I20250830 07:54:34.680356 13629 raft_consensus.cc:3058] T 252cc8fed9624222b26976bf54db68fb P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:34.683593 13882 tablet_bootstrap.cc:492] T c9a8f144d50c4d3d81fbf43ce29a2ad2 P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:54:34.683759 13882 ts_tablet_manager.cc:1397] T c9a8f144d50c4d3d81fbf43ce29a2ad2 P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.026s user 0.004s sys 0.002s
I20250830 07:54:34.684840 13882 raft_consensus.cc:357] T c9a8f144d50c4d3d81fbf43ce29a2ad2 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:34.685199 13882 raft_consensus.cc:383] T c9a8f144d50c4d3d81fbf43ce29a2ad2 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:34.686101 13882 raft_consensus.cc:738] T c9a8f144d50c4d3d81fbf43ce29a2ad2 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:54:34.686357 13882 consensus_queue.cc:260] T c9a8f144d50c4d3d81fbf43ce29a2ad2 P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:34.675604 13886 raft_consensus.cc:383] T 2afb1e75cfcc4e1abd265fbadb4170fa P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:34.687352 13886 raft_consensus.cc:738] T 2afb1e75cfcc4e1abd265fbadb4170fa P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:54:34.687732 13886 consensus_queue.cc:260] T 2afb1e75cfcc4e1abd265fbadb4170fa P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:34.688244 13886 ts_tablet_manager.cc:1428] T 2afb1e75cfcc4e1abd265fbadb4170fa P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.013s user 0.002s sys 0.000s
I20250830 07:54:34.688450 14030 raft_consensus.cc:695] T 252cc8fed9624222b26976bf54db68fb P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 LEADER]: Becoming Leader. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Running, Role: LEADER
I20250830 07:54:34.688711 14030 consensus_queue.cc:237] T 252cc8fed9624222b26976bf54db68fb P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:34.689194 14038 consensus_queue.cc:1035] T 4ab63ff59d4e4ec2b7b64d605545a870 P 2065c332f15a4739899af79f3669c3ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:54:34.692658 13887 tablet_bootstrap.cc:492] T 4c2c85732d454cd98efc2646af9450ed P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:54:34.692791 13887 ts_tablet_manager.cc:1397] T 4c2c85732d454cd98efc2646af9450ed P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.018s user 0.003s sys 0.000s
I20250830 07:54:34.693097 13882 ts_tablet_manager.cc:1428] T c9a8f144d50c4d3d81fbf43ce29a2ad2 P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20250830 07:54:34.693423 14023 consensus_queue.cc:1035] T a78c522b9fa945e2879fb965d82fb359 P 6b5e454d98894637b466ea27f1b647f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:54:34.693733 13629 raft_consensus.cc:2466] T 252cc8fed9624222b26976bf54db68fb P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 1.
I20250830 07:54:34.694411 13882 tablet_bootstrap.cc:492] T 1933d49d319b4bd7b717dda2b83859f3 P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:54:34.696616 13882 tablet_bootstrap.cc:654] T 1933d49d319b4bd7b717dda2b83859f3 P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:34.698772 13887 raft_consensus.cc:357] T 4c2c85732d454cd98efc2646af9450ed P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:34.699693 13887 raft_consensus.cc:383] T 4c2c85732d454cd98efc2646af9450ed P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:34.699908 13887 raft_consensus.cc:738] T 4c2c85732d454cd98efc2646af9450ed P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:54:34.700266 13887 consensus_queue.cc:260] T 4c2c85732d454cd98efc2646af9450ed P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:34.701887 13887 ts_tablet_manager.cc:1428] T 4c2c85732d454cd98efc2646af9450ed P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.009s user 0.002s sys 0.000s
I20250830 07:54:34.706693 13886 tablet_bootstrap.cc:492] T 4c2c85732d454cd98efc2646af9450ed P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:54:34.707929 13887 tablet_bootstrap.cc:492] T 62cf192967d94ecf954d3e965a4d9c9b P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:54:34.709919 14038 consensus_queue.cc:1035] T ef16b9e2d444489699f4db1ac26d5f6c P 2065c332f15a4739899af79f3669c3ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:54:34.711345 13887 tablet_bootstrap.cc:654] T 62cf192967d94ecf954d3e965a4d9c9b P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:34.713141 13886 tablet_bootstrap.cc:654] T 4c2c85732d454cd98efc2646af9450ed P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:34.713799 13882 tablet_bootstrap.cc:492] T 1933d49d319b4bd7b717dda2b83859f3 P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:54:34.713982 13882 ts_tablet_manager.cc:1397] T 1933d49d319b4bd7b717dda2b83859f3 P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.020s user 0.006s sys 0.003s
I20250830 07:54:34.714901 13882 raft_consensus.cc:357] T 1933d49d319b4bd7b717dda2b83859f3 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:34.715166 13882 raft_consensus.cc:383] T 1933d49d319b4bd7b717dda2b83859f3 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:34.715255 13882 raft_consensus.cc:738] T 1933d49d319b4bd7b717dda2b83859f3 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:54:34.715497 13882 consensus_queue.cc:260] T 1933d49d319b4bd7b717dda2b83859f3 P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:34.716137 13882 ts_tablet_manager.cc:1428] T 1933d49d319b4bd7b717dda2b83859f3 P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20250830 07:54:34.716485 13882 tablet_bootstrap.cc:492] T 4c2c85732d454cd98efc2646af9450ed P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:54:34.718392 13882 tablet_bootstrap.cc:654] T 4c2c85732d454cd98efc2646af9450ed P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:34.723767 13887 tablet_bootstrap.cc:492] T 62cf192967d94ecf954d3e965a4d9c9b P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:54:34.724395 13887 ts_tablet_manager.cc:1397] T 62cf192967d94ecf954d3e965a4d9c9b P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.017s user 0.003s sys 0.003s
I20250830 07:54:34.725394 13887 raft_consensus.cc:357] T 62cf192967d94ecf954d3e965a4d9c9b P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:34.726454 13887 raft_consensus.cc:383] T 62cf192967d94ecf954d3e965a4d9c9b P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:34.726703 13887 raft_consensus.cc:738] T 62cf192967d94ecf954d3e965a4d9c9b P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:54:34.727208 13887 consensus_queue.cc:260] T 62cf192967d94ecf954d3e965a4d9c9b P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:34.732218 14023 consensus_queue.cc:1035] T 4b7eff24965f4f3ebfbf70dc82b7cce3 P 6b5e454d98894637b466ea27f1b647f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:54:34.736577 13487 raft_consensus.cc:3058] T a78c522b9fa945e2879fb965d82fb359 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
W20250830 07:54:34.746053 13422 consensus_peers.cc:489] T ef16b9e2d444489699f4db1ac26d5f6c P 2065c332f15a4739899af79f3669c3ba -> Peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Couldn't send request to peer 9b057ade5dce45af9f8bf0bedf8b917f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ef16b9e2d444489699f4db1ac26d5f6c. This is attempt 1: this message will repeat every 5th retry.
I20250830 07:54:34.748282 14023 consensus_queue.cc:1035] T a78c522b9fa945e2879fb965d82fb359 P 6b5e454d98894637b466ea27f1b647f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20250830 07:54:34.751961 13218 catalog_manager.cc:4726] Async tablet task AlterTable RPC for tablet 4828280e6fec4338b35422917966ac8c (table default.Table_fcf6d8285a8a4759b22a5038eb349f72 [id=ccd39c94f435403289f5f425afa4d74e], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 4828280e6fec4338b35422917966ac8c has no consensus state
I20250830 07:54:34.753206 13887 ts_tablet_manager.cc:1428] T 62cf192967d94ecf954d3e965a4d9c9b P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.004s user 0.000s sys 0.001s
I20250830 07:54:34.754051 13887 tablet_bootstrap.cc:492] T e134ab64aa1b4ce89e295b43cbc3fffb P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:54:34.755578 13887 tablet_bootstrap.cc:654] T e134ab64aa1b4ce89e295b43cbc3fffb P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:34.766952 13899 consensus_queue.cc:1035] T 4b7eff24965f4f3ebfbf70dc82b7cce3 P 6b5e454d98894637b466ea27f1b647f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:54:34.779517 14150 raft_consensus.cc:491] T 6f4c400c0e5e43319fa521b5cab694b4 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:34.780244 14150 raft_consensus.cc:513] T 6f4c400c0e5e43319fa521b5cab694b4 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:34.780975 13954 raft_consensus.cc:491] T 6cf10b7011d444cba0ac758add292477 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:34.781128 13954 raft_consensus.cc:513] T 6cf10b7011d444cba0ac758add292477 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:34.781634 13954 leader_election.cc:290] T 6cf10b7011d444cba0ac758add292477 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:34.782598 13628 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "6cf10b7011d444cba0ac758add292477" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:34.783179 13772 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "6cf10b7011d444cba0ac758add292477" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:34.783847 13627 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "6f4c400c0e5e43319fa521b5cab694b4" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:34.784173 13627 raft_consensus.cc:2466] T 6f4c400c0e5e43319fa521b5cab694b4 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 0.
I20250830 07:54:34.784504 13485 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "6f4c400c0e5e43319fa521b5cab694b4" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:54:34.784560 13703 leader_election.cc:304] T 6f4c400c0e5e43319fa521b5cab694b4 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f; no voters:
W20250830 07:54:34.785946 13423 leader_election.cc:343] T 6cf10b7011d444cba0ac758add292477 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:34.786260 14167 raft_consensus.cc:2802] T 6f4c400c0e5e43319fa521b5cab694b4 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election won for term 1
W20250830 07:54:34.786396 13701 leader_election.cc:343] T 6f4c400c0e5e43319fa521b5cab694b4 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:34.786454 14167 raft_consensus.cc:491] T 6f4c400c0e5e43319fa521b5cab694b4 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:54:34.786595 14167 raft_consensus.cc:3058] T 6f4c400c0e5e43319fa521b5cab694b4 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
W20250830 07:54:34.786724 13422 leader_election.cc:343] T 6cf10b7011d444cba0ac758add292477 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:34.786824 13422 leader_election.cc:304] T 6cf10b7011d444cba0ac758add292477 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba; no voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:54:34.787562 13954 raft_consensus.cc:2747] T 6cf10b7011d444cba0ac758add292477 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:54:34.790228 14150 leader_election.cc:290] T 6f4c400c0e5e43319fa521b5cab694b4 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
I20250830 07:54:34.793622 14167 raft_consensus.cc:513] T 6f4c400c0e5e43319fa521b5cab694b4 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:34.795769 13627 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "6f4c400c0e5e43319fa521b5cab694b4" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9"
I20250830 07:54:34.795987 13627 raft_consensus.cc:3058] T 6f4c400c0e5e43319fa521b5cab694b4 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:34.796412 13886 tablet_bootstrap.cc:492] T 4c2c85732d454cd98efc2646af9450ed P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:54:34.796546 13886 ts_tablet_manager.cc:1397] T 4c2c85732d454cd98efc2646af9450ed P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.090s user 0.003s sys 0.000s
I20250830 07:54:34.797385 14167 leader_election.cc:290] T 6f4c400c0e5e43319fa521b5cab694b4 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Requested vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
I20250830 07:54:34.797339 13886 raft_consensus.cc:357] T 4c2c85732d454cd98efc2646af9450ed P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:34.797514 13886 raft_consensus.cc:383] T 4c2c85732d454cd98efc2646af9450ed P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:34.797617 13886 raft_consensus.cc:738] T 4c2c85732d454cd98efc2646af9450ed P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:54:34.797923 13886 consensus_queue.cc:260] T 4c2c85732d454cd98efc2646af9450ed P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:34.798525 13886 ts_tablet_manager.cc:1428] T 4c2c85732d454cd98efc2646af9450ed P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20250830 07:54:34.798800 13886 tablet_bootstrap.cc:492] T c9a8f144d50c4d3d81fbf43ce29a2ad2 P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:54:34.799575 13627 raft_consensus.cc:2466] T 6f4c400c0e5e43319fa521b5cab694b4 P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 1.
I20250830 07:54:34.799963 13485 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "6f4c400c0e5e43319fa521b5cab694b4" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba"
I20250830 07:54:34.800292 13703 leader_election.cc:304] T 6f4c400c0e5e43319fa521b5cab694b4 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f; no voters:
W20250830 07:54:34.800433 13701 leader_election.cc:343] T 6f4c400c0e5e43319fa521b5cab694b4 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:34.800776 14167 raft_consensus.cc:2802] T 6f4c400c0e5e43319fa521b5cab694b4 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election won for term 1
I20250830 07:54:34.800966 14167 raft_consensus.cc:695] T 6f4c400c0e5e43319fa521b5cab694b4 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 LEADER]: Becoming Leader. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Running, Role: LEADER
I20250830 07:54:34.802016 14167 consensus_queue.cc:237] T 6f4c400c0e5e43319fa521b5cab694b4 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
W20250830 07:54:34.811710 13231 catalog_manager.cc:5415] Ignoring report from unknown tablet 1933d49d319b4bd7b717dda2b83859f3
I20250830 07:54:34.813493 13231 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_9da4c3c58ca94b989fa57b37343548b4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:34.814785 13231 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9da4c3c58ca94b989fa57b37343548b4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250830 07:54:34.817237 13226 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 6492bd11e50d4900927db0de3757aa24 consensus state has no leader
I20250830 07:54:34.818569 13233 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet 3167b609ed184decb4ccdb4945933ebb
I20250830 07:54:34.819188 13233 catalog_manager.cc:6652] ReplaceTablet: tablet 3167b609ed184decb4ccdb4945933ebb deleted and replaced by tablet e255d3fdee09400ead41ca835d6d103f
I20250830 07:54:34.819443 13233 master_service.cc:948] ReplaceTablet: received request to replace tablet 4ab63ff59d4e4ec2b7b64d605545a870 from {username='slave'} at 127.0.0.1:42126
I20250830 07:54:34.819584 13459 tablet_service.cc:1515] Processing DeleteTablet for tablet 3167b609ed184decb4ccdb4945933ebb with delete_type TABLET_DATA_DELETED (replaced by tablet e255d3fdee09400ead41ca835d6d103f) from {username='slave'} at 127.0.0.1:37956
I20250830 07:54:34.819885 13234 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet 1fa571e9490e499792225d7b786e8658
W20250830 07:54:34.820117 13218 catalog_manager.cc:4908] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): delete failed for tablet 3167b609ed184decb4ccdb4945933ebb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3167b609ed184decb4ccdb4945933ebb already in progress: creating tablet
I20250830 07:54:34.820381 13234 catalog_manager.cc:6652] ReplaceTablet: tablet 1fa571e9490e499792225d7b786e8658 deleted and replaced by tablet 0507245aa8c74aeb9f3eafba0682590d
I20250830 07:54:34.820766 13459 tablet_service.cc:1515] Processing DeleteTablet for tablet 1fa571e9490e499792225d7b786e8658 with delete_type TABLET_DATA_DELETED (replaced by tablet 0507245aa8c74aeb9f3eafba0682590d) from {username='slave'} at 127.0.0.1:37956
I20250830 07:54:34.821590 13605 tablet_service.cc:1515] Processing DeleteTablet for tablet 3167b609ed184decb4ccdb4945933ebb with delete_type TABLET_DATA_DELETED (replaced by tablet e255d3fdee09400ead41ca835d6d103f) from {username='slave'} at 127.0.0.1:45306
I20250830 07:54:34.821712 13754 tablet_service.cc:1515] Processing DeleteTablet for tablet 3167b609ed184decb4ccdb4945933ebb with delete_type TABLET_DATA_DELETED (replaced by tablet e255d3fdee09400ead41ca835d6d103f) from {username='slave'} at 127.0.0.1:45460
I20250830 07:54:34.821815 13604 tablet_service.cc:1515] Processing DeleteTablet for tablet 1fa571e9490e499792225d7b786e8658 with delete_type TABLET_DATA_DELETED (replaced by tablet 0507245aa8c74aeb9f3eafba0682590d) from {username='slave'} at 127.0.0.1:45306
I20250830 07:54:34.822050 13755 tablet_service.cc:1515] Processing DeleteTablet for tablet 1fa571e9490e499792225d7b786e8658 with delete_type TABLET_DATA_DELETED (replaced by tablet 0507245aa8c74aeb9f3eafba0682590d) from {username='slave'} at 127.0.0.1:45460
W20250830 07:54:34.822853 13219 catalog_manager.cc:4908] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): delete failed for tablet 3167b609ed184decb4ccdb4945933ebb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3167b609ed184decb4ccdb4945933ebb already in progress: creating tablet
W20250830 07:54:34.823151 13220 catalog_manager.cc:4908] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet 3167b609ed184decb4ccdb4945933ebb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3167b609ed184decb4ccdb4945933ebb already in progress: creating tablet
W20250830 07:54:34.823279 13219 catalog_manager.cc:4908] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): delete failed for tablet 1fa571e9490e499792225d7b786e8658 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1fa571e9490e499792225d7b786e8658 already in progress: creating tablet
W20250830 07:54:34.823485 13220 catalog_manager.cc:4908] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet 1fa571e9490e499792225d7b786e8658 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1fa571e9490e499792225d7b786e8658 already in progress: creating tablet
W20250830 07:54:34.823565 13218 catalog_manager.cc:4908] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): delete failed for tablet 1fa571e9490e499792225d7b786e8658 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1fa571e9490e499792225d7b786e8658 already in progress: creating tablet
I20250830 07:54:34.827239 13627 raft_consensus.cc:1273] T f846a23f0be046028cc2472de88b71c4 P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Refusing update from remote peer 2065c332f15a4739899af79f3669c3ba: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250830 07:54:34.827777 13954 consensus_queue.cc:1035] T f846a23f0be046028cc2472de88b71c4 P 2065c332f15a4739899af79f3669c3ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:54:34.831023 13775 raft_consensus.cc:1273] T f846a23f0be046028cc2472de88b71c4 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Refusing update from remote peer 2065c332f15a4739899af79f3669c3ba: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250830 07:54:34.831559 13954 consensus_queue.cc:1035] T f846a23f0be046028cc2472de88b71c4 P 2065c332f15a4739899af79f3669c3ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:54:34.839398 13232 master_service.cc:948] ReplaceTablet: received request to replace tablet 62cf192967d94ecf954d3e965a4d9c9b from {username='slave'} at 127.0.0.1:42126
I20250830 07:54:34.840773 13882 tablet_bootstrap.cc:492] T 4c2c85732d454cd98efc2646af9450ed P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:54:34.840929 13882 ts_tablet_manager.cc:1397] T 4c2c85732d454cd98efc2646af9450ed P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.125s user 0.033s sys 0.026s
I20250830 07:54:34.841789 13882 raft_consensus.cc:357] T 4c2c85732d454cd98efc2646af9450ed P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:34.841971 13882 raft_consensus.cc:383] T 4c2c85732d454cd98efc2646af9450ed P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:34.842083 13882 raft_consensus.cc:738] T 4c2c85732d454cd98efc2646af9450ed P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:54:34.844316 13882 consensus_queue.cc:260] T 4c2c85732d454cd98efc2646af9450ed P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:34.844823 13228 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_3ada97cf95b64b1fb2324762c4800a9a" } modify_external_catalogs: true
I20250830 07:54:34.845023 13228 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_3ada97cf95b64b1fb2324762c4800a9a" } modify_external_catalogs: true
I20250830 07:54:34.845081 13882 ts_tablet_manager.cc:1428] T 4c2c85732d454cd98efc2646af9450ed P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.004s user 0.000s sys 0.002s
I20250830 07:54:34.845374 13882 tablet_bootstrap.cc:492] T bcdac588f7c24d9d8572949e09b80a23 P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:54:34.846022 14073 tablet.cc:1722] T f846a23f0be046028cc2472de88b71c4 P 2065c332f15a4739899af79f3669c3ba: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250830 07:54:34.846621 13233 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_041ceda2433746918526d2219fd68f8e" } modify_external_catalogs: true
I20250830 07:54:34.846781 13233 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_041ceda2433746918526d2219fd68f8e" } modify_external_catalogs: true
I20250830 07:54:34.850371 13230 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_1dd3362d92834f4584155f93d68e8734" } new_table_name: "default.Table_c8fac6974ea94c7e863c1ded184f9230" modify_external_catalogs: true
I20250830 07:54:34.851254 13234 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_3e347dcde734493486c0340c2d4d7101" } modify_external_catalogs: true
I20250830 07:54:34.851344 13227 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_2e8460bb8bf84662b02eb6dd0cb94f40" } modify_external_catalogs: true
I20250830 07:54:34.851450 13234 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_3e347dcde734493486c0340c2d4d7101" } modify_external_catalogs: true
I20250830 07:54:34.851507 13227 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_2e8460bb8bf84662b02eb6dd0cb94f40" } modify_external_catalogs: true
I20250830 07:54:34.852823 14123 tablet.cc:1722] T f846a23f0be046028cc2472de88b71c4 P 9b057ade5dce45af9f8bf0bedf8b917f: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250830 07:54:34.852876 13225 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_77b02efa7d514f4291acb38f6f870ff9" } new_table_name: "default.Table_6f8d287a31204172a037b156956fb0d9" modify_external_catalogs: true
W20250830 07:54:34.853282 13226 catalog_manager.cc:5415] Ignoring report from unknown tablet 4b7eff24965f4f3ebfbf70dc82b7cce3
W20250830 07:54:34.853380 13226 catalog_manager.cc:5415] Ignoring report from unknown tablet ef16b9e2d444489699f4db1ac26d5f6c
W20250830 07:54:34.853431 13226 catalog_manager.cc:5415] Ignoring report from unknown tablet a78c522b9fa945e2879fb965d82fb359
W20250830 07:54:34.853492 13226 catalog_manager.cc:5415] Ignoring report from unknown tablet 1933d49d319b4bd7b717dda2b83859f3
W20250830 07:54:34.853580 13226 catalog_manager.cc:5415] Ignoring report from unknown tablet 4ab63ff59d4e4ec2b7b64d605545a870
W20250830 07:54:34.853655 13226 catalog_manager.cc:5415] Ignoring report from unknown tablet 2afb1e75cfcc4e1abd265fbadb4170fa
W20250830 07:54:34.853720 13226 catalog_manager.cc:5415] Ignoring report from unknown tablet 7ef98dbbdf5848038a2da6140e126301
I20250830 07:54:34.854202 13226 catalog_manager.cc:5674] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967) does not have the latest schema for tablet c9a8f144d50c4d3d81fbf43ce29a2ad2 (table default.Table_739e22d6e6554d3d8859e047e088514f [id=d2dbb756d66b483ebe44d45ddfa5c17c]). Expected version 8 got 0
I20250830 07:54:34.854420 13226 catalog_manager.cc:5582] T d0238794efb14150af6138b0d8bd80ec P 6b5e454d98894637b466ea27f1b647f9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2). New cstate: current_term: 1 leader_uuid: "6b5e454d98894637b466ea27f1b647f9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } health_report { overall_health: UNKNOWN } } }
I20250830 07:54:34.855607 13232 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_83ef88343cbe43eba0c492ac3eb87e9f" } new_table_name: "default.Table_4d93a3d083764fedb28fcf469ae96c80" modify_external_catalogs: true
I20250830 07:54:34.856204 13882 tablet_bootstrap.cc:654] T bcdac588f7c24d9d8572949e09b80a23 P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:34.866468 14124 tablet.cc:1722] T f846a23f0be046028cc2472de88b71c4 P 6b5e454d98894637b466ea27f1b647f9: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250830 07:54:34.867105 13886 tablet_bootstrap.cc:654] T c9a8f144d50c4d3d81fbf43ce29a2ad2 P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:34.868409 13228 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet 861809cc50764aa89140e587489e2d88
I20250830 07:54:34.869805 13459 tablet_service.cc:1515] Processing DeleteTablet for tablet 861809cc50764aa89140e587489e2d88 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:34 UTC) from {username='slave'} at 127.0.0.1:37956
I20250830 07:54:34.869910 13755 tablet_service.cc:1515] Processing DeleteTablet for tablet 861809cc50764aa89140e587489e2d88 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:34 UTC) from {username='slave'} at 127.0.0.1:45460
I20250830 07:54:34.870232 13604 tablet_service.cc:1515] Processing DeleteTablet for tablet 861809cc50764aa89140e587489e2d88 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:34 UTC) from {username='slave'} at 127.0.0.1:45306
W20250830 07:54:34.870491 13219 catalog_manager.cc:4908] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): delete failed for tablet 861809cc50764aa89140e587489e2d88 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 861809cc50764aa89140e587489e2d88 already in progress: creating tablet
I20250830 07:54:34.870604 13887 tablet_bootstrap.cc:492] T e134ab64aa1b4ce89e295b43cbc3fffb P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:54:34.870733 13887 ts_tablet_manager.cc:1397] T e134ab64aa1b4ce89e295b43cbc3fffb P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.117s user 0.004s sys 0.021s
W20250830 07:54:34.870707 13218 catalog_manager.cc:4908] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): delete failed for tablet 861809cc50764aa89140e587489e2d88 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 861809cc50764aa89140e587489e2d88 already in progress: creating tablet
W20250830 07:54:34.871529 13220 catalog_manager.cc:4908] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet 861809cc50764aa89140e587489e2d88 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 861809cc50764aa89140e587489e2d88 already in progress: creating tablet
I20250830 07:54:34.871614 13887 raft_consensus.cc:357] T e134ab64aa1b4ce89e295b43cbc3fffb P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:34.871826 13887 raft_consensus.cc:383] T e134ab64aa1b4ce89e295b43cbc3fffb P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:34.871928 13887 raft_consensus.cc:738] T e134ab64aa1b4ce89e295b43cbc3fffb P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:54:34.874373 13887 consensus_queue.cc:260] T e134ab64aa1b4ce89e295b43cbc3fffb P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:34.878486 13887 ts_tablet_manager.cc:1428] T e134ab64aa1b4ce89e295b43cbc3fffb P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.008s user 0.002s sys 0.000s
I20250830 07:54:34.883774 13887 tablet_bootstrap.cc:492] T 6f4c400c0e5e43319fa521b5cab694b4 P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:54:34.885368 13887 tablet_bootstrap.cc:654] T 6f4c400c0e5e43319fa521b5cab694b4 P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:34.891472 13228 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_c02d944178e54c07946be5f4f5e4e0f5" } modify_external_catalogs: true
I20250830 07:54:34.891664 13228 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_c02d944178e54c07946be5f4f5e4e0f5" } modify_external_catalogs: true
I20250830 07:54:34.892356 13886 tablet_bootstrap.cc:492] T c9a8f144d50c4d3d81fbf43ce29a2ad2 P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:54:34.892508 13886 ts_tablet_manager.cc:1397] T c9a8f144d50c4d3d81fbf43ce29a2ad2 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.094s user 0.004s sys 0.003s
I20250830 07:54:34.893011 13231 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_3a3bd36d028a41e39d051f15093ea71d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250830 07:54:34.893342 13886 raft_consensus.cc:357] T c9a8f144d50c4d3d81fbf43ce29a2ad2 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
W20250830 07:54:34.893534 13231 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3a3bd36d028a41e39d051f15093ea71d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:34.893550 13886 raft_consensus.cc:383] T c9a8f144d50c4d3d81fbf43ce29a2ad2 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:34.893636 13886 raft_consensus.cc:738] T c9a8f144d50c4d3d81fbf43ce29a2ad2 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:54:34.897655 13886 consensus_queue.cc:260] T c9a8f144d50c4d3d81fbf43ce29a2ad2 P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:34.898612 13882 tablet_bootstrap.cc:492] T bcdac588f7c24d9d8572949e09b80a23 P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:54:34.898780 13882 ts_tablet_manager.cc:1397] T bcdac588f7c24d9d8572949e09b80a23 P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.053s user 0.011s sys 0.003s
I20250830 07:54:34.899083 13233 catalog_manager.cc:5864] Not sending DeleteTablet requests; no consensus state for tablet 3a4e3b32235e48d28d87c9514004f71d
I20250830 07:54:34.899510 13882 raft_consensus.cc:357] T bcdac588f7c24d9d8572949e09b80a23 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:34.899705 13882 raft_consensus.cc:383] T bcdac588f7c24d9d8572949e09b80a23 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:34.899780 13882 raft_consensus.cc:738] T bcdac588f7c24d9d8572949e09b80a23 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:54:34.900015 13882 consensus_queue.cc:260] T bcdac588f7c24d9d8572949e09b80a23 P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:34.900228 13886 ts_tablet_manager.cc:1428] T c9a8f144d50c4d3d81fbf43ce29a2ad2 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.008s user 0.001s sys 0.001s
I20250830 07:54:34.900519 13886 tablet_bootstrap.cc:492] T 62cf192967d94ecf954d3e965a4d9c9b P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
W20250830 07:54:34.901857 13233 catalog_manager.cc:5415] Ignoring report from unknown tablet 4c2c85732d454cd98efc2646af9450ed
W20250830 07:54:34.901934 13233 catalog_manager.cc:5415] Ignoring report from unknown tablet 4b7eff24965f4f3ebfbf70dc82b7cce3
W20250830 07:54:34.902022 13233 catalog_manager.cc:5415] Ignoring report from unknown tablet 4ab63ff59d4e4ec2b7b64d605545a870
I20250830 07:54:34.902022 13886 tablet_bootstrap.cc:654] T 62cf192967d94ecf954d3e965a4d9c9b P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
W20250830 07:54:34.902076 13233 catalog_manager.cc:5415] Ignoring report from unknown tablet 2afb1e75cfcc4e1abd265fbadb4170fa
W20250830 07:54:34.902151 13233 catalog_manager.cc:5415] Ignoring report from unknown tablet 6f4c400c0e5e43319fa521b5cab694b4
W20250830 07:54:34.902256 13233 catalog_manager.cc:5415] Ignoring report from unknown tablet a78c522b9fa945e2879fb965d82fb359
W20250830 07:54:34.902326 13233 catalog_manager.cc:5415] Ignoring report from unknown tablet 1933d49d319b4bd7b717dda2b83859f3
I20250830 07:54:34.904040 13882 ts_tablet_manager.cc:1428] T bcdac588f7c24d9d8572949e09b80a23 P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.005s user 0.000s sys 0.003s
I20250830 07:54:34.904661 13882 tablet_bootstrap.cc:492] T d3b47314f7cd4e969d973c0a340137f1 P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:54:34.906219 13882 tablet_bootstrap.cc:654] T d3b47314f7cd4e969d973c0a340137f1 P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:34.908485 13234 catalog_manager.cc:5864] Not sending DeleteTablet requests; no consensus state for tablet aa8302071acf4c149d4955bdada1090b
I20250830 07:54:34.908608 14040 raft_consensus.cc:491] T 29d492735cd14bb6b4a2a9a3929f62f3 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:34.908807 14040 raft_consensus.cc:513] T 29d492735cd14bb6b4a2a9a3929f62f3 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:34.909549 14040 leader_election.cc:290] T 29d492735cd14bb6b4a2a9a3929f62f3 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:34.910629 13627 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "29d492735cd14bb6b4a2a9a3929f62f3" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
W20250830 07:54:34.911216 13423 leader_election.cc:343] T 29d492735cd14bb6b4a2a9a3929f62f3 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:34.911496 13775 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "29d492735cd14bb6b4a2a9a3929f62f3" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
W20250830 07:54:34.912045 13422 leader_election.cc:343] T 29d492735cd14bb6b4a2a9a3929f62f3 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:34.912164 13422 leader_election.cc:304] T 29d492735cd14bb6b4a2a9a3929f62f3 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba; no voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:54:34.912423 14040 raft_consensus.cc:2747] T 29d492735cd14bb6b4a2a9a3929f62f3 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:54:34.914261 13234 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_e416a7a3bb404b1faa035579e6375156" } new_table_name: "default.Table_59fd0f7bd26b46b59945c393fc5bb4dc" modify_external_catalogs: true
I20250830 07:54:34.916344 13227 catalog_manager.cc:5864] Not sending DeleteTablet requests; no consensus state for tablet a432344d861d48708208c80494f4250a
I20250830 07:54:34.916565 13227 master_service.cc:948] ReplaceTablet: received request to replace tablet 2afb1e75cfcc4e1abd265fbadb4170fa from {username='slave'} at 127.0.0.1:42126
W20250830 07:54:34.916646 13230 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 69d6daeb7c774fd48ed296f52ed7c6a6 has no consensus state
I20250830 07:54:34.916994 13230 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_9de60d2dd0dc41fca2f01375068cd911"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250830 07:54:34.917196 13227 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_c440d46b5982439c94ff44ddba2ddd28"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:34.917486 13230 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9de60d2dd0dc41fca2f01375068cd911 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250830 07:54:34.917739 13227 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c440d46b5982439c94ff44ddba2ddd28 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:34.917615 13887 tablet_bootstrap.cc:492] T 6f4c400c0e5e43319fa521b5cab694b4 P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:54:34.918236 13887 ts_tablet_manager.cc:1397] T 6f4c400c0e5e43319fa521b5cab694b4 P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.035s user 0.005s sys 0.004s
W20250830 07:54:34.919039 13225 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 7238db7e31484201a30cf4c035d82aff consensus state has no leader
W20250830 07:54:34.919438 13232 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d0238794efb14150af6138b0d8bd80ec consensus state has no leader
I20250830 07:54:34.918996 13887 raft_consensus.cc:357] T 6f4c400c0e5e43319fa521b5cab694b4 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:34.920260 13887 raft_consensus.cc:383] T 6f4c400c0e5e43319fa521b5cab694b4 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:34.920358 13887 raft_consensus.cc:738] T 6f4c400c0e5e43319fa521b5cab694b4 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:54:34.920881 13886 tablet_bootstrap.cc:492] T 62cf192967d94ecf954d3e965a4d9c9b P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:54:34.920814 13887 consensus_queue.cc:260] T 6f4c400c0e5e43319fa521b5cab694b4 P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:34.920996 13886 ts_tablet_manager.cc:1397] T 62cf192967d94ecf954d3e965a4d9c9b P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.021s user 0.001s sys 0.002s
I20250830 07:54:34.921725 13886 raft_consensus.cc:357] T 62cf192967d94ecf954d3e965a4d9c9b P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:34.921866 13886 raft_consensus.cc:383] T 62cf192967d94ecf954d3e965a4d9c9b P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:34.921932 13886 raft_consensus.cc:738] T 62cf192967d94ecf954d3e965a4d9c9b P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:54:34.922148 13886 consensus_queue.cc:260] T 62cf192967d94ecf954d3e965a4d9c9b P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:34.923842 13232 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_da448c80c657460bb81499960d034919"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:34.924377 13232 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_da448c80c657460bb81499960d034919 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:34.925078 13886 ts_tablet_manager.cc:1428] T 62cf192967d94ecf954d3e965a4d9c9b P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20250830 07:54:34.927083 13886 tablet_bootstrap.cc:492] T e134ab64aa1b4ce89e295b43cbc3fffb P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:54:34.928648 13887 ts_tablet_manager.cc:1428] T 6f4c400c0e5e43319fa521b5cab694b4 P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.010s user 0.002s sys 0.000s
I20250830 07:54:34.928683 13886 tablet_bootstrap.cc:654] T e134ab64aa1b4ce89e295b43cbc3fffb P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:34.933707 13887 tablet_bootstrap.cc:492] T c9a8f144d50c4d3d81fbf43ce29a2ad2 P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:54:34.938318 13886 tablet_bootstrap.cc:492] T e134ab64aa1b4ce89e295b43cbc3fffb P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:54:34.938488 13886 ts_tablet_manager.cc:1397] T e134ab64aa1b4ce89e295b43cbc3fffb P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.011s user 0.004s sys 0.004s
I20250830 07:54:34.938572 13887 tablet_bootstrap.cc:654] T c9a8f144d50c4d3d81fbf43ce29a2ad2 P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:34.939231 13886 raft_consensus.cc:357] T e134ab64aa1b4ce89e295b43cbc3fffb P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:34.939538 13886 raft_consensus.cc:383] T e134ab64aa1b4ce89e295b43cbc3fffb P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:34.939633 13886 raft_consensus.cc:738] T e134ab64aa1b4ce89e295b43cbc3fffb P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:54:34.939862 13886 consensus_queue.cc:260] T e134ab64aa1b4ce89e295b43cbc3fffb P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:34.940431 13886 ts_tablet_manager.cc:1428] T e134ab64aa1b4ce89e295b43cbc3fffb P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20250830 07:54:34.940685 13886 tablet_bootstrap.cc:492] T 02be33dc658d428fa55e59784a2342f6 P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:54:34.941524 14040 consensus_queue.cc:1035] T 508ce3cc87734e5b8cec40e74522549a P 2065c332f15a4739899af79f3669c3ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:54:34.942160 13228 catalog_manager.cc:5864] Not sending DeleteTablet requests; no consensus state for tablet 3bc4ac3967c2463f9659667b45f5eff4
I20250830 07:54:34.942286 13886 tablet_bootstrap.cc:654] T 02be33dc658d428fa55e59784a2342f6 P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
W20250830 07:54:34.942535 13234 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 44313f1a11b74e6d996cafd3c03d1836 has no consensus state
I20250830 07:54:34.944152 13459 tablet_service.cc:1515] Processing DeleteTablet for tablet 252cc8fed9624222b26976bf54db68fb with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:33 UTC) from {username='slave'} at 127.0.0.1:37956
I20250830 07:54:34.945186 13604 tablet_service.cc:1515] Processing DeleteTablet for tablet 252cc8fed9624222b26976bf54db68fb with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:33 UTC) from {username='slave'} at 127.0.0.1:45306
I20250830 07:54:34.945524 13885 tablet_replica.cc:331] T 252cc8fed9624222b26976bf54db68fb P 6b5e454d98894637b466ea27f1b647f9: stopping tablet replica
I20250830 07:54:34.945794 13885 raft_consensus.cc:2241] T 252cc8fed9624222b26976bf54db68fb P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250830 07:54:34.945976 13885 raft_consensus.cc:2270] T 252cc8fed9624222b26976bf54db68fb P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250830 07:54:34.946729 13885 ts_tablet_manager.cc:1905] T 252cc8fed9624222b26976bf54db68fb P 6b5e454d98894637b466ea27f1b647f9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250830 07:54:34.947062 13883 tablet_replica.cc:331] T 252cc8fed9624222b26976bf54db68fb P 2065c332f15a4739899af79f3669c3ba: stopping tablet replica
I20250830 07:54:34.947274 13883 raft_consensus.cc:2241] T 252cc8fed9624222b26976bf54db68fb P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Raft consensus shutting down.
I20250830 07:54:34.947474 13883 raft_consensus.cc:2270] T 252cc8fed9624222b26976bf54db68fb P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20250830 07:54:34.947953 13883 ts_tablet_manager.cc:1905] T 252cc8fed9624222b26976bf54db68fb P 2065c332f15a4739899af79f3669c3ba: Deleting tablet data with delete state TABLET_DATA_DELETED
W20250830 07:54:34.950610 13233 catalog_manager.cc:5415] Ignoring report from unknown tablet e134ab64aa1b4ce89e295b43cbc3fffb
W20250830 07:54:34.950779 13233 catalog_manager.cc:5415] Ignoring report from unknown tablet 4ab63ff59d4e4ec2b7b64d605545a870
W20250830 07:54:34.950865 13233 catalog_manager.cc:5415] Ignoring report from unknown tablet a78c522b9fa945e2879fb965d82fb359
I20250830 07:54:34.951040 13755 tablet_service.cc:1515] Processing DeleteTablet for tablet 252cc8fed9624222b26976bf54db68fb with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:33 UTC) from {username='slave'} at 127.0.0.1:45460
I20250830 07:54:34.951488 13884 tablet_replica.cc:331] T 252cc8fed9624222b26976bf54db68fb P 9b057ade5dce45af9f8bf0bedf8b917f: stopping tablet replica
I20250830 07:54:34.951455 13233 catalog_manager.cc:5674] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743) does not have the latest schema for tablet c9a8f144d50c4d3d81fbf43ce29a2ad2 (table default.Table_739e22d6e6554d3d8859e047e088514f [id=d2dbb756d66b483ebe44d45ddfa5c17c]). Expected version 8 got 0
I20250830 07:54:34.951668 13884 raft_consensus.cc:2241] T 252cc8fed9624222b26976bf54db68fb P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 LEADER]: Raft consensus shutting down.
I20250830 07:54:34.951896 13884 pending_rounds.cc:70] T 252cc8fed9624222b26976bf54db68fb P 9b057ade5dce45af9f8bf0bedf8b917f: Trying to abort 1 pending ops.
I20250830 07:54:34.951941 14027 raft_consensus.cc:491] T 1933d49d319b4bd7b717dda2b83859f3 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:34.951982 13884 pending_rounds.cc:77] T 252cc8fed9624222b26976bf54db68fb P 9b057ade5dce45af9f8bf0bedf8b917f: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7194789784327876608 op_type: NO_OP noop_request { }
I20250830 07:54:34.952118 13884 raft_consensus.cc:2887] T 252cc8fed9624222b26976bf54db68fb P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20250830 07:54:34.952095 14027 raft_consensus.cc:513] T 1933d49d319b4bd7b717dda2b83859f3 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:34.952224 13884 raft_consensus.cc:2270] T 252cc8fed9624222b26976bf54db68fb P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Raft consensus is shut down!
I20250830 07:54:34.952767 14027 leader_election.cc:290] T 1933d49d319b4bd7b717dda2b83859f3 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:34.953192 13775 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "1933d49d319b4bd7b717dda2b83859f3" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:34.953403 13775 raft_consensus.cc:2466] T 1933d49d319b4bd7b717dda2b83859f3 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2065c332f15a4739899af79f3669c3ba in term 0.
I20250830 07:54:34.954044 13422 leader_election.cc:304] T 1933d49d319b4bd7b717dda2b83859f3 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters:
I20250830 07:54:34.954141 13884 ts_tablet_manager.cc:1905] T 252cc8fed9624222b26976bf54db68fb P 9b057ade5dce45af9f8bf0bedf8b917f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250830 07:54:34.955147 14040 raft_consensus.cc:2802] T 1933d49d319b4bd7b717dda2b83859f3 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:54:34.955257 14040 raft_consensus.cc:491] T 1933d49d319b4bd7b717dda2b83859f3 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:54:34.955382 14040 raft_consensus.cc:3058] T 1933d49d319b4bd7b717dda2b83859f3 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:34.956810 13885 ts_tablet_manager.cc:1918] T 252cc8fed9624222b26976bf54db68fb P 6b5e454d98894637b466ea27f1b647f9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250830 07:54:34.956944 13885 log.cc:1199] T 252cc8fed9624222b26976bf54db68fb P 6b5e454d98894637b466ea27f1b647f9: Deleting WAL directory at /tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/ts-1/wal/wals/252cc8fed9624222b26976bf54db68fb
I20250830 07:54:34.957274 13885 ts_tablet_manager.cc:1939] T 252cc8fed9624222b26976bf54db68fb P 6b5e454d98894637b466ea27f1b647f9: Deleting consensus metadata
I20250830 07:54:34.958329 13220 catalog_manager.cc:4928] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): tablet 252cc8fed9624222b26976bf54db68fb (table default.Table_f6365a8a7d034d06824a36d2f6033caf [id=2cc2255be4a84bf08dc5cb0b33234b85]) successfully deleted
I20250830 07:54:34.959077 14038 consensus_queue.cc:1035] T 508ce3cc87734e5b8cec40e74522549a P 2065c332f15a4739899af79f3669c3ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:54:34.959535 14038 raft_consensus.cc:491] T e134ab64aa1b4ce89e295b43cbc3fffb P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:34.959673 14038 raft_consensus.cc:513] T e134ab64aa1b4ce89e295b43cbc3fffb P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:34.960357 14038 leader_election.cc:290] T e134ab64aa1b4ce89e295b43cbc3fffb P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:34.961519 13774 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "e134ab64aa1b4ce89e295b43cbc3fffb" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:34.961715 13774 raft_consensus.cc:2466] T e134ab64aa1b4ce89e295b43cbc3fffb P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2065c332f15a4739899af79f3669c3ba in term 0.
I20250830 07:54:34.961694 13629 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "1933d49d319b4bd7b717dda2b83859f3" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:34.961894 13629 raft_consensus.cc:2466] T 1933d49d319b4bd7b717dda2b83859f3 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2065c332f15a4739899af79f3669c3ba in term 0.
I20250830 07:54:34.961941 13956 raft_consensus.cc:491] T 2afb1e75cfcc4e1abd265fbadb4170fa P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:34.962100 13628 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "e134ab64aa1b4ce89e295b43cbc3fffb" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:34.962141 13956 raft_consensus.cc:513] T 2afb1e75cfcc4e1abd265fbadb4170fa P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:34.962896 13956 leader_election.cc:290] T 2afb1e75cfcc4e1abd265fbadb4170fa P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
W20250830 07:54:34.964032 13423 leader_election.cc:343] T e134ab64aa1b4ce89e295b43cbc3fffb P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:34.964144 13485 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "2afb1e75cfcc4e1abd265fbadb4170fa" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
W20250830 07:54:34.964640 13561 leader_election.cc:343] T 2afb1e75cfcc4e1abd265fbadb4170fa P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:34.964965 13422 leader_election.cc:304] T e134ab64aa1b4ce89e295b43cbc3fffb P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:54:34.967033 14027 raft_consensus.cc:2802] T e134ab64aa1b4ce89e295b43cbc3fffb P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:54:34.967170 14027 raft_consensus.cc:491] T e134ab64aa1b4ce89e295b43cbc3fffb P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:54:34.967271 13485 raft_consensus.cc:1273] T d0238794efb14150af6138b0d8bd80ec P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Refusing update from remote peer 6b5e454d98894637b466ea27f1b647f9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250830 07:54:34.967275 14027 raft_consensus.cc:3058] T e134ab64aa1b4ce89e295b43cbc3fffb P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:34.967602 13774 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "2afb1e75cfcc4e1abd265fbadb4170fa" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:34.967794 13774 raft_consensus.cc:2466] T 2afb1e75cfcc4e1abd265fbadb4170fa P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b5e454d98894637b466ea27f1b647f9 in term 0.
I20250830 07:54:34.970140 13562 leader_election.cc:304] T 2afb1e75cfcc4e1abd265fbadb4170fa P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 2065c332f15a4739899af79f3669c3ba
I20250830 07:54:34.970484 14023 consensus_queue.cc:1035] T d0238794efb14150af6138b0d8bd80ec P 6b5e454d98894637b466ea27f1b647f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:54:34.970618 13774 raft_consensus.cc:1273] T d0238794efb14150af6138b0d8bd80ec P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Refusing update from remote peer 6b5e454d98894637b466ea27f1b647f9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250830 07:54:34.970862 14023 raft_consensus.cc:2802] T 2afb1e75cfcc4e1abd265fbadb4170fa P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:54:34.970988 14023 raft_consensus.cc:491] T 2afb1e75cfcc4e1abd265fbadb4170fa P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:54:34.971104 14023 raft_consensus.cc:3058] T 2afb1e75cfcc4e1abd265fbadb4170fa P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:34.971475 14027 raft_consensus.cc:513] T e134ab64aa1b4ce89e295b43cbc3fffb P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:34.972543 13233 catalog_manager.cc:6127] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: default.Table_e3a02594cc004665a46fa35a486ad4fc [id=66b40d7668914309b6bd8eaf8994d9ac] alter complete (version 1)
I20250830 07:54:34.973246 13755 tablet_service.cc:1515] Processing DeleteTablet for tablet 62cf192967d94ecf954d3e965a4d9c9b with delete_type TABLET_DATA_DELETED (replaced by tablet 73853894da074ecd8147a94ac28bfab8) from {username='slave'} at 127.0.0.1:45460
I20250830 07:54:34.973733 14023 raft_consensus.cc:513] T 2afb1e75cfcc4e1abd265fbadb4170fa P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:34.974268 14023 leader_election.cc:290] T 2afb1e75cfcc4e1abd265fbadb4170fa P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 election: Requested vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:34.975181 13486 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "2afb1e75cfcc4e1abd265fbadb4170fa" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba"
I20250830 07:54:34.958832 14040 raft_consensus.cc:513] T 1933d49d319b4bd7b717dda2b83859f3 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:34.976477 14027 leader_election.cc:290] T e134ab64aa1b4ce89e295b43cbc3fffb P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 election: Requested vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:34.976958 13774 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "e134ab64aa1b4ce89e295b43cbc3fffb" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f"
W20250830 07:54:34.977038 13561 leader_election.cc:343] T 2afb1e75cfcc4e1abd265fbadb4170fa P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:34.977118 13774 raft_consensus.cc:3058] T e134ab64aa1b4ce89e295b43cbc3fffb P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
W20250830 07:54:34.977227 13233 catalog_manager.cc:5415] Ignoring report from unknown tablet 6f4c400c0e5e43319fa521b5cab694b4
W20250830 07:54:34.977331 13233 catalog_manager.cc:5415] Ignoring report from unknown tablet 4c2c85732d454cd98efc2646af9450ed
W20250830 07:54:34.977473 13233 catalog_manager.cc:5415] Ignoring report from unknown tablet 4b7eff24965f4f3ebfbf70dc82b7cce3
W20250830 07:54:34.977522 13233 catalog_manager.cc:5415] Ignoring report from unknown tablet 29d492735cd14bb6b4a2a9a3929f62f3
W20250830 07:54:34.977612 13233 catalog_manager.cc:5415] Ignoring report from unknown tablet e134ab64aa1b4ce89e295b43cbc3fffb
W20250830 07:54:34.977656 13233 catalog_manager.cc:5415] Ignoring report from unknown tablet 508ce3cc87734e5b8cec40e74522549a
W20250830 07:54:34.978645 13233 catalog_manager.cc:5415] Ignoring report from unknown tablet d876f6259bd94799a4e37dc9d14b8efe
W20250830 07:54:34.978724 13233 catalog_manager.cc:5415] Ignoring report from unknown tablet 4ab63ff59d4e4ec2b7b64d605545a870
W20250830 07:54:34.978806 13233 catalog_manager.cc:5415] Ignoring report from unknown tablet b4ab964a64a64e00a78ffd2b220aef46
W20250830 07:54:34.978848 13233 catalog_manager.cc:5415] Ignoring report from unknown tablet c82ac0102b4442449073e44d8a3d9065
W20250830 07:54:34.978962 13233 catalog_manager.cc:5415] Ignoring report from unknown tablet a78c522b9fa945e2879fb965d82fb359
W20250830 07:54:34.979023 13233 catalog_manager.cc:5415] Ignoring report from unknown tablet 7ef98dbbdf5848038a2da6140e126301
I20250830 07:54:34.979318 13629 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "1933d49d319b4bd7b717dda2b83859f3" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9"
I20250830 07:54:34.979509 13629 raft_consensus.cc:3058] T 1933d49d319b4bd7b717dda2b83859f3 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:34.979489 13628 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "e134ab64aa1b4ce89e295b43cbc3fffb" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9"
I20250830 07:54:34.979686 13773 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "2afb1e75cfcc4e1abd265fbadb4170fa" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f"
I20250830 07:54:34.979869 13773 raft_consensus.cc:3058] T 2afb1e75cfcc4e1abd265fbadb4170fa P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:34.982232 13629 raft_consensus.cc:2466] T 1933d49d319b4bd7b717dda2b83859f3 P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2065c332f15a4739899af79f3669c3ba in term 1.
W20250830 07:54:34.982540 13233 catalog_manager.cc:5415] Ignoring report from unknown tablet ef16b9e2d444489699f4db1ac26d5f6c
W20250830 07:54:34.982616 13233 catalog_manager.cc:5415] Ignoring report from unknown tablet f53e7423d1f54566a667195f7cf5e1ce
I20250830 07:54:34.983708 14023 consensus_queue.cc:1035] T d0238794efb14150af6138b0d8bd80ec P 6b5e454d98894637b466ea27f1b647f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:54:34.991089 13773 raft_consensus.cc:2466] T 2afb1e75cfcc4e1abd265fbadb4170fa P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b5e454d98894637b466ea27f1b647f9 in term 1.
I20250830 07:54:34.991566 13562 leader_election.cc:304] T 2afb1e75cfcc4e1abd265fbadb4170fa P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 2065c332f15a4739899af79f3669c3ba
I20250830 07:54:34.992002 14023 raft_consensus.cc:2802] T 2afb1e75cfcc4e1abd265fbadb4170fa P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Leader election won for term 1
I20250830 07:54:34.992282 14023 raft_consensus.cc:695] T 2afb1e75cfcc4e1abd265fbadb4170fa P 6b5e454d98894637b466ea27f1b647f9 [term 1 LEADER]: Becoming Leader. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Running, Role: LEADER
I20250830 07:54:34.993180 14023 consensus_queue.cc:237] T 2afb1e75cfcc4e1abd265fbadb4170fa P 6b5e454d98894637b466ea27f1b647f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:34.993407 13774 raft_consensus.cc:2466] T e134ab64aa1b4ce89e295b43cbc3fffb P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2065c332f15a4739899af79f3669c3ba in term 1.
I20250830 07:54:34.982223 14038 raft_consensus.cc:491] T dfccff3bd0cb4c7d998633b015de3cfa P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20250830 07:54:34.984120 13423 leader_election.cc:343] T e134ab64aa1b4ce89e295b43cbc3fffb P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:34.999435 13423 leader_election.cc:304] T 1933d49d319b4bd7b717dda2b83859f3 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 6b5e454d98894637b466ea27f1b647f9; no voters:
I20250830 07:54:34.999948 13954 raft_consensus.cc:2802] T 1933d49d319b4bd7b717dda2b83859f3 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election won for term 1
I20250830 07:54:34.985987 13459 tablet_service.cc:1515] Processing DeleteTablet for tablet d1ae3812d72b419798736328da64b53c with delete_type TABLET_DATA_DELETED (replaced by tablet e6491d149c0646848680cfdadb6fc76c) from {username='slave'} at 127.0.0.1:37956
I20250830 07:54:34.988740 13466 tablet_service.cc:1515] Processing DeleteTablet for tablet 6cf10b7011d444cba0ac758add292477 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:33 UTC) from {username='slave'} at 127.0.0.1:37956
I20250830 07:54:34.989089 13457 tablet_service.cc:1515] Processing DeleteTablet for tablet 62cf192967d94ecf954d3e965a4d9c9b with delete_type TABLET_DATA_DELETED (replaced by tablet 73853894da074ecd8147a94ac28bfab8) from {username='slave'} at 127.0.0.1:37956
I20250830 07:54:34.989483 13463 tablet_service.cc:1515] Processing DeleteTablet for tablet 69f2105c5eeb47e9a848ae7bf8779996 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:33 UTC) from {username='slave'} at 127.0.0.1:37956
I20250830 07:54:34.998800 14038 raft_consensus.cc:513] T dfccff3bd0cb4c7d998633b015de3cfa P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:34.998522 14040 leader_election.cc:290] T 1933d49d319b4bd7b717dda2b83859f3 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 election: Requested vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:35.001107 14038 leader_election.cc:290] T dfccff3bd0cb4c7d998633b015de3cfa P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:35.001214 14040 consensus_queue.cc:1035] T d876f6259bd94799a4e37dc9d14b8efe P 2065c332f15a4739899af79f3669c3ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:54:35.002002 13422 leader_election.cc:304] T e134ab64aa1b4ce89e295b43cbc3fffb P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:54:35.003758 14038 raft_consensus.cc:2802] T e134ab64aa1b4ce89e295b43cbc3fffb P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election won for term 1
I20250830 07:54:35.003930 14038 raft_consensus.cc:695] T e134ab64aa1b4ce89e295b43cbc3fffb P 2065c332f15a4739899af79f3669c3ba [term 1 LEADER]: Becoming Leader. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Running, Role: LEADER
I20250830 07:54:35.004279 14038 consensus_queue.cc:237] T e134ab64aa1b4ce89e295b43cbc3fffb P 2065c332f15a4739899af79f3669c3ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:35.005836 13773 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "dfccff3bd0cb4c7d998633b015de3cfa" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:35.006796 13773 raft_consensus.cc:2466] T dfccff3bd0cb4c7d998633b015de3cfa P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2065c332f15a4739899af79f3669c3ba in term 0.
I20250830 07:54:35.007547 13422 leader_election.cc:304] T dfccff3bd0cb4c7d998633b015de3cfa P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters:
I20250830 07:54:35.012701 14027 raft_consensus.cc:2802] T dfccff3bd0cb4c7d998633b015de3cfa P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:54:35.012737 13886 tablet_bootstrap.cc:492] T 02be33dc658d428fa55e59784a2342f6 P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:54:35.012898 13886 ts_tablet_manager.cc:1397] T 02be33dc658d428fa55e59784a2342f6 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.072s user 0.000s sys 0.006s
I20250830 07:54:35.013119 14027 raft_consensus.cc:491] T dfccff3bd0cb4c7d998633b015de3cfa P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:54:35.013346 14027 raft_consensus.cc:3058] T dfccff3bd0cb4c7d998633b015de3cfa P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:35.013885 13886 raft_consensus.cc:357] T 02be33dc658d428fa55e59784a2342f6 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:35.014110 13886 raft_consensus.cc:383] T 02be33dc658d428fa55e59784a2342f6 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:35.014215 13886 raft_consensus.cc:738] T 02be33dc658d428fa55e59784a2342f6 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:54:35.014549 13886 consensus_queue.cc:260] T 02be33dc658d428fa55e59784a2342f6 P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:35.016062 13774 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "1933d49d319b4bd7b717dda2b83859f3" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f"
I20250830 07:54:35.018201 13774 raft_consensus.cc:3058] T 1933d49d319b4bd7b717dda2b83859f3 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:35.019487 13233 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_7cae72f2a8a94b11b5ed4b050f5592a7" } new_table_name: "default.Table_857dfeec2d2644ebb4f2674ca8df8b89" modify_external_catalogs: true
I20250830 07:54:35.026120 13629 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "dfccff3bd0cb4c7d998633b015de3cfa" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:35.026341 13629 raft_consensus.cc:2466] T dfccff3bd0cb4c7d998633b015de3cfa P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2065c332f15a4739899af79f3669c3ba in term 0.
I20250830 07:54:35.028056 14124 tablet.cc:1722] T d0238794efb14150af6138b0d8bd80ec P 6b5e454d98894637b466ea27f1b647f9: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250830 07:54:35.029343 13232 catalog_manager.cc:5674] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325) does not have the latest schema for tablet d0238794efb14150af6138b0d8bd80ec (table default.Table_4d93a3d083764fedb28fcf469ae96c80 [id=8628f6e9686d43b6aa84cd3202db8e80]). Expected version 1 got 0
I20250830 07:54:35.030262 14027 raft_consensus.cc:513] T dfccff3bd0cb4c7d998633b015de3cfa P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:35.031316 13773 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "dfccff3bd0cb4c7d998633b015de3cfa" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f"
I20250830 07:54:35.031577 13773 raft_consensus.cc:3058] T dfccff3bd0cb4c7d998633b015de3cfa P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:35.034261 13773 raft_consensus.cc:2466] T dfccff3bd0cb4c7d998633b015de3cfa P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2065c332f15a4739899af79f3669c3ba in term 1.
I20250830 07:54:35.034706 13628 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "dfccff3bd0cb4c7d998633b015de3cfa" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9"
I20250830 07:54:35.034935 13628 raft_consensus.cc:3058] T dfccff3bd0cb4c7d998633b015de3cfa P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:35.035356 13422 leader_election.cc:304] T dfccff3bd0cb4c7d998633b015de3cfa P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters:
I20250830 07:54:35.037391 13227 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_99fc46a4e68b44b7974861887290284e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250830 07:54:35.037668 13628 raft_consensus.cc:2466] T dfccff3bd0cb4c7d998633b015de3cfa P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2065c332f15a4739899af79f3669c3ba in term 1.
W20250830 07:54:35.037993 13227 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_99fc46a4e68b44b7974861887290284e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:35.038522 14040 raft_consensus.cc:2802] T dfccff3bd0cb4c7d998633b015de3cfa P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election won for term 1
I20250830 07:54:35.038650 14040 raft_consensus.cc:695] T dfccff3bd0cb4c7d998633b015de3cfa P 2065c332f15a4739899af79f3669c3ba [term 1 LEADER]: Becoming Leader. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Running, Role: LEADER
I20250830 07:54:35.038899 14040 consensus_queue.cc:237] T dfccff3bd0cb4c7d998633b015de3cfa P 2065c332f15a4739899af79f3669c3ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:35.039601 13884 ts_tablet_manager.cc:1918] T 252cc8fed9624222b26976bf54db68fb P 9b057ade5dce45af9f8bf0bedf8b917f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250830 07:54:35.039716 13226 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_238dacf9721e4d9d9b4f077ddadc5679"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:35.040270 13226 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_238dacf9721e4d9d9b4f077ddadc5679 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:35.040666 13884 log.cc:1199] T 252cc8fed9624222b26976bf54db68fb P 9b057ade5dce45af9f8bf0bedf8b917f: Deleting WAL directory at /tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/ts-2/wal/wals/252cc8fed9624222b26976bf54db68fb
W20250830 07:54:35.040727 13233 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ffc5945a032e47d4bd3397d7c887dc62 consensus state has no leader
I20250830 07:54:35.041141 13884 ts_tablet_manager.cc:1939] T 252cc8fed9624222b26976bf54db68fb P 9b057ade5dce45af9f8bf0bedf8b917f: Deleting consensus metadata
I20250830 07:54:35.042053 13884 tablet_replica.cc:331] T 62cf192967d94ecf954d3e965a4d9c9b P 9b057ade5dce45af9f8bf0bedf8b917f: stopping tablet replica
I20250830 07:54:35.042263 13219 catalog_manager.cc:4928] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): tablet 252cc8fed9624222b26976bf54db68fb (table default.Table_f6365a8a7d034d06824a36d2f6033caf [id=2cc2255be4a84bf08dc5cb0b33234b85]) successfully deleted
I20250830 07:54:35.042357 13233 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_457b48606bd94a959a7675a3cded52ba"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:35.042876 13233 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_457b48606bd94a959a7675a3cded52ba in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:35.044970 13232 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_a1e1dfefb8bc4fc68682b6cbaca77e50"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:35.045467 13232 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a1e1dfefb8bc4fc68682b6cbaca77e50 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:35.045599 13883 ts_tablet_manager.cc:1918] T 252cc8fed9624222b26976bf54db68fb P 2065c332f15a4739899af79f3669c3ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250830 07:54:35.045729 13883 log.cc:1199] T 252cc8fed9624222b26976bf54db68fb P 2065c332f15a4739899af79f3669c3ba: Deleting WAL directory at /tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/ts-0/wal/wals/252cc8fed9624222b26976bf54db68fb
I20250830 07:54:35.045676 13230 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_c71f75e4206e47d0be0d45f0e006cc3d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250830 07:54:35.046151 13883 ts_tablet_manager.cc:1939] T 252cc8fed9624222b26976bf54db68fb P 2065c332f15a4739899af79f3669c3ba: Deleting consensus metadata
W20250830 07:54:35.046207 13230 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c71f75e4206e47d0be0d45f0e006cc3d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:35.046103 14073 tablet.cc:1722] T d0238794efb14150af6138b0d8bd80ec P 2065c332f15a4739899af79f3669c3ba: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250830 07:54:35.048162 13883 tablet_replica.cc:331] T d1ae3812d72b419798736328da64b53c P 2065c332f15a4739899af79f3669c3ba: stopping tablet replica
I20250830 07:54:35.048820 13774 raft_consensus.cc:2466] T 1933d49d319b4bd7b717dda2b83859f3 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2065c332f15a4739899af79f3669c3ba in term 1.
I20250830 07:54:35.049593 13883 raft_consensus.cc:2241] T d1ae3812d72b419798736328da64b53c P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Raft consensus shutting down.
I20250830 07:54:35.049975 13218 catalog_manager.cc:4928] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): tablet 252cc8fed9624222b26976bf54db68fb (table default.Table_f6365a8a7d034d06824a36d2f6033caf [id=2cc2255be4a84bf08dc5cb0b33234b85]) successfully deleted
I20250830 07:54:35.055646 13883 raft_consensus.cc:2270] T d1ae3812d72b419798736328da64b53c P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Raft consensus is shut down!
I20250830 07:54:35.056193 13883 ts_tablet_manager.cc:1905] T d1ae3812d72b419798736328da64b53c P 2065c332f15a4739899af79f3669c3ba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250830 07:54:35.056370 13604 tablet_service.cc:1468] Processing CreateTablet for tablet 62ee2d0fbd774d38a4a4c4a033584ef9 (DEFAULT_TABLE table=default.Table_9da4c3c58ca94b989fa57b37343548b4 [id=b6be55a64bca43c0bbab359694f0bcf6]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:35.056774 13604 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62ee2d0fbd774d38a4a4c4a033584ef9. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:35.060055 13463 tablet_service.cc:1468] Processing CreateTablet for tablet 62ee2d0fbd774d38a4a4c4a033584ef9 (DEFAULT_TABLE table=default.Table_9da4c3c58ca94b989fa57b37343548b4 [id=b6be55a64bca43c0bbab359694f0bcf6]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:35.060436 13463 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62ee2d0fbd774d38a4a4c4a033584ef9. 1 dirs total, 0 dirs full, 0 dirs failed
W20250830 07:54:35.071727 13226 catalog_manager.cc:5415] Ignoring report from unknown tablet 508ce3cc87734e5b8cec40e74522549a
I20250830 07:54:35.073294 13886 ts_tablet_manager.cc:1428] T 02be33dc658d428fa55e59784a2342f6 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20250830 07:54:35.073652 13886 tablet_bootstrap.cc:492] T 6cf10b7011d444cba0ac758add292477 P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:54:35.073856 13883 ts_tablet_manager.cc:1918] T d1ae3812d72b419798736328da64b53c P 2065c332f15a4739899af79f3669c3ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250830 07:54:35.073982 13883 log.cc:1199] T d1ae3812d72b419798736328da64b53c P 2065c332f15a4739899af79f3669c3ba: Deleting WAL directory at /tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/ts-0/wal/wals/d1ae3812d72b419798736328da64b53c
I20250830 07:54:35.074317 13883 ts_tablet_manager.cc:1939] T d1ae3812d72b419798736328da64b53c P 2065c332f15a4739899af79f3669c3ba: Deleting consensus metadata
I20250830 07:54:35.075763 13883 tablet_replica.cc:331] T 6cf10b7011d444cba0ac758add292477 P 2065c332f15a4739899af79f3669c3ba: stopping tablet replica
I20250830 07:54:35.075731 13218 catalog_manager.cc:4928] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): tablet d1ae3812d72b419798736328da64b53c (table default.Table_b4d7f806dfc640eeb8c6468a8ec88e14 [id=cb36c38dc252417e8a428287d4c469e6]) successfully deleted
I20250830 07:54:35.075870 13886 tablet_bootstrap.cc:654] T 6cf10b7011d444cba0ac758add292477 P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:35.075938 13883 raft_consensus.cc:2241] T 6cf10b7011d444cba0ac758add292477 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Raft consensus shutting down.
I20250830 07:54:35.076102 13883 raft_consensus.cc:2270] T 6cf10b7011d444cba0ac758add292477 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Raft consensus is shut down!
I20250830 07:54:35.076251 13227 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_adcde1613f434b17902b76d35e532dd3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:35.076783 13227 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_adcde1613f434b17902b76d35e532dd3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:35.077931 13226 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_a0fec9fe1cad48f6a9c37d2b76075510" } modify_external_catalogs: true
I20250830 07:54:35.078120 13226 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_a0fec9fe1cad48f6a9c37d2b76075510" } modify_external_catalogs: true
I20250830 07:54:35.080463 13883 ts_tablet_manager.cc:1905] T 6cf10b7011d444cba0ac758add292477 P 2065c332f15a4739899af79f3669c3ba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250830 07:54:35.084540 14040 consensus_queue.cc:1035] T d876f6259bd94799a4e37dc9d14b8efe P 2065c332f15a4739899af79f3669c3ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:54:35.087702 13463 tablet_service.cc:1468] Processing CreateTablet for tablet 14ed24577c8f49f49c83242a26877614 (DEFAULT_TABLE table=default.Table_c9397e64edef4d31a5a4eded8ebe365c [id=bcee72f9b1c6407f98435a1494b42407]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:35.087790 13457 tablet_service.cc:1468] Processing CreateTablet for tablet 2be43f828f204f599017b6a04cf2ddf9 (DEFAULT_TABLE table=default.Table_dab1da9ac1584d11b0b0ac9e81748758 [id=cbd8b881bf8a456d9930d5a6b27ab7d4]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:35.088433 13754 tablet_service.cc:1468] Processing CreateTablet for tablet 14ed24577c8f49f49c83242a26877614 (DEFAULT_TABLE table=default.Table_c9397e64edef4d31a5a4eded8ebe365c [id=bcee72f9b1c6407f98435a1494b42407]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:35.088478 13755 tablet_service.cc:1468] Processing CreateTablet for tablet 62ee2d0fbd774d38a4a4c4a033584ef9 (DEFAULT_TABLE table=default.Table_9da4c3c58ca94b989fa57b37343548b4 [id=b6be55a64bca43c0bbab359694f0bcf6]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:35.088819 13754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 14ed24577c8f49f49c83242a26877614. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:35.089013 13463 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 14ed24577c8f49f49c83242a26877614. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:35.089455 13755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62ee2d0fbd774d38a4a4c4a033584ef9. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:35.090531 13457 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2be43f828f204f599017b6a04cf2ddf9. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:35.092458 13226 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet ec4a3975961d4f85ad9da94835417574
I20250830 07:54:35.093535 13605 tablet_service.cc:1515] Processing DeleteTablet for tablet ec4a3975961d4f85ad9da94835417574 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:35 UTC) from {username='slave'} at 127.0.0.1:45306
W20250830 07:54:35.094122 13220 catalog_manager.cc:4895] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet ec4a3975961d4f85ad9da94835417574 because the tablet was not found. No further retry: Not found: Tablet not found: ec4a3975961d4f85ad9da94835417574
I20250830 07:54:35.095301 13466 tablet_service.cc:1515] Processing DeleteTablet for tablet ec4a3975961d4f85ad9da94835417574 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:35 UTC) from {username='slave'} at 127.0.0.1:37956
I20250830 07:54:35.095417 13750 tablet_service.cc:1515] Processing DeleteTablet for tablet ec4a3975961d4f85ad9da94835417574 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:35 UTC) from {username='slave'} at 127.0.0.1:45460
I20250830 07:54:35.098583 13605 tablet_service.cc:1468] Processing CreateTablet for tablet 2be43f828f204f599017b6a04cf2ddf9 (DEFAULT_TABLE table=default.Table_dab1da9ac1584d11b0b0ac9e81748758 [id=cbd8b881bf8a456d9930d5a6b27ab7d4]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:35.099664 13605 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2be43f828f204f599017b6a04cf2ddf9. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:35.106338 13599 tablet_service.cc:1468] Processing CreateTablet for tablet ada52626bbc94105a8b9428b0bbdfb5e (DEFAULT_TABLE table=default.Table_57d9ce41d0254969ae072b4c6936f7f2 [id=a219b2ce56d0408c936d6f2462cc6935]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:35.106617 13606 tablet_service.cc:1468] Processing CreateTablet for tablet 752727eef0734ff3b7b35b1d5f66aea6 (DEFAULT_TABLE table=default.Table_3566feeff7cd468093b299f2cc07abd6 [id=a7aed44b83c44611ae89a1f3a1a158c3]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:35.106856 13599 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ada52626bbc94105a8b9428b0bbdfb5e. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:35.107174 13609 tablet_service.cc:1468] Processing CreateTablet for tablet ea8ccd7ef791471291bca049bdf7f643 (DEFAULT_TABLE table=default.Table_a39e6bb297b74c8aa91039717c6ff1d4 [id=3582c72cab4b4e1084021b098ec30f87]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:35.107525 13609 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea8ccd7ef791471291bca049bdf7f643. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:35.113507 13464 tablet_service.cc:1468] Processing CreateTablet for tablet 66499e87e3d7422ca7a449cc2e89e709 (DEFAULT_TABLE table=default.Table_fc37190c24f34b8e86db55435a3b658e [id=4ec4d0c45603406c91e6b3618418d556]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:35.113694 13226 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_4004f71ffe6442a1a90ef09cae4b9d5c" } modify_external_catalogs: true
I20250830 07:54:35.113766 13600 tablet_service.cc:1468] Processing CreateTablet for tablet 7af74bdde363493f8061eba450ecf4b4 (DEFAULT_TABLE table=default.Table_510bdb6808fa48948663ba929c792917 [id=dfa51a12131743428fa066bbe3b6982e]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:35.113888 13226 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_4004f71ffe6442a1a90ef09cae4b9d5c" } modify_external_catalogs: true
I20250830 07:54:35.113982 13464 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 66499e87e3d7422ca7a449cc2e89e709. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:35.114889 13601 tablet_service.cc:1468] Processing CreateTablet for tablet e4c5eedb7f4d4397b19b8a3e0ddf9458 (DEFAULT_TABLE table=default.Table_bb7373773a224aeda09e03bdc97470e6 [id=3ef8f771f9df4b9a817e462f14c49d09]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:35.115330 13607 tablet_service.cc:1468] Processing CreateTablet for tablet 6dda55ec2da34c8aba9f39a63e144a7c (DEFAULT_TABLE table=default.Table_4004f71ffe6442a1a90ef09cae4b9d5c [id=2d46bc6ec12347bcac59167fb091dd14]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:35.115692 13602 tablet_service.cc:1468] Processing CreateTablet for tablet 66499e87e3d7422ca7a449cc2e89e709 (DEFAULT_TABLE table=default.Table_fc37190c24f34b8e86db55435a3b658e [id=4ec4d0c45603406c91e6b3618418d556]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:35.116091 13597 tablet_service.cc:1468] Processing CreateTablet for tablet b38c8d003413428dae9e47f58e197c2c (DEFAULT_TABLE table=default.Table_89b4b1b127ef49c1ad0bdff27ca49888 [id=158471c696cd4b4f9265dd006180b74b]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:35.116375 13606 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 752727eef0734ff3b7b35b1d5f66aea6. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:35.116776 13230 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_fd6941613dcf424583ca9f728fd345dd" } modify_external_catalogs: true
I20250830 07:54:35.116941 13230 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_fd6941613dcf424583ca9f728fd345dd" } modify_external_catalogs: true
I20250830 07:54:35.116912 13603 tablet_service.cc:1468] Processing CreateTablet for tablet 04c9d954106a4417a34ff80bc98e2ce8 (DEFAULT_TABLE table=default.Table_60f119819df04220a5c92c823e344beb [id=3412e2d7c49b445dbf2c40aaa62d2fee]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:35.117332 13608 tablet_service.cc:1468] Processing CreateTablet for tablet ad3c81a3f8df466fb71472e756c77305 (DEFAULT_TABLE table=default.Table_ebee83f51b6446a8afbf7c1f94b926a2 [id=2693b8974d444e21b284d246f53eca65]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:35.117419 13468 tablet_service.cc:1468] Processing CreateTablet for tablet ad3c81a3f8df466fb71472e756c77305 (DEFAULT_TABLE table=default.Table_ebee83f51b6446a8afbf7c1f94b926a2 [id=2693b8974d444e21b284d246f53eca65]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:35.117825 13468 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad3c81a3f8df466fb71472e756c77305. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:35.117959 13595 tablet_service.cc:1468] Processing CreateTablet for tablet dbe542c478874482b078296a7a0e9ec9 (DEFAULT_TABLE table=default.Table_ee3b720242cc477ca9273d73d1199ac3 [id=b80ba51884ef4042818f8def0b0ebf0e]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:35.118666 13598 tablet_service.cc:1468] Processing CreateTablet for tablet 853503f3f98a49219b077af980180400 (DEFAULT_TABLE table=default.Table_fcd3d99bd5da4461be0a68789d51d740 [id=09e8bd12743d40b89fb69cc66c035df1]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:35.119037 13602 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 66499e87e3d7422ca7a449cc2e89e709. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:35.119778 13749 tablet_service.cc:1468] Processing CreateTablet for tablet 6dda55ec2da34c8aba9f39a63e144a7c (DEFAULT_TABLE table=default.Table_4004f71ffe6442a1a90ef09cae4b9d5c [id=2d46bc6ec12347bcac59167fb091dd14]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:35.119900 13456 tablet_service.cc:1468] Processing CreateTablet for tablet e4c5eedb7f4d4397b19b8a3e0ddf9458 (DEFAULT_TABLE table=default.Table_bb7373773a224aeda09e03bdc97470e6 [id=3ef8f771f9df4b9a817e462f14c49d09]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:35.120018 13750 tablet_service.cc:1468] Processing CreateTablet for tablet 752727eef0734ff3b7b35b1d5f66aea6 (DEFAULT_TABLE table=default.Table_3566feeff7cd468093b299f2cc07abd6 [id=a7aed44b83c44611ae89a1f3a1a158c3]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:35.120133 13749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6dda55ec2da34c8aba9f39a63e144a7c. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:35.120306 13456 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e4c5eedb7f4d4397b19b8a3e0ddf9458. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:35.120338 13750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 752727eef0734ff3b7b35b1d5f66aea6. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:35.120618 13747 tablet_service.cc:1468] Processing CreateTablet for tablet 66499e87e3d7422ca7a449cc2e89e709 (DEFAULT_TABLE table=default.Table_fc37190c24f34b8e86db55435a3b658e [id=4ec4d0c45603406c91e6b3618418d556]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:35.120929 13747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 66499e87e3d7422ca7a449cc2e89e709. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:35.123186 13748 tablet_service.cc:1468] Processing CreateTablet for tablet 04c9d954106a4417a34ff80bc98e2ce8 (DEFAULT_TABLE table=default.Table_60f119819df04220a5c92c823e344beb [id=3412e2d7c49b445dbf2c40aaa62d2fee]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:35.123262 13461 tablet_service.cc:1468] Processing CreateTablet for tablet 7af74bdde363493f8061eba450ecf4b4 (DEFAULT_TABLE table=default.Table_510bdb6808fa48948663ba929c792917 [id=dfa51a12131743428fa066bbe3b6982e]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:35.123504 13748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 04c9d954106a4417a34ff80bc98e2ce8. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:35.123704 13461 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7af74bdde363493f8061eba450ecf4b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:35.126968 13753 tablet_service.cc:1468] Processing CreateTablet for tablet ad3c81a3f8df466fb71472e756c77305 (DEFAULT_TABLE table=default.Table_ebee83f51b6446a8afbf7c1f94b926a2 [id=2693b8974d444e21b284d246f53eca65]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:35.123685 13596 tablet_service.cc:1468] Processing CreateTablet for tablet 30c2558c28944ff39d1a4a4ca9ac604e (DEFAULT_TABLE table=default.Table_878c1e8976de49e599d6240552c2efb8 [id=5bd99792133941ef8175d6f7fbb62251]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:35.127238 13465 tablet_service.cc:1468] Processing CreateTablet for tablet ada52626bbc94105a8b9428b0bbdfb5e (DEFAULT_TABLE table=default.Table_57d9ce41d0254969ae072b4c6936f7f2 [id=a219b2ce56d0408c936d6f2462cc6935]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:35.127312 13753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad3c81a3f8df466fb71472e756c77305. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:35.127605 13465 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ada52626bbc94105a8b9428b0bbdfb5e. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:35.127839 13608 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad3c81a3f8df466fb71472e756c77305. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:35.131260 13462 tablet_service.cc:1468] Processing CreateTablet for tablet 853503f3f98a49219b077af980180400 (DEFAULT_TABLE table=default.Table_fcd3d99bd5da4461be0a68789d51d740 [id=09e8bd12743d40b89fb69cc66c035df1]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:35.131367 13752 tablet_service.cc:1468] Processing CreateTablet for tablet e4c5eedb7f4d4397b19b8a3e0ddf9458 (DEFAULT_TABLE table=default.Table_bb7373773a224aeda09e03bdc97470e6 [id=3ef8f771f9df4b9a817e462f14c49d09]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:35.131603 13746 tablet_service.cc:1468] Processing CreateTablet for tablet 7af74bdde363493f8061eba450ecf4b4 (DEFAULT_TABLE table=default.Table_510bdb6808fa48948663ba929c792917 [id=dfa51a12131743428fa066bbe3b6982e]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:35.131700 13462 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 853503f3f98a49219b077af980180400. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:35.131728 13752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e4c5eedb7f4d4397b19b8a3e0ddf9458. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:35.132000 13746 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7af74bdde363493f8061eba450ecf4b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:35.132627 13603 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 04c9d954106a4417a34ff80bc98e2ce8. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:35.134819 13458 tablet_service.cc:1468] Processing CreateTablet for tablet b38c8d003413428dae9e47f58e197c2c (DEFAULT_TABLE table=default.Table_89b4b1b127ef49c1ad0bdff27ca49888 [id=158471c696cd4b4f9265dd006180b74b]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:35.135288 13458 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b38c8d003413428dae9e47f58e197c2c. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:35.138981 13601 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e4c5eedb7f4d4397b19b8a3e0ddf9458. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:35.139066 13233 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_33ea1b44cf33490a86254fee9a48f5b4" } new_table_name: "default.Table_c31165e5edb0449b86fa51f639e07fb6" modify_external_catalogs: true
I20250830 07:54:35.139266 13455 tablet_service.cc:1468] Processing CreateTablet for tablet 30c2558c28944ff39d1a4a4ca9ac604e (DEFAULT_TABLE table=default.Table_878c1e8976de49e599d6240552c2efb8 [id=5bd99792133941ef8175d6f7fbb62251]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:35.139664 13455 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 30c2558c28944ff39d1a4a4ca9ac604e. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:35.140337 13232 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_6e4493316525486e83d2db0082831718" } modify_external_catalogs: true
I20250830 07:54:35.140538 13232 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_6e4493316525486e83d2db0082831718" } modify_external_catalogs: true
I20250830 07:54:35.143013 13607 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6dda55ec2da34c8aba9f39a63e144a7c. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:35.143267 13460 tablet_service.cc:1468] Processing CreateTablet for tablet dbe542c478874482b078296a7a0e9ec9 (DEFAULT_TABLE table=default.Table_ee3b720242cc477ca9273d73d1199ac3 [id=b80ba51884ef4042818f8def0b0ebf0e]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:35.143661 13460 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dbe542c478874482b078296a7a0e9ec9. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:35.147382 13751 tablet_service.cc:1468] Processing CreateTablet for tablet ea8ccd7ef791471291bca049bdf7f643 (DEFAULT_TABLE table=default.Table_a39e6bb297b74c8aa91039717c6ff1d4 [id=3582c72cab4b4e1084021b098ec30f87]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:35.147897 13751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea8ccd7ef791471291bca049bdf7f643. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:35.150554 13229 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_a39e6bb297b74c8aa91039717c6ff1d4" } new_table_name: "default.Table_5ee90d16de544700998619a8b2b71876" modify_external_catalogs: true
I20250830 07:54:35.152182 13234 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_ee3b720242cc477ca9273d73d1199ac3" } new_table_name: "default.Table_0bdc21c4c56b4f00af7f876cd22a42cb" modify_external_catalogs: true
I20250830 07:54:35.152822 13467 tablet_service.cc:1468] Processing CreateTablet for tablet 04c9d954106a4417a34ff80bc98e2ce8 (DEFAULT_TABLE table=default.Table_60f119819df04220a5c92c823e344beb [id=3412e2d7c49b445dbf2c40aaa62d2fee]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:35.153285 13467 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 04c9d954106a4417a34ff80bc98e2ce8. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:35.153858 13228 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_652f3632a7ff4601a8a53939adab6c35"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:35.154381 13228 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_652f3632a7ff4601a8a53939adab6c35 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:35.155692 13466 tablet_service.cc:1468] Processing CreateTablet for tablet ea8ccd7ef791471291bca049bdf7f643 (DEFAULT_TABLE table=default.Table_a39e6bb297b74c8aa91039717c6ff1d4 [id=3582c72cab4b4e1084021b098ec30f87]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:35.155768 13231 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_755878fc02ed4123b6d4a592e1b87a58"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250830 07:54:35.155877 13225 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_8bc1b4ff2943449a8181e5d31f6f4672" } new_table_name: "default.Table_f59f9a045aae424caca65408c4e7809b" modify_external_catalogs: true
I20250830 07:54:35.156037 13466 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea8ccd7ef791471291bca049bdf7f643. 1 dirs total, 0 dirs full, 0 dirs failed
W20250830 07:54:35.156244 13231 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_755878fc02ed4123b6d4a592e1b87a58 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:35.158288 13744 tablet_service.cc:1468] Processing CreateTablet for tablet 853503f3f98a49219b077af980180400 (DEFAULT_TABLE table=default.Table_fcd3d99bd5da4461be0a68789d51d740 [id=09e8bd12743d40b89fb69cc66c035df1]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:35.158416 13745 tablet_service.cc:1468] Processing CreateTablet for tablet ada52626bbc94105a8b9428b0bbdfb5e (DEFAULT_TABLE table=default.Table_57d9ce41d0254969ae072b4c6936f7f2 [id=a219b2ce56d0408c936d6f2462cc6935]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:35.158878 13744 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 853503f3f98a49219b077af980180400. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:35.159138 13745 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ada52626bbc94105a8b9428b0bbdfb5e. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:35.159266 13459 tablet_service.cc:1468] Processing CreateTablet for tablet 6dda55ec2da34c8aba9f39a63e144a7c (DEFAULT_TABLE table=default.Table_4004f71ffe6442a1a90ef09cae4b9d5c [id=2d46bc6ec12347bcac59167fb091dd14]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:35.159628 13459 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6dda55ec2da34c8aba9f39a63e144a7c. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:35.163578 13742 tablet_service.cc:1468] Processing CreateTablet for tablet b38c8d003413428dae9e47f58e197c2c (DEFAULT_TABLE table=default.Table_89b4b1b127ef49c1ad0bdff27ca49888 [id=158471c696cd4b4f9265dd006180b74b]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:35.164157 13742 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b38c8d003413428dae9e47f58e197c2c. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:35.167342 13741 tablet_service.cc:1468] Processing CreateTablet for tablet 30c2558c28944ff39d1a4a4ca9ac604e (DEFAULT_TABLE table=default.Table_878c1e8976de49e599d6240552c2efb8 [id=5bd99792133941ef8175d6f7fbb62251]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:35.167871 13741 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 30c2558c28944ff39d1a4a4ca9ac604e. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:35.167997 14040 raft_consensus.cc:491] T 69f2105c5eeb47e9a848ae7bf8779996 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:35.168135 14040 raft_consensus.cc:513] T 69f2105c5eeb47e9a848ae7bf8779996 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:35.168779 14040 leader_election.cc:290] T 69f2105c5eeb47e9a848ae7bf8779996 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:35.169977 13596 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 30c2558c28944ff39d1a4a4ca9ac604e. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:35.174311 13598 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 853503f3f98a49219b077af980180400. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:35.174362 13227 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_f95d862caa7944469f67bcf46893fa07" } modify_external_catalogs: true
I20250830 07:54:35.174523 13227 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_f95d862caa7944469f67bcf46893fa07" } modify_external_catalogs: true
I20250830 07:54:35.177711 13883 ts_tablet_manager.cc:1918] T 6cf10b7011d444cba0ac758add292477 P 2065c332f15a4739899af79f3669c3ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250830 07:54:35.177842 13883 log.cc:1199] T 6cf10b7011d444cba0ac758add292477 P 2065c332f15a4739899af79f3669c3ba: Deleting WAL directory at /tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/ts-0/wal/wals/6cf10b7011d444cba0ac758add292477
I20250830 07:54:35.178249 13883 ts_tablet_manager.cc:1939] T 6cf10b7011d444cba0ac758add292477 P 2065c332f15a4739899af79f3669c3ba: Deleting consensus metadata
I20250830 07:54:35.178372 13226 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet 6dda55ec2da34c8aba9f39a63e144a7c
I20250830 07:54:35.179093 13226 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_f3971979b013453b8be5865752fc9c03"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250830 07:54:35.179215 13883 tablet_replica.cc:331] T 62cf192967d94ecf954d3e965a4d9c9b P 2065c332f15a4739899af79f3669c3ba: stopping tablet replica
I20250830 07:54:35.179423 13883 raft_consensus.cc:2241] T 62cf192967d94ecf954d3e965a4d9c9b P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Raft consensus shutting down.
I20250830 07:54:35.179585 13883 raft_consensus.cc:2270] T 62cf192967d94ecf954d3e965a4d9c9b P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Raft consensus is shut down!
W20250830 07:54:35.179596 13226 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f3971979b013453b8be5865752fc9c03 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:35.181093 13218 catalog_manager.cc:4928] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): tablet 6cf10b7011d444cba0ac758add292477 (table default.Table_68a8222fb01847ca88079ba1dead8d71 [id=f15ded59e09140d1a284a41572e297a0]) successfully deleted
I20250830 07:54:35.181768 13883 ts_tablet_manager.cc:1905] T 62cf192967d94ecf954d3e965a4d9c9b P 2065c332f15a4739899af79f3669c3ba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250830 07:54:35.187505 13771 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "69f2105c5eeb47e9a848ae7bf8779996" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:35.188222 14167 raft_consensus.cc:491] T 02be33dc658d428fa55e59784a2342f6 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:35.188407 14167 raft_consensus.cc:513] T 02be33dc658d428fa55e59784a2342f6 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
W20250830 07:54:35.188781 13422 leader_election.cc:343] T 69f2105c5eeb47e9a848ae7bf8779996 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:35.189078 14167 leader_election.cc:290] T 02be33dc658d428fa55e59784a2342f6 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
I20250830 07:54:35.189167 13755 tablet_service.cc:1468] Processing CreateTablet for tablet 2be43f828f204f599017b6a04cf2ddf9 (DEFAULT_TABLE table=default.Table_dab1da9ac1584d11b0b0ac9e81748758 [id=cbd8b881bf8a456d9930d5a6b27ab7d4]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:35.189505 13755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2be43f828f204f599017b6a04cf2ddf9. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:35.189891 13485 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "02be33dc658d428fa55e59784a2342f6" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
W20250830 07:54:35.190405 13701 leader_election.cc:343] T 02be33dc658d428fa55e59784a2342f6 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:35.180143 13629 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "69f2105c5eeb47e9a848ae7bf8779996" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
W20250830 07:54:35.191495 13423 leader_election.cc:343] T 69f2105c5eeb47e9a848ae7bf8779996 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:35.191640 13423 leader_election.cc:304] T 69f2105c5eeb47e9a848ae7bf8779996 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba; no voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:54:35.192034 14040 raft_consensus.cc:2747] T 69f2105c5eeb47e9a848ae7bf8779996 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:54:35.195851 13595 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dbe542c478874482b078296a7a0e9ec9. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:35.196379 13628 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "02be33dc658d428fa55e59784a2342f6" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:35.196934 13597 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b38c8d003413428dae9e47f58e197c2c. 1 dirs total, 0 dirs full, 0 dirs failed
W20250830 07:54:35.196883 13703 leader_election.cc:343] T 02be33dc658d428fa55e59784a2342f6 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:35.197043 13703 leader_election.cc:304] T 02be33dc658d428fa55e59784a2342f6 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 2065c332f15a4739899af79f3669c3ba, 6b5e454d98894637b466ea27f1b647f9
I20250830 07:54:35.197433 14167 raft_consensus.cc:2747] T 02be33dc658d428fa55e59784a2342f6 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:54:35.205112 13600 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7af74bdde363493f8061eba450ecf4b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:35.205319 13594 tablet_service.cc:1515] Processing DeleteTablet for tablet 6dda55ec2da34c8aba9f39a63e144a7c with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:35 UTC) from {username='slave'} at 127.0.0.1:45306
W20250830 07:54:35.206780 13220 catalog_manager.cc:4895] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet 6dda55ec2da34c8aba9f39a63e144a7c because the tablet was not found. No further retry: Not found: Tablet not found: 6dda55ec2da34c8aba9f39a63e144a7c
I20250830 07:54:35.207859 13592 tablet_service.cc:1468] Processing CreateTablet for tablet 8dddcfe56522436287aea212e316a729 (DEFAULT_TABLE table=default.Table_8bc1b4ff2943449a8181e5d31f6f4672 [id=c483c08824f24586855e3575a590b294]), partition=RANGE (key) PARTITION UNBOUNDED
W20250830 07:54:35.213891 13234 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet dbe542c478874482b078296a7a0e9ec9 consensus state has no leader
I20250830 07:54:35.214294 13234 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_af9972a41d74405e9c2896ec5d2a227c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:35.214869 13234 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_af9972a41d74405e9c2896ec5d2a227c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:35.215234 13592 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8dddcfe56522436287aea212e316a729. 1 dirs total, 0 dirs full, 0 dirs failed
W20250830 07:54:35.216318 13229 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ea8ccd7ef791471291bca049bdf7f643 consensus state has no leader
W20250830 07:54:35.217192 13233 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 8f215330505848619ad44569d3167591 consensus state has no leader
I20250830 07:54:35.217579 13232 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet a41c1455404f4ed0a782a0c4ddd4140d
I20250830 07:54:35.219429 13230 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet d912c69d8722403aa56cbbde4ce59782
I20250830 07:54:35.220320 14167 raft_consensus.cc:491] T 4c2c85732d454cd98efc2646af9450ed P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:35.220460 14167 raft_consensus.cc:513] T 4c2c85732d454cd98efc2646af9450ed P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:35.220674 13594 tablet_service.cc:1468] Processing CreateTablet for tablet e862fa77e16945bd94e405aa3474f021 (DEFAULT_TABLE table=default.Table_dc8dc313f9fb46d3bd2a8e79c8d2102f [id=00ec67ef5b344c2cb78378851b106cb5]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:35.221052 14167 leader_election.cc:290] T 4c2c85732d454cd98efc2646af9450ed P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967)
I20250830 07:54:35.221383 13594 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e862fa77e16945bd94e405aa3474f021. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:35.221794 13628 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "4c2c85732d454cd98efc2646af9450ed" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:35.222023 13628 raft_consensus.cc:2466] T 4c2c85732d454cd98efc2646af9450ed P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 0.
I20250830 07:54:35.222379 13486 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "4c2c85732d454cd98efc2646af9450ed" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:54:35.222489 13703 leader_election.cc:304] T 4c2c85732d454cd98efc2646af9450ed P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f; no voters:
I20250830 07:54:35.222597 13486 raft_consensus.cc:2466] T 4c2c85732d454cd98efc2646af9450ed P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 0.
I20250830 07:54:35.222756 14167 raft_consensus.cc:2802] T 4c2c85732d454cd98efc2646af9450ed P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:54:35.222870 14167 raft_consensus.cc:491] T 4c2c85732d454cd98efc2646af9450ed P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:54:35.222977 14167 raft_consensus.cc:3058] T 4c2c85732d454cd98efc2646af9450ed P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:35.225948 14167 raft_consensus.cc:513] T 4c2c85732d454cd98efc2646af9450ed P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:35.215353 13593 tablet_service.cc:1468] Processing CreateTablet for tablet ffc5945a032e47d4bd3397d7c887dc62 (DEFAULT_TABLE table=default.Table_857dfeec2d2644ebb4f2674ca8df8b89 [id=4019fb254763489b855ced05cca3311b]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:35.230288 13452 tablet_service.cc:1468] Processing CreateTablet for tablet cb3c48982add45379c0e1b117ec40c1a (DEFAULT_TABLE table=default.Table_3041c77b19f5443ea4437fda4fdf0799 [id=d9cd99eacc86401783d526105ba687d4]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:35.230536 13454 tablet_service.cc:1468] Processing CreateTablet for tablet e862fa77e16945bd94e405aa3474f021 (DEFAULT_TABLE table=default.Table_dc8dc313f9fb46d3bd2a8e79c8d2102f [id=00ec67ef5b344c2cb78378851b106cb5]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:35.230816 14167 leader_election.cc:290] T 4c2c85732d454cd98efc2646af9450ed P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Requested vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967)
I20250830 07:54:35.231057 13453 tablet_service.cc:1468] Processing CreateTablet for tablet 8f215330505848619ad44569d3167591 (DEFAULT_TABLE table=default.Table_c31165e5edb0449b86fa51f639e07fb6 [id=a860b17c62ce47268c30d1b62e91eae8]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:35.231294 14040 raft_consensus.cc:491] T 6f4c400c0e5e43319fa521b5cab694b4 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:35.231454 14040 raft_consensus.cc:513] T 6f4c400c0e5e43319fa521b5cab694b4 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:35.232159 14040 leader_election.cc:290] T 6f4c400c0e5e43319fa521b5cab694b4 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:35.242340 13771 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "6f4c400c0e5e43319fa521b5cab694b4" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:35.242539 13629 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "6f4c400c0e5e43319fa521b5cab694b4" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:35.243492 13467 tablet_service.cc:1468] Processing CreateTablet for tablet 8dddcfe56522436287aea212e316a729 (DEFAULT_TABLE table=default.Table_8bc1b4ff2943449a8181e5d31f6f4672 [id=c483c08824f24586855e3575a590b294]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:35.244166 13460 tablet_service.cc:1515] Processing DeleteTablet for tablet d912c69d8722403aa56cbbde4ce59782 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:35 UTC) from {username='slave'} at 127.0.0.1:37956
I20250830 07:54:35.244513 13464 tablet_service.cc:1515] Processing DeleteTablet for tablet 6dda55ec2da34c8aba9f39a63e144a7c with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:35 UTC) from {username='slave'} at 127.0.0.1:37956
I20250830 07:54:35.245155 13462 tablet_service.cc:1468] Processing CreateTablet for tablet ffc5945a032e47d4bd3397d7c887dc62 (DEFAULT_TABLE table=default.Table_857dfeec2d2644ebb4f2674ca8df8b89 [id=4019fb254763489b855ced05cca3311b]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:35.245692 13457 tablet_service.cc:1468] Processing CreateTablet for tablet 752727eef0734ff3b7b35b1d5f66aea6 (DEFAULT_TABLE table=default.Table_3566feeff7cd468093b299f2cc07abd6 [id=a7aed44b83c44611ae89a1f3a1a158c3]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:35.247212 13463 tablet_service.cc:1515] Processing DeleteTablet for tablet a41c1455404f4ed0a782a0c4ddd4140d with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:35 UTC) from {username='slave'} at 127.0.0.1:37956
I20250830 07:54:35.247680 13604 tablet_service.cc:1468] Processing CreateTablet for tablet 14ed24577c8f49f49c83242a26877614 (DEFAULT_TABLE table=default.Table_c9397e64edef4d31a5a4eded8ebe365c [id=bcee72f9b1c6407f98435a1494b42407]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:35.247721 13464 tablet_service.cc:1468] Processing CreateTablet for tablet 69d6daeb7c774fd48ed296f52ed7c6a6 (DEFAULT_TABLE table=default.Table_c8fac6974ea94c7e863c1ded184f9230 [id=761247d93d9f4f788ecceabebf1de486]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:35.247962 13451 tablet_service.cc:1468] Processing CreateTablet for tablet f56cab43580a4ee3a912fc5e58a3bd9d (DEFAULT_TABLE table=default.Table_ab15c29b389643c5a0603f49cc80372e [id=6fc5c53b47c24f8283191be07f6f3cb1]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:35.248219 13460 tablet_service.cc:1468] Processing CreateTablet for tablet 533811110191436d96665b3475ab597f (DEFAULT_TABLE table=default.Table_f61db5d7fd4a41d19d96612681e52b96 [id=8e787419bd7d410bb7543030164b402b]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:35.248785 13601 tablet_service.cc:1515] Processing DeleteTablet for tablet a41c1455404f4ed0a782a0c4ddd4140d with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:35 UTC) from {username='slave'} at 127.0.0.1:45306
I20250830 07:54:35.248744 13455 tablet_service.cc:1468] Processing CreateTablet for tablet 04eadf45b82e4c319eb7b316a402d81a (DEFAULT_TABLE table=default.Table_0333c6737081432b8064661a28804d23 [id=c2a3dee1feb24d2dbd795702714970ce]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:35.248977 13629 raft_consensus.cc:2391] T 6f4c400c0e5e43319fa521b5cab694b4 P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2065c332f15a4739899af79f3669c3ba in current term 1: Already voted for candidate 9b057ade5dce45af9f8bf0bedf8b917f in this term.
I20250830 07:54:35.250923 13463 tablet_service.cc:1468] Processing CreateTablet for tablet 99f307a8cbb34addaafab82b3ed18241 (DEFAULT_TABLE table=default.Table_4e2c5e0840fe4d3398519818e193f4dd [id=2a10f84461764fd5ab5a59499a370034]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:35.251875 13228 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_d64f4859d76f4310a74cddb0fded0771"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:35.252447 13228 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d64f4859d76f4310a74cddb0fded0771 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:35.253654 13230 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_aaa473768ea54b76aa309b0ce75757fa" } new_table_name: "default.Table_fa3320a90acd4443936458d7ad7e1bdc" modify_external_catalogs: true
I20250830 07:54:35.253875 13423 leader_election.cc:304] T 6f4c400c0e5e43319fa521b5cab694b4 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba; no voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:54:35.254256 14027 leader_election.cc:290] T dfccff3bd0cb4c7d998633b015de3cfa P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 election: Requested vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:35.254285 14040 raft_consensus.cc:3058] T 6f4c400c0e5e43319fa521b5cab694b4 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:35.254796 14167 raft_consensus.cc:491] T 50360492db824755a6de251436cab5c6 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:35.254941 14167 raft_consensus.cc:513] T 50360492db824755a6de251436cab5c6 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:35.257799 14040 raft_consensus.cc:2747] T 6f4c400c0e5e43319fa521b5cab694b4 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:54:35.259455 13450 tablet_service.cc:1468] Processing CreateTablet for tablet cf5613278b4c4f3bbe751b1ae6f3c313 (DEFAULT_TABLE table=default.Table_decad1c6025c4be0aa3aa8fea4ca31be [id=845167daf17e4719a0405c5856ea3c02]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:35.260793 13449 tablet_service.cc:1468] Processing CreateTablet for tablet 73853894da074ecd8147a94ac28bfab8 (DEFAULT_TABLE table=default.Table_fc6a95f74a1d457d9b5b3b6a6345b834 [id=b983c24ca8174434b0e2c276a9b93495]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:35.261582 13609 tablet_service.cc:1515] Processing DeleteTablet for tablet d912c69d8722403aa56cbbde4ce59782 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:35 UTC) from {username='slave'} at 127.0.0.1:45306
I20250830 07:54:35.259469 13628 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "4c2c85732d454cd98efc2646af9450ed" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9"
I20250830 07:54:35.262385 13604 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 14ed24577c8f49f49c83242a26877614. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:35.262713 13595 tablet_service.cc:1468] Processing CreateTablet for tablet 8f215330505848619ad44569d3167591 (DEFAULT_TABLE table=default.Table_c31165e5edb0449b86fa51f639e07fb6 [id=a860b17c62ce47268c30d1b62e91eae8]), partition=RANGE (key) PARTITION UNBOUNDED
W20250830 07:54:35.263731 13225 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 8dddcfe56522436287aea212e316a729 consensus state has no leader
I20250830 07:54:35.263852 13884 raft_consensus.cc:2241] T 62cf192967d94ecf954d3e965a4d9c9b P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Raft consensus shutting down.
I20250830 07:54:35.264124 13884 raft_consensus.cc:2270] T 62cf192967d94ecf954d3e965a4d9c9b P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Raft consensus is shut down!
I20250830 07:54:35.265448 13227 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet c12cf30cc2aa4e12a20b9492af08a6f8
I20250830 07:54:35.267516 13226 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_6dcce54cec804290914ca3bf2135c880"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:35.268208 13226 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6dcce54cec804290914ca3bf2135c880 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:35.269979 13601 tablet_service.cc:1468] Processing CreateTablet for tablet cb3c48982add45379c0e1b117ec40c1a (DEFAULT_TABLE table=default.Table_3041c77b19f5443ea4437fda4fdf0799 [id=d9cd99eacc86401783d526105ba687d4]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:35.270557 13884 ts_tablet_manager.cc:1905] T 62cf192967d94ecf954d3e965a4d9c9b P 9b057ade5dce45af9f8bf0bedf8b917f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250830 07:54:35.273638 14167 leader_election.cc:290] T 50360492db824755a6de251436cab5c6 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
I20250830 07:54:35.275520 13628 raft_consensus.cc:3058] T 4c2c85732d454cd98efc2646af9450ed P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:35.281739 13954 raft_consensus.cc:695] T 1933d49d319b4bd7b717dda2b83859f3 P 2065c332f15a4739899af79f3669c3ba [term 1 LEADER]: Becoming Leader. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Running, Role: LEADER
I20250830 07:54:35.282155 13954 consensus_queue.cc:237] T 1933d49d319b4bd7b717dda2b83859f3 P 2065c332f15a4739899af79f3669c3ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:35.282269 13227 catalog_manager.cc:5674] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743) does not have the latest schema for tablet d0238794efb14150af6138b0d8bd80ec (table default.Table_4d93a3d083764fedb28fcf469ae96c80 [id=8628f6e9686d43b6aa84cd3202db8e80]). Expected version 1 got 0
I20250830 07:54:35.284615 13599 tablet_service.cc:1468] Processing CreateTablet for tablet 533811110191436d96665b3475ab597f (DEFAULT_TABLE table=default.Table_f61db5d7fd4a41d19d96612681e52b96 [id=8e787419bd7d410bb7543030164b402b]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:35.285015 13590 tablet_service.cc:1468] Processing CreateTablet for tablet 99f307a8cbb34addaafab82b3ed18241 (DEFAULT_TABLE table=default.Table_4e2c5e0840fe4d3398519818e193f4dd [id=2a10f84461764fd5ab5a59499a370034]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:35.286191 13227 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_147915363787467ea640b4240b6fd5a2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250830 07:54:35.286266 13225 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_f2ddc7e5b82f44aabe9060d952e758d7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:35.286718 13227 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_147915363787467ea640b4240b6fd5a2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250830 07:54:35.286778 13225 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f2ddc7e5b82f44aabe9060d952e758d7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250830 07:54:35.288326 13231 catalog_manager.cc:5415] Ignoring report from unknown tablet d876f6259bd94799a4e37dc9d14b8efe
W20250830 07:54:35.288444 13231 catalog_manager.cc:5415] Ignoring report from unknown tablet 508ce3cc87734e5b8cec40e74522549a
I20250830 07:54:35.288926 13593 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ffc5945a032e47d4bd3397d7c887dc62. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:35.288324 13232 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_70545768e27a4371965785132ad85c9c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:35.290150 13232 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_70545768e27a4371965785132ad85c9c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250830 07:54:35.292001 13230 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 007435e198b9440db055711a98e3148a consensus state has no leader
I20250830 07:54:35.296509 13609 tablet_service.cc:1468] Processing CreateTablet for tablet 69d6daeb7c774fd48ed296f52ed7c6a6 (DEFAULT_TABLE table=default.Table_c8fac6974ea94c7e863c1ded184f9230 [id=761247d93d9f4f788ecceabebf1de486]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:35.297124 13230 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_fc6a95f74a1d457d9b5b3b6a6345b834" } modify_external_catalogs: true
I20250830 07:54:35.297343 13230 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_fc6a95f74a1d457d9b5b3b6a6345b834" } modify_external_catalogs: true
W20250830 07:54:35.299728 13703 leader_election.cc:343] T 50360492db824755a6de251436cab5c6 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Not found: Tablet not found: 50360492db824755a6de251436cab5c6
I20250830 07:54:35.301719 13883 ts_tablet_manager.cc:1918] T 62cf192967d94ecf954d3e965a4d9c9b P 2065c332f15a4739899af79f3669c3ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
W20250830 07:54:35.302632 13701 leader_election.cc:343] T 50360492db824755a6de251436cab5c6 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): Not found: Tablet not found: 50360492db824755a6de251436cab5c6
I20250830 07:54:35.302785 13701 leader_election.cc:304] T 50360492db824755a6de251436cab5c6 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 2065c332f15a4739899af79f3669c3ba, 6b5e454d98894637b466ea27f1b647f9
I20250830 07:54:35.303134 13601 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb3c48982add45379c0e1b117ec40c1a. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:35.303447 14167 raft_consensus.cc:2747] T 50360492db824755a6de251436cab5c6 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:54:35.303894 13609 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 69d6daeb7c774fd48ed296f52ed7c6a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:35.305189 13599 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 533811110191436d96665b3475ab597f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:35.302237 13485 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "4c2c85732d454cd98efc2646af9450ed" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba"
I20250830 07:54:35.305617 13485 raft_consensus.cc:3058] T 4c2c85732d454cd98efc2646af9450ed P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:35.305725 13468 tablet_service.cc:1468] Processing CreateTablet for tablet 53a933afa4b74095baf0f54736d99bf0 (DEFAULT_TABLE table=default.Table_d601d7d0f55744e5b227aa7b31516c20 [id=e9e95cc7dbe94eadae3a118c44143363]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:35.305862 13590 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 99f307a8cbb34addaafab82b3ed18241. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:35.306392 13458 tablet_service.cc:1515] Processing DeleteTablet for tablet c12cf30cc2aa4e12a20b9492af08a6f8 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:35 UTC) from {username='slave'} at 127.0.0.1:37956
I20250830 07:54:35.306798 13458 tablet_service.cc:1468] Processing CreateTablet for tablet 007435e198b9440db055711a98e3148a (DEFAULT_TABLE table=default.Table_aaa473768ea54b76aa309b0ce75757fa [id=0f52bd27a789427991f55bcb0527cf54]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:35.306990 13595 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8f215330505848619ad44569d3167591. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:35.307845 13459 tablet_service.cc:1468] Processing CreateTablet for tablet 0507245aa8c74aeb9f3eafba0682590d (DEFAULT_TABLE table=default.Table_12c9ea9f75c24214838d600088c31bcf [id=b51964a7d7d14d6db2fd35783c905bbc]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:35.308568 13485 raft_consensus.cc:2466] T 4c2c85732d454cd98efc2646af9450ed P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 1.
I20250830 07:54:35.303468 13451 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f56cab43580a4ee3a912fc5e58a3bd9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:35.309337 13459 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0507245aa8c74aeb9f3eafba0682590d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:35.310576 13591 tablet_service.cc:1468] Processing CreateTablet for tablet 04eadf45b82e4c319eb7b316a402d81a (DEFAULT_TABLE table=default.Table_0333c6737081432b8064661a28804d23 [id=c2a3dee1feb24d2dbd795702714970ce]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:35.311621 13598 tablet_service.cc:1468] Processing CreateTablet for tablet f56cab43580a4ee3a912fc5e58a3bd9d (DEFAULT_TABLE table=default.Table_ab15c29b389643c5a0603f49cc80372e [id=6fc5c53b47c24f8283191be07f6f3cb1]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:35.314468 13468 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 53a933afa4b74095baf0f54736d99bf0. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:35.304941 13465 tablet_service.cc:1468] Processing CreateTablet for tablet d3f207cee78a43a1b5e030c09752c78c (DEFAULT_TABLE table=default.Table_fa378b7e7c574b23b77d462d15d5313e [id=ffc4e5fdd93b4909b2cbcd8daf6d7a2a]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:35.315415 13465 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3f207cee78a43a1b5e030c09752c78c. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:35.318854 13598 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f56cab43580a4ee3a912fc5e58a3bd9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:35.320349 13454 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e862fa77e16945bd94e405aa3474f021. 1 dirs total, 0 dirs full, 0 dirs failed
W20250830 07:54:35.322039 13220 catalog_manager.cc:4895] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet a41c1455404f4ed0a782a0c4ddd4140d because the tablet was not found. No further retry: Not found: Tablet not found: a41c1455404f4ed0a782a0c4ddd4140d
I20250830 07:54:35.322398 13607 tablet_service.cc:1468] Processing CreateTablet for tablet cf5613278b4c4f3bbe751b1ae6f3c313 (DEFAULT_TABLE table=default.Table_decad1c6025c4be0aa3aa8fea4ca31be [id=845167daf17e4719a0405c5856ea3c02]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:35.323202 13701 leader_election.cc:304] T 4c2c85732d454cd98efc2646af9450ed P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters:
I20250830 07:54:35.323333 13453 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8f215330505848619ad44569d3167591. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:35.323498 14167 raft_consensus.cc:2802] T 4c2c85732d454cd98efc2646af9450ed P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election won for term 1
I20250830 07:54:35.323609 14167 raft_consensus.cc:695] T 4c2c85732d454cd98efc2646af9450ed P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 LEADER]: Becoming Leader. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Running, Role: LEADER
I20250830 07:54:35.323873 14167 consensus_queue.cc:237] T 4c2c85732d454cd98efc2646af9450ed P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
W20250830 07:54:35.324537 13220 catalog_manager.cc:4908] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet d912c69d8722403aa56cbbde4ce59782 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d912c69d8722403aa56cbbde4ce59782 already in progress: creating tablet
I20250830 07:54:35.326591 13883 log.cc:1199] T 62cf192967d94ecf954d3e965a4d9c9b P 2065c332f15a4739899af79f3669c3ba: Deleting WAL directory at /tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/ts-0/wal/wals/62cf192967d94ecf954d3e965a4d9c9b
I20250830 07:54:35.326934 13883 ts_tablet_manager.cc:1939] T 62cf192967d94ecf954d3e965a4d9c9b P 2065c332f15a4739899af79f3669c3ba: Deleting consensus metadata
I20250830 07:54:35.327283 13449 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73853894da074ecd8147a94ac28bfab8. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:35.330651 13591 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 04eadf45b82e4c319eb7b316a402d81a. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:35.331290 13452 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb3c48982add45379c0e1b117ec40c1a. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:35.335368 13462 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ffc5945a032e47d4bd3397d7c887dc62. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:35.336150 13450 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf5613278b4c4f3bbe751b1ae6f3c313. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:35.339147 13467 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8dddcfe56522436287aea212e316a729. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:35.348337 13883 tablet_replica.cc:331] T 69f2105c5eeb47e9a848ae7bf8779996 P 2065c332f15a4739899af79f3669c3ba: stopping tablet replica
I20250830 07:54:35.349699 13607 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf5613278b4c4f3bbe751b1ae6f3c313. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:35.351075 13460 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 533811110191436d96665b3475ab597f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:35.353221 13603 tablet_service.cc:1468] Processing CreateTablet for tablet 007435e198b9440db055711a98e3148a (DEFAULT_TABLE table=default.Table_aaa473768ea54b76aa309b0ce75757fa [id=0f52bd27a789427991f55bcb0527cf54]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:35.353696 13603 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 007435e198b9440db055711a98e3148a. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:35.354307 13605 tablet_service.cc:1468] Processing CreateTablet for tablet d3f207cee78a43a1b5e030c09752c78c (DEFAULT_TABLE table=default.Table_fa378b7e7c574b23b77d462d15d5313e [id=ffc4e5fdd93b4909b2cbcd8daf6d7a2a]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:35.354698 13605 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3f207cee78a43a1b5e030c09752c78c. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:35.355665 13464 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 69d6daeb7c774fd48ed296f52ed7c6a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:35.356560 13608 tablet_service.cc:1468] Processing CreateTablet for tablet 73853894da074ecd8147a94ac28bfab8 (DEFAULT_TABLE table=default.Table_fc6a95f74a1d457d9b5b3b6a6345b834 [id=b983c24ca8174434b0e2c276a9b93495]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:35.361243 14167 raft_consensus.cc:491] T c9a8f144d50c4d3d81fbf43ce29a2ad2 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:35.361483 14167 raft_consensus.cc:513] T c9a8f144d50c4d3d81fbf43ce29a2ad2 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:35.362257 14167 leader_election.cc:290] T c9a8f144d50c4d3d81fbf43ce29a2ad2 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967)
I20250830 07:54:35.362658 13485 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "c9a8f144d50c4d3d81fbf43ce29a2ad2" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:54:35.363145 13629 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "c9a8f144d50c4d3d81fbf43ce29a2ad2" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
W20250830 07:54:35.363186 13701 leader_election.cc:343] T c9a8f144d50c4d3d81fbf43ce29a2ad2 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:35.363384 13629 raft_consensus.cc:2466] T c9a8f144d50c4d3d81fbf43ce29a2ad2 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 0.
I20250830 07:54:35.364121 13703 leader_election.cc:304] T c9a8f144d50c4d3d81fbf43ce29a2ad2 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 2065c332f15a4739899af79f3669c3ba
I20250830 07:54:35.364468 14167 raft_consensus.cc:2802] T c9a8f144d50c4d3d81fbf43ce29a2ad2 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:54:35.364562 14167 raft_consensus.cc:491] T c9a8f144d50c4d3d81fbf43ce29a2ad2 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:54:35.364672 14167 raft_consensus.cc:3058] T c9a8f144d50c4d3d81fbf43ce29a2ad2 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:35.368682 14167 raft_consensus.cc:513] T c9a8f144d50c4d3d81fbf43ce29a2ad2 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:35.369407 14167 leader_election.cc:290] T c9a8f144d50c4d3d81fbf43ce29a2ad2 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Requested vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967)
I20250830 07:54:35.369716 13485 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "c9a8f144d50c4d3d81fbf43ce29a2ad2" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba"
W20250830 07:54:35.370198 13701 leader_election.cc:343] T c9a8f144d50c4d3d81fbf43ce29a2ad2 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:35.373760 13608 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73853894da074ecd8147a94ac28bfab8. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:35.379699 13457 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 752727eef0734ff3b7b35b1d5f66aea6. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:35.383208 13455 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 04eadf45b82e4c319eb7b316a402d81a. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:35.396476 13458 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 007435e198b9440db055711a98e3148a. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:35.399703 13463 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 99f307a8cbb34addaafab82b3ed18241. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:35.409359 14038 consensus_queue.cc:1035] T f53e7423d1f54566a667195f7cf5e1ce P 2065c332f15a4739899af79f3669c3ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20250830 07:54:35.414230 13602 tablet_service.cc:1468] Processing CreateTablet for tablet 53a933afa4b74095baf0f54736d99bf0 (DEFAULT_TABLE table=default.Table_d601d7d0f55744e5b227aa7b31516c20 [id=e9e95cc7dbe94eadae3a118c44143363]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:35.414796 13602 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 53a933afa4b74095baf0f54736d99bf0. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:35.412271 13629 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "c9a8f144d50c4d3d81fbf43ce29a2ad2" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9"
I20250830 07:54:35.426232 13883 raft_consensus.cc:2241] T 69f2105c5eeb47e9a848ae7bf8779996 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Raft consensus shutting down.
I20250830 07:54:35.427320 13883 raft_consensus.cc:2270] T 69f2105c5eeb47e9a848ae7bf8779996 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Raft consensus is shut down!
I20250830 07:54:35.427556 13629 raft_consensus.cc:3058] T c9a8f144d50c4d3d81fbf43ce29a2ad2 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:35.427909 13883 ts_tablet_manager.cc:1905] T 69f2105c5eeb47e9a848ae7bf8779996 P 2065c332f15a4739899af79f3669c3ba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250830 07:54:35.430014 13594 tablet_service.cc:1515] Processing DeleteTablet for tablet c12cf30cc2aa4e12a20b9492af08a6f8 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:35 UTC) from {username='slave'} at 127.0.0.1:45306
I20250830 07:54:35.433102 13885 tablet_replica.cc:331] T c12cf30cc2aa4e12a20b9492af08a6f8 P 6b5e454d98894637b466ea27f1b647f9: stopping tablet replica
I20250830 07:54:35.433377 13885 raft_consensus.cc:2241] T c12cf30cc2aa4e12a20b9492af08a6f8 P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250830 07:54:35.433610 13885 raft_consensus.cc:2270] T c12cf30cc2aa4e12a20b9492af08a6f8 P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250830 07:54:35.434242 13885 ts_tablet_manager.cc:1905] T c12cf30cc2aa4e12a20b9492af08a6f8 P 6b5e454d98894637b466ea27f1b647f9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250830 07:54:35.438764 13886 tablet_bootstrap.cc:492] T 6cf10b7011d444cba0ac758add292477 P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:54:35.439042 13886 ts_tablet_manager.cc:1397] T 6cf10b7011d444cba0ac758add292477 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.365s user 0.003s sys 0.003s
I20250830 07:54:35.444833 14023 consensus_queue.cc:1035] T 18afeddd2c0642028f93a16323b6e849 P 6b5e454d98894637b466ea27f1b647f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:54:35.450822 13628 raft_consensus.cc:2466] T 4c2c85732d454cd98efc2646af9450ed P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 1.
W20250830 07:54:35.458572 13423 consensus_peers.cc:489] T c12cf30cc2aa4e12a20b9492af08a6f8 P 2065c332f15a4739899af79f3669c3ba -> Peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Couldn't send request to peer 6b5e454d98894637b466ea27f1b647f9. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20250830 07:54:35.462126 13887 tablet_bootstrap.cc:492] T c9a8f144d50c4d3d81fbf43ce29a2ad2 P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:54:35.462284 13887 ts_tablet_manager.cc:1397] T c9a8f144d50c4d3d81fbf43ce29a2ad2 P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.529s user 0.003s sys 0.002s
I20250830 07:54:35.463147 13887 raft_consensus.cc:357] T c9a8f144d50c4d3d81fbf43ce29a2ad2 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:35.463363 13887 raft_consensus.cc:383] T c9a8f144d50c4d3d81fbf43ce29a2ad2 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:35.463451 13887 raft_consensus.cc:738] T c9a8f144d50c4d3d81fbf43ce29a2ad2 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:54:35.463701 13887 consensus_queue.cc:260] T c9a8f144d50c4d3d81fbf43ce29a2ad2 P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:35.464275 13887 ts_tablet_manager.cc:1428] T c9a8f144d50c4d3d81fbf43ce29a2ad2 P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20250830 07:54:35.464589 13887 tablet_bootstrap.cc:492] T d3b47314f7cd4e969d973c0a340137f1 P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:54:35.470935 13887 tablet_bootstrap.cc:654] T d3b47314f7cd4e969d973c0a340137f1 P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:35.478475 13887 tablet_bootstrap.cc:492] T d3b47314f7cd4e969d973c0a340137f1 P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:54:35.478647 13887 ts_tablet_manager.cc:1397] T d3b47314f7cd4e969d973c0a340137f1 P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.014s user 0.000s sys 0.003s
I20250830 07:54:35.481019 13887 raft_consensus.cc:357] T d3b47314f7cd4e969d973c0a340137f1 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:35.481230 13887 raft_consensus.cc:383] T d3b47314f7cd4e969d973c0a340137f1 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:35.481308 13887 raft_consensus.cc:738] T d3b47314f7cd4e969d973c0a340137f1 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:54:35.483460 13887 consensus_queue.cc:260] T d3b47314f7cd4e969d973c0a340137f1 P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:35.485497 13887 ts_tablet_manager.cc:1428] T d3b47314f7cd4e969d973c0a340137f1 P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.007s user 0.002s sys 0.001s
I20250830 07:54:35.487243 13887 tablet_bootstrap.cc:492] T 2afb1e75cfcc4e1abd265fbadb4170fa P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:54:35.488822 13629 raft_consensus.cc:2466] T c9a8f144d50c4d3d81fbf43ce29a2ad2 P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 1.
I20250830 07:54:35.492347 13887 tablet_bootstrap.cc:654] T 2afb1e75cfcc4e1abd265fbadb4170fa P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:35.496227 13703 leader_election.cc:304] T c9a8f144d50c4d3d81fbf43ce29a2ad2 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 2065c332f15a4739899af79f3669c3ba
I20250830 07:54:35.496645 14167 raft_consensus.cc:2802] T c9a8f144d50c4d3d81fbf43ce29a2ad2 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election won for term 1
I20250830 07:54:35.496858 14167 raft_consensus.cc:695] T c9a8f144d50c4d3d81fbf43ce29a2ad2 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 LEADER]: Becoming Leader. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Running, Role: LEADER
I20250830 07:54:35.496984 13887 tablet_bootstrap.cc:492] T 2afb1e75cfcc4e1abd265fbadb4170fa P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:54:35.497130 13887 ts_tablet_manager.cc:1397] T 2afb1e75cfcc4e1abd265fbadb4170fa P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.011s user 0.001s sys 0.001s
I20250830 07:54:35.497192 14167 consensus_queue.cc:237] T c9a8f144d50c4d3d81fbf43ce29a2ad2 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:35.497895 13887 raft_consensus.cc:357] T 2afb1e75cfcc4e1abd265fbadb4170fa P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:35.498061 13887 raft_consensus.cc:383] T 2afb1e75cfcc4e1abd265fbadb4170fa P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:35.502813 13887 raft_consensus.cc:738] T 2afb1e75cfcc4e1abd265fbadb4170fa P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:54:35.503417 13887 consensus_queue.cc:260] T 2afb1e75cfcc4e1abd265fbadb4170fa P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:35.504962 14023 consensus_queue.cc:1035] T 18afeddd2c0642028f93a16323b6e849 P 6b5e454d98894637b466ea27f1b647f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:54:35.505625 13887 ts_tablet_manager.cc:1428] T 2afb1e75cfcc4e1abd265fbadb4170fa P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.008s user 0.002s sys 0.000s
I20250830 07:54:35.505918 13887 tablet_bootstrap.cc:492] T 02be33dc658d428fa55e59784a2342f6 P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:54:35.507711 13885 ts_tablet_manager.cc:1918] T c12cf30cc2aa4e12a20b9492af08a6f8 P 6b5e454d98894637b466ea27f1b647f9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250830 07:54:35.507922 13885 log.cc:1199] T c12cf30cc2aa4e12a20b9492af08a6f8 P 6b5e454d98894637b466ea27f1b647f9: Deleting WAL directory at /tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/ts-1/wal/wals/c12cf30cc2aa4e12a20b9492af08a6f8
I20250830 07:54:35.508491 13885 ts_tablet_manager.cc:1939] T c12cf30cc2aa4e12a20b9492af08a6f8 P 6b5e454d98894637b466ea27f1b647f9: Deleting consensus metadata
I20250830 07:54:35.513582 13886 raft_consensus.cc:357] T 6cf10b7011d444cba0ac758add292477 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:35.513809 13886 raft_consensus.cc:383] T 6cf10b7011d444cba0ac758add292477 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:35.513901 13886 raft_consensus.cc:738] T 6cf10b7011d444cba0ac758add292477 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:54:35.514127 13887 tablet_bootstrap.cc:654] T 02be33dc658d428fa55e59784a2342f6 P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:35.514155 13886 consensus_queue.cc:260] T 6cf10b7011d444cba0ac758add292477 P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:35.514590 13886 ts_tablet_manager.cc:1428] T 6cf10b7011d444cba0ac758add292477 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.075s user 0.000s sys 0.000s
I20250830 07:54:35.514952 13886 tablet_bootstrap.cc:492] T 69f2105c5eeb47e9a848ae7bf8779996 P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:54:35.516458 13886 tablet_bootstrap.cc:654] T 69f2105c5eeb47e9a848ae7bf8779996 P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:35.519876 13886 tablet_bootstrap.cc:492] T 69f2105c5eeb47e9a848ae7bf8779996 P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:54:35.520008 13886 ts_tablet_manager.cc:1397] T 69f2105c5eeb47e9a848ae7bf8779996 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.003s
I20250830 07:54:35.521137 13886 raft_consensus.cc:357] T 69f2105c5eeb47e9a848ae7bf8779996 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:35.521327 13886 raft_consensus.cc:383] T 69f2105c5eeb47e9a848ae7bf8779996 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:35.521421 13886 raft_consensus.cc:738] T 69f2105c5eeb47e9a848ae7bf8779996 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:54:35.521648 13886 consensus_queue.cc:260] T 69f2105c5eeb47e9a848ae7bf8779996 P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:35.522405 13886 ts_tablet_manager.cc:1428] T 69f2105c5eeb47e9a848ae7bf8779996 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20250830 07:54:35.522691 13886 tablet_bootstrap.cc:492] T d3b47314f7cd4e969d973c0a340137f1 P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:54:35.524338 13886 tablet_bootstrap.cc:654] T d3b47314f7cd4e969d973c0a340137f1 P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
W20250830 07:54:35.525164 13882 thread.cc:641] log-alloc [worker] (thread pool) Time spent creating pthread: real 0.618s user 0.099s sys 0.316s
W20250830 07:54:35.525266 13882 thread.cc:608] log-alloc [worker] (thread pool) Time spent starting thread: real 0.618s user 0.099s sys 0.316s
I20250830 07:54:35.527319 13882 tablet_bootstrap.cc:492] T d3b47314f7cd4e969d973c0a340137f1 P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:54:35.527475 13882 ts_tablet_manager.cc:1397] T d3b47314f7cd4e969d973c0a340137f1 P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.623s user 0.099s sys 0.316s
I20250830 07:54:35.528287 13882 raft_consensus.cc:357] T d3b47314f7cd4e969d973c0a340137f1 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:35.528508 13882 raft_consensus.cc:383] T d3b47314f7cd4e969d973c0a340137f1 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:35.528620 13882 raft_consensus.cc:738] T d3b47314f7cd4e969d973c0a340137f1 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
W20250830 07:54:35.528934 13627 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.586s user 0.010s sys 0.004s
I20250830 07:54:35.528908 13882 consensus_queue.cc:260] T d3b47314f7cd4e969d973c0a340137f1 P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:35.531678 13218 catalog_manager.cc:4928] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): tablet 62cf192967d94ecf954d3e965a4d9c9b (table default.Table_fc6a95f74a1d457d9b5b3b6a6345b834 [id=b983c24ca8174434b0e2c276a9b93495]) successfully deleted
I20250830 07:54:35.532364 13887 tablet_bootstrap.cc:492] T 02be33dc658d428fa55e59784a2342f6 P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:54:35.532557 13887 ts_tablet_manager.cc:1397] T 02be33dc658d428fa55e59784a2342f6 P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.027s user 0.004s sys 0.002s
I20250830 07:54:35.533448 13887 raft_consensus.cc:357] T 02be33dc658d428fa55e59784a2342f6 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:35.533656 13887 raft_consensus.cc:383] T 02be33dc658d428fa55e59784a2342f6 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:35.533754 13887 raft_consensus.cc:738] T 02be33dc658d428fa55e59784a2342f6 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:54:35.534425 13887 consensus_queue.cc:260] T 02be33dc658d428fa55e59784a2342f6 P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:35.535413 13887 ts_tablet_manager.cc:1428] T 02be33dc658d428fa55e59784a2342f6 P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
W20250830 07:54:35.535255 13218 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.12.209.1:45325, user_credentials={real_user=slave}} blocked reactor thread for 170779us
I20250830 07:54:35.535701 13887 tablet_bootstrap.cc:492] T 1fa571e9490e499792225d7b786e8658 P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:54:35.537909 13887 tablet_bootstrap.cc:654] T 1fa571e9490e499792225d7b786e8658 P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:35.540653 13228 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_69dd6a70cb6040c9b6a6d88a1cbb0ab2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:35.541407 13228 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_69dd6a70cb6040c9b6a6d88a1cbb0ab2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:35.544919 13234 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_878c1e8976de49e599d6240552c2efb8" } modify_external_catalogs: true
I20250830 07:54:35.545113 13234 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_878c1e8976de49e599d6240552c2efb8" } modify_external_catalogs: true
I20250830 07:54:35.545223 13231 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_3041c77b19f5443ea4437fda4fdf0799" } new_table_name: "default.Table_01e41025d7db4d668fcd7f011d151ea6" modify_external_catalogs: true
W20250830 07:54:35.529734 13627 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.586s user 0.010s sys 0.004s
I20250830 07:54:35.530036 13882 ts_tablet_manager.cc:1428] T d3b47314f7cd4e969d973c0a340137f1 P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20250830 07:54:35.546618 13882 tablet_bootstrap.cc:492] T 6cf10b7011d444cba0ac758add292477 P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:54:35.546957 13887 tablet_bootstrap.cc:492] T 1fa571e9490e499792225d7b786e8658 P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:54:35.547091 13887 ts_tablet_manager.cc:1397] T 1fa571e9490e499792225d7b786e8658 P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.011s user 0.000s sys 0.009s
I20250830 07:54:35.548082 14167 raft_consensus.cc:491] T 69f2105c5eeb47e9a848ae7bf8779996 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:35.548226 14167 raft_consensus.cc:513] T 69f2105c5eeb47e9a848ae7bf8779996 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:35.548797 14167 leader_election.cc:290] T 69f2105c5eeb47e9a848ae7bf8779996 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
I20250830 07:54:35.549500 13486 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "69f2105c5eeb47e9a848ae7bf8779996" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:54:35.549798 13954 consensus_queue.cc:1035] T c82ac0102b4442449073e44d8a3d9065 P 2065c332f15a4739899af79f3669c3ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20250830 07:54:35.549976 13701 leader_election.cc:343] T 69f2105c5eeb47e9a848ae7bf8779996 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): Illegal state: Tablet not RUNNING: STOPPED
I20250830 07:54:35.550571 13882 tablet_bootstrap.cc:654] T 6cf10b7011d444cba0ac758add292477 P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:35.550717 13629 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "69f2105c5eeb47e9a848ae7bf8779996" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:35.551040 13460 tablet_service.cc:1468] Processing CreateTablet for tablet e66e56ecdf14466282daab8c894eb3c6 (DEFAULT_TABLE table=default.Table_fa57cb9f83e84e42b79e2f78096a8c78 [id=9b34d71e109a4a1ea4edb877a0b42ebc]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:35.551623 13460 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e66e56ecdf14466282daab8c894eb3c6. 1 dirs total, 0 dirs full, 0 dirs failed
W20250830 07:54:35.551604 13703 leader_election.cc:343] T 69f2105c5eeb47e9a848ae7bf8779996 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:35.551775 13703 leader_election.cc:304] T 69f2105c5eeb47e9a848ae7bf8779996 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 2065c332f15a4739899af79f3669c3ba, 6b5e454d98894637b466ea27f1b647f9
I20250830 07:54:35.552310 14167 raft_consensus.cc:2747] T 69f2105c5eeb47e9a848ae7bf8779996 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:54:35.556708 13887 raft_consensus.cc:357] T 1fa571e9490e499792225d7b786e8658 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:35.558049 13887 raft_consensus.cc:383] T 1fa571e9490e499792225d7b786e8658 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:35.558605 13887 raft_consensus.cc:738] T 1fa571e9490e499792225d7b786e8658 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:54:35.559149 13887 consensus_queue.cc:260] T 1fa571e9490e499792225d7b786e8658 P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:35.560648 13887 ts_tablet_manager.cc:1428] T 1fa571e9490e499792225d7b786e8658 P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.013s user 0.002s sys 0.001s
I20250830 07:54:35.561887 13887 tablet_bootstrap.cc:492] T bcdac588f7c24d9d8572949e09b80a23 P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:54:35.564340 13887 tablet_bootstrap.cc:654] T bcdac588f7c24d9d8572949e09b80a23 P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:35.566416 14189 consensus_queue.cc:1035] T f53e7423d1f54566a667195f7cf5e1ce P 2065c332f15a4739899af79f3669c3ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:54:35.568935 13882 tablet_bootstrap.cc:492] T 6cf10b7011d444cba0ac758add292477 P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:54:35.569093 13882 ts_tablet_manager.cc:1397] T 6cf10b7011d444cba0ac758add292477 P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.023s user 0.008s sys 0.000s
I20250830 07:54:35.569392 13464 tablet_service.cc:1468] Processing CreateTablet for tablet e6491d149c0646848680cfdadb6fc76c (DEFAULT_TABLE table=default.Table_b4d7f806dfc640eeb8c6468a8ec88e14 [id=cb36c38dc252417e8a428287d4c469e6]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:35.569795 13882 raft_consensus.cc:357] T 6cf10b7011d444cba0ac758add292477 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:35.569913 13464 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6491d149c0646848680cfdadb6fc76c. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:35.569998 13882 raft_consensus.cc:383] T 6cf10b7011d444cba0ac758add292477 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:35.570082 13882 raft_consensus.cc:738] T 6cf10b7011d444cba0ac758add292477 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:54:35.570323 13882 consensus_queue.cc:260] T 6cf10b7011d444cba0ac758add292477 P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:35.570762 13882 ts_tablet_manager.cc:1428] T 6cf10b7011d444cba0ac758add292477 P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20250830 07:54:35.571125 13882 tablet_bootstrap.cc:492] T 62cf192967d94ecf954d3e965a4d9c9b P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:54:35.577411 13883 ts_tablet_manager.cc:1918] T 69f2105c5eeb47e9a848ae7bf8779996 P 2065c332f15a4739899af79f3669c3ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250830 07:54:35.577543 13883 log.cc:1199] T 69f2105c5eeb47e9a848ae7bf8779996 P 2065c332f15a4739899af79f3669c3ba: Deleting WAL directory at /tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/ts-0/wal/wals/69f2105c5eeb47e9a848ae7bf8779996
I20250830 07:54:35.577908 13883 ts_tablet_manager.cc:1939] T 69f2105c5eeb47e9a848ae7bf8779996 P 2065c332f15a4739899af79f3669c3ba: Deleting consensus metadata
I20250830 07:54:35.578122 14167 consensus_queue.cc:1035] T 6f4c400c0e5e43319fa521b5cab694b4 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:54:35.579881 13605 tablet_service.cc:1468] Processing CreateTablet for tablet 0507245aa8c74aeb9f3eafba0682590d (DEFAULT_TABLE table=default.Table_12c9ea9f75c24214838d600088c31bcf [id=b51964a7d7d14d6db2fd35783c905bbc]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:35.580297 13605 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0507245aa8c74aeb9f3eafba0682590d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:35.588527 13882 tablet_bootstrap.cc:654] T 62cf192967d94ecf954d3e965a4d9c9b P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:35.593677 14213 tablet.cc:1722] T d0238794efb14150af6138b0d8bd80ec P 9b057ade5dce45af9f8bf0bedf8b917f: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250830 07:54:35.598445 13882 tablet_bootstrap.cc:492] T 62cf192967d94ecf954d3e965a4d9c9b P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:54:35.598582 13882 ts_tablet_manager.cc:1397] T 62cf192967d94ecf954d3e965a4d9c9b P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.028s user 0.003s sys 0.002s
I20250830 07:54:35.600260 13882 raft_consensus.cc:357] T 62cf192967d94ecf954d3e965a4d9c9b P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:35.600443 13882 raft_consensus.cc:383] T 62cf192967d94ecf954d3e965a4d9c9b P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:35.600546 13882 raft_consensus.cc:738] T 62cf192967d94ecf954d3e965a4d9c9b P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:54:35.600878 13884 ts_tablet_manager.cc:1918] T 62cf192967d94ecf954d3e965a4d9c9b P 9b057ade5dce45af9f8bf0bedf8b917f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250830 07:54:35.601048 13884 log.cc:1199] T 62cf192967d94ecf954d3e965a4d9c9b P 9b057ade5dce45af9f8bf0bedf8b917f: Deleting WAL directory at /tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/ts-2/wal/wals/62cf192967d94ecf954d3e965a4d9c9b
I20250830 07:54:35.601482 13884 ts_tablet_manager.cc:1939] T 62cf192967d94ecf954d3e965a4d9c9b P 9b057ade5dce45af9f8bf0bedf8b917f: Deleting consensus metadata
I20250830 07:54:35.601967 13233 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_0333c6737081432b8064661a28804d23" } new_table_name: "default.Table_c142c85ffb7840f6846fa8831f9363ed" modify_external_catalogs: true
I20250830 07:54:35.603050 13882 consensus_queue.cc:260] T 62cf192967d94ecf954d3e965a4d9c9b P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:35.604128 13882 ts_tablet_manager.cc:1428] T 62cf192967d94ecf954d3e965a4d9c9b P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20250830 07:54:35.604408 13882 tablet_bootstrap.cc:492] T 02be33dc658d428fa55e59784a2342f6 P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:54:35.608088 13882 tablet_bootstrap.cc:654] T 02be33dc658d428fa55e59784a2342f6 P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:35.609041 13887 tablet_bootstrap.cc:492] T bcdac588f7c24d9d8572949e09b80a23 P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:54:35.609254 13887 ts_tablet_manager.cc:1397] T bcdac588f7c24d9d8572949e09b80a23 P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.048s user 0.000s sys 0.003s
I20250830 07:54:35.610214 13887 raft_consensus.cc:357] T bcdac588f7c24d9d8572949e09b80a23 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:35.610461 13887 raft_consensus.cc:383] T bcdac588f7c24d9d8572949e09b80a23 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:35.610541 13887 raft_consensus.cc:738] T bcdac588f7c24d9d8572949e09b80a23 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:54:35.610836 13887 consensus_queue.cc:260] T bcdac588f7c24d9d8572949e09b80a23 P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:35.611919 13887 ts_tablet_manager.cc:1428] T bcdac588f7c24d9d8572949e09b80a23 P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20250830 07:54:35.612283 13887 tablet_bootstrap.cc:492] T c2f5f79547184009a0863b695a833694 P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:54:35.614445 13887 tablet_bootstrap.cc:654] T c2f5f79547184009a0863b695a833694 P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:35.646579 14190 raft_consensus.cc:491] T 2afb1e75cfcc4e1abd265fbadb4170fa P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:35.646781 14190 raft_consensus.cc:513] T 2afb1e75cfcc4e1abd265fbadb4170fa P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:35.647564 14190 leader_election.cc:290] T 2afb1e75cfcc4e1abd265fbadb4170fa P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:35.648382 13629 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "2afb1e75cfcc4e1abd265fbadb4170fa" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:35.649895 13771 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "2afb1e75cfcc4e1abd265fbadb4170fa" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:35.650120 13771 raft_consensus.cc:2391] T 2afb1e75cfcc4e1abd265fbadb4170fa P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2065c332f15a4739899af79f3669c3ba in current term 1: Already voted for candidate 6b5e454d98894637b466ea27f1b647f9 in this term.
I20250830 07:54:35.650996 13422 leader_election.cc:304] T 2afb1e75cfcc4e1abd265fbadb4170fa P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba; no voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:54:35.651341 14038 raft_consensus.cc:3058] T 2afb1e75cfcc4e1abd265fbadb4170fa P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:35.654106 14038 raft_consensus.cc:2747] T 2afb1e75cfcc4e1abd265fbadb4170fa P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20250830 07:54:35.661906 13226 catalog_manager.cc:5415] Ignoring report from unknown tablet 4c2c85732d454cd98efc2646af9450ed
I20250830 07:54:35.663115 14038 consensus_queue.cc:1035] T c82ac0102b4442449073e44d8a3d9065 P 2065c332f15a4739899af79f3669c3ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:54:35.664948 14167 raft_consensus.cc:491] T 6cf10b7011d444cba0ac758add292477 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:35.665143 14167 raft_consensus.cc:513] T 6cf10b7011d444cba0ac758add292477 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:35.665828 14167 leader_election.cc:290] T 6cf10b7011d444cba0ac758add292477 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
W20250830 07:54:35.667080 13701 leader_election.cc:343] T 6cf10b7011d444cba0ac758add292477 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): Not found: Tablet not found: 6cf10b7011d444cba0ac758add292477
I20250830 07:54:35.667490 13629 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "6cf10b7011d444cba0ac758add292477" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:35.667744 13629 raft_consensus.cc:2466] T 6cf10b7011d444cba0ac758add292477 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 0.
I20250830 07:54:35.668196 13703 leader_election.cc:304] T 6cf10b7011d444cba0ac758add292477 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 2065c332f15a4739899af79f3669c3ba
I20250830 07:54:35.668653 14167 raft_consensus.cc:2802] T 6cf10b7011d444cba0ac758add292477 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:54:35.668740 14167 raft_consensus.cc:491] T 6cf10b7011d444cba0ac758add292477 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:54:35.668828 14167 raft_consensus.cc:3058] T 6cf10b7011d444cba0ac758add292477 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:35.670037 13218 catalog_manager.cc:4928] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): tablet 69f2105c5eeb47e9a848ae7bf8779996 (table default.Table_452b4395b710434591ea426b1e2432ba [id=504758a50ce541e0935fdd94da5c3239]) successfully deleted
I20250830 07:54:35.670260 13226 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_fcf6d8285a8a4759b22a5038eb349f72" } modify_external_catalogs: true
I20250830 07:54:35.670446 13226 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_fcf6d8285a8a4759b22a5038eb349f72" } modify_external_catalogs: true
I20250830 07:54:35.673686 14167 raft_consensus.cc:513] T 6cf10b7011d444cba0ac758add292477 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
W20250830 07:54:35.675148 13701 leader_election.cc:343] T 6cf10b7011d444cba0ac758add292477 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): Not found: Tablet not found: 6cf10b7011d444cba0ac758add292477
I20250830 07:54:35.675412 14167 leader_election.cc:290] T 6cf10b7011d444cba0ac758add292477 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Requested vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
W20250830 07:54:35.676215 13218 catalog_manager.cc:4895] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): delete failed for tablet ec4a3975961d4f85ad9da94835417574 because the tablet was not found. No further retry: Not found: Tablet not found: ec4a3975961d4f85ad9da94835417574
I20250830 07:54:35.676661 13629 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "6cf10b7011d444cba0ac758add292477" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9"
I20250830 07:54:35.676842 13629 raft_consensus.cc:3058] T 6cf10b7011d444cba0ac758add292477 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Advancing to term 1
W20250830 07:54:35.676612 13218 catalog_manager.cc:4908] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): delete failed for tablet d912c69d8722403aa56cbbde4ce59782 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d912c69d8722403aa56cbbde4ce59782 already in progress: creating tablet
W20250830 07:54:35.677913 13229 catalog_manager.cc:5415] Ignoring report from unknown tablet bcdac588f7c24d9d8572949e09b80a23
I20250830 07:54:35.678869 13754 tablet_service.cc:1515] Processing DeleteTablet for tablet 6dda55ec2da34c8aba9f39a63e144a7c with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:35 UTC) from {username='slave'} at 127.0.0.1:45460
I20250830 07:54:35.679344 13751 tablet_service.cc:1468] Processing CreateTablet for tablet dbe542c478874482b078296a7a0e9ec9 (DEFAULT_TABLE table=default.Table_ee3b720242cc477ca9273d73d1199ac3 [id=b80ba51884ef4042818f8def0b0ebf0e]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:35.679741 13751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dbe542c478874482b078296a7a0e9ec9. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:35.679828 13750 tablet_service.cc:1515] Processing DeleteTablet for tablet d912c69d8722403aa56cbbde4ce59782 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:35 UTC) from {username='slave'} at 127.0.0.1:45460
I20250830 07:54:35.680308 13748 tablet_service.cc:1468] Processing CreateTablet for tablet e862fa77e16945bd94e405aa3474f021 (DEFAULT_TABLE table=default.Table_dc8dc313f9fb46d3bd2a8e79c8d2102f [id=00ec67ef5b344c2cb78378851b106cb5]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:35.680739 13748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e862fa77e16945bd94e405aa3474f021. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:35.680984 13740 tablet_service.cc:1468] Processing CreateTablet for tablet d3f207cee78a43a1b5e030c09752c78c (DEFAULT_TABLE table=default.Table_fa378b7e7c574b23b77d462d15d5313e [id=ffc4e5fdd93b4909b2cbcd8daf6d7a2a]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:35.681378 13744 tablet_service.cc:1468] Processing CreateTablet for tablet ffc5945a032e47d4bd3397d7c887dc62 (DEFAULT_TABLE table=default.Table_857dfeec2d2644ebb4f2674ca8df8b89 [id=4019fb254763489b855ced05cca3311b]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:35.681532 13740 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3f207cee78a43a1b5e030c09752c78c. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:35.681741 13744 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ffc5945a032e47d4bd3397d7c887dc62. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:35.681996 13738 tablet_service.cc:1515] Processing DeleteTablet for tablet c12cf30cc2aa4e12a20b9492af08a6f8 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:35 UTC) from {username='slave'} at 127.0.0.1:45460
I20250830 07:54:35.682273 13884 tablet_replica.cc:331] T c12cf30cc2aa4e12a20b9492af08a6f8 P 9b057ade5dce45af9f8bf0bedf8b917f: stopping tablet replica
I20250830 07:54:35.682492 13884 raft_consensus.cc:2241] T c12cf30cc2aa4e12a20b9492af08a6f8 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Raft consensus shutting down.
I20250830 07:54:35.682715 13884 raft_consensus.cc:2270] T c12cf30cc2aa4e12a20b9492af08a6f8 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Raft consensus is shut down!
I20250830 07:54:35.683027 13755 tablet_service.cc:1515] Processing DeleteTablet for tablet a41c1455404f4ed0a782a0c4ddd4140d with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:35 UTC) from {username='slave'} at 127.0.0.1:45460
I20250830 07:54:35.683185 13754 tablet_service.cc:1468] Processing CreateTablet for tablet 8dddcfe56522436287aea212e316a729 (DEFAULT_TABLE table=default.Table_8bc1b4ff2943449a8181e5d31f6f4672 [id=c483c08824f24586855e3575a590b294]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:35.683300 13884 ts_tablet_manager.cc:1905] T c12cf30cc2aa4e12a20b9492af08a6f8 P 9b057ade5dce45af9f8bf0bedf8b917f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250830 07:54:35.683390 13749 tablet_service.cc:1468] Processing CreateTablet for tablet 8f215330505848619ad44569d3167591 (DEFAULT_TABLE table=default.Table_c31165e5edb0449b86fa51f639e07fb6 [id=a860b17c62ce47268c30d1b62e91eae8]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:35.683532 13754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8dddcfe56522436287aea212e316a729. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:35.683459 13750 tablet_service.cc:1468] Processing CreateTablet for tablet 533811110191436d96665b3475ab597f (DEFAULT_TABLE table=default.Table_f61db5d7fd4a41d19d96612681e52b96 [id=8e787419bd7d410bb7543030164b402b]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:35.683670 13749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8f215330505848619ad44569d3167591. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:35.683801 13220 catalog_manager.cc:4928] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): tablet c12cf30cc2aa4e12a20b9492af08a6f8 (table default.Table_f95d862caa7944469f67bcf46893fa07 [id=4976f023f31746a884cb610d757b94cd]) successfully deleted
I20250830 07:54:35.683193 13753 tablet_service.cc:1468] Processing CreateTablet for tablet 99f307a8cbb34addaafab82b3ed18241 (DEFAULT_TABLE table=default.Table_4e2c5e0840fe4d3398519818e193f4dd [id=2a10f84461764fd5ab5a59499a370034]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:35.684268 13750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 533811110191436d96665b3475ab597f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:35.685734 13752 tablet_service.cc:1468] Processing CreateTablet for tablet cb3c48982add45379c0e1b117ec40c1a (DEFAULT_TABLE table=default.Table_3041c77b19f5443ea4437fda4fdf0799 [id=d9cd99eacc86401783d526105ba687d4]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:35.685845 13753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 99f307a8cbb34addaafab82b3ed18241. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:35.686111 13752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb3c48982add45379c0e1b117ec40c1a. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:35.687464 13747 tablet_service.cc:1468] Processing CreateTablet for tablet 04eadf45b82e4c319eb7b316a402d81a (DEFAULT_TABLE table=default.Table_0333c6737081432b8064661a28804d23 [id=c2a3dee1feb24d2dbd795702714970ce]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:35.687887 13747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 04eadf45b82e4c319eb7b316a402d81a. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:35.689831 13746 tablet_service.cc:1468] Processing CreateTablet for tablet 69d6daeb7c774fd48ed296f52ed7c6a6 (DEFAULT_TABLE table=default.Table_c8fac6974ea94c7e863c1ded184f9230 [id=761247d93d9f4f788ecceabebf1de486]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:35.690137 13746 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 69d6daeb7c774fd48ed296f52ed7c6a6. 1 dirs total, 0 dirs full, 0 dirs failed
W20250830 07:54:35.690492 13229 catalog_manager.cc:5415] Ignoring report from unknown tablet 4c2c85732d454cd98efc2646af9450ed
I20250830 07:54:35.691182 13742 tablet_service.cc:1468] Processing CreateTablet for tablet f56cab43580a4ee3a912fc5e58a3bd9d (DEFAULT_TABLE table=default.Table_ab15c29b389643c5a0603f49cc80372e [id=6fc5c53b47c24f8283191be07f6f3cb1]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:35.691555 13742 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f56cab43580a4ee3a912fc5e58a3bd9d. 1 dirs total, 0 dirs full, 0 dirs failed
W20250830 07:54:35.695039 13229 catalog_manager.cc:5415] Ignoring report from unknown tablet a78c522b9fa945e2879fb965d82fb359
W20250830 07:54:35.695158 13229 catalog_manager.cc:5415] Ignoring report from unknown tablet 508ce3cc87734e5b8cec40e74522549a
I20250830 07:54:35.695240 13741 tablet_service.cc:1468] Processing CreateTablet for tablet cf5613278b4c4f3bbe751b1ae6f3c313 (DEFAULT_TABLE table=default.Table_decad1c6025c4be0aa3aa8fea4ca31be [id=845167daf17e4719a0405c5856ea3c02]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:35.695536 13741 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf5613278b4c4f3bbe751b1ae6f3c313. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:35.696729 13629 raft_consensus.cc:2466] T 6cf10b7011d444cba0ac758add292477 P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 1.
I20250830 07:54:35.699200 13745 tablet_service.cc:1468] Processing CreateTablet for tablet 73853894da074ecd8147a94ac28bfab8 (DEFAULT_TABLE table=default.Table_fc6a95f74a1d457d9b5b3b6a6345b834 [id=b983c24ca8174434b0e2c276a9b93495]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:35.699515 13745 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73853894da074ecd8147a94ac28bfab8. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:35.700266 13703 leader_election.cc:304] T 6cf10b7011d444cba0ac758add292477 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 2065c332f15a4739899af79f3669c3ba
I20250830 07:54:35.701157 14167 raft_consensus.cc:2802] T 6cf10b7011d444cba0ac758add292477 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election won for term 1
I20250830 07:54:35.701406 14167 raft_consensus.cc:695] T 6cf10b7011d444cba0ac758add292477 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 LEADER]: Becoming Leader. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Running, Role: LEADER
I20250830 07:54:35.701627 14167 consensus_queue.cc:237] T 6cf10b7011d444cba0ac758add292477 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:35.702636 13739 tablet_service.cc:1468] Processing CreateTablet for tablet 53a933afa4b74095baf0f54736d99bf0 (DEFAULT_TABLE table=default.Table_d601d7d0f55744e5b227aa7b31516c20 [id=e9e95cc7dbe94eadae3a118c44143363]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:35.703106 13739 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 53a933afa4b74095baf0f54736d99bf0. 1 dirs total, 0 dirs full, 0 dirs failed
W20250830 07:54:35.704284 13229 catalog_manager.cc:5415] Ignoring report from unknown tablet e134ab64aa1b4ce89e295b43cbc3fffb
W20250830 07:54:35.704370 13229 catalog_manager.cc:5415] Ignoring report from unknown tablet 1933d49d319b4bd7b717dda2b83859f3
I20250830 07:54:35.705554 13590 tablet_service.cc:1468] Processing CreateTablet for tablet e66e56ecdf14466282daab8c894eb3c6 (DEFAULT_TABLE table=default.Table_fa57cb9f83e84e42b79e2f78096a8c78 [id=9b34d71e109a4a1ea4edb877a0b42ebc]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:35.706008 13590 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e66e56ecdf14466282daab8c894eb3c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:35.706452 13737 tablet_service.cc:1468] Processing CreateTablet for tablet 007435e198b9440db055711a98e3148a (DEFAULT_TABLE table=default.Table_aaa473768ea54b76aa309b0ce75757fa [id=0f52bd27a789427991f55bcb0527cf54]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:35.706845 13737 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 007435e198b9440db055711a98e3148a. 1 dirs total, 0 dirs full, 0 dirs failed
W20250830 07:54:35.710407 13229 catalog_manager.cc:5415] Ignoring report from unknown tablet bcdac588f7c24d9d8572949e09b80a23
W20250830 07:54:35.710491 13229 catalog_manager.cc:5415] Ignoring report from unknown tablet f53e7423d1f54566a667195f7cf5e1ce
W20250830 07:54:35.710618 13229 catalog_manager.cc:5415] Ignoring report from unknown tablet 2afb1e75cfcc4e1abd265fbadb4170fa
W20250830 07:54:35.710704 13229 catalog_manager.cc:5415] Ignoring report from unknown tablet d3b47314f7cd4e969d973c0a340137f1
W20250830 07:54:35.710819 13229 catalog_manager.cc:5415] Ignoring report from unknown tablet b4ab964a64a64e00a78ffd2b220aef46
W20250830 07:54:35.710876 13229 catalog_manager.cc:5415] Ignoring report from unknown tablet 18afeddd2c0642028f93a16323b6e849
I20250830 07:54:35.712656 13740 tablet_service.cc:1515] Processing DeleteTablet for tablet 02be33dc658d428fa55e59784a2342f6 with delete_type TABLET_DATA_DELETED (replaced by tablet 69d6daeb7c774fd48ed296f52ed7c6a6) from {username='slave'} at 127.0.0.1:45460
I20250830 07:54:35.712600 13738 tablet_service.cc:1468] Processing CreateTablet for tablet e6491d149c0646848680cfdadb6fc76c (DEFAULT_TABLE table=default.Table_b4d7f806dfc640eeb8c6468a8ec88e14 [id=cb36c38dc252417e8a428287d4c469e6]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:35.715389 13595 tablet_service.cc:1468] Processing CreateTablet for tablet e6491d149c0646848680cfdadb6fc76c (DEFAULT_TABLE table=default.Table_b4d7f806dfc640eeb8c6468a8ec88e14 [id=cb36c38dc252417e8a428287d4c469e6]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:35.720731 14023 raft_consensus.cc:491] T bcdac588f7c24d9d8572949e09b80a23 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:35.724211 13738 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6491d149c0646848680cfdadb6fc76c. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:35.724272 14023 raft_consensus.cc:513] T bcdac588f7c24d9d8572949e09b80a23 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:35.724905 14023 leader_election.cc:290] T bcdac588f7c24d9d8572949e09b80a23 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:35.725446 13595 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6491d149c0646848680cfdadb6fc76c. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:35.730623 13485 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "bcdac588f7c24d9d8572949e09b80a23" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:54:35.730841 13485 raft_consensus.cc:2466] T bcdac588f7c24d9d8572949e09b80a23 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b5e454d98894637b466ea27f1b647f9 in term 0.
I20250830 07:54:35.712953 13755 tablet_service.cc:1468] Processing CreateTablet for tablet 0507245aa8c74aeb9f3eafba0682590d (DEFAULT_TABLE table=default.Table_12c9ea9f75c24214838d600088c31bcf [id=b51964a7d7d14d6db2fd35783c905bbc]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:35.731316 13755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0507245aa8c74aeb9f3eafba0682590d. 1 dirs total, 0 dirs full, 0 dirs failed
W20250830 07:54:35.731415 13229 catalog_manager.cc:5415] Ignoring report from unknown tablet d876f6259bd94799a4e37dc9d14b8efe
W20250830 07:54:35.731511 13229 catalog_manager.cc:5415] Ignoring report from unknown tablet c82ac0102b4442449073e44d8a3d9065
W20250830 07:54:35.731575 13229 catalog_manager.cc:5415] Ignoring report from unknown tablet dfccff3bd0cb4c7d998633b015de3cfa
W20250830 07:54:35.731617 13229 catalog_manager.cc:5415] Ignoring report from unknown tablet 508ce3cc87734e5b8cec40e74522549a
I20250830 07:54:35.732254 13229 catalog_manager.cc:5674] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325) does not have the latest schema for tablet c9a8f144d50c4d3d81fbf43ce29a2ad2 (table default.Table_739e22d6e6554d3d8859e047e088514f [id=d2dbb756d66b483ebe44d45ddfa5c17c]). Expected version 8 got 0
I20250830 07:54:35.713058 13736 tablet_service.cc:1468] Processing CreateTablet for tablet e66e56ecdf14466282daab8c894eb3c6 (DEFAULT_TABLE table=default.Table_fa57cb9f83e84e42b79e2f78096a8c78 [id=9b34d71e109a4a1ea4edb877a0b42ebc]), partition=RANGE (key) PARTITION UNBOUNDED
W20250830 07:54:35.734619 13218 catalog_manager.cc:4908] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): delete failed for tablet 6dda55ec2da34c8aba9f39a63e144a7c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6dda55ec2da34c8aba9f39a63e144a7c already in progress: creating tablet
I20250830 07:54:35.734939 13561 leader_election.cc:304] T bcdac588f7c24d9d8572949e09b80a23 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 6b5e454d98894637b466ea27f1b647f9; no voters:
I20250830 07:54:35.735244 14023 raft_consensus.cc:2802] T bcdac588f7c24d9d8572949e09b80a23 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20250830 07:54:35.735261 13218 catalog_manager.cc:4895] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): delete failed for tablet a41c1455404f4ed0a782a0c4ddd4140d because the tablet was not found. No further retry: Not found: Tablet not found: a41c1455404f4ed0a782a0c4ddd4140d
I20250830 07:54:35.735363 13736 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e66e56ecdf14466282daab8c894eb3c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:35.735320 14023 raft_consensus.cc:491] T bcdac588f7c24d9d8572949e09b80a23 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:54:35.735448 14023 raft_consensus.cc:3058] T bcdac588f7c24d9d8572949e09b80a23 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:35.735621 13602 tablet_service.cc:1468] Processing CreateTablet for tablet f0144701d459480d96c1ece519951442 (DEFAULT_TABLE table=default.Table_378bc8a57a1d461abd6da90d53bd2be3 [id=29b252a6917d42808eee4e53559c3392]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:35.735939 13602 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0144701d459480d96c1ece519951442. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:35.737709 13883 tablet_replica.cc:331] T c12cf30cc2aa4e12a20b9492af08a6f8 P 2065c332f15a4739899af79f3669c3ba: stopping tablet replica
I20250830 07:54:35.737941 13883 raft_consensus.cc:2241] T c12cf30cc2aa4e12a20b9492af08a6f8 P 2065c332f15a4739899af79f3669c3ba [term 1 LEADER]: Raft consensus shutting down.
I20250830 07:54:35.738286 13883 raft_consensus.cc:2270] T c12cf30cc2aa4e12a20b9492af08a6f8 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20250830 07:54:35.738593 14023 raft_consensus.cc:513] T bcdac588f7c24d9d8572949e09b80a23 P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:35.719383 13884 ts_tablet_manager.cc:1918] T c12cf30cc2aa4e12a20b9492af08a6f8 P 9b057ade5dce45af9f8bf0bedf8b917f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250830 07:54:35.739326 13884 log.cc:1199] T c12cf30cc2aa4e12a20b9492af08a6f8 P 9b057ade5dce45af9f8bf0bedf8b917f: Deleting WAL directory at /tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/ts-2/wal/wals/c12cf30cc2aa4e12a20b9492af08a6f8
I20250830 07:54:35.740432 13485 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "bcdac588f7c24d9d8572949e09b80a23" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba"
I20250830 07:54:35.740623 13485 raft_consensus.cc:3058] T bcdac588f7c24d9d8572949e09b80a23 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:35.742165 13884 ts_tablet_manager.cc:1939] T c12cf30cc2aa4e12a20b9492af08a6f8 P 9b057ade5dce45af9f8bf0bedf8b917f: Deleting consensus metadata
I20250830 07:54:35.743428 13884 tablet_replica.cc:331] T 02be33dc658d428fa55e59784a2342f6 P 9b057ade5dce45af9f8bf0bedf8b917f: stopping tablet replica
I20250830 07:54:35.743681 13485 raft_consensus.cc:2466] T bcdac588f7c24d9d8572949e09b80a23 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b5e454d98894637b466ea27f1b647f9 in term 1.
I20250830 07:54:35.744454 13561 leader_election.cc:304] T bcdac588f7c24d9d8572949e09b80a23 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 6b5e454d98894637b466ea27f1b647f9; no voters:
I20250830 07:54:35.744725 13899 raft_consensus.cc:2802] T bcdac588f7c24d9d8572949e09b80a23 P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Leader election won for term 1
I20250830 07:54:35.744877 13899 raft_consensus.cc:695] T bcdac588f7c24d9d8572949e09b80a23 P 6b5e454d98894637b466ea27f1b647f9 [term 1 LEADER]: Becoming Leader. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Running, Role: LEADER
I20250830 07:54:35.745172 13899 consensus_queue.cc:237] T bcdac588f7c24d9d8572949e09b80a23 P 6b5e454d98894637b466ea27f1b647f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:35.746973 13459 tablet_service.cc:1468] Processing CreateTablet for tablet e255d3fdee09400ead41ca835d6d103f (DEFAULT_TABLE table=default.Table_4285c0443c5848eeb9cddb335be79aab [id=37a468bf42d2445d9fa2eab817a52b9f]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:35.748567 14023 leader_election.cc:290] T bcdac588f7c24d9d8572949e09b80a23 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 election: Requested vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:35.748764 13459 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e255d3fdee09400ead41ca835d6d103f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:35.749225 13884 raft_consensus.cc:2241] T 02be33dc658d428fa55e59784a2342f6 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Raft consensus shutting down.
I20250830 07:54:35.751765 13772 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "bcdac588f7c24d9d8572949e09b80a23" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:35.752661 13884 raft_consensus.cc:2270] T 02be33dc658d428fa55e59784a2342f6 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Raft consensus is shut down!
W20250830 07:54:35.752959 13221 catalog_manager.cc:4726] Async tablet task AlterTable RPC for tablet 8f215330505848619ad44569d3167591 (table default.Table_c31165e5edb0449b86fa51f639e07fb6 [id=a860b17c62ce47268c30d1b62e91eae8], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 8f215330505848619ad44569d3167591 consensus state has no leader
I20250830 07:54:35.753381 13771 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "bcdac588f7c24d9d8572949e09b80a23" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f"
I20250830 07:54:35.753449 13884 ts_tablet_manager.cc:1905] T 02be33dc658d428fa55e59784a2342f6 P 9b057ade5dce45af9f8bf0bedf8b917f: Deleting tablet data with delete state TABLET_DATA_DELETED
W20250830 07:54:35.753995 13562 leader_election.cc:343] T bcdac588f7c24d9d8572949e09b80a23 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Illegal state: must be running to vote when last-logged opid is not known
W20250830 07:54:35.754577 13562 leader_election.cc:343] T bcdac588f7c24d9d8572949e09b80a23 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Illegal state: must be running to vote when last-logged opid is not known
W20250830 07:54:35.761528 13220 catalog_manager.cc:5001] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): alter failed for tablet ccc90f6c867147cc9fe93c9ffa2e4802 (table default.Table_89fb50934e7f4289bbb16b05a52a3af4 [id=1b7c141ed8af4dcab20683653fd59ee1]),no further retry: Not found: Tablet not found: ccc90f6c867147cc9fe93c9ffa2e4802
I20250830 07:54:35.762953 14038 raft_consensus.cc:491] T d3b47314f7cd4e969d973c0a340137f1 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:35.763080 14038 raft_consensus.cc:513] T d3b47314f7cd4e969d973c0a340137f1 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:35.763350 13591 tablet_service.cc:1468] Processing CreateTablet for tablet e255d3fdee09400ead41ca835d6d103f (DEFAULT_TABLE table=default.Table_4285c0443c5848eeb9cddb335be79aab [id=37a468bf42d2445d9fa2eab817a52b9f]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:35.763666 13591 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e255d3fdee09400ead41ca835d6d103f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:35.763641 14038 leader_election.cc:290] T d3b47314f7cd4e969d973c0a340137f1 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:35.764267 13771 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "d3b47314f7cd4e969d973c0a340137f1" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
W20250830 07:54:35.764689 13422 leader_election.cc:343] T d3b47314f7cd4e969d973c0a340137f1 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:35.765724 14023 consensus_queue.cc:1035] T 2afb1e75cfcc4e1abd265fbadb4170fa P 6b5e454d98894637b466ea27f1b647f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:54:35.767321 13883 ts_tablet_manager.cc:1905] T c12cf30cc2aa4e12a20b9492af08a6f8 P 2065c332f15a4739899af79f3669c3ba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250830 07:54:35.768461 13629 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "d3b47314f7cd4e969d973c0a340137f1" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:35.768836 13629 raft_consensus.cc:2466] T d3b47314f7cd4e969d973c0a340137f1 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2065c332f15a4739899af79f3669c3ba in term 0.
I20250830 07:54:35.769210 13884 ts_tablet_manager.cc:1918] T 02be33dc658d428fa55e59784a2342f6 P 9b057ade5dce45af9f8bf0bedf8b917f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250830 07:54:35.769384 13423 leader_election.cc:304] T d3b47314f7cd4e969d973c0a340137f1 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 6b5e454d98894637b466ea27f1b647f9; no voters: 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:54:35.769785 14038 raft_consensus.cc:2802] T d3b47314f7cd4e969d973c0a340137f1 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:54:35.769884 14038 raft_consensus.cc:491] T d3b47314f7cd4e969d973c0a340137f1 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:54:35.770004 14038 raft_consensus.cc:3058] T d3b47314f7cd4e969d973c0a340137f1 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:35.770181 13884 log.cc:1199] T 02be33dc658d428fa55e59784a2342f6 P 9b057ade5dce45af9f8bf0bedf8b917f: Deleting WAL directory at /tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/ts-2/wal/wals/02be33dc658d428fa55e59784a2342f6
I20250830 07:54:35.770579 13884 ts_tablet_manager.cc:1939] T 02be33dc658d428fa55e59784a2342f6 P 9b057ade5dce45af9f8bf0bedf8b917f: Deleting consensus metadata
I20250830 07:54:35.770040 13886 tablet_bootstrap.cc:492] T d3b47314f7cd4e969d973c0a340137f1 P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:54:35.771221 13886 ts_tablet_manager.cc:1397] T d3b47314f7cd4e969d973c0a340137f1 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.249s user 0.023s sys 0.026s
I20250830 07:54:35.771996 13463 tablet_service.cc:1468] Processing CreateTablet for tablet f0144701d459480d96c1ece519951442 (DEFAULT_TABLE table=default.Table_378bc8a57a1d461abd6da90d53bd2be3 [id=29b252a6917d42808eee4e53559c3392]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:35.772001 13886 raft_consensus.cc:357] T d3b47314f7cd4e969d973c0a340137f1 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:35.772200 13886 raft_consensus.cc:383] T d3b47314f7cd4e969d973c0a340137f1 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:35.772267 13886 raft_consensus.cc:738] T d3b47314f7cd4e969d973c0a340137f1 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:54:35.772387 13463 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0144701d459480d96c1ece519951442. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:35.772600 14038 raft_consensus.cc:513] T d3b47314f7cd4e969d973c0a340137f1 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:35.772637 13886 consensus_queue.cc:260] T d3b47314f7cd4e969d973c0a340137f1 P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:35.772992 13886 ts_tablet_manager.cc:1428] T d3b47314f7cd4e969d973c0a340137f1 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20250830 07:54:35.773643 14038 leader_election.cc:290] T d3b47314f7cd4e969d973c0a340137f1 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 election: Requested vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:35.773264 13886 tablet_bootstrap.cc:492] T 1fa571e9490e499792225d7b786e8658 P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:54:35.774895 13591 tablet_service.cc:1468] Processing CreateTablet for tablet c0147310dad84226808332a4c2c6e09d (DEFAULT_TABLE table=default.Table_dc8706b84cd24906a5a3aae9f96e909e [id=dce926f371dd4b4ba61511c14d245622]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:35.775328 13591 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c0147310dad84226808332a4c2c6e09d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:35.776656 13629 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "d3b47314f7cd4e969d973c0a340137f1" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9"
I20250830 07:54:35.777206 13629 raft_consensus.cc:3058] T d3b47314f7cd4e969d973c0a340137f1 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:35.779110 13773 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "d3b47314f7cd4e969d973c0a340137f1" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f"
I20250830 07:54:35.779338 13773 raft_consensus.cc:3058] T d3b47314f7cd4e969d973c0a340137f1 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:35.779661 13887 tablet_bootstrap.cc:492] T c2f5f79547184009a0863b695a833694 P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:54:35.779882 13887 ts_tablet_manager.cc:1397] T c2f5f79547184009a0863b695a833694 P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.168s user 0.004s sys 0.012s
I20250830 07:54:35.780124 13629 raft_consensus.cc:2466] T d3b47314f7cd4e969d973c0a340137f1 P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2065c332f15a4739899af79f3669c3ba in term 1.
I20250830 07:54:35.780602 13887 raft_consensus.cc:357] T c2f5f79547184009a0863b695a833694 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:54:35.780830 13887 raft_consensus.cc:383] T c2f5f79547184009a0863b695a833694 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:35.780936 13887 raft_consensus.cc:738] T c2f5f79547184009a0863b695a833694 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:54:35.781236 13887 consensus_queue.cc:260] T c2f5f79547184009a0863b695a833694 P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:54:35.781371 13886 tablet_bootstrap.cc:654] T 1fa571e9490e499792225d7b786e8658 P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:35.783128 13887 ts_tablet_manager.cc:1428] T c2f5f79547184009a0863b695a833694 P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20250830 07:54:35.785524 13423 leader_election.cc:304] T d3b47314f7cd4e969d973c0a340137f1 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 6b5e454d98894637b466ea27f1b647f9; no voters:
I20250830 07:54:35.785894 14038 raft_consensus.cc:2802] T d3b47314f7cd4e969d973c0a340137f1 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election won for term 1
W20250830 07:54:35.785981 13225 catalog_manager.cc:5415] Ignoring report from unknown tablet c82ac0102b4442449073e44d8a3d9065
W20250830 07:54:35.786144 13225 catalog_manager.cc:5415] Ignoring report from unknown tablet 18afeddd2c0642028f93a16323b6e849
W20250830 07:54:35.786237 13225 catalog_manager.cc:5415] Ignoring report from unknown tablet f53e7423d1f54566a667195f7cf5e1ce
I20250830 07:54:35.786266 14038 raft_consensus.cc:695] T d3b47314f7cd4e969d973c0a340137f1 P 2065c332f15a4739899af79f3669c3ba [term 1 LEADER]: Becoming Leader. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Running, Role: LEADER
I20250830 07:54:35.786615 14038 consensus_queue.cc:237] T d3b47314f7cd4e969d973c0a340137f1 P 2065c332f15a4739899af79f3669c3ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:35.787091 13954 raft_consensus.cc:491] T c9a8f144d50c4d3d81fbf43ce29a2ad2 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:35.787227 13954 raft_consensus.cc:513] T c9a8f144d50c4d3d81fbf43ce29a2ad2 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:35.786832 13225 catalog_manager.cc:5582] T c9a8f144d50c4d3d81fbf43ce29a2ad2 P 9b057ade5dce45af9f8bf0bedf8b917f reported cstate change: term changed from 0 to 1, leader changed from <none> to 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3). New cstate: current_term: 1 leader_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } health_report { overall_health: HEALTHY } } }
I20250830 07:54:35.787562 13225 catalog_manager.cc:5674] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743) does not have the latest schema for tablet c9a8f144d50c4d3d81fbf43ce29a2ad2 (table default.Table_739e22d6e6554d3d8859e047e088514f [id=d2dbb756d66b483ebe44d45ddfa5c17c]). Expected version 8 got 0
I20250830 07:54:35.787736 13954 leader_election.cc:290] T c9a8f144d50c4d3d81fbf43ce29a2ad2 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:35.789417 13771 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "c9a8f144d50c4d3d81fbf43ce29a2ad2" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:35.790464 13626 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "c9a8f144d50c4d3d81fbf43ce29a2ad2" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:35.790717 13626 raft_consensus.cc:2391] T c9a8f144d50c4d3d81fbf43ce29a2ad2 P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2065c332f15a4739899af79f3669c3ba in current term 1: Already voted for candidate 9b057ade5dce45af9f8bf0bedf8b917f in this term.
I20250830 07:54:35.791167 13423 leader_election.cc:304] T c9a8f144d50c4d3d81fbf43ce29a2ad2 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba; no voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:54:35.791635 13954 raft_consensus.cc:3058] T c9a8f144d50c4d3d81fbf43ce29a2ad2 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:35.791996 13886 tablet_bootstrap.cc:492] T 1fa571e9490e499792225d7b786e8658 P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:54:35.792106 13886 ts_tablet_manager.cc:1397] T 1fa571e9490e499792225d7b786e8658 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.019s user 0.005s sys 0.001s
I20250830 07:54:35.792876 13886 raft_consensus.cc:357] T 1fa571e9490e499792225d7b786e8658 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:35.793035 13886 raft_consensus.cc:383] T 1fa571e9490e499792225d7b786e8658 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:35.793110 13886 raft_consensus.cc:738] T 1fa571e9490e499792225d7b786e8658 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:54:35.793322 13886 consensus_queue.cc:260] T 1fa571e9490e499792225d7b786e8658 P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:35.794149 13954 raft_consensus.cc:2747] T c9a8f144d50c4d3d81fbf43ce29a2ad2 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:54:35.795861 13886 ts_tablet_manager.cc:1428] T 1fa571e9490e499792225d7b786e8658 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20250830 07:54:35.796775 13886 tablet_bootstrap.cc:492] T d1ae3812d72b419798736328da64b53c P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:54:35.799361 13886 tablet_bootstrap.cc:654] T d1ae3812d72b419798736328da64b53c P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:35.799279 14153 consensus_queue.cc:1035] T 6f4c400c0e5e43319fa521b5cab694b4 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:54:35.803190 13887 tablet_bootstrap.cc:492] T 1476bb480bf747838613948875001c30 P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:54:35.807394 13887 tablet_bootstrap.cc:654] T 1476bb480bf747838613948875001c30 P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
W20250830 07:54:35.814391 13219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.209.60:43889, user_credentials={real_user=slave}} blocked reactor thread for 117490us
I20250830 07:54:35.817440 13219 catalog_manager.cc:4928] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): tablet 62cf192967d94ecf954d3e965a4d9c9b (table default.Table_fc6a95f74a1d457d9b5b3b6a6345b834 [id=b983c24ca8174434b0e2c276a9b93495]) successfully deleted
W20250830 07:54:35.817672 13219 catalog_manager.cc:4895] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): delete failed for tablet ec4a3975961d4f85ad9da94835417574 because the tablet was not found. No further retry: Not found: Tablet not found: ec4a3975961d4f85ad9da94835417574
W20250830 07:54:35.817864 13219 catalog_manager.cc:4908] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): delete failed for tablet 6dda55ec2da34c8aba9f39a63e144a7c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6dda55ec2da34c8aba9f39a63e144a7c already in progress: creating tablet
W20250830 07:54:35.818044 13219 catalog_manager.cc:4908] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): delete failed for tablet d912c69d8722403aa56cbbde4ce59782 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d912c69d8722403aa56cbbde4ce59782 already in progress: creating tablet
I20250830 07:54:35.822132 13773 raft_consensus.cc:2466] T d3b47314f7cd4e969d973c0a340137f1 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2065c332f15a4739899af79f3669c3ba in term 1.
I20250830 07:54:35.815232 13460 tablet_service.cc:1468] Processing CreateTablet for tablet c0147310dad84226808332a4c2c6e09d (DEFAULT_TABLE table=default.Table_dc8706b84cd24906a5a3aae9f96e909e [id=dce926f371dd4b4ba61511c14d245622]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:35.833191 13460 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c0147310dad84226808332a4c2c6e09d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:35.834735 14189 consensus_queue.cc:1035] T dfccff3bd0cb4c7d998633b015de3cfa P 2065c332f15a4739899af79f3669c3ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20250830 07:54:35.834955 13234 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet 30c2558c28944ff39d1a4a4ca9ac604e
I20250830 07:54:35.837653 13230 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet 73853894da074ecd8147a94ac28bfab8
I20250830 07:54:35.839967 13603 tablet_service.cc:1468] Processing CreateTablet for tablet 2b4ce50fbd26484faba3faa2ec5115c0 (DEFAULT_TABLE table=default.Table_ed86b365cefe4412bcc0629921f39f3b [id=caf655ebda6a46eebb1e01c23b4cb8ca]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:35.840360 13603 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b4ce50fbd26484faba3faa2ec5115c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:35.840561 13883 ts_tablet_manager.cc:1918] T c12cf30cc2aa4e12a20b9492af08a6f8 P 2065c332f15a4739899af79f3669c3ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250830 07:54:35.840692 13883 log.cc:1199] T c12cf30cc2aa4e12a20b9492af08a6f8 P 2065c332f15a4739899af79f3669c3ba: Deleting WAL directory at /tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/ts-0/wal/wals/c12cf30cc2aa4e12a20b9492af08a6f8
I20250830 07:54:35.841099 13883 ts_tablet_manager.cc:1939] T c12cf30cc2aa4e12a20b9492af08a6f8 P 2065c332f15a4739899af79f3669c3ba: Deleting consensus metadata
I20250830 07:54:35.842419 13457 tablet_service.cc:1468] Processing CreateTablet for tablet 2b4ce50fbd26484faba3faa2ec5115c0 (DEFAULT_TABLE table=default.Table_ed86b365cefe4412bcc0629921f39f3b [id=caf655ebda6a46eebb1e01c23b4cb8ca]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:35.842795 13457 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b4ce50fbd26484faba3faa2ec5115c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:35.844453 13593 tablet_service.cc:1468] Processing CreateTablet for tablet 6a82ea7078e344a497c34f932e139bcd (DEFAULT_TABLE table=default.Table_9b6234585c0042ba812e260dbbe5752b [id=5c25d822b21a485a9409aca750350750]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:35.844776 13593 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a82ea7078e344a497c34f932e139bcd. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:35.848702 13218 catalog_manager.cc:4928] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): tablet c12cf30cc2aa4e12a20b9492af08a6f8 (table default.Table_f95d862caa7944469f67bcf46893fa07 [id=4976f023f31746a884cb610d757b94cd]) successfully deleted
I20250830 07:54:35.848796 13608 tablet_service.cc:1468] Processing CreateTablet for tablet a41c1455404f4ed0a782a0c4ddd4140d (DEFAULT_TABLE table=default.Table_6e4493316525486e83d2db0082831718 [id=8da10811b0fb4543ad7ed525ab57e08b]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:35.849211 13608 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a41c1455404f4ed0a782a0c4ddd4140d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:35.849817 13598 tablet_service.cc:1468] Processing CreateTablet for tablet 44313f1a11b74e6d996cafd3c03d1836 (DEFAULT_TABLE table=default.Table_59fd0f7bd26b46b59945c393fc5bb4dc [id=578852f9cfa646f4b00f37b2070a26ae]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:35.850147 13598 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 44313f1a11b74e6d996cafd3c03d1836. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:35.851068 14189 consensus_queue.cc:1035] T dfccff3bd0cb4c7d998633b015de3cfa P 2065c332f15a4739899af79f3669c3ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20250830 07:54:35.851313 13599 tablet_service.cc:1468] Processing CreateTablet for tablet 29f0695563854e45965a1cc36ac54138 (DEFAULT_TABLE table=default.Table_da489b0caa4241ce9aeabe907212bd0b [id=7d0a5ef4aaf64241be34eba188f2cbcd]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:35.851663 13599 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 29f0695563854e45965a1cc36ac54138. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:35.853049 13458 tablet_service.cc:1468] Processing CreateTablet for tablet 6a82ea7078e344a497c34f932e139bcd (DEFAULT_TABLE table=default.Table_9b6234585c0042ba812e260dbbe5752b [id=5c25d822b21a485a9409aca750350750]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:35.853397 13458 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a82ea7078e344a497c34f932e139bcd. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:35.855895 13455 tablet_service.cc:1468] Processing CreateTablet for tablet acca1a8240454b889c63c82d3c75087e (DEFAULT_TABLE table=default.Table_33e47ed000c24372ac8f1b89c5fc38cb [id=9c9207d3b60e4781b1cc610cff92c8e6]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:35.856232 13455 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet acca1a8240454b889c63c82d3c75087e. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:35.860334 14189 raft_consensus.cc:491] T 1fa571e9490e499792225d7b786e8658 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:35.860483 14189 raft_consensus.cc:513] T 1fa571e9490e499792225d7b786e8658 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:35.861074 14189 leader_election.cc:290] T 1fa571e9490e499792225d7b786e8658 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:35.861907 13468 tablet_service.cc:1468] Processing CreateTablet for tablet 01771fa171374e92892345e7402c33d1 (DEFAULT_TABLE table=default.Table_d72b020da8b34ec291b8c8dcd8e0d459 [id=1740a0f9c36b44a7ab5b65366950cc95]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:35.862246 13468 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01771fa171374e92892345e7402c33d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:35.862778 13602 tablet_service.cc:1468] Processing CreateTablet for tablet acca1a8240454b889c63c82d3c75087e (DEFAULT_TABLE table=default.Table_33e47ed000c24372ac8f1b89c5fc38cb [id=9c9207d3b60e4781b1cc610cff92c8e6]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:35.863186 13452 tablet_service.cc:1468] Processing CreateTablet for tablet a41c1455404f4ed0a782a0c4ddd4140d (DEFAULT_TABLE table=default.Table_6e4493316525486e83d2db0082831718 [id=8da10811b0fb4543ad7ed525ab57e08b]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:35.863485 13452 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a41c1455404f4ed0a782a0c4ddd4140d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:35.863907 13771 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "1fa571e9490e499792225d7b786e8658" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:35.864082 14189 raft_consensus.cc:491] T c2f5f79547184009a0863b695a833694 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:35.864151 13771 raft_consensus.cc:2466] T 1fa571e9490e499792225d7b786e8658 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2065c332f15a4739899af79f3669c3ba in term 0.
I20250830 07:54:35.864229 14189 raft_consensus.cc:513] T c2f5f79547184009a0863b695a833694 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:54:35.864790 14189 leader_election.cc:290] T c2f5f79547184009a0863b695a833694 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:35.864888 13590 tablet_service.cc:1468] Processing CreateTablet for tablet 01771fa171374e92892345e7402c33d1 (DEFAULT_TABLE table=default.Table_d72b020da8b34ec291b8c8dcd8e0d459 [id=1740a0f9c36b44a7ab5b65366950cc95]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:35.865312 13422 leader_election.cc:304] T 1fa571e9490e499792225d7b786e8658 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters:
I20250830 07:54:35.865408 13453 tablet_service.cc:1468] Processing CreateTablet for tablet 44313f1a11b74e6d996cafd3c03d1836 (DEFAULT_TABLE table=default.Table_59fd0f7bd26b46b59945c393fc5bb4dc [id=578852f9cfa646f4b00f37b2070a26ae]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:35.865410 13771 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "c2f5f79547184009a0863b695a833694" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:35.865542 14189 raft_consensus.cc:2802] T 1fa571e9490e499792225d7b786e8658 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:54:35.865633 14189 raft_consensus.cc:491] T 1fa571e9490e499792225d7b786e8658 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:54:35.865725 14189 raft_consensus.cc:3058] T 1fa571e9490e499792225d7b786e8658 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:35.865900 13602 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet acca1a8240454b889c63c82d3c75087e. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:35.865978 13454 tablet_service.cc:1468] Processing CreateTablet for tablet 29f0695563854e45965a1cc36ac54138 (DEFAULT_TABLE table=default.Table_da489b0caa4241ce9aeabe907212bd0b [id=7d0a5ef4aaf64241be34eba188f2cbcd]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:35.865728 13453 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 44313f1a11b74e6d996cafd3c03d1836. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:35.867359 13627 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "1fa571e9490e499792225d7b786e8658" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:35.867509 13626 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "c2f5f79547184009a0863b695a833694" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
W20250830 07:54:35.867926 13423 leader_election.cc:343] T 1fa571e9490e499792225d7b786e8658 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
W20250830 07:54:35.868302 13423 leader_election.cc:343] T c2f5f79547184009a0863b695a833694 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:35.868600 13454 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 29f0695563854e45965a1cc36ac54138. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:35.869032 13590 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01771fa171374e92892345e7402c33d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:35.869335 14189 raft_consensus.cc:513] T 1fa571e9490e499792225d7b786e8658 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:35.869998 14189 leader_election.cc:290] T 1fa571e9490e499792225d7b786e8658 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 election: Requested vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
W20250830 07:54:35.870425 13422 leader_election.cc:343] T c2f5f79547184009a0863b695a833694 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:35.870534 13422 leader_election.cc:304] T c2f5f79547184009a0863b695a833694 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba; no voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:54:35.870666 13771 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "1fa571e9490e499792225d7b786e8658" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f"
I20250830 07:54:35.870807 13771 raft_consensus.cc:3058] T 1fa571e9490e499792225d7b786e8658 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:35.871033 14189 raft_consensus.cc:2747] T c2f5f79547184009a0863b695a833694 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:54:35.874279 13886 tablet_bootstrap.cc:492] T d1ae3812d72b419798736328da64b53c P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:54:35.874433 13886 ts_tablet_manager.cc:1397] T d1ae3812d72b419798736328da64b53c P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.078s user 0.004s sys 0.012s
I20250830 07:54:35.874692 13771 raft_consensus.cc:2466] T 1fa571e9490e499792225d7b786e8658 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2065c332f15a4739899af79f3669c3ba in term 1.
I20250830 07:54:35.875212 13886 raft_consensus.cc:357] T d1ae3812d72b419798736328da64b53c P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:35.875547 13886 raft_consensus.cc:383] T d1ae3812d72b419798736328da64b53c P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:35.875571 13626 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "1fa571e9490e499792225d7b786e8658" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9"
I20250830 07:54:35.875660 13886 raft_consensus.cc:738] T d1ae3812d72b419798736328da64b53c P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
W20250830 07:54:35.876019 13423 leader_election.cc:343] T 1fa571e9490e499792225d7b786e8658 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:35.876003 13886 consensus_queue.cc:260] T d1ae3812d72b419798736328da64b53c P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:35.876680 13422 leader_election.cc:304] T 1fa571e9490e499792225d7b786e8658 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:54:35.876654 13886 ts_tablet_manager.cc:1428] T d1ae3812d72b419798736328da64b53c P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
W20250830 07:54:35.877272 13219 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.12.209.3:38743, user_credentials={real_user=slave}} blocked reactor thread for 58349.1us
I20250830 07:54:35.877477 13219 catalog_manager.cc:4928] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): tablet c12cf30cc2aa4e12a20b9492af08a6f8 (table default.Table_f95d862caa7944469f67bcf46893fa07 [id=4976f023f31746a884cb610d757b94cd]) successfully deleted
I20250830 07:54:35.877568 14189 raft_consensus.cc:2802] T 1fa571e9490e499792225d7b786e8658 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election won for term 1
W20250830 07:54:35.877723 13219 catalog_manager.cc:4895] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): delete failed for tablet a41c1455404f4ed0a782a0c4ddd4140d because the tablet was not found. No further retry: Not found: Tablet not found: a41c1455404f4ed0a782a0c4ddd4140d
I20250830 07:54:35.878209 13886 tablet_bootstrap.cc:492] T bcdac588f7c24d9d8572949e09b80a23 P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:54:35.878078 14189 raft_consensus.cc:695] T 1fa571e9490e499792225d7b786e8658 P 2065c332f15a4739899af79f3669c3ba [term 1 LEADER]: Becoming Leader. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Running, Role: LEADER
I20250830 07:54:35.878479 13464 tablet_service.cc:1515] Processing DeleteTablet for tablet 73853894da074ecd8147a94ac28bfab8 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:35 UTC) from {username='slave'} at 127.0.0.1:37956
I20250830 07:54:35.878531 14189 consensus_queue.cc:237] T 1fa571e9490e499792225d7b786e8658 P 2065c332f15a4739899af79f3669c3ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:35.878715 13219 catalog_manager.cc:4928] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): tablet 02be33dc658d428fa55e59784a2342f6 (table default.Table_c8fac6974ea94c7e863c1ded184f9230 [id=761247d93d9f4f788ecceabebf1de486]) successfully deleted
I20250830 07:54:35.879992 13605 tablet_service.cc:1515] Processing DeleteTablet for tablet 73853894da074ecd8147a94ac28bfab8 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:35 UTC) from {username='slave'} at 127.0.0.1:45306
W20250830 07:54:35.880537 13218 catalog_manager.cc:4908] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): delete failed for tablet 73853894da074ecd8147a94ac28bfab8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 73853894da074ecd8147a94ac28bfab8 already in progress: creating tablet
W20250830 07:54:35.880797 13220 catalog_manager.cc:4908] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet 73853894da074ecd8147a94ac28bfab8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 73853894da074ecd8147a94ac28bfab8 already in progress: creating tablet
I20250830 07:54:35.881718 13459 tablet_service.cc:1515] Processing DeleteTablet for tablet 30c2558c28944ff39d1a4a4ca9ac604e with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:35 UTC) from {username='slave'} at 127.0.0.1:37956
W20250830 07:54:35.882829 13218 catalog_manager.cc:4908] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): delete failed for tablet 30c2558c28944ff39d1a4a4ca9ac604e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 30c2558c28944ff39d1a4a4ca9ac604e already in progress: creating tablet
I20250830 07:54:35.885638 13886 tablet_bootstrap.cc:654] T bcdac588f7c24d9d8572949e09b80a23 P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:35.887364 13598 tablet_service.cc:1468] Processing CreateTablet for tablet f1fe024f0de048a5a0931ee38752d5a1 (DEFAULT_TABLE table=default.Table_14aee7781209444194ef305d8eab1ef1 [id=2e4e80b5de924f18a54c9f0731e19534]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:35.887943 13608 tablet_service.cc:1468] Processing CreateTablet for tablet 856e644662334f8194ffef6ca1232248 (DEFAULT_TABLE table=default.Table_717ec99a6275426ba7651552b70962f3 [id=fe3e5972240046eaa659a06b4eea8648]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:35.888109 13450 tablet_service.cc:1468] Processing CreateTablet for tablet f1fe024f0de048a5a0931ee38752d5a1 (DEFAULT_TABLE table=default.Table_14aee7781209444194ef305d8eab1ef1 [id=2e4e80b5de924f18a54c9f0731e19534]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:35.888504 13450 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1fe024f0de048a5a0931ee38752d5a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:35.888530 13464 tablet_service.cc:1468] Processing CreateTablet for tablet 856e644662334f8194ffef6ca1232248 (DEFAULT_TABLE table=default.Table_717ec99a6275426ba7651552b70962f3 [id=fe3e5972240046eaa659a06b4eea8648]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:35.888949 13605 tablet_service.cc:1468] Processing CreateTablet for tablet e6b7646588fe4134b2db62ff84ca4791 (DEFAULT_TABLE table=default.Table_3e83417f25834382bd64da7edd1a18cb [id=e38a27157b504bac9c3ba85277b6b1ae]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:35.889292 13464 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 856e644662334f8194ffef6ca1232248. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:35.891062 13449 tablet_service.cc:1468] Processing CreateTablet for tablet 66d59910b4b2451a851e9d2728d50f42 (DEFAULT_TABLE table=default.Table_89fb50934e7f4289bbb16b05a52a3af4 [id=1b7c141ed8af4dcab20683653fd59ee1]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:35.891846 13449 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 66d59910b4b2451a851e9d2728d50f42. 1 dirs total, 0 dirs full, 0 dirs failed
W20250830 07:54:35.897565 14236 log.cc:927] Time spent T 2afb1e75cfcc4e1abd265fbadb4170fa P 2065c332f15a4739899af79f3669c3ba: Append to log took a long time: real 0.067s user 0.000s sys 0.000s
I20250830 07:54:35.899600 13461 tablet_service.cc:1468] Processing CreateTablet for tablet 4c4a8eea119044b49e2b29f10a703097 (DEFAULT_TABLE table=default.Table_0ad9565d4f894c8ab1ac0aac02496e55 [id=a7c08cd2a1f04e3a8ff028424a443a7e]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:35.899989 13461 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4c4a8eea119044b49e2b29f10a703097. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:35.903201 13456 tablet_service.cc:1468] Processing CreateTablet for tablet 4828280e6fec4338b35422917966ac8c (DEFAULT_TABLE table=default.Table_fcf6d8285a8a4759b22a5038eb349f72 [id=ccd39c94f435403289f5f425afa4d74e]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:35.903537 13456 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4828280e6fec4338b35422917966ac8c. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:35.905532 13899 consensus_queue.cc:1035] T 2afb1e75cfcc4e1abd265fbadb4170fa P 6b5e454d98894637b466ea27f1b647f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:54:35.907209 13466 tablet_service.cc:1468] Processing CreateTablet for tablet ec4a3975961d4f85ad9da94835417574 (DEFAULT_TABLE table=default.Table_a0fec9fe1cad48f6a9c37d2b76075510 [id=b37ceb4d0d494fde9ac5d811b88f706c]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:35.906998 13886 tablet_bootstrap.cc:492] T bcdac588f7c24d9d8572949e09b80a23 P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:54:35.907546 13466 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec4a3975961d4f85ad9da94835417574. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:35.907478 13886 ts_tablet_manager.cc:1397] T bcdac588f7c24d9d8572949e09b80a23 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.029s user 0.003s sys 0.001s
I20250830 07:54:35.908412 13886 raft_consensus.cc:357] T bcdac588f7c24d9d8572949e09b80a23 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:35.908581 13886 raft_consensus.cc:383] T bcdac588f7c24d9d8572949e09b80a23 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:35.908669 13886 raft_consensus.cc:738] T bcdac588f7c24d9d8572949e09b80a23 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:54:35.908902 13886 consensus_queue.cc:260] T bcdac588f7c24d9d8572949e09b80a23 P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:35.909722 13886 ts_tablet_manager.cc:1428] T bcdac588f7c24d9d8572949e09b80a23 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20250830 07:54:35.910409 13886 tablet_bootstrap.cc:492] T 29d492735cd14bb6b4a2a9a3929f62f3 P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:54:35.911176 13462 tablet_service.cc:1468] Processing CreateTablet for tablet 51cee993ce4249c0830b29cb1808fe80 (DEFAULT_TABLE table=default.Table_c2c6c57d30d440d691f87632feae3633 [id=34fc9dab5c14465d8f3362d4c9ff5748]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:35.911489 13462 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 51cee993ce4249c0830b29cb1808fe80. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:35.912043 13886 tablet_bootstrap.cc:654] T 29d492735cd14bb6b4a2a9a3929f62f3 P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
W20250830 07:54:35.920784 14241 log.cc:927] Time spent T 6f4c400c0e5e43319fa521b5cab694b4 P 2065c332f15a4739899af79f3669c3ba: Append to log took a long time: real 0.090s user 0.000s sys 0.000s
W20250830 07:54:35.921698 14238 log.cc:927] Time spent T d3b47314f7cd4e969d973c0a340137f1 P 2065c332f15a4739899af79f3669c3ba: Append to log took a long time: real 0.086s user 0.000s sys 0.000s
I20250830 07:54:35.935483 13752 tablet_service.cc:1468] Processing CreateTablet for tablet f0144701d459480d96c1ece519951442 (DEFAULT_TABLE table=default.Table_378bc8a57a1d461abd6da90d53bd2be3 [id=29b252a6917d42808eee4e53559c3392]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:35.936012 13752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0144701d459480d96c1ece519951442. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:35.940960 13595 tablet_service.cc:1468] Processing CreateTablet for tablet 4828280e6fec4338b35422917966ac8c (DEFAULT_TABLE table=default.Table_fcf6d8285a8a4759b22a5038eb349f72 [id=ccd39c94f435403289f5f425afa4d74e]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:35.942099 13601 tablet_service.cc:1468] Processing CreateTablet for tablet 51cee993ce4249c0830b29cb1808fe80 (DEFAULT_TABLE table=default.Table_c2c6c57d30d440d691f87632feae3633 [id=34fc9dab5c14465d8f3362d4c9ff5748]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:35.942801 13606 tablet_service.cc:1468] Processing CreateTablet for tablet d6afa1ad4791429ba96ee81583dcee64 (DEFAULT_TABLE table=default.Table_79eac01717044a179c06e461fe6f82bb [id=46e088c9ead5481a868232259267699a]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:35.943837 13596 tablet_service.cc:1468] Processing CreateTablet for tablet e4ca3110247640fbae4241448e8d5ef7 (DEFAULT_TABLE table=default.Table_3a3bd36d028a41e39d051f15093ea71d [id=fa763e770a13439084bb86dd227be4cf]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:35.944125 13752 tablet_service.cc:1468] Processing CreateTablet for tablet e255d3fdee09400ead41ca835d6d103f (DEFAULT_TABLE table=default.Table_4285c0443c5848eeb9cddb335be79aab [id=37a468bf42d2445d9fa2eab817a52b9f]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:35.944453 13600 tablet_service.cc:1468] Processing CreateTablet for tablet 8eb010d7955d47a89ff1d01be1b5b01e (DEFAULT_TABLE table=default.Table_f5718c63775946638bc63cf7e8708669 [id=10cdb0b0b3ca416b8e7164aa1a37c8c9]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:35.944555 13752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e255d3fdee09400ead41ca835d6d103f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:35.945525 13595 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4828280e6fec4338b35422917966ac8c. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:35.946108 13600 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8eb010d7955d47a89ff1d01be1b5b01e. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:35.946583 13606 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6afa1ad4791429ba96ee81583dcee64. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:35.946930 13599 tablet_service.cc:1468] Processing CreateTablet for tablet 4c4a8eea119044b49e2b29f10a703097 (DEFAULT_TABLE table=default.Table_0ad9565d4f894c8ab1ac0aac02496e55 [id=a7c08cd2a1f04e3a8ff028424a443a7e]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:35.947186 13601 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 51cee993ce4249c0830b29cb1808fe80. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:35.947520 13593 tablet_service.cc:1468] Processing CreateTablet for tablet ec4a3975961d4f85ad9da94835417574 (DEFAULT_TABLE table=default.Table_a0fec9fe1cad48f6a9c37d2b76075510 [id=b37ceb4d0d494fde9ac5d811b88f706c]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:35.947671 13596 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e4ca3110247640fbae4241448e8d5ef7. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:35.947857 13886 tablet_bootstrap.cc:492] T 29d492735cd14bb6b4a2a9a3929f62f3 P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:54:35.948011 13886 ts_tablet_manager.cc:1397] T 29d492735cd14bb6b4a2a9a3929f62f3 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.038s user 0.004s sys 0.000s
I20250830 07:54:35.948010 13603 tablet_service.cc:1468] Processing CreateTablet for tablet 66d59910b4b2451a851e9d2728d50f42 (DEFAULT_TABLE table=default.Table_89fb50934e7f4289bbb16b05a52a3af4 [id=1b7c141ed8af4dcab20683653fd59ee1]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:35.948797 13886 raft_consensus.cc:357] T 29d492735cd14bb6b4a2a9a3929f62f3 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:35.949019 13886 raft_consensus.cc:383] T 29d492735cd14bb6b4a2a9a3929f62f3 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:35.949110 13886 raft_consensus.cc:738] T 29d492735cd14bb6b4a2a9a3929f62f3 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:54:35.949244 13598 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1fe024f0de048a5a0931ee38752d5a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:35.949347 13886 consensus_queue.cc:260] T 29d492735cd14bb6b4a2a9a3929f62f3 P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:35.949821 13608 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 856e644662334f8194ffef6ca1232248. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:35.950246 13886 ts_tablet_manager.cc:1428] T 29d492735cd14bb6b4a2a9a3929f62f3 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20250830 07:54:35.951154 13886 tablet_bootstrap.cc:492] T c2f5f79547184009a0863b695a833694 P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:54:35.951910 13737 tablet_service.cc:1468] Processing CreateTablet for tablet c0147310dad84226808332a4c2c6e09d (DEFAULT_TABLE table=default.Table_dc8706b84cd24906a5a3aae9f96e909e [id=dce926f371dd4b4ba61511c14d245622]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:35.952353 13737 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c0147310dad84226808332a4c2c6e09d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:35.953455 13455 tablet_service.cc:1468] Processing CreateTablet for tablet 8eb010d7955d47a89ff1d01be1b5b01e (DEFAULT_TABLE table=default.Table_f5718c63775946638bc63cf7e8708669 [id=10cdb0b0b3ca416b8e7164aa1a37c8c9]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:35.953575 13886 tablet_bootstrap.cc:654] T c2f5f79547184009a0863b695a833694 P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:35.954649 13455 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8eb010d7955d47a89ff1d01be1b5b01e. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:35.956138 13458 tablet_service.cc:1468] Processing CreateTablet for tablet e4ca3110247640fbae4241448e8d5ef7 (DEFAULT_TABLE table=default.Table_3a3bd36d028a41e39d051f15093ea71d [id=fa763e770a13439084bb86dd227be4cf]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:35.957047 13458 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e4ca3110247640fbae4241448e8d5ef7. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:35.959249 13461 tablet_service.cc:1468] Processing CreateTablet for tablet d6afa1ad4791429ba96ee81583dcee64 (DEFAULT_TABLE table=default.Table_79eac01717044a179c06e461fe6f82bb [id=46e088c9ead5481a868232259267699a]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:35.969923 13591 tablet_service.cc:1515] Processing DeleteTablet for tablet 30c2558c28944ff39d1a4a4ca9ac604e with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:35 UTC) from {username='slave'} at 127.0.0.1:45306
W20250830 07:54:35.970659 13220 catalog_manager.cc:4908] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet 30c2558c28944ff39d1a4a4ca9ac604e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 30c2558c28944ff39d1a4a4ca9ac604e already in progress: creating tablet
W20250830 07:54:35.971127 13231 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet cb3c48982add45379c0e1b117ec40c1a consensus state has no leader
W20250830 07:54:35.972188 13233 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 04eadf45b82e4c319eb7b316a402d81a consensus state has no leader
I20250830 07:54:35.972777 13226 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet 4828280e6fec4338b35422917966ac8c
I20250830 07:54:35.974247 13597 tablet_service.cc:1515] Processing DeleteTablet for tablet 4828280e6fec4338b35422917966ac8c with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:35 UTC) from {username='slave'} at 127.0.0.1:45306
W20250830 07:54:35.975018 13220 catalog_manager.cc:4895] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet 4828280e6fec4338b35422917966ac8c because the tablet was not found. No further retry: Not found: Tablet not found: 4828280e6fec4338b35422917966ac8c
I20250830 07:54:35.985765 13599 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4c4a8eea119044b49e2b29f10a703097. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:35.985903 13228 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_717ec99a6275426ba7651552b70962f3" } new_table_name: "default.Table_5a48429e0b894a6ea2c01b3ce40de1e9" modify_external_catalogs: true
I20250830 07:54:35.986353 13593 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec4a3975961d4f85ad9da94835417574. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:35.986826 13603 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 66d59910b4b2451a851e9d2728d50f42. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:35.987178 13229 catalog_manager.cc:6127] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: default.Table_4d93a3d083764fedb28fcf469ae96c80 [id=8628f6e9686d43b6aa84cd3202db8e80] alter complete (version 1)
I20250830 07:54:35.987901 13882 tablet_bootstrap.cc:492] T 02be33dc658d428fa55e59784a2342f6 P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:54:35.988056 13882 ts_tablet_manager.cc:1397] T 02be33dc658d428fa55e59784a2342f6 P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.384s user 0.039s sys 0.063s
W20250830 07:54:35.988517 13232 catalog_manager.cc:5415] Ignoring report from unknown tablet 9e055d6089f541f799eddb5778eb2148
W20250830 07:54:35.988615 13232 catalog_manager.cc:5415] Ignoring report from unknown tablet ff2267fb411942ff826e2a72bcb89cd7
W20250830 07:54:35.988771 13232 catalog_manager.cc:5415] Ignoring report from unknown tablet 508ce3cc87734e5b8cec40e74522549a
W20250830 07:54:35.988847 13232 catalog_manager.cc:5415] Ignoring report from unknown tablet 7ef98dbbdf5848038a2da6140e126301
W20250830 07:54:35.988940 13232 catalog_manager.cc:5415] Ignoring report from unknown tablet a78c522b9fa945e2879fb965d82fb359
W20250830 07:54:35.989004 13232 catalog_manager.cc:5415] Ignoring report from unknown tablet 5ce773ce68f649b1bf51f0dd901cb04f
W20250830 07:54:35.989092 13232 catalog_manager.cc:5415] Ignoring report from unknown tablet 4b7eff24965f4f3ebfbf70dc82b7cce3
I20250830 07:54:35.988723 13227 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_89fb50934e7f4289bbb16b05a52a3af4" } modify_external_catalogs: true
I20250830 07:54:35.989184 13226 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_de59395b45a5466eb264ad7be546608f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250830 07:54:35.989264 13227 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_89fb50934e7f4289bbb16b05a52a3af4" } modify_external_catalogs: true
W20250830 07:54:35.989674 13226 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_de59395b45a5466eb264ad7be546608f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:35.990028 13234 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_67739ac4113c4648920b4a24633396c5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:35.990653 13234 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_67739ac4113c4648920b4a24633396c5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250830 07:54:35.989187 13232 catalog_manager.cc:5415] Ignoring report from unknown tablet 2afb1e75cfcc4e1abd265fbadb4170fa
W20250830 07:54:35.991483 13232 catalog_manager.cc:5415] Ignoring report from unknown tablet d876f6259bd94799a4e37dc9d14b8efe
W20250830 07:54:35.991573 13232 catalog_manager.cc:5415] Ignoring report from unknown tablet 18afeddd2c0642028f93a16323b6e849
I20250830 07:54:35.991523 13229 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_a69ef62b5e2a4bb0b70c263090ce598c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:35.991707 13232 catalog_manager.cc:5415] Ignoring report from unknown tablet c82ac0102b4442449073e44d8a3d9065
W20250830 07:54:35.991762 13232 catalog_manager.cc:5415] Ignoring report from unknown tablet d3b47314f7cd4e969d973c0a340137f1
W20250830 07:54:35.991827 13232 catalog_manager.cc:5415] Ignoring report from unknown tablet 6f4c400c0e5e43319fa521b5cab694b4
W20250830 07:54:35.991878 13232 catalog_manager.cc:5415] Ignoring report from unknown tablet f53e7423d1f54566a667195f7cf5e1ce
W20250830 07:54:35.992107 13229 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a69ef62b5e2a4bb0b70c263090ce598c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:35.992214 13230 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_a1e1dfefb8bc4fc68682b6cbaca77e50" } new_table_name: "default.Table_2bb70ab8f64a485c909945f467efe644" modify_external_catalogs: true
I20250830 07:54:35.992353 13233 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_6fdd8b95556645e3aca8b103373a8dac"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:35.992712 13233 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6fdd8b95556645e3aca8b103373a8dac in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:35.995890 13882 raft_consensus.cc:357] T 02be33dc658d428fa55e59784a2342f6 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:35.996137 13882 raft_consensus.cc:383] T 02be33dc658d428fa55e59784a2342f6 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:35.996237 13882 raft_consensus.cc:738] T 02be33dc658d428fa55e59784a2342f6 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:54:35.996779 13882 consensus_queue.cc:260] T 02be33dc658d428fa55e59784a2342f6 P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:35.999493 13882 ts_tablet_manager.cc:1428] T 02be33dc658d428fa55e59784a2342f6 P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.011s user 0.001s sys 0.002s
I20250830 07:54:36.000666 13882 tablet_bootstrap.cc:492] T 69f2105c5eeb47e9a848ae7bf8779996 P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:54:36.000651 13225 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_307276a7da514840af7d3a3c90634e05" } new_table_name: "default.Table_f63c8357d00949f7822da8771d6a44f1" modify_external_catalogs: true
I20250830 07:54:36.002756 13882 tablet_bootstrap.cc:654] T 69f2105c5eeb47e9a848ae7bf8779996 P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:36.010644 13882 tablet_bootstrap.cc:492] T 69f2105c5eeb47e9a848ae7bf8779996 P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:54:36.010809 13882 ts_tablet_manager.cc:1397] T 69f2105c5eeb47e9a848ae7bf8779996 P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.010s user 0.000s sys 0.006s
I20250830 07:54:36.011183 13231 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_fa3320a90acd4443936458d7ad7e1bdc" } modify_external_catalogs: true
I20250830 07:54:36.011364 13231 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_fa3320a90acd4443936458d7ad7e1bdc" } modify_external_catalogs: true
W20250830 07:54:36.015588 13228 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 856e644662334f8194ffef6ca1232248 consensus state has no leader
I20250830 07:54:36.015986 13228 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_b2b6c71b45ea47a088960316d6b712a5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:36.016544 13228 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b2b6c71b45ea47a088960316d6b712a5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:36.017771 13227 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet 66d59910b4b2451a851e9d2728d50f42
I20250830 07:54:36.018666 13227 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_f430b456b071480fb3f9a71e7f7ab431"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:36.019241 13227 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f430b456b071480fb3f9a71e7f7ab431 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:36.020757 13755 tablet_service.cc:1515] Processing DeleteTablet for tablet 73853894da074ecd8147a94ac28bfab8 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:35 UTC) from {username='slave'} at 127.0.0.1:45460
I20250830 07:54:36.022949 13755 tablet_service.cc:1468] Processing CreateTablet for tablet 2b4ce50fbd26484faba3faa2ec5115c0 (DEFAULT_TABLE table=default.Table_ed86b365cefe4412bcc0629921f39f3b [id=caf655ebda6a46eebb1e01c23b4cb8ca]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:36.023339 13755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b4ce50fbd26484faba3faa2ec5115c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:36.024350 13887 tablet_bootstrap.cc:492] T 1476bb480bf747838613948875001c30 P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:54:36.025938 13459 tablet_service.cc:1468] Processing CreateTablet for tablet e6b7646588fe4134b2db62ff84ca4791 (DEFAULT_TABLE table=default.Table_3e83417f25834382bd64da7edd1a18cb [id=e38a27157b504bac9c3ba85277b6b1ae]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:36.026335 13887 ts_tablet_manager.cc:1397] T 1476bb480bf747838613948875001c30 P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.241s user 0.000s sys 0.003s
I20250830 07:54:36.027119 13887 raft_consensus.cc:357] T 1476bb480bf747838613948875001c30 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:54:36.027307 13887 raft_consensus.cc:383] T 1476bb480bf747838613948875001c30 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:36.027377 13887 raft_consensus.cc:738] T 1476bb480bf747838613948875001c30 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:54:36.027619 13887 consensus_queue.cc:260] T 1476bb480bf747838613948875001c30 P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:54:36.028123 13887 ts_tablet_manager.cc:1428] T 1476bb480bf747838613948875001c30 P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20250830 07:54:36.028432 13887 tablet_bootstrap.cc:492] T 05697181c0c149c79a395ff7525ea2af P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:54:36.032555 13233 master_service.cc:948] ReplaceTablet: received request to replace tablet 2009012fddc24e4fb7ad0fab33a1103b from {username='slave'} at 127.0.0.1:42126
W20250830 07:54:36.032999 13230 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 38080b5efc194260a7b1b8b6c1aa8e3b has no consensus state
I20250830 07:54:36.033247 13230 master_service.cc:948] ReplaceTablet: received request to replace tablet 9b9c2ae8805a48f7959d6745677a96f2 from {username='slave'} at 127.0.0.1:42126
I20250830 07:54:36.034859 13755 tablet_service.cc:1468] Processing CreateTablet for tablet 6a82ea7078e344a497c34f932e139bcd (DEFAULT_TABLE table=default.Table_9b6234585c0042ba812e260dbbe5752b [id=5c25d822b21a485a9409aca750350750]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:36.037228 13755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a82ea7078e344a497c34f932e139bcd. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:36.038818 13232 master_service.cc:948] ReplaceTablet: received request to replace tablet 9b9c2ae8805a48f7959d6745677a96f2 from {username='slave'} at 127.0.0.1:42126
I20250830 07:54:36.040138 13461 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6afa1ad4791429ba96ee81583dcee64. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:36.041443 13591 tablet_service.cc:1515] Processing DeleteTablet for tablet 66d59910b4b2451a851e9d2728d50f42 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:35 UTC) from {username='slave'} at 127.0.0.1:45306
I20250830 07:54:36.050730 13459 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6b7646588fe4134b2db62ff84ca4791. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:36.050797 13737 tablet_service.cc:1515] Processing DeleteTablet for tablet 30c2558c28944ff39d1a4a4ca9ac604e with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:35 UTC) from {username='slave'} at 127.0.0.1:45460
I20250830 07:54:36.052872 13591 tablet_service.cc:1515] Processing DeleteTablet for tablet 62cf192967d94ecf954d3e965a4d9c9b with delete_type TABLET_DATA_DELETED (replaced by tablet 73853894da074ecd8147a94ac28bfab8) from {username='slave'} at 127.0.0.1:45306
I20250830 07:54:36.053295 13591 tablet_service.cc:1515] Processing DeleteTablet for tablet 6cf10b7011d444cba0ac758add292477 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:33 UTC) from {username='slave'} at 127.0.0.1:45306
I20250830 07:54:36.057603 13234 master_service.cc:948] ReplaceTablet: received request to replace tablet 27da527d9fe045ae8c17f193d034f5ac from {username='slave'} at 127.0.0.1:42126
I20250830 07:54:36.058169 13229 master_service.cc:948] ReplaceTablet: received request to replace tablet 861809cc50764aa89140e587489e2d88 from {username='slave'} at 127.0.0.1:42126
W20250830 07:54:36.060477 13225 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet cada6410e2884c508bb7dd38bea438ae consensus state has no leader
I20250830 07:54:36.063012 13231 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet 007435e198b9440db055711a98e3148a
I20250830 07:54:36.066794 13234 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_752efa41f91b4c74b642b4fc89bf584c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:36.067407 13234 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_752efa41f91b4c74b642b4fc89bf584c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:36.068893 13229 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_a73aa006f02f4599bf419556e64f6f3b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:36.069420 13229 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a73aa006f02f4599bf419556e64f6f3b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:36.071074 13462 tablet_service.cc:1515] Processing DeleteTablet for tablet 02be33dc658d428fa55e59784a2342f6 with delete_type TABLET_DATA_DELETED (replaced by tablet 69d6daeb7c774fd48ed296f52ed7c6a6) from {username='slave'} at 127.0.0.1:37956
I20250830 07:54:36.071830 13230 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_9b6234585c0042ba812e260dbbe5752b" } modify_external_catalogs: true
I20250830 07:54:36.072114 13230 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_9b6234585c0042ba812e260dbbe5752b" } modify_external_catalogs: true
W20250830 07:54:36.072206 13226 catalog_manager.cc:5415] Ignoring report from unknown tablet 29d492735cd14bb6b4a2a9a3929f62f3
W20250830 07:54:36.072356 13226 catalog_manager.cc:5415] Ignoring report from unknown tablet bcdac588f7c24d9d8572949e09b80a23
W20250830 07:54:36.072435 13226 catalog_manager.cc:5415] Ignoring report from unknown tablet f53e7423d1f54566a667195f7cf5e1ce
W20250830 07:54:36.072503 13226 catalog_manager.cc:5415] Ignoring report from unknown tablet d1ae3812d72b419798736328da64b53c
W20250830 07:54:36.072609 13226 catalog_manager.cc:5415] Ignoring report from unknown tablet 6cf10b7011d444cba0ac758add292477
W20250830 07:54:36.072705 13226 catalog_manager.cc:5415] Ignoring report from unknown tablet f398e12cd9f543738d5163354f8a9d9d
W20250830 07:54:36.072772 13226 catalog_manager.cc:5415] Ignoring report from unknown tablet dfccff3bd0cb4c7d998633b015de3cfa
W20250830 07:54:36.072836 13226 catalog_manager.cc:5415] Ignoring report from unknown tablet 4c2c85732d454cd98efc2646af9450ed
W20250830 07:54:36.072892 13226 catalog_manager.cc:5415] Ignoring report from unknown tablet 7ed22d9617024d55a8add137e7971061
W20250830 07:54:36.072959 13226 catalog_manager.cc:5415] Ignoring report from unknown tablet 6f4c400c0e5e43319fa521b5cab694b4
W20250830 07:54:36.073009 13226 catalog_manager.cc:5415] Ignoring report from unknown tablet d3b47314f7cd4e969d973c0a340137f1
W20250830 07:54:36.073073 13226 catalog_manager.cc:5415] Ignoring report from unknown tablet 1fa571e9490e499792225d7b786e8658
W20250830 07:54:36.073123 13226 catalog_manager.cc:5415] Ignoring report from unknown tablet 2afb1e75cfcc4e1abd265fbadb4170fa
I20250830 07:54:36.073570 13885 tablet_replica.cc:331] T 62cf192967d94ecf954d3e965a4d9c9b P 6b5e454d98894637b466ea27f1b647f9: stopping tablet replica
I20250830 07:54:36.073604 13226 catalog_manager.cc:5674] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743) does not have the latest schema for tablet c9a8f144d50c4d3d81fbf43ce29a2ad2 (table default.Table_739e22d6e6554d3d8859e047e088514f [id=d2dbb756d66b483ebe44d45ddfa5c17c]). Expected version 8 got 0
I20250830 07:54:36.073776 13885 raft_consensus.cc:2241] T 62cf192967d94ecf954d3e965a4d9c9b P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250830 07:54:36.073863 13466 tablet_service.cc:1515] Processing DeleteTablet for tablet 4828280e6fec4338b35422917966ac8c with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:35 UTC) from {username='slave'} at 127.0.0.1:37956
I20250830 07:54:36.073951 13885 raft_consensus.cc:2270] T 62cf192967d94ecf954d3e965a4d9c9b P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250830 07:54:36.074628 13885 ts_tablet_manager.cc:1905] T 62cf192967d94ecf954d3e965a4d9c9b P 6b5e454d98894637b466ea27f1b647f9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250830 07:54:36.075989 13883 tablet_replica.cc:331] T 02be33dc658d428fa55e59784a2342f6 P 2065c332f15a4739899af79f3669c3ba: stopping tablet replica
I20250830 07:54:36.076189 13883 raft_consensus.cc:2241] T 02be33dc658d428fa55e59784a2342f6 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Raft consensus shutting down.
W20250830 07:54:36.077211 13226 catalog_manager.cc:5415] Ignoring report from unknown tablet 02be33dc658d428fa55e59784a2342f6
I20250830 07:54:36.078415 13883 raft_consensus.cc:2270] T 02be33dc658d428fa55e59784a2342f6 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Raft consensus is shut down!
I20250830 07:54:36.078966 13883 ts_tablet_manager.cc:1905] T 02be33dc658d428fa55e59784a2342f6 P 2065c332f15a4739899af79f3669c3ba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250830 07:54:36.077548 13231 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_1ea5f85222ec42f6af7118df29b3407b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:36.080149 13231 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1ea5f85222ec42f6af7118df29b3407b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:36.078099 13232 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_01e41025d7db4d668fcd7f011d151ea6" } modify_external_catalogs: true
W20250830 07:54:36.080482 13226 catalog_manager.cc:5415] Ignoring report from unknown tablet bcdac588f7c24d9d8572949e09b80a23
W20250830 07:54:36.080601 13226 catalog_manager.cc:5415] Ignoring report from unknown tablet 2afb1e75cfcc4e1abd265fbadb4170fa
W20250830 07:54:36.080741 13226 catalog_manager.cc:5415] Ignoring report from unknown tablet dfccff3bd0cb4c7d998633b015de3cfa
I20250830 07:54:36.079668 13225 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_5486f1dec4564e6db48bab52a8b297eb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:36.081148 13226 catalog_manager.cc:5415] Ignoring report from unknown tablet 6f4c400c0e5e43319fa521b5cab694b4
W20250830 07:54:36.081527 13225 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5486f1dec4564e6db48bab52a8b297eb in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:36.082736 13463 tablet_service.cc:1515] Processing DeleteTablet for tablet 007435e198b9440db055711a98e3148a with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:36 UTC) from {username='slave'} at 127.0.0.1:37956
I20250830 07:54:36.082935 13232 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_01e41025d7db4d668fcd7f011d151ea6" } modify_external_catalogs: true
I20250830 07:54:36.084282 13454 tablet_service.cc:1515] Processing DeleteTablet for tablet 66d59910b4b2451a851e9d2728d50f42 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:35 UTC) from {username='slave'} at 127.0.0.1:37956
I20250830 07:54:36.086264 13450 tablet_service.cc:1515] Processing DeleteTablet for tablet 1fa571e9490e499792225d7b786e8658 with delete_type TABLET_DATA_DELETED (replaced by tablet 0507245aa8c74aeb9f3eafba0682590d) from {username='slave'} at 127.0.0.1:37956
W20250830 07:54:36.090041 13220 catalog_manager.cc:4895] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet 66d59910b4b2451a851e9d2728d50f42 because the tablet was not found. No further retry: Not found: Tablet not found: 66d59910b4b2451a851e9d2728d50f42
I20250830 07:54:36.090886 13605 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6b7646588fe4134b2db62ff84ca4791. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:36.096853 13736 tablet_service.cc:1468] Processing CreateTablet for tablet 01771fa171374e92892345e7402c33d1 (DEFAULT_TABLE table=default.Table_d72b020da8b34ec291b8c8dcd8e0d459 [id=1740a0f9c36b44a7ab5b65366950cc95]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:36.097280 13736 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01771fa171374e92892345e7402c33d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:36.098771 13737 tablet_service.cc:1468] Processing CreateTablet for tablet acca1a8240454b889c63c82d3c75087e (DEFAULT_TABLE table=default.Table_33e47ed000c24372ac8f1b89c5fc38cb [id=9c9207d3b60e4781b1cc610cff92c8e6]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:36.099149 13737 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet acca1a8240454b889c63c82d3c75087e. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:36.105207 13887 tablet_bootstrap.cc:654] T 05697181c0c149c79a395ff7525ea2af P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:36.106511 13736 tablet_service.cc:1468] Processing CreateTablet for tablet a41c1455404f4ed0a782a0c4ddd4140d (DEFAULT_TABLE table=default.Table_6e4493316525486e83d2db0082831718 [id=8da10811b0fb4543ad7ed525ab57e08b]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:36.106973 13736 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a41c1455404f4ed0a782a0c4ddd4140d. 1 dirs total, 0 dirs full, 0 dirs failed
W20250830 07:54:36.111330 13226 catalog_manager.cc:5415] Ignoring report from unknown tablet 1476bb480bf747838613948875001c30
W20250830 07:54:36.111434 13226 catalog_manager.cc:5415] Ignoring report from unknown tablet 6f4c400c0e5e43319fa521b5cab694b4
W20250830 07:54:36.111654 13226 catalog_manager.cc:5415] Ignoring report from unknown tablet f53e7423d1f54566a667195f7cf5e1ce
W20250830 07:54:36.111726 13226 catalog_manager.cc:5415] Ignoring report from unknown tablet 2afb1e75cfcc4e1abd265fbadb4170fa
I20250830 07:54:36.112648 13737 tablet_service.cc:1468] Processing CreateTablet for tablet 44313f1a11b74e6d996cafd3c03d1836 (DEFAULT_TABLE table=default.Table_59fd0f7bd26b46b59945c393fc5bb4dc [id=578852f9cfa646f4b00f37b2070a26ae]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:36.112732 13750 tablet_service.cc:1468] Processing CreateTablet for tablet 29f0695563854e45965a1cc36ac54138 (DEFAULT_TABLE table=default.Table_da489b0caa4241ce9aeabe907212bd0b [id=7d0a5ef4aaf64241be34eba188f2cbcd]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:36.113031 13737 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 44313f1a11b74e6d996cafd3c03d1836. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:36.113338 13750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 29f0695563854e45965a1cc36ac54138. 1 dirs total, 0 dirs full, 0 dirs failed
W20250830 07:54:36.116819 13226 catalog_manager.cc:5415] Ignoring report from unknown tablet 1fa571e9490e499792225d7b786e8658
W20250830 07:54:36.116899 13226 catalog_manager.cc:5415] Ignoring report from unknown tablet d3b47314f7cd4e969d973c0a340137f1
W20250830 07:54:36.116968 13226 catalog_manager.cc:5415] Ignoring report from unknown tablet 4ab63ff59d4e4ec2b7b64d605545a870
W20250830 07:54:36.117013 13226 catalog_manager.cc:5415] Ignoring report from unknown tablet d876f6259bd94799a4e37dc9d14b8efe
W20250830 07:54:36.117074 13226 catalog_manager.cc:5415] Ignoring report from unknown tablet dfccff3bd0cb4c7d998633b015de3cfa
I20250830 07:54:36.117126 13752 tablet_service.cc:1468] Processing CreateTablet for tablet e6b7646588fe4134b2db62ff84ca4791 (DEFAULT_TABLE table=default.Table_3e83417f25834382bd64da7edd1a18cb [id=e38a27157b504bac9c3ba85277b6b1ae]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:36.117357 13226 catalog_manager.cc:5674] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325) does not have the latest schema for tablet c2f5f79547184009a0863b695a833694 (table default.Table_4abf499bcf8a4fd88fd739d3a1daee3a [id=768d7e569197455bb092328ca1b32ed0]). Expected version 2 got 0
I20250830 07:54:36.117506 13752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6b7646588fe4134b2db62ff84ca4791. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:36.126986 13749 tablet_service.cc:1468] Processing CreateTablet for tablet 856e644662334f8194ffef6ca1232248 (DEFAULT_TABLE table=default.Table_717ec99a6275426ba7651552b70962f3 [id=fe3e5972240046eaa659a06b4eea8648]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:36.127401 13749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 856e644662334f8194ffef6ca1232248. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:36.131995 13886 tablet_bootstrap.cc:492] T c2f5f79547184009a0863b695a833694 P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:54:36.132159 13886 ts_tablet_manager.cc:1397] T c2f5f79547184009a0863b695a833694 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.182s user 0.015s sys 0.044s
I20250830 07:54:36.133010 13886 raft_consensus.cc:357] T c2f5f79547184009a0863b695a833694 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:54:36.133198 13886 raft_consensus.cc:383] T c2f5f79547184009a0863b695a833694 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:36.133312 13886 raft_consensus.cc:738] T c2f5f79547184009a0863b695a833694 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:54:36.133569 13886 consensus_queue.cc:260] T c2f5f79547184009a0863b695a833694 P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:54:36.133656 13747 tablet_service.cc:1468] Processing CreateTablet for tablet f1fe024f0de048a5a0931ee38752d5a1 (DEFAULT_TABLE table=default.Table_14aee7781209444194ef305d8eab1ef1 [id=2e4e80b5de924f18a54c9f0731e19534]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:36.134012 13747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1fe024f0de048a5a0931ee38752d5a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:36.134131 13886 ts_tablet_manager.cc:1428] T c2f5f79547184009a0863b695a833694 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20250830 07:54:36.138629 13883 ts_tablet_manager.cc:1918] T 02be33dc658d428fa55e59784a2342f6 P 2065c332f15a4739899af79f3669c3ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250830 07:54:36.138798 13883 log.cc:1199] T 02be33dc658d428fa55e59784a2342f6 P 2065c332f15a4739899af79f3669c3ba: Deleting WAL directory at /tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/ts-0/wal/wals/02be33dc658d428fa55e59784a2342f6
I20250830 07:54:36.141626 14153 raft_consensus.cc:491] T 29d492735cd14bb6b4a2a9a3929f62f3 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:36.141849 14153 raft_consensus.cc:513] T 29d492735cd14bb6b4a2a9a3929f62f3 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:36.142724 14153 leader_election.cc:290] T 29d492735cd14bb6b4a2a9a3929f62f3 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
I20250830 07:54:36.143153 13742 tablet_service.cc:1468] Processing CreateTablet for tablet 66d59910b4b2451a851e9d2728d50f42 (DEFAULT_TABLE table=default.Table_89fb50934e7f4289bbb16b05a52a3af4 [id=1b7c141ed8af4dcab20683653fd59ee1]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:36.143517 13742 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 66d59910b4b2451a851e9d2728d50f42. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:36.147289 13486 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "29d492735cd14bb6b4a2a9a3929f62f3" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:54:36.147496 13486 raft_consensus.cc:2466] T 29d492735cd14bb6b4a2a9a3929f62f3 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 0.
I20250830 07:54:36.151202 13701 leader_election.cc:304] T 29d492735cd14bb6b4a2a9a3929f62f3 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters:
I20250830 07:54:36.151681 14153 raft_consensus.cc:2802] T 29d492735cd14bb6b4a2a9a3929f62f3 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:54:36.151796 14153 raft_consensus.cc:491] T 29d492735cd14bb6b4a2a9a3929f62f3 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:54:36.151922 14153 raft_consensus.cc:3058] T 29d492735cd14bb6b4a2a9a3929f62f3 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:36.152226 13741 tablet_service.cc:1468] Processing CreateTablet for tablet 4c4a8eea119044b49e2b29f10a703097 (DEFAULT_TABLE table=default.Table_0ad9565d4f894c8ab1ac0aac02496e55 [id=a7c08cd2a1f04e3a8ff028424a443a7e]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:36.152611 13741 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4c4a8eea119044b49e2b29f10a703097. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:36.153692 13886 tablet_bootstrap.cc:492] T 6f2d855ab3c04123b2f9ea22cda6ef04 P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:54:36.157598 13233 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet 2009012fddc24e4fb7ad0fab33a1103b
I20250830 07:54:36.158703 13886 tablet_bootstrap.cc:654] T 6f2d855ab3c04123b2f9ea22cda6ef04 P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:36.159724 13233 catalog_manager.cc:6652] ReplaceTablet: tablet 2009012fddc24e4fb7ad0fab33a1103b deleted and replaced by tablet 52e910677ae34630a919d1d3f21b7e83
I20250830 07:54:36.159754 13232 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet cb3c48982add45379c0e1b117ec40c1a
W20250830 07:54:36.160034 13219 catalog_manager.cc:4908] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): delete failed for tablet 73853894da074ecd8147a94ac28bfab8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 73853894da074ecd8147a94ac28bfab8 already in progress: creating tablet
I20250830 07:54:36.160157 13230 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet 6a82ea7078e344a497c34f932e139bcd
I20250830 07:54:36.160779 13461 tablet_service.cc:1515] Processing DeleteTablet for tablet 2009012fddc24e4fb7ad0fab33a1103b with delete_type TABLET_DATA_DELETED (replaced by tablet 52e910677ae34630a919d1d3f21b7e83) from {username='slave'} at 127.0.0.1:37956
I20250830 07:54:36.161242 13468 tablet_service.cc:1515] Processing DeleteTablet for tablet cb3c48982add45379c0e1b117ec40c1a with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:36 UTC) from {username='slave'} at 127.0.0.1:37956
I20250830 07:54:36.163005 13229 catalog_manager.cc:5674] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743) does not have the latest schema for tablet c2f5f79547184009a0863b695a833694 (table default.Table_4abf499bcf8a4fd88fd739d3a1daee3a [id=768d7e569197455bb092328ca1b32ed0]). Expected version 2 got 0
I20250830 07:54:36.163283 13468 tablet_service.cc:1515] Processing DeleteTablet for tablet 6a82ea7078e344a497c34f932e139bcd with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:36 UTC) from {username='slave'} at 127.0.0.1:37956
I20250830 07:54:36.163956 13883 ts_tablet_manager.cc:1939] T 02be33dc658d428fa55e59784a2342f6 P 2065c332f15a4739899af79f3669c3ba: Deleting consensus metadata
I20250830 07:54:36.165531 13218 catalog_manager.cc:4928] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): tablet 02be33dc658d428fa55e59784a2342f6 (table default.Table_c8fac6974ea94c7e863c1ded184f9230 [id=761247d93d9f4f788ecceabebf1de486]) successfully deleted
W20250830 07:54:36.171151 13219 catalog_manager.cc:4908] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): delete failed for tablet 30c2558c28944ff39d1a4a4ca9ac604e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 30c2558c28944ff39d1a4a4ca9ac604e already in progress: creating tablet
W20250830 07:54:36.172847 13218 catalog_manager.cc:4908] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): delete failed for tablet 4828280e6fec4338b35422917966ac8c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4828280e6fec4338b35422917966ac8c already in progress: creating tablet
I20250830 07:54:36.173732 13230 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_4d93a3d083764fedb28fcf469ae96c80" } new_table_name: "default.Table_e1ed2f47829e4c758205540705f2f6ec" modify_external_catalogs: true
W20250830 07:54:36.174110 13218 catalog_manager.cc:4908] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): delete failed for tablet 007435e198b9440db055711a98e3148a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 007435e198b9440db055711a98e3148a already in progress: creating tablet
W20250830 07:54:36.174840 13218 catalog_manager.cc:4908] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): delete failed for tablet 66d59910b4b2451a851e9d2728d50f42 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 66d59910b4b2451a851e9d2728d50f42 already in progress: creating tablet
I20250830 07:54:36.175410 13883 tablet_replica.cc:331] T 1fa571e9490e499792225d7b786e8658 P 2065c332f15a4739899af79f3669c3ba: stopping tablet replica
I20250830 07:54:36.175836 13883 raft_consensus.cc:2241] T 1fa571e9490e499792225d7b786e8658 P 2065c332f15a4739899af79f3669c3ba [term 1 LEADER]: Raft consensus shutting down.
I20250830 07:54:36.176718 13232 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_c971df90450b4c17821d0f0a51ae48a3" } modify_external_catalogs: true
I20250830 07:54:36.176944 13232 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_c971df90450b4c17821d0f0a51ae48a3" } modify_external_catalogs: true
I20250830 07:54:36.179520 13883 pending_rounds.cc:70] T 1fa571e9490e499792225d7b786e8658 P 2065c332f15a4739899af79f3669c3ba: Trying to abort 1 pending ops.
I20250830 07:54:36.179870 13883 pending_rounds.cc:77] T 1fa571e9490e499792225d7b786e8658 P 2065c332f15a4739899af79f3669c3ba: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7194789789202063360 op_type: NO_OP noop_request { }
I20250830 07:54:36.180887 13883 raft_consensus.cc:2887] T 1fa571e9490e499792225d7b786e8658 P 2065c332f15a4739899af79f3669c3ba [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20250830 07:54:36.181077 13883 raft_consensus.cc:2270] T 1fa571e9490e499792225d7b786e8658 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20250830 07:54:36.180756 13887 tablet_bootstrap.cc:492] T 05697181c0c149c79a395ff7525ea2af P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:54:36.181329 13887 ts_tablet_manager.cc:1397] T 05697181c0c149c79a395ff7525ea2af P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.153s user 0.003s sys 0.004s
I20250830 07:54:36.182195 13887 raft_consensus.cc:357] T 05697181c0c149c79a395ff7525ea2af P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:54:36.182384 13887 raft_consensus.cc:383] T 05697181c0c149c79a395ff7525ea2af P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:36.182487 13887 raft_consensus.cc:738] T 05697181c0c149c79a395ff7525ea2af P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:54:36.182775 13887 consensus_queue.cc:260] T 05697181c0c149c79a395ff7525ea2af P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:54:36.183490 13887 ts_tablet_manager.cc:1428] T 05697181c0c149c79a395ff7525ea2af P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20250830 07:54:36.186484 13887 tablet_bootstrap.cc:492] T 9b9c2ae8805a48f7959d6745677a96f2 P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:54:36.190976 13883 ts_tablet_manager.cc:1905] T 1fa571e9490e499792225d7b786e8658 P 2065c332f15a4739899af79f3669c3ba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250830 07:54:36.192389 13887 tablet_bootstrap.cc:654] T 9b9c2ae8805a48f7959d6745677a96f2 P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:36.180150 13229 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_c142c85ffb7840f6846fa8831f9363ed" } new_table_name: "default.Table_cfc5a483d4e2458894ca6d5044bbebf6" modify_external_catalogs: true
I20250830 07:54:36.202490 13599 tablet_service.cc:1515] Processing DeleteTablet for tablet 007435e198b9440db055711a98e3148a with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:36 UTC) from {username='slave'} at 127.0.0.1:45306
I20250830 07:54:36.204493 13755 tablet_service.cc:1468] Processing CreateTablet for tablet ec4a3975961d4f85ad9da94835417574 (DEFAULT_TABLE table=default.Table_a0fec9fe1cad48f6a9c37d2b76075510 [id=b37ceb4d0d494fde9ac5d811b88f706c]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:36.204624 13232 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet 5dac49aebcfa476d81547636cd4c6986
I20250830 07:54:36.204953 13755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec4a3975961d4f85ad9da94835417574. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:36.208060 13736 tablet_service.cc:1468] Processing CreateTablet for tablet 51cee993ce4249c0830b29cb1808fe80 (DEFAULT_TABLE table=default.Table_c2c6c57d30d440d691f87632feae3633 [id=34fc9dab5c14465d8f3362d4c9ff5748]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:36.208454 13736 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 51cee993ce4249c0830b29cb1808fe80. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:36.209249 13752 tablet_service.cc:1468] Processing CreateTablet for tablet d6afa1ad4791429ba96ee81583dcee64 (DEFAULT_TABLE table=default.Table_79eac01717044a179c06e461fe6f82bb [id=46e088c9ead5481a868232259267699a]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:36.165704 13882 raft_consensus.cc:357] T 69f2105c5eeb47e9a848ae7bf8779996 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:36.211067 13752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6afa1ad4791429ba96ee81583dcee64. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:36.211258 13629 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "29d492735cd14bb6b4a2a9a3929f62f3" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:36.211575 13459 tablet_service.cc:1515] Processing DeleteTablet for tablet 5dac49aebcfa476d81547636cd4c6986 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:36 UTC) from {username='slave'} at 127.0.0.1:37956
I20250830 07:54:36.212050 13749 tablet_service.cc:1468] Processing CreateTablet for tablet 8eb010d7955d47a89ff1d01be1b5b01e (DEFAULT_TABLE table=default.Table_f5718c63775946638bc63cf7e8708669 [id=10cdb0b0b3ca416b8e7164aa1a37c8c9]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:36.212401 14153 raft_consensus.cc:513] T 29d492735cd14bb6b4a2a9a3929f62f3 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:36.213502 14153 leader_election.cc:290] T 29d492735cd14bb6b4a2a9a3929f62f3 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Requested vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
W20250830 07:54:36.214131 13703 leader_election.cc:343] T 29d492735cd14bb6b4a2a9a3929f62f3 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:36.214412 13742 tablet_service.cc:1515] Processing DeleteTablet for tablet 4828280e6fec4338b35422917966ac8c with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:35 UTC) from {username='slave'} at 127.0.0.1:45460
I20250830 07:54:36.214983 13486 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "29d492735cd14bb6b4a2a9a3929f62f3" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba"
I20250830 07:54:36.215090 13750 tablet_service.cc:1468] Processing CreateTablet for tablet 4828280e6fec4338b35422917966ac8c (DEFAULT_TABLE table=default.Table_fcf6d8285a8a4759b22a5038eb349f72 [id=ccd39c94f435403289f5f425afa4d74e]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:36.215204 13486 raft_consensus.cc:3058] T 29d492735cd14bb6b4a2a9a3929f62f3 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:36.215390 13747 tablet_service.cc:1468] Processing CreateTablet for tablet e4ca3110247640fbae4241448e8d5ef7 (DEFAULT_TABLE table=default.Table_3a3bd36d028a41e39d051f15093ea71d [id=fa763e770a13439084bb86dd227be4cf]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:36.215875 13737 tablet_service.cc:1515] Processing DeleteTablet for tablet 6cf10b7011d444cba0ac758add292477 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:33 UTC) from {username='slave'} at 127.0.0.1:45460
I20250830 07:54:36.216429 13884 tablet_replica.cc:331] T 6cf10b7011d444cba0ac758add292477 P 9b057ade5dce45af9f8bf0bedf8b917f: stopping tablet replica
I20250830 07:54:36.216645 13884 raft_consensus.cc:2241] T 6cf10b7011d444cba0ac758add292477 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 LEADER]: Raft consensus shutting down.
I20250830 07:54:36.216997 13749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8eb010d7955d47a89ff1d01be1b5b01e. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:36.217325 13884 pending_rounds.cc:70] T 6cf10b7011d444cba0ac758add292477 P 9b057ade5dce45af9f8bf0bedf8b917f: Trying to abort 1 pending ops.
I20250830 07:54:36.217386 13884 pending_rounds.cc:77] T 6cf10b7011d444cba0ac758add292477 P 9b057ade5dce45af9f8bf0bedf8b917f: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7194789788476231680 op_type: NO_OP noop_request { }
I20250830 07:54:36.217665 13884 raft_consensus.cc:2887] T 6cf10b7011d444cba0ac758add292477 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20250830 07:54:36.217757 13884 raft_consensus.cc:2270] T 6cf10b7011d444cba0ac758add292477 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Raft consensus is shut down!
I20250830 07:54:36.218276 13737 tablet_service.cc:1515] Processing DeleteTablet for tablet 69f2105c5eeb47e9a848ae7bf8779996 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:33 UTC) from {username='slave'} at 127.0.0.1:45460
I20250830 07:54:36.218269 13486 raft_consensus.cc:2466] T 29d492735cd14bb6b4a2a9a3929f62f3 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 1.
I20250830 07:54:36.218861 13884 ts_tablet_manager.cc:1905] T 6cf10b7011d444cba0ac758add292477 P 9b057ade5dce45af9f8bf0bedf8b917f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250830 07:54:36.220957 13701 leader_election.cc:304] T 29d492735cd14bb6b4a2a9a3929f62f3 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters:
I20250830 07:54:36.220997 13595 tablet_service.cc:1515] Processing DeleteTablet for tablet 2009012fddc24e4fb7ad0fab33a1103b with delete_type TABLET_DATA_DELETED (replaced by tablet 52e910677ae34630a919d1d3f21b7e83) from {username='slave'} at 127.0.0.1:45306
I20250830 07:54:36.221292 14153 raft_consensus.cc:2802] T 29d492735cd14bb6b4a2a9a3929f62f3 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election won for term 1
I20250830 07:54:36.221431 14153 raft_consensus.cc:695] T 29d492735cd14bb6b4a2a9a3929f62f3 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 LEADER]: Becoming Leader. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Running, Role: LEADER
I20250830 07:54:36.221693 14153 consensus_queue.cc:237] T 29d492735cd14bb6b4a2a9a3929f62f3 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:36.221858 13883 ts_tablet_manager.cc:1918] T 1fa571e9490e499792225d7b786e8658 P 2065c332f15a4739899af79f3669c3ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250830 07:54:36.221974 13883 log.cc:1199] T 1fa571e9490e499792225d7b786e8658 P 2065c332f15a4739899af79f3669c3ba: Deleting WAL directory at /tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/ts-0/wal/wals/1fa571e9490e499792225d7b786e8658
I20250830 07:54:36.223290 13882 raft_consensus.cc:383] T 69f2105c5eeb47e9a848ae7bf8779996 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:36.224198 13737 tablet_service.cc:1515] Processing DeleteTablet for tablet 66d59910b4b2451a851e9d2728d50f42 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:35 UTC) from {username='slave'} at 127.0.0.1:45460
I20250830 07:54:36.224694 13738 tablet_service.cc:1515] Processing DeleteTablet for tablet cb3c48982add45379c0e1b117ec40c1a with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:36 UTC) from {username='slave'} at 127.0.0.1:45460
I20250830 07:54:36.224874 13750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4828280e6fec4338b35422917966ac8c. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:36.224694 13742 tablet_service.cc:1515] Processing DeleteTablet for tablet 007435e198b9440db055711a98e3148a with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:36 UTC) from {username='slave'} at 127.0.0.1:45460
I20250830 07:54:36.225137 13747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e4ca3110247640fbae4241448e8d5ef7. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:36.225176 13746 tablet_service.cc:1515] Processing DeleteTablet for tablet 2009012fddc24e4fb7ad0fab33a1103b with delete_type TABLET_DATA_DELETED (replaced by tablet 52e910677ae34630a919d1d3f21b7e83) from {username='slave'} at 127.0.0.1:45460
I20250830 07:54:36.225744 13883 ts_tablet_manager.cc:1939] T 1fa571e9490e499792225d7b786e8658 P 2065c332f15a4739899af79f3669c3ba: Deleting consensus metadata
W20250830 07:54:36.228164 13219 catalog_manager.cc:4895] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): delete failed for tablet 4828280e6fec4338b35422917966ac8c because the tablet was not found. No further retry: Not found: Tablet not found: 4828280e6fec4338b35422917966ac8c
I20250830 07:54:36.228668 13599 tablet_service.cc:1515] Processing DeleteTablet for tablet cb3c48982add45379c0e1b117ec40c1a with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:36 UTC) from {username='slave'} at 127.0.0.1:45306
I20250830 07:54:36.228940 13746 tablet_service.cc:1515] Processing DeleteTablet for tablet 5dac49aebcfa476d81547636cd4c6986 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:36 UTC) from {username='slave'} at 127.0.0.1:45460
I20250830 07:54:36.229188 13218 catalog_manager.cc:4928] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): tablet 1fa571e9490e499792225d7b786e8658 (table default.Table_12c9ea9f75c24214838d600088c31bcf [id=b51964a7d7d14d6db2fd35783c905bbc]) successfully deleted
W20250830 07:54:36.229460 13218 catalog_manager.cc:4908] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): delete failed for tablet 2009012fddc24e4fb7ad0fab33a1103b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2009012fddc24e4fb7ad0fab33a1103b already in progress: creating tablet
W20250830 07:54:36.229666 13218 catalog_manager.cc:4908] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): delete failed for tablet cb3c48982add45379c0e1b117ec40c1a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cb3c48982add45379c0e1b117ec40c1a already in progress: creating tablet
W20250830 07:54:36.229893 13218 catalog_manager.cc:4908] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): delete failed for tablet 6a82ea7078e344a497c34f932e139bcd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6a82ea7078e344a497c34f932e139bcd already in progress: creating tablet
W20250830 07:54:36.230129 13218 catalog_manager.cc:4908] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): delete failed for tablet 5dac49aebcfa476d81547636cd4c6986 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5dac49aebcfa476d81547636cd4c6986 already in progress: creating tablet
I20250830 07:54:36.230309 13737 tablet_service.cc:1515] Processing DeleteTablet for tablet 6a82ea7078e344a497c34f932e139bcd with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:36 UTC) from {username='slave'} at 127.0.0.1:45460
I20250830 07:54:36.234397 13606 tablet_service.cc:1515] Processing DeleteTablet for tablet 6a82ea7078e344a497c34f932e139bcd with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:36 UTC) from {username='slave'} at 127.0.0.1:45306
I20250830 07:54:36.236114 13629 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "29d492735cd14bb6b4a2a9a3929f62f3" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9"
I20250830 07:54:36.238023 13882 raft_consensus.cc:738] T 69f2105c5eeb47e9a848ae7bf8779996 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:54:36.239519 13595 tablet_service.cc:1515] Processing DeleteTablet for tablet 5dac49aebcfa476d81547636cd4c6986 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:36 UTC) from {username='slave'} at 127.0.0.1:45306
W20250830 07:54:36.240005 13703 leader_election.cc:343] T 29d492735cd14bb6b4a2a9a3929f62f3 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:36.240394 14247 consensus_queue.cc:1035] T 1933d49d319b4bd7b717dda2b83859f3 P 2065c332f15a4739899af79f3669c3ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:54:36.241938 13882 consensus_queue.cc:260] T 69f2105c5eeb47e9a848ae7bf8779996 P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:36.244040 14247 consensus_queue.cc:1035] T e134ab64aa1b4ce89e295b43cbc3fffb P 2065c332f15a4739899af79f3669c3ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:54:36.244593 13884 ts_tablet_manager.cc:1918] T 6cf10b7011d444cba0ac758add292477 P 9b057ade5dce45af9f8bf0bedf8b917f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250830 07:54:36.244735 13884 log.cc:1199] T 6cf10b7011d444cba0ac758add292477 P 9b057ade5dce45af9f8bf0bedf8b917f: Deleting WAL directory at /tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/ts-2/wal/wals/6cf10b7011d444cba0ac758add292477
I20250830 07:54:36.245128 13884 ts_tablet_manager.cc:1939] T 6cf10b7011d444cba0ac758add292477 P 9b057ade5dce45af9f8bf0bedf8b917f: Deleting consensus metadata
I20250830 07:54:36.246104 13884 tablet_replica.cc:331] T 69f2105c5eeb47e9a848ae7bf8779996 P 9b057ade5dce45af9f8bf0bedf8b917f: stopping tablet replica
I20250830 07:54:36.246308 13884 raft_consensus.cc:2241] T 69f2105c5eeb47e9a848ae7bf8779996 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Raft consensus shutting down.
I20250830 07:54:36.246488 13884 raft_consensus.cc:2270] T 69f2105c5eeb47e9a848ae7bf8779996 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Raft consensus is shut down!
I20250830 07:54:36.246537 13219 catalog_manager.cc:4928] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): tablet 6cf10b7011d444cba0ac758add292477 (table default.Table_68a8222fb01847ca88079ba1dead8d71 [id=f15ded59e09140d1a284a41572e297a0]) successfully deleted
I20250830 07:54:36.247117 13887 tablet_bootstrap.cc:492] T 9b9c2ae8805a48f7959d6745677a96f2 P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:54:36.247289 13887 ts_tablet_manager.cc:1397] T 9b9c2ae8805a48f7959d6745677a96f2 P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.063s user 0.007s sys 0.010s
I20250830 07:54:36.247541 13882 ts_tablet_manager.cc:1428] T 69f2105c5eeb47e9a848ae7bf8779996 P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.232s user 0.004s sys 0.000s
I20250830 07:54:36.254000 13886 tablet_bootstrap.cc:492] T 6f2d855ab3c04123b2f9ea22cda6ef04 P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:54:36.254202 13886 ts_tablet_manager.cc:1397] T 6f2d855ab3c04123b2f9ea22cda6ef04 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.101s user 0.005s sys 0.001s
I20250830 07:54:36.255110 13886 raft_consensus.cc:357] T 6f2d855ab3c04123b2f9ea22cda6ef04 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:54:36.255326 13886 raft_consensus.cc:383] T 6f2d855ab3c04123b2f9ea22cda6ef04 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:36.255393 13886 raft_consensus.cc:738] T 6f2d855ab3c04123b2f9ea22cda6ef04 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:54:36.255617 13886 consensus_queue.cc:260] T 6f2d855ab3c04123b2f9ea22cda6ef04 P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:54:36.256114 13886 ts_tablet_manager.cc:1428] T 6f2d855ab3c04123b2f9ea22cda6ef04 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20250830 07:54:36.257997 13885 ts_tablet_manager.cc:1918] T 62cf192967d94ecf954d3e965a4d9c9b P 6b5e454d98894637b466ea27f1b647f9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250830 07:54:36.258286 13882 tablet_bootstrap.cc:492] T 1fa571e9490e499792225d7b786e8658 P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
W20250830 07:54:36.261118 13423 consensus_peers.cc:489] T e134ab64aa1b4ce89e295b43cbc3fffb P 2065c332f15a4739899af79f3669c3ba -> Peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Couldn't send request to peer 6b5e454d98894637b466ea27f1b647f9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20250830 07:54:36.272728 13234 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_0f1c1d835d57490a8d95803a9a51e3a9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:36.273499 13234 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0f1c1d835d57490a8d95803a9a51e3a9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250830 07:54:36.274509 13229 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 04eadf45b82e4c319eb7b316a402d81a consensus state has no leader
I20250830 07:54:36.274941 13228 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_755878fc02ed4123b6d4a592e1b87a58" } new_table_name: "default.Table_78284117ae8d41f7a9404cd74bf3f2a2" modify_external_catalogs: true
I20250830 07:54:36.275313 13232 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_c31165e5edb0449b86fa51f639e07fb6" } modify_external_catalogs: true
I20250830 07:54:36.275499 13232 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_c31165e5edb0449b86fa51f639e07fb6" } modify_external_catalogs: true
I20250830 07:54:36.275584 13230 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_e1ed2f47829e4c758205540705f2f6ec" } new_table_name: "default.Table_53b3c649c07a4c328e41b846806f0f8b" modify_external_catalogs: true
I20250830 07:54:36.274984 13229 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_941683cb836e4df7a4f2cf11c6b54f0e" } modify_external_catalogs: true
I20250830 07:54:36.276594 13229 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_941683cb836e4df7a4f2cf11c6b54f0e" } modify_external_catalogs: true
I20250830 07:54:36.277102 13233 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_b5663761ffc54702be1146492aaf6430"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:36.277645 13233 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b5663761ffc54702be1146492aaf6430 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:36.278265 13885 log.cc:1199] T 62cf192967d94ecf954d3e965a4d9c9b P 6b5e454d98894637b466ea27f1b647f9: Deleting WAL directory at /tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/ts-1/wal/wals/62cf192967d94ecf954d3e965a4d9c9b
I20250830 07:54:36.278849 13226 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_b80e6d1dfec04784820a83f2122542f6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:36.279325 13226 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b80e6d1dfec04784820a83f2122542f6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250830 07:54:36.281375 13227 catalog_manager.cc:5415] Ignoring report from unknown tablet 69f2105c5eeb47e9a848ae7bf8779996
I20250830 07:54:36.282174 13225 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_ba9345bf0ef34b1d91aae9fb48945102"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250830 07:54:36.282514 13885 ts_tablet_manager.cc:1939] T 62cf192967d94ecf954d3e965a4d9c9b P 6b5e454d98894637b466ea27f1b647f9: Deleting consensus metadata
W20250830 07:54:36.282639 13225 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ba9345bf0ef34b1d91aae9fb48945102 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:36.283593 13220 catalog_manager.cc:4928] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): tablet 62cf192967d94ecf954d3e965a4d9c9b (table default.Table_fc6a95f74a1d457d9b5b3b6a6345b834 [id=b983c24ca8174434b0e2c276a9b93495]) successfully deleted
I20250830 07:54:36.284335 13231 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_739e22d6e6554d3d8859e047e088514f" } new_table_name: "default.Table_31c70ac145a8402ca709a5ffdeaaffb3" modify_external_catalogs: true
I20250830 07:54:36.285832 13885 tablet_replica.cc:331] T 6cf10b7011d444cba0ac758add292477 P 6b5e454d98894637b466ea27f1b647f9: stopping tablet replica
I20250830 07:54:36.286226 13885 raft_consensus.cc:2241] T 6cf10b7011d444cba0ac758add292477 P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250830 07:54:36.295496 13882 tablet_bootstrap.cc:654] T 1fa571e9490e499792225d7b786e8658 P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:36.295822 13884 ts_tablet_manager.cc:1905] T 69f2105c5eeb47e9a848ae7bf8779996 P 9b057ade5dce45af9f8bf0bedf8b917f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250830 07:54:36.298241 13886 tablet_bootstrap.cc:492] T ed87c6793dd149a6a363f1977d816628 P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:54:36.298260 13887 raft_consensus.cc:357] T 9b9c2ae8805a48f7959d6745677a96f2 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:54:36.299402 13887 raft_consensus.cc:383] T 9b9c2ae8805a48f7959d6745677a96f2 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:36.299670 13887 raft_consensus.cc:738] T 9b9c2ae8805a48f7959d6745677a96f2 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:54:36.300042 13886 tablet_bootstrap.cc:654] T ed87c6793dd149a6a363f1977d816628 P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:36.305996 13885 raft_consensus.cc:2270] T 6cf10b7011d444cba0ac758add292477 P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250830 07:54:36.314706 13227 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_4320c5ce2b254d82870834c4a358fefa"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:36.315548 13227 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4320c5ce2b254d82870834c4a358fefa in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250830 07:54:36.320868 13234 catalog_manager.cc:5415] Ignoring report from unknown tablet 29d492735cd14bb6b4a2a9a3929f62f3
I20250830 07:54:36.321414 13234 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_3c6b83acc24c48e4ace89e977f29c549"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:36.321923 13234 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3c6b83acc24c48e4ace89e977f29c549 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:36.323096 14256 raft_consensus.cc:491] T 69f2105c5eeb47e9a848ae7bf8779996 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:36.323251 14256 raft_consensus.cc:513] T 69f2105c5eeb47e9a848ae7bf8779996 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:36.324080 14256 leader_election.cc:290] T 69f2105c5eeb47e9a848ae7bf8779996 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:36.325546 13886 tablet_bootstrap.cc:492] T ed87c6793dd149a6a363f1977d816628 P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:54:36.325692 13886 ts_tablet_manager.cc:1397] T ed87c6793dd149a6a363f1977d816628 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.031s user 0.002s sys 0.007s
I20250830 07:54:36.326522 13773 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "69f2105c5eeb47e9a848ae7bf8779996" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:36.328680 13885 ts_tablet_manager.cc:1905] T 6cf10b7011d444cba0ac758add292477 P 6b5e454d98894637b466ea27f1b647f9: Deleting tablet data with delete state TABLET_DATA_DELETED
W20250830 07:54:36.329371 13561 leader_election.cc:343] T 69f2105c5eeb47e9a848ae7bf8779996 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): Not found: Tablet not found: 69f2105c5eeb47e9a848ae7bf8779996
W20250830 07:54:36.332713 13562 leader_election.cc:343] T 69f2105c5eeb47e9a848ae7bf8779996 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Illegal state: Tablet not RUNNING: STOPPED
I20250830 07:54:36.333032 13562 leader_election.cc:304] T 69f2105c5eeb47e9a848ae7bf8779996 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b5e454d98894637b466ea27f1b647f9; no voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:54:36.333127 13230 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_7a75311e3f8f4af1b7cf203012949ba4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:36.333652 13230 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7a75311e3f8f4af1b7cf203012949ba4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:36.337507 13232 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet 8f215330505848619ad44569d3167591
I20250830 07:54:36.337754 13956 raft_consensus.cc:2747] T 69f2105c5eeb47e9a848ae7bf8779996 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:54:36.338393 13229 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet 8ab12188dddc4de69ac73dffb01d51a9
I20250830 07:54:36.339105 13459 tablet_service.cc:1515] Processing DeleteTablet for tablet 8f215330505848619ad44569d3167591 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:36 UTC) from {username='slave'} at 127.0.0.1:37956
I20250830 07:54:36.340091 13459 tablet_service.cc:1515] Processing DeleteTablet for tablet 8ab12188dddc4de69ac73dffb01d51a9 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:36 UTC) from {username='slave'} at 127.0.0.1:37956
W20250830 07:54:36.341310 13218 catalog_manager.cc:4908] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): delete failed for tablet 8f215330505848619ad44569d3167591 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8f215330505848619ad44569d3167591 already in progress: creating tablet
I20250830 07:54:36.341787 13598 tablet_service.cc:1515] Processing DeleteTablet for tablet 8f215330505848619ad44569d3167591 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:36 UTC) from {username='slave'} at 127.0.0.1:45306
W20250830 07:54:36.341852 13218 catalog_manager.cc:4908] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): delete failed for tablet 8ab12188dddc4de69ac73dffb01d51a9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8ab12188dddc4de69ac73dffb01d51a9 already in progress: creating tablet
I20250830 07:54:36.344245 13749 tablet_service.cc:1515] Processing DeleteTablet for tablet 8f215330505848619ad44569d3167591 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:36 UTC) from {username='slave'} at 127.0.0.1:45460
W20250830 07:54:36.344631 13229 catalog_manager.cc:5415] Ignoring report from unknown tablet 1933d49d319b4bd7b717dda2b83859f3
W20250830 07:54:36.344727 13229 catalog_manager.cc:5415] Ignoring report from unknown tablet 69f2105c5eeb47e9a848ae7bf8779996
I20250830 07:54:36.345305 13752 tablet_service.cc:1515] Processing DeleteTablet for tablet 8ab12188dddc4de69ac73dffb01d51a9 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:36 UTC) from {username='slave'} at 127.0.0.1:45460
I20250830 07:54:36.347738 13608 tablet_service.cc:1515] Processing DeleteTablet for tablet 8ab12188dddc4de69ac73dffb01d51a9 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:36 UTC) from {username='slave'} at 127.0.0.1:45306
I20250830 07:54:36.348184 14153 raft_consensus.cc:491] T ff0f9cccc8ed43b1a8cd38de0e9d4097 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:36.348361 14153 raft_consensus.cc:513] T ff0f9cccc8ed43b1a8cd38de0e9d4097 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:36.349074 14153 leader_election.cc:290] T ff0f9cccc8ed43b1a8cd38de0e9d4097 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967)
I20250830 07:54:36.350092 13485 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "ff0f9cccc8ed43b1a8cd38de0e9d4097" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:54:36.350325 13485 raft_consensus.cc:2466] T ff0f9cccc8ed43b1a8cd38de0e9d4097 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 1.
W20250830 07:54:36.351914 13703 leader_election.cc:343] T ff0f9cccc8ed43b1a8cd38de0e9d4097 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Not found: Tablet not found: ff0f9cccc8ed43b1a8cd38de0e9d4097
I20250830 07:54:36.344677 13886 raft_consensus.cc:357] T ed87c6793dd149a6a363f1977d816628 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:54:36.352587 13886 raft_consensus.cc:383] T ed87c6793dd149a6a363f1977d816628 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:36.352753 13886 raft_consensus.cc:738] T ed87c6793dd149a6a363f1977d816628 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:54:36.353593 13701 leader_election.cc:304] T ff0f9cccc8ed43b1a8cd38de0e9d4097 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:54:36.353852 13885 ts_tablet_manager.cc:1918] T 6cf10b7011d444cba0ac758add292477 P 6b5e454d98894637b466ea27f1b647f9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250830 07:54:36.353957 13885 log.cc:1199] T 6cf10b7011d444cba0ac758add292477 P 6b5e454d98894637b466ea27f1b647f9: Deleting WAL directory at /tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/ts-1/wal/wals/6cf10b7011d444cba0ac758add292477
I20250830 07:54:36.354341 13885 ts_tablet_manager.cc:1939] T 6cf10b7011d444cba0ac758add292477 P 6b5e454d98894637b466ea27f1b647f9: Deleting consensus metadata
W20250830 07:54:36.354938 13228 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 0208de98277c4d6889fb0289b6013ae1 has no consensus state
I20250830 07:54:36.353114 13886 consensus_queue.cc:260] T ed87c6793dd149a6a363f1977d816628 P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:54:36.356720 14153 raft_consensus.cc:2802] T ff0f9cccc8ed43b1a8cd38de0e9d4097 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20250830 07:54:36.356824 14153 raft_consensus.cc:491] T ff0f9cccc8ed43b1a8cd38de0e9d4097 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:54:36.356896 14153 raft_consensus.cc:3058] T ff0f9cccc8ed43b1a8cd38de0e9d4097 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Advancing to term 2
I20250830 07:54:36.360081 13228 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_8c549af74ae14e02bf6c6866959590cc"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:36.360667 13228 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8c549af74ae14e02bf6c6866959590cc in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:36.361963 13231 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_1ec96f693c91430b9170e6812cd247d8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:36.362474 13231 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1ec96f693c91430b9170e6812cd247d8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:36.363694 13226 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_654a7f85db4149ab81cf988af807fe0b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:36.364212 13226 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_654a7f85db4149ab81cf988af807fe0b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:36.364892 13233 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_89b4b1b127ef49c1ad0bdff27ca49888" } modify_external_catalogs: true
I20250830 07:54:36.365073 13233 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_89b4b1b127ef49c1ad0bdff27ca49888" } modify_external_catalogs: true
I20250830 07:54:36.365417 13225 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_2bb70ab8f64a485c909945f467efe644" } modify_external_catalogs: true
I20250830 07:54:36.365588 13225 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_2bb70ab8f64a485c909945f467efe644" } modify_external_catalogs: true
W20250830 07:54:36.369462 13229 catalog_manager.cc:5415] Ignoring report from unknown tablet 1933d49d319b4bd7b717dda2b83859f3
I20250830 07:54:36.371079 13627 raft_consensus.cc:1273] T c9a8f144d50c4d3d81fbf43ce29a2ad2 P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Refusing update from remote peer 9b057ade5dce45af9f8bf0bedf8b917f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250830 07:54:36.373526 14153 raft_consensus.cc:513] T ff0f9cccc8ed43b1a8cd38de0e9d4097 P 9b057ade5dce45af9f8bf0bedf8b917f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
W20250830 07:54:36.375695 13703 leader_election.cc:343] T ff0f9cccc8ed43b1a8cd38de0e9d4097 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Not found: Tablet not found: ff0f9cccc8ed43b1a8cd38de0e9d4097
I20250830 07:54:36.375962 13886 ts_tablet_manager.cc:1428] T ed87c6793dd149a6a363f1977d816628 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.050s user 0.002s sys 0.004s
I20250830 07:54:36.376633 13886 tablet_bootstrap.cc:492] T 7c8e248d938f4651ae13199122b08768 P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:54:36.377223 14153 leader_election.cc:290] T ff0f9cccc8ed43b1a8cd38de0e9d4097 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 2 election: Requested vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967)
I20250830 07:54:36.377810 13220 catalog_manager.cc:4928] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): tablet 6cf10b7011d444cba0ac758add292477 (table default.Table_68a8222fb01847ca88079ba1dead8d71 [id=f15ded59e09140d1a284a41572e297a0]) successfully deleted
I20250830 07:54:36.377720 14153 consensus_queue.cc:1035] T c9a8f144d50c4d3d81fbf43ce29a2ad2 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20250830 07:54:36.378743 13220 catalog_manager.cc:4908] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet 007435e198b9440db055711a98e3148a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 007435e198b9440db055711a98e3148a already in progress: creating tablet
W20250830 07:54:36.379761 13220 catalog_manager.cc:4908] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet 2009012fddc24e4fb7ad0fab33a1103b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2009012fddc24e4fb7ad0fab33a1103b already in progress: creating tablet
I20250830 07:54:36.382279 13886 tablet_bootstrap.cc:654] T 7c8e248d938f4651ae13199122b08768 P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:36.384624 13882 tablet_bootstrap.cc:492] T 1fa571e9490e499792225d7b786e8658 P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:54:36.384820 13882 ts_tablet_manager.cc:1397] T 1fa571e9490e499792225d7b786e8658 P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.135s user 0.003s sys 0.012s
W20250830 07:54:36.385465 13220 catalog_manager.cc:4908] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet cb3c48982add45379c0e1b117ec40c1a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cb3c48982add45379c0e1b117ec40c1a already in progress: creating tablet
W20250830 07:54:36.386212 13220 catalog_manager.cc:4908] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet 6a82ea7078e344a497c34f932e139bcd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6a82ea7078e344a497c34f932e139bcd already in progress: creating tablet
I20250830 07:54:36.386308 13882 raft_consensus.cc:357] T 1fa571e9490e499792225d7b786e8658 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:36.386516 13882 raft_consensus.cc:383] T 1fa571e9490e499792225d7b786e8658 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:36.386597 13882 raft_consensus.cc:738] T 1fa571e9490e499792225d7b786e8658 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
W20250830 07:54:36.392963 13220 catalog_manager.cc:4908] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet 5dac49aebcfa476d81547636cd4c6986 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5dac49aebcfa476d81547636cd4c6986 already in progress: creating tablet
W20250830 07:54:36.395614 13220 catalog_manager.cc:4908] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet 8f215330505848619ad44569d3167591 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8f215330505848619ad44569d3167591 already in progress: creating tablet
W20250830 07:54:36.396534 13220 catalog_manager.cc:4908] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet 8ab12188dddc4de69ac73dffb01d51a9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8ab12188dddc4de69ac73dffb01d51a9 already in progress: creating tablet
I20250830 07:54:36.400564 13887 consensus_queue.cc:260] T 9b9c2ae8805a48f7959d6745677a96f2 P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:54:36.386830 13882 consensus_queue.cc:260] T 1fa571e9490e499792225d7b786e8658 P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:36.406476 13882 ts_tablet_manager.cc:1428] T 1fa571e9490e499792225d7b786e8658 P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.022s user 0.003s sys 0.000s
I20250830 07:54:36.406809 13882 tablet_bootstrap.cc:492] T 29d492735cd14bb6b4a2a9a3929f62f3 P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:54:36.408640 13882 tablet_bootstrap.cc:654] T 29d492735cd14bb6b4a2a9a3929f62f3 P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:36.410192 13227 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_ad824ae7601a4c6b9e756946853e09c7" } modify_external_catalogs: true
I20250830 07:54:36.410383 13227 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_ad824ae7601a4c6b9e756946853e09c7" } modify_external_catalogs: true
I20250830 07:54:36.410598 13232 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_f59f9a045aae424caca65408c4e7809b" } new_table_name: "default.Table_e0d2400861094b258fca0704d88ed743" modify_external_catalogs: true
I20250830 07:54:36.411397 13887 ts_tablet_manager.cc:1428] T 9b9c2ae8805a48f7959d6745677a96f2 P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.164s user 0.001s sys 0.001s
W20250830 07:54:36.413058 13229 catalog_manager.cc:5415] Ignoring report from unknown tablet 9b9c2ae8805a48f7959d6745677a96f2
W20250830 07:54:36.419920 13701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.209.1:45325, user_credentials={real_user=slave}} blocked reactor thread for 65327.5us
I20250830 07:54:36.420926 13485 raft_consensus.cc:1273] T c9a8f144d50c4d3d81fbf43ce29a2ad2 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Refusing update from remote peer 9b057ade5dce45af9f8bf0bedf8b917f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250830 07:54:36.421777 14294 raft_consensus.cc:491] T bcdac588f7c24d9d8572949e09b80a23 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:36.421947 14153 consensus_queue.cc:1035] T c9a8f144d50c4d3d81fbf43ce29a2ad2 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:54:36.421990 13954 consensus_queue.cc:1035] T 1933d49d319b4bd7b717dda2b83859f3 P 2065c332f15a4739899af79f3669c3ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20250830 07:54:36.422469 13487 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "ff0f9cccc8ed43b1a8cd38de0e9d4097" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba"
I20250830 07:54:36.422652 13487 raft_consensus.cc:3058] T ff0f9cccc8ed43b1a8cd38de0e9d4097 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Advancing to term 2
I20250830 07:54:36.424113 13887 tablet_bootstrap.cc:492] T 861809cc50764aa89140e587489e2d88 P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
W20250830 07:54:36.425554 13229 catalog_manager.cc:5415] Ignoring report from unknown tablet 9b9c2ae8805a48f7959d6745677a96f2
I20250830 07:54:36.425688 13487 raft_consensus.cc:2466] T ff0f9cccc8ed43b1a8cd38de0e9d4097 P 2065c332f15a4739899af79f3669c3ba [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 2.
I20250830 07:54:36.426028 13887 tablet_bootstrap.cc:654] T 861809cc50764aa89140e587489e2d88 P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:36.421958 14294 raft_consensus.cc:513] T bcdac588f7c24d9d8572949e09b80a23 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:36.429632 14291 tablet.cc:1722] T d0238794efb14150af6138b0d8bd80ec P 2065c332f15a4739899af79f3669c3ba: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20250830 07:54:36.430330 13701 leader_election.cc:304] T ff0f9cccc8ed43b1a8cd38de0e9d4097 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:54:36.432333 13886 tablet_bootstrap.cc:492] T 7c8e248d938f4651ae13199122b08768 P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:54:36.433051 13886 ts_tablet_manager.cc:1397] T 7c8e248d938f4651ae13199122b08768 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.056s user 0.010s sys 0.003s
I20250830 07:54:36.435081 14287 raft_consensus.cc:2802] T ff0f9cccc8ed43b1a8cd38de0e9d4097 P 9b057ade5dce45af9f8bf0bedf8b917f [term 2 FOLLOWER]: Leader election won for term 2
I20250830 07:54:36.435318 14287 raft_consensus.cc:695] T ff0f9cccc8ed43b1a8cd38de0e9d4097 P 9b057ade5dce45af9f8bf0bedf8b917f [term 2 LEADER]: Becoming Leader. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Running, Role: LEADER
I20250830 07:54:36.435847 14287 consensus_queue.cc:237] T ff0f9cccc8ed43b1a8cd38de0e9d4097 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:36.440343 13486 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "bcdac588f7c24d9d8572949e09b80a23" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:54:36.440392 13886 raft_consensus.cc:357] T 7c8e248d938f4651ae13199122b08768 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:54:36.440604 13486 raft_consensus.cc:2391] T bcdac588f7c24d9d8572949e09b80a23 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b057ade5dce45af9f8bf0bedf8b917f in current term 1: Already voted for candidate 6b5e454d98894637b466ea27f1b647f9 in this term.
I20250830 07:54:36.440689 14294 leader_election.cc:290] T bcdac588f7c24d9d8572949e09b80a23 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
I20250830 07:54:36.443171 13627 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "bcdac588f7c24d9d8572949e09b80a23" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:36.443799 13886 raft_consensus.cc:383] T 7c8e248d938f4651ae13199122b08768 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:36.443917 13886 raft_consensus.cc:738] T 7c8e248d938f4651ae13199122b08768 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:54:36.444036 13703 leader_election.cc:304] T bcdac588f7c24d9d8572949e09b80a23 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 2065c332f15a4739899af79f3669c3ba, 6b5e454d98894637b466ea27f1b647f9
I20250830 07:54:36.444459 13886 consensus_queue.cc:260] T 7c8e248d938f4651ae13199122b08768 P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:54:36.445008 13886 ts_tablet_manager.cc:1428] T 7c8e248d938f4651ae13199122b08768 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.012s user 0.000s sys 0.002s
I20250830 07:54:36.445801 13886 tablet_bootstrap.cc:492] T 1476bb480bf747838613948875001c30 P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:54:36.448644 14292 tablet.cc:1722] T d0238794efb14150af6138b0d8bd80ec P 9b057ade5dce45af9f8bf0bedf8b917f: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20250830 07:54:36.448750 14167 raft_consensus.cc:3058] T bcdac588f7c24d9d8572949e09b80a23 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:36.450289 14294 raft_consensus.cc:491] T 7c8e248d938f4651ae13199122b08768 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:36.452461 14294 raft_consensus.cc:513] T 7c8e248d938f4651ae13199122b08768 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:54:36.456408 13886 tablet_bootstrap.cc:654] T 1476bb480bf747838613948875001c30 P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:36.458636 13486 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "7c8e248d938f4651ae13199122b08768" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:54:36.457882 14294 leader_election.cc:290] T 7c8e248d938f4651ae13199122b08768 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
I20250830 07:54:36.467860 13627 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "7c8e248d938f4651ae13199122b08768" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
W20250830 07:54:36.468793 13703 leader_election.cc:343] T 7c8e248d938f4651ae13199122b08768 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
W20250830 07:54:36.469790 13701 leader_election.cc:343] T 7c8e248d938f4651ae13199122b08768 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:36.470063 13701 leader_election.cc:304] T 7c8e248d938f4651ae13199122b08768 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 2065c332f15a4739899af79f3669c3ba, 6b5e454d98894637b466ea27f1b647f9
I20250830 07:54:36.470471 14294 raft_consensus.cc:2747] T 7c8e248d938f4651ae13199122b08768 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:54:36.474502 13887 tablet_bootstrap.cc:492] T 861809cc50764aa89140e587489e2d88 P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:54:36.475155 13887 ts_tablet_manager.cc:1397] T 861809cc50764aa89140e587489e2d88 P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.051s user 0.005s sys 0.001s
I20250830 07:54:36.476056 13887 raft_consensus.cc:357] T 861809cc50764aa89140e587489e2d88 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:54:36.476241 13887 raft_consensus.cc:383] T 861809cc50764aa89140e587489e2d88 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:36.476338 13887 raft_consensus.cc:738] T 861809cc50764aa89140e587489e2d88 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:54:36.476642 13887 consensus_queue.cc:260] T 861809cc50764aa89140e587489e2d88 P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:54:36.477018 13884 ts_tablet_manager.cc:1918] T 69f2105c5eeb47e9a848ae7bf8779996 P 9b057ade5dce45af9f8bf0bedf8b917f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250830 07:54:36.477279 13884 log.cc:1199] T 69f2105c5eeb47e9a848ae7bf8779996 P 9b057ade5dce45af9f8bf0bedf8b917f: Deleting WAL directory at /tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/ts-2/wal/wals/69f2105c5eeb47e9a848ae7bf8779996
I20250830 07:54:36.479254 13887 ts_tablet_manager.cc:1428] T 861809cc50764aa89140e587489e2d88 P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20250830 07:54:36.479789 14153 consensus_queue.cc:1035] T 4c2c85732d454cd98efc2646af9450ed P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:54:36.479606 13887 tablet_bootstrap.cc:492] T 5dac49aebcfa476d81547636cd4c6986 P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:54:36.486980 13887 tablet_bootstrap.cc:654] T 5dac49aebcfa476d81547636cd4c6986 P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:36.488126 14314 tablet.cc:1722] T c9a8f144d50c4d3d81fbf43ce29a2ad2 P 9b057ade5dce45af9f8bf0bedf8b917f: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 9
I20250830 07:54:36.491048 13884 ts_tablet_manager.cc:1939] T 69f2105c5eeb47e9a848ae7bf8779996 P 9b057ade5dce45af9f8bf0bedf8b917f: Deleting consensus metadata
I20250830 07:54:36.497002 13882 tablet_bootstrap.cc:492] T 29d492735cd14bb6b4a2a9a3929f62f3 P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:54:36.499715 13229 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_70545768e27a4371965785132ad85c9c" } new_table_name: "default.Table_707da4392f44468095ba243aacef5dd9" modify_external_catalogs: true
I20250830 07:54:36.502553 13230 catalog_manager.cc:5674] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967) does not have the latest schema for tablet c9a8f144d50c4d3d81fbf43ce29a2ad2 (table default.Table_31c70ac145a8402ca709a5ffdeaaffb3 [id=d2dbb756d66b483ebe44d45ddfa5c17c]). Expected version 9 got 0
W20250830 07:54:36.504951 13234 catalog_manager.cc:5415] Ignoring report from unknown tablet f398e12cd9f543738d5163354f8a9d9d
W20250830 07:54:36.505088 13234 catalog_manager.cc:5415] Ignoring report from unknown tablet 6f2d855ab3c04123b2f9ea22cda6ef04
W20250830 07:54:36.505143 13234 catalog_manager.cc:5415] Ignoring report from unknown tablet e134ab64aa1b4ce89e295b43cbc3fffb
I20250830 07:54:36.506985 13219 catalog_manager.cc:4928] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): tablet 69f2105c5eeb47e9a848ae7bf8779996 (table default.Table_452b4395b710434591ea426b1e2432ba [id=504758a50ce541e0935fdd94da5c3239]) successfully deleted
W20250830 07:54:36.507488 13219 catalog_manager.cc:4908] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): delete failed for tablet 66d59910b4b2451a851e9d2728d50f42 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 66d59910b4b2451a851e9d2728d50f42 already in progress: creating tablet
I20250830 07:54:36.510705 13882 ts_tablet_manager.cc:1397] T 29d492735cd14bb6b4a2a9a3929f62f3 P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.091s user 0.005s sys 0.001s
I20250830 07:54:36.512663 14167 raft_consensus.cc:2747] T bcdac588f7c24d9d8572949e09b80a23 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20250830 07:54:36.514578 13219 catalog_manager.cc:4908] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): delete failed for tablet cb3c48982add45379c0e1b117ec40c1a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cb3c48982add45379c0e1b117ec40c1a already in progress: creating tablet
W20250830 07:54:36.514892 13219 catalog_manager.cc:4908] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): delete failed for tablet 007435e198b9440db055711a98e3148a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 007435e198b9440db055711a98e3148a already in progress: creating tablet
I20250830 07:54:36.515302 13234 catalog_manager.cc:5674] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325) does not have the latest schema for tablet c9a8f144d50c4d3d81fbf43ce29a2ad2 (table default.Table_31c70ac145a8402ca709a5ffdeaaffb3 [id=d2dbb756d66b483ebe44d45ddfa5c17c]). Expected version 9 got 0
W20250830 07:54:36.518671 13219 catalog_manager.cc:4908] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): delete failed for tablet 2009012fddc24e4fb7ad0fab33a1103b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2009012fddc24e4fb7ad0fab33a1103b already in progress: creating tablet
I20250830 07:54:36.521837 13886 tablet_bootstrap.cc:492] T 1476bb480bf747838613948875001c30 P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
W20250830 07:54:36.522663 13219 catalog_manager.cc:4908] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): delete failed for tablet 5dac49aebcfa476d81547636cd4c6986 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5dac49aebcfa476d81547636cd4c6986 already in progress: creating tablet
I20250830 07:54:36.523818 13886 ts_tablet_manager.cc:1397] T 1476bb480bf747838613948875001c30 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.077s user 0.003s sys 0.011s
W20250830 07:54:36.524406 13219 catalog_manager.cc:4908] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): delete failed for tablet 6a82ea7078e344a497c34f932e139bcd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6a82ea7078e344a497c34f932e139bcd already in progress: creating tablet
W20250830 07:54:36.525820 13219 catalog_manager.cc:4908] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): delete failed for tablet 8f215330505848619ad44569d3167591 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8f215330505848619ad44569d3167591 already in progress: creating tablet
I20250830 07:54:36.525858 13886 raft_consensus.cc:357] T 1476bb480bf747838613948875001c30 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
W20250830 07:54:36.526305 13219 catalog_manager.cc:4908] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): delete failed for tablet 8ab12188dddc4de69ac73dffb01d51a9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8ab12188dddc4de69ac73dffb01d51a9 already in progress: creating tablet
I20250830 07:54:36.527766 13886 raft_consensus.cc:383] T 1476bb480bf747838613948875001c30 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:36.506453 14290 tablet.cc:1722] T d0238794efb14150af6138b0d8bd80ec P 6b5e454d98894637b466ea27f1b647f9: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20250830 07:54:36.532716 13886 raft_consensus.cc:738] T 1476bb480bf747838613948875001c30 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:54:36.532964 13886 consensus_queue.cc:260] T 1476bb480bf747838613948875001c30 P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:54:36.533634 13886 ts_tablet_manager.cc:1428] T 1476bb480bf747838613948875001c30 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.010s user 0.002s sys 0.000s
I20250830 07:54:36.534240 13886 tablet_bootstrap.cc:492] T 8ab12188dddc4de69ac73dffb01d51a9 P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:54:36.534181 14023 raft_consensus.cc:491] T 02be33dc658d428fa55e59784a2342f6 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:36.534346 14023 raft_consensus.cc:513] T 02be33dc658d428fa55e59784a2342f6 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:36.536206 14023 leader_election.cc:290] T 02be33dc658d428fa55e59784a2342f6 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
W20250830 07:54:36.536549 13562 leader_election.cc:343] T 02be33dc658d428fa55e59784a2342f6 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Not found: Tablet not found: 02be33dc658d428fa55e59784a2342f6
W20250830 07:54:36.537602 13561 leader_election.cc:343] T 02be33dc658d428fa55e59784a2342f6 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): Not found: Tablet not found: 02be33dc658d428fa55e59784a2342f6
I20250830 07:54:36.538239 13561 leader_election.cc:304] T 02be33dc658d428fa55e59784a2342f6 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b5e454d98894637b466ea27f1b647f9; no voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:54:36.541325 13887 tablet_bootstrap.cc:492] T 5dac49aebcfa476d81547636cd4c6986 P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:54:36.542332 13887 ts_tablet_manager.cc:1397] T 5dac49aebcfa476d81547636cd4c6986 P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.062s user 0.007s sys 0.003s
I20250830 07:54:36.543107 13882 raft_consensus.cc:357] T 29d492735cd14bb6b4a2a9a3929f62f3 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:36.543315 13882 raft_consensus.cc:383] T 29d492735cd14bb6b4a2a9a3929f62f3 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:36.543406 13882 raft_consensus.cc:738] T 29d492735cd14bb6b4a2a9a3929f62f3 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:54:36.543370 13887 raft_consensus.cc:357] T 5dac49aebcfa476d81547636cd4c6986 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:54:36.543622 13887 raft_consensus.cc:383] T 5dac49aebcfa476d81547636cd4c6986 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:36.543644 13882 consensus_queue.cc:260] T 29d492735cd14bb6b4a2a9a3929f62f3 P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:36.543726 13887 raft_consensus.cc:738] T 5dac49aebcfa476d81547636cd4c6986 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:54:36.544075 13887 consensus_queue.cc:260] T 5dac49aebcfa476d81547636cd4c6986 P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:54:36.544260 13882 ts_tablet_manager.cc:1428] T 29d492735cd14bb6b4a2a9a3929f62f3 P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.033s user 0.001s sys 0.000s
I20250830 07:54:36.544763 13882 tablet_bootstrap.cc:492] T d1ae3812d72b419798736328da64b53c P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:54:36.546337 13228 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_b012b7ddd1ee43f4bb1639d60c5cfd78"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:36.547058 13228 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b012b7ddd1ee43f4bb1639d60c5cfd78 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:36.547748 13230 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_f61db5d7fd4a41d19d96612681e52b96" } new_table_name: "default.Table_c19f13a84191465baea4b6af0cfb9ee4" modify_external_catalogs: true
W20250830 07:54:36.550335 13234 catalog_manager.cc:5415] Ignoring report from unknown tablet e134ab64aa1b4ce89e295b43cbc3fffb
W20250830 07:54:36.550443 13234 catalog_manager.cc:5415] Ignoring report from unknown tablet 4c2c85732d454cd98efc2646af9450ed
W20250830 07:54:36.550549 13234 catalog_manager.cc:5415] Ignoring report from unknown tablet 861809cc50764aa89140e587489e2d88
W20250830 07:54:36.550606 13234 catalog_manager.cc:5415] Ignoring report from unknown tablet b4ab964a64a64e00a78ffd2b220aef46
I20250830 07:54:36.550879 13234 catalog_manager.cc:5674] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325) does not have the latest schema for tablet d0238794efb14150af6138b0d8bd80ec (table default.Table_53b3c649c07a4c328e41b846806f0f8b [id=8628f6e9686d43b6aa84cd3202db8e80]). Expected version 3 got 2
I20250830 07:54:36.551133 14023 raft_consensus.cc:2747] T 02be33dc658d428fa55e59784a2342f6 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:54:36.551980 13234 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_652f3632a7ff4601a8a53939adab6c35" } modify_external_catalogs: true
I20250830 07:54:36.552333 13234 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_652f3632a7ff4601a8a53939adab6c35" } modify_external_catalogs: true
I20250830 07:54:36.552505 13887 ts_tablet_manager.cc:1428] T 5dac49aebcfa476d81547636cd4c6986 P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.010s user 0.002s sys 0.000s
I20250830 07:54:36.552851 13887 tablet_bootstrap.cc:492] T ed87c6793dd149a6a363f1977d816628 P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:54:36.557962 13886 tablet_bootstrap.cc:654] T 8ab12188dddc4de69ac73dffb01d51a9 P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:36.558830 13954 raft_consensus.cc:491] T 9b9c2ae8805a48f7959d6745677a96f2 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:36.559032 13954 raft_consensus.cc:513] T 9b9c2ae8805a48f7959d6745677a96f2 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:54:36.560525 13954 leader_election.cc:290] T 9b9c2ae8805a48f7959d6745677a96f2 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:36.561805 13773 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "9b9c2ae8805a48f7959d6745677a96f2" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
W20250830 07:54:36.562752 13422 leader_election.cc:343] T 9b9c2ae8805a48f7959d6745677a96f2 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:36.563059 13882 tablet_bootstrap.cc:654] T d1ae3812d72b419798736328da64b53c P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:36.561360 13887 tablet_bootstrap.cc:654] T ed87c6793dd149a6a363f1977d816628 P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
W20250830 07:54:36.577078 13231 catalog_manager.cc:5415] Ignoring report from unknown tablet 4c2c85732d454cd98efc2646af9450ed
W20250830 07:54:36.581751 13231 catalog_manager.cc:5415] Ignoring report from unknown tablet 1933d49d319b4bd7b717dda2b83859f3
W20250830 07:54:36.581892 13231 catalog_manager.cc:5415] Ignoring report from unknown tablet ff0f9cccc8ed43b1a8cd38de0e9d4097
W20250830 07:54:36.582566 13231 catalog_manager.cc:5415] Ignoring report from unknown tablet ed87c6793dd149a6a363f1977d816628
W20250830 07:54:36.582708 13231 catalog_manager.cc:5415] Ignoring report from unknown tablet f398e12cd9f543738d5163354f8a9d9d
W20250830 07:54:36.582839 13231 catalog_manager.cc:5415] Ignoring report from unknown tablet e134ab64aa1b4ce89e295b43cbc3fffb
I20250830 07:54:36.583570 13231 catalog_manager.cc:5674] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743) does not have the latest schema for tablet d0238794efb14150af6138b0d8bd80ec (table default.Table_53b3c649c07a4c328e41b846806f0f8b [id=8628f6e9686d43b6aa84cd3202db8e80]). Expected version 3 got 2
I20250830 07:54:36.585673 13459 tablet_service.cc:1515] Processing DeleteTablet for tablet 5dac49aebcfa476d81547636cd4c6986 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:36 UTC) from {username='slave'} at 127.0.0.1:37956
I20250830 07:54:36.586024 13883 tablet_replica.cc:331] T 5dac49aebcfa476d81547636cd4c6986 P 2065c332f15a4739899af79f3669c3ba: stopping tablet replica
I20250830 07:54:36.586249 13883 raft_consensus.cc:2241] T 5dac49aebcfa476d81547636cd4c6986 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Raft consensus shutting down.
I20250830 07:54:36.586449 13883 raft_consensus.cc:2270] T 5dac49aebcfa476d81547636cd4c6986 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Raft consensus is shut down!
I20250830 07:54:36.587100 14291 tablet.cc:1722] T c9a8f144d50c4d3d81fbf43ce29a2ad2 P 2065c332f15a4739899af79f3669c3ba: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 9
I20250830 07:54:36.588902 14315 raft_consensus.cc:491] T 1476bb480bf747838613948875001c30 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:36.589078 14315 raft_consensus.cc:513] T 1476bb480bf747838613948875001c30 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:54:36.589859 14315 leader_election.cc:290] T 1476bb480bf747838613948875001c30 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
I20250830 07:54:36.597805 13487 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "1476bb480bf747838613948875001c30" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:54:36.598115 13487 raft_consensus.cc:2466] T 1476bb480bf747838613948875001c30 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 0.
I20250830 07:54:36.598529 13883 ts_tablet_manager.cc:1905] T 5dac49aebcfa476d81547636cd4c6986 P 2065c332f15a4739899af79f3669c3ba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250830 07:54:36.606439 13701 leader_election.cc:304] T 1476bb480bf747838613948875001c30 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters:
I20250830 07:54:36.607424 14315 raft_consensus.cc:491] T d1ae3812d72b419798736328da64b53c P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:36.607595 14315 raft_consensus.cc:513] T d1ae3812d72b419798736328da64b53c P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:36.597539 14317 tablet.cc:1722] T c9a8f144d50c4d3d81fbf43ce29a2ad2 P 6b5e454d98894637b466ea27f1b647f9: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 9
I20250830 07:54:36.608251 14315 leader_election.cc:290] T d1ae3812d72b419798736328da64b53c P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
I20250830 07:54:36.608438 14315 raft_consensus.cc:2802] T 1476bb480bf747838613948875001c30 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:54:36.608529 14315 raft_consensus.cc:491] T 1476bb480bf747838613948875001c30 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:54:36.608639 14315 raft_consensus.cc:3058] T 1476bb480bf747838613948875001c30 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:36.608686 13887 tablet_bootstrap.cc:492] T ed87c6793dd149a6a363f1977d816628 P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:54:36.608850 13887 ts_tablet_manager.cc:1397] T ed87c6793dd149a6a363f1977d816628 P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.056s user 0.006s sys 0.008s
I20250830 07:54:36.609591 13887 raft_consensus.cc:357] T ed87c6793dd149a6a363f1977d816628 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:54:36.609761 13887 raft_consensus.cc:383] T ed87c6793dd149a6a363f1977d816628 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:36.609851 13887 raft_consensus.cc:738] T ed87c6793dd149a6a363f1977d816628 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:54:36.610050 13887 consensus_queue.cc:260] T ed87c6793dd149a6a363f1977d816628 P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:54:36.612040 14315 raft_consensus.cc:513] T 1476bb480bf747838613948875001c30 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:54:36.612561 13887 ts_tablet_manager.cc:1428] T ed87c6793dd149a6a363f1977d816628 P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20250830 07:54:36.612854 13887 tablet_bootstrap.cc:492] T 6f2d855ab3c04123b2f9ea22cda6ef04 P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:54:36.613078 14315 leader_election.cc:290] T 1476bb480bf747838613948875001c30 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Requested vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
I20250830 07:54:36.613420 13629 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "9b9c2ae8805a48f7959d6745677a96f2" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
W20250830 07:54:36.614255 13423 leader_election.cc:343] T 9b9c2ae8805a48f7959d6745677a96f2 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:36.614388 13423 leader_election.cc:304] T 9b9c2ae8805a48f7959d6745677a96f2 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba; no voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:54:36.614785 13954 raft_consensus.cc:2747] T 9b9c2ae8805a48f7959d6745677a96f2 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:54:36.615013 14315 consensus_queue.cc:1035] T 4c2c85732d454cd98efc2646af9450ed P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:54:36.615079 13486 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "1476bb480bf747838613948875001c30" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba"
I20250830 07:54:36.615234 13486 raft_consensus.cc:3058] T 1476bb480bf747838613948875001c30 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
W20250830 07:54:36.615967 13701 leader_election.cc:343] T d1ae3812d72b419798736328da64b53c P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): Not found: Tablet not found: d1ae3812d72b419798736328da64b53c
I20250830 07:54:36.617887 13626 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "d1ae3812d72b419798736328da64b53c" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:36.618244 13629 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "1476bb480bf747838613948875001c30" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:36.618220 13627 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "1476bb480bf747838613948875001c30" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9"
W20250830 07:54:36.619519 13703 leader_election.cc:343] T d1ae3812d72b419798736328da64b53c P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:36.619700 13703 leader_election.cc:304] T d1ae3812d72b419798736328da64b53c P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 2065c332f15a4739899af79f3669c3ba, 6b5e454d98894637b466ea27f1b647f9
W20250830 07:54:36.620189 13703 leader_election.cc:343] T 1476bb480bf747838613948875001c30 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:36.618610 13486 raft_consensus.cc:2466] T 1476bb480bf747838613948875001c30 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 1.
I20250830 07:54:36.621771 14315 raft_consensus.cc:2747] T d1ae3812d72b419798736328da64b53c P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:54:36.624487 13701 leader_election.cc:304] T 1476bb480bf747838613948875001c30 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters:
I20250830 07:54:36.625511 14315 raft_consensus.cc:2802] T 1476bb480bf747838613948875001c30 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election won for term 1
I20250830 07:54:36.625780 14315 raft_consensus.cc:695] T 1476bb480bf747838613948875001c30 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 LEADER]: Becoming Leader. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Running, Role: LEADER
I20250830 07:54:36.626187 14315 consensus_queue.cc:237] T 1476bb480bf747838613948875001c30 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:54:36.627077 13883 ts_tablet_manager.cc:1918] T 5dac49aebcfa476d81547636cd4c6986 P 2065c332f15a4739899af79f3669c3ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
W20250830 07:54:36.628297 13226 catalog_manager.cc:5415] Ignoring report from unknown tablet 1933d49d319b4bd7b717dda2b83859f3
I20250830 07:54:36.628439 13887 tablet_bootstrap.cc:654] T 6f2d855ab3c04123b2f9ea22cda6ef04 P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
W20250830 07:54:36.628865 13226 catalog_manager.cc:5415] Ignoring report from unknown tablet 1fa571e9490e499792225d7b786e8658
W20250830 07:54:36.628996 13226 catalog_manager.cc:5415] Ignoring report from unknown tablet ff2267fb411942ff826e2a72bcb89cd7
I20250830 07:54:36.629793 13226 catalog_manager.cc:5674] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967) does not have the latest schema for tablet c9a8f144d50c4d3d81fbf43ce29a2ad2 (table default.Table_31c70ac145a8402ca709a5ffdeaaffb3 [id=d2dbb756d66b483ebe44d45ddfa5c17c]). Expected version 9 got 0
W20250830 07:54:36.637310 13703 leader_election.cc:343] T 1476bb480bf747838613948875001c30 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:36.639436 13883 log.cc:1199] T 5dac49aebcfa476d81547636cd4c6986 P 2065c332f15a4739899af79f3669c3ba: Deleting WAL directory at /tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/ts-0/wal/wals/5dac49aebcfa476d81547636cd4c6986
I20250830 07:54:36.640540 13883 ts_tablet_manager.cc:1939] T 5dac49aebcfa476d81547636cd4c6986 P 2065c332f15a4739899af79f3669c3ba: Deleting consensus metadata
I20250830 07:54:36.641702 13233 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet b38c8d003413428dae9e47f58e197c2c
I20250830 07:54:36.642971 13747 tablet_service.cc:1515] Processing DeleteTablet for tablet b38c8d003413428dae9e47f58e197c2c with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:36 UTC) from {username='slave'} at 127.0.0.1:45460
I20250830 07:54:36.643529 13608 tablet_service.cc:1515] Processing DeleteTablet for tablet b38c8d003413428dae9e47f58e197c2c with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:36 UTC) from {username='slave'} at 127.0.0.1:45306
W20250830 07:54:36.644124 13219 catalog_manager.cc:4908] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): delete failed for tablet b38c8d003413428dae9e47f58e197c2c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b38c8d003413428dae9e47f58e197c2c already in progress: creating tablet
I20250830 07:54:36.644563 13887 tablet_bootstrap.cc:492] T 6f2d855ab3c04123b2f9ea22cda6ef04 P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
W20250830 07:54:36.644573 13220 catalog_manager.cc:4908] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet b38c8d003413428dae9e47f58e197c2c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b38c8d003413428dae9e47f58e197c2c already in progress: creating tablet
I20250830 07:54:36.644727 13887 ts_tablet_manager.cc:1397] T 6f2d855ab3c04123b2f9ea22cda6ef04 P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.032s user 0.003s sys 0.003s
I20250830 07:54:36.647372 14023 consensus_queue.cc:1035] T bcdac588f7c24d9d8572949e09b80a23 P 6b5e454d98894637b466ea27f1b647f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20250830 07:54:36.649744 13218 catalog_manager.cc:4928] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): tablet 5dac49aebcfa476d81547636cd4c6986 (table default.Table_c971df90450b4c17821d0f0a51ae48a3 [id=5be1411ad9f548f8b84fa170596c4cf5]) successfully deleted
I20250830 07:54:36.650797 13459 tablet_service.cc:1515] Processing DeleteTablet for tablet b38c8d003413428dae9e47f58e197c2c with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:36 UTC) from {username='slave'} at 127.0.0.1:37956
I20250830 07:54:36.654848 13887 raft_consensus.cc:357] T 6f2d855ab3c04123b2f9ea22cda6ef04 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:54:36.655092 13887 raft_consensus.cc:383] T 6f2d855ab3c04123b2f9ea22cda6ef04 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:36.655185 13887 raft_consensus.cc:738] T 6f2d855ab3c04123b2f9ea22cda6ef04 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:54:36.655428 13887 consensus_queue.cc:260] T 6f2d855ab3c04123b2f9ea22cda6ef04 P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:54:36.656956 13887 ts_tablet_manager.cc:1428] T 6f2d855ab3c04123b2f9ea22cda6ef04 P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.012s user 0.002s sys 0.001s
I20250830 07:54:36.657261 13887 tablet_bootstrap.cc:492] T 9696d8531a174585b8fd83a2391c02f7 P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:54:36.661454 13233 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_6dcce54cec804290914ca3bf2135c880" } modify_external_catalogs: true
I20250830 07:54:36.661556 13887 tablet_bootstrap.cc:654] T 9696d8531a174585b8fd83a2391c02f7 P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:36.661664 13233 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_6dcce54cec804290914ca3bf2135c880" } modify_external_catalogs: true
I20250830 07:54:36.662149 13882 tablet_bootstrap.cc:492] T d1ae3812d72b419798736328da64b53c P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:54:36.662380 13882 ts_tablet_manager.cc:1397] T d1ae3812d72b419798736328da64b53c P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.118s user 0.002s sys 0.005s
I20250830 07:54:36.663968 13882 raft_consensus.cc:357] T d1ae3812d72b419798736328da64b53c P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
W20250830 07:54:36.666668 13218 catalog_manager.cc:4908] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): delete failed for tablet b38c8d003413428dae9e47f58e197c2c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b38c8d003413428dae9e47f58e197c2c already in progress: creating tablet
I20250830 07:54:36.668911 14291 tablet.cc:1722] T d0238794efb14150af6138b0d8bd80ec P 2065c332f15a4739899af79f3669c3ba: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20250830 07:54:36.674547 14290 tablet.cc:1722] T d0238794efb14150af6138b0d8bd80ec P 6b5e454d98894637b466ea27f1b647f9: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20250830 07:54:36.674787 14314 tablet.cc:1722] T d0238794efb14150af6138b0d8bd80ec P 9b057ade5dce45af9f8bf0bedf8b917f: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20250830 07:54:36.675328 13882 raft_consensus.cc:383] T d1ae3812d72b419798736328da64b53c P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:36.675483 13882 raft_consensus.cc:738] T d1ae3812d72b419798736328da64b53c P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:54:36.677500 13225 catalog_manager.cc:5864] Not sending DeleteTablet requests; no consensus state for tablet 38080b5efc194260a7b1b8b6c1aa8e3b
I20250830 07:54:36.678562 13886 tablet_bootstrap.cc:492] T 8ab12188dddc4de69ac73dffb01d51a9 P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:54:36.678797 13886 ts_tablet_manager.cc:1397] T 8ab12188dddc4de69ac73dffb01d51a9 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.145s user 0.005s sys 0.000s
I20250830 07:54:36.679672 13886 raft_consensus.cc:357] T 8ab12188dddc4de69ac73dffb01d51a9 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:54:36.680150 13882 consensus_queue.cc:260] T d1ae3812d72b419798736328da64b53c P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:36.681205 13882 ts_tablet_manager.cc:1428] T d1ae3812d72b419798736328da64b53c P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.019s user 0.002s sys 0.000s
I20250830 07:54:36.680440 13886 raft_consensus.cc:383] T 8ab12188dddc4de69ac73dffb01d51a9 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:36.681416 13886 raft_consensus.cc:738] T 8ab12188dddc4de69ac73dffb01d51a9 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:54:36.681749 13886 consensus_queue.cc:260] T 8ab12188dddc4de69ac73dffb01d51a9 P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:54:36.682235 13882 tablet_bootstrap.cc:492] T e134ab64aa1b4ce89e295b43cbc3fffb P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:54:36.685873 13886 ts_tablet_manager.cc:1428] T 8ab12188dddc4de69ac73dffb01d51a9 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.007s user 0.002s sys 0.000s
I20250830 07:54:36.688334 13886 tablet_bootstrap.cc:492] T 5dac49aebcfa476d81547636cd4c6986 P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:54:36.691475 13886 tablet_bootstrap.cc:654] T 5dac49aebcfa476d81547636cd4c6986 P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:36.692301 13882 tablet_bootstrap.cc:654] T e134ab64aa1b4ce89e295b43cbc3fffb P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
W20250830 07:54:36.698009 13232 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 8dddcfe56522436287aea212e316a729 consensus state has no leader
W20250830 07:54:36.698251 13225 catalog_manager.cc:5415] Ignoring report from unknown tablet ed87c6793dd149a6a363f1977d816628
W20250830 07:54:36.698370 13225 catalog_manager.cc:5415] Ignoring report from unknown tablet c82ac0102b4442449073e44d8a3d9065
I20250830 07:54:36.698465 13232 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_429185b39740488c933444abe9883526"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:36.699011 13232 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_429185b39740488c933444abe9883526 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:36.700443 13227 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet 05697181c0c149c79a395ff7525ea2af
I20250830 07:54:36.701295 13227 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_e4f722cf97f34259b0ef37b76c007dee"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:36.701946 13227 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e4f722cf97f34259b0ef37b76c007dee in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250830 07:54:36.703986 13229 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 5235e1a32f044f0cbf882e338c482003 has no consensus state
I20250830 07:54:36.704442 13229 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_5ee90d16de544700998619a8b2b71876" } new_table_name: "default.Table_523d7bc660f94c9db577f499e22c772f" modify_external_catalogs: true
W20250830 07:54:36.705822 13230 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 533811110191436d96665b3475ab597f consensus state has no leader
I20250830 07:54:36.706189 13230 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_af6ae1f5434745bb8a3262612e7e4e36"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:36.706722 13230 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_af6ae1f5434745bb8a3262612e7e4e36 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:36.709012 13228 master_service.cc:948] ReplaceTablet: received request to replace tablet a78c522b9fa945e2879fb965d82fb359 from {username='slave'} at 127.0.0.1:42126
I20250830 07:54:36.709246 13231 catalog_manager.cc:6127] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: default.Table_31c70ac145a8402ca709a5ffdeaaffb3 [id=d2dbb756d66b483ebe44d45ddfa5c17c] alter complete (version 9)
I20250830 07:54:36.709527 13228 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_752efa41f91b4c74b642b4fc89bf584c" } new_table_name: "default.Table_d72a50af0d2844f0b50c767903f8f693" modify_external_catalogs: true
I20250830 07:54:36.709774 13231 master_service.cc:948] ReplaceTablet: received request to replace tablet 01771fa171374e92892345e7402c33d1 from {username='slave'} at 127.0.0.1:42126
I20250830 07:54:36.711946 13226 master_service.cc:948] ReplaceTablet: received request to replace tablet 6f4c400c0e5e43319fa521b5cab694b4 from {username='slave'} at 127.0.0.1:42126
I20250830 07:54:36.712467 13226 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_13f58d14bfbd46279e17abb34c722044"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:36.713084 13226 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_13f58d14bfbd46279e17abb34c722044 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:36.714285 13608 tablet_service.cc:1515] Processing DeleteTablet for tablet 05697181c0c149c79a395ff7525ea2af with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:36 UTC) from {username='slave'} at 127.0.0.1:45306
I20250830 07:54:36.715893 13747 tablet_service.cc:1515] Processing DeleteTablet for tablet 05697181c0c149c79a395ff7525ea2af with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:36 UTC) from {username='slave'} at 127.0.0.1:45460
I20250830 07:54:36.709092 13234 catalog_manager.cc:5864] Not sending DeleteTablet requests; no consensus state for tablet a94f79b136c741b59512fef4a064aecb
I20250830 07:54:36.718230 13234 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_9aa8d17e919f4ae09cb9c42cf2ba54a5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:36.718744 13234 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9aa8d17e919f4ae09cb9c42cf2ba54a5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250830 07:54:36.722853 13220 catalog_manager.cc:4908] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet 05697181c0c149c79a395ff7525ea2af because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 05697181c0c149c79a395ff7525ea2af already in progress: creating tablet
W20250830 07:54:36.723568 13219 catalog_manager.cc:4908] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): delete failed for tablet 05697181c0c149c79a395ff7525ea2af because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 05697181c0c149c79a395ff7525ea2af already in progress: creating tablet
I20250830 07:54:36.725370 14256 consensus_queue.cc:1035] T bcdac588f7c24d9d8572949e09b80a23 P 6b5e454d98894637b466ea27f1b647f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:54:36.725740 13459 tablet_service.cc:1515] Processing DeleteTablet for tablet 05697181c0c149c79a395ff7525ea2af with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:36 UTC) from {username='slave'} at 127.0.0.1:37956
I20250830 07:54:36.726052 13883 tablet_replica.cc:331] T 05697181c0c149c79a395ff7525ea2af P 2065c332f15a4739899af79f3669c3ba: stopping tablet replica
I20250830 07:54:36.726289 13883 raft_consensus.cc:2241] T 05697181c0c149c79a395ff7525ea2af P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Raft consensus shutting down.
I20250830 07:54:36.726497 13883 raft_consensus.cc:2270] T 05697181c0c149c79a395ff7525ea2af P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Raft consensus is shut down!
I20250830 07:54:36.727635 13883 ts_tablet_manager.cc:1905] T 05697181c0c149c79a395ff7525ea2af P 2065c332f15a4739899af79f3669c3ba: Deleting tablet data with delete state TABLET_DATA_DELETED
W20250830 07:54:36.730082 13225 catalog_manager.cc:5415] Ignoring report from unknown tablet d1ae3812d72b419798736328da64b53c
W20250830 07:54:36.730243 13225 catalog_manager.cc:5415] Ignoring report from unknown tablet 4c2c85732d454cd98efc2646af9450ed
W20250830 07:54:36.730304 13225 catalog_manager.cc:5415] Ignoring report from unknown tablet 29d492735cd14bb6b4a2a9a3929f62f3
I20250830 07:54:36.735261 13883 ts_tablet_manager.cc:1918] T 05697181c0c149c79a395ff7525ea2af P 2065c332f15a4739899af79f3669c3ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250830 07:54:36.735474 13883 log.cc:1199] T 05697181c0c149c79a395ff7525ea2af P 2065c332f15a4739899af79f3669c3ba: Deleting WAL directory at /tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/ts-0/wal/wals/05697181c0c149c79a395ff7525ea2af
I20250830 07:54:36.735793 14189 consensus_queue.cc:1035] T d3b47314f7cd4e969d973c0a340137f1 P 2065c332f15a4739899af79f3669c3ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:54:36.736593 13886 tablet_bootstrap.cc:492] T 5dac49aebcfa476d81547636cd4c6986 P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:54:36.737046 13883 ts_tablet_manager.cc:1939] T 05697181c0c149c79a395ff7525ea2af P 2065c332f15a4739899af79f3669c3ba: Deleting consensus metadata
I20250830 07:54:36.737349 13886 ts_tablet_manager.cc:1397] T 5dac49aebcfa476d81547636cd4c6986 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.049s user 0.005s sys 0.002s
I20250830 07:54:36.738397 13218 catalog_manager.cc:4928] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): tablet 05697181c0c149c79a395ff7525ea2af (table default.Table_ad824ae7601a4c6b9e756946853e09c7 [id=a2376c0724aa49b8b9545d111f12e1e6]) successfully deleted
I20250830 07:54:36.739521 13886 raft_consensus.cc:357] T 5dac49aebcfa476d81547636cd4c6986 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:54:36.741109 13886 raft_consensus.cc:383] T 5dac49aebcfa476d81547636cd4c6986 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:36.741286 13886 raft_consensus.cc:738] T 5dac49aebcfa476d81547636cd4c6986 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:54:36.741786 13886 consensus_queue.cc:260] T 5dac49aebcfa476d81547636cd4c6986 P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:54:36.747761 13886 ts_tablet_manager.cc:1428] T 5dac49aebcfa476d81547636cd4c6986 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.009s user 0.002s sys 0.000s
I20250830 07:54:36.751870 13886 tablet_bootstrap.cc:492] T 9b9c2ae8805a48f7959d6745677a96f2 P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
W20250830 07:54:36.752997 13221 catalog_manager.cc:4726] Async tablet task AlterTable RPC for tablet ea8ccd7ef791471291bca049bdf7f643 (table default.Table_5ee90d16de544700998619a8b2b71876 [id=3582c72cab4b4e1084021b098ec30f87], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet ea8ccd7ef791471291bca049bdf7f643 consensus state has no leader
I20250830 07:54:36.754271 13886 tablet_bootstrap.cc:654] T 9b9c2ae8805a48f7959d6745677a96f2 P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:36.755319 13882 tablet_bootstrap.cc:492] T e134ab64aa1b4ce89e295b43cbc3fffb P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:54:36.755529 13882 ts_tablet_manager.cc:1397] T e134ab64aa1b4ce89e295b43cbc3fffb P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.073s user 0.005s sys 0.004s
I20250830 07:54:36.755699 13233 catalog_manager.cc:5864] Not sending DeleteTablet requests; no consensus state for tablet 6bc8fe6f77d54560bff5393f2c5dd852
I20250830 07:54:36.756363 13882 raft_consensus.cc:357] T e134ab64aa1b4ce89e295b43cbc3fffb P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:36.756528 13882 raft_consensus.cc:383] T e134ab64aa1b4ce89e295b43cbc3fffb P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:36.756608 13882 raft_consensus.cc:738] T e134ab64aa1b4ce89e295b43cbc3fffb P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:54:36.756821 13882 consensus_queue.cc:260] T e134ab64aa1b4ce89e295b43cbc3fffb P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
W20250830 07:54:36.757284 13233 catalog_manager.cc:5415] Ignoring report from unknown tablet 6f4c400c0e5e43319fa521b5cab694b4
I20250830 07:54:36.757328 13882 ts_tablet_manager.cc:1428] T e134ab64aa1b4ce89e295b43cbc3fffb P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
W20250830 07:54:36.757375 13233 catalog_manager.cc:5415] Ignoring report from unknown tablet 4c2c85732d454cd98efc2646af9450ed
W20250830 07:54:36.757419 13233 catalog_manager.cc:5415] Ignoring report from unknown tablet 1476bb480bf747838613948875001c30
I20250830 07:54:36.757644 13882 tablet_bootstrap.cc:492] T 6f2d855ab3c04123b2f9ea22cda6ef04 P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:54:36.759538 13882 tablet_bootstrap.cc:654] T 6f2d855ab3c04123b2f9ea22cda6ef04 P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:36.763355 13230 master_service.cc:948] ReplaceTablet: received request to replace tablet c2f5f79547184009a0863b695a833694 from {username='slave'} at 127.0.0.1:42126
W20250830 07:54:36.764425 13232 catalog_manager.cc:5415] Ignoring report from unknown tablet 6f2d855ab3c04123b2f9ea22cda6ef04
W20250830 07:54:36.764511 13232 catalog_manager.cc:5415] Ignoring report from unknown tablet bcdac588f7c24d9d8572949e09b80a23
W20250830 07:54:36.764600 13232 catalog_manager.cc:5415] Ignoring report from unknown tablet dfccff3bd0cb4c7d998633b015de3cfa
W20250830 07:54:36.765215 13229 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ea8ccd7ef791471291bca049bdf7f643 consensus state has no leader
I20250830 07:54:36.765589 13229 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_f42b593eb80b4833a31384f9aca872b0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:36.766162 13229 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f42b593eb80b4833a31384f9aca872b0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250830 07:54:36.767625 13228 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d64f20df166a46249c08444f44422fc3 has no consensus state
I20250830 07:54:36.767904 13228 master_service.cc:948] ReplaceTablet: received request to replace tablet d3f207cee78a43a1b5e030c09752c78c from {username='slave'} at 127.0.0.1:42126
I20250830 07:54:36.770035 14287 raft_consensus.cc:491] T 6f2d855ab3c04123b2f9ea22cda6ef04 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:36.770076 13956 raft_consensus.cc:491] T e134ab64aa1b4ce89e295b43cbc3fffb P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:36.770220 13956 raft_consensus.cc:513] T e134ab64aa1b4ce89e295b43cbc3fffb P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:36.770216 14287 raft_consensus.cc:513] T 6f2d855ab3c04123b2f9ea22cda6ef04 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:54:36.770823 13956 leader_election.cc:290] T e134ab64aa1b4ce89e295b43cbc3fffb P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:36.770812 14287 leader_election.cc:290] T 6f2d855ab3c04123b2f9ea22cda6ef04 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
I20250830 07:54:36.771847 13773 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "e134ab64aa1b4ce89e295b43cbc3fffb" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:36.772351 13625 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "6f2d855ab3c04123b2f9ea22cda6ef04" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:36.772399 14247 consensus_queue.cc:1035] T d3b47314f7cd4e969d973c0a340137f1 P 2065c332f15a4739899af79f3669c3ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20250830 07:54:36.772884 13703 leader_election.cc:343] T 6f2d855ab3c04123b2f9ea22cda6ef04 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:36.773345 13487 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "6f2d855ab3c04123b2f9ea22cda6ef04" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:54:36.773564 13487 raft_consensus.cc:2466] T 6f2d855ab3c04123b2f9ea22cda6ef04 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 0.
I20250830 07:54:36.779412 13701 leader_election.cc:304] T 6f2d855ab3c04123b2f9ea22cda6ef04 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:54:36.780246 13486 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "e134ab64aa1b4ce89e295b43cbc3fffb" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:54:36.780949 13561 leader_election.cc:304] T e134ab64aa1b4ce89e295b43cbc3fffb P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b5e454d98894637b466ea27f1b647f9; no voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:54:36.781611 13956 raft_consensus.cc:2747] T e134ab64aa1b4ce89e295b43cbc3fffb P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:54:36.785022 14287 raft_consensus.cc:2802] T 6f2d855ab3c04123b2f9ea22cda6ef04 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:54:36.785197 14287 raft_consensus.cc:491] T 6f2d855ab3c04123b2f9ea22cda6ef04 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:54:36.785521 14287 raft_consensus.cc:3058] T 6f2d855ab3c04123b2f9ea22cda6ef04 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:36.789105 14287 raft_consensus.cc:513] T 6f2d855ab3c04123b2f9ea22cda6ef04 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:54:36.793437 14287 leader_election.cc:290] T 6f2d855ab3c04123b2f9ea22cda6ef04 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Requested vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
I20250830 07:54:36.794327 13886 tablet_bootstrap.cc:492] T 9b9c2ae8805a48f7959d6745677a96f2 P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:54:36.794360 13625 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "6f2d855ab3c04123b2f9ea22cda6ef04" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9"
I20250830 07:54:36.794503 13886 ts_tablet_manager.cc:1397] T 9b9c2ae8805a48f7959d6745677a96f2 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.043s user 0.004s sys 0.003s
W20250830 07:54:36.795097 13703 leader_election.cc:343] T 6f2d855ab3c04123b2f9ea22cda6ef04 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:36.795284 13886 raft_consensus.cc:357] T 9b9c2ae8805a48f7959d6745677a96f2 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:54:36.795483 13886 raft_consensus.cc:383] T 9b9c2ae8805a48f7959d6745677a96f2 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:36.795567 13886 raft_consensus.cc:738] T 9b9c2ae8805a48f7959d6745677a96f2 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:54:36.795483 13486 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "6f2d855ab3c04123b2f9ea22cda6ef04" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba"
I20250830 07:54:36.795682 13486 raft_consensus.cc:3058] T 6f2d855ab3c04123b2f9ea22cda6ef04 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:36.796226 13886 consensus_queue.cc:260] T 9b9c2ae8805a48f7959d6745677a96f2 P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:54:36.799444 13886 ts_tablet_manager.cc:1428] T 9b9c2ae8805a48f7959d6745677a96f2 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20250830 07:54:36.799755 13886 tablet_bootstrap.cc:492] T 05697181c0c149c79a395ff7525ea2af P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:54:36.800189 13486 raft_consensus.cc:2466] T 6f2d855ab3c04123b2f9ea22cda6ef04 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 1.
I20250830 07:54:36.801556 13886 tablet_bootstrap.cc:654] T 05697181c0c149c79a395ff7525ea2af P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:36.805425 13882 tablet_bootstrap.cc:492] T 6f2d855ab3c04123b2f9ea22cda6ef04 P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:54:36.805589 13882 ts_tablet_manager.cc:1397] T 6f2d855ab3c04123b2f9ea22cda6ef04 P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.048s user 0.000s sys 0.007s
I20250830 07:54:36.806262 13882 raft_consensus.cc:357] T 6f2d855ab3c04123b2f9ea22cda6ef04 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:54:36.806495 13882 raft_consensus.cc:383] T 6f2d855ab3c04123b2f9ea22cda6ef04 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:36.806557 13882 raft_consensus.cc:738] T 6f2d855ab3c04123b2f9ea22cda6ef04 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:54:36.806916 13231 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet 01771fa171374e92892345e7402c33d1
I20250830 07:54:36.807554 13231 catalog_manager.cc:6652] ReplaceTablet: tablet 01771fa171374e92892345e7402c33d1 deleted and replaced by tablet 1520d7257f864ea4ba4b9a5d0443f8a7
I20250830 07:54:36.807934 13608 tablet_service.cc:1515] Processing DeleteTablet for tablet 01771fa171374e92892345e7402c33d1 with delete_type TABLET_DATA_DELETED (replaced by tablet 1520d7257f864ea4ba4b9a5d0443f8a7) from {username='slave'} at 127.0.0.1:45306
I20250830 07:54:36.807993 13231 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_049167f2b5e44e98b771e19ddb7ac501"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:36.808530 13220 catalog_manager.cc:4908] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet 01771fa171374e92892345e7402c33d1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 01771fa171374e92892345e7402c33d1 already in progress: creating tablet
W20250830 07:54:36.808676 13231 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_049167f2b5e44e98b771e19ddb7ac501 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:36.811147 13225 catalog_manager.cc:6127] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: default.Table_53b3c649c07a4c328e41b846806f0f8b [id=8628f6e9686d43b6aa84cd3202db8e80] alter complete (version 3)
I20250830 07:54:36.806785 13882 consensus_queue.cc:260] T 6f2d855ab3c04123b2f9ea22cda6ef04 P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:54:36.812188 13230 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet c2f5f79547184009a0863b695a833694
I20250830 07:54:36.812618 13230 catalog_manager.cc:6652] ReplaceTablet: tablet c2f5f79547184009a0863b695a833694 deleted and replaced by tablet 852e353f6ee945628ddebdbdd1bd76fb
I20250830 07:54:36.813355 13608 tablet_service.cc:1515] Processing DeleteTablet for tablet c2f5f79547184009a0863b695a833694 with delete_type TABLET_DATA_DELETED (replaced by tablet 852e353f6ee945628ddebdbdd1bd76fb) from {username='slave'} at 127.0.0.1:45306
I20250830 07:54:36.815244 13226 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_98238aa0585b4974bfdc935b98b5ed1e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250830 07:54:36.815743 13882 ts_tablet_manager.cc:1428] T 6f2d855ab3c04123b2f9ea22cda6ef04 P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.010s user 0.002s sys 0.000s
W20250830 07:54:36.815924 13226 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_98238aa0585b4974bfdc935b98b5ed1e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:36.816064 13882 tablet_bootstrap.cc:492] T 05697181c0c149c79a395ff7525ea2af P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:54:36.816816 13747 tablet_service.cc:1515] Processing DeleteTablet for tablet 01771fa171374e92892345e7402c33d1 with delete_type TABLET_DATA_DELETED (replaced by tablet 1520d7257f864ea4ba4b9a5d0443f8a7) from {username='slave'} at 127.0.0.1:45460
I20250830 07:54:36.817087 13752 tablet_service.cc:1515] Processing DeleteTablet for tablet 8ab12188dddc4de69ac73dffb01d51a9 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:36 UTC) from {username='slave'} at 127.0.0.1:45460
I20250830 07:54:36.817262 13749 tablet_service.cc:1515] Processing DeleteTablet for tablet c2f5f79547184009a0863b695a833694 with delete_type TABLET_DATA_DELETED (replaced by tablet 852e353f6ee945628ddebdbdd1bd76fb) from {username='slave'} at 127.0.0.1:45460
I20250830 07:54:36.817638 13884 tablet_replica.cc:331] T 8ab12188dddc4de69ac73dffb01d51a9 P 9b057ade5dce45af9f8bf0bedf8b917f: stopping tablet replica
I20250830 07:54:36.817886 13884 raft_consensus.cc:2241] T 8ab12188dddc4de69ac73dffb01d51a9 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Raft consensus shutting down.
I20250830 07:54:36.818096 13884 raft_consensus.cc:2270] T 8ab12188dddc4de69ac73dffb01d51a9 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Raft consensus is shut down!
I20250830 07:54:36.818889 13884 ts_tablet_manager.cc:1905] T 8ab12188dddc4de69ac73dffb01d51a9 P 9b057ade5dce45af9f8bf0bedf8b917f: Deleting tablet data with delete state TABLET_DATA_DELETED
W20250830 07:54:36.820772 13233 catalog_manager.cc:5415] Ignoring report from unknown tablet 9b9c2ae8805a48f7959d6745677a96f2
W20250830 07:54:36.820923 13233 catalog_manager.cc:5415] Ignoring report from unknown tablet d3b47314f7cd4e969d973c0a340137f1
W20250830 07:54:36.821103 13233 catalog_manager.cc:5415] Ignoring report from unknown tablet bcdac588f7c24d9d8572949e09b80a23
W20250830 07:54:36.822407 13219 catalog_manager.cc:4908] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): delete failed for tablet 01771fa171374e92892345e7402c33d1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 01771fa171374e92892345e7402c33d1 already in progress: creating tablet
I20250830 07:54:36.823693 13228 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet d3f207cee78a43a1b5e030c09752c78c
I20250830 07:54:36.823845 13749 tablet_service.cc:1515] Processing DeleteTablet for tablet 5dac49aebcfa476d81547636cd4c6986 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:36 UTC) from {username='slave'} at 127.0.0.1:45460
I20250830 07:54:36.824205 13228 catalog_manager.cc:6652] ReplaceTablet: tablet d3f207cee78a43a1b5e030c09752c78c deleted and replaced by tablet e0148ace593a4a70bbf941c97e65bda8
I20250830 07:54:36.824992 13230 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_7669c1559ff94b0b9ce898713cc8ea9e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:36.825525 13230 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7669c1559ff94b0b9ce898713cc8ea9e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:36.826488 13884 ts_tablet_manager.cc:1918] T 8ab12188dddc4de69ac73dffb01d51a9 P 9b057ade5dce45af9f8bf0bedf8b917f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250830 07:54:36.827396 13749 tablet_service.cc:1515] Processing DeleteTablet for tablet d3f207cee78a43a1b5e030c09752c78c with delete_type TABLET_DATA_DELETED (replaced by tablet e0148ace593a4a70bbf941c97e65bda8) from {username='slave'} at 127.0.0.1:45460
I20250830 07:54:36.827067 13884 log.cc:1199] T 8ab12188dddc4de69ac73dffb01d51a9 P 9b057ade5dce45af9f8bf0bedf8b917f: Deleting WAL directory at /tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/ts-2/wal/wals/8ab12188dddc4de69ac73dffb01d51a9
W20250830 07:54:36.827839 13220 catalog_manager.cc:4908] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet c2f5f79547184009a0863b695a833694 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c2f5f79547184009a0863b695a833694 already in progress: creating tablet
I20250830 07:54:36.827898 13884 ts_tablet_manager.cc:1939] T 8ab12188dddc4de69ac73dffb01d51a9 P 9b057ade5dce45af9f8bf0bedf8b917f: Deleting consensus metadata
I20250830 07:54:36.828388 13608 tablet_service.cc:1515] Processing DeleteTablet for tablet d3f207cee78a43a1b5e030c09752c78c with delete_type TABLET_DATA_DELETED (replaced by tablet e0148ace593a4a70bbf941c97e65bda8) from {username='slave'} at 127.0.0.1:45306
I20250830 07:54:36.828943 13219 catalog_manager.cc:4928] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): tablet 8ab12188dddc4de69ac73dffb01d51a9 (table default.Table_941683cb836e4df7a4f2cf11c6b54f0e [id=388ffc0a7b884c26811aab0ec8eccf71]) successfully deleted
W20250830 07:54:36.829094 13220 catalog_manager.cc:4908] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet d3f207cee78a43a1b5e030c09752c78c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d3f207cee78a43a1b5e030c09752c78c already in progress: creating tablet
I20250830 07:54:36.829262 13884 tablet_replica.cc:331] T c2f5f79547184009a0863b695a833694 P 9b057ade5dce45af9f8bf0bedf8b917f: stopping tablet replica
I20250830 07:54:36.829490 13884 raft_consensus.cc:2241] T c2f5f79547184009a0863b695a833694 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Raft consensus shutting down.
I20250830 07:54:36.829668 13884 raft_consensus.cc:2270] T c2f5f79547184009a0863b695a833694 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Raft consensus is shut down!
I20250830 07:54:36.830181 13884 ts_tablet_manager.cc:1905] T c2f5f79547184009a0863b695a833694 P 9b057ade5dce45af9f8bf0bedf8b917f: Deleting tablet data with delete state TABLET_DATA_DELETED
W20250830 07:54:36.831619 13233 catalog_manager.cc:5415] Ignoring report from unknown tablet d3b47314f7cd4e969d973c0a340137f1
W20250830 07:54:36.831770 13233 catalog_manager.cc:5415] Ignoring report from unknown tablet 2afb1e75cfcc4e1abd265fbadb4170fa
W20250830 07:54:36.831859 13233 catalog_manager.cc:5415] Ignoring report from unknown tablet e134ab64aa1b4ce89e295b43cbc3fffb
W20250830 07:54:36.831960 13233 catalog_manager.cc:5415] Ignoring report from unknown tablet bcdac588f7c24d9d8572949e09b80a23
W20250830 07:54:36.835856 13229 catalog_manager.cc:5415] Ignoring report from unknown tablet 6f2d855ab3c04123b2f9ea22cda6ef04
W20250830 07:54:36.836722 13233 catalog_manager.cc:5415] Ignoring report from unknown tablet d3b47314f7cd4e969d973c0a340137f1
W20250830 07:54:36.837237 13233 catalog_manager.cc:5415] Ignoring report from unknown tablet bcdac588f7c24d9d8572949e09b80a23
I20250830 07:54:36.823282 13459 tablet_service.cc:1515] Processing DeleteTablet for tablet 01771fa171374e92892345e7402c33d1 with delete_type TABLET_DATA_DELETED (replaced by tablet 1520d7257f864ea4ba4b9a5d0443f8a7) from {username='slave'} at 127.0.0.1:37956
I20250830 07:54:36.837348 13882 tablet_bootstrap.cc:654] T 05697181c0c149c79a395ff7525ea2af P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:36.823379 13468 tablet_service.cc:1515] Processing DeleteTablet for tablet c2f5f79547184009a0863b695a833694 with delete_type TABLET_DATA_DELETED (replaced by tablet 852e353f6ee945628ddebdbdd1bd76fb) from {username='slave'} at 127.0.0.1:37956
I20250830 07:54:36.825659 13461 tablet_service.cc:1515] Processing DeleteTablet for tablet d3f207cee78a43a1b5e030c09752c78c with delete_type TABLET_DATA_DELETED (replaced by tablet e0148ace593a4a70bbf941c97e65bda8) from {username='slave'} at 127.0.0.1:37956
I20250830 07:54:36.837955 13883 tablet_replica.cc:331] T c2f5f79547184009a0863b695a833694 P 2065c332f15a4739899af79f3669c3ba: stopping tablet replica
W20250830 07:54:36.838068 13218 catalog_manager.cc:4908] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): delete failed for tablet 01771fa171374e92892345e7402c33d1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 01771fa171374e92892345e7402c33d1 already in progress: creating tablet
I20250830 07:54:36.838255 13883 raft_consensus.cc:2241] T c2f5f79547184009a0863b695a833694 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Raft consensus shutting down.
I20250830 07:54:36.838459 13883 raft_consensus.cc:2270] T c2f5f79547184009a0863b695a833694 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Raft consensus is shut down!
I20250830 07:54:36.839944 13883 ts_tablet_manager.cc:1905] T c2f5f79547184009a0863b695a833694 P 2065c332f15a4739899af79f3669c3ba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250830 07:54:36.843005 13884 ts_tablet_manager.cc:1918] T c2f5f79547184009a0863b695a833694 P 9b057ade5dce45af9f8bf0bedf8b917f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250830 07:54:36.844729 13233 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_b4d7f806dfc640eeb8c6468a8ec88e14" } modify_external_catalogs: true
I20250830 07:54:36.844923 13233 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_b4d7f806dfc640eeb8c6468a8ec88e14" } modify_external_catalogs: true
I20250830 07:54:36.847711 13882 tablet_bootstrap.cc:492] T 05697181c0c149c79a395ff7525ea2af P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:54:36.847914 13882 ts_tablet_manager.cc:1397] T 05697181c0c149c79a395ff7525ea2af P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.032s user 0.001s sys 0.002s
I20250830 07:54:36.849040 13882 raft_consensus.cc:357] T 05697181c0c149c79a395ff7525ea2af P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:54:36.849225 13882 raft_consensus.cc:383] T 05697181c0c149c79a395ff7525ea2af P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:36.853304 13882 raft_consensus.cc:738] T 05697181c0c149c79a395ff7525ea2af P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:54:36.853629 13882 consensus_queue.cc:260] T 05697181c0c149c79a395ff7525ea2af P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:54:36.854197 13882 ts_tablet_manager.cc:1428] T 05697181c0c149c79a395ff7525ea2af P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.006s user 0.001s sys 0.001s
I20250830 07:54:36.843789 13886 tablet_bootstrap.cc:492] T 05697181c0c149c79a395ff7525ea2af P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:54:36.854508 13886 ts_tablet_manager.cc:1397] T 05697181c0c149c79a395ff7525ea2af P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.055s user 0.002s sys 0.003s
I20250830 07:54:36.855295 13886 raft_consensus.cc:357] T 05697181c0c149c79a395ff7525ea2af P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:54:36.855460 13886 raft_consensus.cc:383] T 05697181c0c149c79a395ff7525ea2af P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:36.856128 13886 raft_consensus.cc:738] T 05697181c0c149c79a395ff7525ea2af P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:54:36.856757 13886 consensus_queue.cc:260] T 05697181c0c149c79a395ff7525ea2af P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:54:36.860194 13608 tablet_service.cc:1515] Processing DeleteTablet for tablet 05697181c0c149c79a395ff7525ea2af with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:36 UTC) from {username='slave'} at 127.0.0.1:45306
I20250830 07:54:36.860436 13885 tablet_replica.cc:331] T 05697181c0c149c79a395ff7525ea2af P 6b5e454d98894637b466ea27f1b647f9: stopping tablet replica
I20250830 07:54:36.860639 13885 raft_consensus.cc:2241] T 05697181c0c149c79a395ff7525ea2af P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250830 07:54:36.860790 13885 raft_consensus.cc:2270] T 05697181c0c149c79a395ff7525ea2af P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250830 07:54:36.867199 13749 tablet_service.cc:1515] Processing DeleteTablet for tablet 05697181c0c149c79a395ff7525ea2af with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:36 UTC) from {username='slave'} at 127.0.0.1:45460
I20250830 07:54:36.870242 13233 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet e6491d149c0646848680cfdadb6fc76c
I20250830 07:54:36.870949 13608 tablet_service.cc:1515] Processing DeleteTablet for tablet e6491d149c0646848680cfdadb6fc76c with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:36 UTC) from {username='slave'} at 127.0.0.1:45306
I20250830 07:54:36.871553 13749 tablet_service.cc:1515] Processing DeleteTablet for tablet e6491d149c0646848680cfdadb6fc76c with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:36 UTC) from {username='slave'} at 127.0.0.1:45460
I20250830 07:54:36.871623 13461 tablet_service.cc:1515] Processing DeleteTablet for tablet e6491d149c0646848680cfdadb6fc76c with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:36 UTC) from {username='slave'} at 127.0.0.1:37956
I20250830 07:54:36.872870 13701 leader_election.cc:304] T 6f2d855ab3c04123b2f9ea22cda6ef04 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:54:36.873217 14287 raft_consensus.cc:2802] T 6f2d855ab3c04123b2f9ea22cda6ef04 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election won for term 1
I20250830 07:54:36.873415 14287 raft_consensus.cc:695] T 6f2d855ab3c04123b2f9ea22cda6ef04 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 LEADER]: Becoming Leader. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Running, Role: LEADER
I20250830 07:54:36.873656 14287 consensus_queue.cc:237] T 6f2d855ab3c04123b2f9ea22cda6ef04 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:54:36.876477 13886 ts_tablet_manager.cc:1428] T 05697181c0c149c79a395ff7525ea2af P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.022s user 0.002s sys 0.000s
I20250830 07:54:36.877768 13885 ts_tablet_manager.cc:1905] T 05697181c0c149c79a395ff7525ea2af P 6b5e454d98894637b466ea27f1b647f9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250830 07:54:36.880177 13233 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_8c549af74ae14e02bf6c6866959590cc" } modify_external_catalogs: true
I20250830 07:54:36.880383 13233 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_8c549af74ae14e02bf6c6866959590cc" } modify_external_catalogs: true
I20250830 07:54:36.884020 13886 tablet_bootstrap.cc:492] T 3167b609ed184decb4ccdb4945933ebb P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:54:36.885021 13883 ts_tablet_manager.cc:1918] T c2f5f79547184009a0863b695a833694 P 2065c332f15a4739899af79f3669c3ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250830 07:54:36.885566 13883 log.cc:1199] T c2f5f79547184009a0863b695a833694 P 2065c332f15a4739899af79f3669c3ba: Deleting WAL directory at /tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/ts-0/wal/wals/c2f5f79547184009a0863b695a833694
I20250830 07:54:36.887531 13886 tablet_bootstrap.cc:654] T 3167b609ed184decb4ccdb4945933ebb P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:36.889107 13883 ts_tablet_manager.cc:1939] T c2f5f79547184009a0863b695a833694 P 2065c332f15a4739899af79f3669c3ba: Deleting consensus metadata
I20250830 07:54:36.890719 13218 catalog_manager.cc:4928] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): tablet c2f5f79547184009a0863b695a833694 (table default.Table_4abf499bcf8a4fd88fd739d3a1daee3a [id=768d7e569197455bb092328ca1b32ed0]) successfully deleted
W20250830 07:54:36.891525 13218 catalog_manager.cc:4908] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): delete failed for tablet d3f207cee78a43a1b5e030c09752c78c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d3f207cee78a43a1b5e030c09752c78c already in progress: creating tablet
I20250830 07:54:36.892721 13887 tablet_bootstrap.cc:492] T 9696d8531a174585b8fd83a2391c02f7 P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:54:36.892911 13887 ts_tablet_manager.cc:1397] T 9696d8531a174585b8fd83a2391c02f7 P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.236s user 0.023s sys 0.051s
W20250830 07:54:36.893417 13218 catalog_manager.cc:4908] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): delete failed for tablet e6491d149c0646848680cfdadb6fc76c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e6491d149c0646848680cfdadb6fc76c already in progress: creating tablet
I20250830 07:54:36.894436 13887 raft_consensus.cc:357] T 9696d8531a174585b8fd83a2391c02f7 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:54:36.894661 13887 raft_consensus.cc:383] T 9696d8531a174585b8fd83a2391c02f7 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:36.894799 13887 raft_consensus.cc:738] T 9696d8531a174585b8fd83a2391c02f7 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:54:36.895118 13887 consensus_queue.cc:260] T 9696d8531a174585b8fd83a2391c02f7 P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:54:36.896865 13884 log.cc:1199] T c2f5f79547184009a0863b695a833694 P 9b057ade5dce45af9f8bf0bedf8b917f: Deleting WAL directory at /tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/ts-2/wal/wals/c2f5f79547184009a0863b695a833694
I20250830 07:54:36.897320 13884 ts_tablet_manager.cc:1939] T c2f5f79547184009a0863b695a833694 P 9b057ade5dce45af9f8bf0bedf8b917f: Deleting consensus metadata
I20250830 07:54:36.897526 13887 ts_tablet_manager.cc:1428] T 9696d8531a174585b8fd83a2391c02f7 P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20250830 07:54:36.897828 13887 tablet_bootstrap.cc:492] T 3167b609ed184decb4ccdb4945933ebb P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:54:36.898229 13884 tablet_replica.cc:331] T 5dac49aebcfa476d81547636cd4c6986 P 9b057ade5dce45af9f8bf0bedf8b917f: stopping tablet replica
I20250830 07:54:36.898443 13884 raft_consensus.cc:2241] T 5dac49aebcfa476d81547636cd4c6986 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Raft consensus shutting down.
I20250830 07:54:36.898613 13884 raft_consensus.cc:2270] T 5dac49aebcfa476d81547636cd4c6986 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Raft consensus is shut down!
I20250830 07:54:36.899338 13233 catalog_manager.cc:5864] Not sending DeleteTablet requests; no consensus state for tablet e5cbcc9367fd48ecb61654229c43c26d
W20250830 07:54:36.901836 13233 catalog_manager.cc:5415] Ignoring report from unknown tablet 6f2d855ab3c04123b2f9ea22cda6ef04
I20250830 07:54:36.902247 13231 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_d625e110b8414c8a8eb7e08d8ccc3270" } new_table_name: "default.Table_7dc4898210c641719d6d97c45dbd89c9" modify_external_catalogs: true
I20250830 07:54:36.904733 13887 tablet_bootstrap.cc:654] T 3167b609ed184decb4ccdb4945933ebb P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:36.905917 13226 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_f430b456b071480fb3f9a71e7f7ab431" } new_table_name: "default.Table_d9853559e8474b00b8c7d7b1a4d0c3ac" modify_external_catalogs: true
I20250830 07:54:36.906683 13219 catalog_manager.cc:4928] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): tablet c2f5f79547184009a0863b695a833694 (table default.Table_4abf499bcf8a4fd88fd739d3a1daee3a [id=768d7e569197455bb092328ca1b32ed0]) successfully deleted
I20250830 07:54:36.907012 14315 raft_consensus.cc:491] T ed87c6793dd149a6a363f1977d816628 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:36.907202 14315 raft_consensus.cc:513] T ed87c6793dd149a6a363f1977d816628 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:54:36.907953 14315 leader_election.cc:290] T ed87c6793dd149a6a363f1977d816628 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
I20250830 07:54:36.912619 13884 ts_tablet_manager.cc:1905] T 5dac49aebcfa476d81547636cd4c6986 P 9b057ade5dce45af9f8bf0bedf8b917f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250830 07:54:36.914425 13230 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_b012b7ddd1ee43f4bb1639d60c5cfd78" } new_table_name: "default.Table_80adb7e372ef4a98bd60fe6337d06400" modify_external_catalogs: true
W20250830 07:54:36.914978 13229 catalog_manager.cc:5415] Ignoring report from unknown tablet 9696d8531a174585b8fd83a2391c02f7
I20250830 07:54:36.916267 13229 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_8b26aa88b9f34e35ac10a238c1b2b2a1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:36.917250 13229 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8b26aa88b9f34e35ac10a238c1b2b2a1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:36.918180 13233 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_bb7373773a224aeda09e03bdc97470e6" } modify_external_catalogs: true
I20250830 07:54:36.918341 13233 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_bb7373773a224aeda09e03bdc97470e6" } modify_external_catalogs: true
I20250830 07:54:36.918768 13887 tablet_bootstrap.cc:492] T 3167b609ed184decb4ccdb4945933ebb P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:54:36.918970 13887 ts_tablet_manager.cc:1397] T 3167b609ed184decb4ccdb4945933ebb P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.021s user 0.004s sys 0.002s
I20250830 07:54:36.919346 13627 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "ed87c6793dd149a6a363f1977d816628" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
W20250830 07:54:36.919965 13703 leader_election.cc:343] T ed87c6793dd149a6a363f1977d816628 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:36.920338 14247 raft_consensus.cc:491] T 861809cc50764aa89140e587489e2d88 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:36.920495 14247 raft_consensus.cc:513] T 861809cc50764aa89140e587489e2d88 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:54:36.921137 14247 leader_election.cc:290] T 861809cc50764aa89140e587489e2d88 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:36.921725 13772 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "861809cc50764aa89140e587489e2d88" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:36.921931 13886 tablet_bootstrap.cc:492] T 3167b609ed184decb4ccdb4945933ebb P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:54:36.922118 13886 ts_tablet_manager.cc:1397] T 3167b609ed184decb4ccdb4945933ebb P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.038s user 0.005s sys 0.001s
W20250830 07:54:36.922295 13422 leader_election.cc:343] T 861809cc50764aa89140e587489e2d88 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:36.922847 13627 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "861809cc50764aa89140e587489e2d88" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:36.922886 13886 raft_consensus.cc:357] T 3167b609ed184decb4ccdb4945933ebb P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:54:36.923098 13886 raft_consensus.cc:383] T 3167b609ed184decb4ccdb4945933ebb P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:36.923185 13886 raft_consensus.cc:738] T 3167b609ed184decb4ccdb4945933ebb P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
W20250830 07:54:36.923342 13423 leader_election.cc:343] T 861809cc50764aa89140e587489e2d88 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:36.923450 13423 leader_election.cc:304] T 861809cc50764aa89140e587489e2d88 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba; no voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:54:36.923439 13886 consensus_queue.cc:260] T 3167b609ed184decb4ccdb4945933ebb P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:54:36.923916 14247 raft_consensus.cc:2747] T 861809cc50764aa89140e587489e2d88 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:54:36.925804 13886 ts_tablet_manager.cc:1428] T 3167b609ed184decb4ccdb4945933ebb P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20250830 07:54:36.926098 13887 raft_consensus.cc:357] T 3167b609ed184decb4ccdb4945933ebb P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:54:36.926298 13886 tablet_bootstrap.cc:492] T 48b422b125154fbdbb9c995dc372d128 P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:54:36.926702 13887 raft_consensus.cc:383] T 3167b609ed184decb4ccdb4945933ebb P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:36.926957 13887 raft_consensus.cc:738] T 3167b609ed184decb4ccdb4945933ebb P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:54:36.927409 13887 consensus_queue.cc:260] T 3167b609ed184decb4ccdb4945933ebb P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:54:36.928406 13886 tablet_bootstrap.cc:654] T 48b422b125154fbdbb9c995dc372d128 P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
W20250830 07:54:36.928536 13228 catalog_manager.cc:5415] Ignoring report from unknown tablet 3167b609ed184decb4ccdb4945933ebb
I20250830 07:54:36.930466 13232 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_fcd3d99bd5da4461be0a68789d51d740" } modify_external_catalogs: true
I20250830 07:54:36.930662 13232 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_fcd3d99bd5da4461be0a68789d51d740" } modify_external_catalogs: true
W20250830 07:54:36.932652 13228 catalog_manager.cc:5415] Ignoring report from unknown tablet 3167b609ed184decb4ccdb4945933ebb
I20250830 07:54:36.932950 13887 ts_tablet_manager.cc:1428] T 3167b609ed184decb4ccdb4945933ebb P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.011s user 0.001s sys 0.000s
I20250830 07:54:36.936035 13884 ts_tablet_manager.cc:1918] T 5dac49aebcfa476d81547636cd4c6986 P 9b057ade5dce45af9f8bf0bedf8b917f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250830 07:54:36.936237 13884 log.cc:1199] T 5dac49aebcfa476d81547636cd4c6986 P 9b057ade5dce45af9f8bf0bedf8b917f: Deleting WAL directory at /tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/ts-2/wal/wals/5dac49aebcfa476d81547636cd4c6986
I20250830 07:54:36.936678 13884 ts_tablet_manager.cc:1939] T 5dac49aebcfa476d81547636cd4c6986 P 9b057ade5dce45af9f8bf0bedf8b917f: Deleting consensus metadata
I20250830 07:54:36.937656 13219 catalog_manager.cc:4928] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): tablet 5dac49aebcfa476d81547636cd4c6986 (table default.Table_c971df90450b4c17821d0f0a51ae48a3 [id=5be1411ad9f548f8b84fa170596c4cf5]) successfully deleted
I20250830 07:54:36.938553 13887 tablet_bootstrap.cc:492] T 7c8e248d938f4651ae13199122b08768 P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
W20250830 07:54:36.938568 13219 catalog_manager.cc:4908] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): delete failed for tablet d3f207cee78a43a1b5e030c09752c78c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d3f207cee78a43a1b5e030c09752c78c already in progress: creating tablet
I20250830 07:54:36.938956 13884 tablet_replica.cc:331] T 05697181c0c149c79a395ff7525ea2af P 9b057ade5dce45af9f8bf0bedf8b917f: stopping tablet replica
I20250830 07:54:36.939195 13884 raft_consensus.cc:2241] T 05697181c0c149c79a395ff7525ea2af P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Raft consensus shutting down.
I20250830 07:54:36.939409 13884 raft_consensus.cc:2270] T 05697181c0c149c79a395ff7525ea2af P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Raft consensus is shut down!
I20250830 07:54:36.940160 13884 ts_tablet_manager.cc:1905] T 05697181c0c149c79a395ff7525ea2af P 9b057ade5dce45af9f8bf0bedf8b917f: Deleting tablet data with delete state TABLET_DATA_DELETED
W20250830 07:54:36.943159 13226 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a7dc529c40544bafbc9e7f0ab34086bd has no consensus state
I20250830 07:54:36.943434 13886 tablet_bootstrap.cc:492] T 48b422b125154fbdbb9c995dc372d128 P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:54:36.943620 13886 ts_tablet_manager.cc:1397] T 48b422b125154fbdbb9c995dc372d128 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.017s user 0.000s sys 0.003s
W20250830 07:54:36.944417 13230 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 8ae468b43b4c450ca7591b543c2539d9 has no consensus state
I20250830 07:54:36.944691 13887 tablet_bootstrap.cc:654] T 7c8e248d938f4651ae13199122b08768 P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:36.944612 13886 raft_consensus.cc:357] T 48b422b125154fbdbb9c995dc372d128 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:54:36.944770 13886 raft_consensus.cc:383] T 48b422b125154fbdbb9c995dc372d128 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20250830 07:54:36.944823 13231 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 6492bd11e50d4900927db0de3757aa24 consensus state has no leader
I20250830 07:54:36.944943 13886 raft_consensus.cc:738] T 48b422b125154fbdbb9c995dc372d128 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:54:36.945236 13886 consensus_queue.cc:260] T 48b422b125154fbdbb9c995dc372d128 P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:54:36.949503 13486 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "ed87c6793dd149a6a363f1977d816628" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:54:36.949867 13486 raft_consensus.cc:2466] T ed87c6793dd149a6a363f1977d816628 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 0.
I20250830 07:54:36.950387 13701 leader_election.cc:304] T ed87c6793dd149a6a363f1977d816628 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
W20250830 07:54:36.950836 13230 catalog_manager.cc:5415] Ignoring report from unknown tablet 3167b609ed184decb4ccdb4945933ebb
I20250830 07:54:36.951294 14287 raft_consensus.cc:2802] T ed87c6793dd149a6a363f1977d816628 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:54:36.951921 14287 raft_consensus.cc:491] T ed87c6793dd149a6a363f1977d816628 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:54:36.952059 14287 raft_consensus.cc:3058] T ed87c6793dd149a6a363f1977d816628 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:36.954890 14287 raft_consensus.cc:513] T ed87c6793dd149a6a363f1977d816628 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:54:36.956300 14287 leader_election.cc:290] T ed87c6793dd149a6a363f1977d816628 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Requested vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
I20250830 07:54:36.957211 13886 ts_tablet_manager.cc:1428] T 48b422b125154fbdbb9c995dc372d128 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.013s user 0.000s sys 0.001s
I20250830 07:54:36.957724 13486 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "ed87c6793dd149a6a363f1977d816628" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba"
I20250830 07:54:36.958081 13486 raft_consensus.cc:3058] T ed87c6793dd149a6a363f1977d816628 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:36.961643 13886 tablet_bootstrap.cc:492] T 9696d8531a174585b8fd83a2391c02f7 P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:54:36.962669 13486 raft_consensus.cc:2466] T ed87c6793dd149a6a363f1977d816628 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 1.
I20250830 07:54:36.963860 13231 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_f3971979b013453b8be5865752fc9c03" } modify_external_catalogs: true
I20250830 07:54:36.964152 13231 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_f3971979b013453b8be5865752fc9c03" } modify_external_catalogs: true
I20250830 07:54:36.968452 13887 tablet_bootstrap.cc:492] T 7c8e248d938f4651ae13199122b08768 P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:54:36.968776 13887 ts_tablet_manager.cc:1397] T 7c8e248d938f4651ae13199122b08768 P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.030s user 0.000s sys 0.008s
I20250830 07:54:36.963645 13701 leader_election.cc:304] T ed87c6793dd149a6a363f1977d816628 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters:
I20250830 07:54:36.969856 14287 raft_consensus.cc:2802] T ed87c6793dd149a6a363f1977d816628 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election won for term 1
I20250830 07:54:36.970227 13230 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_53b3c649c07a4c328e41b846806f0f8b" } new_table_name: "default.Table_9d44727222db4c239a8c0e2c980d03e8" modify_external_catalogs: true
I20250830 07:54:36.970446 13226 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_e24800a610814eeabd6df4339f329787"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:36.971009 13226 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e24800a610814eeabd6df4339f329787 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:36.971141 13887 raft_consensus.cc:357] T 7c8e248d938f4651ae13199122b08768 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:54:36.971338 13887 raft_consensus.cc:383] T 7c8e248d938f4651ae13199122b08768 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:36.971408 13887 raft_consensus.cc:738] T 7c8e248d938f4651ae13199122b08768 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:54:36.971666 14287 raft_consensus.cc:695] T ed87c6793dd149a6a363f1977d816628 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 LEADER]: Becoming Leader. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Running, Role: LEADER
I20250830 07:54:36.972018 14287 consensus_queue.cc:237] T ed87c6793dd149a6a363f1977d816628 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:54:36.972105 13887 consensus_queue.cc:260] T 7c8e248d938f4651ae13199122b08768 P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:54:36.963363 13886 tablet_bootstrap.cc:654] T 9696d8531a174585b8fd83a2391c02f7 P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:36.976460 13887 ts_tablet_manager.cc:1428] T 7c8e248d938f4651ae13199122b08768 P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.007s user 0.001s sys 0.001s
I20250830 07:54:36.976454 13627 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "ed87c6793dd149a6a363f1977d816628" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9"
I20250830 07:54:36.976455 13228 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_3dd5954f874245b0969d023030dec5a2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250830 07:54:36.976784 13225 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_f5718c63775946638bc63cf7e8708669" } new_table_name: "default.Table_27b3b751051e48bd8597cd51939e2c7d" modify_external_catalogs: true
W20250830 07:54:36.976995 13228 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3dd5954f874245b0969d023030dec5a2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:36.977319 13887 tablet_bootstrap.cc:492] T 8ab12188dddc4de69ac73dffb01d51a9 P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:54:36.978082 13956 raft_consensus.cc:491] T 1fa571e9490e499792225d7b786e8658 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:36.978325 13956 raft_consensus.cc:513] T 1fa571e9490e499792225d7b786e8658 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:36.979010 13887 tablet_bootstrap.cc:654] T 8ab12188dddc4de69ac73dffb01d51a9 P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:36.979839 13956 leader_election.cc:290] T 1fa571e9490e499792225d7b786e8658 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
W20250830 07:54:36.980392 13703 leader_election.cc:343] T ed87c6793dd149a6a363f1977d816628 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:36.981297 13885 ts_tablet_manager.cc:1918] T 05697181c0c149c79a395ff7525ea2af P 6b5e454d98894637b466ea27f1b647f9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250830 07:54:36.981701 13772 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "1fa571e9490e499792225d7b786e8658" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:36.981952 13772 raft_consensus.cc:2391] T 1fa571e9490e499792225d7b786e8658 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b5e454d98894637b466ea27f1b647f9 in current term 1: Already voted for candidate 2065c332f15a4739899af79f3669c3ba in this term.
I20250830 07:54:36.981515 13882 tablet_bootstrap.cc:492] T ed87c6793dd149a6a363f1977d816628 P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:54:36.982535 13232 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet 853503f3f98a49219b077af980180400
I20250830 07:54:36.984436 13461 tablet_service.cc:1515] Processing DeleteTablet for tablet 853503f3f98a49219b077af980180400 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:36 UTC) from {username='slave'} at 127.0.0.1:37956
I20250830 07:54:36.984490 13749 tablet_service.cc:1515] Processing DeleteTablet for tablet 853503f3f98a49219b077af980180400 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:36 UTC) from {username='slave'} at 127.0.0.1:45460
I20250830 07:54:36.984890 13233 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet e4c5eedb7f4d4397b19b8a3e0ddf9458
I20250830 07:54:36.986852 13749 tablet_service.cc:1515] Processing DeleteTablet for tablet e4c5eedb7f4d4397b19b8a3e0ddf9458 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:36 UTC) from {username='slave'} at 127.0.0.1:45460
W20250830 07:54:36.986954 13218 catalog_manager.cc:4908] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): delete failed for tablet 853503f3f98a49219b077af980180400 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 853503f3f98a49219b077af980180400 already in progress: creating tablet
I20250830 07:54:36.988013 13461 tablet_service.cc:1515] Processing DeleteTablet for tablet e4c5eedb7f4d4397b19b8a3e0ddf9458 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:36 UTC) from {username='slave'} at 127.0.0.1:37956
I20250830 07:54:36.988528 13608 tablet_service.cc:1515] Processing DeleteTablet for tablet 853503f3f98a49219b077af980180400 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:36 UTC) from {username='slave'} at 127.0.0.1:45306
W20250830 07:54:36.988976 13218 catalog_manager.cc:4908] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): delete failed for tablet e4c5eedb7f4d4397b19b8a3e0ddf9458 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e4c5eedb7f4d4397b19b8a3e0ddf9458 already in progress: creating tablet
I20250830 07:54:36.969513 13884 ts_tablet_manager.cc:1918] T 05697181c0c149c79a395ff7525ea2af P 9b057ade5dce45af9f8bf0bedf8b917f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250830 07:54:36.990819 13598 tablet_service.cc:1515] Processing DeleteTablet for tablet e4c5eedb7f4d4397b19b8a3e0ddf9458 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:36 UTC) from {username='slave'} at 127.0.0.1:45306
I20250830 07:54:36.991173 13884 log.cc:1199] T 05697181c0c149c79a395ff7525ea2af P 9b057ade5dce45af9f8bf0bedf8b917f: Deleting WAL directory at /tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/ts-2/wal/wals/05697181c0c149c79a395ff7525ea2af
I20250830 07:54:36.991897 13882 tablet_bootstrap.cc:654] T ed87c6793dd149a6a363f1977d816628 P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:36.992627 13885 log.cc:1199] T 05697181c0c149c79a395ff7525ea2af P 6b5e454d98894637b466ea27f1b647f9: Deleting WAL directory at /tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/ts-1/wal/wals/05697181c0c149c79a395ff7525ea2af
I20250830 07:54:36.993214 13884 ts_tablet_manager.cc:1939] T 05697181c0c149c79a395ff7525ea2af P 9b057ade5dce45af9f8bf0bedf8b917f: Deleting consensus metadata
I20250830 07:54:36.994767 13219 catalog_manager.cc:4928] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): tablet 05697181c0c149c79a395ff7525ea2af (table default.Table_ad824ae7601a4c6b9e756946853e09c7 [id=a2376c0724aa49b8b9545d111f12e1e6]) successfully deleted
I20250830 07:54:36.996035 13956 raft_consensus.cc:491] T d1ae3812d72b419798736328da64b53c P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:36.996331 13886 tablet_bootstrap.cc:492] T 9696d8531a174585b8fd83a2391c02f7 P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:54:36.996404 13956 raft_consensus.cc:513] T d1ae3812d72b419798736328da64b53c P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:36.997061 13886 ts_tablet_manager.cc:1397] T 9696d8531a174585b8fd83a2391c02f7 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.035s user 0.006s sys 0.000s
I20250830 07:54:36.997208 13956 leader_election.cc:290] T d1ae3812d72b419798736328da64b53c P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
W20250830 07:54:36.998262 13219 catalog_manager.cc:4908] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): delete failed for tablet e6491d149c0646848680cfdadb6fc76c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e6491d149c0646848680cfdadb6fc76c already in progress: creating tablet
W20250830 07:54:36.998600 13561 leader_election.cc:343] T d1ae3812d72b419798736328da64b53c P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): Not found: Tablet not found: d1ae3812d72b419798736328da64b53c
I20250830 07:54:36.999119 13885 ts_tablet_manager.cc:1939] T 05697181c0c149c79a395ff7525ea2af P 6b5e454d98894637b466ea27f1b647f9: Deleting consensus metadata
I20250830 07:54:37.000080 13220 catalog_manager.cc:4928] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): tablet 05697181c0c149c79a395ff7525ea2af (table default.Table_ad824ae7601a4c6b9e756946853e09c7 [id=a2376c0724aa49b8b9545d111f12e1e6]) successfully deleted
W20250830 07:54:37.000367 13220 catalog_manager.cc:4908] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet e6491d149c0646848680cfdadb6fc76c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e6491d149c0646848680cfdadb6fc76c already in progress: creating tablet
I20250830 07:54:36.997666 13772 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "d1ae3812d72b419798736328da64b53c" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:37.001289 13772 raft_consensus.cc:2466] T d1ae3812d72b419798736328da64b53c P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b5e454d98894637b466ea27f1b647f9 in term 0.
W20250830 07:54:37.001441 13220 catalog_manager.cc:4908] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet 853503f3f98a49219b077af980180400 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 853503f3f98a49219b077af980180400 already in progress: creating tablet
I20250830 07:54:37.001714 13562 leader_election.cc:304] T d1ae3812d72b419798736328da64b53c P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 2065c332f15a4739899af79f3669c3ba
W20250830 07:54:37.001745 13220 catalog_manager.cc:4908] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet e4c5eedb7f4d4397b19b8a3e0ddf9458 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e4c5eedb7f4d4397b19b8a3e0ddf9458 already in progress: creating tablet
I20250830 07:54:37.002421 13956 raft_consensus.cc:2802] T d1ae3812d72b419798736328da64b53c P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:54:37.002516 13956 raft_consensus.cc:491] T d1ae3812d72b419798736328da64b53c P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:54:37.002619 13956 raft_consensus.cc:3058] T d1ae3812d72b419798736328da64b53c P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:37.003062 13886 raft_consensus.cc:357] T 9696d8531a174585b8fd83a2391c02f7 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:54:37.003247 13886 raft_consensus.cc:383] T 9696d8531a174585b8fd83a2391c02f7 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:37.003330 13886 raft_consensus.cc:738] T 9696d8531a174585b8fd83a2391c02f7 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:54:37.004089 13886 consensus_queue.cc:260] T 9696d8531a174585b8fd83a2391c02f7 P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
W20250830 07:54:37.004878 13219 catalog_manager.cc:4908] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): delete failed for tablet 853503f3f98a49219b077af980180400 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 853503f3f98a49219b077af980180400 already in progress: creating tablet
I20250830 07:54:37.005201 13886 ts_tablet_manager.cc:1428] T 9696d8531a174585b8fd83a2391c02f7 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20250830 07:54:37.005336 13956 raft_consensus.cc:513] T d1ae3812d72b419798736328da64b53c P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
W20250830 07:54:37.005843 13219 catalog_manager.cc:4908] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): delete failed for tablet e4c5eedb7f4d4397b19b8a3e0ddf9458 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e4c5eedb7f4d4397b19b8a3e0ddf9458 already in progress: creating tablet
I20250830 07:54:37.006048 13887 tablet_bootstrap.cc:492] T 8ab12188dddc4de69ac73dffb01d51a9 P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:54:37.006230 13887 ts_tablet_manager.cc:1397] T 8ab12188dddc4de69ac73dffb01d51a9 P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.029s user 0.005s sys 0.002s
W20250830 07:54:37.006630 13561 leader_election.cc:343] T d1ae3812d72b419798736328da64b53c P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): Not found: Tablet not found: d1ae3812d72b419798736328da64b53c
W20250830 07:54:37.007301 13233 catalog_manager.cc:5415] Ignoring report from unknown tablet ed87c6793dd149a6a363f1977d816628
I20250830 07:54:37.007421 13772 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "d1ae3812d72b419798736328da64b53c" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f"
I20250830 07:54:37.007594 13772 raft_consensus.cc:3058] T d1ae3812d72b419798736328da64b53c P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:37.007921 13887 raft_consensus.cc:357] T 8ab12188dddc4de69ac73dffb01d51a9 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:54:37.008105 13887 raft_consensus.cc:383] T 8ab12188dddc4de69ac73dffb01d51a9 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:37.008172 13887 raft_consensus.cc:738] T 8ab12188dddc4de69ac73dffb01d51a9 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:54:37.010218 13772 raft_consensus.cc:2466] T d1ae3812d72b419798736328da64b53c P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b5e454d98894637b466ea27f1b647f9 in term 1.
I20250830 07:54:37.010715 13562 leader_election.cc:304] T d1ae3812d72b419798736328da64b53c P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 2065c332f15a4739899af79f3669c3ba
I20250830 07:54:37.011027 13899 raft_consensus.cc:2802] T d1ae3812d72b419798736328da64b53c P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Leader election won for term 1
I20250830 07:54:37.011197 13899 raft_consensus.cc:695] T d1ae3812d72b419798736328da64b53c P 6b5e454d98894637b466ea27f1b647f9 [term 1 LEADER]: Becoming Leader. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Running, Role: LEADER
I20250830 07:54:37.011531 13899 consensus_queue.cc:237] T d1ae3812d72b419798736328da64b53c P 6b5e454d98894637b466ea27f1b647f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:37.012158 13956 leader_election.cc:290] T d1ae3812d72b419798736328da64b53c P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 election: Requested vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
W20250830 07:54:37.014667 13561 leader_election.cc:343] T 1fa571e9490e499792225d7b786e8658 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): Not found: Tablet not found: 1fa571e9490e499792225d7b786e8658
I20250830 07:54:37.014833 13561 leader_election.cc:304] T 1fa571e9490e499792225d7b786e8658 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b5e454d98894637b466ea27f1b647f9; no voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f
W20250830 07:54:37.001422 13232 catalog_manager.cc:5415] Ignoring report from unknown tablet ef16b9e2d444489699f4db1ac26d5f6c
I20250830 07:54:37.015563 13956 raft_consensus.cc:3058] T 1fa571e9490e499792225d7b786e8658 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:37.016251 13886 tablet_bootstrap.cc:492] T 861809cc50764aa89140e587489e2d88 P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:54:37.018559 13956 raft_consensus.cc:2747] T 1fa571e9490e499792225d7b786e8658 P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:54:37.019814 13233 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_86688c50c80b483d9db991795dd03369"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250830 07:54:37.020165 13229 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_df1448b0d1b44810b3ce8ad508249df6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:37.020659 13233 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_86688c50c80b483d9db991795dd03369 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250830 07:54:37.020694 13229 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_df1448b0d1b44810b3ce8ad508249df6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250830 07:54:37.023659 13232 catalog_manager.cc:5415] Ignoring report from unknown tablet 9696d8531a174585b8fd83a2391c02f7
I20250830 07:54:37.024228 13231 catalog_manager.cc:5864] Not sending DeleteTablet requests; no consensus state for tablet 2edfb2d6a7f340fd888eeba2f09c58ab
I20250830 07:54:37.034437 13232 master_service.cc:948] ReplaceTablet: received request to replace tablet 0507245aa8c74aeb9f3eafba0682590d from {username='slave'} at 127.0.0.1:42126
I20250830 07:54:37.041745 13227 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_5e025fcd87f8470fa772efb1dfeaa957"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250830 07:54:37.040381 13887 consensus_queue.cc:260] T 8ab12188dddc4de69ac73dffb01d51a9 P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
W20250830 07:54:37.042515 13227 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5e025fcd87f8470fa772efb1dfeaa957 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250830 07:54:37.046547 13225 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 8eb010d7955d47a89ff1d01be1b5b01e consensus state has no leader
I20250830 07:54:37.047122 13231 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_8fee89ccc11041be9f0ff95c5aa089c4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:37.048049 13231 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8fee89ccc11041be9f0ff95c5aa089c4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:37.048702 14290 tablet.cc:1722] T d0238794efb14150af6138b0d8bd80ec P 6b5e454d98894637b466ea27f1b647f9: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4
I20250830 07:54:37.049125 13887 ts_tablet_manager.cc:1428] T 8ab12188dddc4de69ac73dffb01d51a9 P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.042s user 0.000s sys 0.002s
W20250830 07:54:37.050508 13230 catalog_manager.cc:5415] Ignoring report from unknown tablet 9696d8531a174585b8fd83a2391c02f7
I20250830 07:54:37.052062 13461 tablet_service.cc:1515] Processing DeleteTablet for tablet 8ab12188dddc4de69ac73dffb01d51a9 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:36 UTC) from {username='slave'} at 127.0.0.1:37956
I20250830 07:54:37.052330 13883 tablet_replica.cc:331] T 8ab12188dddc4de69ac73dffb01d51a9 P 2065c332f15a4739899af79f3669c3ba: stopping tablet replica
I20250830 07:54:37.052528 13883 raft_consensus.cc:2241] T 8ab12188dddc4de69ac73dffb01d51a9 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Raft consensus shutting down.
I20250830 07:54:37.052703 13883 raft_consensus.cc:2270] T 8ab12188dddc4de69ac73dffb01d51a9 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Raft consensus is shut down!
W20250830 07:54:37.052961 13230 catalog_manager.cc:5415] Ignoring report from unknown tablet d1ae3812d72b419798736328da64b53c
I20250830 07:54:37.053875 13883 ts_tablet_manager.cc:1905] T 8ab12188dddc4de69ac73dffb01d51a9 P 2065c332f15a4739899af79f3669c3ba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250830 07:54:37.053998 14314 tablet.cc:1722] T d0238794efb14150af6138b0d8bd80ec P 9b057ade5dce45af9f8bf0bedf8b917f: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4
I20250830 07:54:37.059579 13886 tablet_bootstrap.cc:654] T 861809cc50764aa89140e587489e2d88 P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:37.065178 13883 ts_tablet_manager.cc:1918] T 8ab12188dddc4de69ac73dffb01d51a9 P 2065c332f15a4739899af79f3669c3ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250830 07:54:37.065414 13225 master_service.cc:948] ReplaceTablet: received request to replace tablet e4f1ff6026bb45e28e63c27c83399d72 from {username='slave'} at 127.0.0.1:42126
I20250830 07:54:37.068830 13883 log.cc:1199] T 8ab12188dddc4de69ac73dffb01d51a9 P 2065c332f15a4739899af79f3669c3ba: Deleting WAL directory at /tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/ts-0/wal/wals/8ab12188dddc4de69ac73dffb01d51a9
I20250830 07:54:37.069295 13230 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_366afa859163468bad426ce2e1e8f209"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:37.070055 13230 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_366afa859163468bad426ce2e1e8f209 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:37.070026 13225 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_d64a5c5f7ba84d93ae31d439707f528d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250830 07:54:37.071938 13954 raft_consensus.cc:491] T d33a5d107c6849aca6eb48ffdf8a5463 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:37.072125 13954 raft_consensus.cc:513] T d33a5d107c6849aca6eb48ffdf8a5463 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } }
W20250830 07:54:37.072394 13225 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d64a5c5f7ba84d93ae31d439707f528d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:37.072769 13954 leader_election.cc:290] T d33a5d107c6849aca6eb48ffdf8a5463 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743), 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967)
I20250830 07:54:37.069319 13226 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_106c5d91b7314b3398e48ac2c97aa95b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:37.073830 13423 leader_election.cc:343] T d33a5d107c6849aca6eb48ffdf8a5463 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Not found: Tablet not found: d33a5d107c6849aca6eb48ffdf8a5463
W20250830 07:54:37.074246 13226 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_106c5d91b7314b3398e48ac2c97aa95b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:37.074219 13772 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "d33a5d107c6849aca6eb48ffdf8a5463" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:37.074417 13772 raft_consensus.cc:2466] T d33a5d107c6849aca6eb48ffdf8a5463 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2065c332f15a4739899af79f3669c3ba in term 1.
I20250830 07:54:37.074934 13422 leader_election.cc:304] T d33a5d107c6849aca6eb48ffdf8a5463 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:54:37.075050 14291 tablet.cc:1722] T d0238794efb14150af6138b0d8bd80ec P 2065c332f15a4739899af79f3669c3ba: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4
I20250830 07:54:37.075453 13954 raft_consensus.cc:2802] T d33a5d107c6849aca6eb48ffdf8a5463 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader pre-election won for term 2
I20250830 07:54:37.075552 13954 raft_consensus.cc:491] T d33a5d107c6849aca6eb48ffdf8a5463 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:54:37.075680 13954 raft_consensus.cc:3058] T d33a5d107c6849aca6eb48ffdf8a5463 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Advancing to term 2
I20250830 07:54:37.076821 13883 ts_tablet_manager.cc:1939] T 8ab12188dddc4de69ac73dffb01d51a9 P 2065c332f15a4739899af79f3669c3ba: Deleting consensus metadata
I20250830 07:54:37.078198 13887 tablet_bootstrap.cc:492] T d912c69d8722403aa56cbbde4ce59782 P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:54:37.079201 13218 catalog_manager.cc:4928] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): tablet 8ab12188dddc4de69ac73dffb01d51a9 (table default.Table_941683cb836e4df7a4f2cf11c6b54f0e [id=388ffc0a7b884c26811aab0ec8eccf71]) successfully deleted
I20250830 07:54:37.081357 13887 tablet_bootstrap.cc:654] T d912c69d8722403aa56cbbde4ce59782 P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:37.083014 14344 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.12.209.60:43889 every 8 connection(s)
I20250830 07:54:37.086092 13233 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_decad1c6025c4be0aa3aa8fea4ca31be" } modify_external_catalogs: true
I20250830 07:54:37.086272 13233 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_decad1c6025c4be0aa3aa8fea4ca31be" } modify_external_catalogs: true
I20250830 07:54:37.082085 13954 raft_consensus.cc:513] T d33a5d107c6849aca6eb48ffdf8a5463 P 2065c332f15a4739899af79f3669c3ba [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } }
I20250830 07:54:37.091241 13773 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "d33a5d107c6849aca6eb48ffdf8a5463" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f"
I20250830 07:54:37.091430 13773 raft_consensus.cc:3058] T d33a5d107c6849aca6eb48ffdf8a5463 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Advancing to term 2
I20250830 07:54:37.093770 13887 tablet_bootstrap.cc:492] T d912c69d8722403aa56cbbde4ce59782 P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:54:37.093904 13887 ts_tablet_manager.cc:1397] T d912c69d8722403aa56cbbde4ce59782 P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.016s user 0.005s sys 0.001s
I20250830 07:54:37.094545 13773 raft_consensus.cc:2466] T d33a5d107c6849aca6eb48ffdf8a5463 P 9b057ade5dce45af9f8bf0bedf8b917f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2065c332f15a4739899af79f3669c3ba in term 2.
I20250830 07:54:37.095489 13422 leader_election.cc:304] T d33a5d107c6849aca6eb48ffdf8a5463 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters:
I20250830 07:54:37.095896 14038 raft_consensus.cc:2802] T d33a5d107c6849aca6eb48ffdf8a5463 P 2065c332f15a4739899af79f3669c3ba [term 2 FOLLOWER]: Leader election won for term 2
I20250830 07:54:37.096067 14038 raft_consensus.cc:695] T d33a5d107c6849aca6eb48ffdf8a5463 P 2065c332f15a4739899af79f3669c3ba [term 2 LEADER]: Becoming Leader. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Running, Role: LEADER
I20250830 07:54:37.096498 13887 raft_consensus.cc:357] T d912c69d8722403aa56cbbde4ce59782 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:54:37.096695 13887 raft_consensus.cc:383] T d912c69d8722403aa56cbbde4ce59782 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:37.096788 13887 raft_consensus.cc:738] T d912c69d8722403aa56cbbde4ce59782 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:54:37.096441 14038 consensus_queue.cc:237] T d33a5d107c6849aca6eb48ffdf8a5463 P 2065c332f15a4739899af79f3669c3ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } }
I20250830 07:54:37.096988 13887 consensus_queue.cc:260] T d912c69d8722403aa56cbbde4ce59782 P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:54:37.098975 13887 ts_tablet_manager.cc:1428] T d912c69d8722403aa56cbbde4ce59782 P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20250830 07:54:37.099303 13887 tablet_bootstrap.cc:492] T 05da843c0fe4482a926e410e06b22461 P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:54:37.099637 13954 leader_election.cc:290] T d33a5d107c6849aca6eb48ffdf8a5463 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 2 election: Requested vote from peers 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743), 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967)
W20250830 07:54:37.100121 13423 leader_election.cc:343] T d33a5d107c6849aca6eb48ffdf8a5463 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Not found: Tablet not found: d33a5d107c6849aca6eb48ffdf8a5463
I20250830 07:54:37.101460 13229 master_service.cc:948] ReplaceTablet: received request to replace tablet 2b4ce50fbd26484faba3faa2ec5115c0 from {username='slave'} at 127.0.0.1:42126
I20250830 07:54:37.103965 13887 tablet_bootstrap.cc:654] T 05da843c0fe4482a926e410e06b22461 P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:37.104369 13999 rpc_server.cc:307] RPC server started. Bound to: 127.12.209.60:43889
I20250830 07:54:37.107350 13999 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/master-2/data/info.pb
I20250830 07:54:37.110750 13124 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskbivBUj/build/asan/bin/kudu as pid 13999
I20250830 07:54:37.121636 13882 tablet_bootstrap.cc:492] T ed87c6793dd149a6a363f1977d816628 P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:54:37.122232 13882 ts_tablet_manager.cc:1397] T ed87c6793dd149a6a363f1977d816628 P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.141s user 0.015s sys 0.024s
I20250830 07:54:37.123286 13882 raft_consensus.cc:357] T ed87c6793dd149a6a363f1977d816628 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:54:37.124439 13882 raft_consensus.cc:383] T ed87c6793dd149a6a363f1977d816628 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:37.124683 13887 tablet_bootstrap.cc:492] T 05da843c0fe4482a926e410e06b22461 P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:54:37.124909 13882 raft_consensus.cc:738] T ed87c6793dd149a6a363f1977d816628 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:54:37.125213 13887 ts_tablet_manager.cc:1397] T 05da843c0fe4482a926e410e06b22461 P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.026s user 0.002s sys 0.002s
I20250830 07:54:37.125548 13882 consensus_queue.cc:260] T ed87c6793dd149a6a363f1977d816628 P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:54:37.128042 13887 raft_consensus.cc:357] T 05da843c0fe4482a926e410e06b22461 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:54:37.128973 13882 ts_tablet_manager.cc:1428] T ed87c6793dd149a6a363f1977d816628 P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
I20250830 07:54:37.129371 13882 tablet_bootstrap.cc:492] T c2f5f79547184009a0863b695a833694 P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:54:37.129536 13887 raft_consensus.cc:383] T 05da843c0fe4482a926e410e06b22461 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:37.129969 13899 raft_consensus.cc:491] T 29d492735cd14bb6b4a2a9a3929f62f3 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:37.130091 13899 raft_consensus.cc:513] T 29d492735cd14bb6b4a2a9a3929f62f3 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:37.130810 13899 leader_election.cc:290] T 29d492735cd14bb6b4a2a9a3929f62f3 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:37.131834 13882 tablet_bootstrap.cc:654] T c2f5f79547184009a0863b695a833694 P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:37.131978 13772 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "29d492735cd14bb6b4a2a9a3929f62f3" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:37.131642 13486 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "29d492735cd14bb6b4a2a9a3929f62f3" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:54:37.132799 13486 raft_consensus.cc:2391] T 29d492735cd14bb6b4a2a9a3929f62f3 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b5e454d98894637b466ea27f1b647f9 in current term 1: Already voted for candidate 9b057ade5dce45af9f8bf0bedf8b917f in this term.
I20250830 07:54:37.133276 13561 leader_election.cc:304] T 29d492735cd14bb6b4a2a9a3929f62f3 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b5e454d98894637b466ea27f1b647f9; no voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:54:37.133684 13956 raft_consensus.cc:3058] T 29d492735cd14bb6b4a2a9a3929f62f3 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:37.136396 13956 raft_consensus.cc:2747] T 29d492735cd14bb6b4a2a9a3929f62f3 P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:54:37.136760 13887 raft_consensus.cc:738] T 05da843c0fe4482a926e410e06b22461 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:54:37.137140 13887 consensus_queue.cc:260] T 05da843c0fe4482a926e410e06b22461 P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:54:37.142630 13887 ts_tablet_manager.cc:1428] T 05da843c0fe4482a926e410e06b22461 P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.015s user 0.001s sys 0.001s
I20250830 07:54:37.142726 13232 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet 0507245aa8c74aeb9f3eafba0682590d
I20250830 07:54:37.143322 13232 catalog_manager.cc:6652] ReplaceTablet: tablet 0507245aa8c74aeb9f3eafba0682590d deleted and replaced by tablet d2f842d4367145108aa9ebe78828d6b0
I20250830 07:54:37.144677 13461 tablet_service.cc:1515] Processing DeleteTablet for tablet 0507245aa8c74aeb9f3eafba0682590d with delete_type TABLET_DATA_DELETED (replaced by tablet d2f842d4367145108aa9ebe78828d6b0) from {username='slave'} at 127.0.0.1:37956
I20250830 07:54:37.145879 13598 tablet_service.cc:1515] Processing DeleteTablet for tablet 0507245aa8c74aeb9f3eafba0682590d with delete_type TABLET_DATA_DELETED (replaced by tablet d2f842d4367145108aa9ebe78828d6b0) from {username='slave'} at 127.0.0.1:45306
I20250830 07:54:37.146302 13749 tablet_service.cc:1515] Processing DeleteTablet for tablet 0507245aa8c74aeb9f3eafba0682590d with delete_type TABLET_DATA_DELETED (replaced by tablet d2f842d4367145108aa9ebe78828d6b0) from {username='slave'} at 127.0.0.1:45460
I20250830 07:54:37.147101 13887 tablet_bootstrap.cc:492] T 48b422b125154fbdbb9c995dc372d128 P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:54:37.148774 13887 tablet_bootstrap.cc:654] T 48b422b125154fbdbb9c995dc372d128 P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
W20250830 07:54:37.148792 13218 catalog_manager.cc:4908] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): delete failed for tablet 0507245aa8c74aeb9f3eafba0682590d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0507245aa8c74aeb9f3eafba0682590d already in progress: creating tablet
W20250830 07:54:37.149441 13220 catalog_manager.cc:4908] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet 0507245aa8c74aeb9f3eafba0682590d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0507245aa8c74aeb9f3eafba0682590d already in progress: creating tablet
W20250830 07:54:37.150085 13219 catalog_manager.cc:4908] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): delete failed for tablet 0507245aa8c74aeb9f3eafba0682590d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0507245aa8c74aeb9f3eafba0682590d already in progress: creating tablet
I20250830 07:54:37.152782 13231 master_service.cc:948] ReplaceTablet: received request to replace tablet b480f5eb03804baeb61cd0424d70faf5 from {username='slave'} at 127.0.0.1:42126
I20250830 07:54:37.153337 13228 catalog_manager.cc:6127] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: default.Table_9d44727222db4c239a8c0e2c980d03e8 [id=8628f6e9686d43b6aa84cd3202db8e80] alter complete (version 4)
I20250830 07:54:37.153863 13232 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_98238aa0585b4974bfdc935b98b5ed1e" } modify_external_catalogs: true
I20250830 07:54:37.154067 13232 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_98238aa0585b4974bfdc935b98b5ed1e" } modify_external_catalogs: true
I20250830 07:54:37.157064 13234 master_service.cc:948] ReplaceTablet: received request to replace tablet 4ab63ff59d4e4ec2b7b64d605545a870 from {username='slave'} at 127.0.0.1:42126
I20250830 07:54:37.157307 13231 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_f2ddc7e5b82f44aabe9060d952e758d7" } new_table_name: "default.Table_12347ca05ca14f29981270f4186c49e4" modify_external_catalogs: true
I20250830 07:54:37.157691 13227 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_99fc46a4e68b44b7974861887290284e" } new_table_name: "default.Table_a1b7e99160f443da8add698947fe9e63" modify_external_catalogs: true
I20250830 07:54:37.159687 13228 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_238dacf9721e4d9d9b4f077ddadc5679" } new_table_name: "default.Table_f0b390998fd444f6bd6a1b82953067c2" modify_external_catalogs: true
W20250830 07:54:37.164350 13234 catalog_manager.cc:5415] Ignoring report from unknown tablet 05da843c0fe4482a926e410e06b22461
W20250830 07:54:37.164485 13234 catalog_manager.cc:5415] Ignoring report from unknown tablet d33a5d107c6849aca6eb48ffdf8a5463
I20250830 07:54:37.167923 13882 tablet_bootstrap.cc:492] T c2f5f79547184009a0863b695a833694 P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:54:37.168144 13882 ts_tablet_manager.cc:1397] T c2f5f79547184009a0863b695a833694 P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.039s user 0.003s sys 0.000s
I20250830 07:54:37.169175 13882 raft_consensus.cc:357] T c2f5f79547184009a0863b695a833694 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:54:37.170148 13882 raft_consensus.cc:383] T c2f5f79547184009a0863b695a833694 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:37.170293 13882 raft_consensus.cc:738] T c2f5f79547184009a0863b695a833694 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:54:37.170390 14038 raft_consensus.cc:491] T 7c8e248d938f4651ae13199122b08768 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:37.170557 13882 consensus_queue.cc:260] T c2f5f79547184009a0863b695a833694 P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:54:37.170565 14038 raft_consensus.cc:513] T 7c8e248d938f4651ae13199122b08768 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:54:37.171311 14038 leader_election.cc:290] T 7c8e248d938f4651ae13199122b08768 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:37.172149 13772 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "7c8e248d938f4651ae13199122b08768" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:37.172382 13772 raft_consensus.cc:2466] T 7c8e248d938f4651ae13199122b08768 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2065c332f15a4739899af79f3669c3ba in term 0.
I20250830 07:54:37.172843 13422 leader_election.cc:304] T 7c8e248d938f4651ae13199122b08768 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters:
I20250830 07:54:37.172888 13627 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "7c8e248d938f4651ae13199122b08768" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:37.173121 14038 raft_consensus.cc:2802] T 7c8e248d938f4651ae13199122b08768 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:54:37.173213 14038 raft_consensus.cc:491] T 7c8e248d938f4651ae13199122b08768 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:54:37.173339 14038 raft_consensus.cc:3058] T 7c8e248d938f4651ae13199122b08768 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
W20250830 07:54:37.173480 13423 leader_election.cc:343] T 7c8e248d938f4651ae13199122b08768 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:37.173714 13882 ts_tablet_manager.cc:1428] T c2f5f79547184009a0863b695a833694 P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.005s user 0.003s sys 0.001s
I20250830 07:54:37.173974 13882 tablet_bootstrap.cc:492] T 8ab12188dddc4de69ac73dffb01d51a9 P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:54:37.175503 13882 tablet_bootstrap.cc:654] T 8ab12188dddc4de69ac73dffb01d51a9 P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:37.175951 14038 raft_consensus.cc:513] T 7c8e248d938f4651ae13199122b08768 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:54:37.176573 14038 leader_election.cc:290] T 7c8e248d938f4651ae13199122b08768 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 election: Requested vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:37.177814 13772 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "7c8e248d938f4651ae13199122b08768" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f"
I20250830 07:54:37.178027 13772 raft_consensus.cc:3058] T 7c8e248d938f4651ae13199122b08768 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:37.179824 13627 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "7c8e248d938f4651ae13199122b08768" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9"
W20250830 07:54:37.180282 13423 leader_election.cc:343] T 7c8e248d938f4651ae13199122b08768 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:37.181510 13772 raft_consensus.cc:2466] T 7c8e248d938f4651ae13199122b08768 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2065c332f15a4739899af79f3669c3ba in term 1.
I20250830 07:54:37.181900 13422 leader_election.cc:304] T 7c8e248d938f4651ae13199122b08768 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:54:37.182216 14038 raft_consensus.cc:2802] T 7c8e248d938f4651ae13199122b08768 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election won for term 1
I20250830 07:54:37.182386 14038 raft_consensus.cc:695] T 7c8e248d938f4651ae13199122b08768 P 2065c332f15a4739899af79f3669c3ba [term 1 LEADER]: Becoming Leader. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Running, Role: LEADER
I20250830 07:54:37.182626 14038 consensus_queue.cc:237] T 7c8e248d938f4651ae13199122b08768 P 2065c332f15a4739899af79f3669c3ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
W20250830 07:54:37.188527 13225 catalog_manager.cc:5415] Ignoring report from unknown tablet ed87c6793dd149a6a363f1977d816628
I20250830 07:54:37.190811 13887 tablet_bootstrap.cc:492] T 48b422b125154fbdbb9c995dc372d128 P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:54:37.191030 13887 ts_tablet_manager.cc:1397] T 48b422b125154fbdbb9c995dc372d128 P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.044s user 0.023s sys 0.005s
I20250830 07:54:37.191802 13887 raft_consensus.cc:357] T 48b422b125154fbdbb9c995dc372d128 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:54:37.192716 13887 raft_consensus.cc:383] T 48b422b125154fbdbb9c995dc372d128 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:37.192929 13887 raft_consensus.cc:738] T 48b422b125154fbdbb9c995dc372d128 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:54:37.193331 13887 consensus_queue.cc:260] T 48b422b125154fbdbb9c995dc372d128 P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:54:37.194806 13225 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_e24800a610814eeabd6df4339f329787" } modify_external_catalogs: true
I20250830 07:54:37.195385 14287 consensus_queue.cc:1035] T 29d492735cd14bb6b4a2a9a3929f62f3 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:54:37.197580 13225 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_e24800a610814eeabd6df4339f329787" } modify_external_catalogs: true
I20250830 07:54:37.200968 13229 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet 2b4ce50fbd26484faba3faa2ec5115c0
I20250830 07:54:37.201557 13229 catalog_manager.cc:6652] ReplaceTablet: tablet 2b4ce50fbd26484faba3faa2ec5115c0 deleted and replaced by tablet ee44ab24333742909f773889ad5c3e00
I20250830 07:54:37.203836 13230 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_0ace36b202294925a0a5ba37727867c5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250830 07:54:37.204051 13232 catalog_manager.cc:5864] Not sending DeleteTablet requests; no consensus state for tablet 9e9616a813a0425a82363efab8c16240
W20250830 07:54:37.204447 13230 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0ace36b202294925a0a5ba37727867c5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250830 07:54:37.204663 13231 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 713c12e1efec4e6f9895c65dc8a9c4b9 has no consensus state
I20250830 07:54:37.205199 13749 tablet_service.cc:1515] Processing DeleteTablet for tablet 2b4ce50fbd26484faba3faa2ec5115c0 with delete_type TABLET_DATA_DELETED (replaced by tablet ee44ab24333742909f773889ad5c3e00) from {username='slave'} at 127.0.0.1:45460
W20250830 07:54:37.205880 13219 catalog_manager.cc:4908] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): delete failed for tablet 2b4ce50fbd26484faba3faa2ec5115c0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2b4ce50fbd26484faba3faa2ec5115c0 already in progress: creating tablet
I20250830 07:54:37.205937 13233 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet cf5613278b4c4f3bbe751b1ae6f3c313
I20250830 07:54:37.206881 13749 tablet_service.cc:1515] Processing DeleteTablet for tablet cf5613278b4c4f3bbe751b1ae6f3c313 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:37 UTC) from {username='slave'} at 127.0.0.1:45460
W20250830 07:54:37.207547 13219 catalog_manager.cc:4908] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): delete failed for tablet cf5613278b4c4f3bbe751b1ae6f3c313 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cf5613278b4c4f3bbe751b1ae6f3c313 already in progress: creating tablet
W20250830 07:54:37.208866 13227 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 6251a06d1efe44e38d35d962c468f8b2 has no consensus state
I20250830 07:54:37.209775 13598 tablet_service.cc:1515] Processing DeleteTablet for tablet 2b4ce50fbd26484faba3faa2ec5115c0 with delete_type TABLET_DATA_DELETED (replaced by tablet ee44ab24333742909f773889ad5c3e00) from {username='slave'} at 127.0.0.1:45306
I20250830 07:54:37.210021 13608 tablet_service.cc:1515] Processing DeleteTablet for tablet c2f5f79547184009a0863b695a833694 with delete_type TABLET_DATA_DELETED (replaced by tablet 852e353f6ee945628ddebdbdd1bd76fb) from {username='slave'} at 127.0.0.1:45306
W20250830 07:54:37.210152 13228 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 49165f0001044d72b68263a60ef56457 has no consensus state
I20250830 07:54:37.210242 13605 tablet_service.cc:1515] Processing DeleteTablet for tablet cf5613278b4c4f3bbe751b1ae6f3c313 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:37 UTC) from {username='slave'} at 127.0.0.1:45306
I20250830 07:54:37.210824 13885 tablet_replica.cc:331] T c2f5f79547184009a0863b695a833694 P 6b5e454d98894637b466ea27f1b647f9: stopping tablet replica
I20250830 07:54:37.211045 13885 raft_consensus.cc:2241] T c2f5f79547184009a0863b695a833694 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250830 07:54:37.211115 13882 tablet_bootstrap.cc:492] T 8ab12188dddc4de69ac73dffb01d51a9 P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:54:37.211238 13885 raft_consensus.cc:2270] T c2f5f79547184009a0863b695a833694 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250830 07:54:37.211295 13882 ts_tablet_manager.cc:1397] T 8ab12188dddc4de69ac73dffb01d51a9 P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.037s user 0.003s sys 0.000s
I20250830 07:54:37.211586 13887 ts_tablet_manager.cc:1428] T 48b422b125154fbdbb9c995dc372d128 P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.020s user 0.000s sys 0.001s
I20250830 07:54:37.211874 13887 tablet_bootstrap.cc:492] T d4e35395930f4c37b34649da5718aa1f P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:54:37.212098 13882 raft_consensus.cc:357] T 8ab12188dddc4de69ac73dffb01d51a9 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:54:37.212296 13882 raft_consensus.cc:383] T 8ab12188dddc4de69ac73dffb01d51a9 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:37.212364 13882 raft_consensus.cc:738] T 8ab12188dddc4de69ac73dffb01d51a9 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:54:37.212580 13882 consensus_queue.cc:260] T 8ab12188dddc4de69ac73dffb01d51a9 P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:54:37.213450 13886 tablet_bootstrap.cc:492] T 861809cc50764aa89140e587489e2d88 P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:54:37.213534 13887 tablet_bootstrap.cc:654] T d4e35395930f4c37b34649da5718aa1f P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:37.213591 13886 ts_tablet_manager.cc:1397] T 861809cc50764aa89140e587489e2d88 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.197s user 0.004s sys 0.003s
I20250830 07:54:37.214337 13885 ts_tablet_manager.cc:1905] T c2f5f79547184009a0863b695a833694 P 6b5e454d98894637b466ea27f1b647f9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250830 07:54:37.215163 13882 ts_tablet_manager.cc:1428] T 8ab12188dddc4de69ac73dffb01d51a9 P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20250830 07:54:37.215454 13882 tablet_bootstrap.cc:492] T 1476bb480bf747838613948875001c30 P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:54:37.216444 13886 raft_consensus.cc:357] T 861809cc50764aa89140e587489e2d88 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:54:37.216601 13886 raft_consensus.cc:383] T 861809cc50764aa89140e587489e2d88 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:37.216682 13886 raft_consensus.cc:738] T 861809cc50764aa89140e587489e2d88 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:54:37.217573 13882 tablet_bootstrap.cc:654] T 1476bb480bf747838613948875001c30 P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
W20250830 07:54:37.220528 13220 catalog_manager.cc:4908] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet 2b4ce50fbd26484faba3faa2ec5115c0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2b4ce50fbd26484faba3faa2ec5115c0 already in progress: creating tablet
I20250830 07:54:37.220927 13461 tablet_service.cc:1515] Processing DeleteTablet for tablet 2b4ce50fbd26484faba3faa2ec5115c0 with delete_type TABLET_DATA_DELETED (replaced by tablet ee44ab24333742909f773889ad5c3e00) from {username='slave'} at 127.0.0.1:37956
I20250830 07:54:37.221197 13468 tablet_service.cc:1515] Processing DeleteTablet for tablet cf5613278b4c4f3bbe751b1ae6f3c313 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:37 UTC) from {username='slave'} at 127.0.0.1:37956
W20250830 07:54:37.221956 13218 catalog_manager.cc:4908] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): delete failed for tablet 2b4ce50fbd26484faba3faa2ec5115c0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2b4ce50fbd26484faba3faa2ec5115c0 already in progress: creating tablet
W20250830 07:54:37.222201 13218 catalog_manager.cc:4908] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): delete failed for tablet cf5613278b4c4f3bbe751b1ae6f3c313 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cf5613278b4c4f3bbe751b1ae6f3c313 already in progress: creating tablet
I20250830 07:54:37.223232 13887 tablet_bootstrap.cc:492] T d4e35395930f4c37b34649da5718aa1f P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:54:37.223368 13887 ts_tablet_manager.cc:1397] T d4e35395930f4c37b34649da5718aa1f P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.012s user 0.001s sys 0.002s
I20250830 07:54:37.224051 13887 raft_consensus.cc:357] T d4e35395930f4c37b34649da5718aa1f P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:37.224766 13887 raft_consensus.cc:383] T d4e35395930f4c37b34649da5718aa1f P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:37.224860 13887 raft_consensus.cc:738] T d4e35395930f4c37b34649da5718aa1f P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:54:37.225077 13887 consensus_queue.cc:260] T d4e35395930f4c37b34649da5718aa1f P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:37.225900 13887 ts_tablet_manager.cc:1428] T d4e35395930f4c37b34649da5718aa1f P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
W20250830 07:54:37.226032 13228 catalog_manager.cc:5415] Ignoring report from unknown tablet 29d492735cd14bb6b4a2a9a3929f62f3
I20250830 07:54:37.226183 13887 tablet_bootstrap.cc:492] T bee1b5f6f04740dba64cdcb094e26113 P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:54:37.227521 14315 consensus_queue.cc:1035] T 29d492735cd14bb6b4a2a9a3929f62f3 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:54:37.227807 13887 tablet_bootstrap.cc:654] T bee1b5f6f04740dba64cdcb094e26113 P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:37.203858 13229 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_d64a5c5f7ba84d93ae31d439707f528d" } modify_external_catalogs: true
I20250830 07:54:37.229452 13229 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_d64a5c5f7ba84d93ae31d439707f528d" } modify_external_catalogs: true
I20250830 07:54:37.230755 13887 tablet_bootstrap.cc:492] T bee1b5f6f04740dba64cdcb094e26113 P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:54:37.230757 13882 tablet_bootstrap.cc:492] T 1476bb480bf747838613948875001c30 P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:54:37.230893 13882 ts_tablet_manager.cc:1397] T 1476bb480bf747838613948875001c30 P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.016s user 0.003s sys 0.000s
I20250830 07:54:37.230893 13887 ts_tablet_manager.cc:1397] T bee1b5f6f04740dba64cdcb094e26113 P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.003s
I20250830 07:54:37.230990 13227 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_33e47ed000c24372ac8f1b89c5fc38cb" } new_table_name: "default.Table_2e6009ad55fd42afb9f5d177f2b8c272" modify_external_catalogs: true
I20250830 07:54:37.231132 13605 tablet_service.cc:1515] Processing DeleteTablet for tablet 8ab12188dddc4de69ac73dffb01d51a9 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:36 UTC) from {username='slave'} at 127.0.0.1:45306
I20250830 07:54:37.231695 13887 raft_consensus.cc:357] T bee1b5f6f04740dba64cdcb094e26113 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:54:37.231695 13882 raft_consensus.cc:357] T 1476bb480bf747838613948875001c30 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:54:37.231863 13882 raft_consensus.cc:383] T 1476bb480bf747838613948875001c30 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:37.231861 13887 raft_consensus.cc:383] T bee1b5f6f04740dba64cdcb094e26113 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:37.231950 13887 raft_consensus.cc:738] T bee1b5f6f04740dba64cdcb094e26113 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:54:37.231948 13882 raft_consensus.cc:738] T 1476bb480bf747838613948875001c30 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:54:37.232282 13887 consensus_queue.cc:260] T bee1b5f6f04740dba64cdcb094e26113 P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:54:37.232538 13233 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_e3a02594cc004665a46fa35a486ad4fc" } modify_external_catalogs: true
I20250830 07:54:37.232728 13233 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_e3a02594cc004665a46fa35a486ad4fc" } modify_external_catalogs: true
I20250830 07:54:37.232992 13887 ts_tablet_manager.cc:1428] T bee1b5f6f04740dba64cdcb094e26113 P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20250830 07:54:37.233258 13887 tablet_bootstrap.cc:492] T cada6410e2884c508bb7dd38bea438ae P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:54:37.234602 13882 consensus_queue.cc:260] T 1476bb480bf747838613948875001c30 P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:54:37.235517 13882 ts_tablet_manager.cc:1428] T 1476bb480bf747838613948875001c30 P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.004s user 0.001s sys 0.000s
I20250830 07:54:37.235791 13882 tablet_bootstrap.cc:492] T 7c8e248d938f4651ae13199122b08768 P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:54:37.236052 13887 tablet_bootstrap.cc:654] T cada6410e2884c508bb7dd38bea438ae P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:37.237608 13882 tablet_bootstrap.cc:654] T 7c8e248d938f4651ae13199122b08768 P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:37.242208 13536 heartbeater.cc:344] Connected to a master server at 127.12.209.60:43889
I20250830 07:54:37.242583 13886 consensus_queue.cc:260] T 861809cc50764aa89140e587489e2d88 P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:54:37.248378 13887 tablet_bootstrap.cc:492] T cada6410e2884c508bb7dd38bea438ae P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:54:37.248591 13887 ts_tablet_manager.cc:1397] T cada6410e2884c508bb7dd38bea438ae P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.015s user 0.001s sys 0.008s
I20250830 07:54:37.249509 13887 raft_consensus.cc:357] T cada6410e2884c508bb7dd38bea438ae P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:37.249692 13887 raft_consensus.cc:383] T cada6410e2884c508bb7dd38bea438ae P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:37.249758 13887 raft_consensus.cc:738] T cada6410e2884c508bb7dd38bea438ae P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:54:37.250010 13887 consensus_queue.cc:260] T cada6410e2884c508bb7dd38bea438ae P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:37.258845 13226 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_caaf22211b564ae8a28d2c4987248a7b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250830 07:54:37.259002 13887 ts_tablet_manager.cc:1428] T cada6410e2884c508bb7dd38bea438ae P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.010s user 0.001s sys 0.001s
I20250830 07:54:37.259389 13887 tablet_bootstrap.cc:492] T 91ab8c468c8143b9ae11b839a95a26fd P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
W20250830 07:54:37.259426 13228 catalog_manager.cc:5415] Ignoring report from unknown tablet 861809cc50764aa89140e587489e2d88
W20250830 07:54:37.259536 13226 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_caaf22211b564ae8a28d2c4987248a7b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:37.259737 14256 raft_consensus.cc:491] T ed87c6793dd149a6a363f1977d816628 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:37.259893 14256 raft_consensus.cc:513] T ed87c6793dd149a6a363f1977d816628 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:54:37.260593 14256 leader_election.cc:290] T ed87c6793dd149a6a363f1977d816628 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
I20250830 07:54:37.260785 13232 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_78055261418242849901a0fd7e88083e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250830 07:54:37.261240 13487 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "ed87c6793dd149a6a363f1977d816628" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
W20250830 07:54:37.261325 13232 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_78055261418242849901a0fd7e88083e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:37.261488 13487 raft_consensus.cc:2391] T ed87c6793dd149a6a363f1977d816628 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b5e454d98894637b466ea27f1b647f9 in current term 1: Already voted for candidate 9b057ade5dce45af9f8bf0bedf8b917f in this term.
I20250830 07:54:37.261994 13887 tablet_bootstrap.cc:654] T 91ab8c468c8143b9ae11b839a95a26fd P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:37.262418 13231 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_8fee89ccc11041be9f0ff95c5aa089c4" } new_table_name: "default.Table_062f0e529a09425da9da5b7ab68a6e38" modify_external_catalogs: true
I20250830 07:54:37.262687 13772 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "ed87c6793dd149a6a363f1977d816628" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:37.263217 13562 leader_election.cc:304] T ed87c6793dd149a6a363f1977d816628 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b5e454d98894637b466ea27f1b647f9; no voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:54:37.263615 14256 raft_consensus.cc:3058] T ed87c6793dd149a6a363f1977d816628 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:37.266250 14256 raft_consensus.cc:2747] T ed87c6793dd149a6a363f1977d816628 P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:54:37.267174 13625 raft_consensus.cc:3058] T e134ab64aa1b4ce89e295b43cbc3fffb P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:37.285773 13886 ts_tablet_manager.cc:1428] T 861809cc50764aa89140e587489e2d88 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.072s user 0.001s sys 0.001s
I20250830 07:54:37.287930 13882 tablet_bootstrap.cc:492] T 7c8e248d938f4651ae13199122b08768 P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:54:37.288153 13882 ts_tablet_manager.cc:1397] T 7c8e248d938f4651ae13199122b08768 P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.052s user 0.005s sys 0.000s
I20250830 07:54:37.288371 13885 ts_tablet_manager.cc:1918] T c2f5f79547184009a0863b695a833694 P 6b5e454d98894637b466ea27f1b647f9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250830 07:54:37.288492 13885 log.cc:1199] T c2f5f79547184009a0863b695a833694 P 6b5e454d98894637b466ea27f1b647f9: Deleting WAL directory at /tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/ts-1/wal/wals/c2f5f79547184009a0863b695a833694
I20250830 07:54:37.288956 13882 raft_consensus.cc:357] T 7c8e248d938f4651ae13199122b08768 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:54:37.289173 13882 raft_consensus.cc:383] T 7c8e248d938f4651ae13199122b08768 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:37.289237 13882 raft_consensus.cc:738] T 7c8e248d938f4651ae13199122b08768 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:54:37.290002 13674 heartbeater.cc:344] Connected to a master server at 127.12.209.60:43889
I20250830 07:54:37.291247 13885 ts_tablet_manager.cc:1939] T c2f5f79547184009a0863b695a833694 P 6b5e454d98894637b466ea27f1b647f9: Deleting consensus metadata
I20250830 07:54:37.291965 13885 tablet_replica.cc:331] T 8ab12188dddc4de69ac73dffb01d51a9 P 6b5e454d98894637b466ea27f1b647f9: stopping tablet replica
I20250830 07:54:37.292169 13885 raft_consensus.cc:2241] T 8ab12188dddc4de69ac73dffb01d51a9 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250830 07:54:37.292352 13885 raft_consensus.cc:2270] T 8ab12188dddc4de69ac73dffb01d51a9 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250830 07:54:37.295840 13885 ts_tablet_manager.cc:1905] T 8ab12188dddc4de69ac73dffb01d51a9 P 6b5e454d98894637b466ea27f1b647f9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250830 07:54:37.296000 13220 catalog_manager.cc:4928] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): tablet c2f5f79547184009a0863b695a833694 (table default.Table_4abf499bcf8a4fd88fd739d3a1daee3a [id=768d7e569197455bb092328ca1b32ed0]) successfully deleted
W20250830 07:54:37.296411 13220 catalog_manager.cc:4908] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet cf5613278b4c4f3bbe751b1ae6f3c313 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cf5613278b4c4f3bbe751b1ae6f3c313 already in progress: creating tablet
I20250830 07:54:37.298178 13228 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_87164c8c18154ed0853e069939e9025c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:37.298894 13228 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_87164c8c18154ed0853e069939e9025c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:37.302736 13885 ts_tablet_manager.cc:1918] T 8ab12188dddc4de69ac73dffb01d51a9 P 6b5e454d98894637b466ea27f1b647f9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250830 07:54:37.303639 13229 catalog_manager.cc:5864] Not sending DeleteTablet requests; no consensus state for tablet b5179914758249b984bc04274981b895
I20250830 07:54:37.304490 13225 catalog_manager.cc:5864] Not sending DeleteTablet requests; no consensus state for tablet 4f6709430a3b4b39a9d53aa391d3c292
I20250830 07:54:37.304133 13229 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_9eaf5529c5124d089dcdaaf915f587c0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250830 07:54:37.304841 13225 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_d68a03611fb04e57a0bfba61c0921f5b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250830 07:54:37.304462 13233 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet f846a23f0be046028cc2472de88b71c4
W20250830 07:54:37.305305 13225 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d68a03611fb04e57a0bfba61c0921f5b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250830 07:54:37.305954 13229 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9eaf5529c5124d089dcdaaf915f587c0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:37.306535 13468 tablet_service.cc:1515] Processing DeleteTablet for tablet f846a23f0be046028cc2472de88b71c4 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:37 UTC) from {username='slave'} at 127.0.0.1:37956
I20250830 07:54:37.306813 13883 tablet_replica.cc:331] T f846a23f0be046028cc2472de88b71c4 P 2065c332f15a4739899af79f3669c3ba: stopping tablet replica
I20250830 07:54:37.307075 13883 raft_consensus.cc:2241] T f846a23f0be046028cc2472de88b71c4 P 2065c332f15a4739899af79f3669c3ba [term 1 LEADER]: Raft consensus shutting down.
W20250830 07:54:37.307207 13227 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet acca1a8240454b889c63c82d3c75087e consensus state has no leader
I20250830 07:54:37.307435 13883 raft_consensus.cc:2270] T f846a23f0be046028cc2472de88b71c4 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20250830 07:54:37.308045 13883 ts_tablet_manager.cc:1905] T f846a23f0be046028cc2472de88b71c4 P 2065c332f15a4739899af79f3669c3ba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250830 07:54:37.316804 13883 ts_tablet_manager.cc:1918] T f846a23f0be046028cc2472de88b71c4 P 2065c332f15a4739899af79f3669c3ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250830 07:54:37.317078 13883 log.cc:1199] T f846a23f0be046028cc2472de88b71c4 P 2065c332f15a4739899af79f3669c3ba: Deleting WAL directory at /tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/ts-0/wal/wals/f846a23f0be046028cc2472de88b71c4
I20250830 07:54:37.317584 13883 ts_tablet_manager.cc:1939] T f846a23f0be046028cc2472de88b71c4 P 2065c332f15a4739899af79f3669c3ba: Deleting consensus metadata
W20250830 07:54:37.319716 13227 catalog_manager.cc:5415] Ignoring report from unknown tablet 861809cc50764aa89140e587489e2d88
I20250830 07:54:37.319991 13886 tablet_bootstrap.cc:492] T 008827b3d09d464b9182fb42dc2170d5 P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:54:37.321034 13218 catalog_manager.cc:4928] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): tablet f846a23f0be046028cc2472de88b71c4 (table default.Table_e3a02594cc004665a46fa35a486ad4fc [id=66b40d7668914309b6bd8eaf8994d9ac]) successfully deleted
I20250830 07:54:37.329252 14287 raft_consensus.cc:491] T 9696d8531a174585b8fd83a2391c02f7 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:37.329413 14287 raft_consensus.cc:513] T 9696d8531a174585b8fd83a2391c02f7 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:54:37.330044 14287 leader_election.cc:290] T 9696d8531a174585b8fd83a2391c02f7 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
I20250830 07:54:37.330777 13486 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "9696d8531a174585b8fd83a2391c02f7" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:54:37.331046 13486 raft_consensus.cc:2466] T 9696d8531a174585b8fd83a2391c02f7 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 0.
I20250830 07:54:37.331554 13701 leader_election.cc:304] T 9696d8531a174585b8fd83a2391c02f7 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters:
I20250830 07:54:37.331838 14315 raft_consensus.cc:2802] T 9696d8531a174585b8fd83a2391c02f7 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:54:37.331918 14315 raft_consensus.cc:491] T 9696d8531a174585b8fd83a2391c02f7 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:54:37.332002 14315 raft_consensus.cc:3058] T 9696d8531a174585b8fd83a2391c02f7 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:37.334445 14315 raft_consensus.cc:513] T 9696d8531a174585b8fd83a2391c02f7 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
W20250830 07:54:37.334599 13231 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 74ea2298876a4066b297915c135d4618 has no consensus state
I20250830 07:54:37.336159 14315 leader_election.cc:290] T 9696d8531a174585b8fd83a2391c02f7 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Requested vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
I20250830 07:54:37.336987 13486 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "9696d8531a174585b8fd83a2391c02f7" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba"
I20250830 07:54:37.337241 13486 raft_consensus.cc:3058] T 9696d8531a174585b8fd83a2391c02f7 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:37.339875 13749 tablet_service.cc:1515] Processing DeleteTablet for tablet f846a23f0be046028cc2472de88b71c4 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:37 UTC) from {username='slave'} at 127.0.0.1:45460
I20250830 07:54:37.340123 13884 tablet_replica.cc:331] T f846a23f0be046028cc2472de88b71c4 P 9b057ade5dce45af9f8bf0bedf8b917f: stopping tablet replica
I20250830 07:54:37.340356 13884 raft_consensus.cc:2241] T f846a23f0be046028cc2472de88b71c4 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Raft consensus shutting down.
I20250830 07:54:37.340544 13884 raft_consensus.cc:2270] T f846a23f0be046028cc2472de88b71c4 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Raft consensus is shut down!
I20250830 07:54:37.341096 13884 ts_tablet_manager.cc:1905] T f846a23f0be046028cc2472de88b71c4 P 9b057ade5dce45af9f8bf0bedf8b917f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250830 07:54:37.341234 13486 raft_consensus.cc:2466] T 9696d8531a174585b8fd83a2391c02f7 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 1.
I20250830 07:54:37.341629 13701 leader_election.cc:304] T 9696d8531a174585b8fd83a2391c02f7 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters:
I20250830 07:54:37.342068 14315 raft_consensus.cc:2802] T 9696d8531a174585b8fd83a2391c02f7 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election won for term 1
I20250830 07:54:37.342311 14315 raft_consensus.cc:695] T 9696d8531a174585b8fd83a2391c02f7 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 LEADER]: Becoming Leader. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Running, Role: LEADER
I20250830 07:54:37.342578 14315 consensus_queue.cc:237] T 9696d8531a174585b8fd83a2391c02f7 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:54:37.347642 13884 ts_tablet_manager.cc:1918] T f846a23f0be046028cc2472de88b71c4 P 9b057ade5dce45af9f8bf0bedf8b917f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250830 07:54:37.347828 13884 log.cc:1199] T f846a23f0be046028cc2472de88b71c4 P 9b057ade5dce45af9f8bf0bedf8b917f: Deleting WAL directory at /tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/ts-2/wal/wals/f846a23f0be046028cc2472de88b71c4
I20250830 07:54:37.348320 13884 ts_tablet_manager.cc:1939] T f846a23f0be046028cc2472de88b71c4 P 9b057ade5dce45af9f8bf0bedf8b917f: Deleting consensus metadata
I20250830 07:54:37.349872 13219 catalog_manager.cc:4928] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): tablet f846a23f0be046028cc2472de88b71c4 (table default.Table_e3a02594cc004665a46fa35a486ad4fc [id=66b40d7668914309b6bd8eaf8994d9ac]) successfully deleted
I20250830 07:54:37.352782 13887 tablet_bootstrap.cc:492] T 91ab8c468c8143b9ae11b839a95a26fd P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:54:37.353039 13887 ts_tablet_manager.cc:1397] T 91ab8c468c8143b9ae11b839a95a26fd P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.094s user 0.030s sys 0.042s
I20250830 07:54:37.353859 13887 raft_consensus.cc:357] T 91ab8c468c8143b9ae11b839a95a26fd P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:37.354214 13885 log.cc:1199] T 8ab12188dddc4de69ac73dffb01d51a9 P 6b5e454d98894637b466ea27f1b647f9: Deleting WAL directory at /tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/ts-1/wal/wals/8ab12188dddc4de69ac73dffb01d51a9
I20250830 07:54:37.312436 13605 tablet_service.cc:1515] Processing DeleteTablet for tablet f846a23f0be046028cc2472de88b71c4 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:37 UTC) from {username='slave'} at 127.0.0.1:45306
I20250830 07:54:37.331180 13628 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "9696d8531a174585b8fd83a2391c02f7" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:37.354770 13885 ts_tablet_manager.cc:1939] T 8ab12188dddc4de69ac73dffb01d51a9 P 6b5e454d98894637b466ea27f1b647f9: Deleting consensus metadata
I20250830 07:54:37.338675 13629 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "9696d8531a174585b8fd83a2391c02f7" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9"
I20250830 07:54:37.303385 13882 consensus_queue.cc:260] T 7c8e248d938f4651ae13199122b08768 P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:54:37.355295 13220 catalog_manager.cc:4928] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): tablet 8ab12188dddc4de69ac73dffb01d51a9 (table default.Table_941683cb836e4df7a4f2cf11c6b54f0e [id=388ffc0a7b884c26811aab0ec8eccf71]) successfully deleted
I20250830 07:54:37.355474 13882 ts_tablet_manager.cc:1428] T 7c8e248d938f4651ae13199122b08768 P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.067s user 0.002s sys 0.000s
I20250830 07:54:37.355556 13887 raft_consensus.cc:383] T 91ab8c468c8143b9ae11b839a95a26fd P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:37.355777 13882 tablet_bootstrap.cc:492] T 9b9c2ae8805a48f7959d6745677a96f2 P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:54:37.355865 13885 tablet_replica.cc:331] T f846a23f0be046028cc2472de88b71c4 P 6b5e454d98894637b466ea27f1b647f9: stopping tablet replica
W20250830 07:54:37.355942 13703 leader_election.cc:343] T 9696d8531a174585b8fd83a2391c02f7 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:37.356057 13885 raft_consensus.cc:2241] T f846a23f0be046028cc2472de88b71c4 P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250830 07:54:37.356283 13885 raft_consensus.cc:2270] T f846a23f0be046028cc2472de88b71c4 P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Raft consensus is shut down!
W20250830 07:54:37.356412 13703 leader_election.cc:343] T 9696d8531a174585b8fd83a2391c02f7 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:37.356704 13887 raft_consensus.cc:738] T 91ab8c468c8143b9ae11b839a95a26fd P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:54:37.356961 13887 consensus_queue.cc:260] T 91ab8c468c8143b9ae11b839a95a26fd P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:37.358320 14256 raft_consensus.cc:491] T 7c8e248d938f4651ae13199122b08768 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:37.358479 14256 raft_consensus.cc:513] T 7c8e248d938f4651ae13199122b08768 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:54:37.358783 13887 ts_tablet_manager.cc:1428] T 91ab8c468c8143b9ae11b839a95a26fd P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.006s user 0.001s sys 0.001s
I20250830 07:54:37.359077 13225 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_4afcfcaafd5f41b1b0b66e198877db37"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250830 07:54:37.359344 14256 leader_election.cc:290] T 7c8e248d938f4651ae13199122b08768 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
I20250830 07:54:37.359586 13887 tablet_bootstrap.cc:492] T b480f5eb03804baeb61cd0424d70faf5 P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
W20250830 07:54:37.359664 13225 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4afcfcaafd5f41b1b0b66e198877db37 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:37.361394 13887 tablet_bootstrap.cc:654] T b480f5eb03804baeb61cd0424d70faf5 P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
W20250830 07:54:37.361490 13228 catalog_manager.cc:5415] Ignoring report from unknown tablet 29d492735cd14bb6b4a2a9a3929f62f3
I20250830 07:54:37.362226 13885 ts_tablet_manager.cc:1905] T f846a23f0be046028cc2472de88b71c4 P 6b5e454d98894637b466ea27f1b647f9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250830 07:54:37.365754 13486 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "7c8e248d938f4651ae13199122b08768" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:54:37.371899 13885 ts_tablet_manager.cc:1918] T f846a23f0be046028cc2472de88b71c4 P 6b5e454d98894637b466ea27f1b647f9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250830 07:54:37.372062 13885 log.cc:1199] T f846a23f0be046028cc2472de88b71c4 P 6b5e454d98894637b466ea27f1b647f9: Deleting WAL directory at /tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/ts-1/wal/wals/f846a23f0be046028cc2472de88b71c4
I20250830 07:54:37.372402 14256 raft_consensus.cc:491] T 6f2d855ab3c04123b2f9ea22cda6ef04 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:37.372541 14256 raft_consensus.cc:513] T 6f2d855ab3c04123b2f9ea22cda6ef04 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:54:37.373123 14256 leader_election.cc:290] T 6f2d855ab3c04123b2f9ea22cda6ef04 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
I20250830 07:54:37.373682 13486 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "6f2d855ab3c04123b2f9ea22cda6ef04" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:54:37.373893 13486 raft_consensus.cc:2391] T 6f2d855ab3c04123b2f9ea22cda6ef04 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b5e454d98894637b466ea27f1b647f9 in current term 1: Already voted for candidate 9b057ade5dce45af9f8bf0bedf8b917f in this term.
I20250830 07:54:37.375041 13885 ts_tablet_manager.cc:1939] T f846a23f0be046028cc2472de88b71c4 P 6b5e454d98894637b466ea27f1b647f9: Deleting consensus metadata
I20250830 07:54:37.375197 13882 tablet_bootstrap.cc:654] T 9b9c2ae8805a48f7959d6745677a96f2 P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:37.375644 13220 catalog_manager.cc:4928] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): tablet f846a23f0be046028cc2472de88b71c4 (table default.Table_e3a02594cc004665a46fa35a486ad4fc [id=66b40d7668914309b6bd8eaf8994d9ac]) successfully deleted
I20250830 07:54:37.376649 13772 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "7c8e248d938f4651ae13199122b08768" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:37.376937 13772 raft_consensus.cc:2391] T 7c8e248d938f4651ae13199122b08768 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b5e454d98894637b466ea27f1b647f9 in current term 1: Already voted for candidate 2065c332f15a4739899af79f3669c3ba in this term.
I20250830 07:54:37.377640 13772 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "6f2d855ab3c04123b2f9ea22cda6ef04" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:37.380412 13562 leader_election.cc:304] T 7c8e248d938f4651ae13199122b08768 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b5e454d98894637b466ea27f1b647f9; no voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:54:37.380759 14256 raft_consensus.cc:3058] T 7c8e248d938f4651ae13199122b08768 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:37.381456 13887 tablet_bootstrap.cc:492] T b480f5eb03804baeb61cd0424d70faf5 P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:54:37.381613 13887 ts_tablet_manager.cc:1397] T b480f5eb03804baeb61cd0424d70faf5 P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.022s user 0.002s sys 0.007s
I20250830 07:54:37.382365 13887 raft_consensus.cc:357] T b480f5eb03804baeb61cd0424d70faf5 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:54:37.382555 13887 raft_consensus.cc:383] T b480f5eb03804baeb61cd0424d70faf5 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:37.382616 13887 raft_consensus.cc:738] T b480f5eb03804baeb61cd0424d70faf5 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:54:37.382828 13887 consensus_queue.cc:260] T b480f5eb03804baeb61cd0424d70faf5 P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:54:37.383379 13887 ts_tablet_manager.cc:1428] T b480f5eb03804baeb61cd0424d70faf5 P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20250830 07:54:37.383401 14256 raft_consensus.cc:2747] T 7c8e248d938f4651ae13199122b08768 P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:54:37.383936 13562 leader_election.cc:304] T 6f2d855ab3c04123b2f9ea22cda6ef04 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b5e454d98894637b466ea27f1b647f9; no voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:54:37.384598 13899 raft_consensus.cc:3058] T 6f2d855ab3c04123b2f9ea22cda6ef04 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:37.385793 13882 tablet_bootstrap.cc:492] T 9b9c2ae8805a48f7959d6745677a96f2 P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:54:37.385944 13882 ts_tablet_manager.cc:1397] T 9b9c2ae8805a48f7959d6745677a96f2 P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.030s user 0.001s sys 0.002s
I20250830 07:54:37.387480 13882 raft_consensus.cc:357] T 9b9c2ae8805a48f7959d6745677a96f2 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:54:37.387637 13882 raft_consensus.cc:383] T 9b9c2ae8805a48f7959d6745677a96f2 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:37.387729 13882 raft_consensus.cc:738] T 9b9c2ae8805a48f7959d6745677a96f2 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:54:37.389032 13887 tablet_bootstrap.cc:492] T 2009012fddc24e4fb7ad0fab33a1103b P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:54:37.390832 13887 tablet_bootstrap.cc:654] T 2009012fddc24e4fb7ad0fab33a1103b P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:37.393716 13899 raft_consensus.cc:2747] T 6f2d855ab3c04123b2f9ea22cda6ef04 P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:54:37.404438 13882 consensus_queue.cc:260] T 9b9c2ae8805a48f7959d6745677a96f2 P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:54:37.406661 13229 master_service.cc:948] ReplaceTablet: received request to replace tablet b38c8d003413428dae9e47f58e197c2c from {username='slave'} at 127.0.0.1:42126
I20250830 07:54:37.409404 13882 ts_tablet_manager.cc:1428] T 9b9c2ae8805a48f7959d6745677a96f2 P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.023s user 0.002s sys 0.000s
I20250830 07:54:37.411064 13882 tablet_bootstrap.cc:492] T 5dac49aebcfa476d81547636cd4c6986 P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:54:37.412721 13882 tablet_bootstrap.cc:654] T 5dac49aebcfa476d81547636cd4c6986 P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:37.420049 13887 tablet_bootstrap.cc:492] T 2009012fddc24e4fb7ad0fab33a1103b P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:54:37.420629 13887 ts_tablet_manager.cc:1397] T 2009012fddc24e4fb7ad0fab33a1103b P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.032s user 0.004s sys 0.000s
I20250830 07:54:37.421816 13887 raft_consensus.cc:357] T 2009012fddc24e4fb7ad0fab33a1103b P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:54:37.422003 13887 raft_consensus.cc:383] T 2009012fddc24e4fb7ad0fab33a1103b P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:37.422094 13887 raft_consensus.cc:738] T 2009012fddc24e4fb7ad0fab33a1103b P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:54:37.422370 13887 consensus_queue.cc:260] T 2009012fddc24e4fb7ad0fab33a1103b P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:54:37.428196 14382 raft_consensus.cc:491] T a04bf79de30a42a98e71f622efc90c22 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:37.428229 13887 ts_tablet_manager.cc:1428] T 2009012fddc24e4fb7ad0fab33a1103b P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.007s user 0.002s sys 0.000s
I20250830 07:54:37.433018 13887 tablet_bootstrap.cc:492] T 6492bd11e50d4900927db0de3757aa24 P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:54:37.433254 14382 raft_consensus.cc:513] T a04bf79de30a42a98e71f622efc90c22 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:37.435043 13887 tablet_bootstrap.cc:654] T 6492bd11e50d4900927db0de3757aa24 P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:37.436410 13882 tablet_bootstrap.cc:492] T 5dac49aebcfa476d81547636cd4c6986 P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:54:37.436868 14382 leader_election.cc:290] T a04bf79de30a42a98e71f622efc90c22 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
I20250830 07:54:37.437849 13882 ts_tablet_manager.cc:1397] T 5dac49aebcfa476d81547636cd4c6986 P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.027s user 0.003s sys 0.000s
W20250830 07:54:37.438107 13701 leader_election.cc:343] T a04bf79de30a42a98e71f622efc90c22 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): Not found: Tablet not found: a04bf79de30a42a98e71f622efc90c22
W20250830 07:54:37.439910 13226 catalog_manager.cc:5415] Ignoring report from unknown tablet e134ab64aa1b4ce89e295b43cbc3fffb
W20250830 07:54:37.440040 13226 catalog_manager.cc:5415] Ignoring report from unknown tablet ff2267fb411942ff826e2a72bcb89cd7
W20250830 07:54:37.440109 13226 catalog_manager.cc:5415] Ignoring report from unknown tablet 1476bb480bf747838613948875001c30
W20250830 07:54:37.440186 13226 catalog_manager.cc:5415] Ignoring report from unknown tablet 29d492735cd14bb6b4a2a9a3929f62f3
I20250830 07:54:37.440904 13232 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_a4097958af86408498f5bc26a4fc0871"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250830 07:54:37.441195 13226 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_366afa859163468bad426ce2e1e8f209" } new_table_name: "default.Table_1f9c1593bbe849a691399e175b9555b7" modify_external_catalogs: true
W20250830 07:54:37.441506 13232 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a4097958af86408498f5bc26a4fc0871 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:37.442540 13227 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_d9853559e8474b00b8c7d7b1a4d0c3ac" } new_table_name: "default.Table_718987422ffe497c86a1b4e53c47d620" modify_external_catalogs: true
I20250830 07:54:37.438789 13882 raft_consensus.cc:357] T 5dac49aebcfa476d81547636cd4c6986 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:54:37.443151 13882 raft_consensus.cc:383] T 5dac49aebcfa476d81547636cd4c6986 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:37.443224 13882 raft_consensus.cc:738] T 5dac49aebcfa476d81547636cd4c6986 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:54:37.443233 13230 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_4285c0443c5848eeb9cddb335be79aab" } modify_external_catalogs: true
I20250830 07:54:37.443403 13230 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_4285c0443c5848eeb9cddb335be79aab" } modify_external_catalogs: true
I20250830 07:54:37.443426 13882 consensus_queue.cc:260] T 5dac49aebcfa476d81547636cd4c6986 P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:54:37.444099 13231 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_fa378b7e7c574b23b77d462d15d5313e" } modify_external_catalogs: true
I20250830 07:54:37.444239 13231 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_fa378b7e7c574b23b77d462d15d5313e" } modify_external_catalogs: true
I20250830 07:54:37.444767 13233 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_8fc143e40fc14b37bac695b6f7604eed"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:37.445289 13233 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8fc143e40fc14b37bac695b6f7604eed in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:37.446394 13882 ts_tablet_manager.cc:1428] T 5dac49aebcfa476d81547636cd4c6986 P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.008s user 0.001s sys 0.000s
I20250830 07:54:37.446669 13882 tablet_bootstrap.cc:492] T 861809cc50764aa89140e587489e2d88 P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:54:37.446949 13229 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_ba9345bf0ef34b1d91aae9fb48945102" } new_table_name: "default.Table_98c8314f6ad34324b9f857226d762d7d" modify_external_catalogs: true
I20250830 07:54:37.451718 13882 tablet_bootstrap.cc:654] T 861809cc50764aa89140e587489e2d88 P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:37.451745 13225 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_dfe2a98f84744faeb4200202374bb186"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:37.452303 13225 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_dfe2a98f84744faeb4200202374bb186 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:37.462795 13674 heartbeater.cc:344] Connected to a master server at 127.12.209.60:43889
I20250830 07:54:37.475579 13887 tablet_bootstrap.cc:492] T 6492bd11e50d4900927db0de3757aa24 P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:54:37.475795 13887 ts_tablet_manager.cc:1397] T 6492bd11e50d4900927db0de3757aa24 P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.043s user 0.013s sys 0.014s
I20250830 07:54:37.476297 13228 master_service.cc:948] ReplaceTablet: received request to replace tablet f53e7423d1f54566a667195f7cf5e1ce from {username='slave'} at 127.0.0.1:42126
I20250830 07:54:37.480885 13887 raft_consensus.cc:357] T 6492bd11e50d4900927db0de3757aa24 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:37.481148 13887 raft_consensus.cc:383] T 6492bd11e50d4900927db0de3757aa24 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:37.481249 13887 raft_consensus.cc:738] T 6492bd11e50d4900927db0de3757aa24 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:54:37.481526 13887 consensus_queue.cc:260] T 6492bd11e50d4900927db0de3757aa24 P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:37.486374 13887 ts_tablet_manager.cc:1428] T 6492bd11e50d4900927db0de3757aa24 P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.010s user 0.000s sys 0.003s
I20250830 07:54:37.486901 13882 tablet_bootstrap.cc:492] T 861809cc50764aa89140e587489e2d88 P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:54:37.487075 13882 ts_tablet_manager.cc:1397] T 861809cc50764aa89140e587489e2d88 P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.040s user 0.006s sys 0.000s
I20250830 07:54:37.492295 13887 tablet_bootstrap.cc:492] T afb132e8a5b14a029e005e375f276348 P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:54:37.492964 13882 raft_consensus.cc:357] T 861809cc50764aa89140e587489e2d88 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:54:37.493177 13882 raft_consensus.cc:383] T 861809cc50764aa89140e587489e2d88 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:37.493327 13882 raft_consensus.cc:738] T 861809cc50764aa89140e587489e2d88 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:54:37.493669 13882 consensus_queue.cc:260] T 861809cc50764aa89140e587489e2d88 P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:54:37.494028 13887 tablet_bootstrap.cc:654] T afb132e8a5b14a029e005e375f276348 P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:37.494241 13882 ts_tablet_manager.cc:1428] T 861809cc50764aa89140e587489e2d88 P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.007s user 0.001s sys 0.000s
I20250830 07:54:37.497448 13882 tablet_bootstrap.cc:492] T 9696d8531a174585b8fd83a2391c02f7 P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:54:37.499245 13882 tablet_bootstrap.cc:654] T 9696d8531a174585b8fd83a2391c02f7 P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
W20250830 07:54:37.501948 13232 catalog_manager.cc:5415] Ignoring report from unknown tablet 9b9c2ae8805a48f7959d6745677a96f2
W20250830 07:54:37.502030 13232 catalog_manager.cc:5415] Ignoring report from unknown tablet e134ab64aa1b4ce89e295b43cbc3fffb
W20250830 07:54:37.503248 13227 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a7dc529c40544bafbc9e7f0ab34086bd has no consensus state
W20250830 07:54:37.503222 13703 leader_election.cc:343] T a04bf79de30a42a98e71f622efc90c22 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Not found: Tablet not found: a04bf79de30a42a98e71f622efc90c22
I20250830 07:54:37.503371 13703 leader_election.cc:304] T a04bf79de30a42a98e71f622efc90c22 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 2065c332f15a4739899af79f3669c3ba, 6b5e454d98894637b466ea27f1b647f9
I20250830 07:54:37.503561 13227 master_service.cc:948] ReplaceTablet: received request to replace tablet 2b4ce50fbd26484faba3faa2ec5115c0 from {username='slave'} at 127.0.0.1:42126
I20250830 07:54:37.504112 14287 raft_consensus.cc:491] T 9b9c2ae8805a48f7959d6745677a96f2 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:37.504114 13227 master_service.cc:948] ReplaceTablet: received request to replace tablet c0147310dad84226808332a4c2c6e09d from {username='slave'} at 127.0.0.1:42126
I20250830 07:54:37.504236 14287 raft_consensus.cc:513] T 9b9c2ae8805a48f7959d6745677a96f2 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:54:37.504799 14287 leader_election.cc:290] T 9b9c2ae8805a48f7959d6745677a96f2 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
I20250830 07:54:37.504925 14287 raft_consensus.cc:2747] T a04bf79de30a42a98e71f622efc90c22 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20250830 07:54:37.505218 13887 tablet_bootstrap.cc:492] T afb132e8a5b14a029e005e375f276348 P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:54:37.505406 13887 ts_tablet_manager.cc:1397] T afb132e8a5b14a029e005e375f276348 P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.013s user 0.000s sys 0.005s
I20250830 07:54:37.506237 13887 raft_consensus.cc:357] T afb132e8a5b14a029e005e375f276348 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:37.506323 13487 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "9b9c2ae8805a48f7959d6745677a96f2" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:54:37.506458 13887 raft_consensus.cc:383] T afb132e8a5b14a029e005e375f276348 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:37.506507 13487 raft_consensus.cc:2466] T 9b9c2ae8805a48f7959d6745677a96f2 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 0.
I20250830 07:54:37.506572 13887 raft_consensus.cc:738] T afb132e8a5b14a029e005e375f276348 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:54:37.506861 13887 consensus_queue.cc:260] T afb132e8a5b14a029e005e375f276348 P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
W20250830 07:54:37.507210 13226 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet aee84a97524e4568acdc4ae1c74fb492 has no consensus state
I20250830 07:54:37.507609 13701 leader_election.cc:304] T 9b9c2ae8805a48f7959d6745677a96f2 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters:
I20250830 07:54:37.508409 14383 raft_consensus.cc:2802] T 9b9c2ae8805a48f7959d6745677a96f2 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:54:37.508502 14383 raft_consensus.cc:491] T 9b9c2ae8805a48f7959d6745677a96f2 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:54:37.508598 14383 raft_consensus.cc:3058] T 9b9c2ae8805a48f7959d6745677a96f2 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:37.509783 13226 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_5e025fcd87f8470fa772efb1dfeaa957" } modify_external_catalogs: true
I20250830 07:54:37.511271 14383 raft_consensus.cc:513] T 9b9c2ae8805a48f7959d6745677a96f2 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:54:37.511885 14383 leader_election.cc:290] T 9b9c2ae8805a48f7959d6745677a96f2 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Requested vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
I20250830 07:54:37.512439 13887 ts_tablet_manager.cc:1428] T afb132e8a5b14a029e005e375f276348 P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.007s user 0.002s sys 0.001s
I20250830 07:54:37.515381 13226 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_5e025fcd87f8470fa772efb1dfeaa957" } modify_external_catalogs: true
I20250830 07:54:37.517050 13487 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "9b9c2ae8805a48f7959d6745677a96f2" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba"
I20250830 07:54:37.517112 13232 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_8fe6b43b7fce46bcac3805cc7cb4aa4f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250830 07:54:37.517233 13487 raft_consensus.cc:3058] T 9b9c2ae8805a48f7959d6745677a96f2 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
W20250830 07:54:37.517551 13232 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8fe6b43b7fce46bcac3805cc7cb4aa4f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:37.520061 13487 raft_consensus.cc:2466] T 9b9c2ae8805a48f7959d6745677a96f2 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 1.
I20250830 07:54:37.520505 13701 leader_election.cc:304] T 9b9c2ae8805a48f7959d6745677a96f2 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters:
I20250830 07:54:37.520824 14385 raft_consensus.cc:2802] T 9b9c2ae8805a48f7959d6745677a96f2 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election won for term 1
I20250830 07:54:37.520974 14385 raft_consensus.cc:695] T 9b9c2ae8805a48f7959d6745677a96f2 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 LEADER]: Becoming Leader. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Running, Role: LEADER
I20250830 07:54:37.521256 14385 consensus_queue.cc:237] T 9b9c2ae8805a48f7959d6745677a96f2 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:54:37.522729 13605 tablet_service.cc:1515] Processing DeleteTablet for tablet 5dac49aebcfa476d81547636cd4c6986 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:36 UTC) from {username='slave'} at 127.0.0.1:45306
I20250830 07:54:37.523682 13885 tablet_replica.cc:331] T 5dac49aebcfa476d81547636cd4c6986 P 6b5e454d98894637b466ea27f1b647f9: stopping tablet replica
I20250830 07:54:37.523335 13628 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "9b9c2ae8805a48f7959d6745677a96f2" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:37.523200 13625 raft_consensus.cc:3058] T 1476bb480bf747838613948875001c30 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:37.524375 13887 tablet_bootstrap.cc:492] T 7238db7e31484201a30cf4c035d82aff P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:54:37.524739 13885 raft_consensus.cc:2241] T 5dac49aebcfa476d81547636cd4c6986 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250830 07:54:37.524916 13885 raft_consensus.cc:2270] T 5dac49aebcfa476d81547636cd4c6986 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250830 07:54:37.526132 13887 tablet_bootstrap.cc:654] T 7238db7e31484201a30cf4c035d82aff P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:37.526731 13885 ts_tablet_manager.cc:1905] T 5dac49aebcfa476d81547636cd4c6986 P 6b5e454d98894637b466ea27f1b647f9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250830 07:54:37.530529 14038 raft_consensus.cc:491] T bee1b5f6f04740dba64cdcb094e26113 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:37.530668 14038 raft_consensus.cc:513] T bee1b5f6f04740dba64cdcb094e26113 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:54:37.531066 13628 raft_consensus.cc:2466] T 9b9c2ae8805a48f7959d6745677a96f2 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 0.
I20250830 07:54:37.531589 14038 leader_election.cc:290] T bee1b5f6f04740dba64cdcb094e26113 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:37.532836 13772 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "bee1b5f6f04740dba64cdcb094e26113" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
W20250830 07:54:37.533413 13422 leader_election.cc:343] T bee1b5f6f04740dba64cdcb094e26113 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:37.535295 13228 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_59fd0f7bd26b46b59945c393fc5bb4dc" } modify_external_catalogs: true
I20250830 07:54:37.535712 13228 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_59fd0f7bd26b46b59945c393fc5bb4dc" } modify_external_catalogs: true
I20250830 07:54:37.537827 13628 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "bee1b5f6f04740dba64cdcb094e26113" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
W20250830 07:54:37.538586 13423 leader_election.cc:343] T bee1b5f6f04740dba64cdcb094e26113 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:37.538720 13423 leader_election.cc:304] T bee1b5f6f04740dba64cdcb094e26113 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba; no voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:54:37.539237 14038 raft_consensus.cc:2747] T bee1b5f6f04740dba64cdcb094e26113 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:54:37.540068 13627 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "9b9c2ae8805a48f7959d6745677a96f2" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9"
I20250830 07:54:37.540798 13627 raft_consensus.cc:3058] T 9b9c2ae8805a48f7959d6745677a96f2 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:37.543641 13627 raft_consensus.cc:2466] T 9b9c2ae8805a48f7959d6745677a96f2 P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 1.
I20250830 07:54:37.548720 13885 ts_tablet_manager.cc:1918] T 5dac49aebcfa476d81547636cd4c6986 P 6b5e454d98894637b466ea27f1b647f9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250830 07:54:37.548960 13885 log.cc:1199] T 5dac49aebcfa476d81547636cd4c6986 P 6b5e454d98894637b466ea27f1b647f9: Deleting WAL directory at /tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/ts-1/wal/wals/5dac49aebcfa476d81547636cd4c6986
I20250830 07:54:37.549877 13885 ts_tablet_manager.cc:1939] T 5dac49aebcfa476d81547636cd4c6986 P 6b5e454d98894637b466ea27f1b647f9: Deleting consensus metadata
I20250830 07:54:37.550581 13220 catalog_manager.cc:4928] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): tablet 5dac49aebcfa476d81547636cd4c6986 (table default.Table_c971df90450b4c17821d0f0a51ae48a3 [id=5be1411ad9f548f8b84fa170596c4cf5]) successfully deleted
I20250830 07:54:37.556007 14038 raft_consensus.cc:491] T 48b422b125154fbdbb9c995dc372d128 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:37.556178 14038 raft_consensus.cc:513] T 48b422b125154fbdbb9c995dc372d128 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:54:37.556783 14038 leader_election.cc:290] T 48b422b125154fbdbb9c995dc372d128 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:37.557528 13772 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "48b422b125154fbdbb9c995dc372d128" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:37.557762 13772 raft_consensus.cc:2466] T 48b422b125154fbdbb9c995dc372d128 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2065c332f15a4739899af79f3669c3ba in term 0.
I20250830 07:54:37.558234 13422 leader_election.cc:304] T 48b422b125154fbdbb9c995dc372d128 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters:
I20250830 07:54:37.558516 14038 raft_consensus.cc:2802] T 48b422b125154fbdbb9c995dc372d128 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:54:37.558642 14038 raft_consensus.cc:491] T 48b422b125154fbdbb9c995dc372d128 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:54:37.558740 14038 raft_consensus.cc:3058] T 48b422b125154fbdbb9c995dc372d128 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:37.559106 13627 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "48b422b125154fbdbb9c995dc372d128" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:37.560320 13886 tablet_bootstrap.cc:654] T 008827b3d09d464b9182fb42dc2170d5 P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:37.561360 13882 tablet_bootstrap.cc:492] T 9696d8531a174585b8fd83a2391c02f7 P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:54:37.561467 13820 heartbeater.cc:344] Connected to a master server at 127.12.209.60:43889
I20250830 07:54:37.561745 13882 ts_tablet_manager.cc:1397] T 9696d8531a174585b8fd83a2391c02f7 P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.064s user 0.005s sys 0.024s
I20250830 07:54:37.561867 14038 raft_consensus.cc:513] T 48b422b125154fbdbb9c995dc372d128 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
W20250830 07:54:37.562636 13423 leader_election.cc:343] T 48b422b125154fbdbb9c995dc372d128 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:37.562610 13882 raft_consensus.cc:357] T 9696d8531a174585b8fd83a2391c02f7 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:54:37.562804 13882 raft_consensus.cc:383] T 9696d8531a174585b8fd83a2391c02f7 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:37.562871 13882 raft_consensus.cc:738] T 9696d8531a174585b8fd83a2391c02f7 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:54:37.563120 13882 consensus_queue.cc:260] T 9696d8531a174585b8fd83a2391c02f7 P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:54:37.563623 13882 ts_tablet_manager.cc:1428] T 9696d8531a174585b8fd83a2391c02f7 P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20250830 07:54:37.563972 13882 tablet_bootstrap.cc:492] T 3167b609ed184decb4ccdb4945933ebb P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:54:37.565953 14038 leader_election.cc:290] T 48b422b125154fbdbb9c995dc372d128 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 election: Requested vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:37.566689 13625 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "48b422b125154fbdbb9c995dc372d128" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9"
W20250830 07:54:37.570243 13423 leader_election.cc:343] T 48b422b125154fbdbb9c995dc372d128 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:37.570662 13230 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet e255d3fdee09400ead41ca835d6d103f
I20250830 07:54:37.571560 13882 tablet_bootstrap.cc:654] T 3167b609ed184decb4ccdb4945933ebb P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
W20250830 07:54:37.572598 13230 catalog_manager.cc:5415] Ignoring report from unknown tablet 861809cc50764aa89140e587489e2d88
W20250830 07:54:37.574222 13230 catalog_manager.cc:5415] Ignoring report from unknown tablet 9696d8531a174585b8fd83a2391c02f7
I20250830 07:54:37.574668 13230 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_60f119819df04220a5c92c823e344beb" } modify_external_catalogs: true
I20250830 07:54:37.575351 13468 tablet_service.cc:1515] Processing DeleteTablet for tablet e255d3fdee09400ead41ca835d6d103f with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:37 UTC) from {username='slave'} at 127.0.0.1:37956
I20250830 07:54:37.576124 13605 tablet_service.cc:1515] Processing DeleteTablet for tablet e255d3fdee09400ead41ca835d6d103f with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:37 UTC) from {username='slave'} at 127.0.0.1:45306
W20250830 07:54:37.576539 13218 catalog_manager.cc:4908] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): delete failed for tablet e255d3fdee09400ead41ca835d6d103f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e255d3fdee09400ead41ca835d6d103f already in progress: creating tablet
W20250830 07:54:37.576910 13220 catalog_manager.cc:4908] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet e255d3fdee09400ead41ca835d6d103f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e255d3fdee09400ead41ca835d6d103f already in progress: creating tablet
I20250830 07:54:37.577481 13230 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_60f119819df04220a5c92c823e344beb" } modify_external_catalogs: true
I20250830 07:54:37.579778 13882 tablet_bootstrap.cc:492] T 3167b609ed184decb4ccdb4945933ebb P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:54:37.579914 13882 ts_tablet_manager.cc:1397] T 3167b609ed184decb4ccdb4945933ebb P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.016s user 0.003s sys 0.006s
I20250830 07:54:37.580693 13882 raft_consensus.cc:357] T 3167b609ed184decb4ccdb4945933ebb P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:54:37.580857 13882 raft_consensus.cc:383] T 3167b609ed184decb4ccdb4945933ebb P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:37.580942 13882 raft_consensus.cc:738] T 3167b609ed184decb4ccdb4945933ebb P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:54:37.581161 13882 consensus_queue.cc:260] T 3167b609ed184decb4ccdb4945933ebb P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:54:37.581714 13882 ts_tablet_manager.cc:1428] T 3167b609ed184decb4ccdb4945933ebb P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20250830 07:54:37.582337 13882 tablet_bootstrap.cc:492] T 7238db7e31484201a30cf4c035d82aff P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:54:37.583081 13887 tablet_bootstrap.cc:492] T 7238db7e31484201a30cf4c035d82aff P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:54:37.584250 13882 tablet_bootstrap.cc:654] T 7238db7e31484201a30cf4c035d82aff P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:37.586958 14038 raft_consensus.cc:491] T 3167b609ed184decb4ccdb4945933ebb P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:37.587121 14038 raft_consensus.cc:513] T 3167b609ed184decb4ccdb4945933ebb P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:54:37.587361 13887 ts_tablet_manager.cc:1397] T 7238db7e31484201a30cf4c035d82aff P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.063s user 0.001s sys 0.003s
I20250830 07:54:37.588268 14038 leader_election.cc:290] T 3167b609ed184decb4ccdb4945933ebb P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:37.589138 14315 consensus_queue.cc:1035] T 1476bb480bf747838613948875001c30 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.023s
I20250830 07:54:37.588678 13887 raft_consensus.cc:357] T 7238db7e31484201a30cf4c035d82aff P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:54:37.589735 13887 raft_consensus.cc:383] T 7238db7e31484201a30cf4c035d82aff P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:37.589812 13887 raft_consensus.cc:738] T 7238db7e31484201a30cf4c035d82aff P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:54:37.589931 13749 tablet_service.cc:1515] Processing DeleteTablet for tablet e255d3fdee09400ead41ca835d6d103f with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:37 UTC) from {username='slave'} at 127.0.0.1:45460
I20250830 07:54:37.590075 13887 consensus_queue.cc:260] T 7238db7e31484201a30cf4c035d82aff P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:54:37.595289 13887 ts_tablet_manager.cc:1428] T 7238db7e31484201a30cf4c035d82aff P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.008s user 0.002s sys 0.000s
I20250830 07:54:37.596815 13231 catalog_manager.cc:5864] Not sending DeleteTablet requests; no consensus state for tablet e0148ace593a4a70bbf941c97e65bda8
W20250830 07:54:37.598161 13231 catalog_manager.cc:5415] Ignoring report from unknown tablet 9696d8531a174585b8fd83a2391c02f7
I20250830 07:54:37.598693 13231 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_1ea5f85222ec42f6af7118df29b3407b" } new_table_name: "default.Table_1cda1cda267540b4bcc19d4ac70c0519" modify_external_catalogs: true
I20250830 07:54:37.600034 13887 tablet_bootstrap.cc:492] T 27da527d9fe045ae8c17f193d034f5ac P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:54:37.601693 13536 heartbeater.cc:344] Connected to a master server at 127.12.209.60:43889
I20250830 07:54:37.604277 13625 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "3167b609ed184decb4ccdb4945933ebb" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:37.604516 13625 raft_consensus.cc:2466] T 3167b609ed184decb4ccdb4945933ebb P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2065c332f15a4739899af79f3669c3ba in term 0.
I20250830 07:54:37.604961 13423 leader_election.cc:304] T 3167b609ed184decb4ccdb4945933ebb P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 6b5e454d98894637b466ea27f1b647f9; no voters:
I20250830 07:54:37.605296 14038 raft_consensus.cc:2802] T 3167b609ed184decb4ccdb4945933ebb P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:54:37.605392 14038 raft_consensus.cc:491] T 3167b609ed184decb4ccdb4945933ebb P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:54:37.605463 14038 raft_consensus.cc:3058] T 3167b609ed184decb4ccdb4945933ebb P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
W20250830 07:54:37.605582 13219 catalog_manager.cc:4908] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): delete failed for tablet e255d3fdee09400ead41ca835d6d103f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e255d3fdee09400ead41ca835d6d103f already in progress: creating tablet
I20250830 07:54:37.605893 13773 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "3167b609ed184decb4ccdb4945933ebb" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:37.608290 14038 raft_consensus.cc:513] T 3167b609ed184decb4ccdb4945933ebb P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:54:37.608368 13887 tablet_bootstrap.cc:654] T 27da527d9fe045ae8c17f193d034f5ac P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:37.610641 13625 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "3167b609ed184decb4ccdb4945933ebb" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9"
I20250830 07:54:37.610841 13625 raft_consensus.cc:3058] T 3167b609ed184decb4ccdb4945933ebb P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:37.612701 13233 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_86688c50c80b483d9db991795dd03369" } new_table_name: "default.Table_4cb9bc1005a747f2adafe021b2369ba2" modify_external_catalogs: true
I20250830 07:54:37.613891 14038 leader_election.cc:290] T 3167b609ed184decb4ccdb4945933ebb P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 election: Requested vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:37.614588 13625 raft_consensus.cc:2466] T 3167b609ed184decb4ccdb4945933ebb P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2065c332f15a4739899af79f3669c3ba in term 1.
I20250830 07:54:37.614837 13773 raft_consensus.cc:2466] T 3167b609ed184decb4ccdb4945933ebb P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2065c332f15a4739899af79f3669c3ba in term 0.
I20250830 07:54:37.615198 13772 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "48b422b125154fbdbb9c995dc372d128" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f"
I20250830 07:54:37.615675 13423 leader_election.cc:304] T 3167b609ed184decb4ccdb4945933ebb P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 6b5e454d98894637b466ea27f1b647f9; no voters:
I20250830 07:54:37.615947 14038 raft_consensus.cc:2802] T 3167b609ed184decb4ccdb4945933ebb P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election won for term 1
I20250830 07:54:37.616430 14038 raft_consensus.cc:695] T 3167b609ed184decb4ccdb4945933ebb P 2065c332f15a4739899af79f3669c3ba [term 1 LEADER]: Becoming Leader. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Running, Role: LEADER
I20250830 07:54:37.617309 14038 consensus_queue.cc:237] T 3167b609ed184decb4ccdb4945933ebb P 2065c332f15a4739899af79f3669c3ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:54:37.617449 13954 raft_consensus.cc:491] T afb132e8a5b14a029e005e375f276348 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:37.617609 13954 raft_consensus.cc:513] T afb132e8a5b14a029e005e375f276348 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:37.618227 13954 leader_election.cc:290] T afb132e8a5b14a029e005e375f276348 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
W20250830 07:54:37.621938 13229 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 410b1e2d520c470eb4b9ab60104e0cd4 has no consensus state
I20250830 07:54:37.622380 13229 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_7369fede0ccd48d1bc738e5dcda4ab25"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:37.622975 13229 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7369fede0ccd48d1bc738e5dcda4ab25 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:37.622887 13772 raft_consensus.cc:3058] T 48b422b125154fbdbb9c995dc372d128 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:37.624589 13225 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_3c375881f4bd48f78131bbf90d56ca6d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250830 07:54:37.624678 13774 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "afb132e8a5b14a029e005e375f276348" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
W20250830 07:54:37.624958 13703 consensus_peers.cc:489] T ff0f9cccc8ed43b1a8cd38de0e9d4097 P 9b057ade5dce45af9f8bf0bedf8b917f -> Peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Couldn't send request to peer 6b5e454d98894637b466ea27f1b647f9. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ff0f9cccc8ed43b1a8cd38de0e9d4097. This is attempt 1: this message will repeat every 5th retry.
W20250830 07:54:37.625046 13225 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3c375881f4bd48f78131bbf90d56ca6d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:37.626478 13771 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "3167b609ed184decb4ccdb4945933ebb" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f"
I20250830 07:54:37.626890 13771 raft_consensus.cc:3058] T 3167b609ed184decb4ccdb4945933ebb P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:37.629743 13771 raft_consensus.cc:2466] T 3167b609ed184decb4ccdb4945933ebb P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2065c332f15a4739899af79f3669c3ba in term 1.
I20250830 07:54:37.631572 13772 raft_consensus.cc:2466] T 48b422b125154fbdbb9c995dc372d128 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2065c332f15a4739899af79f3669c3ba in term 1.
I20250830 07:54:37.637517 14360 sys_catalog.cc:263] Verifying existing consensus state
I20250830 07:54:37.639263 13227 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet c0147310dad84226808332a4c2c6e09d
I20250830 07:54:37.639784 13227 catalog_manager.cc:6652] ReplaceTablet: tablet c0147310dad84226808332a4c2c6e09d deleted and replaced by tablet c8bc6e07377a4ba99c39a909dae11402
I20250830 07:54:37.640183 13749 tablet_service.cc:1515] Processing DeleteTablet for tablet c0147310dad84226808332a4c2c6e09d with delete_type TABLET_DATA_DELETED (replaced by tablet c8bc6e07377a4ba99c39a909dae11402) from {username='slave'} at 127.0.0.1:45460
I20250830 07:54:37.640213 13227 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_f21862e4d3614f3599c1f8c6b3a0d624"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:37.640816 13227 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f21862e4d3614f3599c1f8c6b3a0d624 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250830 07:54:37.640899 13219 catalog_manager.cc:4908] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): delete failed for tablet c0147310dad84226808332a4c2c6e09d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c0147310dad84226808332a4c2c6e09d already in progress: creating tablet
I20250830 07:54:37.642558 13605 tablet_service.cc:1515] Processing DeleteTablet for tablet c0147310dad84226808332a4c2c6e09d with delete_type TABLET_DATA_DELETED (replaced by tablet c8bc6e07377a4ba99c39a909dae11402) from {username='slave'} at 127.0.0.1:45306
W20250830 07:54:37.643236 13220 catalog_manager.cc:4908] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet c0147310dad84226808332a4c2c6e09d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c0147310dad84226808332a4c2c6e09d already in progress: creating tablet
I20250830 07:54:37.645957 14315 raft_consensus.cc:491] T 4d4b00bdadb24ec892d87c9be2ed7dd9 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:37.646158 14315 raft_consensus.cc:513] T 4d4b00bdadb24ec892d87c9be2ed7dd9 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:37.646804 14315 leader_election.cc:290] T 4d4b00bdadb24ec892d87c9be2ed7dd9 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967)
W20250830 07:54:37.648240 13703 leader_election.cc:343] T 4d4b00bdadb24ec892d87c9be2ed7dd9 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Not found: Tablet not found: 4d4b00bdadb24ec892d87c9be2ed7dd9
I20250830 07:54:37.652465 13226 catalog_manager.cc:5864] Not sending DeleteTablet requests; no consensus state for tablet 70182d834a8641ff8798e3e45b5e89da
I20250830 07:54:37.652876 13226 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_975129530c7048dc8e739e361b2bbceb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:37.653512 13226 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_975129530c7048dc8e739e361b2bbceb in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:37.653904 13625 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "afb132e8a5b14a029e005e375f276348" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
W20250830 07:54:37.656170 13423 leader_election.cc:343] T afb132e8a5b14a029e005e375f276348 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:37.663565 13228 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet 44313f1a11b74e6d996cafd3c03d1836
I20250830 07:54:37.664323 13232 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_b879db4950f2469bb1b1739334f7b035"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250830 07:54:37.664386 13228 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_909c19bf1a2c49b48c19d50c7bebda25"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:37.664938 13232 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b879db4950f2469bb1b1739334f7b035 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:37.665127 13230 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet 04c9d954106a4417a34ff80bc98e2ce8
I20250830 07:54:37.665791 13230 master_service.cc:948] ReplaceTablet: received request to replace tablet 2009012fddc24e4fb7ad0fab33a1103b from {username='slave'} at 127.0.0.1:42126
W20250830 07:54:37.664934 13228 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_909c19bf1a2c49b48c19d50c7bebda25 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:37.667462 13605 tablet_service.cc:1515] Processing DeleteTablet for tablet 44313f1a11b74e6d996cafd3c03d1836 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:37 UTC) from {username='slave'} at 127.0.0.1:45306
I20250830 07:54:37.667771 13749 tablet_service.cc:1515] Processing DeleteTablet for tablet 44313f1a11b74e6d996cafd3c03d1836 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:37 UTC) from {username='slave'} at 127.0.0.1:45460
W20250830 07:54:37.667999 13231 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 087bb1e80d2d44bf8619b0341ff99527 has no consensus state
I20250830 07:54:37.668013 13752 tablet_service.cc:1515] Processing DeleteTablet for tablet 04c9d954106a4417a34ff80bc98e2ce8 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:37 UTC) from {username='slave'} at 127.0.0.1:45460
W20250830 07:54:37.668406 13233 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ef1ab62a5b7845e58d50f34206eaaa27 has no consensus state
I20250830 07:54:37.669564 13605 tablet_service.cc:1515] Processing DeleteTablet for tablet 04c9d954106a4417a34ff80bc98e2ce8 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:37 UTC) from {username='slave'} at 127.0.0.1:45306
W20250830 07:54:37.669713 13220 catalog_manager.cc:4908] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet 44313f1a11b74e6d996cafd3c03d1836 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 44313f1a11b74e6d996cafd3c03d1836 already in progress: creating tablet
W20250830 07:54:37.670321 13219 catalog_manager.cc:4908] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): delete failed for tablet 44313f1a11b74e6d996cafd3c03d1836 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 44313f1a11b74e6d996cafd3c03d1836 already in progress: creating tablet
W20250830 07:54:37.670562 13219 catalog_manager.cc:4908] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): delete failed for tablet 04c9d954106a4417a34ff80bc98e2ce8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 04c9d954106a4417a34ff80bc98e2ce8 already in progress: creating tablet
W20250830 07:54:37.671276 13220 catalog_manager.cc:4908] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet 04c9d954106a4417a34ff80bc98e2ce8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 04c9d954106a4417a34ff80bc98e2ce8 already in progress: creating tablet
I20250830 07:54:37.675904 14360 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3ea183a890b84f408b20b55e9eb7c7ed: Bootstrap starting.
W20250830 07:54:37.681121 13422 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.209.3:38743, user_credentials={real_user=slave}} blocked reactor thread for 56578.7us
W20250830 07:54:37.681691 13233 catalog_manager.cc:5415] Ignoring report from unknown tablet 1476bb480bf747838613948875001c30
W20250830 07:54:37.681805 13233 catalog_manager.cc:5415] Ignoring report from unknown tablet 3167b609ed184decb4ccdb4945933ebb
I20250830 07:54:37.682401 13487 raft_consensus.cc:1273] T ff0f9cccc8ed43b1a8cd38de0e9d4097 P 2065c332f15a4739899af79f3669c3ba [term 2 FOLLOWER]: Refusing update from remote peer 9b057ade5dce45af9f8bf0bedf8b917f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20250830 07:54:37.683359 13468 tablet_service.cc:1515] Processing DeleteTablet for tablet c0147310dad84226808332a4c2c6e09d with delete_type TABLET_DATA_DELETED (replaced by tablet c8bc6e07377a4ba99c39a909dae11402) from {username='slave'} at 127.0.0.1:37956
I20250830 07:54:37.683655 13461 tablet_service.cc:1515] Processing DeleteTablet for tablet 44313f1a11b74e6d996cafd3c03d1836 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:37 UTC) from {username='slave'} at 127.0.0.1:37956
I20250830 07:54:37.683894 13459 tablet_service.cc:1515] Processing DeleteTablet for tablet 04c9d954106a4417a34ff80bc98e2ce8 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:37 UTC) from {username='slave'} at 127.0.0.1:37956
W20250830 07:54:37.683676 13422 leader_election.cc:343] T afb132e8a5b14a029e005e375f276348 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:37.686190 13422 leader_election.cc:304] T afb132e8a5b14a029e005e375f276348 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba; no voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:54:37.686546 13954 raft_consensus.cc:2747] T afb132e8a5b14a029e005e375f276348 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:54:37.686856 13422 leader_election.cc:304] T 48b422b125154fbdbb9c995dc372d128 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:54:37.687318 13954 raft_consensus.cc:2802] T 48b422b125154fbdbb9c995dc372d128 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election won for term 1
I20250830 07:54:37.687481 13954 raft_consensus.cc:695] T 48b422b125154fbdbb9c995dc372d128 P 2065c332f15a4739899af79f3669c3ba [term 1 LEADER]: Becoming Leader. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Running, Role: LEADER
I20250830 07:54:37.687783 13954 consensus_queue.cc:237] T 48b422b125154fbdbb9c995dc372d128 P 2065c332f15a4739899af79f3669c3ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
W20250830 07:54:37.688216 13701 leader_election.cc:343] T 4d4b00bdadb24ec892d87c9be2ed7dd9 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): Not found: Tablet not found: 4d4b00bdadb24ec892d87c9be2ed7dd9
I20250830 07:54:37.688346 13701 leader_election.cc:304] T 4d4b00bdadb24ec892d87c9be2ed7dd9 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 2065c332f15a4739899af79f3669c3ba, 6b5e454d98894637b466ea27f1b647f9
I20250830 07:54:37.688977 14287 raft_consensus.cc:2747] T 4d4b00bdadb24ec892d87c9be2ed7dd9 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:54:37.689204 14287 consensus_queue.cc:1035] T ff0f9cccc8ed43b1a8cd38de0e9d4097 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20250830 07:54:37.689872 13218 catalog_manager.cc:4908] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): delete failed for tablet c0147310dad84226808332a4c2c6e09d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c0147310dad84226808332a4c2c6e09d already in progress: creating tablet
W20250830 07:54:37.690160 13218 catalog_manager.cc:4908] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): delete failed for tablet 44313f1a11b74e6d996cafd3c03d1836 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 44313f1a11b74e6d996cafd3c03d1836 already in progress: creating tablet
W20250830 07:54:37.690363 13218 catalog_manager.cc:4908] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): delete failed for tablet 04c9d954106a4417a34ff80bc98e2ce8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 04c9d954106a4417a34ff80bc98e2ce8 already in progress: creating tablet
W20250830 07:54:37.693506 13233 catalog_manager.cc:5415] Ignoring report from unknown tablet 9b9c2ae8805a48f7959d6745677a96f2
W20250830 07:54:37.693640 13233 catalog_manager.cc:5415] Ignoring report from unknown tablet 4c2c85732d454cd98efc2646af9450ed
W20250830 07:54:37.693750 13233 catalog_manager.cc:5415] Ignoring report from unknown tablet f398e12cd9f543738d5163354f8a9d9d
I20250830 07:54:37.694489 13886 tablet_bootstrap.cc:492] T 008827b3d09d464b9182fb42dc2170d5 P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:54:37.694707 13886 ts_tablet_manager.cc:1397] T 008827b3d09d464b9182fb42dc2170d5 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.375s user 0.003s sys 0.004s
I20250830 07:54:37.695650 13886 raft_consensus.cc:357] T 008827b3d09d464b9182fb42dc2170d5 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:54:37.695851 13886 raft_consensus.cc:383] T 008827b3d09d464b9182fb42dc2170d5 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:37.696202 13886 raft_consensus.cc:738] T 008827b3d09d464b9182fb42dc2170d5 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:54:37.697088 13886 consensus_queue.cc:260] T 008827b3d09d464b9182fb42dc2170d5 P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:54:37.702610 13886 ts_tablet_manager.cc:1428] T 008827b3d09d464b9182fb42dc2170d5 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.008s user 0.000s sys 0.002s
I20250830 07:54:37.705248 13886 tablet_bootstrap.cc:492] T 2009012fddc24e4fb7ad0fab33a1103b P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
W20250830 07:54:37.706329 13229 catalog_manager.cc:5415] Ignoring report from unknown tablet 008827b3d09d464b9182fb42dc2170d5
I20250830 07:54:37.713912 13228 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_79f5696bfda54c74b293dfd15540cac9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:37.714483 13228 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_79f5696bfda54c74b293dfd15540cac9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:37.715197 13232 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_4afcfcaafd5f41b1b0b66e198877db37" } new_table_name: "default.Table_72d8d836afc847fb82eafafb9a395d0d" modify_external_catalogs: true
I20250830 07:54:37.715588 13886 tablet_bootstrap.cc:654] T 2009012fddc24e4fb7ad0fab33a1103b P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:37.716488 13227 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_c9397e64edef4d31a5a4eded8ebe365c" } new_table_name: "default.Table_4428c29c8358411282f00fd33a6badd4" modify_external_catalogs: true
W20250830 07:54:37.720775 13225 catalog_manager.cc:5415] Ignoring report from unknown tablet 008827b3d09d464b9182fb42dc2170d5
I20250830 07:54:37.725801 13886 tablet_bootstrap.cc:492] T 2009012fddc24e4fb7ad0fab33a1103b P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:54:37.725973 13886 ts_tablet_manager.cc:1397] T 2009012fddc24e4fb7ad0fab33a1103b P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.021s user 0.001s sys 0.003s
I20250830 07:54:37.726845 13886 raft_consensus.cc:357] T 2009012fddc24e4fb7ad0fab33a1103b P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:54:37.727065 13886 raft_consensus.cc:383] T 2009012fddc24e4fb7ad0fab33a1103b P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:37.727173 13886 raft_consensus.cc:738] T 2009012fddc24e4fb7ad0fab33a1103b P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:54:37.727437 13886 consensus_queue.cc:260] T 2009012fddc24e4fb7ad0fab33a1103b P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
W20250830 07:54:37.728365 13232 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 93181873e9014529bc19d64145b1a98a has no consensus state
W20250830 07:54:37.728725 13227 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 14ed24577c8f49f49c83242a26877614 consensus state has no leader
I20250830 07:54:37.733405 13752 tablet_service.cc:1515] Processing DeleteTablet for tablet 2009012fddc24e4fb7ad0fab33a1103b with delete_type TABLET_DATA_DELETED (replaced by tablet 52e910677ae34630a919d1d3f21b7e83) from {username='slave'} at 127.0.0.1:45460
W20250830 07:54:37.734058 13219 catalog_manager.cc:4908] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): delete failed for tablet 2009012fddc24e4fb7ad0fab33a1103b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2009012fddc24e4fb7ad0fab33a1103b already in progress: creating tablet
I20250830 07:54:37.734297 13886 ts_tablet_manager.cc:1428] T 2009012fddc24e4fb7ad0fab33a1103b P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
I20250830 07:54:37.737324 14360 log.cc:826] T 00000000000000000000000000000000 P 3ea183a890b84f408b20b55e9eb7c7ed: Log is configured to *not* fsync() on all Append() calls
I20250830 07:54:37.739127 13886 tablet_bootstrap.cc:492] T bee1b5f6f04740dba64cdcb094e26113 P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:54:37.741886 13752 tablet_service.cc:1515] Processing DeleteTablet for tablet 2009012fddc24e4fb7ad0fab33a1103b with delete_type TABLET_DATA_DELETED (replaced by tablet 52e910677ae34630a919d1d3f21b7e83) from {username='slave'} at 127.0.0.1:45460
I20250830 07:54:37.743837 13886 tablet_bootstrap.cc:654] T bee1b5f6f04740dba64cdcb094e26113 P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:37.744164 13884 tablet_replica.cc:331] T 2009012fddc24e4fb7ad0fab33a1103b P 9b057ade5dce45af9f8bf0bedf8b917f: stopping tablet replica
I20250830 07:54:37.744369 13884 raft_consensus.cc:2241] T 2009012fddc24e4fb7ad0fab33a1103b P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Raft consensus shutting down.
I20250830 07:54:37.744535 13884 raft_consensus.cc:2270] T 2009012fddc24e4fb7ad0fab33a1103b P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Raft consensus is shut down!
I20250830 07:54:37.750211 13884 ts_tablet_manager.cc:1905] T 2009012fddc24e4fb7ad0fab33a1103b P 9b057ade5dce45af9f8bf0bedf8b917f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250830 07:54:37.752084 13228 master_service.cc:948] ReplaceTablet: received request to replace tablet 30c2558c28944ff39d1a4a4ca9ac604e from {username='slave'} at 127.0.0.1:42126
W20250830 07:54:37.754817 13220 catalog_manager.cc:4726] Async tablet task AlterTable RPC for tablet 8ab12188dddc4de69ac73dffb01d51a9 (table default.Table_941683cb836e4df7a4f2cf11c6b54f0e [id=388ffc0a7b884c26811aab0ec8eccf71], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 8ab12188dddc4de69ac73dffb01d51a9 consensus state has no leader
I20250830 07:54:37.756547 13884 ts_tablet_manager.cc:1918] T 2009012fddc24e4fb7ad0fab33a1103b P 9b057ade5dce45af9f8bf0bedf8b917f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250830 07:54:37.756757 13884 log.cc:1199] T 2009012fddc24e4fb7ad0fab33a1103b P 9b057ade5dce45af9f8bf0bedf8b917f: Deleting WAL directory at /tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/ts-2/wal/wals/2009012fddc24e4fb7ad0fab33a1103b
I20250830 07:54:37.757164 13884 ts_tablet_manager.cc:1939] T 2009012fddc24e4fb7ad0fab33a1103b P 9b057ade5dce45af9f8bf0bedf8b917f: Deleting consensus metadata
I20250830 07:54:37.757758 13219 catalog_manager.cc:4928] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): tablet 2009012fddc24e4fb7ad0fab33a1103b (table default.Table_3af4480a9af740f598919322e7fc5efc [id=b3fced981b2a4b44a8eab43675699ba5]) successfully deleted
I20250830 07:54:37.768242 13882 tablet_bootstrap.cc:492] T 7238db7e31484201a30cf4c035d82aff P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:54:37.768441 13882 ts_tablet_manager.cc:1397] T 7238db7e31484201a30cf4c035d82aff P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.186s user 0.005s sys 0.009s
I20250830 07:54:37.769019 13886 tablet_bootstrap.cc:492] T bee1b5f6f04740dba64cdcb094e26113 P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:54:37.769225 13886 ts_tablet_manager.cc:1397] T bee1b5f6f04740dba64cdcb094e26113 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.030s user 0.004s sys 0.001s
I20250830 07:54:37.769217 13882 raft_consensus.cc:357] T 7238db7e31484201a30cf4c035d82aff P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:54:37.769435 13882 raft_consensus.cc:383] T 7238db7e31484201a30cf4c035d82aff P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:37.769507 13882 raft_consensus.cc:738] T 7238db7e31484201a30cf4c035d82aff P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:54:37.769722 13882 consensus_queue.cc:260] T 7238db7e31484201a30cf4c035d82aff P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:54:37.770192 13882 ts_tablet_manager.cc:1428] T 7238db7e31484201a30cf4c035d82aff P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20250830 07:54:37.770823 13882 tablet_bootstrap.cc:492] T 008827b3d09d464b9182fb42dc2170d5 P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:54:37.773700 13228 catalog_manager.cc:5674] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967) does not have the latest schema for tablet 7238db7e31484201a30cf4c035d82aff (table default.Table_6f8d287a31204172a037b156956fb0d9 [id=0e4bba403b27442cb6e7f5b50ff4a39f]). Expected version 1 got 0
I20250830 07:54:37.775470 13882 tablet_bootstrap.cc:654] T 008827b3d09d464b9182fb42dc2170d5 P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:37.778187 13228 catalog_manager.cc:5674] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967) does not have the latest schema for tablet 7238db7e31484201a30cf4c035d82aff (table default.Table_6f8d287a31204172a037b156956fb0d9 [id=0e4bba403b27442cb6e7f5b50ff4a39f]). Expected version 1 got 0
I20250830 07:54:37.778514 13227 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_72d8d836afc847fb82eafafb9a395d0d" } modify_external_catalogs: true
I20250830 07:54:37.778792 13227 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_72d8d836afc847fb82eafafb9a395d0d" } modify_external_catalogs: true
I20250830 07:54:37.787002 13886 raft_consensus.cc:357] T bee1b5f6f04740dba64cdcb094e26113 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:54:37.787259 13886 raft_consensus.cc:383] T bee1b5f6f04740dba64cdcb094e26113 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:37.787348 13886 raft_consensus.cc:738] T bee1b5f6f04740dba64cdcb094e26113 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:54:37.787573 13886 consensus_queue.cc:260] T bee1b5f6f04740dba64cdcb094e26113 P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:54:37.791635 13886 ts_tablet_manager.cc:1428] T bee1b5f6f04740dba64cdcb094e26113 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.022s user 0.002s sys 0.000s
W20250830 07:54:37.792654 13228 catalog_manager.cc:5415] Ignoring report from unknown tablet 1476bb480bf747838613948875001c30
I20250830 07:54:37.798019 13882 tablet_bootstrap.cc:492] T 008827b3d09d464b9182fb42dc2170d5 P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:54:37.798450 13882 ts_tablet_manager.cc:1397] T 008827b3d09d464b9182fb42dc2170d5 P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.028s user 0.007s sys 0.002s
I20250830 07:54:37.800091 13882 raft_consensus.cc:357] T 008827b3d09d464b9182fb42dc2170d5 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:54:37.800504 13882 raft_consensus.cc:383] T 008827b3d09d464b9182fb42dc2170d5 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:37.800719 13882 raft_consensus.cc:738] T 008827b3d09d464b9182fb42dc2170d5 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:54:37.801167 13882 consensus_queue.cc:260] T 008827b3d09d464b9182fb42dc2170d5 P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:54:37.801981 13228 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_9eaf5529c5124d089dcdaaf915f587c0" } modify_external_catalogs: true
I20250830 07:54:37.802242 13228 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_9eaf5529c5124d089dcdaaf915f587c0" } modify_external_catalogs: true
I20250830 07:54:37.803802 13882 ts_tablet_manager.cc:1428] T 008827b3d09d464b9182fb42dc2170d5 P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.005s user 0.003s sys 0.000s
W20250830 07:54:37.804528 13232 catalog_manager.cc:5415] Ignoring report from unknown tablet bee1b5f6f04740dba64cdcb094e26113
I20250830 07:54:37.804826 13882 tablet_bootstrap.cc:492] T 48b422b125154fbdbb9c995dc372d128 P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:54:37.805636 13886 tablet_bootstrap.cc:492] T d912c69d8722403aa56cbbde4ce59782 P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:54:37.807489 13886 tablet_bootstrap.cc:654] T d912c69d8722403aa56cbbde4ce59782 P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
W20250830 07:54:37.810467 13232 catalog_manager.cc:5415] Ignoring report from unknown tablet bee1b5f6f04740dba64cdcb094e26113
W20250830 07:54:37.812587 13225 catalog_manager.cc:5415] Ignoring report from unknown tablet 008827b3d09d464b9182fb42dc2170d5
I20250830 07:54:37.813238 14385 raft_consensus.cc:491] T 5aef6fd239ba43478cd978fa5d29b26e P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:37.813531 13882 tablet_bootstrap.cc:654] T 48b422b125154fbdbb9c995dc372d128 P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:37.816859 14382 raft_consensus.cc:491] T 008827b3d09d464b9182fb42dc2170d5 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:37.818974 14287 consensus_queue.cc:1035] T ed87c6793dd149a6a363f1977d816628 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20250830 07:54:37.819548 14382 raft_consensus.cc:513] T 008827b3d09d464b9182fb42dc2170d5 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
W20250830 07:54:37.820156 13561 consensus_peers.cc:489] T d1ae3812d72b419798736328da64b53c P 6b5e454d98894637b466ea27f1b647f9 -> Peer 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): Couldn't send request to peer 2065c332f15a4739899af79f3669c3ba. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d1ae3812d72b419798736328da64b53c. This is attempt 1: this message will repeat every 5th retry.
I20250830 07:54:37.820197 14382 leader_election.cc:290] T 008827b3d09d464b9182fb42dc2170d5 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
I20250830 07:54:37.821130 14385 raft_consensus.cc:513] T 5aef6fd239ba43478cd978fa5d29b26e P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:37.821215 13625 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "008827b3d09d464b9182fb42dc2170d5" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:37.821425 13625 raft_consensus.cc:2466] T 008827b3d09d464b9182fb42dc2170d5 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 0.
I20250830 07:54:37.821801 13703 leader_election.cc:304] T 008827b3d09d464b9182fb42dc2170d5 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f; no voters:
I20250830 07:54:37.822351 14385 leader_election.cc:290] T 5aef6fd239ba43478cd978fa5d29b26e P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
I20250830 07:54:37.823376 14287 raft_consensus.cc:2802] T 008827b3d09d464b9182fb42dc2170d5 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:54:37.823495 14287 raft_consensus.cc:491] T 008827b3d09d464b9182fb42dc2170d5 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:54:37.823597 14287 raft_consensus.cc:3058] T 008827b3d09d464b9182fb42dc2170d5 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
W20250830 07:54:37.827171 13703 leader_election.cc:343] T 5aef6fd239ba43478cd978fa5d29b26e P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Not found: Tablet not found: 5aef6fd239ba43478cd978fa5d29b26e
I20250830 07:54:37.827477 14287 raft_consensus.cc:513] T 008827b3d09d464b9182fb42dc2170d5 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:54:37.828253 13225 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_b6f012ba5b2741d2a5b1ed74a2dcd9eb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250830 07:54:37.828418 13625 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "008827b3d09d464b9182fb42dc2170d5" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9"
I20250830 07:54:37.828615 13625 raft_consensus.cc:3058] T 008827b3d09d464b9182fb42dc2170d5 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Advancing to term 1
W20250830 07:54:37.828873 13225 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b6f012ba5b2741d2a5b1ed74a2dcd9eb in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:37.830533 13226 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_dab1da9ac1584d11b0b0ac9e81748758" } new_table_name: "default.Table_7a6b99ecc85740eb8de4ec8dece64920" modify_external_catalogs: true
I20250830 07:54:37.830672 13229 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_affac1e19f984bf38960e637cb801588"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250830 07:54:37.831737 13227 catalog_manager.cc:5864] Not sending DeleteTablet requests; no consensus state for tablet 93181873e9014529bc19d64145b1a98a
I20250830 07:54:37.832188 14382 raft_consensus.cc:491] T 861809cc50764aa89140e587489e2d88 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:37.832330 14382 raft_consensus.cc:513] T 861809cc50764aa89140e587489e2d88 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:54:37.832888 14382 leader_election.cc:290] T 861809cc50764aa89140e587489e2d88 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
W20250830 07:54:37.833405 13232 catalog_manager.cc:5415] Ignoring report from unknown tablet 1476bb480bf747838613948875001c30
W20250830 07:54:37.833446 13229 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_affac1e19f984bf38960e637cb801588 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:37.834549 13627 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "861809cc50764aa89140e587489e2d88" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:37.834774 13627 raft_consensus.cc:2466] T 861809cc50764aa89140e587489e2d88 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 0.
I20250830 07:54:37.835166 13703 leader_election.cc:304] T 861809cc50764aa89140e587489e2d88 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f; no voters:
I20250830 07:54:37.835494 14385 raft_consensus.cc:2802] T 861809cc50764aa89140e587489e2d88 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:54:37.835600 14385 raft_consensus.cc:491] T 861809cc50764aa89140e587489e2d88 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:54:37.835968 13625 raft_consensus.cc:2466] T 008827b3d09d464b9182fb42dc2170d5 P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 1.
I20250830 07:54:37.836145 14385 raft_consensus.cc:3058] T 861809cc50764aa89140e587489e2d88 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:37.836649 13703 leader_election.cc:304] T 008827b3d09d464b9182fb42dc2170d5 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f; no voters:
I20250830 07:54:37.836934 14382 raft_consensus.cc:2802] T 008827b3d09d464b9182fb42dc2170d5 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election won for term 1
I20250830 07:54:37.837076 14382 raft_consensus.cc:695] T 008827b3d09d464b9182fb42dc2170d5 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 LEADER]: Becoming Leader. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Running, Role: LEADER
I20250830 07:54:37.837323 14382 consensus_queue.cc:237] T 008827b3d09d464b9182fb42dc2170d5 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:54:37.842888 14287 leader_election.cc:290] T 008827b3d09d464b9182fb42dc2170d5 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Requested vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
I20250830 07:54:37.844759 13228 catalog_manager.cc:5864] Not sending DeleteTablet requests; no consensus state for tablet 0551b344995943b497b44435b4bed49f
I20250830 07:54:37.847937 14385 raft_consensus.cc:513] T 861809cc50764aa89140e587489e2d88 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
W20250830 07:54:37.850183 13226 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 2be43f828f204f599017b6a04cf2ddf9 consensus state has no leader
I20250830 07:54:37.851917 13486 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "008827b3d09d464b9182fb42dc2170d5" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:54:37.853299 13625 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "861809cc50764aa89140e587489e2d88" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9"
I20250830 07:54:37.853413 13486 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "861809cc50764aa89140e587489e2d88" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:54:37.853574 13625 raft_consensus.cc:3058] T 861809cc50764aa89140e587489e2d88 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:37.853603 13486 raft_consensus.cc:2466] T 861809cc50764aa89140e587489e2d88 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 0.
I20250830 07:54:37.853628 14385 leader_election.cc:290] T 861809cc50764aa89140e587489e2d88 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Requested vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
I20250830 07:54:37.854315 13486 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "008827b3d09d464b9182fb42dc2170d5" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba"
I20250830 07:54:37.854964 13486 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "861809cc50764aa89140e587489e2d88" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba"
I20250830 07:54:37.855137 13486 raft_consensus.cc:3058] T 861809cc50764aa89140e587489e2d88 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:37.856418 13625 raft_consensus.cc:2466] T 861809cc50764aa89140e587489e2d88 P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 1.
I20250830 07:54:37.857724 13229 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_3dd5954f874245b0969d023030dec5a2" } modify_external_catalogs: true
I20250830 07:54:37.857805 13703 leader_election.cc:304] T 861809cc50764aa89140e587489e2d88 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f; no voters:
I20250830 07:54:37.857910 13229 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_3dd5954f874245b0969d023030dec5a2" } modify_external_catalogs: true
I20250830 07:54:37.858309 13486 raft_consensus.cc:2466] T 861809cc50764aa89140e587489e2d88 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 1.
I20250830 07:54:37.858340 14315 raft_consensus.cc:2802] T 861809cc50764aa89140e587489e2d88 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election won for term 1
I20250830 07:54:37.858477 14315 raft_consensus.cc:695] T 861809cc50764aa89140e587489e2d88 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 LEADER]: Becoming Leader. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Running, Role: LEADER
I20250830 07:54:37.858743 14315 consensus_queue.cc:237] T 861809cc50764aa89140e587489e2d88 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:54:37.861616 13882 tablet_bootstrap.cc:492] T 48b422b125154fbdbb9c995dc372d128 P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:54:37.861774 13882 ts_tablet_manager.cc:1397] T 48b422b125154fbdbb9c995dc372d128 P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.057s user 0.003s sys 0.001s
I20250830 07:54:37.862506 13882 raft_consensus.cc:357] T 48b422b125154fbdbb9c995dc372d128 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:54:37.862682 13882 raft_consensus.cc:383] T 48b422b125154fbdbb9c995dc372d128 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:37.862747 13882 raft_consensus.cc:738] T 48b422b125154fbdbb9c995dc372d128 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:54:37.862990 13882 consensus_queue.cc:260] T 48b422b125154fbdbb9c995dc372d128 P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:54:37.863508 13882 ts_tablet_manager.cc:1428] T 48b422b125154fbdbb9c995dc372d128 P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20250830 07:54:37.863761 13882 tablet_bootstrap.cc:492] T 05da843c0fe4482a926e410e06b22461 P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:54:37.863834 13886 tablet_bootstrap.cc:492] T d912c69d8722403aa56cbbde4ce59782 P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:54:37.863963 13886 ts_tablet_manager.cc:1397] T d912c69d8722403aa56cbbde4ce59782 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.058s user 0.004s sys 0.000s
I20250830 07:54:37.865260 13882 tablet_bootstrap.cc:654] T 05da843c0fe4482a926e410e06b22461 P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:37.866096 13226 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_1c1a8a41b5bc44b6b33f0d33246d5d56"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250830 07:54:37.866640 13228 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_12c9ea9f75c24214838d600088c31bcf" } modify_external_catalogs: true
W20250830 07:54:37.866709 13226 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1c1a8a41b5bc44b6b33f0d33246d5d56 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:37.866852 13228 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_12c9ea9f75c24214838d600088c31bcf" } modify_external_catalogs: true
I20250830 07:54:37.867529 13225 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_fa57cb9f83e84e42b79e2f78096a8c78" } modify_external_catalogs: true
I20250830 07:54:37.867714 13225 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_fa57cb9f83e84e42b79e2f78096a8c78" } modify_external_catalogs: true
I20250830 07:54:37.871114 13227 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_1f9c1593bbe849a691399e175b9555b7" } new_table_name: "default.Table_65ab52329c314c13817e7261f5108188" modify_external_catalogs: true
I20250830 07:54:37.871007 13886 raft_consensus.cc:357] T d912c69d8722403aa56cbbde4ce59782 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
W20250830 07:54:37.872606 13233 catalog_manager.cc:5415] Ignoring report from unknown tablet 008827b3d09d464b9182fb42dc2170d5
I20250830 07:54:37.872083 13886 raft_consensus.cc:383] T d912c69d8722403aa56cbbde4ce59782 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:37.873077 13886 raft_consensus.cc:738] T d912c69d8722403aa56cbbde4ce59782 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:54:37.873340 13886 consensus_queue.cc:260] T d912c69d8722403aa56cbbde4ce59782 P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:54:37.873456 13232 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_dc8706b84cd24906a5a3aae9f96e909e" } new_table_name: "default.Table_86c9025e70234ffeb1cafaac64f9b691" modify_external_catalogs: true
I20250830 07:54:37.875684 13886 ts_tablet_manager.cc:1428] T d912c69d8722403aa56cbbde4ce59782 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.012s user 0.002s sys 0.000s
I20250830 07:54:37.876510 13886 tablet_bootstrap.cc:492] T d4e35395930f4c37b34649da5718aa1f P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:54:37.878712 13886 tablet_bootstrap.cc:654] T d4e35395930f4c37b34649da5718aa1f P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:37.881619 13882 tablet_bootstrap.cc:492] T 05da843c0fe4482a926e410e06b22461 P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:54:37.881922 13882 ts_tablet_manager.cc:1397] T 05da843c0fe4482a926e410e06b22461 P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.018s user 0.003s sys 0.005s
I20250830 07:54:37.879601 13820 heartbeater.cc:344] Connected to a master server at 127.12.209.60:43889
W20250830 07:54:37.882441 13233 catalog_manager.cc:5415] Ignoring report from unknown tablet ed87c6793dd149a6a363f1977d816628
W20250830 07:54:37.883337 13231 catalog_manager.cc:5415] Ignoring report from unknown tablet ed87c6793dd149a6a363f1977d816628
I20250830 07:54:37.883587 13882 raft_consensus.cc:357] T 05da843c0fe4482a926e410e06b22461 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:54:37.884078 13882 raft_consensus.cc:383] T 05da843c0fe4482a926e410e06b22461 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:37.884274 13882 raft_consensus.cc:738] T 05da843c0fe4482a926e410e06b22461 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:54:37.884670 13882 consensus_queue.cc:260] T 05da843c0fe4482a926e410e06b22461 P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:54:37.885831 13882 ts_tablet_manager.cc:1428] T 05da843c0fe4482a926e410e06b22461 P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20250830 07:54:37.887148 13882 tablet_bootstrap.cc:492] T d4e35395930f4c37b34649da5718aa1f P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
W20250830 07:54:37.891203 13233 catalog_manager.cc:5415] Ignoring report from unknown tablet 05da843c0fe4482a926e410e06b22461
W20250830 07:54:37.891395 13233 catalog_manager.cc:5415] Ignoring report from unknown tablet ed87c6793dd149a6a363f1977d816628
I20250830 07:54:37.893857 13882 tablet_bootstrap.cc:654] T d4e35395930f4c37b34649da5718aa1f P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:37.900117 14360 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3ea183a890b84f408b20b55e9eb7c7ed: Bootstrap replayed 1/1 log segments. Stats: ops{read=39 overwritten=0 applied=37 ignored=0} inserts{seen=37 ignored=0} mutations{seen=26 ignored=0} orphaned_commits=0. Pending: 2 replicates
I20250830 07:54:37.901638 13886 tablet_bootstrap.cc:492] T d4e35395930f4c37b34649da5718aa1f P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:54:37.901851 13886 ts_tablet_manager.cc:1397] T d4e35395930f4c37b34649da5718aa1f P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.025s user 0.004s sys 0.006s
I20250830 07:54:37.902395 14360 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3ea183a890b84f408b20b55e9eb7c7ed: Bootstrap complete.
I20250830 07:54:37.902653 13886 raft_consensus.cc:357] T d4e35395930f4c37b34649da5718aa1f P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:37.903630 13886 raft_consensus.cc:383] T d4e35395930f4c37b34649da5718aa1f P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:37.903877 13886 raft_consensus.cc:738] T d4e35395930f4c37b34649da5718aa1f P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:54:37.904322 13886 consensus_queue.cc:260] T d4e35395930f4c37b34649da5718aa1f P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:37.905329 13886 ts_tablet_manager.cc:1428] T d4e35395930f4c37b34649da5718aa1f P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20250830 07:54:37.907433 13233 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_e6df4c4dda3c4a549f671ade119cc38c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:37.908201 13233 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e6df4c4dda3c4a549f671ade119cc38c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:37.908573 13882 tablet_bootstrap.cc:492] T d4e35395930f4c37b34649da5718aa1f P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:54:37.908851 13882 ts_tablet_manager.cc:1397] T d4e35395930f4c37b34649da5718aa1f P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.022s user 0.004s sys 0.002s
I20250830 07:54:37.910714 13882 raft_consensus.cc:357] T d4e35395930f4c37b34649da5718aa1f P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:37.911085 13882 raft_consensus.cc:383] T d4e35395930f4c37b34649da5718aa1f P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:37.911227 13882 raft_consensus.cc:738] T d4e35395930f4c37b34649da5718aa1f P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:54:37.911612 13882 consensus_queue.cc:260] T d4e35395930f4c37b34649da5718aa1f P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:37.912876 13887 tablet_bootstrap.cc:492] T 27da527d9fe045ae8c17f193d034f5ac P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:54:37.912828 13230 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_b40dad149c2d4efe8abbd16dacb9092f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250830 07:54:37.913153 13886 tablet_bootstrap.cc:492] T 7238db7e31484201a30cf4c035d82aff P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:54:37.913178 13887 ts_tablet_manager.cc:1397] T 27da527d9fe045ae8c17f193d034f5ac P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.313s user 0.006s sys 0.006s
W20250830 07:54:37.913374 13230 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b40dad149c2d4efe8abbd16dacb9092f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:37.913640 13882 ts_tablet_manager.cc:1428] T d4e35395930f4c37b34649da5718aa1f P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.005s user 0.003s sys 0.000s
I20250830 07:54:37.914103 13887 raft_consensus.cc:357] T 27da527d9fe045ae8c17f193d034f5ac P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:37.914327 13887 raft_consensus.cc:383] T 27da527d9fe045ae8c17f193d034f5ac P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:37.914446 13887 raft_consensus.cc:738] T 27da527d9fe045ae8c17f193d034f5ac P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:54:37.914768 13882 tablet_bootstrap.cc:492] T bee1b5f6f04740dba64cdcb094e26113 P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:54:37.914675 13887 consensus_queue.cc:260] T 27da527d9fe045ae8c17f193d034f5ac P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:37.915355 13887 ts_tablet_manager.cc:1428] T 27da527d9fe045ae8c17f193d034f5ac P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20250830 07:54:37.915663 13887 tablet_bootstrap.cc:492] T c3b35ea656db4741a02e6746e1b049ec P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:54:37.917522 14315 consensus_queue.cc:1035] T 6f2d855ab3c04123b2f9ea22cda6ef04 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:54:37.920543 13882 tablet_bootstrap.cc:654] T bee1b5f6f04740dba64cdcb094e26113 P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:37.927515 14315 raft_consensus.cc:491] T d912c69d8722403aa56cbbde4ce59782 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:37.927676 14315 raft_consensus.cc:513] T d912c69d8722403aa56cbbde4ce59782 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:54:37.928359 14315 leader_election.cc:290] T d912c69d8722403aa56cbbde4ce59782 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
I20250830 07:54:37.931263 13228 catalog_manager.cc:5864] Not sending DeleteTablet requests; no consensus state for tablet d2f842d4367145108aa9ebe78828d6b0
I20250830 07:54:37.931658 13228 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_2c14c2548447473a998f5b39993d1b72"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:37.932293 13228 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2c14c2548447473a998f5b39993d1b72 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250830 07:54:37.933858 13227 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet aee84a97524e4568acdc4ae1c74fb492 has no consensus state
I20250830 07:54:37.934263 13227 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_10814d96e8104432b92e4084232ada15"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250830 07:54:37.934610 13886 tablet_bootstrap.cc:654] T 7238db7e31484201a30cf4c035d82aff P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
W20250830 07:54:37.934823 13227 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_10814d96e8104432b92e4084232ada15 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250830 07:54:37.936107 13232 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet c8bc6e07377a4ba99c39a909dae11402 has no consensus state
I20250830 07:54:37.936493 13232 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_83d1032daed546d9ac781ef43a37179b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:37.937037 13232 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_83d1032daed546d9ac781ef43a37179b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:37.940274 13230 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_da489b0caa4241ce9aeabe907212bd0b" } new_table_name: "default.Table_e40b329adbd0475da2669620084f75f3" modify_external_catalogs: true
I20250830 07:54:37.941817 13226 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_8edbcf7950a04e75982f77c91ac9ff84"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:37.942283 13226 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8edbcf7950a04e75982f77c91ac9ff84 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:37.938643 14360 raft_consensus.cc:357] T 00000000000000000000000000000000 P 3ea183a890b84f408b20b55e9eb7c7ed [term 2 FOLLOWER]: Replica starting. Triggering 2 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fea6152429cc4e79a25b18e02aafae57" member_type: VOTER last_known_addr { host: "127.12.209.62" port: 39725 } } peers { permanent_uuid: "5e9d6449ae824acab24c459a72075e88" member_type: VOTER last_known_addr { host: "127.12.209.61" port: 44241 } } peers { permanent_uuid: "3ea183a890b84f408b20b55e9eb7c7ed" member_type: VOTER last_known_addr { host: "127.12.209.60" port: 43889 } }
I20250830 07:54:37.944298 13229 catalog_manager.cc:5864] Not sending DeleteTablet requests; no consensus state for tablet 96429e16495e481da2742c89612a3ea0
I20250830 07:54:37.944648 13229 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_87164c8c18154ed0853e069939e9025c" } new_table_name: "default.Table_85e7f0b13c094fd7841dcabce61fd911" modify_external_catalogs: true
I20250830 07:54:37.947211 13225 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet e66e56ecdf14466282daab8c894eb3c6
I20250830 07:54:37.948330 13605 tablet_service.cc:1515] Processing DeleteTablet for tablet e66e56ecdf14466282daab8c894eb3c6 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:37 UTC) from {username='slave'} at 127.0.0.1:45306
W20250830 07:54:37.949062 13220 catalog_manager.cc:4908] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet e66e56ecdf14466282daab8c894eb3c6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e66e56ecdf14466282daab8c894eb3c6 already in progress: creating tablet
I20250830 07:54:37.950421 13752 tablet_service.cc:1515] Processing DeleteTablet for tablet e66e56ecdf14466282daab8c894eb3c6 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:37 UTC) from {username='slave'} at 127.0.0.1:45460
W20250830 07:54:37.951395 13234 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.12.209.1:41421 (request call id 52) took 791 ms (client timeout 1000 ms). Trace:
W20250830 07:54:37.951514 13234 rpcz_store.cc:269] 0830 07:54:37.159552 (+ 0us) service_pool.cc:168] Inserting onto call queue
0830 07:54:37.160897 (+ 1345us) service_pool.cc:225] Handling call
0830 07:54:37.163482 (+ 2585us) spinlock_profiling.cc:243] Waited 1.88 ms on lock 0x616000040f54. stack: 00007f4985b867d6 00007f4985b86590 00007f4984b793ad 0000000000972d94 0000000000972d5d 00007f499495114d 00007f4994951243 00007f4991610941 00007f499919ba5d 00007f499931f6d8 00007f4990159c86 00007f49901599b5 00007f498c9342ce 00007f498c9331ae 00007f498c9393e5 00007f498c939d0f
0830 07:54:37.951337 (+787855us) inbound_call.cc:173] Queueing success response
Metrics: {"reported_tablets":3,"spinlock_wait_cycles":4333312}
I20250830 07:54:37.951690 13225 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_de8e8221990d4aed88566a552450af56"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:37.954066 13225 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_de8e8221990d4aed88566a552450af56 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:37.956897 13752 tablet_service.cc:1515] Processing DeleteTablet for tablet d912c69d8722403aa56cbbde4ce59782 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:35 UTC) from {username='slave'} at 127.0.0.1:45460
I20250830 07:54:37.957193 13884 tablet_replica.cc:331] T d912c69d8722403aa56cbbde4ce59782 P 9b057ade5dce45af9f8bf0bedf8b917f: stopping tablet replica
I20250830 07:54:37.957412 13884 raft_consensus.cc:2241] T d912c69d8722403aa56cbbde4ce59782 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Raft consensus shutting down.
I20250830 07:54:37.957600 13884 raft_consensus.cc:2270] T d912c69d8722403aa56cbbde4ce59782 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Raft consensus is shut down!
W20250830 07:54:37.957965 13219 catalog_manager.cc:4908] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): delete failed for tablet e66e56ecdf14466282daab8c894eb3c6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e66e56ecdf14466282daab8c894eb3c6 already in progress: creating tablet
I20250830 07:54:37.958473 13629 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "d912c69d8722403aa56cbbde4ce59782" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
W20250830 07:54:37.961452 13703 leader_election.cc:343] T d912c69d8722403aa56cbbde4ce59782 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:37.963433 13884 ts_tablet_manager.cc:1905] T d912c69d8722403aa56cbbde4ce59782 P 9b057ade5dce45af9f8bf0bedf8b917f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250830 07:54:37.963510 14401 raft_consensus.cc:491] T 2009012fddc24e4fb7ad0fab33a1103b P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:37.963657 14401 raft_consensus.cc:513] T 2009012fddc24e4fb7ad0fab33a1103b P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:54:37.964310 14401 leader_election.cc:290] T 2009012fddc24e4fb7ad0fab33a1103b P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:37.965214 13629 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "2009012fddc24e4fb7ad0fab33a1103b" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
W20250830 07:54:37.965759 13423 leader_election.cc:343] T 2009012fddc24e4fb7ad0fab33a1103b P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
W20250830 07:54:37.966034 13233 catalog_manager.cc:5415] Ignoring report from unknown tablet 861809cc50764aa89140e587489e2d88
W20250830 07:54:37.971207 13229 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ff72a0fd9a0e46a6bd54a15e4ad783b4 has no consensus state
W20250830 07:54:37.972193 13230 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 29f0695563854e45965a1cc36ac54138 consensus state has no leader
I20250830 07:54:37.974678 14360 raft_consensus.cc:738] T 00000000000000000000000000000000 P 3ea183a890b84f408b20b55e9eb7c7ed [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea183a890b84f408b20b55e9eb7c7ed, State: Initialized, Role: FOLLOWER
I20250830 07:54:37.978752 13884 ts_tablet_manager.cc:1918] T d912c69d8722403aa56cbbde4ce59782 P 9b057ade5dce45af9f8bf0bedf8b917f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250830 07:54:37.978961 13884 log.cc:1199] T d912c69d8722403aa56cbbde4ce59782 P 9b057ade5dce45af9f8bf0bedf8b917f: Deleting WAL directory at /tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/ts-2/wal/wals/d912c69d8722403aa56cbbde4ce59782
I20250830 07:54:37.979386 13884 ts_tablet_manager.cc:1939] T d912c69d8722403aa56cbbde4ce59782 P 9b057ade5dce45af9f8bf0bedf8b917f: Deleting consensus metadata
I20250830 07:54:37.980142 13219 catalog_manager.cc:4928] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): tablet d912c69d8722403aa56cbbde4ce59782 (table default.Table_fd6941613dcf424583ca9f728fd345dd [id=1b6e4f675c3749ac94e3e7a84d1cf5da]) successfully deleted
I20250830 07:54:37.980537 14315 raft_consensus.cc:491] T bee1b5f6f04740dba64cdcb094e26113 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:37.980686 14315 raft_consensus.cc:513] T bee1b5f6f04740dba64cdcb094e26113 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:54:37.981308 14315 leader_election.cc:290] T bee1b5f6f04740dba64cdcb094e26113 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
I20250830 07:54:37.982460 14360 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3ea183a890b84f408b20b55e9eb7c7ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 37, Last appended: 2.39, Last appended by leader: 39, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fea6152429cc4e79a25b18e02aafae57" member_type: VOTER last_known_addr { host: "127.12.209.62" port: 39725 } } peers { permanent_uuid: "5e9d6449ae824acab24c459a72075e88" member_type: VOTER last_known_addr { host: "127.12.209.61" port: 44241 } } peers { permanent_uuid: "3ea183a890b84f408b20b55e9eb7c7ed" member_type: VOTER last_known_addr { host: "127.12.209.60" port: 43889 } }
I20250830 07:54:37.983574 13629 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "bee1b5f6f04740dba64cdcb094e26113" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
W20250830 07:54:37.984256 13703 leader_election.cc:343] T bee1b5f6f04740dba64cdcb094e26113 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:37.984337 14424 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3ea183a890b84f408b20b55e9eb7c7ed [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fea6152429cc4e79a25b18e02aafae57" member_type: VOTER last_known_addr { host: "127.12.209.62" port: 39725 } } peers { permanent_uuid: "5e9d6449ae824acab24c459a72075e88" member_type: VOTER last_known_addr { host: "127.12.209.61" port: 44241 } } peers { permanent_uuid: "3ea183a890b84f408b20b55e9eb7c7ed" member_type: VOTER last_known_addr { host: "127.12.209.60" port: 43889 } } }
I20250830 07:54:37.984813 14424 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3ea183a890b84f408b20b55e9eb7c7ed [sys.catalog]: This master's current role is: FOLLOWER
I20250830 07:54:37.985606 14315 consensus_queue.cc:1035] T 6f2d855ab3c04123b2f9ea22cda6ef04 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20250830 07:54:37.986398 13701 leader_election.cc:343] T 008827b3d09d464b9182fb42dc2170d5 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:37.986924 14315 consensus_queue.cc:1035] T 1476bb480bf747838613948875001c30 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20250830 07:54:37.987757 13701 leader_election.cc:343] T 5aef6fd239ba43478cd978fa5d29b26e P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): Not found: Tablet not found: 5aef6fd239ba43478cd978fa5d29b26e
I20250830 07:54:37.987928 13701 leader_election.cc:304] T 5aef6fd239ba43478cd978fa5d29b26e P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 2065c332f15a4739899af79f3669c3ba, 6b5e454d98894637b466ea27f1b647f9
I20250830 07:54:37.988463 14315 raft_consensus.cc:2747] T 5aef6fd239ba43478cd978fa5d29b26e P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:54:37.988965 13886 tablet_bootstrap.cc:492] T 7238db7e31484201a30cf4c035d82aff P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
W20250830 07:54:37.989214 13701 leader_election.cc:343] T 008827b3d09d464b9182fb42dc2170d5 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:37.989257 13886 ts_tablet_manager.cc:1397] T 7238db7e31484201a30cf4c035d82aff P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.076s user 0.003s sys 0.003s
I20250830 07:54:37.990130 13954 raft_consensus.cc:491] T d912c69d8722403aa56cbbde4ce59782 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:37.990279 13954 raft_consensus.cc:513] T d912c69d8722403aa56cbbde4ce59782 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:54:37.990645 14401 raft_consensus.cc:491] T 05da843c0fe4482a926e410e06b22461 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:37.990790 14401 raft_consensus.cc:513] T 05da843c0fe4482a926e410e06b22461 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:54:37.991091 13886 raft_consensus.cc:357] T 7238db7e31484201a30cf4c035d82aff P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:54:37.991394 13886 raft_consensus.cc:383] T 7238db7e31484201a30cf4c035d82aff P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:37.991446 14401 leader_election.cc:290] T 05da843c0fe4482a926e410e06b22461 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:37.991642 13886 raft_consensus.cc:738] T 7238db7e31484201a30cf4c035d82aff P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:54:37.992070 13886 consensus_queue.cc:260] T 7238db7e31484201a30cf4c035d82aff P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:54:37.992364 14360 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3ea183a890b84f408b20b55e9eb7c7ed [sys.catalog]: configured and running, proceeding with master startup.
I20250830 07:54:37.992612 13954 leader_election.cc:290] T d912c69d8722403aa56cbbde4ce59782 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:37.996155 13628 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "d912c69d8722403aa56cbbde4ce59782" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
W20250830 07:54:38.000548 13423 leader_election.cc:343] T d912c69d8722403aa56cbbde4ce59782 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:38.004742 13886 ts_tablet_manager.cc:1428] T 7238db7e31484201a30cf4c035d82aff P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.015s user 0.000s sys 0.002s
I20250830 07:54:38.005117 13886 tablet_bootstrap.cc:492] T 05da843c0fe4482a926e410e06b22461 P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:54:38.008833 13886 tablet_bootstrap.cc:654] T 05da843c0fe4482a926e410e06b22461 P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:38.011967 13629 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "05da843c0fe4482a926e410e06b22461" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:38.012259 13629 raft_consensus.cc:2466] T 05da843c0fe4482a926e410e06b22461 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2065c332f15a4739899af79f3669c3ba in term 0.
I20250830 07:54:38.012682 13423 leader_election.cc:304] T 05da843c0fe4482a926e410e06b22461 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 6b5e454d98894637b466ea27f1b647f9; no voters:
I20250830 07:54:38.012984 13954 raft_consensus.cc:2802] T 05da843c0fe4482a926e410e06b22461 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:54:38.013085 13954 raft_consensus.cc:491] T 05da843c0fe4482a926e410e06b22461 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:54:38.013170 13954 raft_consensus.cc:3058] T 05da843c0fe4482a926e410e06b22461 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:38.013723 14401 raft_consensus.cc:491] T cada6410e2884c508bb7dd38bea438ae P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:38.013880 14401 raft_consensus.cc:513] T cada6410e2884c508bb7dd38bea438ae P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:38.014472 14401 leader_election.cc:290] T cada6410e2884c508bb7dd38bea438ae P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:38.016798 13954 raft_consensus.cc:513] T 05da843c0fe4482a926e410e06b22461 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:54:38.017665 13954 leader_election.cc:290] T 05da843c0fe4482a926e410e06b22461 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 election: Requested vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:38.017825 13629 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "cada6410e2884c508bb7dd38bea438ae" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:38.017871 13628 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "05da843c0fe4482a926e410e06b22461" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9"
I20250830 07:54:38.018074 13628 raft_consensus.cc:3058] T 05da843c0fe4482a926e410e06b22461 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:38.018368 13954 raft_consensus.cc:491] T 91ab8c468c8143b9ae11b839a95a26fd P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:38.018486 13954 raft_consensus.cc:513] T 91ab8c468c8143b9ae11b839a95a26fd P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:38.019029 13954 leader_election.cc:290] T 91ab8c468c8143b9ae11b839a95a26fd P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:38.019532 13954 raft_consensus.cc:491] T b480f5eb03804baeb61cd0424d70faf5 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:38.019915 13954 raft_consensus.cc:513] T b480f5eb03804baeb61cd0424d70faf5 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
W20250830 07:54:38.020320 13423 leader_election.cc:343] T cada6410e2884c508bb7dd38bea438ae P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:38.020781 13628 raft_consensus.cc:2466] T 05da843c0fe4482a926e410e06b22461 P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2065c332f15a4739899af79f3669c3ba in term 1.
I20250830 07:54:38.020808 13954 leader_election.cc:290] T b480f5eb03804baeb61cd0424d70faf5 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:38.021232 13628 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "b480f5eb03804baeb61cd0424d70faf5" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:38.021855 13459 tablet_service.cc:1515] Processing DeleteTablet for tablet e66e56ecdf14466282daab8c894eb3c6 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:37 UTC) from {username='slave'} at 127.0.0.1:37956
I20250830 07:54:38.022140 13461 tablet_service.cc:1515] Processing DeleteTablet for tablet d912c69d8722403aa56cbbde4ce59782 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:35 UTC) from {username='slave'} at 127.0.0.1:37956
I20250830 07:54:38.022524 13485 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "d912c69d8722403aa56cbbde4ce59782" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:54:38.022722 13485 raft_consensus.cc:2466] T d912c69d8722403aa56cbbde4ce59782 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 0.
I20250830 07:54:38.023140 13883 tablet_replica.cc:331] T d912c69d8722403aa56cbbde4ce59782 P 2065c332f15a4739899af79f3669c3ba: stopping tablet replica
I20250830 07:54:38.023344 13883 raft_consensus.cc:2241] T d912c69d8722403aa56cbbde4ce59782 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Raft consensus shutting down.
I20250830 07:54:38.023520 13883 raft_consensus.cc:2270] T d912c69d8722403aa56cbbde4ce59782 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Raft consensus is shut down!
I20250830 07:54:38.024103 13883 ts_tablet_manager.cc:1905] T d912c69d8722403aa56cbbde4ce59782 P 2065c332f15a4739899af79f3669c3ba: Deleting tablet data with delete state TABLET_DATA_DELETED
W20250830 07:54:38.026741 13218 catalog_manager.cc:4908] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): delete failed for tablet e66e56ecdf14466282daab8c894eb3c6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e66e56ecdf14466282daab8c894eb3c6 already in progress: creating tablet
I20250830 07:54:38.027086 13423 leader_election.cc:304] T 05da843c0fe4482a926e410e06b22461 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 6b5e454d98894637b466ea27f1b647f9; no voters:
I20250830 07:54:38.027081 13486 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "bee1b5f6f04740dba64cdcb094e26113" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:54:38.028626 13701 leader_election.cc:304] T d912c69d8722403aa56cbbde4ce59782 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
W20250830 07:54:38.028869 13701 raft_consensus.cc:2684] T d912c69d8722403aa56cbbde4ce59782 P 9b057ade5dce45af9f8bf0bedf8b917f: unable to run election callback: Service unavailable: Thread pool token was shut down
I20250830 07:54:38.029949 13771 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "05da843c0fe4482a926e410e06b22461" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:38.030320 13486 raft_consensus.cc:2466] T bee1b5f6f04740dba64cdcb094e26113 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 0.
I20250830 07:54:38.031430 13771 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "cada6410e2884c508bb7dd38bea438ae" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:38.031760 13775 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "b480f5eb03804baeb61cd0424d70faf5" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
W20250830 07:54:38.032091 13423 leader_election.cc:343] T b480f5eb03804baeb61cd0424d70faf5 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:38.032749 13773 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "91ab8c468c8143b9ae11b839a95a26fd" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:38.033051 13772 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "05da843c0fe4482a926e410e06b22461" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f"
I20250830 07:54:38.035040 13629 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "91ab8c468c8143b9ae11b839a95a26fd" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:38.035326 13226 master_service.cc:948] ReplaceTablet: received request to replace tablet ffc5945a032e47d4bd3397d7c887dc62 from {username='slave'} at 127.0.0.1:42126
I20250830 07:54:38.037771 13228 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_8b26aa88b9f34e35ac10a238c1b2b2a1" } modify_external_catalogs: true
I20250830 07:54:38.037973 13228 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_8b26aa88b9f34e35ac10a238c1b2b2a1" } modify_external_catalogs: true
I20250830 07:54:38.039019 14038 raft_consensus.cc:491] T 7238db7e31484201a30cf4c035d82aff P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:38.039222 14038 raft_consensus.cc:513] T 7238db7e31484201a30cf4c035d82aff P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:54:38.039896 14038 leader_election.cc:290] T 7238db7e31484201a30cf4c035d82aff P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:38.040001 14401 raft_consensus.cc:2802] T 05da843c0fe4482a926e410e06b22461 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election won for term 1
W20250830 07:54:38.040696 13227 catalog_manager.cc:5415] Ignoring report from unknown tablet 6f2d855ab3c04123b2f9ea22cda6ef04
I20250830 07:54:38.040704 14401 raft_consensus.cc:695] T 05da843c0fe4482a926e410e06b22461 P 2065c332f15a4739899af79f3669c3ba [term 1 LEADER]: Becoming Leader. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Running, Role: LEADER
W20250830 07:54:38.040830 13227 catalog_manager.cc:5415] Ignoring report from unknown tablet 05da843c0fe4482a926e410e06b22461
I20250830 07:54:38.040951 14401 consensus_queue.cc:237] T 05da843c0fe4482a926e410e06b22461 P 2065c332f15a4739899af79f3669c3ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
W20250830 07:54:38.048188 13423 leader_election.cc:343] T 91ab8c468c8143b9ae11b839a95a26fd P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:38.048408 13232 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_adcde1613f434b17902b76d35e532dd3" } modify_external_catalogs: true
I20250830 07:54:38.048653 13232 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_adcde1613f434b17902b76d35e532dd3" } modify_external_catalogs: true
I20250830 07:54:38.041448 13625 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "7238db7e31484201a30cf4c035d82aff" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:38.048978 13625 raft_consensus.cc:2466] T 7238db7e31484201a30cf4c035d82aff P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2065c332f15a4739899af79f3669c3ba in term 0.
I20250830 07:54:38.049348 13230 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_1c93edc0678341fea10a950688a68c08"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:38.050120 13230 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1c93edc0678341fea10a950688a68c08 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:38.050679 13423 leader_election.cc:304] T 7238db7e31484201a30cf4c035d82aff P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 6b5e454d98894637b466ea27f1b647f9; no voters:
I20250830 07:54:38.051034 14038 raft_consensus.cc:2802] T 7238db7e31484201a30cf4c035d82aff P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:54:38.051120 14038 raft_consensus.cc:491] T 7238db7e31484201a30cf4c035d82aff P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:54:38.051223 14038 raft_consensus.cc:3058] T 7238db7e31484201a30cf4c035d82aff P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:38.055799 14038 raft_consensus.cc:513] T 7238db7e31484201a30cf4c035d82aff P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:54:38.056574 14038 leader_election.cc:290] T 7238db7e31484201a30cf4c035d82aff P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 election: Requested vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:38.057183 13629 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "7238db7e31484201a30cf4c035d82aff" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9"
I20250830 07:54:38.059167 13225 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_378bc8a57a1d461abd6da90d53bd2be3" } new_table_name: "default.Table_d49f355c492e4edead23a073107e2bec" modify_external_catalogs: true
I20250830 07:54:38.059275 13229 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_ceb6b6a4e5014de182da8b467ca360f1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:38.059829 13229 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ceb6b6a4e5014de182da8b467ca360f1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:38.060096 13629 raft_consensus.cc:3058] T 7238db7e31484201a30cf4c035d82aff P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:38.062170 13883 ts_tablet_manager.cc:1918] T d912c69d8722403aa56cbbde4ce59782 P 2065c332f15a4739899af79f3669c3ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250830 07:54:38.062346 13883 log.cc:1199] T d912c69d8722403aa56cbbde4ce59782 P 2065c332f15a4739899af79f3669c3ba: Deleting WAL directory at /tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/ts-0/wal/wals/d912c69d8722403aa56cbbde4ce59782
I20250830 07:54:38.062736 13883 ts_tablet_manager.cc:1939] T d912c69d8722403aa56cbbde4ce59782 P 2065c332f15a4739899af79f3669c3ba: Deleting consensus metadata
I20250830 07:54:38.066660 13629 raft_consensus.cc:2466] T 7238db7e31484201a30cf4c035d82aff P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2065c332f15a4739899af79f3669c3ba in term 1.
I20250830 07:54:38.080027 13886 tablet_bootstrap.cc:492] T 05da843c0fe4482a926e410e06b22461 P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:54:38.080377 13886 ts_tablet_manager.cc:1397] T 05da843c0fe4482a926e410e06b22461 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.075s user 0.002s sys 0.004s
I20250830 07:54:38.081228 13886 raft_consensus.cc:357] T 05da843c0fe4482a926e410e06b22461 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:54:38.081524 13886 raft_consensus.cc:383] T 05da843c0fe4482a926e410e06b22461 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:38.081646 13886 raft_consensus.cc:738] T 05da843c0fe4482a926e410e06b22461 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:54:38.081950 13886 consensus_queue.cc:260] T 05da843c0fe4482a926e410e06b22461 P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:54:38.082118 13887 tablet_bootstrap.cc:654] T c3b35ea656db4741a02e6746e1b049ec P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:38.082741 13886 ts_tablet_manager.cc:1428] T 05da843c0fe4482a926e410e06b22461 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20250830 07:54:38.083177 13886 tablet_bootstrap.cc:492] T 91ab8c468c8143b9ae11b839a95a26fd P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:54:38.085057 13886 tablet_bootstrap.cc:654] T 91ab8c468c8143b9ae11b839a95a26fd P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
W20250830 07:54:38.087337 13422 leader_election.cc:343] T 05da843c0fe4482a926e410e06b22461 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Illegal state: must be running to vote when last-logged opid is not known
W20250830 07:54:38.088946 13129 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerService.ListTablets -> {remote=127.12.209.2:38967, user_credentials={real_user=slave}} blocked reactor thread for 61366.3us
I20250830 07:54:38.099131 13231 master_service.cc:948] ReplaceTablet: received request to replace tablet 7c8e248d938f4651ae13199122b08768 from {username='slave'} at 127.0.0.1:42126
W20250830 07:54:38.099773 13422 leader_election.cc:343] T 2009012fddc24e4fb7ad0fab33a1103b P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Not found: Tablet not found: 2009012fddc24e4fb7ad0fab33a1103b
I20250830 07:54:38.099931 13422 leader_election.cc:304] T 2009012fddc24e4fb7ad0fab33a1103b P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba; no voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:54:38.100198 14038 raft_consensus.cc:2747] T 2009012fddc24e4fb7ad0fab33a1103b P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20250830 07:54:38.100306 13422 leader_election.cc:343] T cada6410e2884c508bb7dd38bea438ae P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:38.100407 13422 leader_election.cc:304] T cada6410e2884c508bb7dd38bea438ae P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba; no voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:54:38.100607 14038 raft_consensus.cc:2747] T cada6410e2884c508bb7dd38bea438ae P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20250830 07:54:38.100697 13422 leader_election.cc:343] T b480f5eb03804baeb61cd0424d70faf5 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:38.100791 13422 leader_election.cc:304] T b480f5eb03804baeb61cd0424d70faf5 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba; no voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:54:38.100983 14038 raft_consensus.cc:2747] T b480f5eb03804baeb61cd0424d70faf5 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:54:38.103678 13886 tablet_bootstrap.cc:492] T 91ab8c468c8143b9ae11b839a95a26fd P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:54:38.103894 13886 ts_tablet_manager.cc:1397] T 91ab8c468c8143b9ae11b839a95a26fd P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.021s user 0.002s sys 0.008s
W20250830 07:54:38.101094 13422 leader_election.cc:343] T d912c69d8722403aa56cbbde4ce59782 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Not found: Tablet not found: d912c69d8722403aa56cbbde4ce59782
I20250830 07:54:38.104713 13422 leader_election.cc:304] T d912c69d8722403aa56cbbde4ce59782 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba; no voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f
W20250830 07:54:38.104930 13422 raft_consensus.cc:2684] T d912c69d8722403aa56cbbde4ce59782 P 2065c332f15a4739899af79f3669c3ba: unable to run election callback: Service unavailable: Thread pool token was shut down
W20250830 07:54:38.105597 13422 leader_election.cc:343] T 91ab8c468c8143b9ae11b839a95a26fd P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:38.105782 13422 leader_election.cc:304] T 91ab8c468c8143b9ae11b839a95a26fd P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba; no voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:54:38.106045 14038 raft_consensus.cc:2747] T 91ab8c468c8143b9ae11b839a95a26fd P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20250830 07:54:38.106431 13422 leader_election.cc:343] T 05da843c0fe4482a926e410e06b22461 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:38.108475 14038 raft_consensus.cc:491] T 27da527d9fe045ae8c17f193d034f5ac P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:38.108657 14038 raft_consensus.cc:513] T 27da527d9fe045ae8c17f193d034f5ac P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:38.109076 13218 catalog_manager.cc:4928] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): tablet d912c69d8722403aa56cbbde4ce59782 (table default.Table_fd6941613dcf424583ca9f728fd345dd [id=1b6e4f675c3749ac94e3e7a84d1cf5da]) successfully deleted
I20250830 07:54:38.109287 14038 leader_election.cc:290] T 27da527d9fe045ae8c17f193d034f5ac P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
W20250830 07:54:38.112090 13229 catalog_manager.cc:5415] Ignoring report from unknown tablet d3b47314f7cd4e969d973c0a340137f1
W20250830 07:54:38.112187 13229 catalog_manager.cc:5415] Ignoring report from unknown tablet 27da527d9fe045ae8c17f193d034f5ac
W20250830 07:54:38.112272 13229 catalog_manager.cc:5415] Ignoring report from unknown tablet afb132e8a5b14a029e005e375f276348
W20250830 07:54:38.112357 13229 catalog_manager.cc:5415] Ignoring report from unknown tablet b480f5eb03804baeb61cd0424d70faf5
W20250830 07:54:38.112397 13229 catalog_manager.cc:5415] Ignoring report from unknown tablet ff0f9cccc8ed43b1a8cd38de0e9d4097
W20250830 07:54:38.112526 13229 catalog_manager.cc:5415] Ignoring report from unknown tablet bee1b5f6f04740dba64cdcb094e26113
W20250830 07:54:38.112583 13229 catalog_manager.cc:5415] Ignoring report from unknown tablet b4ab964a64a64e00a78ffd2b220aef46
W20250830 07:54:38.112665 13229 catalog_manager.cc:5415] Ignoring report from unknown tablet 3167b609ed184decb4ccdb4945933ebb
W20250830 07:54:38.113230 13229 catalog_manager.cc:5415] Ignoring report from unknown tablet 91ab8c468c8143b9ae11b839a95a26fd
W20250830 07:54:38.113312 13229 catalog_manager.cc:5415] Ignoring report from unknown tablet 29d492735cd14bb6b4a2a9a3929f62f3
W20250830 07:54:38.113351 13229 catalog_manager.cc:5415] Ignoring report from unknown tablet 1933d49d319b4bd7b717dda2b83859f3
W20250830 07:54:38.114095 13225 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f0144701d459480d96c1ece519951442 consensus state has no leader
I20250830 07:54:38.115051 13886 raft_consensus.cc:357] T 91ab8c468c8143b9ae11b839a95a26fd P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:38.115257 13886 raft_consensus.cc:383] T 91ab8c468c8143b9ae11b839a95a26fd P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:38.115358 13886 raft_consensus.cc:738] T 91ab8c468c8143b9ae11b839a95a26fd P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:54:38.115578 13701 leader_election.cc:304] T bee1b5f6f04740dba64cdcb094e26113 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:54:38.116722 13774 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "27da527d9fe045ae8c17f193d034f5ac" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:38.117281 14385 raft_consensus.cc:2802] T bee1b5f6f04740dba64cdcb094e26113 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:54:38.117425 14385 raft_consensus.cc:491] T bee1b5f6f04740dba64cdcb094e26113 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:54:38.117528 14385 raft_consensus.cc:3058] T bee1b5f6f04740dba64cdcb094e26113 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:38.120626 14385 raft_consensus.cc:513] T bee1b5f6f04740dba64cdcb094e26113 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:54:38.122043 14385 leader_election.cc:290] T bee1b5f6f04740dba64cdcb094e26113 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Requested vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
I20250830 07:54:38.115578 13886 consensus_queue.cc:260] T 91ab8c468c8143b9ae11b839a95a26fd P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:38.126364 13886 ts_tablet_manager.cc:1428] T 91ab8c468c8143b9ae11b839a95a26fd P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.022s user 0.002s sys 0.000s
I20250830 07:54:38.126672 13886 tablet_bootstrap.cc:492] T afb132e8a5b14a029e005e375f276348 P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:54:38.128763 14385 raft_consensus.cc:491] T 91ab8c468c8143b9ae11b839a95a26fd P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:38.128922 14385 raft_consensus.cc:513] T 91ab8c468c8143b9ae11b839a95a26fd P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:38.129691 14385 leader_election.cc:290] T 91ab8c468c8143b9ae11b839a95a26fd P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967)
I20250830 07:54:38.115649 14315 consensus_queue.cc:1035] T ed87c6793dd149a6a363f1977d816628 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:54:38.116103 13772 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "7238db7e31484201a30cf4c035d82aff" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:38.129910 13772 raft_consensus.cc:2466] T 7238db7e31484201a30cf4c035d82aff P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2065c332f15a4739899af79f3669c3ba in term 0.
I20250830 07:54:38.116571 13773 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "7238db7e31484201a30cf4c035d82aff" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f"
I20250830 07:54:38.130187 13773 raft_consensus.cc:3058] T 7238db7e31484201a30cf4c035d82aff P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:38.132980 13773 raft_consensus.cc:2466] T 7238db7e31484201a30cf4c035d82aff P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2065c332f15a4739899af79f3669c3ba in term 1.
I20250830 07:54:38.133620 13225 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_7abf2e48a940411181ec19ecfe22ce3f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250830 07:54:38.134397 13230 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_78284117ae8d41f7a9404cd74bf3f2a2" } modify_external_catalogs: true
I20250830 07:54:38.134575 13230 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_78284117ae8d41f7a9404cd74bf3f2a2" } modify_external_catalogs: true
I20250830 07:54:38.135244 13234 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_0bdc21c4c56b4f00af7f876cd22a42cb" } new_table_name: "default.Table_54bd02c58de341ec93ced1d662a7e671" modify_external_catalogs: true
I20250830 07:54:38.137226 13886 tablet_bootstrap.cc:654] T afb132e8a5b14a029e005e375f276348 P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:38.139745 13488 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "bee1b5f6f04740dba64cdcb094e26113" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba"
I20250830 07:54:38.140515 13488 raft_consensus.cc:3058] T bee1b5f6f04740dba64cdcb094e26113 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:38.143285 13488 raft_consensus.cc:2466] T bee1b5f6f04740dba64cdcb094e26113 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 1.
I20250830 07:54:38.143792 13488 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "91ab8c468c8143b9ae11b839a95a26fd" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:54:38.144030 13488 raft_consensus.cc:2466] T 91ab8c468c8143b9ae11b839a95a26fd P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 0.
W20250830 07:54:38.148492 13422 leader_election.cc:343] T 27da527d9fe045ae8c17f193d034f5ac P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:38.148907 13422 leader_election.cc:304] T 7238db7e31484201a30cf4c035d82aff P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters:
I20250830 07:54:38.150586 14038 raft_consensus.cc:2802] T 7238db7e31484201a30cf4c035d82aff P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election won for term 1
I20250830 07:54:38.150732 14038 raft_consensus.cc:695] T 7238db7e31484201a30cf4c035d82aff P 2065c332f15a4739899af79f3669c3ba [term 1 LEADER]: Becoming Leader. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Running, Role: LEADER
I20250830 07:54:38.151120 14038 consensus_queue.cc:237] T 7238db7e31484201a30cf4c035d82aff P 2065c332f15a4739899af79f3669c3ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:54:38.084254 13882 tablet_bootstrap.cc:492] T bee1b5f6f04740dba64cdcb094e26113 P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:54:38.087636 14421 raft_consensus.cc:491] T d4e35395930f4c37b34649da5718aa1f P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:38.153628 14421 raft_consensus.cc:513] T d4e35395930f4c37b34649da5718aa1f P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:38.154404 14421 leader_election.cc:290] T d4e35395930f4c37b34649da5718aa1f P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:38.110208 13625 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "27da527d9fe045ae8c17f193d034f5ac" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:38.121965 13628 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "bee1b5f6f04740dba64cdcb094e26113" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9"
I20250830 07:54:38.130293 13627 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "91ab8c468c8143b9ae11b839a95a26fd" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:38.155370 13485 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "d4e35395930f4c37b34649da5718aa1f" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:54:38.155591 13485 raft_consensus.cc:2466] T d4e35395930f4c37b34649da5718aa1f P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b5e454d98894637b466ea27f1b647f9 in term 0.
W20250830 07:54:38.156106 13423 leader_election.cc:343] T 27da527d9fe045ae8c17f193d034f5ac P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:38.156268 13423 leader_election.cc:304] T 27da527d9fe045ae8c17f193d034f5ac P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba; no voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f
W20250830 07:54:38.156387 13703 leader_election.cc:343] T bee1b5f6f04740dba64cdcb094e26113 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
W20250830 07:54:38.156674 13703 leader_election.cc:343] T 91ab8c468c8143b9ae11b839a95a26fd P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:38.156698 13954 raft_consensus.cc:2747] T 27da527d9fe045ae8c17f193d034f5ac P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:54:38.157135 13773 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "d4e35395930f4c37b34649da5718aa1f" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:38.157264 13561 leader_election.cc:304] T d4e35395930f4c37b34649da5718aa1f P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 6b5e454d98894637b466ea27f1b647f9; no voters:
I20250830 07:54:38.157461 13773 raft_consensus.cc:2466] T d4e35395930f4c37b34649da5718aa1f P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b5e454d98894637b466ea27f1b647f9 in term 0.
I20250830 07:54:38.157761 14256 raft_consensus.cc:2802] T d4e35395930f4c37b34649da5718aa1f P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:54:38.157882 14256 raft_consensus.cc:491] T d4e35395930f4c37b34649da5718aa1f P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:54:38.157974 14256 raft_consensus.cc:3058] T d4e35395930f4c37b34649da5718aa1f P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:38.161542 14256 raft_consensus.cc:513] T d4e35395930f4c37b34649da5718aa1f P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:38.162621 13485 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "d4e35395930f4c37b34649da5718aa1f" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba"
I20250830 07:54:38.162824 13485 raft_consensus.cc:3058] T d4e35395930f4c37b34649da5718aa1f P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:38.163794 13701 leader_election.cc:304] T bee1b5f6f04740dba64cdcb094e26113 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:54:38.164295 14315 raft_consensus.cc:2802] T bee1b5f6f04740dba64cdcb094e26113 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election won for term 1
I20250830 07:54:38.164470 14315 raft_consensus.cc:695] T bee1b5f6f04740dba64cdcb094e26113 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 LEADER]: Becoming Leader. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Running, Role: LEADER
I20250830 07:54:38.165082 14315 consensus_queue.cc:237] T bee1b5f6f04740dba64cdcb094e26113 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:54:38.165863 13485 raft_consensus.cc:2466] T d4e35395930f4c37b34649da5718aa1f P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b5e454d98894637b466ea27f1b647f9 in term 1.
I20250830 07:54:38.167296 13561 leader_election.cc:304] T d4e35395930f4c37b34649da5718aa1f P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 6b5e454d98894637b466ea27f1b647f9; no voters:
I20250830 07:54:38.168330 14421 raft_consensus.cc:2802] T d4e35395930f4c37b34649da5718aa1f P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Leader election won for term 1
W20250830 07:54:38.168727 13225 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7abf2e48a940411181ec19ecfe22ce3f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:38.168807 13627 raft_consensus.cc:3058] T 9696d8531a174585b8fd83a2391c02f7 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:38.172199 13701 leader_election.cc:304] T 91ab8c468c8143b9ae11b839a95a26fd P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:54:38.172709 14385 raft_consensus.cc:2802] T 91ab8c468c8143b9ae11b839a95a26fd P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:54:38.172855 14385 raft_consensus.cc:491] T 91ab8c468c8143b9ae11b839a95a26fd P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:54:38.172999 14385 raft_consensus.cc:3058] T 91ab8c468c8143b9ae11b839a95a26fd P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:38.175567 14385 raft_consensus.cc:513] T 91ab8c468c8143b9ae11b839a95a26fd P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:38.176539 14385 leader_election.cc:290] T 91ab8c468c8143b9ae11b839a95a26fd P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Requested vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967)
I20250830 07:54:38.177379 14256 leader_election.cc:290] T d4e35395930f4c37b34649da5718aa1f P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 election: Requested vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:38.172271 14382 consensus_queue.cc:1035] T 9696d8531a174585b8fd83a2391c02f7 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20250830 07:54:38.177690 14256 consensus_queue.cc:1035] T d1ae3812d72b419798736328da64b53c P 6b5e454d98894637b466ea27f1b647f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:54:38.179070 13485 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "91ab8c468c8143b9ae11b839a95a26fd" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba"
I20250830 07:54:38.179389 13485 raft_consensus.cc:3058] T 91ab8c468c8143b9ae11b839a95a26fd P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:38.184235 13485 raft_consensus.cc:2466] T 91ab8c468c8143b9ae11b839a95a26fd P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 1.
I20250830 07:54:38.184485 14421 raft_consensus.cc:695] T d4e35395930f4c37b34649da5718aa1f P 6b5e454d98894637b466ea27f1b647f9 [term 1 LEADER]: Becoming Leader. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Running, Role: LEADER
I20250830 07:54:38.184834 14421 consensus_queue.cc:237] T d4e35395930f4c37b34649da5718aa1f P 6b5e454d98894637b466ea27f1b647f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:38.189507 13882 ts_tablet_manager.cc:1397] T bee1b5f6f04740dba64cdcb094e26113 P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.275s user 0.010s sys 0.026s
I20250830 07:54:38.190388 13882 raft_consensus.cc:357] T bee1b5f6f04740dba64cdcb094e26113 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:54:38.190640 13882 raft_consensus.cc:383] T bee1b5f6f04740dba64cdcb094e26113 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:38.190759 13882 raft_consensus.cc:738] T bee1b5f6f04740dba64cdcb094e26113 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:54:38.191048 13882 consensus_queue.cc:260] T bee1b5f6f04740dba64cdcb094e26113 P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:54:38.191605 13882 ts_tablet_manager.cc:1428] T bee1b5f6f04740dba64cdcb094e26113 P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20250830 07:54:38.191740 14315 raft_consensus.cc:491] T 05da843c0fe4482a926e410e06b22461 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:38.191989 14315 raft_consensus.cc:513] T 05da843c0fe4482a926e410e06b22461 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:54:38.193663 14315 leader_election.cc:290] T 05da843c0fe4482a926e410e06b22461 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
W20250830 07:54:38.197234 13234 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet dbe542c478874482b078296a7a0e9ec9 consensus state has no leader
I20250830 07:54:38.197774 13234 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_b80e6d1dfec04784820a83f2122542f6" } new_table_name: "default.Table_2ef4fd56f595442da659bbfe83fea326" modify_external_catalogs: true
I20250830 07:54:38.203802 13225 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_4fb18bd6eae047269e7dbf64bee9d1bd"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:38.204416 13225 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4fb18bd6eae047269e7dbf64bee9d1bd in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:38.209017 13886 tablet_bootstrap.cc:492] T afb132e8a5b14a029e005e375f276348 P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:54:38.209225 13886 ts_tablet_manager.cc:1397] T afb132e8a5b14a029e005e375f276348 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.083s user 0.005s sys 0.015s
I20250830 07:54:38.210008 13886 raft_consensus.cc:357] T afb132e8a5b14a029e005e375f276348 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:38.210235 13886 raft_consensus.cc:383] T afb132e8a5b14a029e005e375f276348 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:38.210325 13886 raft_consensus.cc:738] T afb132e8a5b14a029e005e375f276348 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:54:38.210583 13886 consensus_queue.cc:260] T afb132e8a5b14a029e005e375f276348 P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
W20250830 07:54:38.211133 13234 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet c1e0e774b86d4ef9a75e2635295f3e2a has no consensus state
I20250830 07:54:38.211236 13886 ts_tablet_manager.cc:1428] T afb132e8a5b14a029e005e375f276348 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20250830 07:54:38.211555 13886 tablet_bootstrap.cc:492] T 27da527d9fe045ae8c17f193d034f5ac P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:54:38.211689 13234 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_3566feeff7cd468093b299f2cc07abd6" } modify_external_catalogs: true
I20250830 07:54:38.211915 13234 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_3566feeff7cd468093b299f2cc07abd6" } modify_external_catalogs: true
I20250830 07:54:38.213227 13886 tablet_bootstrap.cc:654] T 27da527d9fe045ae8c17f193d034f5ac P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:38.215956 13225 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_0ad9565d4f894c8ab1ac0aac02496e55" } modify_external_catalogs: true
I20250830 07:54:38.216151 13225 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_0ad9565d4f894c8ab1ac0aac02496e55" } modify_external_catalogs: true
I20250830 07:54:38.193485 13486 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "05da843c0fe4482a926e410e06b22461" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:54:38.222671 13701 leader_election.cc:304] T 91ab8c468c8143b9ae11b839a95a26fd P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters:
I20250830 07:54:38.223099 14315 raft_consensus.cc:2802] T 91ab8c468c8143b9ae11b839a95a26fd P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election won for term 1
I20250830 07:54:38.223241 14315 raft_consensus.cc:695] T 91ab8c468c8143b9ae11b839a95a26fd P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 LEADER]: Becoming Leader. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Running, Role: LEADER
I20250830 07:54:38.223508 14315 consensus_queue.cc:237] T 91ab8c468c8143b9ae11b839a95a26fd P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:38.225023 14038 raft_consensus.cc:491] T 6492bd11e50d4900927db0de3757aa24 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:38.225235 14038 raft_consensus.cc:513] T 6492bd11e50d4900927db0de3757aa24 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:38.225858 14038 leader_election.cc:290] T 6492bd11e50d4900927db0de3757aa24 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:38.230541 13233 catalog_manager.cc:5674] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743) does not have the latest schema for tablet d4e35395930f4c37b34649da5718aa1f (table default.Table_fc298c4951614456914be830598a020a [id=e946db3cd3504a69a61a7ed2cabcada7]). Expected version 1 got 0
W20250830 07:54:38.231108 13233 catalog_manager.cc:5774] Failed to send AlterTable RPC for tablet d4e35395930f4c37b34649da5718aa1f (table default.Table_fc298c4951614456914be830598a020a [id=e946db3cd3504a69a61a7ed2cabcada7], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet d4e35395930f4c37b34649da5718aa1f consensus state has no leader
I20250830 07:54:38.231593 13233 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_85cff6310828487f93c6d44cd1770ecb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:38.232143 13233 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_85cff6310828487f93c6d44cd1770ecb in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:38.233264 13227 catalog_manager.cc:5674] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967) does not have the latest schema for tablet d4e35395930f4c37b34649da5718aa1f (table default.Table_fc298c4951614456914be830598a020a [id=e946db3cd3504a69a61a7ed2cabcada7]). Expected version 1 got 0
I20250830 07:54:38.233974 13227 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_e6df4c4dda3c4a549f671ade119cc38c" } new_table_name: "default.Table_7ee43052368b4ef9ac4cce0939b37dcb" modify_external_catalogs: true
I20250830 07:54:38.236850 13461 tablet_service.cc:1468] Processing CreateTablet for tablet f52dd8eeb64a4b8a92babf34387b6c5b (DEFAULT_TABLE table=default.Table_b40dad149c2d4efe8abbd16dacb9092f [id=7b095f26f6eb46d09f56121b9ced62e7]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:38.237311 13461 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f52dd8eeb64a4b8a92babf34387b6c5b. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:38.237514 13234 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet 752727eef0734ff3b7b35b1d5f66aea6
I20250830 07:54:38.237865 13225 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet 4c4a8eea119044b49e2b29f10a703097
I20250830 07:54:38.238762 13230 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet 0208de98277c4d6889fb0289b6013ae1
I20250830 07:54:38.240732 13459 tablet_service.cc:1468] Processing CreateTablet for tablet 13df49c2c2cd4e5cae26a540835b74c9 (DEFAULT_TABLE table=default.Table_909c19bf1a2c49b48c19d50c7bebda25 [id=f366e4f894174aeb837a8749180c3a34]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:38.241238 13459 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 13df49c2c2cd4e5cae26a540835b74c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:38.243057 13468 tablet_service.cc:1515] Processing DeleteTablet for tablet 752727eef0734ff3b7b35b1d5f66aea6 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:38 UTC) from {username='slave'} at 127.0.0.1:37956
I20250830 07:54:38.243381 13455 tablet_service.cc:1515] Processing DeleteTablet for tablet 4c4a8eea119044b49e2b29f10a703097 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:38 UTC) from {username='slave'} at 127.0.0.1:37956
I20250830 07:54:38.243572 13458 tablet_service.cc:1515] Processing DeleteTablet for tablet 0208de98277c4d6889fb0289b6013ae1 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:38 UTC) from {username='slave'} at 127.0.0.1:37956
W20250830 07:54:38.247216 13218 catalog_manager.cc:4908] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): delete failed for tablet 752727eef0734ff3b7b35b1d5f66aea6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 752727eef0734ff3b7b35b1d5f66aea6 already in progress: creating tablet
W20250830 07:54:38.247479 13218 catalog_manager.cc:4908] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): delete failed for tablet 4c4a8eea119044b49e2b29f10a703097 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4c4a8eea119044b49e2b29f10a703097 already in progress: creating tablet
W20250830 07:54:38.247674 13218 catalog_manager.cc:4895] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): delete failed for tablet 0208de98277c4d6889fb0289b6013ae1 because the tablet was not found. No further retry: Not found: Tablet not found: 0208de98277c4d6889fb0289b6013ae1
I20250830 07:54:38.251139 13230 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_df56588fffed4c0cb8cfd91844045df2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:38.251672 13230 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_df56588fffed4c0cb8cfd91844045df2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:38.252854 13225 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_12347ca05ca14f29981270f4186c49e4" } new_table_name: "default.Table_a5ac1561c57f4248ad01f99c4739a38a" modify_external_catalogs: true
I20250830 07:54:38.255767 13605 tablet_service.cc:1468] Processing CreateTablet for tablet f52dd8eeb64a4b8a92babf34387b6c5b (DEFAULT_TABLE table=default.Table_b40dad149c2d4efe8abbd16dacb9092f [id=7b095f26f6eb46d09f56121b9ced62e7]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:38.256260 13605 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f52dd8eeb64a4b8a92babf34387b6c5b. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:38.257627 13772 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "6492bd11e50d4900927db0de3757aa24" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:38.259292 13234 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_6c0a3a12a98942679fe0d83bcda5c0ef"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:38.261132 13234 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6c0a3a12a98942679fe0d83bcda5c0ef in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250830 07:54:38.262634 13422 leader_election.cc:343] T 6492bd11e50d4900927db0de3757aa24 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:38.263087 14038 consensus_queue.cc:1035] T 7c8e248d938f4651ae13199122b08768 P 2065c332f15a4739899af79f3669c3ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:54:38.263918 13752 tablet_service.cc:1468] Processing CreateTablet for tablet f52dd8eeb64a4b8a92babf34387b6c5b (DEFAULT_TABLE table=default.Table_b40dad149c2d4efe8abbd16dacb9092f [id=7b095f26f6eb46d09f56121b9ced62e7]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:38.264385 13752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f52dd8eeb64a4b8a92babf34387b6c5b. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:38.271034 13750 tablet_service.cc:1515] Processing DeleteTablet for tablet 0208de98277c4d6889fb0289b6013ae1 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:38 UTC) from {username='slave'} at 127.0.0.1:45460
I20250830 07:54:38.271356 13747 tablet_service.cc:1515] Processing DeleteTablet for tablet 4c4a8eea119044b49e2b29f10a703097 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:38 UTC) from {username='slave'} at 127.0.0.1:45460
I20250830 07:54:38.271494 13749 tablet_service.cc:1515] Processing DeleteTablet for tablet 752727eef0734ff3b7b35b1d5f66aea6 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:38 UTC) from {username='slave'} at 127.0.0.1:45460
I20250830 07:54:38.272365 13231 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet 7c8e248d938f4651ae13199122b08768
I20250830 07:54:38.272888 13231 catalog_manager.cc:6652] ReplaceTablet: tablet 7c8e248d938f4651ae13199122b08768 deleted and replaced by tablet 7e9d6af1d7fc4d4b961583b44f2f962a
I20250830 07:54:38.273015 13232 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet ec47a59c22ff4370bd21bc2a18336049
I20250830 07:54:38.273324 13231 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_b520311338ac432283a508831f98574e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250830 07:54:38.273670 13232 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_dfe4a0834a4e426184d5c247a9327e4f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:38.273892 13231 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b520311338ac432283a508831f98574e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:38.273897 13887 tablet_bootstrap.cc:492] T c3b35ea656db4741a02e6746e1b049ec P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:54:38.274092 13887 ts_tablet_manager.cc:1397] T c3b35ea656db4741a02e6746e1b049ec P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.358s user 0.003s sys 0.000s
W20250830 07:54:38.274116 13232 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_dfe4a0834a4e426184d5c247a9327e4f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:38.275241 13228 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet f66e1d07039841088a444ee0203a4eb0
W20250830 07:54:38.275779 13225 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 713c12e1efec4e6f9895c65dc8a9c4b9 consensus state has no leader
I20250830 07:54:38.275689 13887 raft_consensus.cc:357] T c3b35ea656db4741a02e6746e1b049ec P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:38.275916 13887 raft_consensus.cc:383] T c3b35ea656db4741a02e6746e1b049ec P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:38.275686 13229 catalog_manager.cc:5582] T 48b422b125154fbdbb9c995dc372d128 P 2065c332f15a4739899af79f3669c3ba reported cstate change: term changed from 0 to 1, leader changed from <none> to 2065c332f15a4739899af79f3669c3ba (127.12.209.1). New cstate: current_term: 1 leader_uuid: "2065c332f15a4739899af79f3669c3ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } health_report { overall_health: HEALTHY } } }
I20250830 07:54:38.275883 13228 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_6ef13cf21d7d4330be0de43381e7047f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250830 07:54:38.275987 13887 raft_consensus.cc:738] T c3b35ea656db4741a02e6746e1b049ec P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:54:38.276211 13229 catalog_manager.cc:5674] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325) does not have the latest schema for tablet 7238db7e31484201a30cf4c035d82aff (table default.Table_6f8d287a31204172a037b156956fb0d9 [id=0e4bba403b27442cb6e7f5b50ff4a39f]). Expected version 1 got 0
W20250830 07:54:38.276381 13228 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6ef13cf21d7d4330be0de43381e7047f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:38.276415 13229 catalog_manager.cc:5674] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325) does not have the latest schema for tablet cada6410e2884c508bb7dd38bea438ae (table default.Table_f63c8357d00949f7822da8771d6a44f1 [id=4678375d8d3d474290ad1a254de14054]). Expected version 1 got 0
I20250830 07:54:38.276633 13229 catalog_manager.cc:5674] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325) does not have the latest schema for tablet 6492bd11e50d4900927db0de3757aa24 (table default.Table_7dc4898210c641719d6d97c45dbd89c9 [id=b7dcb14885434162aac95c78a5a70ba9]). Expected version 7 got 0
I20250830 07:54:38.276808 13229 catalog_manager.cc:5674] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325) does not have the latest schema for tablet d4e35395930f4c37b34649da5718aa1f (table default.Table_fc298c4951614456914be830598a020a [id=e946db3cd3504a69a61a7ed2cabcada7]). Expected version 1 got 0
I20250830 07:54:38.277439 13226 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet ffc5945a032e47d4bd3397d7c887dc62
I20250830 07:54:38.277895 13226 catalog_manager.cc:6652] ReplaceTablet: tablet ffc5945a032e47d4bd3397d7c887dc62 deleted and replaced by tablet f4e07ba34525405ebe8dae182520d896
W20250830 07:54:38.278254 13227 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f519f292f2cc4e2b8c63c0404fef1125 has no consensus state
I20250830 07:54:38.282171 13458 tablet_service.cc:1515] Processing DeleteTablet for tablet f66e1d07039841088a444ee0203a4eb0 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:38 UTC) from {username='slave'} at 127.0.0.1:37956
I20250830 07:54:38.282452 13455 tablet_service.cc:1515] Processing DeleteTablet for tablet ffc5945a032e47d4bd3397d7c887dc62 with delete_type TABLET_DATA_DELETED (replaced by tablet f4e07ba34525405ebe8dae182520d896) from {username='slave'} at 127.0.0.1:37956
W20250830 07:54:38.283439 13218 catalog_manager.cc:4895] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): delete failed for tablet f66e1d07039841088a444ee0203a4eb0 because the tablet was not found. No further retry: Not found: Tablet not found: f66e1d07039841088a444ee0203a4eb0
W20250830 07:54:38.283722 13218 catalog_manager.cc:4908] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): delete failed for tablet ffc5945a032e47d4bd3397d7c887dc62 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ffc5945a032e47d4bd3397d7c887dc62 already in progress: creating tablet
W20250830 07:54:38.287428 13219 catalog_manager.cc:4895] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): delete failed for tablet 0208de98277c4d6889fb0289b6013ae1 because the tablet was not found. No further retry: Not found: Tablet not found: 0208de98277c4d6889fb0289b6013ae1
W20250830 07:54:38.287709 13219 catalog_manager.cc:4908] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): delete failed for tablet 4c4a8eea119044b49e2b29f10a703097 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4c4a8eea119044b49e2b29f10a703097 already in progress: creating tablet
I20250830 07:54:38.288518 13736 tablet_service.cc:1515] Processing DeleteTablet for tablet ffc5945a032e47d4bd3397d7c887dc62 with delete_type TABLET_DATA_DELETED (replaced by tablet f4e07ba34525405ebe8dae182520d896) from {username='slave'} at 127.0.0.1:45460
I20250830 07:54:38.288828 13749 tablet_service.cc:1515] Processing DeleteTablet for tablet 7c8e248d938f4651ae13199122b08768 with delete_type TABLET_DATA_DELETED (replaced by tablet 7e9d6af1d7fc4d4b961583b44f2f962a) from {username='slave'} at 127.0.0.1:45460
W20250830 07:54:38.290117 13219 catalog_manager.cc:4908] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): delete failed for tablet 752727eef0734ff3b7b35b1d5f66aea6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 752727eef0734ff3b7b35b1d5f66aea6 already in progress: creating tablet
W20250830 07:54:38.290416 13219 catalog_manager.cc:4908] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): delete failed for tablet ffc5945a032e47d4bd3397d7c887dc62 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ffc5945a032e47d4bd3397d7c887dc62 already in progress: creating tablet
I20250830 07:54:38.291477 13455 tablet_service.cc:1468] Processing CreateTablet for tablet 74891b8103e144c486750f64ba2003f4 (DEFAULT_TABLE table=default.Table_b879db4950f2469bb1b1739334f7b035 [id=63f62da0ba61488791fcce76368d92a8]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:38.291986 13455 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 74891b8103e144c486750f64ba2003f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:38.295703 13458 tablet_service.cc:1468] Processing CreateTablet for tablet 09586fdda94c4aff9d3fa25d71fe6ac0 (DEFAULT_TABLE table=default.Table_3c375881f4bd48f78131bbf90d56ca6d [id=793284417870487abbf842b1ee7f889b]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:38.296156 13458 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 09586fdda94c4aff9d3fa25d71fe6ac0. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:38.302660 13887 consensus_queue.cc:260] T c3b35ea656db4741a02e6746e1b049ec P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:38.303449 13887 ts_tablet_manager.cc:1428] T c3b35ea656db4741a02e6746e1b049ec P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.029s user 0.003s sys 0.000s
I20250830 07:54:38.303783 13887 tablet_bootstrap.cc:492] T 008827b3d09d464b9182fb42dc2170d5 P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:54:38.304503 13468 tablet_service.cc:1468] Processing CreateTablet for tablet d206f6b6e7524a27a9f95787bcd5de77 (DEFAULT_TABLE table=default.Table_dfe2a98f84744faeb4200202374bb186 [id=9a01be181c024b9b8d677bf8625263e3]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:38.304870 13468 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d206f6b6e7524a27a9f95787bcd5de77. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:38.306962 13887 tablet_bootstrap.cc:654] T 008827b3d09d464b9182fb42dc2170d5 P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:38.311352 13232 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_6a958507c89649f0b5da3534949c2122"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:38.311880 13232 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6a958507c89649f0b5da3534949c2122 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:38.313002 13464 tablet_service.cc:1515] Processing DeleteTablet for tablet 2009012fddc24e4fb7ad0fab33a1103b with delete_type TABLET_DATA_DELETED (replaced by tablet 52e910677ae34630a919d1d3f21b7e83) from {username='slave'} at 127.0.0.1:37956
I20250830 07:54:38.313238 13883 tablet_replica.cc:331] T 2009012fddc24e4fb7ad0fab33a1103b P 2065c332f15a4739899af79f3669c3ba: stopping tablet replica
I20250830 07:54:38.313331 13229 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_3d914debcfbf473a93a5955114938fdf"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250830 07:54:38.313455 13883 raft_consensus.cc:2241] T 2009012fddc24e4fb7ad0fab33a1103b P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Raft consensus shutting down.
I20250830 07:54:38.313624 13883 raft_consensus.cc:2270] T 2009012fddc24e4fb7ad0fab33a1103b P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Raft consensus is shut down!
W20250830 07:54:38.313808 13229 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3d914debcfbf473a93a5955114938fdf in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:38.314195 13883 ts_tablet_manager.cc:1905] T 2009012fddc24e4fb7ad0fab33a1103b P 2065c332f15a4739899af79f3669c3ba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250830 07:54:38.318553 13231 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_b879db4950f2469bb1b1739334f7b035" } new_table_name: "default.Table_f898ce75325a436ca3a63a3c9e46fb68" modify_external_catalogs: true
I20250830 07:54:38.319435 13884 tablet_replica.cc:331] T 7c8e248d938f4651ae13199122b08768 P 9b057ade5dce45af9f8bf0bedf8b917f: stopping tablet replica
W20250830 07:54:38.320688 13228 catalog_manager.cc:5415] Ignoring report from unknown tablet ed87c6793dd149a6a363f1977d816628
W20250830 07:54:38.320773 13228 catalog_manager.cc:5415] Ignoring report from unknown tablet e134ab64aa1b4ce89e295b43cbc3fffb
W20250830 07:54:38.320818 13228 catalog_manager.cc:5415] Ignoring report from unknown tablet 05da843c0fe4482a926e410e06b22461
W20250830 07:54:38.320886 13228 catalog_manager.cc:5415] Ignoring report from unknown tablet 1476bb480bf747838613948875001c30
I20250830 07:54:38.320881 13747 tablet_service.cc:1515] Processing DeleteTablet for tablet ec47a59c22ff4370bd21bc2a18336049 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:38 UTC) from {username='slave'} at 127.0.0.1:45460
W20250830 07:54:38.320945 13228 catalog_manager.cc:5415] Ignoring report from unknown tablet 6f2d855ab3c04123b2f9ea22cda6ef04
W20250830 07:54:38.321058 13228 catalog_manager.cc:5415] Ignoring report from unknown tablet ff0f9cccc8ed43b1a8cd38de0e9d4097
W20250830 07:54:38.321111 13228 catalog_manager.cc:5415] Ignoring report from unknown tablet c3b35ea656db4741a02e6746e1b049ec
I20250830 07:54:38.321087 13750 tablet_service.cc:1515] Processing DeleteTablet for tablet f66e1d07039841088a444ee0203a4eb0 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:38 UTC) from {username='slave'} at 127.0.0.1:45460
I20250830 07:54:38.321420 13228 catalog_manager.cc:5582] T 7238db7e31484201a30cf4c035d82aff P 2065c332f15a4739899af79f3669c3ba reported cstate change: term changed from 0 to 1, leader changed from <none> to 2065c332f15a4739899af79f3669c3ba (127.12.209.1). New cstate: current_term: 1 leader_uuid: "2065c332f15a4739899af79f3669c3ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } health_report { overall_health: HEALTHY } } }
I20250830 07:54:38.321794 13228 catalog_manager.cc:5674] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325) does not have the latest schema for tablet 7238db7e31484201a30cf4c035d82aff (table default.Table_6f8d287a31204172a037b156956fb0d9 [id=0e4bba403b27442cb6e7f5b50ff4a39f]). Expected version 1 got 0
I20250830 07:54:38.321846 13749 tablet_service.cc:1468] Processing CreateTablet for tablet 09586fdda94c4aff9d3fa25d71fe6ac0 (DEFAULT_TABLE table=default.Table_3c375881f4bd48f78131bbf90d56ca6d [id=793284417870487abbf842b1ee7f889b]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:38.322504 14401 raft_consensus.cc:491] T c3b35ea656db4741a02e6746e1b049ec P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:38.322686 14401 raft_consensus.cc:513] T c3b35ea656db4741a02e6746e1b049ec P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:38.323345 14401 leader_election.cc:290] T c3b35ea656db4741a02e6746e1b049ec P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:38.323665 13882 tablet_bootstrap.cc:492] T d912c69d8722403aa56cbbde4ce59782 P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:54:38.323897 13749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 09586fdda94c4aff9d3fa25d71fe6ac0. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:38.325241 13601 tablet_service.cc:1515] Processing DeleteTablet for tablet 0208de98277c4d6889fb0289b6013ae1 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:38 UTC) from {username='slave'} at 127.0.0.1:45306
I20250830 07:54:38.326462 13598 tablet_service.cc:1515] Processing DeleteTablet for tablet 4c4a8eea119044b49e2b29f10a703097 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:38 UTC) from {username='slave'} at 127.0.0.1:45306
I20250830 07:54:38.326604 13608 tablet_service.cc:1468] Processing CreateTablet for tablet 13df49c2c2cd4e5cae26a540835b74c9 (DEFAULT_TABLE table=default.Table_909c19bf1a2c49b48c19d50c7bebda25 [id=f366e4f894174aeb837a8749180c3a34]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:38.327015 13608 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 13df49c2c2cd4e5cae26a540835b74c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:38.327441 13750 tablet_service.cc:1468] Processing CreateTablet for tablet 13df49c2c2cd4e5cae26a540835b74c9 (DEFAULT_TABLE table=default.Table_909c19bf1a2c49b48c19d50c7bebda25 [id=f366e4f894174aeb837a8749180c3a34]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:38.327791 13750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 13df49c2c2cd4e5cae26a540835b74c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:38.330349 13773 raft_consensus.cc:1273] T d33a5d107c6849aca6eb48ffdf8a5463 P 9b057ade5dce45af9f8bf0bedf8b917f [term 2 FOLLOWER]: Refusing update from remote peer 2065c332f15a4739899af79f3669c3ba: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
W20250830 07:54:38.331015 13220 catalog_manager.cc:4895] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet 0208de98277c4d6889fb0289b6013ae1 because the tablet was not found. No further retry: Not found: Tablet not found: 0208de98277c4d6889fb0289b6013ae1
W20250830 07:54:38.331175 13231 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 74891b8103e144c486750f64ba2003f4 consensus state has no leader
I20250830 07:54:38.331982 13593 tablet_service.cc:1515] Processing DeleteTablet for tablet 752727eef0734ff3b7b35b1d5f66aea6 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:38 UTC) from {username='slave'} at 127.0.0.1:45306
I20250830 07:54:38.332475 13602 tablet_service.cc:1515] Processing DeleteTablet for tablet 7c8e248d938f4651ae13199122b08768 with delete_type TABLET_DATA_DELETED (replaced by tablet 7e9d6af1d7fc4d4b961583b44f2f962a) from {username='slave'} at 127.0.0.1:45306
I20250830 07:54:38.332651 13595 tablet_service.cc:1515] Processing DeleteTablet for tablet ec47a59c22ff4370bd21bc2a18336049 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:38 UTC) from {username='slave'} at 127.0.0.1:45306
I20250830 07:54:38.332819 13600 tablet_service.cc:1515] Processing DeleteTablet for tablet f66e1d07039841088a444ee0203a4eb0 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:38 UTC) from {username='slave'} at 127.0.0.1:45306
I20250830 07:54:38.332171 13747 tablet_service.cc:1468] Processing CreateTablet for tablet 74891b8103e144c486750f64ba2003f4 (DEFAULT_TABLE table=default.Table_b879db4950f2469bb1b1739334f7b035 [id=63f62da0ba61488791fcce76368d92a8]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:38.332973 13596 tablet_service.cc:1515] Processing DeleteTablet for tablet ffc5945a032e47d4bd3397d7c887dc62 with delete_type TABLET_DATA_DELETED (replaced by tablet f4e07ba34525405ebe8dae182520d896) from {username='slave'} at 127.0.0.1:45306
I20250830 07:54:38.333173 13599 tablet_service.cc:1468] Processing CreateTablet for tablet 74891b8103e144c486750f64ba2003f4 (DEFAULT_TABLE table=default.Table_b879db4950f2469bb1b1739334f7b035 [id=63f62da0ba61488791fcce76368d92a8]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:38.333393 13606 tablet_service.cc:1468] Processing CreateTablet for tablet 09586fdda94c4aff9d3fa25d71fe6ac0 (DEFAULT_TABLE table=default.Table_3c375881f4bd48f78131bbf90d56ca6d [id=793284417870487abbf842b1ee7f889b]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:38.333798 13606 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 09586fdda94c4aff9d3fa25d71fe6ac0. 1 dirs total, 0 dirs full, 0 dirs failed
W20250830 07:54:38.335177 13220 catalog_manager.cc:4908] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet 4c4a8eea119044b49e2b29f10a703097 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4c4a8eea119044b49e2b29f10a703097 already in progress: creating tablet
W20250830 07:54:38.335486 13220 catalog_manager.cc:4908] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet 752727eef0734ff3b7b35b1d5f66aea6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 752727eef0734ff3b7b35b1d5f66aea6 already in progress: creating tablet
I20250830 07:54:38.336154 13885 tablet_replica.cc:331] T 7c8e248d938f4651ae13199122b08768 P 6b5e454d98894637b466ea27f1b647f9: stopping tablet replica
I20250830 07:54:38.336418 13885 raft_consensus.cc:2241] T 7c8e248d938f4651ae13199122b08768 P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250830 07:54:38.336853 13885 raft_consensus.cc:2270] T 7c8e248d938f4651ae13199122b08768 P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250830 07:54:38.337548 13885 ts_tablet_manager.cc:1905] T 7c8e248d938f4651ae13199122b08768 P 6b5e454d98894637b466ea27f1b647f9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250830 07:54:38.338209 13747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 74891b8103e144c486750f64ba2003f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:38.339267 13599 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 74891b8103e144c486750f64ba2003f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:38.339478 14401 consensus_queue.cc:1035] T d33a5d107c6849aca6eb48ffdf8a5463 P 2065c332f15a4739899af79f3669c3ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:54:38.347115 13773 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "c3b35ea656db4741a02e6746e1b049ec" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:38.358685 14445 raft_consensus.cc:491] T 48b422b125154fbdbb9c995dc372d128 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:38.358945 14445 raft_consensus.cc:513] T 48b422b125154fbdbb9c995dc372d128 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:54:38.363185 14445 leader_election.cc:290] T 48b422b125154fbdbb9c995dc372d128 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
I20250830 07:54:38.363430 13486 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "48b422b125154fbdbb9c995dc372d128" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
W20250830 07:54:38.376251 13422 leader_election.cc:343] T c3b35ea656db4741a02e6746e1b049ec P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Illegal state: must be running to vote when last-logged opid is not known
W20250830 07:54:38.379287 13228 catalog_manager.cc:5415] Ignoring report from unknown tablet ef16b9e2d444489699f4db1ac26d5f6c
I20250830 07:54:38.381246 13883 ts_tablet_manager.cc:1918] T 2009012fddc24e4fb7ad0fab33a1103b P 2065c332f15a4739899af79f3669c3ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250830 07:54:38.384733 13885 ts_tablet_manager.cc:1918] T 7c8e248d938f4651ae13199122b08768 P 6b5e454d98894637b466ea27f1b647f9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250830 07:54:38.385077 13885 log.cc:1199] T 7c8e248d938f4651ae13199122b08768 P 6b5e454d98894637b466ea27f1b647f9: Deleting WAL directory at /tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/ts-1/wal/wals/7c8e248d938f4651ae13199122b08768
I20250830 07:54:38.385804 13885 ts_tablet_manager.cc:1939] T 7c8e248d938f4651ae13199122b08768 P 6b5e454d98894637b466ea27f1b647f9: Deleting consensus metadata
I20250830 07:54:38.388763 13886 tablet_bootstrap.cc:492] T 27da527d9fe045ae8c17f193d034f5ac P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:54:38.388938 13886 ts_tablet_manager.cc:1397] T 27da527d9fe045ae8c17f193d034f5ac P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.177s user 0.025s sys 0.036s
I20250830 07:54:38.390518 13886 raft_consensus.cc:357] T 27da527d9fe045ae8c17f193d034f5ac P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:38.390698 13886 raft_consensus.cc:383] T 27da527d9fe045ae8c17f193d034f5ac P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:38.390774 13886 raft_consensus.cc:738] T 27da527d9fe045ae8c17f193d034f5ac P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:54:38.392056 13886 consensus_queue.cc:260] T 27da527d9fe045ae8c17f193d034f5ac P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:38.392928 14385 consensus_queue.cc:1035] T 9696d8531a174585b8fd83a2391c02f7 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:54:38.393882 13886 ts_tablet_manager.cc:1428] T 27da527d9fe045ae8c17f193d034f5ac P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20250830 07:54:38.394184 13886 tablet_bootstrap.cc:492] T 6492bd11e50d4900927db0de3757aa24 P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:54:38.398474 13886 tablet_bootstrap.cc:654] T 6492bd11e50d4900927db0de3757aa24 P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:38.401376 13228 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_4fb18bd6eae047269e7dbf64bee9d1bd" } new_table_name: "default.Table_005af599605e4bd090ba828f70a19003" modify_external_catalogs: true
I20250830 07:54:38.403924 13886 tablet_bootstrap.cc:492] T 6492bd11e50d4900927db0de3757aa24 P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:54:38.404122 13886 ts_tablet_manager.cc:1397] T 6492bd11e50d4900927db0de3757aa24 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.010s user 0.003s sys 0.000s
I20250830 07:54:38.404819 13886 raft_consensus.cc:357] T 6492bd11e50d4900927db0de3757aa24 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:38.405038 13886 raft_consensus.cc:383] T 6492bd11e50d4900927db0de3757aa24 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:38.405110 13886 raft_consensus.cc:738] T 6492bd11e50d4900927db0de3757aa24 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:54:38.405365 13886 consensus_queue.cc:260] T 6492bd11e50d4900927db0de3757aa24 P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:38.405948 13886 ts_tablet_manager.cc:1428] T 6492bd11e50d4900927db0de3757aa24 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20250830 07:54:38.406245 13886 tablet_bootstrap.cc:492] T b480f5eb03804baeb61cd0424d70faf5 P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
W20250830 07:54:38.406419 13231 catalog_manager.cc:5415] Ignoring report from unknown tablet afb132e8a5b14a029e005e375f276348
W20250830 07:54:38.406520 13231 catalog_manager.cc:5415] Ignoring report from unknown tablet bee1b5f6f04740dba64cdcb094e26113
W20250830 07:54:38.406605 13231 catalog_manager.cc:5415] Ignoring report from unknown tablet 91ab8c468c8143b9ae11b839a95a26fd
W20250830 07:54:38.406668 13231 catalog_manager.cc:5415] Ignoring report from unknown tablet 6f2d855ab3c04123b2f9ea22cda6ef04
W20250830 07:54:38.406764 13231 catalog_manager.cc:5415] Ignoring report from unknown tablet ff0f9cccc8ed43b1a8cd38de0e9d4097
W20250830 07:54:38.406826 13231 catalog_manager.cc:5415] Ignoring report from unknown tablet 05da843c0fe4482a926e410e06b22461
I20250830 07:54:38.407267 13231 catalog_manager.cc:5674] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743) does not have the latest schema for tablet 7238db7e31484201a30cf4c035d82aff (table default.Table_6f8d287a31204172a037b156956fb0d9 [id=0e4bba403b27442cb6e7f5b50ff4a39f]). Expected version 1 got 0
I20250830 07:54:38.407894 13886 tablet_bootstrap.cc:654] T b480f5eb03804baeb61cd0424d70faf5 P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:38.410116 13231 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_1de56737f9f24ca3936c6c21ecfc7c69"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:38.410984 13231 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1de56737f9f24ca3936c6c21ecfc7c69 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:38.414683 13229 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_7a6b99ecc85740eb8de4ec8dece64920" } new_table_name: "default.Table_517ee5a88dc8431fb14bc9f85c62b395" modify_external_catalogs: true
W20250830 07:54:38.415032 13228 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet b4c345013ff04cf991989f456aa2d420 has no consensus state
W20250830 07:54:38.423274 13229 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 2be43f828f204f599017b6a04cf2ddf9 consensus state has no leader
I20250830 07:54:38.424535 13231 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_b25c4cfbc9cf443d904f57da99dd6bee"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:38.425294 13231 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b25c4cfbc9cf443d904f57da99dd6bee in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:38.430335 13749 tablet_service.cc:1468] Processing CreateTablet for tablet de3a52a8e08a45808373902a0185e6f0 (DEFAULT_TABLE table=default.Table_a4097958af86408498f5bc26a4fc0871 [id=0ca73c1fbe9f48ad82737dca6997e50e]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:38.431610 13749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de3a52a8e08a45808373902a0185e6f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:38.432157 13750 tablet_service.cc:1468] Processing CreateTablet for tablet d206f6b6e7524a27a9f95787bcd5de77 (DEFAULT_TABLE table=default.Table_dfe2a98f84744faeb4200202374bb186 [id=9a01be181c024b9b8d677bf8625263e3]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:38.432459 13750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d206f6b6e7524a27a9f95787bcd5de77. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:38.441164 13229 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_dc8dc313f9fb46d3bd2a8e79c8d2102f" } modify_external_catalogs: true
I20250830 07:54:38.441399 13229 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_dc8dc313f9fb46d3bd2a8e79c8d2102f" } modify_external_catalogs: true
I20250830 07:54:38.441959 13232 master_service.cc:948] ReplaceTablet: received request to replace tablet c0147310dad84226808332a4c2c6e09d from {username='slave'} at 127.0.0.1:42126
I20250830 07:54:38.441670 13228 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_a69ef62b5e2a4bb0b70c263090ce598c" } modify_external_catalogs: true
I20250830 07:54:38.443084 13228 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_a69ef62b5e2a4bb0b70c263090ce598c" } modify_external_catalogs: true
I20250830 07:54:38.444355 13736 tablet_service.cc:1468] Processing CreateTablet for tablet d2b8e6df64ef49e2ba36c093efd3c351 (DEFAULT_TABLE table=default.Table_caaf22211b564ae8a28d2c4987248a7b [id=f1e914e3be1d450ab4f7f605af71bfa1]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:38.444628 13232 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_857dfeec2d2644ebb4f2674ca8df8b89" } modify_external_catalogs: true
I20250830 07:54:38.444802 13736 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d2b8e6df64ef49e2ba36c093efd3c351. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:38.444849 13232 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_857dfeec2d2644ebb4f2674ca8df8b89" } modify_external_catalogs: true
I20250830 07:54:38.447890 13886 tablet_bootstrap.cc:492] T b480f5eb03804baeb61cd0424d70faf5 P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:54:38.448055 13886 ts_tablet_manager.cc:1397] T b480f5eb03804baeb61cd0424d70faf5 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.042s user 0.006s sys 0.003s
I20250830 07:54:38.448869 13886 raft_consensus.cc:357] T b480f5eb03804baeb61cd0424d70faf5 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:54:38.449079 13886 raft_consensus.cc:383] T b480f5eb03804baeb61cd0424d70faf5 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:38.449177 13886 raft_consensus.cc:738] T b480f5eb03804baeb61cd0424d70faf5 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:54:38.449694 13886 consensus_queue.cc:260] T b480f5eb03804baeb61cd0424d70faf5 P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:54:38.450559 13886 ts_tablet_manager.cc:1428] T b480f5eb03804baeb61cd0424d70faf5 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20250830 07:54:38.450901 13886 tablet_bootstrap.cc:492] T c3b35ea656db4741a02e6746e1b049ec P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:54:38.452855 13755 tablet_service.cc:1468] Processing CreateTablet for tablet 4b403cadfb7b42f8896b2ee16b50ecb1 (DEFAULT_TABLE table=default.Table_106c5d91b7314b3398e48ac2c97aa95b [id=7f24e7d037584d65b1c480cf52b59fa9]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:38.453238 13755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b403cadfb7b42f8896b2ee16b50ecb1. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:38.456105 13736 tablet_service.cc:1468] Processing CreateTablet for tablet aee84a97524e4568acdc4ae1c74fb492 (DEFAULT_TABLE table=default.Table_65ab52329c314c13817e7261f5108188 [id=18b2c25896e546748465c4807b839cbf]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:38.456485 13736 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aee84a97524e4568acdc4ae1c74fb492. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:38.458842 13741 tablet_service.cc:1468] Processing CreateTablet for tablet 3525652a73b8413b8ccbcb5824cc5880 (DEFAULT_TABLE table=default.Table_7369fede0ccd48d1bc738e5dcda4ab25 [id=af6c7908ff81481bbd041214ae6cf74c]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:38.459192 13741 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3525652a73b8413b8ccbcb5824cc5880. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:38.464030 13737 tablet_service.cc:1468] Processing CreateTablet for tablet 74ea2298876a4066b297915c135d4618 (DEFAULT_TABLE table=default.Table_062f0e529a09425da9da5b7ab68a6e38 [id=c61cd884076e445791d32f8c83d1229f]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:38.464411 13737 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 74ea2298876a4066b297915c135d4618. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:38.465898 13220 catalog_manager.cc:4928] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): tablet 7c8e248d938f4651ae13199122b08768 (table default.Table_b272b07ca0614cafb8c14f4e2132d255 [id=957201242ea748618cc610a5002a8684]) successfully deleted
I20250830 07:54:38.466584 13601 tablet_service.cc:1468] Processing CreateTablet for tablet 65f1ee59e6e9498381d686f16a865e23 (DEFAULT_TABLE table=default.Table_df1448b0d1b44810b3ce8ad508249df6 [id=3cf0d12aa7644ef4abfcf50bdba92a79]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:38.467010 13601 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 65f1ee59e6e9498381d686f16a865e23. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:38.467346 13742 tablet_service.cc:1468] Processing CreateTablet for tablet 65f1ee59e6e9498381d686f16a865e23 (DEFAULT_TABLE table=default.Table_df1448b0d1b44810b3ce8ad508249df6 [id=3cf0d12aa7644ef4abfcf50bdba92a79]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:38.467741 13742 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 65f1ee59e6e9498381d686f16a865e23. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:38.467610 13746 tablet_service.cc:1468] Processing CreateTablet for tablet b83dfc54383d4e7b96523568aea5c9f3 (DEFAULT_TABLE table=default.Table_1c1a8a41b5bc44b6b33f0d33246d5d56 [id=803bcda3ed6641749163c3162af467f2]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:38.468858 13746 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b83dfc54383d4e7b96523568aea5c9f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:38.471081 14287 raft_consensus.cc:491] T 27da527d9fe045ae8c17f193d034f5ac P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:38.471211 14287 raft_consensus.cc:513] T 27da527d9fe045ae8c17f193d034f5ac P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:38.471443 13603 tablet_service.cc:1468] Processing CreateTablet for tablet 0ceccc5f18294356894695fe08d73e30 (DEFAULT_TABLE table=default.Table_049167f2b5e44e98b771e19ddb7ac501 [id=0e99ba575a7a4f8dae74a98627249018]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:38.471812 13603 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ceccc5f18294356894695fe08d73e30. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:38.471969 14287 leader_election.cc:290] T 27da527d9fe045ae8c17f193d034f5ac P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967)
I20250830 07:54:38.467609 13747 tablet_service.cc:1468] Processing CreateTablet for tablet ff72a0fd9a0e46a6bd54a15e4ad783b4 (DEFAULT_TABLE table=default.Table_85e7f0b13c094fd7841dcabce61fd911 [id=de7b214458f247ef831f43727543afc5]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:38.474159 13747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff72a0fd9a0e46a6bd54a15e4ad783b4. 1 dirs total, 0 dirs full, 0 dirs failed
W20250830 07:54:38.400728 13562 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.209.3:38743, user_credentials={real_user=slave}} blocked reactor thread for 228080us
I20250830 07:54:38.477270 14256 raft_consensus.cc:491] T 9696d8531a174585b8fd83a2391c02f7 P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20250830 07:54:38.477509 13227 catalog_manager.cc:5415] Ignoring report from unknown tablet 9696d8531a174585b8fd83a2391c02f7
I20250830 07:54:38.477581 13231 master_service.cc:948] ReplaceTablet: received request to replace tablet ff2267fb411942ff826e2a72bcb89cd7 from {username='slave'} at 127.0.0.1:42126
I20250830 07:54:38.477710 14256 raft_consensus.cc:513] T 9696d8531a174585b8fd83a2391c02f7 P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:54:38.478338 14256 leader_election.cc:290] T 9696d8531a174585b8fd83a2391c02f7 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
I20250830 07:54:38.419294 13882 tablet_bootstrap.cc:654] T d912c69d8722403aa56cbbde4ce59782 P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:38.479138 13771 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "48b422b125154fbdbb9c995dc372d128" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:38.479385 13771 raft_consensus.cc:2391] T 48b422b125154fbdbb9c995dc372d128 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b5e454d98894637b466ea27f1b647f9 in current term 1: Already voted for candidate 2065c332f15a4739899af79f3669c3ba in this term.
I20250830 07:54:38.479897 13752 tablet_service.cc:1468] Processing CreateTablet for tablet d37fe59b4f964f30bb1ed4cb00868b75 (DEFAULT_TABLE table=default.Table_8fc143e40fc14b37bac695b6f7604eed [id=3abbecb154a042428e6d68d43bf105fb]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:38.480302 13752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d37fe59b4f964f30bb1ed4cb00868b75. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:38.425627 13608 tablet_service.cc:1468] Processing CreateTablet for tablet de3a52a8e08a45808373902a0185e6f0 (DEFAULT_TABLE table=default.Table_a4097958af86408498f5bc26a4fc0871 [id=0ca73c1fbe9f48ad82737dca6997e50e]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:38.480892 13742 tablet_service.cc:1468] Processing CreateTablet for tablet 0ceccc5f18294356894695fe08d73e30 (DEFAULT_TABLE table=default.Table_049167f2b5e44e98b771e19ddb7ac501 [id=0e99ba575a7a4f8dae74a98627249018]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:38.481207 13608 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de3a52a8e08a45808373902a0185e6f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:38.481256 13742 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ceccc5f18294356894695fe08d73e30. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:38.428432 13605 tablet_service.cc:1468] Processing CreateTablet for tablet d37fe59b4f964f30bb1ed4cb00868b75 (DEFAULT_TABLE table=default.Table_8fc143e40fc14b37bac695b6f7604eed [id=3abbecb154a042428e6d68d43bf105fb]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:38.485415 13605 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d37fe59b4f964f30bb1ed4cb00868b75. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:38.487113 13738 tablet_service.cc:1468] Processing CreateTablet for tablet d1bf58d367f54ba8bad64887b9a8d9cc (DEFAULT_TABLE table=default.Table_affac1e19f984bf38960e637cb801588 [id=b163cf9c3a7c4c61b0f0d0143ffbeb6f]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:38.487509 13738 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1bf58d367f54ba8bad64887b9a8d9cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:38.431107 13599 tablet_service.cc:1468] Processing CreateTablet for tablet d206f6b6e7524a27a9f95787bcd5de77 (DEFAULT_TABLE table=default.Table_dfe2a98f84744faeb4200202374bb186 [id=9a01be181c024b9b8d677bf8625263e3]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:38.491225 13599 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d206f6b6e7524a27a9f95787bcd5de77. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:38.431432 13606 tablet_service.cc:1468] Processing CreateTablet for tablet ff72a0fd9a0e46a6bd54a15e4ad783b4 (DEFAULT_TABLE table=default.Table_85e7f0b13c094fd7841dcabce61fd911 [id=de7b214458f247ef831f43727543afc5]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:38.443850 13596 tablet_service.cc:1468] Processing CreateTablet for tablet d2b8e6df64ef49e2ba36c093efd3c351 (DEFAULT_TABLE table=default.Table_caaf22211b564ae8a28d2c4987248a7b [id=f1e914e3be1d450ab4f7f605af71bfa1]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:38.495127 13596 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d2b8e6df64ef49e2ba36c093efd3c351. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:38.427258 13464 tablet_service.cc:1468] Processing CreateTablet for tablet d2b8e6df64ef49e2ba36c093efd3c351 (DEFAULT_TABLE table=default.Table_caaf22211b564ae8a28d2c4987248a7b [id=f1e914e3be1d450ab4f7f605af71bfa1]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:38.496446 13464 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d2b8e6df64ef49e2ba36c093efd3c351. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:38.496445 13603 tablet_service.cc:1468] Processing CreateTablet for tablet d1bf58d367f54ba8bad64887b9a8d9cc (DEFAULT_TABLE table=default.Table_affac1e19f984bf38960e637cb801588 [id=b163cf9c3a7c4c61b0f0d0143ffbeb6f]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:38.496814 13603 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1bf58d367f54ba8bad64887b9a8d9cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:38.452657 13600 tablet_service.cc:1468] Processing CreateTablet for tablet 4b403cadfb7b42f8896b2ee16b50ecb1 (DEFAULT_TABLE table=default.Table_106c5d91b7314b3398e48ac2c97aa95b [id=7f24e7d037584d65b1c480cf52b59fa9]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:38.455065 13595 tablet_service.cc:1468] Processing CreateTablet for tablet aee84a97524e4568acdc4ae1c74fb492 (DEFAULT_TABLE table=default.Table_65ab52329c314c13817e7261f5108188 [id=18b2c25896e546748465c4807b839cbf]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:38.456769 13602 tablet_service.cc:1468] Processing CreateTablet for tablet 3525652a73b8413b8ccbcb5824cc5880 (DEFAULT_TABLE table=default.Table_7369fede0ccd48d1bc738e5dcda4ab25 [id=af6c7908ff81481bbd041214ae6cf74c]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:38.499287 13600 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b403cadfb7b42f8896b2ee16b50ecb1. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:38.499667 13233 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_f42b593eb80b4833a31384f9aca872b0" } modify_external_catalogs: true
I20250830 07:54:38.500068 13602 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3525652a73b8413b8ccbcb5824cc5880. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:38.500105 13233 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_f42b593eb80b4833a31384f9aca872b0" } modify_external_catalogs: true
I20250830 07:54:38.500892 13595 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aee84a97524e4568acdc4ae1c74fb492. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:38.501811 13226 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_9de60d2dd0dc41fca2f01375068cd911" } new_table_name: "default.Table_286f41edfff142439df1257c3c4559e0" modify_external_catalogs: true
I20250830 07:54:38.502544 13227 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_69dd6a70cb6040c9b6a6d88a1cbb0ab2" } modify_external_catalogs: true
I20250830 07:54:38.502708 13227 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_69dd6a70cb6040c9b6a6d88a1cbb0ab2" } modify_external_catalogs: true
I20250830 07:54:38.505070 13229 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet e862fa77e16945bd94e405aa3474f021
I20250830 07:54:38.433315 13459 tablet_service.cc:1515] Processing DeleteTablet for tablet 7c8e248d938f4651ae13199122b08768 with delete_type TABLET_DATA_DELETED (replaced by tablet 7e9d6af1d7fc4d4b961583b44f2f962a) from {username='slave'} at 127.0.0.1:37956
I20250830 07:54:38.433568 13461 tablet_service.cc:1515] Processing DeleteTablet for tablet ec47a59c22ff4370bd21bc2a18336049 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:38 UTC) from {username='slave'} at 127.0.0.1:37956
I20250830 07:54:38.505863 13230 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_79f5696bfda54c74b293dfd15540cac9" } new_table_name: "default.Table_c84716cd62b9446384ad71e0503211db" modify_external_catalogs: true
I20250830 07:54:38.505945 13229 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_6870747baea44adaad44f6d6fb61285a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250830 07:54:38.506486 13886 tablet_bootstrap.cc:654] T c3b35ea656db4741a02e6746e1b049ec P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
W20250830 07:54:38.506517 13229 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6870747baea44adaad44f6d6fb61285a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:38.507212 13234 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_a80b1e63a1564ede800990c7cfc0b9b3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250830 07:54:38.463385 13593 tablet_service.cc:1468] Processing CreateTablet for tablet 74ea2298876a4066b297915c135d4618 (DEFAULT_TABLE table=default.Table_062f0e529a09425da9da5b7ab68a6e38 [id=c61cd884076e445791d32f8c83d1229f]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:38.465091 13598 tablet_service.cc:1468] Processing CreateTablet for tablet b83dfc54383d4e7b96523568aea5c9f3 (DEFAULT_TABLE table=default.Table_1c1a8a41b5bc44b6b33f0d33246d5d56 [id=803bcda3ed6641749163c3162af467f2]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:38.507180 13225 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_2c46d09a19884723bb6778784b0e3fa0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250830 07:54:38.507551 13461 tablet_service.cc:1515] Processing DeleteTablet for tablet e862fa77e16945bd94e405aa3474f021 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:38 UTC) from {username='slave'} at 127.0.0.1:37956
W20250830 07:54:38.507754 13234 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a80b1e63a1564ede800990c7cfc0b9b3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250830 07:54:38.507817 13225 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2c46d09a19884723bb6778784b0e3fa0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:38.516191 13772 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "d4e35395930f4c37b34649da5718aa1f" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f"
I20250830 07:54:38.516429 13772 raft_consensus.cc:3058] T d4e35395930f4c37b34649da5718aa1f P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:38.517819 13883 log.cc:1199] T 2009012fddc24e4fb7ad0fab33a1103b P 2065c332f15a4739899af79f3669c3ba: Deleting WAL directory at /tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/ts-0/wal/wals/2009012fddc24e4fb7ad0fab33a1103b
I20250830 07:54:38.518316 13883 ts_tablet_manager.cc:1939] T 2009012fddc24e4fb7ad0fab33a1103b P 2065c332f15a4739899af79f3669c3ba: Deleting consensus metadata
I20250830 07:54:38.442090 13458 tablet_service.cc:1468] Processing CreateTablet for tablet de3a52a8e08a45808373902a0185e6f0 (DEFAULT_TABLE table=default.Table_a4097958af86408498f5bc26a4fc0871 [id=0ca73c1fbe9f48ad82737dca6997e50e]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:38.447217 13456 tablet_service.cc:1468] Processing CreateTablet for tablet 4b403cadfb7b42f8896b2ee16b50ecb1 (DEFAULT_TABLE table=default.Table_106c5d91b7314b3398e48ac2c97aa95b [id=7f24e7d037584d65b1c480cf52b59fa9]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:38.454692 13450 tablet_service.cc:1468] Processing CreateTablet for tablet aee84a97524e4568acdc4ae1c74fb492 (DEFAULT_TABLE table=default.Table_65ab52329c314c13817e7261f5108188 [id=18b2c25896e546748465c4807b839cbf]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:38.456384 13454 tablet_service.cc:1468] Processing CreateTablet for tablet 3525652a73b8413b8ccbcb5824cc5880 (DEFAULT_TABLE table=default.Table_7369fede0ccd48d1bc738e5dcda4ab25 [id=af6c7908ff81481bbd041214ae6cf74c]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:38.462368 13463 tablet_service.cc:1468] Processing CreateTablet for tablet 74ea2298876a4066b297915c135d4618 (DEFAULT_TABLE table=default.Table_062f0e529a09425da9da5b7ab68a6e38 [id=c61cd884076e445791d32f8c83d1229f]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:38.467222 13466 tablet_service.cc:1468] Processing CreateTablet for tablet b83dfc54383d4e7b96523568aea5c9f3 (DEFAULT_TABLE table=default.Table_1c1a8a41b5bc44b6b33f0d33246d5d56 [id=803bcda3ed6641749163c3162af467f2]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:38.472373 13462 tablet_service.cc:1468] Processing CreateTablet for tablet 65f1ee59e6e9498381d686f16a865e23 (DEFAULT_TABLE table=default.Table_df1448b0d1b44810b3ce8ad508249df6 [id=3cf0d12aa7644ef4abfcf50bdba92a79]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:38.472715 13449 tablet_service.cc:1468] Processing CreateTablet for tablet 0ceccc5f18294356894695fe08d73e30 (DEFAULT_TABLE table=default.Table_049167f2b5e44e98b771e19ddb7ac501 [id=0e99ba575a7a4f8dae74a98627249018]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:38.475905 13486 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "27da527d9fe045ae8c17f193d034f5ac" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:54:38.520069 13486 raft_consensus.cc:2466] T 27da527d9fe045ae8c17f193d034f5ac P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 0.
I20250830 07:54:38.486480 13453 tablet_service.cc:1468] Processing CreateTablet for tablet d1bf58d367f54ba8bad64887b9a8d9cc (DEFAULT_TABLE table=default.Table_affac1e19f984bf38960e637cb801588 [id=b163cf9c3a7c4c61b0f0d0143ffbeb6f]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:38.520484 13701 leader_election.cc:304] T 27da527d9fe045ae8c17f193d034f5ac P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters:
I20250830 07:54:38.520866 14287 raft_consensus.cc:2802] T 27da527d9fe045ae8c17f193d034f5ac P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:54:38.520967 14287 raft_consensus.cc:491] T 27da527d9fe045ae8c17f193d034f5ac P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:54:38.521035 14287 raft_consensus.cc:3058] T 27da527d9fe045ae8c17f193d034f5ac P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:38.523833 14287 raft_consensus.cc:513] T 27da527d9fe045ae8c17f193d034f5ac P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:38.525385 14287 leader_election.cc:290] T 27da527d9fe045ae8c17f193d034f5ac P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Requested vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967)
W20250830 07:54:38.528331 13220 catalog_manager.cc:4895] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet ec47a59c22ff4370bd21bc2a18336049 because the tablet was not found. No further retry: Not found: Tablet not found: ec47a59c22ff4370bd21bc2a18336049
I20250830 07:54:38.528659 13486 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "27da527d9fe045ae8c17f193d034f5ac" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba"
I20250830 07:54:38.528924 13486 raft_consensus.cc:3058] T 27da527d9fe045ae8c17f193d034f5ac P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:38.528925 13456 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b403cadfb7b42f8896b2ee16b50ecb1. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:38.529965 13737 tablet_service.cc:1515] Processing DeleteTablet for tablet e862fa77e16945bd94e405aa3474f021 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:38 UTC) from {username='slave'} at 127.0.0.1:45460
I20250830 07:54:38.532629 13486 raft_consensus.cc:2466] T 27da527d9fe045ae8c17f193d034f5ac P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 1.
I20250830 07:54:38.533202 13701 leader_election.cc:304] T 27da527d9fe045ae8c17f193d034f5ac P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters:
I20250830 07:54:38.533614 14287 raft_consensus.cc:2802] T 27da527d9fe045ae8c17f193d034f5ac P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election won for term 1
I20250830 07:54:38.533824 14287 raft_consensus.cc:695] T 27da527d9fe045ae8c17f193d034f5ac P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 LEADER]: Becoming Leader. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Running, Role: LEADER
I20250830 07:54:38.495625 13455 tablet_service.cc:1468] Processing CreateTablet for tablet ff72a0fd9a0e46a6bd54a15e4ad783b4 (DEFAULT_TABLE table=default.Table_85e7f0b13c094fd7841dcabce61fd911 [id=de7b214458f247ef831f43727543afc5]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:38.534106 14287 consensus_queue.cc:237] T 27da527d9fe045ae8c17f193d034f5ac P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:38.535092 13450 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aee84a97524e4568acdc4ae1c74fb492. 1 dirs total, 0 dirs full, 0 dirs failed
W20250830 07:54:38.536674 13220 catalog_manager.cc:4895] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet f66e1d07039841088a444ee0203a4eb0 because the tablet was not found. No further retry: Not found: Tablet not found: f66e1d07039841088a444ee0203a4eb0
I20250830 07:54:38.538549 13455 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff72a0fd9a0e46a6bd54a15e4ad783b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:38.541019 13463 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 74ea2298876a4066b297915c135d4618. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:38.541460 13593 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 74ea2298876a4066b297915c135d4618. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:38.541481 13232 catalog_manager.cc:5864] Not sending DeleteTablet requests; no consensus state for tablet f4e07ba34525405ebe8dae182520d896
I20250830 07:54:38.541882 13232 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_0cebf3f048d64286a08f66238dbbc35f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:38.542479 13232 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0cebf3f048d64286a08f66238dbbc35f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:38.542966 13598 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b83dfc54383d4e7b96523568aea5c9f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:38.544095 13233 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet e6060a3dc6444483b8fb2944b8090cb6
I20250830 07:54:38.545261 13233 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_58be973418b94b6d9c25747a596793b6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:38.545820 13233 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_58be973418b94b6d9c25747a596793b6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:38.547008 13454 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3525652a73b8413b8ccbcb5824cc5880. 1 dirs total, 0 dirs full, 0 dirs failed
W20250830 07:54:38.547592 13226 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 33701eeb12fc451d90ae0b1c4dd7d134 consensus state has no leader
I20250830 07:54:38.547958 13226 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_b0514d974e9d4da1b8599e38ea5657cb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:38.548498 13226 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b0514d974e9d4da1b8599e38ea5657cb in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:38.549764 13601 tablet_service.cc:1515] Processing DeleteTablet for tablet e862fa77e16945bd94e405aa3474f021 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:38 UTC) from {username='slave'} at 127.0.0.1:45306
I20250830 07:54:38.549953 13227 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet 7c5e50cb605c4a40b47984f328eedd93
I20250830 07:54:38.550650 13452 tablet_service.cc:1515] Processing DeleteTablet for tablet 7c5e50cb605c4a40b47984f328eedd93 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:38 UTC) from {username='slave'} at 127.0.0.1:37956
I20250830 07:54:38.550949 13629 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "6492bd11e50d4900927db0de3757aa24" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:38.551044 13227 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_dcc3f90b74de4848b1d750ec0aa814f4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:38.551671 13227 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_dcc3f90b74de4848b1d750ec0aa814f4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:38.553388 13462 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 65f1ee59e6e9498381d686f16a865e23. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:38.553763 13606 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff72a0fd9a0e46a6bd54a15e4ad783b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:38.554684 13229 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_0b763c9c5ec849f9830f2670d074b17c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:38.555223 13229 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0b763c9c5ec849f9830f2670d074b17c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:38.556676 13228 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet a8660a6ff9254d4f9f0ef047b8682ed1
I20250830 07:54:38.557477 13452 tablet_service.cc:1515] Processing DeleteTablet for tablet a8660a6ff9254d4f9f0ef047b8682ed1 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:38 UTC) from {username='slave'} at 127.0.0.1:37956
I20250830 07:54:38.557896 13228 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_10814d96e8104432b92e4084232ada15" } new_table_name: "default.Table_844cfa31981f4db594c87b260d390b06" modify_external_catalogs: true
I20250830 07:54:38.560240 13627 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "c3b35ea656db4741a02e6746e1b049ec" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:38.561126 13452 tablet_service.cc:1468] Processing CreateTablet for tablet 1e48641532cd439e9b4074712033c737 (DEFAULT_TABLE table=default.Table_e4f722cf97f34259b0ef37b76c007dee [id=4e107bdebbc749af933e7cd0ee557f9f]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:38.562216 13449 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ceccc5f18294356894695fe08d73e30. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:38.562335 13738 tablet_service.cc:1515] Processing DeleteTablet for tablet 7c5e50cb605c4a40b47984f328eedd93 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:38 UTC) from {username='slave'} at 127.0.0.1:45460
I20250830 07:54:38.562561 13755 tablet_service.cc:1468] Processing CreateTablet for tablet 43e93d3038f7496ebb18319420ab67e0 (DEFAULT_TABLE table=default.Table_7669c1559ff94b0b9ce898713cc8ea9e [id=6e83b7e7a9ee4e7fa80aa264ee97e1ff]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:38.563100 13755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43e93d3038f7496ebb18319420ab67e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:38.496018 13468 tablet_service.cc:1468] Processing CreateTablet for tablet d37fe59b4f964f30bb1ed4cb00868b75 (DEFAULT_TABLE table=default.Table_8fc143e40fc14b37bac695b6f7604eed [id=3abbecb154a042428e6d68d43bf105fb]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:38.566975 13452 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e48641532cd439e9b4074712033c737. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:38.567739 13746 tablet_service.cc:1515] Processing DeleteTablet for tablet a8660a6ff9254d4f9f0ef047b8682ed1 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:38 UTC) from {username='slave'} at 127.0.0.1:45460
I20250830 07:54:38.569386 13741 tablet_service.cc:1468] Processing CreateTablet for tablet e6060a3dc6444483b8fb2944b8090cb6 (DEFAULT_TABLE table=default.Table_f42b593eb80b4833a31384f9aca872b0 [id=aa0ebb9820ff4b219cb0c5960a6764dd]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:38.569511 13625 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "05da843c0fe4482a926e410e06b22461" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:38.569746 13625 raft_consensus.cc:2391] T 05da843c0fe4482a926e410e06b22461 P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b057ade5dce45af9f8bf0bedf8b917f in current term 1: Already voted for candidate 2065c332f15a4739899af79f3669c3ba in this term.
I20250830 07:54:38.569780 13466 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b83dfc54383d4e7b96523568aea5c9f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:38.570039 13741 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6060a3dc6444483b8fb2944b8090cb6. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:38.575742 13737 tablet_service.cc:1515] Processing DeleteTablet for tablet e6060a3dc6444483b8fb2944b8090cb6 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:38 UTC) from {username='slave'} at 127.0.0.1:45460
I20250830 07:54:38.576386 13485 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "9696d8531a174585b8fd83a2391c02f7" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:54:38.577013 13453 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1bf58d367f54ba8bad64887b9a8d9cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:38.577359 13468 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d37fe59b4f964f30bb1ed4cb00868b75. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:38.577951 13601 tablet_service.cc:1515] Processing DeleteTablet for tablet e6060a3dc6444483b8fb2944b8090cb6 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:38 UTC) from {username='slave'} at 127.0.0.1:45306
I20250830 07:54:38.578258 13464 tablet_service.cc:1468] Processing CreateTablet for tablet e6060a3dc6444483b8fb2944b8090cb6 (DEFAULT_TABLE table=default.Table_f42b593eb80b4833a31384f9aca872b0 [id=aa0ebb9820ff4b219cb0c5960a6764dd]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:38.582830 13458 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de3a52a8e08a45808373902a0185e6f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:38.583540 13461 tablet_service.cc:1468] Processing CreateTablet for tablet 43e93d3038f7496ebb18319420ab67e0 (DEFAULT_TABLE table=default.Table_7669c1559ff94b0b9ce898713cc8ea9e [id=6e83b7e7a9ee4e7fa80aa264ee97e1ff]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:38.584899 13459 tablet_service.cc:1515] Processing DeleteTablet for tablet e6060a3dc6444483b8fb2944b8090cb6 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:38 UTC) from {username='slave'} at 127.0.0.1:37956
I20250830 07:54:38.586019 13886 tablet_bootstrap.cc:492] T c3b35ea656db4741a02e6746e1b049ec P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:54:38.586246 13886 ts_tablet_manager.cc:1397] T c3b35ea656db4741a02e6746e1b049ec P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.135s user 0.004s sys 0.000s
I20250830 07:54:38.587158 13602 tablet_service.cc:1468] Processing CreateTablet for tablet 43e93d3038f7496ebb18319420ab67e0 (DEFAULT_TABLE table=default.Table_7669c1559ff94b0b9ce898713cc8ea9e [id=6e83b7e7a9ee4e7fa80aa264ee97e1ff]), partition=RANGE (key) PARTITION UNBOUNDED
W20250830 07:54:38.587358 13220 catalog_manager.cc:4908] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet e862fa77e16945bd94e405aa3474f021 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e862fa77e16945bd94e405aa3474f021 already in progress: creating tablet
W20250830 07:54:38.587639 13220 catalog_manager.cc:4895] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet e6060a3dc6444483b8fb2944b8090cb6 because the tablet was not found. No further retry: Not found: Tablet not found: e6060a3dc6444483b8fb2944b8090cb6
W20250830 07:54:38.587738 13231 catalog_manager.cc:5415] Ignoring report from unknown tablet 9696d8531a174585b8fd83a2391c02f7
I20250830 07:54:38.576280 13218 catalog_manager.cc:4928] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): tablet 2009012fddc24e4fb7ad0fab33a1103b (table default.Table_3af4480a9af740f598919322e7fc5efc [id=b3fced981b2a4b44a8eab43675699ba5]) successfully deleted
I20250830 07:54:38.588423 13629 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "91ab8c468c8143b9ae11b839a95a26fd" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9"
I20250830 07:54:38.591044 13596 tablet_service.cc:1515] Processing DeleteTablet for tablet 7c5e50cb605c4a40b47984f328eedd93 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:38 UTC) from {username='slave'} at 127.0.0.1:45306
I20250830 07:54:38.588317 13954 consensus_queue.cc:1035] T 3167b609ed184decb4ccdb4945933ebb P 2065c332f15a4739899af79f3669c3ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.010s
W20250830 07:54:38.592905 13220 catalog_manager.cc:4895] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet 7c5e50cb605c4a40b47984f328eedd93 because the tablet was not found. No further retry: Not found: Tablet not found: 7c5e50cb605c4a40b47984f328eedd93
I20250830 07:54:38.598980 13464 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6060a3dc6444483b8fb2944b8090cb6. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:38.599849 13461 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43e93d3038f7496ebb18319420ab67e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:38.604058 13884 raft_consensus.cc:2241] T 7c8e248d938f4651ae13199122b08768 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Raft consensus shutting down.
I20250830 07:54:38.609923 13884 pending_rounds.cc:70] T 7c8e248d938f4651ae13199122b08768 P 9b057ade5dce45af9f8bf0bedf8b917f: Trying to abort 1 pending ops.
I20250830 07:54:38.610005 13884 pending_rounds.cc:77] T 7c8e248d938f4651ae13199122b08768 P 9b057ade5dce45af9f8bf0bedf8b917f: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7194789794542325760 op_type: NO_OP noop_request { }
I20250830 07:54:38.610138 13884 raft_consensus.cc:2887] T 7c8e248d938f4651ae13199122b08768 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20250830 07:54:38.610255 13884 raft_consensus.cc:2270] T 7c8e248d938f4651ae13199122b08768 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Raft consensus is shut down!
I20250830 07:54:38.610837 13746 tablet_service.cc:1468] Processing CreateTablet for tablet a8baad9c419e436b9659d8d5582d4066 (DEFAULT_TABLE table=default.Table_13f58d14bfbd46279e17abb34c722044 [id=aa01e396828e4f3caff27c57fad0cce2]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:38.611467 13737 tablet_service.cc:1468] Processing CreateTablet for tablet 1e48641532cd439e9b4074712033c737 (DEFAULT_TABLE table=default.Table_e4f722cf97f34259b0ef37b76c007dee [id=4e107bdebbc749af933e7cd0ee557f9f]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:38.612398 13591 tablet_service.cc:1468] Processing CreateTablet for tablet 1e48641532cd439e9b4074712033c737 (DEFAULT_TABLE table=default.Table_e4f722cf97f34259b0ef37b76c007dee [id=4e107bdebbc749af933e7cd0ee557f9f]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:38.614426 13738 tablet_service.cc:1468] Processing CreateTablet for tablet 8ae468b43b4c450ca7591b543c2539d9 (DEFAULT_TABLE table=default.Table_80adb7e372ef4a98bd60fe6337d06400 [id=aa617ba5edb54a248d9e95035ebd2c96]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:38.615428 13886 raft_consensus.cc:357] T c3b35ea656db4741a02e6746e1b049ec P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:38.615625 13886 raft_consensus.cc:383] T c3b35ea656db4741a02e6746e1b049ec P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:38.615695 13886 raft_consensus.cc:738] T c3b35ea656db4741a02e6746e1b049ec P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:54:38.615675 13601 tablet_service.cc:1468] Processing CreateTablet for tablet e6060a3dc6444483b8fb2944b8090cb6 (DEFAULT_TABLE table=default.Table_f42b593eb80b4833a31384f9aca872b0 [id=aa0ebb9820ff4b219cb0c5960a6764dd]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:38.615917 13886 consensus_queue.cc:260] T c3b35ea656db4741a02e6746e1b049ec P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:38.616086 13590 tablet_service.cc:1468] Processing CreateTablet for tablet 8ae468b43b4c450ca7591b543c2539d9 (DEFAULT_TABLE table=default.Table_80adb7e372ef4a98bd60fe6337d06400 [id=aa617ba5edb54a248d9e95035ebd2c96]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:38.616485 13886 ts_tablet_manager.cc:1428] T c3b35ea656db4741a02e6746e1b049ec P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20250830 07:54:38.618168 13596 tablet_service.cc:1468] Processing CreateTablet for tablet a8baad9c419e436b9659d8d5582d4066 (DEFAULT_TABLE table=default.Table_13f58d14bfbd46279e17abb34c722044 [id=aa01e396828e4f3caff27c57fad0cce2]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:38.618539 13746 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8baad9c419e436b9659d8d5582d4066. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:38.618865 13595 tablet_service.cc:1515] Processing DeleteTablet for tablet a8660a6ff9254d4f9f0ef047b8682ed1 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:38 UTC) from {username='slave'} at 127.0.0.1:45306
W20250830 07:54:38.620267 13220 catalog_manager.cc:4895] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet a8660a6ff9254d4f9f0ef047b8682ed1 because the tablet was not found. No further retry: Not found: Tablet not found: a8660a6ff9254d4f9f0ef047b8682ed1
I20250830 07:54:38.620271 13627 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "27da527d9fe045ae8c17f193d034f5ac" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:38.620836 13627 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "27da527d9fe045ae8c17f193d034f5ac" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9"
I20250830 07:54:38.627787 13772 raft_consensus.cc:2466] T d4e35395930f4c37b34649da5718aa1f P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b5e454d98894637b466ea27f1b647f9 in term 1.
I20250830 07:54:38.628801 13737 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e48641532cd439e9b4074712033c737. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:38.629185 13738 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ae468b43b4c450ca7591b543c2539d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:38.630939 13602 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43e93d3038f7496ebb18319420ab67e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:38.631210 13596 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8baad9c419e436b9659d8d5582d4066. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:38.631397 13591 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e48641532cd439e9b4074712033c737. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:38.631597 13884 ts_tablet_manager.cc:1905] T 7c8e248d938f4651ae13199122b08768 P 9b057ade5dce45af9f8bf0bedf8b917f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250830 07:54:38.632241 13590 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ae468b43b4c450ca7591b543c2539d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:38.637642 13884 ts_tablet_manager.cc:1918] T 7c8e248d938f4651ae13199122b08768 P 9b057ade5dce45af9f8bf0bedf8b917f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250830 07:54:38.637778 13884 log.cc:1199] T 7c8e248d938f4651ae13199122b08768 P 9b057ade5dce45af9f8bf0bedf8b917f: Deleting WAL directory at /tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/ts-2/wal/wals/7c8e248d938f4651ae13199122b08768
I20250830 07:54:38.638172 13884 ts_tablet_manager.cc:1939] T 7c8e248d938f4651ae13199122b08768 P 9b057ade5dce45af9f8bf0bedf8b917f: Deleting consensus metadata
I20250830 07:54:38.642395 13219 catalog_manager.cc:4928] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): tablet 7c8e248d938f4651ae13199122b08768 (table default.Table_b272b07ca0614cafb8c14f4e2132d255 [id=957201242ea748618cc610a5002a8684]) successfully deleted
W20250830 07:54:38.642788 13219 catalog_manager.cc:4895] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): delete failed for tablet ec47a59c22ff4370bd21bc2a18336049 because the tablet was not found. No further retry: Not found: Tablet not found: ec47a59c22ff4370bd21bc2a18336049
I20250830 07:54:38.642894 13601 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6060a3dc6444483b8fb2944b8090cb6. 1 dirs total, 0 dirs full, 0 dirs failed
W20250830 07:54:38.643095 13219 catalog_manager.cc:4895] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): delete failed for tablet f66e1d07039841088a444ee0203a4eb0 because the tablet was not found. No further retry: Not found: Tablet not found: f66e1d07039841088a444ee0203a4eb0
W20250830 07:54:38.643354 13219 catalog_manager.cc:4908] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): delete failed for tablet e862fa77e16945bd94e405aa3474f021 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e862fa77e16945bd94e405aa3474f021 already in progress: creating tablet
W20250830 07:54:38.643580 13219 catalog_manager.cc:4895] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): delete failed for tablet 7c5e50cb605c4a40b47984f328eedd93 because the tablet was not found. No further retry: Not found: Tablet not found: 7c5e50cb605c4a40b47984f328eedd93
W20250830 07:54:38.643795 13219 catalog_manager.cc:4895] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): delete failed for tablet a8660a6ff9254d4f9f0ef047b8682ed1 because the tablet was not found. No further retry: Not found: Tablet not found: a8660a6ff9254d4f9f0ef047b8682ed1
W20250830 07:54:38.644086 13219 catalog_manager.cc:4895] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): delete failed for tablet e6060a3dc6444483b8fb2944b8090cb6 because the tablet was not found. No further retry: Not found: Tablet not found: e6060a3dc6444483b8fb2944b8090cb6
I20250830 07:54:38.644697 14287 raft_consensus.cc:491] T afb132e8a5b14a029e005e375f276348 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:38.644938 14287 raft_consensus.cc:513] T afb132e8a5b14a029e005e375f276348 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:38.646958 14287 leader_election.cc:290] T afb132e8a5b14a029e005e375f276348 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967)
I20250830 07:54:38.649338 13703 leader_election.cc:304] T 05da843c0fe4482a926e410e06b22461 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 2065c332f15a4739899af79f3669c3ba, 6b5e454d98894637b466ea27f1b647f9
W20250830 07:54:38.649931 13703 leader_election.cc:343] T 91ab8c468c8143b9ae11b839a95a26fd P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:38.650854 14315 raft_consensus.cc:3058] T 05da843c0fe4482a926e410e06b22461 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
W20250830 07:54:38.650944 13703 leader_election.cc:343] T 27da527d9fe045ae8c17f193d034f5ac P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
W20250830 07:54:38.651248 13703 leader_election.cc:343] T 27da527d9fe045ae8c17f193d034f5ac P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:38.652169 13562 leader_election.cc:304] T 48b422b125154fbdbb9c995dc372d128 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b5e454d98894637b466ea27f1b647f9; no voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:54:38.652419 14446 raft_consensus.cc:3058] T 48b422b125154fbdbb9c995dc372d128 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:38.653489 14315 raft_consensus.cc:2747] T 05da843c0fe4482a926e410e06b22461 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:54:38.654567 13590 tablet_service.cc:1468] Processing CreateTablet for tablet 410b1e2d520c470eb4b9ab60104e0cd4 (DEFAULT_TABLE table=default.Table_98c8314f6ad34324b9f857226d762d7d [id=6a8f7192d53441c383824fb67bed40df]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:38.654798 14315 raft_consensus.cc:491] T 50360492db824755a6de251436cab5c6 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:38.654963 14315 raft_consensus.cc:513] T 50360492db824755a6de251436cab5c6 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:38.655215 13590 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 410b1e2d520c470eb4b9ab60104e0cd4. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:38.655678 14315 leader_election.cc:290] T 50360492db824755a6de251436cab5c6 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
I20250830 07:54:38.658186 13738 tablet_service.cc:1468] Processing CreateTablet for tablet 410b1e2d520c470eb4b9ab60104e0cd4 (DEFAULT_TABLE table=default.Table_98c8314f6ad34324b9f857226d762d7d [id=6a8f7192d53441c383824fb67bed40df]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:38.658674 13738 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 410b1e2d520c470eb4b9ab60104e0cd4. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:38.660101 14446 raft_consensus.cc:2747] T 48b422b125154fbdbb9c995dc372d128 P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:54:38.660899 13593 tablet_service.cc:1468] Processing CreateTablet for tablet 70703eb1d47841a1a227e277ed6a268d (DEFAULT_TABLE table=default.Table_b5663761ffc54702be1146492aaf6430 [id=f8ee1dbbf2df48dea75fa01ffbfdebd9]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:38.660392 13608 tablet_service.cc:1468] Processing CreateTablet for tablet 519b3e58b63b402d84e234f5e180b98c (DEFAULT_TABLE table=default.Table_654a7f85db4149ab81cf988af807fe0b [id=297cf31cb8d04fe3b40216565c923e5f]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:38.662645 13593 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 70703eb1d47841a1a227e277ed6a268d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:38.667053 13739 tablet_service.cc:1468] Processing CreateTablet for tablet 28c2f7a3a6dd444585f0f5d337b985e9 (DEFAULT_TABLE table=default.Table_5486f1dec4564e6db48bab52a8b297eb [id=9fd46fc815604123bcb15dc7ecd892a9]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:38.667528 13739 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 28c2f7a3a6dd444585f0f5d337b985e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:38.668792 13595 tablet_service.cc:1468] Processing CreateTablet for tablet 9ffa3c1d128c49c8b8e2566c6a64304a (DEFAULT_TABLE table=default.Table_0f1c1d835d57490a8d95803a9a51e3a9 [id=61e13d21a8264ef982043d5fb4e2ddef]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:38.669137 13600 tablet_service.cc:1468] Processing CreateTablet for tablet 28c2f7a3a6dd444585f0f5d337b985e9 (DEFAULT_TABLE table=default.Table_5486f1dec4564e6db48bab52a8b297eb [id=9fd46fc815604123bcb15dc7ecd892a9]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:38.670579 13608 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 519b3e58b63b402d84e234f5e180b98c. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:38.674754 13754 tablet_service.cc:1468] Processing CreateTablet for tablet d64f20df166a46249c08444f44422fc3 (DEFAULT_TABLE table=default.Table_d72a50af0d2844f0b50c767903f8f693 [id=26a7abb1aee44e438ca996ebb2ab37b2]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:38.675211 13754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d64f20df166a46249c08444f44422fc3. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:38.676410 14315 consensus_queue.cc:1035] T 9b9c2ae8805a48f7959d6745677a96f2 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:54:38.680292 13595 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ffa3c1d128c49c8b8e2566c6a64304a. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:38.680115 13773 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "9696d8531a174585b8fd83a2391c02f7" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:38.682065 13739 tablet_service.cc:1468] Processing CreateTablet for tablet 087bb1e80d2d44bf8619b0341ff99527 (DEFAULT_TABLE table=default.Table_1cda1cda267540b4bcc19d4ac70c0519 [id=bbfbc80659fd4a558cd48597a7456667]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:38.682531 13739 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 087bb1e80d2d44bf8619b0341ff99527. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:38.682948 13600 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 28c2f7a3a6dd444585f0f5d337b985e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:38.687784 13754 tablet_service.cc:1468] Processing CreateTablet for tablet 3c3c798b2b7b460b98a30605464763e6 (DEFAULT_TABLE table=default.Table_79f5696bfda54c74b293dfd15540cac9 [id=9407d235897b4b56927798496fd114c4]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:38.688298 13754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c3c798b2b7b460b98a30605464763e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:38.689590 13598 tablet_service.cc:1468] Processing CreateTablet for tablet 087bb1e80d2d44bf8619b0341ff99527 (DEFAULT_TABLE table=default.Table_1cda1cda267540b4bcc19d4ac70c0519 [id=bbfbc80659fd4a558cd48597a7456667]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:38.690030 13886 tablet_bootstrap.cc:492] T cada6410e2884c508bb7dd38bea438ae P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:54:38.690902 13603 tablet_service.cc:1468] Processing CreateTablet for tablet d64f20df166a46249c08444f44422fc3 (DEFAULT_TABLE table=default.Table_d72a50af0d2844f0b50c767903f8f693 [id=26a7abb1aee44e438ca996ebb2ab37b2]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:38.692025 13886 tablet_bootstrap.cc:654] T cada6410e2884c508bb7dd38bea438ae P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:38.694476 13598 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 087bb1e80d2d44bf8619b0341ff99527. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:38.695564 13606 tablet_service.cc:1468] Processing CreateTablet for tablet 3c3c798b2b7b460b98a30605464763e6 (DEFAULT_TABLE table=default.Table_79f5696bfda54c74b293dfd15540cac9 [id=9407d235897b4b56927798496fd114c4]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:38.695915 13603 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d64f20df166a46249c08444f44422fc3. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:38.696010 13742 tablet_service.cc:1468] Processing CreateTablet for tablet 9ffa3c1d128c49c8b8e2566c6a64304a (DEFAULT_TABLE table=default.Table_0f1c1d835d57490a8d95803a9a51e3a9 [id=61e13d21a8264ef982043d5fb4e2ddef]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:38.696523 13742 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ffa3c1d128c49c8b8e2566c6a64304a. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:38.699170 13629 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "afb132e8a5b14a029e005e375f276348" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
W20250830 07:54:38.699599 13423 consensus_peers.cc:489] T 7c8e248d938f4651ae13199122b08768 P 2065c332f15a4739899af79f3669c3ba -> Peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Couldn't send request to peer 6b5e454d98894637b466ea27f1b647f9. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7c8e248d938f4651ae13199122b08768. This is attempt 1: this message will repeat every 5th retry.
I20250830 07:54:38.699668 13606 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c3c798b2b7b460b98a30605464763e6. 1 dirs total, 0 dirs full, 0 dirs failed
W20250830 07:54:38.701463 13423 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.209.2:38967, user_credentials={real_user=slave}} blocked reactor thread for 55133.5us
W20250830 07:54:38.702168 13423 leader_election.cc:343] T 6492bd11e50d4900927db0de3757aa24 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:38.704471 13750 tablet_service.cc:1468] Processing CreateTablet for tablet 519b3e58b63b402d84e234f5e180b98c (DEFAULT_TABLE table=default.Table_654a7f85db4149ab81cf988af807fe0b [id=297cf31cb8d04fe3b40216565c923e5f]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:38.704974 13750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 519b3e58b63b402d84e234f5e180b98c. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:38.715245 13749 tablet_service.cc:1468] Processing CreateTablet for tablet 70703eb1d47841a1a227e277ed6a268d (DEFAULT_TABLE table=default.Table_b5663761ffc54702be1146492aaf6430 [id=f8ee1dbbf2df48dea75fa01ffbfdebd9]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:38.715814 13749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 70703eb1d47841a1a227e277ed6a268d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:38.718030 13423 leader_election.cc:304] T 6492bd11e50d4900927db0de3757aa24 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba; no voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:54:38.726540 13452 tablet_service.cc:1468] Processing CreateTablet for tablet 519b3e58b63b402d84e234f5e180b98c (DEFAULT_TABLE table=default.Table_654a7f85db4149ab81cf988af807fe0b [id=297cf31cb8d04fe3b40216565c923e5f]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:38.727372 13449 tablet_service.cc:1468] Processing CreateTablet for tablet 410b1e2d520c470eb4b9ab60104e0cd4 (DEFAULT_TABLE table=default.Table_98c8314f6ad34324b9f857226d762d7d [id=6a8f7192d53441c383824fb67bed40df]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:38.727766 13449 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 410b1e2d520c470eb4b9ab60104e0cd4. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:38.728816 13452 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 519b3e58b63b402d84e234f5e180b98c. 1 dirs total, 0 dirs full, 0 dirs failed
W20250830 07:54:38.741752 13703 leader_election.cc:343] T afb132e8a5b14a029e005e375f276348 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
W20250830 07:54:38.742843 13703 leader_election.cc:343] T 50360492db824755a6de251436cab5c6 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Not found: Tablet not found: 50360492db824755a6de251436cab5c6
I20250830 07:54:38.756814 13886 tablet_bootstrap.cc:492] T cada6410e2884c508bb7dd38bea438ae P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
W20250830 07:54:38.757552 13219 catalog_manager.cc:4726] Async tablet task AlterTable RPC for tablet 33701eeb12fc451d90ae0b1c4dd7d134 (table default.Table_286f41edfff142439df1257c3c4559e0 [id=e8d3cb9074b1481b811287ab708db176], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 33701eeb12fc451d90ae0b1c4dd7d134 consensus state has no leader
I20250830 07:54:38.758049 13886 ts_tablet_manager.cc:1397] T cada6410e2884c508bb7dd38bea438ae P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.068s user 0.006s sys 0.000s
I20250830 07:54:38.764853 13886 raft_consensus.cc:357] T cada6410e2884c508bb7dd38bea438ae P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:38.764969 13602 tablet_service.cc:1468] Processing CreateTablet for tablet d1153d8cd2994377ac0dcbfeeda1fd52 (DEFAULT_TABLE table=default.Table_b2b6c71b45ea47a088960316d6b712a5 [id=c46d6d03fcc14be2ad2edd43a904a020]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:38.766031 13591 tablet_service.cc:1468] Processing CreateTablet for tablet ca959e42c8764eeba0faee96caf8b39f (DEFAULT_TABLE table=default.Table_78055261418242849901a0fd7e88083e [id=a44f6adf02ab4c2ca726561ad07fb7c5]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:38.766469 13886 raft_consensus.cc:383] T cada6410e2884c508bb7dd38bea438ae P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:38.766455 13562 leader_election.cc:304] T 9696d8531a174585b8fd83a2391c02f7 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b5e454d98894637b466ea27f1b647f9; no voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:54:38.763870 13454 tablet_service.cc:1468] Processing CreateTablet for tablet 8ae468b43b4c450ca7591b543c2539d9 (DEFAULT_TABLE table=default.Table_80adb7e372ef4a98bd60fe6337d06400 [id=aa617ba5edb54a248d9e95035ebd2c96]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:38.766849 13886 raft_consensus.cc:738] T cada6410e2884c508bb7dd38bea438ae P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:54:38.737205 13883 tablet_replica.cc:331] T 7c8e248d938f4651ae13199122b08768 P 2065c332f15a4739899af79f3669c3ba: stopping tablet replica
I20250830 07:54:38.767433 13886 consensus_queue.cc:260] T cada6410e2884c508bb7dd38bea438ae P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:38.768040 13605 tablet_service.cc:1468] Processing CreateTablet for tablet 95b6f084eb5240ea94c125eaa154ac9f (DEFAULT_TABLE table=default.Table_de59395b45a5466eb264ad7be546608f [id=64375c1ac4f5471ba43d07a4d4bc31af]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:38.768304 14256 raft_consensus.cc:2747] T 9696d8531a174585b8fd83a2391c02f7 P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20250830 07:54:38.768656 13423 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.209.2:38967, user_credentials={real_user=slave}} blocked reactor thread for 66489.5us
I20250830 07:54:38.769665 13886 ts_tablet_manager.cc:1428] T cada6410e2884c508bb7dd38bea438ae P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.011s user 0.002s sys 0.000s
I20250830 07:54:38.771752 13886 tablet_bootstrap.cc:492] T e4f1ff6026bb45e28e63c27c83399d72 P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:54:38.774276 13596 tablet_service.cc:1468] Processing CreateTablet for tablet 7c5e50cb605c4a40b47984f328eedd93 (DEFAULT_TABLE table=default.Table_69dd6a70cb6040c9b6a6d88a1cbb0ab2 [id=15c0e8f130a24979b4f1dc35c13aab12]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:38.777349 13599 tablet_service.cc:1468] Processing CreateTablet for tablet da5c7b084e1f4fda92fff35a9cb2c7fc (DEFAULT_TABLE table=default.Table_147915363787467ea640b4240b6fd5a2 [id=5b0ef58b04834c50bb378d3ae9b64258]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:38.777490 13605 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95b6f084eb5240ea94c125eaa154ac9f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:38.777688 13599 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da5c7b084e1f4fda92fff35a9cb2c7fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:38.777925 13591 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca959e42c8764eeba0faee96caf8b39f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:38.774353 13459 tablet_service.cc:1468] Processing CreateTablet for tablet 9ffa3c1d128c49c8b8e2566c6a64304a (DEFAULT_TABLE table=default.Table_0f1c1d835d57490a8d95803a9a51e3a9 [id=61e13d21a8264ef982043d5fb4e2ddef]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:38.779736 13600 tablet_service.cc:1468] Processing CreateTablet for tablet 924403105a6a40f28aad60647a2a8987 (DEFAULT_TABLE table=default.Table_67739ac4113c4648920b4a24633396c5 [id=46ec9117fe9146cb807dd092284616fc]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:38.780144 13597 tablet_service.cc:1468] Processing CreateTablet for tablet 057bcce2860345da860acc262dc4d339 (DEFAULT_TABLE table=default.Table_a73aa006f02f4599bf419556e64f6f3b [id=b017269d4dd64657b421a2771bdc02b7]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:38.780606 13459 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ffa3c1d128c49c8b8e2566c6a64304a. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:38.780798 13598 tablet_service.cc:1468] Processing CreateTablet for tablet 713c12e1efec4e6f9895c65dc8a9c4b9 (DEFAULT_TABLE table=default.Table_a5ac1561c57f4248ad01f99c4739a38a [id=5f77c407feff41a7ab7089ab43413032]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:38.784062 13609 tablet_service.cc:1468] Processing CreateTablet for tablet 5235e1a32f044f0cbf882e338c482003 (DEFAULT_TABLE table=default.Table_707da4392f44468095ba243aacef5dd9 [id=09a229bb6aae40758486bb9d0da948fc]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:38.784590 13462 tablet_service.cc:1468] Processing CreateTablet for tablet 70703eb1d47841a1a227e277ed6a268d (DEFAULT_TABLE table=default.Table_b5663761ffc54702be1146492aaf6430 [id=f8ee1dbbf2df48dea75fa01ffbfdebd9]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:38.784974 14287 raft_consensus.cc:491] T c3b35ea656db4741a02e6746e1b049ec P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:38.785135 14287 raft_consensus.cc:513] T c3b35ea656db4741a02e6746e1b049ec P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:38.785818 14287 leader_election.cc:290] T c3b35ea656db4741a02e6746e1b049ec P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
I20250830 07:54:38.786207 13454 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ae468b43b4c450ca7591b543c2539d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:38.786659 13592 tablet_service.cc:1468] Processing CreateTablet for tablet ec47a59c22ff4370bd21bc2a18336049 (DEFAULT_TABLE table=default.Table_adcde1613f434b17902b76d35e532dd3 [id=bbedbbe46f484b3ca711408171b8fb91]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:38.786972 13604 tablet_service.cc:1468] Processing CreateTablet for tablet 10ec97b8a82145479e0bb526c4cc7c05 (DEFAULT_TABLE table=default.Table_8fe6b43b7fce46bcac3805cc7cb4aa4f [id=cbccbdff1775490b82548ec2f44f9e97]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:38.787606 13954 raft_consensus.cc:2747] T 6492bd11e50d4900927db0de3757aa24 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:54:38.788131 13602 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1153d8cd2994377ac0dcbfeeda1fd52. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:38.787267 13594 tablet_service.cc:1468] Processing CreateTablet for tablet c1e0e774b86d4ef9a75e2635295f3e2a (DEFAULT_TABLE table=default.Table_2ef4fd56f595442da659bbfe83fea326 [id=d05616fc48704721ad64764335e6505a]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:38.786873 13601 tablet_service.cc:1468] Processing CreateTablet for tablet 3c9dd258e6be47f68e039e4cdcd899b2 (DEFAULT_TABLE table=default.Table_d64f4859d76f4310a74cddb0fded0771 [id=bbc7dd98ed194f0f95f8b651bdc662a8]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:38.789539 13886 tablet_bootstrap.cc:654] T e4f1ff6026bb45e28e63c27c83399d72 P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:38.789693 13450 tablet_service.cc:1468] Processing CreateTablet for tablet 28c2f7a3a6dd444585f0f5d337b985e9 (DEFAULT_TABLE table=default.Table_5486f1dec4564e6db48bab52a8b297eb [id=9fd46fc815604123bcb15dc7ecd892a9]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:38.790627 13462 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 70703eb1d47841a1a227e277ed6a268d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:38.790896 13607 tablet_service.cc:1468] Processing CreateTablet for tablet 88bbd6b4c795433d9b6ad746353f3aa1 (DEFAULT_TABLE table=default.Table_af9972a41d74405e9c2896ec5d2a227c [id=258aec805fe64cb98de25da08818cd2a]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:38.791355 13450 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 28c2f7a3a6dd444585f0f5d337b985e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:38.793427 13463 tablet_service.cc:1468] Processing CreateTablet for tablet 087bb1e80d2d44bf8619b0341ff99527 (DEFAULT_TABLE table=default.Table_1cda1cda267540b4bcc19d4ac70c0519 [id=bbfbc80659fd4a558cd48597a7456667]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:38.793816 13463 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 087bb1e80d2d44bf8619b0341ff99527. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:38.794253 13609 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5235e1a32f044f0cbf882e338c482003. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:38.797175 13594 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1e0e774b86d4ef9a75e2635295f3e2a. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:38.797554 13456 tablet_service.cc:1468] Processing CreateTablet for tablet d64f20df166a46249c08444f44422fc3 (DEFAULT_TABLE table=default.Table_d72a50af0d2844f0b50c767903f8f693 [id=26a7abb1aee44e438ca996ebb2ab37b2]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:38.797897 13456 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d64f20df166a46249c08444f44422fc3. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:38.798231 13597 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 057bcce2860345da860acc262dc4d339. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:38.800199 13590 tablet_service.cc:1468] Processing CreateTablet for tablet db4077bf8e184ac5809ef629222f2cc5 (DEFAULT_TABLE table=default.Table_4320c5ce2b254d82870834c4a358fefa [id=a2c2889665864762a6830b4e9fffb229]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:38.800596 13592 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec47a59c22ff4370bd21bc2a18336049. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:38.807554 14256 raft_consensus.cc:491] T bee1b5f6f04740dba64cdcb094e26113 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:38.808518 13457 tablet_service.cc:1468] Processing CreateTablet for tablet ca959e42c8764eeba0faee96caf8b39f (DEFAULT_TABLE table=default.Table_78055261418242849901a0fd7e88083e [id=a44f6adf02ab4c2ca726561ad07fb7c5]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:38.808993 13457 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca959e42c8764eeba0faee96caf8b39f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:38.810420 13886 tablet_bootstrap.cc:492] T e4f1ff6026bb45e28e63c27c83399d72 P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:54:38.811791 13465 tablet_service.cc:1468] Processing CreateTablet for tablet 95b6f084eb5240ea94c125eaa154ac9f (DEFAULT_TABLE table=default.Table_de59395b45a5466eb264ad7be546608f [id=64375c1ac4f5471ba43d07a4d4bc31af]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:38.812260 13465 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95b6f084eb5240ea94c125eaa154ac9f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:38.812757 13886 ts_tablet_manager.cc:1397] T e4f1ff6026bb45e28e63c27c83399d72 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.041s user 0.004s sys 0.002s
I20250830 07:54:38.814160 13886 raft_consensus.cc:357] T e4f1ff6026bb45e28e63c27c83399d72 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:54:38.814937 13451 tablet_service.cc:1468] Processing CreateTablet for tablet 7c5e50cb605c4a40b47984f328eedd93 (DEFAULT_TABLE table=default.Table_69dd6a70cb6040c9b6a6d88a1cbb0ab2 [id=15c0e8f130a24979b4f1dc35c13aab12]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:38.815410 13451 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c5e50cb605c4a40b47984f328eedd93. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:38.817749 13455 tablet_service.cc:1468] Processing CreateTablet for tablet 924403105a6a40f28aad60647a2a8987 (DEFAULT_TABLE table=default.Table_67739ac4113c4648920b4a24633396c5 [id=46ec9117fe9146cb807dd092284616fc]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:38.818317 13455 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 924403105a6a40f28aad60647a2a8987. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:38.819204 13886 raft_consensus.cc:383] T e4f1ff6026bb45e28e63c27c83399d72 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20250830 07:54:38.823242 13701 leader_election.cc:343] T 50360492db824755a6de251436cab5c6 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): Not found: Tablet not found: 50360492db824755a6de251436cab5c6
I20250830 07:54:38.823675 13701 leader_election.cc:304] T 50360492db824755a6de251436cab5c6 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 2065c332f15a4739899af79f3669c3ba, 6b5e454d98894637b466ea27f1b647f9
I20250830 07:54:38.825101 14287 raft_consensus.cc:2747] T 50360492db824755a6de251436cab5c6 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:54:38.825394 13486 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "c3b35ea656db4741a02e6746e1b049ec" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:54:38.825609 13486 raft_consensus.cc:2466] T c3b35ea656db4741a02e6746e1b049ec P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 0.
W20250830 07:54:38.826439 13422 consensus_peers.cc:489] T 7c8e248d938f4651ae13199122b08768 P 2065c332f15a4739899af79f3669c3ba -> Peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Couldn't send request to peer 9b057ade5dce45af9f8bf0bedf8b917f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7c8e248d938f4651ae13199122b08768. This is attempt 1: this message will repeat every 5th retry.
W20250830 07:54:38.826567 13701 consensus_peers.cc:489] T 008827b3d09d464b9182fb42dc2170d5 P 9b057ade5dce45af9f8bf0bedf8b917f -> Peer 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): Couldn't send request to peer 2065c332f15a4739899af79f3669c3ba. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20250830 07:54:38.826731 13701 leader_election.cc:304] T c3b35ea656db4741a02e6746e1b049ec P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters:
I20250830 07:54:38.827167 13607 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88bbd6b4c795433d9b6ad746353f3aa1. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:38.827162 14287 raft_consensus.cc:2802] T c3b35ea656db4741a02e6746e1b049ec P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:54:38.827241 14287 raft_consensus.cc:491] T c3b35ea656db4741a02e6746e1b049ec P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:54:38.827351 14287 raft_consensus.cc:3058] T c3b35ea656db4741a02e6746e1b049ec P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:38.827994 13457 tablet_service.cc:1468] Processing CreateTablet for tablet da5c7b084e1f4fda92fff35a9cb2c7fc (DEFAULT_TABLE table=default.Table_147915363787467ea640b4240b6fd5a2 [id=5b0ef58b04834c50bb378d3ae9b64258]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:38.828390 13457 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da5c7b084e1f4fda92fff35a9cb2c7fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:38.830477 13598 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 713c12e1efec4e6f9895c65dc8a9c4b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:38.830766 13600 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 924403105a6a40f28aad60647a2a8987. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:38.830979 13596 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c5e50cb605c4a40b47984f328eedd93. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:38.831007 14287 raft_consensus.cc:513] T c3b35ea656db4741a02e6746e1b049ec P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:38.831969 14287 leader_election.cc:290] T c3b35ea656db4741a02e6746e1b049ec P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Requested vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
I20250830 07:54:38.832719 13451 tablet_service.cc:1468] Processing CreateTablet for tablet ec47a59c22ff4370bd21bc2a18336049 (DEFAULT_TABLE table=default.Table_adcde1613f434b17902b76d35e532dd3 [id=bbedbbe46f484b3ca711408171b8fb91]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:38.832868 13886 raft_consensus.cc:738] T e4f1ff6026bb45e28e63c27c83399d72 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:54:38.833262 13451 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec47a59c22ff4370bd21bc2a18336049. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:38.833649 13886 consensus_queue.cc:260] T e4f1ff6026bb45e28e63c27c83399d72 P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:54:38.827065 14256 raft_consensus.cc:513] T bee1b5f6f04740dba64cdcb094e26113 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:54:38.835701 13886 ts_tablet_manager.cc:1428] T e4f1ff6026bb45e28e63c27c83399d72 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.022s user 0.001s sys 0.001s
I20250830 07:54:38.836222 13454 tablet_service.cc:1468] Processing CreateTablet for tablet 5235e1a32f044f0cbf882e338c482003 (DEFAULT_TABLE table=default.Table_707da4392f44468095ba243aacef5dd9 [id=09a229bb6aae40758486bb9d0da948fc]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:38.836795 13886 tablet_bootstrap.cc:492] T 62ee2d0fbd774d38a4a4c4a033584ef9 P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:54:38.836973 13601 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c9dd258e6be47f68e039e4cdcd899b2. 1 dirs total, 0 dirs full, 0 dirs failed
W20250830 07:54:38.838303 13562 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.209.3:38743, user_credentials={real_user=slave}} blocked reactor thread for 71390.1us
I20250830 07:54:38.839553 13465 tablet_service.cc:1468] Processing CreateTablet for tablet 057bcce2860345da860acc262dc4d339 (DEFAULT_TABLE table=default.Table_a73aa006f02f4599bf419556e64f6f3b [id=b017269d4dd64657b421a2771bdc02b7]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:38.842980 13467 tablet_service.cc:1468] Processing CreateTablet for tablet d1153d8cd2994377ac0dcbfeeda1fd52 (DEFAULT_TABLE table=default.Table_b2b6c71b45ea47a088960316d6b712a5 [id=c46d6d03fcc14be2ad2edd43a904a020]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:38.843293 13460 tablet_service.cc:1468] Processing CreateTablet for tablet 3c3c798b2b7b460b98a30605464763e6 (DEFAULT_TABLE table=default.Table_79f5696bfda54c74b293dfd15540cac9 [id=9407d235897b4b56927798496fd114c4]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:38.843590 13604 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 10ec97b8a82145479e0bb526c4cc7c05. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:38.844130 13886 tablet_bootstrap.cc:654] T 62ee2d0fbd774d38a4a4c4a033584ef9 P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:38.844439 13461 tablet_service.cc:1468] Processing CreateTablet for tablet 713c12e1efec4e6f9895c65dc8a9c4b9 (DEFAULT_TABLE table=default.Table_a5ac1561c57f4248ad01f99c4739a38a [id=5f77c407feff41a7ab7089ab43413032]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:38.849486 13750 tablet_service.cc:1468] Processing CreateTablet for tablet ca959e42c8764eeba0faee96caf8b39f (DEFAULT_TABLE table=default.Table_78055261418242849901a0fd7e88083e [id=a44f6adf02ab4c2ca726561ad07fb7c5]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:38.849882 13750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca959e42c8764eeba0faee96caf8b39f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:38.851249 13749 tablet_service.cc:1468] Processing CreateTablet for tablet d1153d8cd2994377ac0dcbfeeda1fd52 (DEFAULT_TABLE table=default.Table_b2b6c71b45ea47a088960316d6b712a5 [id=c46d6d03fcc14be2ad2edd43a904a020]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:38.851670 13749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1153d8cd2994377ac0dcbfeeda1fd52. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:38.852877 13745 tablet_service.cc:1468] Processing CreateTablet for tablet 5235e1a32f044f0cbf882e338c482003 (DEFAULT_TABLE table=default.Table_707da4392f44468095ba243aacef5dd9 [id=09a229bb6aae40758486bb9d0da948fc]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:38.853142 14256 leader_election.cc:290] T bee1b5f6f04740dba64cdcb094e26113 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
I20250830 07:54:38.853241 13745 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5235e1a32f044f0cbf882e338c482003. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:38.853739 13590 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet db4077bf8e184ac5809ef629222f2cc5. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:38.855217 13742 tablet_service.cc:1468] Processing CreateTablet for tablet 924403105a6a40f28aad60647a2a8987 (DEFAULT_TABLE table=default.Table_67739ac4113c4648920b4a24633396c5 [id=46ec9117fe9146cb807dd092284616fc]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:38.855264 13772 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "bee1b5f6f04740dba64cdcb094e26113" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:38.855545 13742 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 924403105a6a40f28aad60647a2a8987. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:38.859189 13747 tablet_service.cc:1468] Processing CreateTablet for tablet 95b6f084eb5240ea94c125eaa154ac9f (DEFAULT_TABLE table=default.Table_de59395b45a5466eb264ad7be546608f [id=64375c1ac4f5471ba43d07a4d4bc31af]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:38.859547 13747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95b6f084eb5240ea94c125eaa154ac9f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:38.861238 13745 tablet_service.cc:1468] Processing CreateTablet for tablet 713c12e1efec4e6f9895c65dc8a9c4b9 (DEFAULT_TABLE table=default.Table_a5ac1561c57f4248ad01f99c4739a38a [id=5f77c407feff41a7ab7089ab43413032]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:38.861568 13745 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 713c12e1efec4e6f9895c65dc8a9c4b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:38.864821 13752 tablet_service.cc:1468] Processing CreateTablet for tablet 7c5e50cb605c4a40b47984f328eedd93 (DEFAULT_TABLE table=default.Table_69dd6a70cb6040c9b6a6d88a1cbb0ab2 [id=15c0e8f130a24979b4f1dc35c13aab12]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:38.865154 13752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c5e50cb605c4a40b47984f328eedd93. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:38.867123 13736 tablet_service.cc:1468] Processing CreateTablet for tablet 057bcce2860345da860acc262dc4d339 (DEFAULT_TABLE table=default.Table_a73aa006f02f4599bf419556e64f6f3b [id=b017269d4dd64657b421a2771bdc02b7]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:38.868350 13746 tablet_service.cc:1468] Processing CreateTablet for tablet da5c7b084e1f4fda92fff35a9cb2c7fc (DEFAULT_TABLE table=default.Table_147915363787467ea640b4240b6fd5a2 [id=5b0ef58b04834c50bb378d3ae9b64258]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:38.872538 13736 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 057bcce2860345da860acc262dc4d339. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:38.873781 13746 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da5c7b084e1f4fda92fff35a9cb2c7fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:38.862850 13601 tablet_service.cc:1468] Processing CreateTablet for tablet 042fd7ff08fc4695b87bb8f9d225ef12 (DEFAULT_TABLE table=default.Table_457b48606bd94a959a7675a3cded52ba [id=478c49ffdf644b35aefc85cae7c744f9]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:38.876379 13454 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5235e1a32f044f0cbf882e338c482003. 1 dirs total, 0 dirs full, 0 dirs failed
W20250830 07:54:38.883191 13423 consensus_peers.cc:489] T d33a5d107c6849aca6eb48ffdf8a5463 P 2065c332f15a4739899af79f3669c3ba -> Peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Couldn't send request to peer 6b5e454d98894637b466ea27f1b647f9. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d33a5d107c6849aca6eb48ffdf8a5463. This is attempt 1: this message will repeat every 5th retry.
I20250830 07:54:38.890674 13464 tablet_service.cc:1468] Processing CreateTablet for tablet 88bbd6b4c795433d9b6ad746353f3aa1 (DEFAULT_TABLE table=default.Table_af9972a41d74405e9c2896ec5d2a227c [id=258aec805fe64cb98de25da08818cd2a]), partition=RANGE (key) PARTITION UNBOUNDED
W20250830 07:54:38.893620 13423 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.209.2:38967, user_credentials={real_user=slave}} blocked reactor thread for 114443us
I20250830 07:54:38.894732 13466 tablet_service.cc:1468] Processing CreateTablet for tablet a8baad9c419e436b9659d8d5582d4066 (DEFAULT_TABLE table=default.Table_13f58d14bfbd46279e17abb34c722044 [id=aa01e396828e4f3caff27c57fad0cce2]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:38.898622 13628 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "c3b35ea656db4741a02e6746e1b049ec" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:38.900161 13601 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 042fd7ff08fc4695b87bb8f9d225ef12. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:38.900640 13486 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "c3b35ea656db4741a02e6746e1b049ec" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba"
I20250830 07:54:38.901983 13624 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "c3b35ea656db4741a02e6746e1b049ec" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9"
I20250830 07:54:38.912918 13485 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "afb132e8a5b14a029e005e375f276348" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:54:38.913844 13488 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "bee1b5f6f04740dba64cdcb094e26113" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:54:38.914080 13488 raft_consensus.cc:2391] T bee1b5f6f04740dba64cdcb094e26113 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b5e454d98894637b466ea27f1b647f9 in current term 1: Already voted for candidate 9b057ade5dce45af9f8bf0bedf8b917f in this term.
W20250830 07:54:38.916291 13231 catalog_manager.cc:5415] Ignoring report from unknown tablet b4ab964a64a64e00a78ffd2b220aef46
W20250830 07:54:38.916407 13231 catalog_manager.cc:5415] Ignoring report from unknown tablet d33a5d107c6849aca6eb48ffdf8a5463
W20250830 07:54:38.918336 13231 catalog_manager.cc:5415] Ignoring report from unknown tablet d33a5d107c6849aca6eb48ffdf8a5463
W20250830 07:54:38.918442 13231 catalog_manager.cc:5415] Ignoring report from unknown tablet f398e12cd9f543738d5163354f8a9d9d
W20250830 07:54:38.918572 13231 catalog_manager.cc:5415] Ignoring report from unknown tablet 27da527d9fe045ae8c17f193d034f5ac
I20250830 07:54:38.921229 13234 master_service.cc:948] ReplaceTablet: received request to replace tablet 1933d49d319b4bd7b717dda2b83859f3 from {username='slave'} at 127.0.0.1:42126
W20250830 07:54:38.922578 13225 catalog_manager.cc:5415] Ignoring report from unknown tablet bee1b5f6f04740dba64cdcb094e26113
W20250830 07:54:38.922665 13225 catalog_manager.cc:5415] Ignoring report from unknown tablet ff2267fb411942ff826e2a72bcb89cd7
W20250830 07:54:38.922736 13225 catalog_manager.cc:5415] Ignoring report from unknown tablet 6f2d855ab3c04123b2f9ea22cda6ef04
I20250830 07:54:38.923318 13231 catalog_manager.cc:5674] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743) does not have the latest schema for tablet 6492bd11e50d4900927db0de3757aa24 (table default.Table_7dc4898210c641719d6d97c45dbd89c9 [id=b7dcb14885434162aac95c78a5a70ba9]). Expected version 7 got 0
I20250830 07:54:38.924223 13234 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_1cda1cda267540b4bcc19d4ac70c0519" } new_table_name: "default.Table_1c21cd643b93432fb20d2d30014dafcc" modify_external_catalogs: true
I20250830 07:54:38.925969 13231 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_2ec941924ad14c3eafbc20ba5404a4bc"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:38.926563 13231 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2ec941924ad14c3eafbc20ba5404a4bc in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:38.923172 13225 catalog_manager.cc:5582] T d4e35395930f4c37b34649da5718aa1f P 6b5e454d98894637b466ea27f1b647f9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2). New cstate: current_term: 1 leader_uuid: "6b5e454d98894637b466ea27f1b647f9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } health_report { overall_health: UNKNOWN } } }
I20250830 07:54:38.927131 13225 catalog_manager.cc:5674] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967) does not have the latest schema for tablet d4e35395930f4c37b34649da5718aa1f (table default.Table_fc298c4951614456914be830598a020a [id=e946db3cd3504a69a61a7ed2cabcada7]). Expected version 1 got 0
W20250830 07:54:38.924218 13230 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 3c3c798b2b7b460b98a30605464763e6 consensus state has no leader
I20250830 07:54:38.928201 13230 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_a73aa006f02f4599bf419556e64f6f3b" } new_table_name: "default.Table_8ae535ae9db2427a99899af4ecafb4e2" modify_external_catalogs: true
I20250830 07:54:38.929014 13603 tablet_service.cc:1468] Processing CreateTablet for tablet 49165f0001044d72b68263a60ef56457 (DEFAULT_TABLE table=default.Table_f0b390998fd444f6bd6a1b82953067c2 [id=16c0b33e1e744e61b48b7cb029228977]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:38.929446 13603 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 49165f0001044d72b68263a60ef56457. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:38.929962 13674 heartbeater.cc:344] Connected to a master server at 127.12.209.60:43889
I20250830 07:54:38.937328 13486 raft_consensus.cc:3058] T c3b35ea656db4741a02e6746e1b049ec P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:38.949494 13820 heartbeater.cc:344] Connected to a master server at 127.12.209.60:43889
I20250830 07:54:38.952840 13485 raft_consensus.cc:2466] T afb132e8a5b14a029e005e375f276348 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 0.
I20250830 07:54:38.958240 13232 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_ffed9a8a8cb2455082f2fd5db500bcb2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250830 07:54:38.958355 13561 leader_election.cc:304] T bee1b5f6f04740dba64cdcb094e26113 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b5e454d98894637b466ea27f1b647f9; no voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f
W20250830 07:54:38.958878 13232 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ffed9a8a8cb2455082f2fd5db500bcb2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:38.960789 14256 raft_consensus.cc:3058] T bee1b5f6f04740dba64cdcb094e26113 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:38.960826 13608 tablet_service.cc:1468] Processing CreateTablet for tablet 3bb48fce24074a8e8ec99d3172a655d8 (DEFAULT_TABLE table=default.Table_0ace36b202294925a0a5ba37727867c5 [id=e32687e5e7ee4c0390062675bf75c7c7]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:38.961205 13608 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3bb48fce24074a8e8ec99d3172a655d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:38.962499 13233 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_6c0a3a12a98942679fe0d83bcda5c0ef" } modify_external_catalogs: true
I20250830 07:54:38.962733 13233 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_6c0a3a12a98942679fe0d83bcda5c0ef" } modify_external_catalogs: true
I20250830 07:54:38.964917 13597 tablet_service.cc:1468] Processing CreateTablet for tablet 91705fc35a1b4977b89bac1765c886c0 (DEFAULT_TABLE table=default.Table_b6f012ba5b2741d2a5b1ed74a2dcd9eb [id=48089766c3514336991a5ada71b03dd0]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:38.966836 13226 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_de59395b45a5466eb264ad7be546608f" } modify_external_catalogs: true
I20250830 07:54:38.967077 13226 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_de59395b45a5466eb264ad7be546608f" } modify_external_catalogs: true
I20250830 07:54:38.968043 13606 tablet_service.cc:1468] Processing CreateTablet for tablet 74f2fcc22fd545fb8ca7c20619843023 (DEFAULT_TABLE table=default.Table_da448c80c657460bb81499960d034919 [id=9db5da3d813f4496916fb08ad6fd2dc7]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:38.971287 13227 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_7669c1559ff94b0b9ce898713cc8ea9e" } modify_external_catalogs: true
I20250830 07:54:38.971448 13227 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_7669c1559ff94b0b9ce898713cc8ea9e" } modify_external_catalogs: true
I20250830 07:54:38.971899 13594 tablet_service.cc:1468] Processing CreateTablet for tablet ef1ab62a5b7845e58d50f34206eaaa27 (DEFAULT_TABLE table=default.Table_4cb9bc1005a747f2adafe021b2369ba2 [id=d10aad4180ed441797ad1d46287b73bd]), partition=RANGE (key) PARTITION UNBOUNDED
W20250830 07:54:38.972679 13228 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet c6355878115a4907ae1f0a45fb2c6492 has no consensus state
I20250830 07:54:38.973083 13228 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_f63c8357d00949f7822da8771d6a44f1" } new_table_name: "default.Table_8f85f386d1e54a59a6e539b06a508623" modify_external_catalogs: true
I20250830 07:54:38.974804 13229 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_3d914debcfbf473a93a5955114938fdf" } modify_external_catalogs: true
I20250830 07:54:38.974990 13229 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_3d914debcfbf473a93a5955114938fdf" } modify_external_catalogs: true
W20250830 07:54:38.978048 13703 leader_election.cc:343] T c3b35ea656db4741a02e6746e1b049ec P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
W20250830 07:54:38.978364 13703 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.209.2:38967, user_credentials={real_user=slave}} blocked reactor thread for 46973.8us
I20250830 07:54:38.980710 14287 raft_consensus.cc:491] T e4f1ff6026bb45e28e63c27c83399d72 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:38.981808 13746 tablet_service.cc:1468] Processing CreateTablet for tablet c1e0e774b86d4ef9a75e2635295f3e2a (DEFAULT_TABLE table=default.Table_2ef4fd56f595442da659bbfe83fea326 [id=d05616fc48704721ad64764335e6505a]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:38.983309 13593 tablet_service.cc:1468] Processing CreateTablet for tablet 23d2c7013c9c4b4aacf47e6ac7ab5a0b (DEFAULT_TABLE table=default.Table_429185b39740488c933444abe9883526 [id=f9ad704c39ac48a4bd0143a74457b6bb]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:38.983467 13452 tablet_service.cc:1468] Processing CreateTablet for tablet c1e0e774b86d4ef9a75e2635295f3e2a (DEFAULT_TABLE table=default.Table_2ef4fd56f595442da659bbfe83fea326 [id=d05616fc48704721ad64764335e6505a]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:38.984071 13595 tablet_service.cc:1468] Processing CreateTablet for tablet 8cce7e5537794e9484f5a7c82b9e6e1d (DEFAULT_TABLE table=default.Table_c440d46b5982439c94ff44ddba2ddd28 [id=d0663b8417d6495aa05b374b76351a74]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:38.985275 13606 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 74f2fcc22fd545fb8ca7c20619843023. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:38.989029 13746 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1e0e774b86d4ef9a75e2635295f3e2a. 1 dirs total, 0 dirs full, 0 dirs failed
W20250830 07:54:38.989153 13234 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 087bb1e80d2d44bf8619b0341ff99527 consensus state has no leader
I20250830 07:54:38.989600 13234 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_9a69fe1a51464ff9bd75cc9902331abf"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:38.990159 13234 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9a69fe1a51464ff9bd75cc9902331abf in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:38.991907 13225 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_6870747baea44adaad44f6d6fb61285a" } modify_external_catalogs: true
I20250830 07:54:38.992092 13225 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_6870747baea44adaad44f6d6fb61285a" } modify_external_catalogs: true
I20250830 07:54:38.993860 14287 raft_consensus.cc:513] T e4f1ff6026bb45e28e63c27c83399d72 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:54:38.994499 14287 leader_election.cc:290] T e4f1ff6026bb45e28e63c27c83399d72 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
I20250830 07:54:38.994829 13749 tablet_service.cc:1468] Processing CreateTablet for tablet ec47a59c22ff4370bd21bc2a18336049 (DEFAULT_TABLE table=default.Table_adcde1613f434b17902b76d35e532dd3 [id=bbedbbe46f484b3ca711408171b8fb91]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:38.994971 13750 tablet_service.cc:1468] Processing CreateTablet for tablet 88bbd6b4c795433d9b6ad746353f3aa1 (DEFAULT_TABLE table=default.Table_af9972a41d74405e9c2896ec5d2a227c [id=258aec805fe64cb98de25da08818cd2a]), partition=RANGE (key) PARTITION UNBOUNDED
W20250830 07:54:38.997699 13703 leader_election.cc:343] T c3b35ea656db4741a02e6746e1b049ec P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
W20250830 07:54:38.999135 13882 thread.cc:641] log-alloc [worker] (thread pool) Time spent creating pthread: real 0.518s user 0.008s sys 0.042s
I20250830 07:54:38.999636 13602 tablet_service.cc:1468] Processing CreateTablet for tablet 33701eeb12fc451d90ae0b1c4dd7d134 (DEFAULT_TABLE table=default.Table_286f41edfff142439df1257c3c4559e0 [id=e8d3cb9074b1481b811287ab708db176]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:39.002996 13744 tablet_service.cc:1468] Processing CreateTablet for tablet 042fd7ff08fc4695b87bb8f9d225ef12 (DEFAULT_TABLE table=default.Table_457b48606bd94a959a7675a3cded52ba [id=478c49ffdf644b35aefc85cae7c744f9]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:39.003863 13740 tablet_service.cc:1468] Processing CreateTablet for tablet 91705fc35a1b4977b89bac1765c886c0 (DEFAULT_TABLE table=default.Table_b6f012ba5b2741d2a5b1ed74a2dcd9eb [id=48089766c3514336991a5ada71b03dd0]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:39.008045 14382 consensus_queue.cc:1035] T 861809cc50764aa89140e587489e2d88 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.010s
I20250830 07:54:39.010290 13750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88bbd6b4c795433d9b6ad746353f3aa1. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:39.011479 13597 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 91705fc35a1b4977b89bac1765c886c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:39.011569 13748 tablet_service.cc:1468] Processing CreateTablet for tablet 74f2fcc22fd545fb8ca7c20619843023 (DEFAULT_TABLE table=default.Table_da448c80c657460bb81499960d034919 [id=9db5da3d813f4496916fb08ad6fd2dc7]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:39.011806 13736 tablet_service.cc:1468] Processing CreateTablet for tablet 3c9dd258e6be47f68e039e4cdcd899b2 (DEFAULT_TABLE table=default.Table_d64f4859d76f4310a74cddb0fded0771 [id=bbc7dd98ed194f0f95f8b651bdc662a8]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:39.012187 13744 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 042fd7ff08fc4695b87bb8f9d225ef12. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:39.019035 13594 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef1ab62a5b7845e58d50f34206eaaa27. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:39.020097 13605 tablet_service.cc:1468] Processing CreateTablet for tablet 7aed56dba39e40518e9c3325bcccd74a (DEFAULT_TABLE table=default.Table_af6ae1f5434745bb8a3262612e7e4e36 [id=a462a162c51f405b8d2bf1c83b633ad1]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:39.023015 13591 tablet_service.cc:1468] Processing CreateTablet for tablet 2048c04578104c78aa6504fd9d5953a3 (DEFAULT_TABLE table=default.Table_1ec96f693c91430b9170e6812cd247d8 [id=2f37d76cb66742b5ac3d9f0714c6394d]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:39.023550 14256 raft_consensus.cc:2747] T bee1b5f6f04740dba64cdcb094e26113 P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:54:39.026019 13595 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8cce7e5537794e9484f5a7c82b9e6e1d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:39.032552 13740 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 91705fc35a1b4977b89bac1765c886c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:39.033480 13605 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7aed56dba39e40518e9c3325bcccd74a. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:39.033793 13609 tablet_service.cc:1468] Processing CreateTablet for tablet 97d49a1f600f4c13a4aafca99cedabe8 (DEFAULT_TABLE table=default.Table_975129530c7048dc8e739e361b2bbceb [id=acc1e5dbb6194762b2cbe00d13d65c23]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:39.036131 13592 tablet_service.cc:1468] Processing CreateTablet for tablet 62bc8168176e4678a77827c5b7cc0f3e (DEFAULT_TABLE table=default.Table_7a75311e3f8f4af1b7cf203012949ba4 [id=e950f4141a48492297f5e6c7f7731d68]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:39.039050 13591 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2048c04578104c78aa6504fd9d5953a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:39.039215 13752 tablet_service.cc:1468] Processing CreateTablet for tablet 10ec97b8a82145479e0bb526c4cc7c05 (DEFAULT_TABLE table=default.Table_8fe6b43b7fce46bcac3805cc7cb4aa4f [id=cbccbdff1775490b82548ec2f44f9e97]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:39.039906 13747 tablet_service.cc:1468] Processing CreateTablet for tablet db4077bf8e184ac5809ef629222f2cc5 (DEFAULT_TABLE table=default.Table_4320c5ce2b254d82870834c4a358fefa [id=a2c2889665864762a6830b4e9fffb229]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:39.043282 13751 tablet_service.cc:1468] Processing CreateTablet for tablet ef1ab62a5b7845e58d50f34206eaaa27 (DEFAULT_TABLE table=default.Table_4cb9bc1005a747f2adafe021b2369ba2 [id=d10aad4180ed441797ad1d46287b73bd]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:39.043689 13748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 74f2fcc22fd545fb8ca7c20619843023. 1 dirs total, 0 dirs full, 0 dirs failed
W20250830 07:54:39.044374 13230 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 057bcce2860345da860acc262dc4d339 consensus state has no leader
I20250830 07:54:39.044698 13599 tablet_service.cc:1468] Processing CreateTablet for tablet 6ccbaf109e36453ea6645dfd090f5a1a (DEFAULT_TABLE table=default.Table_f21862e4d3614f3599c1f8c6b3a0d624 [id=5a0934cf98934953bdf1cd9b5abf2192]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:39.044910 14382 raft_consensus.cc:491] T 6492bd11e50d4900927db0de3757aa24 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:39.045050 14382 raft_consensus.cc:513] T 6492bd11e50d4900927db0de3757aa24 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
W20250830 07:54:39.046043 13230 catalog_manager.cc:5415] Ignoring report from unknown tablet d1ae3812d72b419798736328da64b53c
W20250830 07:54:39.046136 13230 catalog_manager.cc:5415] Ignoring report from unknown tablet 9b9c2ae8805a48f7959d6745677a96f2
W20250830 07:54:39.046202 13230 catalog_manager.cc:5415] Ignoring report from unknown tablet 9696d8531a174585b8fd83a2391c02f7
I20250830 07:54:39.046648 13230 master_service.cc:948] ReplaceTablet: received request to replace tablet 29d492735cd14bb6b4a2a9a3929f62f3 from {username='slave'} at 127.0.0.1:42126
I20250830 07:54:39.046707 14382 leader_election.cc:290] T 6492bd11e50d4900927db0de3757aa24 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967)
I20250830 07:54:39.046869 13753 tablet_service.cc:1468] Processing CreateTablet for tablet 3bb48fce24074a8e8ec99d3172a655d8 (DEFAULT_TABLE table=default.Table_0ace36b202294925a0a5ba37727867c5 [id=e32687e5e7ee4c0390062675bf75c7c7]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:39.047452 13751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef1ab62a5b7845e58d50f34206eaaa27. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:39.048060 13230 master_service.cc:948] ReplaceTablet: received request to replace tablet 0507245aa8c74aeb9f3eafba0682590d from {username='slave'} at 127.0.0.1:42126
I20250830 07:54:39.048230 13592 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62bc8168176e4678a77827c5b7cc0f3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:39.054203 13609 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 97d49a1f600f4c13a4aafca99cedabe8. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:39.056156 13753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3bb48fce24074a8e8ec99d3172a655d8. 1 dirs total, 0 dirs full, 0 dirs failed
W20250830 07:54:39.058409 13882 thread.cc:608] log-alloc [worker] (thread pool) Time spent starting thread: real 0.519s user 0.008s sys 0.042s
I20250830 07:54:39.059515 13742 tablet_service.cc:1468] Processing CreateTablet for tablet 33701eeb12fc451d90ae0b1c4dd7d134 (DEFAULT_TABLE table=default.Table_286f41edfff142439df1257c3c4559e0 [id=e8d3cb9074b1481b811287ab708db176]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:39.061815 13604 tablet_service.cc:1468] Processing CreateTablet for tablet a7dc529c40544bafbc9e7f0ab34086bd (DEFAULT_TABLE table=default.Table_718987422ffe497c86a1b4e53c47d620 [id=2516f68ca8104ddd819df0fb8a6975b2]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:39.063092 13599 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ccbaf109e36453ea6645dfd090f5a1a. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:39.064769 13602 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 33701eeb12fc451d90ae0b1c4dd7d134. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:39.074723 13593 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 23d2c7013c9c4b4aacf47e6ac7ab5a0b. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:39.076665 13604 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a7dc529c40544bafbc9e7f0ab34086bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:39.077234 13882 tablet_bootstrap.cc:492] T d912c69d8722403aa56cbbde4ce59782 P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
W20250830 07:54:39.081605 14423 lock_manager.cc:585] Waited 1 seconds to obtain row lock on key '<redacted>' (key hash 5364414700222232986) tablet 00000000000000000000000000000000 cur holder 0x617000040c80
I20250830 07:54:39.084345 13882 ts_tablet_manager.cc:1397] T d912c69d8722403aa56cbbde4ce59782 P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.841s user 0.009s sys 0.045s
I20250830 07:54:39.087456 13598 tablet_service.cc:1468] Processing CreateTablet for tablet 6251a06d1efe44e38d35d962c468f8b2 (DEFAULT_TABLE table=default.Table_a1b7e99160f443da8add698947fe9e63 [id=b48c4464cfae4e0384974f9647660540]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:39.087859 13590 tablet_service.cc:1468] Processing CreateTablet for tablet 689b4fee1dd04b3d9ccdea334b0f6b59 (DEFAULT_TABLE table=default.Table_3c6b83acc24c48e4ace89e977f29c549 [id=f64b358cd69f4bd292434b30333fde87]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:39.088469 13600 tablet_service.cc:1468] Processing CreateTablet for tablet 52e910677ae34630a919d1d3f21b7e83 (DEFAULT_TABLE table=default.Table_3af4480a9af740f598919322e7fc5efc [id=b3fced981b2a4b44a8eab43675699ba5]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:39.088853 13747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet db4077bf8e184ac5809ef629222f2cc5. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:39.088069 13737 tablet_service.cc:1468] Processing CreateTablet for tablet 7aed56dba39e40518e9c3325bcccd74a (DEFAULT_TABLE table=default.Table_af6ae1f5434745bb8a3262612e7e4e36 [id=a462a162c51f405b8d2bf1c83b633ad1]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:39.091163 13754 tablet_service.cc:1468] Processing CreateTablet for tablet 49165f0001044d72b68263a60ef56457 (DEFAULT_TABLE table=default.Table_f0b390998fd444f6bd6a1b82953067c2 [id=16c0b33e1e744e61b48b7cb029228977]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:39.091059 13735 tablet_service.cc:1468] Processing CreateTablet for tablet 8cce7e5537794e9484f5a7c82b9e6e1d (DEFAULT_TABLE table=default.Table_c440d46b5982439c94ff44ddba2ddd28 [id=d0663b8417d6495aa05b374b76351a74]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:39.092625 13882 raft_consensus.cc:357] T d912c69d8722403aa56cbbde4ce59782 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:54:39.100102 13598 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6251a06d1efe44e38d35d962c468f8b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:39.102981 13230 master_service.cc:948] ReplaceTablet: received request to replace tablet 28c2f7a3a6dd444585f0f5d337b985e9 from {username='slave'} at 127.0.0.1:42126
I20250830 07:54:39.104561 13742 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 33701eeb12fc451d90ae0b1c4dd7d134. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:39.113035 13752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 10ec97b8a82145479e0bb526c4cc7c05. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:39.114264 13132 master_runner.cc:186] Error getting master registration for 127.12.209.60:43889: OK, instance_id { permanent_uuid: "3ea183a890b84f408b20b55e9eb7c7ed" instance_seqno: 1756540476270952 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20250830 07:54:39.114513 13132 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20250830 07:54:39.114367 13741 tablet_service.cc:1468] Processing CreateTablet for tablet 23d2c7013c9c4b4aacf47e6ac7ab5a0b (DEFAULT_TABLE table=default.Table_429185b39740488c933444abe9883526 [id=f9ad704c39ac48a4bd0143a74457b6bb]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:39.117976 13596 tablet_service.cc:1468] Processing CreateTablet for tablet 0208de98277c4d6889fb0289b6013ae1 (DEFAULT_TABLE table=default.Table_78284117ae8d41f7a9404cd74bf3f2a2 [id=f591e1acb3fc4cafa69f58ba9ff062c5]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:39.122339 13882 raft_consensus.cc:383] T d912c69d8722403aa56cbbde4ce59782 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:39.130823 13882 raft_consensus.cc:738] T d912c69d8722403aa56cbbde4ce59782 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:54:39.132442 13603 tablet_service.cc:1468] Processing CreateTablet for tablet 796e01f6a36241fc94e335253929d6ab (DEFAULT_TABLE table=default.Table_c71f75e4206e47d0be0d45f0e006cc3d [id=0d8f23d4f0244a12810e64acd4ddb3bf]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:39.134624 14382 raft_consensus.cc:491] T b480f5eb03804baeb61cd0424d70faf5 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:39.138214 13600 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52e910677ae34630a919d1d3f21b7e83. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:39.138386 13882 consensus_queue.cc:260] T d912c69d8722403aa56cbbde4ce59782 P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:54:39.138743 13749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec47a59c22ff4370bd21bc2a18336049. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:39.138971 13882 ts_tablet_manager.cc:1428] T d912c69d8722403aa56cbbde4ce59782 P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.054s user 0.003s sys 0.000s
I20250830 07:54:39.139082 13735 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8cce7e5537794e9484f5a7c82b9e6e1d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:39.139166 13603 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 796e01f6a36241fc94e335253929d6ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:39.140110 13882 tablet_bootstrap.cc:492] T afb132e8a5b14a029e005e375f276348 P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:54:39.142066 13739 tablet_service.cc:1468] Processing CreateTablet for tablet 2048c04578104c78aa6504fd9d5953a3 (DEFAULT_TABLE table=default.Table_1ec96f693c91430b9170e6812cd247d8 [id=2f37d76cb66742b5ac3d9f0714c6394d]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:39.150233 13593 tablet_service.cc:1468] Processing CreateTablet for tablet f66e1d07039841088a444ee0203a4eb0 (DEFAULT_TABLE table=default.Table_8b26aa88b9f34e35ac10a238c1b2b2a1 [id=49c7a085612145f3a514c47e91bf7f14]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:39.150571 13597 tablet_service.cc:1468] Processing CreateTablet for tablet 1520d7257f864ea4ba4b9a5d0443f8a7 (DEFAULT_TABLE table=default.Table_d72b020da8b34ec291b8c8dcd8e0d459 [id=1740a0f9c36b44a7ab5b65366950cc95]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:39.150828 13607 tablet_service.cc:1468] Processing CreateTablet for tablet c8bc6e07377a4ba99c39a909dae11402 (DEFAULT_TABLE table=default.Table_86c9025e70234ffeb1cafaac64f9b691 [id=dce926f371dd4b4ba61511c14d245622]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:39.152899 13596 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0208de98277c4d6889fb0289b6013ae1. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:39.149652 13608 tablet_service.cc:1468] Processing CreateTablet for tablet a8660a6ff9254d4f9f0ef047b8682ed1 (DEFAULT_TABLE table=default.Table_a69ef62b5e2a4bb0b70c263090ce598c [id=7e9c5362e13f40d4aea1d40514bed3cb]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:39.156998 13601 tablet_service.cc:1468] Processing CreateTablet for tablet ee44ab24333742909f773889ad5c3e00 (DEFAULT_TABLE table=default.Table_ed86b365cefe4412bcc0629921f39f3b [id=caf655ebda6a46eebb1e01c23b4cb8ca]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:39.156998 13593 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f66e1d07039841088a444ee0203a4eb0. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:39.159936 13597 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1520d7257f864ea4ba4b9a5d0443f8a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:39.162700 13607 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c8bc6e07377a4ba99c39a909dae11402. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:39.166127 14382 raft_consensus.cc:513] T b480f5eb03804baeb61cd0424d70faf5 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:54:39.166956 14382 leader_election.cc:290] T b480f5eb03804baeb61cd0424d70faf5 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
I20250830 07:54:39.173576 13590 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 689b4fee1dd04b3d9ccdea334b0f6b59. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:39.180169 13882 tablet_bootstrap.cc:654] T afb132e8a5b14a029e005e375f276348 P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:39.181859 13608 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8660a6ff9254d4f9f0ef047b8682ed1. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:39.186094 13601 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee44ab24333742909f773889ad5c3e00. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:39.193001 13461 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 713c12e1efec4e6f9895c65dc8a9c4b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:39.204255 13463 tablet_service.cc:1468] Processing CreateTablet for tablet 3c9dd258e6be47f68e039e4cdcd899b2 (DEFAULT_TABLE table=default.Table_d64f4859d76f4310a74cddb0fded0771 [id=bbc7dd98ed194f0f95f8b651bdc662a8]), partition=RANGE (key) PARTITION UNBOUNDED
W20250830 07:54:39.205333 14476 log.cc:927] Time spent T 3167b609ed184decb4ccdb4945933ebb P 2065c332f15a4739899af79f3669c3ba: Append to log took a long time: real 0.053s user 0.000s sys 0.000s
I20250830 07:54:39.206111 13887 tablet_bootstrap.cc:492] T 008827b3d09d464b9182fb42dc2170d5 P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:54:39.206279 13887 ts_tablet_manager.cc:1397] T 008827b3d09d464b9182fb42dc2170d5 P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.903s user 0.010s sys 0.018s
I20250830 07:54:39.206435 13460 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c3c798b2b7b460b98a30605464763e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:39.206705 13452 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1e0e774b86d4ef9a75e2635295f3e2a. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:39.207258 13463 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c9dd258e6be47f68e039e4cdcd899b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:39.207213 13887 raft_consensus.cc:357] T 008827b3d09d464b9182fb42dc2170d5 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:54:39.207433 13887 raft_consensus.cc:383] T 008827b3d09d464b9182fb42dc2170d5 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:39.207531 13887 raft_consensus.cc:738] T 008827b3d09d464b9182fb42dc2170d5 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:54:39.207763 13887 consensus_queue.cc:260] T 008827b3d09d464b9182fb42dc2170d5 P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:54:39.207922 13467 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1153d8cd2994377ac0dcbfeeda1fd52. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:39.208390 13887 ts_tablet_manager.cc:1428] T 008827b3d09d464b9182fb42dc2170d5 P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20250830 07:54:39.208696 13887 tablet_bootstrap.cc:492] T e4f1ff6026bb45e28e63c27c83399d72 P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:54:39.208972 13466 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8baad9c419e436b9659d8d5582d4066. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:39.209611 13464 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88bbd6b4c795433d9b6ad746353f3aa1. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:39.210253 13465 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 057bcce2860345da860acc262dc4d339. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:39.211908 13883 raft_consensus.cc:2241] T 7c8e248d938f4651ae13199122b08768 P 2065c332f15a4739899af79f3669c3ba [term 1 LEADER]: Raft consensus shutting down.
I20250830 07:54:39.214603 13606 tablet_service.cc:1468] Processing CreateTablet for tablet 76ab56c469cf4675a4e21acbe0a8085d (DEFAULT_TABLE table=default.Table_d68a03611fb04e57a0bfba61c0921f5b [id=702da22d51af40638f69620d00fc50b5]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:39.215240 13458 tablet_service.cc:1468] Processing CreateTablet for tablet 91705fc35a1b4977b89bac1765c886c0 (DEFAULT_TABLE table=default.Table_b6f012ba5b2741d2a5b1ed74a2dcd9eb [id=48089766c3514336991a5ada71b03dd0]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:39.216936 13595 tablet_service.cc:1468] Processing CreateTablet for tablet 852e353f6ee945628ddebdbdd1bd76fb (DEFAULT_TABLE table=default.Table_4abf499bcf8a4fd88fd739d3a1daee3a [id=768d7e569197455bb092328ca1b32ed0]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:39.220849 13602 tablet_service.cc:1468] Processing CreateTablet for tablet f5baa35307a1425c8d52666d130d6d8a (DEFAULT_TABLE table=default.Table_6fdd8b95556645e3aca8b103373a8dac [id=6a35c4abd132478caba0152786455169]), partition=RANGE (key) PARTITION UNBOUNDED
W20250830 07:54:39.212845 13423 leader_election.cc:343] T c3b35ea656db4741a02e6746e1b049ec P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:39.227532 13423 leader_election.cc:304] T c3b35ea656db4741a02e6746e1b049ec P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba; no voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f
W20250830 07:54:39.230839 13423 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.209.2:38967, user_credentials={real_user=slave}} blocked reactor thread for 333870us
I20250830 07:54:39.231303 13954 consensus_queue.cc:1035] T 48b422b125154fbdbb9c995dc372d128 P 2065c332f15a4739899af79f3669c3ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:54:39.231796 13954 consensus_queue.cc:1035] T 3167b609ed184decb4ccdb4945933ebb P 2065c332f15a4739899af79f3669c3ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:54:39.240267 13483 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "e4f1ff6026bb45e28e63c27c83399d72" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:54:39.241120 13483 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "6492bd11e50d4900927db0de3757aa24" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:54:39.241362 13483 raft_consensus.cc:2466] T 6492bd11e50d4900927db0de3757aa24 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 0.
I20250830 07:54:39.241568 13456 tablet_service.cc:1468] Processing CreateTablet for tablet 3bb48fce24074a8e8ec99d3172a655d8 (DEFAULT_TABLE table=default.Table_0ace36b202294925a0a5ba37727867c5 [id=e32687e5e7ee4c0390062675bf75c7c7]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:39.249855 13227 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet 43e93d3038f7496ebb18319420ab67e0
I20250830 07:54:39.250643 13233 catalog_manager.cc:5864] Not sending DeleteTablet requests; no consensus state for tablet d2060484fd6b402b8cc77c7c5b0b5911
I20250830 07:54:39.251180 13226 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet 95b6f084eb5240ea94c125eaa154ac9f
W20250830 07:54:39.263262 13755 consensus_meta.cc:287] T 43e93d3038f7496ebb18319420ab67e0 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent flushing consensus metadata: real 0.554s user 0.005s sys 0.001s
I20250830 07:54:39.264495 13606 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 76ab56c469cf4675a4e21acbe0a8085d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:39.267259 13595 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 852e353f6ee945628ddebdbdd1bd76fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:39.271613 13602 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5baa35307a1425c8d52666d130d6d8a. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:39.274204 13604 tablet_service.cc:1468] Processing CreateTablet for tablet db7144b25ff34bed8c7b779ba9497ef4 (DEFAULT_TABLE table=default.Table_9aa8d17e919f4ae09cb9c42cf2ba54a5 [id=91fe2be3513e4073aba290fc05ab108b]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:39.274618 13604 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet db7144b25ff34bed8c7b779ba9497ef4. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:39.279196 13594 tablet_service.cc:1515] Processing DeleteTablet for tablet 43e93d3038f7496ebb18319420ab67e0 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:38 UTC) from {username='slave'} at 127.0.0.1:45306
I20250830 07:54:39.283562 13226 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_dbadc01ffe94447080e199d005d9e87c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:39.284222 13226 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_dbadc01ffe94447080e199d005d9e87c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:39.285619 13232 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_c8928475736a40768e1ad90aed18fa32"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:39.286155 13232 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c8928475736a40768e1ad90aed18fa32 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:39.287606 13227 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_8204a5b070a84e9293e28fc53c97d88f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:39.288058 13227 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8204a5b070a84e9293e28fc53c97d88f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:39.289211 13233 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_6ef13cf21d7d4330be0de43381e7047f" } new_table_name: "default.Table_f2eab0db9efb46dba139ecb73d18bfbb" modify_external_catalogs: true
I20250830 07:54:39.294504 13736 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c9dd258e6be47f68e039e4cdcd899b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:39.297005 13754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 49165f0001044d72b68263a60ef56457. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:39.301096 13605 tablet_service.cc:1515] Processing DeleteTablet for tablet 95b6f084eb5240ea94c125eaa154ac9f with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:38 UTC) from {username='slave'} at 127.0.0.1:45306
I20250830 07:54:39.301329 13739 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2048c04578104c78aa6504fd9d5953a3. 1 dirs total, 0 dirs full, 0 dirs failed
W20250830 07:54:39.310983 13228 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet cada6410e2884c508bb7dd38bea438ae consensus state has no leader
I20250830 07:54:39.311599 13229 catalog_manager.cc:5864] Not sending DeleteTablet requests; no consensus state for tablet 64cd176859c54ecfb74c9fbe0911a0fc
I20250830 07:54:39.312253 13741 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 23d2c7013c9c4b4aacf47e6ac7ab5a0b. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:39.318218 13883 raft_consensus.cc:2270] T 7c8e248d938f4651ae13199122b08768 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20250830 07:54:39.318450 13458 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 91705fc35a1b4977b89bac1765c886c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:39.328792 13456 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3bb48fce24074a8e8ec99d3172a655d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:39.330381 13228 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_99ddb5ec94474f889af2d0b33b0f6a99"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:39.330973 13228 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_99ddb5ec94474f889af2d0b33b0f6a99 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:39.332545 13229 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_3fc8320fad174384a19616004d3b6e4e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:39.333082 13229 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3fc8320fad174384a19616004d3b6e4e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:39.343878 13883 ts_tablet_manager.cc:1905] T 7c8e248d938f4651ae13199122b08768 P 2065c332f15a4739899af79f3669c3ba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250830 07:54:39.346567 13746 tablet_service.cc:1468] Processing CreateTablet for tablet 52e910677ae34630a919d1d3f21b7e83 (DEFAULT_TABLE table=default.Table_3af4480a9af740f598919322e7fc5efc [id=b3fced981b2a4b44a8eab43675699ba5]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:39.347530 13701 leader_election.cc:304] T afb132e8a5b14a029e005e375f276348 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:54:39.348435 13887 tablet_bootstrap.cc:654] T e4f1ff6026bb45e28e63c27c83399d72 P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:39.348992 13751 tablet_service.cc:1468] Processing CreateTablet for tablet 62bc8168176e4678a77827c5b7cc0f3e (DEFAULT_TABLE table=default.Table_7a75311e3f8f4af1b7cf203012949ba4 [id=e950f4141a48492297f5e6c7f7731d68]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:39.349463 13449 tablet_service.cc:1468] Processing CreateTablet for tablet 10ec97b8a82145479e0bb526c4cc7c05 (DEFAULT_TABLE table=default.Table_8fe6b43b7fce46bcac3805cc7cb4aa4f [id=cbccbdff1775490b82548ec2f44f9e97]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:39.350430 13449 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 10ec97b8a82145479e0bb526c4cc7c05. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:39.350767 14382 raft_consensus.cc:2802] T afb132e8a5b14a029e005e375f276348 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:54:39.350888 14382 raft_consensus.cc:491] T afb132e8a5b14a029e005e375f276348 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:54:39.351042 14382 raft_consensus.cc:3058] T afb132e8a5b14a029e005e375f276348 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:39.352658 13488 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "b480f5eb03804baeb61cd0424d70faf5" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:54:39.353010 13486 raft_consensus.cc:2466] T c3b35ea656db4741a02e6746e1b049ec P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 1.
I20250830 07:54:39.353543 14401 raft_consensus.cc:2747] T c3b35ea656db4741a02e6746e1b049ec P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:54:39.353997 13488 raft_consensus.cc:2466] T b480f5eb03804baeb61cd0424d70faf5 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 0.
I20250830 07:54:39.354213 14382 raft_consensus.cc:513] T afb132e8a5b14a029e005e375f276348 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:39.357736 13737 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7aed56dba39e40518e9c3325bcccd74a. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:39.358069 13461 tablet_service.cc:1468] Processing CreateTablet for tablet db4077bf8e184ac5809ef629222f2cc5 (DEFAULT_TABLE table=default.Table_4320c5ce2b254d82870834c4a358fefa [id=a2c2889665864762a6830b4e9fffb229]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:39.364550 13461 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet db4077bf8e184ac5809ef629222f2cc5. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:39.372408 13755 tablet_service.cc:1468] Processing CreateTablet for tablet 97d49a1f600f4c13a4aafca99cedabe8 (DEFAULT_TABLE table=default.Table_975129530c7048dc8e739e361b2bbceb [id=acc1e5dbb6194762b2cbe00d13d65c23]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:39.378400 13459 tablet_service.cc:1468] Processing CreateTablet for tablet 042fd7ff08fc4695b87bb8f9d225ef12 (DEFAULT_TABLE table=default.Table_457b48606bd94a959a7675a3cded52ba [id=478c49ffdf644b35aefc85cae7c744f9]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:39.378813 13459 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 042fd7ff08fc4695b87bb8f9d225ef12. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:39.380535 13738 tablet_service.cc:1468] Processing CreateTablet for tablet 689b4fee1dd04b3d9ccdea334b0f6b59 (DEFAULT_TABLE table=default.Table_3c6b83acc24c48e4ace89e977f29c549 [id=f64b358cd69f4bd292434b30333fde87]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:39.384943 13748 tablet_service.cc:1468] Processing CreateTablet for tablet a7dc529c40544bafbc9e7f0ab34086bd (DEFAULT_TABLE table=default.Table_718987422ffe497c86a1b4e53c47d620 [id=2516f68ca8104ddd819df0fb8a6975b2]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:39.385375 13755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 97d49a1f600f4c13a4aafca99cedabe8. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:39.386224 13738 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 689b4fee1dd04b3d9ccdea334b0f6b59. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:39.387018 13748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a7dc529c40544bafbc9e7f0ab34086bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:39.387460 13459 tablet_service.cc:1468] Processing CreateTablet for tablet 49165f0001044d72b68263a60ef56457 (DEFAULT_TABLE table=default.Table_f0b390998fd444f6bd6a1b82953067c2 [id=16c0b33e1e744e61b48b7cb029228977]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:39.387647 14382 leader_election.cc:290] T afb132e8a5b14a029e005e375f276348 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Requested vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967)
I20250830 07:54:39.387913 14382 consensus_queue.cc:1035] T 9b9c2ae8805a48f7959d6745677a96f2 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:54:39.388607 13234 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_4e84ca71cc784cd78c5223e4b6c49f49"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:39.389185 13234 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4e84ca71cc784cd78c5223e4b6c49f49 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250830 07:54:39.394059 13220 catalog_manager.cc:4908] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet 43e93d3038f7496ebb18319420ab67e0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 43e93d3038f7496ebb18319420ab67e0 already in progress: creating tablet
W20250830 07:54:39.394716 13220 catalog_manager.cc:4908] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet 95b6f084eb5240ea94c125eaa154ac9f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 95b6f084eb5240ea94c125eaa154ac9f already in progress: creating tablet
I20250830 07:54:39.413292 13225 catalog_manager.cc:5864] Not sending DeleteTablet requests; no consensus state for tablet 94db6973ee3c40a8be811353d29cecc5
I20250830 07:54:39.413659 13225 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_7a75311e3f8f4af1b7cf203012949ba4" } new_table_name: "default.Table_6599f3cf995f409296d8e841380b6d7f" modify_external_catalogs: true
I20250830 07:54:39.395761 13450 tablet_service.cc:1468] Processing CreateTablet for tablet ef1ab62a5b7845e58d50f34206eaaa27 (DEFAULT_TABLE table=default.Table_4cb9bc1005a747f2adafe021b2369ba2 [id=d10aad4180ed441797ad1d46287b73bd]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:39.398478 13451 tablet_service.cc:1468] Processing CreateTablet for tablet 74f2fcc22fd545fb8ca7c20619843023 (DEFAULT_TABLE table=default.Table_da448c80c657460bb81499960d034919 [id=9db5da3d813f4496916fb08ad6fd2dc7]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:39.415640 13459 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 49165f0001044d72b68263a60ef56457. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:39.427588 13231 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_2c4b8a7c25664cc4babc5c58ec16a720"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250830 07:54:39.427918 13230 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet 28c2f7a3a6dd444585f0f5d337b985e9
W20250830 07:54:39.428383 13231 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2c4b8a7c25664cc4babc5c58ec16a720 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:39.428932 13226 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_1c1a8a41b5bc44b6b33f0d33246d5d56" } new_table_name: "default.Table_7b399745f2fc4d5190617bafbae2c454" modify_external_catalogs: true
I20250830 07:54:39.429433 13606 tablet_service.cc:1515] Processing DeleteTablet for tablet d912c69d8722403aa56cbbde4ce59782 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:35 UTC) from {username='slave'} at 127.0.0.1:45306
I20250830 07:54:39.429709 14497 tablet_replica.cc:331] T d912c69d8722403aa56cbbde4ce59782 P 6b5e454d98894637b466ea27f1b647f9: stopping tablet replica
I20250830 07:54:39.429952 14497 raft_consensus.cc:2241] T d912c69d8722403aa56cbbde4ce59782 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250830 07:54:39.430162 14497 raft_consensus.cc:2270] T d912c69d8722403aa56cbbde4ce59782 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250830 07:54:39.430354 13232 master_service.cc:948] ReplaceTablet: received request to replace tablet 29d492735cd14bb6b4a2a9a3929f62f3 from {username='slave'} at 127.0.0.1:42126
I20250830 07:54:39.430775 13232 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_1c21cd643b93432fb20d2d30014dafcc" } new_table_name: "default.Table_bc55377123bb4f3cbbcd992cedbab17e" modify_external_catalogs: true
I20250830 07:54:39.431059 13744 tablet_service.cc:1468] Processing CreateTablet for tablet 6251a06d1efe44e38d35d962c468f8b2 (DEFAULT_TABLE table=default.Table_a1b7e99160f443da8add698947fe9e63 [id=b48c4464cfae4e0384974f9647660540]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:39.431522 13744 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6251a06d1efe44e38d35d962c468f8b2. 1 dirs total, 0 dirs full, 0 dirs failed
W20250830 07:54:39.431951 13233 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 3866260af12943acb496d9d60633db87 has no consensus state
I20250830 07:54:39.432219 13233 master_service.cc:948] ReplaceTablet: received request to replace tablet acca1a8240454b889c63c82d3c75087e from {username='slave'} at 127.0.0.1:42126
I20250830 07:54:39.433674 13228 master_service.cc:948] ReplaceTablet: received request to replace tablet 91ab8c468c8143b9ae11b839a95a26fd from {username='slave'} at 127.0.0.1:42126
I20250830 07:54:39.433972 13228 master_service.cc:948] ReplaceTablet: received request to replace tablet cb3c48982add45379c0e1b117ec40c1a from {username='slave'} at 127.0.0.1:42126
I20250830 07:54:39.434543 14497 ts_tablet_manager.cc:1905] T d912c69d8722403aa56cbbde4ce59782 P 6b5e454d98894637b466ea27f1b647f9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250830 07:54:39.428385 13230 catalog_manager.cc:6652] ReplaceTablet: tablet 28c2f7a3a6dd444585f0f5d337b985e9 deleted and replaced by tablet 2d91b0ba74034b85812a13719e21dc6c
W20250830 07:54:39.437526 13228 catalog_manager.cc:5415] Ignoring report from unknown tablet ff2267fb411942ff826e2a72bcb89cd7
W20250830 07:54:39.437682 13228 catalog_manager.cc:5415] Ignoring report from unknown tablet d912c69d8722403aa56cbbde4ce59782
I20250830 07:54:39.438022 13753 tablet_service.cc:1515] Processing DeleteTablet for tablet 7c8e248d938f4651ae13199122b08768 with delete_type TABLET_DATA_DELETED (replaced by tablet 7e9d6af1d7fc4d4b961583b44f2f962a) from {username='slave'} at 127.0.0.1:45460
I20250830 07:54:39.440101 13594 tablet_service.cc:1515] Processing DeleteTablet for tablet 28c2f7a3a6dd444585f0f5d337b985e9 with delete_type TABLET_DATA_DELETED (replaced by tablet 2d91b0ba74034b85812a13719e21dc6c) from {username='slave'} at 127.0.0.1:45306
I20250830 07:54:39.443907 14497 ts_tablet_manager.cc:1918] T d912c69d8722403aa56cbbde4ce59782 P 6b5e454d98894637b466ea27f1b647f9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250830 07:54:39.444141 14497 log.cc:1199] T d912c69d8722403aa56cbbde4ce59782 P 6b5e454d98894637b466ea27f1b647f9: Deleting WAL directory at /tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/ts-1/wal/wals/d912c69d8722403aa56cbbde4ce59782
I20250830 07:54:39.444734 14497 ts_tablet_manager.cc:1939] T d912c69d8722403aa56cbbde4ce59782 P 6b5e454d98894637b466ea27f1b647f9: Deleting consensus metadata
I20250830 07:54:39.445518 13228 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_a22710bc37024873ab4d641d2c9aad8d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250830 07:54:39.446203 13220 catalog_manager.cc:4928] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): tablet d912c69d8722403aa56cbbde4ce59782 (table default.Table_fd6941613dcf424583ca9f728fd345dd [id=1b6e4f675c3749ac94e3e7a84d1cf5da]) successfully deleted
W20250830 07:54:39.446440 13228 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a22710bc37024873ab4d641d2c9aad8d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250830 07:54:39.447793 13220 catalog_manager.cc:4908] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet 28c2f7a3a6dd444585f0f5d337b985e9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 28c2f7a3a6dd444585f0f5d337b985e9 already in progress: creating tablet
I20250830 07:54:39.451265 13742 tablet_service.cc:1468] Processing CreateTablet for tablet 6ccbaf109e36453ea6645dfd090f5a1a (DEFAULT_TABLE table=default.Table_f21862e4d3614f3599c1f8c6b3a0d624 [id=5a0934cf98934953bdf1cd9b5abf2192]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:39.418953 13452 tablet_service.cc:1468] Processing CreateTablet for tablet 8cce7e5537794e9484f5a7c82b9e6e1d (DEFAULT_TABLE table=default.Table_c440d46b5982439c94ff44ddba2ddd28 [id=d0663b8417d6495aa05b374b76351a74]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:39.456043 13740 tablet_service.cc:1468] Processing CreateTablet for tablet 0208de98277c4d6889fb0289b6013ae1 (DEFAULT_TABLE table=default.Table_78284117ae8d41f7a9404cd74bf3f2a2 [id=f591e1acb3fc4cafa69f58ba9ff062c5]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:39.429494 13458 tablet_service.cc:1468] Processing CreateTablet for tablet 33701eeb12fc451d90ae0b1c4dd7d134 (DEFAULT_TABLE table=default.Table_286f41edfff142439df1257c3c4559e0 [id=e8d3cb9074b1481b811287ab708db176]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:39.459313 13452 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8cce7e5537794e9484f5a7c82b9e6e1d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:39.460680 13227 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_975129530c7048dc8e739e361b2bbceb" } modify_external_catalogs: true
I20250830 07:54:39.460860 13227 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_975129530c7048dc8e739e361b2bbceb" } modify_external_catalogs: true
W20250830 07:54:39.429770 13453 consensus_meta.cc:287] T d1bf58d367f54ba8bad64887b9a8d9cc P 2065c332f15a4739899af79f3669c3ba: Time spent flushing consensus metadata: real 0.530s user 0.003s sys 0.000s
I20250830 07:54:39.461998 13453 tablet_service.cc:1468] Processing CreateTablet for tablet 23d2c7013c9c4b4aacf47e6ac7ab5a0b (DEFAULT_TABLE table=default.Table_429185b39740488c933444abe9883526 [id=f9ad704c39ac48a4bd0143a74457b6bb]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:39.462213 13230 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_87c4d4c8f9434a7887c620edd83eebaf"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250830 07:54:39.462411 13453 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 23d2c7013c9c4b4aacf47e6ac7ab5a0b. 1 dirs total, 0 dirs full, 0 dirs failed
W20250830 07:54:39.462739 13230 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_87c4d4c8f9434a7887c620edd83eebaf in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250830 07:54:39.429945 13468 consensus_meta.cc:287] T d37fe59b4f964f30bb1ed4cb00868b75 P 2065c332f15a4739899af79f3669c3ba: Time spent flushing consensus metadata: real 0.584s user 0.004s sys 0.000s
I20250830 07:54:39.466455 13468 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 286) took 1042 ms. Trace:
I20250830 07:54:39.466580 13468 rpcz_store.cc:276] 0830 07:54:38.424169 (+ 0us) service_pool.cc:168] Inserting onto call queue
0830 07:54:38.495797 (+ 71628us) service_pool.cc:225] Handling call
0830 07:54:38.565830 (+ 70033us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0830 07:54:38.565880 (+ 50us) ts_tablet_manager.cc:676] Creating new metadata...
0830 07:54:38.695111 (+129231us) tablet_metadata.cc:641] Metadata flushed
0830 07:54:39.466252 (+771141us) tablet_replica.cc:206] Creating consensus instance
0830 07:54:39.466412 (+ 160us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20250830 07:54:39.467139 13468 tablet_service.cc:1468] Processing CreateTablet for tablet 7aed56dba39e40518e9c3325bcccd74a (DEFAULT_TABLE table=default.Table_af6ae1f5434745bb8a3262612e7e4e36 [id=a462a162c51f405b8d2bf1c83b633ad1]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:39.467522 13468 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7aed56dba39e40518e9c3325bcccd74a. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:39.469928 13452 tablet_service.cc:1468] Processing CreateTablet for tablet 2048c04578104c78aa6504fd9d5953a3 (DEFAULT_TABLE table=default.Table_1ec96f693c91430b9170e6812cd247d8 [id=2f37d76cb66742b5ac3d9f0714c6394d]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:39.470592 13458 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 33701eeb12fc451d90ae0b1c4dd7d134. 1 dirs total, 0 dirs full, 0 dirs failed
W20250830 07:54:39.430099 13455 consensus_meta.cc:287] T 924403105a6a40f28aad60647a2a8987 P 2065c332f15a4739899af79f3669c3ba: Time spent flushing consensus metadata: real 0.555s user 0.001s sys 0.002s
I20250830 07:54:39.471710 13455 tablet_service.cc:1468] Processing CreateTablet for tablet 62bc8168176e4678a77827c5b7cc0f3e (DEFAULT_TABLE table=default.Table_7a75311e3f8f4af1b7cf203012949ba4 [id=e950f4141a48492297f5e6c7f7731d68]), partition=RANGE (key) PARTITION UNBOUNDED
W20250830 07:54:39.486645 13423 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.209.2:38967, user_credentials={real_user=slave}} blocked reactor thread for 255316us
I20250830 07:54:39.490442 13455 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62bc8168176e4678a77827c5b7cc0f3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:39.492779 13229 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_4cb9bc1005a747f2adafe021b2369ba2" } modify_external_catalogs: true
I20250830 07:54:39.493021 13229 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_4cb9bc1005a747f2adafe021b2369ba2" } modify_external_catalogs: true
W20250830 07:54:39.497704 13703 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.209.2:38967, user_credentials={real_user=slave}} blocked reactor thread for 498556us
W20250830 07:54:39.510546 13225 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 62bc8168176e4678a77827c5b7cc0f3e consensus state has no leader
W20250830 07:54:39.511984 13226 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet b83dfc54383d4e7b96523568aea5c9f3 consensus state has no leader
W20250830 07:54:39.512395 13232 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 087bb1e80d2d44bf8619b0341ff99527 consensus state has no leader
I20250830 07:54:39.514057 13234 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_f2eab0db9efb46dba139ecb73d18bfbb" } modify_external_catalogs: true
I20250830 07:54:39.514254 13234 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_f2eab0db9efb46dba139ecb73d18bfbb" } modify_external_catalogs: true
I20250830 07:54:39.514844 13742 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ccbaf109e36453ea6645dfd090f5a1a. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:39.516891 13740 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0208de98277c4d6889fb0289b6013ae1. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:39.518016 13233 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet acca1a8240454b889c63c82d3c75087e
I20250830 07:54:39.518518 13233 catalog_manager.cc:6652] ReplaceTablet: tablet acca1a8240454b889c63c82d3c75087e deleted and replaced by tablet b85843ab0e3a40e1b453cfdd71bbae5e
I20250830 07:54:39.519141 13227 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet 97d49a1f600f4c13a4aafca99cedabe8
I20250830 07:54:39.519397 13457 tablet_service.cc:1468] Processing CreateTablet for tablet 97d49a1f600f4c13a4aafca99cedabe8 (DEFAULT_TABLE table=default.Table_975129530c7048dc8e739e361b2bbceb [id=acc1e5dbb6194762b2cbe00d13d65c23]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:39.519801 13450 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef1ab62a5b7845e58d50f34206eaaa27. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:39.520170 13457 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 97d49a1f600f4c13a4aafca99cedabe8. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:39.520706 13606 tablet_service.cc:1515] Processing DeleteTablet for tablet 97d49a1f600f4c13a4aafca99cedabe8 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:39 UTC) from {username='slave'} at 127.0.0.1:45306
I20250830 07:54:39.521348 13451 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 74f2fcc22fd545fb8ca7c20619843023. 1 dirs total, 0 dirs full, 0 dirs failed
W20250830 07:54:39.521428 13220 catalog_manager.cc:4908] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet 97d49a1f600f4c13a4aafca99cedabe8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 97d49a1f600f4c13a4aafca99cedabe8 already in progress: creating tablet
I20250830 07:54:39.522243 13627 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "e4f1ff6026bb45e28e63c27c83399d72" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:39.523175 13227 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_7ee43052368b4ef9ac4cce0939b37dcb" } modify_external_catalogs: true
I20250830 07:54:39.523377 13227 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_7ee43052368b4ef9ac4cce0939b37dcb" } modify_external_catalogs: true
I20250830 07:54:39.524811 13230 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_909c19bf1a2c49b48c19d50c7bebda25" } new_table_name: "default.Table_cbbde0aa8e5b47e69f1a0db288d36cdf" modify_external_catalogs: true
I20250830 07:54:39.526085 13229 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet ef1ab62a5b7845e58d50f34206eaaa27
I20250830 07:54:39.527145 13606 tablet_service.cc:1515] Processing DeleteTablet for tablet ef1ab62a5b7845e58d50f34206eaaa27 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:39 UTC) from {username='slave'} at 127.0.0.1:45306
W20250830 07:54:39.528126 13220 catalog_manager.cc:4908] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet ef1ab62a5b7845e58d50f34206eaaa27 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ef1ab62a5b7845e58d50f34206eaaa27 already in progress: creating tablet
I20250830 07:54:39.530980 13594 tablet_service.cc:1515] Processing DeleteTablet for tablet acca1a8240454b889c63c82d3c75087e with delete_type TABLET_DATA_DELETED (replaced by tablet b85843ab0e3a40e1b453cfdd71bbae5e) from {username='slave'} at 127.0.0.1:45306
W20250830 07:54:39.531682 13220 catalog_manager.cc:4908] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet acca1a8240454b889c63c82d3c75087e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet acca1a8240454b889c63c82d3c75087e already in progress: creating tablet
I20250830 07:54:39.536319 13753 tablet_service.cc:1468] Processing CreateTablet for tablet a8660a6ff9254d4f9f0ef047b8682ed1 (DEFAULT_TABLE table=default.Table_a69ef62b5e2a4bb0b70c263090ce598c [id=7e9c5362e13f40d4aea1d40514bed3cb]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:39.537324 13454 tablet_service.cc:1468] Processing CreateTablet for tablet 6ccbaf109e36453ea6645dfd090f5a1a (DEFAULT_TABLE table=default.Table_f21862e4d3614f3599c1f8c6b3a0d624 [id=5a0934cf98934953bdf1cd9b5abf2192]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:39.537377 13754 tablet_service.cc:1468] Processing CreateTablet for tablet f66e1d07039841088a444ee0203a4eb0 (DEFAULT_TABLE table=default.Table_8b26aa88b9f34e35ac10a238c1b2b2a1 [id=49c7a085612145f3a514c47e91bf7f14]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:39.537878 13628 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "6492bd11e50d4900927db0de3757aa24" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:39.538542 13747 tablet_service.cc:1468] Processing CreateTablet for tablet 796e01f6a36241fc94e335253929d6ab (DEFAULT_TABLE table=default.Table_c71f75e4206e47d0be0d45f0e006cc3d [id=0d8f23d4f0244a12810e64acd4ddb3bf]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:39.540241 13746 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52e910677ae34630a919d1d3f21b7e83. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:39.540529 13754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f66e1d07039841088a444ee0203a4eb0. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:39.540916 13751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62bc8168176e4678a77827c5b7cc0f3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:39.542217 13628 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "b480f5eb03804baeb61cd0424d70faf5" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:39.543141 13736 tablet_service.cc:1468] Processing CreateTablet for tablet c8bc6e07377a4ba99c39a909dae11402 (DEFAULT_TABLE table=default.Table_86c9025e70234ffeb1cafaac64f9b691 [id=dce926f371dd4b4ba61511c14d245622]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:39.550593 13745 tablet_service.cc:1468] Processing CreateTablet for tablet 1520d7257f864ea4ba4b9a5d0443f8a7 (DEFAULT_TABLE table=default.Table_d72b020da8b34ec291b8c8dcd8e0d459 [id=1740a0f9c36b44a7ab5b65366950cc95]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:39.544680 13749 tablet_service.cc:1468] Processing CreateTablet for tablet ee44ab24333742909f773889ad5c3e00 (DEFAULT_TABLE table=default.Table_ed86b365cefe4412bcc0629921f39f3b [id=caf655ebda6a46eebb1e01c23b4cb8ca]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:39.555464 13626 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "afb132e8a5b14a029e005e375f276348" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9"
I20250830 07:54:39.561056 13882 tablet_bootstrap.cc:492] T afb132e8a5b14a029e005e375f276348 P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:54:39.561269 13882 ts_tablet_manager.cc:1397] T afb132e8a5b14a029e005e375f276348 P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.421s user 0.011s sys 0.027s
I20250830 07:54:39.562179 13882 raft_consensus.cc:357] T afb132e8a5b14a029e005e375f276348 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:39.563700 13882 raft_consensus.cc:383] T afb132e8a5b14a029e005e375f276348 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:39.564595 13882 raft_consensus.cc:738] T afb132e8a5b14a029e005e375f276348 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:54:39.565317 13882 consensus_queue.cc:260] T afb132e8a5b14a029e005e375f276348 P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:39.571220 13456 tablet_service.cc:1468] Processing CreateTablet for tablet a8660a6ff9254d4f9f0ef047b8682ed1 (DEFAULT_TABLE table=default.Table_a69ef62b5e2a4bb0b70c263090ce598c [id=7e9c5362e13f40d4aea1d40514bed3cb]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:39.572536 13454 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ccbaf109e36453ea6645dfd090f5a1a. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:39.573309 13750 tablet_service.cc:1468] Processing CreateTablet for tablet 852e353f6ee945628ddebdbdd1bd76fb (DEFAULT_TABLE table=default.Table_4abf499bcf8a4fd88fd739d3a1daee3a [id=768d7e569197455bb092328ca1b32ed0]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:39.573814 13752 tablet_service.cc:1468] Processing CreateTablet for tablet 76ab56c469cf4675a4e21acbe0a8085d (DEFAULT_TABLE table=default.Table_d68a03611fb04e57a0bfba61c0921f5b [id=702da22d51af40638f69620d00fc50b5]), partition=RANGE (key) PARTITION UNBOUNDED
W20250830 07:54:39.589200 13228 catalog_manager.cc:5415] Ignoring report from unknown tablet 861809cc50764aa89140e587489e2d88
W20250830 07:54:39.589315 13228 catalog_manager.cc:5415] Ignoring report from unknown tablet 3167b609ed184decb4ccdb4945933ebb
I20250830 07:54:39.593748 13228 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_f61a294aa5624e5fa7b38c70b72a4bc2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:39.596135 13228 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f61a294aa5624e5fa7b38c70b72a4bc2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250830 07:54:39.606467 13229 catalog_manager.cc:5415] Ignoring report from unknown tablet 3167b609ed184decb4ccdb4945933ebb
I20250830 07:54:39.608301 13755 tablet_service.cc:1468] Processing CreateTablet for tablet db7144b25ff34bed8c7b779ba9497ef4 (DEFAULT_TABLE table=default.Table_9aa8d17e919f4ae09cb9c42cf2ba54a5 [id=91fe2be3513e4073aba290fc05ab108b]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:39.608770 14467 raft_consensus.cc:491] T 00000000000000000000000000000000 P 3ea183a890b84f408b20b55e9eb7c7ed [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5e9d6449ae824acab24c459a72075e88)
I20250830 07:54:39.609052 14467 raft_consensus.cc:513] T 00000000000000000000000000000000 P 3ea183a890b84f408b20b55e9eb7c7ed [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fea6152429cc4e79a25b18e02aafae57" member_type: VOTER last_known_addr { host: "127.12.209.62" port: 39725 } } peers { permanent_uuid: "5e9d6449ae824acab24c459a72075e88" member_type: VOTER last_known_addr { host: "127.12.209.61" port: 44241 } } peers { permanent_uuid: "3ea183a890b84f408b20b55e9eb7c7ed" member_type: VOTER last_known_addr { host: "127.12.209.60" port: 43889 } }
I20250830 07:54:39.566226 14445 consensus_queue.cc:1035] T d4e35395930f4c37b34649da5718aa1f P 6b5e454d98894637b466ea27f1b647f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:54:39.613229 14424 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3ea183a890b84f408b20b55e9eb7c7ed [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5e9d6449ae824acab24c459a72075e88. Latest consensus state: current_term: 2 leader_uuid: "5e9d6449ae824acab24c459a72075e88" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fea6152429cc4e79a25b18e02aafae57" member_type: VOTER last_known_addr { host: "127.12.209.62" port: 39725 } } peers { permanent_uuid: "5e9d6449ae824acab24c459a72075e88" member_type: VOTER last_known_addr { host: "127.12.209.61" port: 44241 } } peers { permanent_uuid: "3ea183a890b84f408b20b55e9eb7c7ed" member_type: VOTER last_known_addr { host: "127.12.209.60" port: 43889 } } }
I20250830 07:54:39.613425 14424 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3ea183a890b84f408b20b55e9eb7c7ed [sys.catalog]: This master's current role is: FOLLOWER
W20250830 07:54:39.615351 13229 catalog_manager.cc:5415] Ignoring report from unknown tablet 7c8e248d938f4651ae13199122b08768
W20250830 07:54:39.616302 13229 catalog_manager.cc:5415] Ignoring report from unknown tablet 008827b3d09d464b9182fb42dc2170d5
I20250830 07:54:39.616317 13231 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_78055261418242849901a0fd7e88083e" } modify_external_catalogs: true
W20250830 07:54:39.616578 13229 catalog_manager.cc:5415] Ignoring report from unknown tablet 3167b609ed184decb4ccdb4945933ebb
I20250830 07:54:39.616626 13231 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_78055261418242849901a0fd7e88083e" } modify_external_catalogs: true
W20250830 07:54:39.620147 13233 catalog_manager.cc:5415] Ignoring report from unknown tablet afb132e8a5b14a029e005e375f276348
I20250830 07:54:39.620609 14467 leader_election.cc:290] T 00000000000000000000000000000000 P 3ea183a890b84f408b20b55e9eb7c7ed [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fea6152429cc4e79a25b18e02aafae57 (127.12.209.62:39725), 5e9d6449ae824acab24c459a72075e88 (127.12.209.61:44241)
W20250830 07:54:39.620438 14508 log.cc:927] Time spent T d4e35395930f4c37b34649da5718aa1f P 6b5e454d98894637b466ea27f1b647f9: Append to log took a long time: real 0.067s user 0.000s sys 0.000s
I20250830 07:54:39.630421 13882 ts_tablet_manager.cc:1428] T afb132e8a5b14a029e005e375f276348 P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.068s user 0.003s sys 0.000s
I20250830 07:54:39.644222 13233 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_d68a03611fb04e57a0bfba61c0921f5b" } new_table_name: "default.Table_7e6ff9d50e134fdeab2a52fca051aadf" modify_external_catalogs: true
I20250830 07:54:39.645248 13753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8660a6ff9254d4f9f0ef047b8682ed1. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:39.645220 13229 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_c01144cf05e74ffea49c8b6a709652e2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250830 07:54:39.646257 13954 consensus_queue.cc:1035] T 05da843c0fe4482a926e410e06b22461 P 2065c332f15a4739899af79f3669c3ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.060s
I20250830 07:54:39.647511 13232 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_de0f48eea7d242d18e0801cf1190d363"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250830 07:54:39.647420 13882 tablet_bootstrap.cc:492] T 2009012fddc24e4fb7ad0fab33a1103b P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
W20250830 07:54:39.648036 13229 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c01144cf05e74ffea49c8b6a709652e2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:39.648378 13452 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2048c04578104c78aa6504fd9d5953a3. 1 dirs total, 0 dirs full, 0 dirs failed
W20250830 07:54:39.648414 13232 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_de0f48eea7d242d18e0801cf1190d363 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:39.649835 13225 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_0a409df4f056485face66acaeadfeda9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:39.650357 13225 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0a409df4f056485face66acaeadfeda9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:39.651397 13226 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_456a93d36cbe4e58a192a0c6bc9518fa"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:39.651873 13226 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_456a93d36cbe4e58a192a0c6bc9518fa in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:39.660099 14502 consensus_queue.cc:1035] T 7238db7e31484201a30cf4c035d82aff P 2065c332f15a4739899af79f3669c3ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.088s
W20250830 07:54:39.666473 13701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.209.1:45325, user_credentials={real_user=slave}} blocked reactor thread for 293597us
I20250830 07:54:39.666714 13886 tablet_bootstrap.cc:492] T 62ee2d0fbd774d38a4a4c4a033584ef9 P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:54:39.667166 13752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 76ab56c469cf4675a4e21acbe0a8085d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:39.667815 13886 ts_tablet_manager.cc:1397] T 62ee2d0fbd774d38a4a4c4a033584ef9 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.830s user 0.020s sys 0.012s
I20250830 07:54:39.669207 13456 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8660a6ff9254d4f9f0ef047b8682ed1. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:39.672502 13882 tablet_bootstrap.cc:654] T 2009012fddc24e4fb7ad0fab33a1103b P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:39.681043 13463 tablet_service.cc:1468] Processing CreateTablet for tablet 796e01f6a36241fc94e335253929d6ab (DEFAULT_TABLE table=default.Table_c71f75e4206e47d0be0d45f0e006cc3d [id=0d8f23d4f0244a12810e64acd4ddb3bf]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:39.681509 13463 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 796e01f6a36241fc94e335253929d6ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:39.689586 13739 tablet_service.cc:1468] Processing CreateTablet for tablet f5baa35307a1425c8d52666d130d6d8a (DEFAULT_TABLE table=default.Table_6fdd8b95556645e3aca8b103373a8dac [id=6a35c4abd132478caba0152786455169]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:39.695708 13750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 852e353f6ee945628ddebdbdd1bd76fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:39.697651 14445 raft_consensus.cc:491] T afb132e8a5b14a029e005e375f276348 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:39.697837 14445 raft_consensus.cc:513] T afb132e8a5b14a029e005e375f276348 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:39.698652 14445 leader_election.cc:290] T afb132e8a5b14a029e005e375f276348 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
W20250830 07:54:39.701069 13219 catalog_manager.cc:4895] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): delete failed for tablet 7c8e248d938f4651ae13199122b08768 because the tablet was not found. No further retry: Not found: Tablet not found: 7c8e248d938f4651ae13199122b08768
I20250830 07:54:39.705206 14198 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" instance_seqno: 1756540470476645) as {username='slave'} at 127.12.209.3:56077; Asking this server to re-register.
W20250830 07:54:39.706691 13701 leader_election.cc:343] T e4f1ff6026bb45e28e63c27c83399d72 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:39.710397 13701 leader_election.cc:304] T 6492bd11e50d4900927db0de3757aa24 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters:
I20250830 07:54:39.712730 13882 tablet_bootstrap.cc:492] T 2009012fddc24e4fb7ad0fab33a1103b P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:54:39.715224 13820 heartbeater.cc:461] Registering TS with master...
I20250830 07:54:39.716308 13882 ts_tablet_manager.cc:1397] T 2009012fddc24e4fb7ad0fab33a1103b P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.070s user 0.009s sys 0.000s
I20250830 07:54:39.716506 13744 tablet_service.cc:1515] Processing DeleteTablet for tablet 43e93d3038f7496ebb18319420ab67e0 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:38 UTC) from {username='slave'} at 127.0.0.1:45460
I20250830 07:54:39.726086 13883 ts_tablet_manager.cc:1918] T 7c8e248d938f4651ae13199122b08768 P 2065c332f15a4739899af79f3669c3ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250830 07:54:39.726801 13883 log.cc:1199] T 7c8e248d938f4651ae13199122b08768 P 2065c332f15a4739899af79f3669c3ba: Deleting WAL directory at /tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/ts-0/wal/wals/7c8e248d938f4651ae13199122b08768
I20250830 07:54:39.727375 13883 ts_tablet_manager.cc:1939] T 7c8e248d938f4651ae13199122b08768 P 2065c332f15a4739899af79f3669c3ba: Deleting consensus metadata
I20250830 07:54:39.729049 13883 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37956 (request call id 278) took 1448 ms. Trace:
I20250830 07:54:39.728754 13882 raft_consensus.cc:357] T 2009012fddc24e4fb7ad0fab33a1103b P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:54:39.731606 13882 raft_consensus.cc:383] T 2009012fddc24e4fb7ad0fab33a1103b P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:39.732044 13882 raft_consensus.cc:738] T 2009012fddc24e4fb7ad0fab33a1103b P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:54:39.733326 13882 consensus_queue.cc:260] T 2009012fddc24e4fb7ad0fab33a1103b P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:54:39.733877 13754 tablet_service.cc:1515] Processing DeleteTablet for tablet 95b6f084eb5240ea94c125eaa154ac9f with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:38 UTC) from {username='slave'} at 127.0.0.1:45460
I20250830 07:54:39.737032 13755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet db7144b25ff34bed8c7b779ba9497ef4. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:39.736955 13882 ts_tablet_manager.cc:1428] T 2009012fddc24e4fb7ad0fab33a1103b P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.020s user 0.001s sys 0.002s
I20250830 07:54:39.739240 13882 tablet_bootstrap.cc:492] T b480f5eb03804baeb61cd0424d70faf5 P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:54:39.739501 13736 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c8bc6e07377a4ba99c39a909dae11402. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:39.739741 13754 tablet_service.cc:1515] Processing DeleteTablet for tablet 97d49a1f600f4c13a4aafca99cedabe8 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:39 UTC) from {username='slave'} at 127.0.0.1:45460
I20250830 07:54:39.734138 13744 tablet_service.cc:1515] Processing DeleteTablet for tablet acca1a8240454b889c63c82d3c75087e with delete_type TABLET_DATA_DELETED (replaced by tablet b85843ab0e3a40e1b453cfdd71bbae5e) from {username='slave'} at 127.0.0.1:45460
I20250830 07:54:39.740553 14480 consensus_queue.cc:1035] T d4e35395930f4c37b34649da5718aa1f P 6b5e454d98894637b466ea27f1b647f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20250830 07:54:39.741808 13748 tablet_service.cc:1515] Processing DeleteTablet for tablet 28c2f7a3a6dd444585f0f5d337b985e9 with delete_type TABLET_DATA_DELETED (replaced by tablet 2d91b0ba74034b85812a13719e21dc6c) from {username='slave'} at 127.0.0.1:45460
I20250830 07:54:39.748251 13882 tablet_bootstrap.cc:654] T b480f5eb03804baeb61cd0424d70faf5 P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:39.749836 13886 raft_consensus.cc:357] T 62ee2d0fbd774d38a4a4c4a033584ef9 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:39.750047 13886 raft_consensus.cc:383] T 62ee2d0fbd774d38a4a4c4a033584ef9 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:39.750768 13886 raft_consensus.cc:738] T 62ee2d0fbd774d38a4a4c4a033584ef9 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:54:39.751029 13886 consensus_queue.cc:260] T 62ee2d0fbd774d38a4a4c4a033584ef9 P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:39.753362 13886 ts_tablet_manager.cc:1428] T 62ee2d0fbd774d38a4a4c4a033584ef9 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.084s user 0.002s sys 0.000s
I20250830 07:54:39.754242 13754 tablet_service.cc:1515] Processing DeleteTablet for tablet ef1ab62a5b7845e58d50f34206eaaa27 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:39 UTC) from {username='slave'} at 127.0.0.1:45460
W20250830 07:54:39.756403 13219 catalog_manager.cc:4908] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): delete failed for tablet 43e93d3038f7496ebb18319420ab67e0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 43e93d3038f7496ebb18319420ab67e0 already in progress: creating tablet
I20250830 07:54:39.756870 13886 tablet_bootstrap.cc:492] T ada52626bbc94105a8b9428b0bbdfb5e P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:54:39.757933 13747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 796e01f6a36241fc94e335253929d6ab. 1 dirs total, 0 dirs full, 0 dirs failed
W20250830 07:54:39.758966 13219 catalog_manager.cc:4908] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): delete failed for tablet 95b6f084eb5240ea94c125eaa154ac9f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 95b6f084eb5240ea94c125eaa154ac9f already in progress: creating tablet
W20250830 07:54:39.759320 13219 catalog_manager.cc:4908] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): delete failed for tablet 97d49a1f600f4c13a4aafca99cedabe8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 97d49a1f600f4c13a4aafca99cedabe8 already in progress: creating tablet
W20250830 07:54:39.759569 13219 catalog_manager.cc:4908] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): delete failed for tablet acca1a8240454b889c63c82d3c75087e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet acca1a8240454b889c63c82d3c75087e already in progress: creating tablet
W20250830 07:54:39.759795 13219 catalog_manager.cc:4908] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): delete failed for tablet 28c2f7a3a6dd444585f0f5d337b985e9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 28c2f7a3a6dd444585f0f5d337b985e9 already in progress: creating tablet
W20250830 07:54:39.760026 13219 catalog_manager.cc:4908] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): delete failed for tablet ef1ab62a5b7845e58d50f34206eaaa27 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ef1ab62a5b7845e58d50f34206eaaa27 already in progress: creating tablet
W20250830 07:54:39.760286 13221 catalog_manager.cc:4726] Async tablet task AlterTable RPC for tablet aee84a97524e4568acdc4ae1c74fb492 (table default.Table_65ab52329c314c13817e7261f5108188 [id=18b2c25896e546748465c4807b839cbf], current schema version=2) failed: Not found: failed to reset TS proxy: No leader found: Tablet aee84a97524e4568acdc4ae1c74fb492 consensus state has no leader
I20250830 07:54:39.760597 13745 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1520d7257f864ea4ba4b9a5d0443f8a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:39.760964 13772 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "afb132e8a5b14a029e005e375f276348" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:39.761227 13772 raft_consensus.cc:2391] T afb132e8a5b14a029e005e375f276348 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b5e454d98894637b466ea27f1b647f9 in current term 1: Already voted for candidate 9b057ade5dce45af9f8bf0bedf8b917f in this term.
I20250830 07:54:39.765321 13234 catalog_manager.cc:5864] Not sending DeleteTablet requests; no consensus state for tablet 3866260af12943acb496d9d60633db87
W20250830 07:54:39.766865 13234 catalog_manager.cc:5415] Ignoring report from unknown tablet afb132e8a5b14a029e005e375f276348
I20250830 07:54:39.767621 13234 master_service.cc:948] ReplaceTablet: received request to replace tablet b83dfc54383d4e7b96523568aea5c9f3 from {username='slave'} at 127.0.0.1:42126
I20250830 07:54:39.768056 13227 catalog_manager.cc:5864] Not sending DeleteTablet requests; no consensus state for tablet f519f292f2cc4e2b8c63c0404fef1125
I20250830 07:54:39.768344 13227 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_9fe110ab062c400d8861f86ac328ea71"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250830 07:54:39.768435 13453 tablet_service.cc:1468] Processing CreateTablet for tablet c8bc6e07377a4ba99c39a909dae11402 (DEFAULT_TABLE table=default.Table_86c9025e70234ffeb1cafaac64f9b691 [id=dce926f371dd4b4ba61511c14d245622]), partition=RANGE (key) PARTITION UNBOUNDED
W20250830 07:54:39.768918 13227 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9fe110ab062c400d8861f86ac328ea71 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250830 07:54:39.770215 13230 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 13df49c2c2cd4e5cae26a540835b74c9 consensus state has no leader
I20250830 07:54:39.770852 13230 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_b5663761ffc54702be1146492aaf6430" } new_table_name: "default.Table_3ab80fb58bfa45f0aa3aaeef49d0b416" modify_external_catalogs: true
I20250830 07:54:39.774539 13882 tablet_bootstrap.cc:492] T b480f5eb03804baeb61cd0424d70faf5 P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:54:39.774701 13882 ts_tablet_manager.cc:1397] T b480f5eb03804baeb61cd0424d70faf5 P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.037s user 0.007s sys 0.001s
I20250830 07:54:39.775534 13882 raft_consensus.cc:357] T b480f5eb03804baeb61cd0424d70faf5 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:54:39.775723 13882 raft_consensus.cc:383] T b480f5eb03804baeb61cd0424d70faf5 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:39.775832 13882 raft_consensus.cc:738] T b480f5eb03804baeb61cd0424d70faf5 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:54:39.776062 13882 consensus_queue.cc:260] T b480f5eb03804baeb61cd0424d70faf5 P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:54:39.776381 13453 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c8bc6e07377a4ba99c39a909dae11402. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:39.776607 13882 ts_tablet_manager.cc:1428] T b480f5eb03804baeb61cd0424d70faf5 P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20250830 07:54:39.777123 13882 tablet_bootstrap.cc:492] T 91ab8c468c8143b9ae11b839a95a26fd P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:54:39.781679 13484 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "afb132e8a5b14a029e005e375f276348" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:54:39.784592 13882 tablet_bootstrap.cc:654] T 91ab8c468c8143b9ae11b839a95a26fd P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:39.787283 13460 tablet_service.cc:1468] Processing CreateTablet for tablet a7dc529c40544bafbc9e7f0ab34086bd (DEFAULT_TABLE table=default.Table_718987422ffe497c86a1b4e53c47d620 [id=2516f68ca8104ddd819df0fb8a6975b2]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:39.787837 14262 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51788 (request call id 0) took 2249 ms. Trace:
I20250830 07:54:39.793047 13484 raft_consensus.cc:2466] T afb132e8a5b14a029e005e375f276348 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b5e454d98894637b466ea27f1b647f9 in term 0.
I20250830 07:54:39.803628 13228 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_e9dc95fecbf6406997ec10252d8e788e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250830 07:54:39.804312 13231 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet ca959e42c8764eeba0faee96caf8b39f
W20250830 07:54:39.804324 13228 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e9dc95fecbf6406997ec10252d8e788e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:39.805059 13231 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_41eb28f070d04bf69d643c4208052120"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:39.805538 13231 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_41eb28f070d04bf69d643c4208052120 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250830 07:54:39.806669 13233 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 76ab56c469cf4675a4e21acbe0a8085d consensus state has no leader
I20250830 07:54:39.806699 13561 leader_election.cc:304] T afb132e8a5b14a029e005e375f276348 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 6b5e454d98894637b466ea27f1b647f9; no voters:
I20250830 07:54:39.807024 14445 raft_consensus.cc:2802] T afb132e8a5b14a029e005e375f276348 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:54:39.807154 14445 raft_consensus.cc:491] T afb132e8a5b14a029e005e375f276348 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:54:39.807242 14445 raft_consensus.cc:3058] T afb132e8a5b14a029e005e375f276348 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:39.807168 13233 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_d72a50af0d2844f0b50c767903f8f693" } new_table_name: "default.Table_bff4eb83b12a4825993387659d6b3428" modify_external_catalogs: true
I20250830 07:54:39.809104 13232 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_cfc5a483d4e2458894ca6d5044bbebf6" } new_table_name: "default.Table_50694aef0f8f4d3ba65034dc94d0efb4" modify_external_catalogs: true
I20250830 07:54:39.810539 13226 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_df56588fffed4c0cb8cfd91844045df2" } modify_external_catalogs: true
I20250830 07:54:39.810711 13226 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_df56588fffed4c0cb8cfd91844045df2" } modify_external_catalogs: true
I20250830 07:54:39.810638 14445 raft_consensus.cc:513] T afb132e8a5b14a029e005e375f276348 P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:39.812467 14445 leader_election.cc:290] T afb132e8a5b14a029e005e375f276348 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 election: Requested vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:39.813652 13594 tablet_service.cc:1515] Processing DeleteTablet for tablet ca959e42c8764eeba0faee96caf8b39f with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:39 UTC) from {username='slave'} at 127.0.0.1:45306
I20250830 07:54:39.814414 13227 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_d1157e0797784cdca583812222959656"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:39.814981 13227 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d1157e0797784cdca583812222959656 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250830 07:54:39.816424 13220 catalog_manager.cc:4908] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet ca959e42c8764eeba0faee96caf8b39f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ca959e42c8764eeba0faee96caf8b39f already in progress: creating tablet
I20250830 07:54:39.820448 13229 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_de8e8221990d4aed88566a552450af56" } modify_external_catalogs: true
I20250830 07:54:39.820631 13229 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_de8e8221990d4aed88566a552450af56" } modify_external_catalogs: true
I20250830 07:54:39.823405 13225 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_ee107090683f4625a3815e28e838c84a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:39.823884 13225 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ee107090683f4625a3815e28e838c84a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:39.825628 13466 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 305) took 1088 ms. Trace:
I20250830 07:54:39.827395 13464 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 326) took 1015 ms. Trace:
I20250830 07:54:39.831943 13460 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a7dc529c40544bafbc9e7f0ab34086bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:39.833084 13882 tablet_bootstrap.cc:492] T 91ab8c468c8143b9ae11b839a95a26fd P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:54:39.833266 13882 ts_tablet_manager.cc:1397] T 91ab8c468c8143b9ae11b839a95a26fd P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.056s user 0.002s sys 0.012s
I20250830 07:54:39.834192 13882 raft_consensus.cc:357] T 91ab8c468c8143b9ae11b839a95a26fd P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:39.834415 13882 raft_consensus.cc:383] T 91ab8c468c8143b9ae11b839a95a26fd P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:39.834486 13882 raft_consensus.cc:738] T 91ab8c468c8143b9ae11b839a95a26fd P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:54:39.834720 13882 consensus_queue.cc:260] T 91ab8c468c8143b9ae11b839a95a26fd P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:39.783604 13883 rpcz_store.cc:276] 0830 07:54:38.281049 (+ 0us) service_pool.cc:168] Inserting onto call queue
0830 07:54:38.433191 (+152142us) service_pool.cc:225] Handling call
0830 07:54:38.592167 (+158976us) ts_tablet_manager.cc:1145] Deleting tablet 7c8e248d938f4651ae13199122b08768
0830 07:54:38.604374 (+ 12207us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0830 07:54:39.212161 (+607787us) spinlock_profiling.cc:243] Waited 425 ms on lock 0x6160001a0e54. stack: 00007fc8027427d6 00007fc802742590 00007fc8017353ad 0000000000972d94 0000000000972d5d 000000000097272a 00007fc80e1c9600 00007fc80f4dcb13 00007fc811fbf2b7 00007fc811ff1344 00007fc811fd2da0 00007fc811fd2b2d 0000000000a774dc 00007fc802788b5f 00007fc80278be2b 00007fc80278bca8
0830 07:54:39.487804 (+275643us) tablet_metadata.cc:641] Metadata flushed
0830 07:54:39.725925 (+238121us) tablet_metadata.cc:641] Metadata flushed
0830 07:54:39.729012 (+ 3087us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":18605,"spinlock_wait_cycles":978115328,"tablet-delete.queue_time_us":86837}
I20250830 07:54:39.837559 13882 ts_tablet_manager.cc:1428] T 91ab8c468c8143b9ae11b839a95a26fd P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20250830 07:54:39.837955 13882 tablet_bootstrap.cc:492] T 6492bd11e50d4900927db0de3757aa24 P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:54:39.837965 13218 catalog_manager.cc:4928] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): tablet 7c8e248d938f4651ae13199122b08768 (table default.Table_b272b07ca0614cafb8c14f4e2132d255 [id=957201242ea748618cc610a5002a8684]) successfully deleted
I20250830 07:54:39.842015 13460 tablet_service.cc:1468] Processing CreateTablet for tablet 1520d7257f864ea4ba4b9a5d0443f8a7 (DEFAULT_TABLE table=default.Table_d72b020da8b34ec291b8c8dcd8e0d459 [id=1740a0f9c36b44a7ab5b65366950cc95]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:39.842551 13460 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1520d7257f864ea4ba4b9a5d0443f8a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:39.842576 13882 tablet_bootstrap.cc:654] T 6492bd11e50d4900927db0de3757aa24 P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:39.844233 13449 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 328) took 1003 ms. Trace:
I20250830 07:54:39.844398 13449 rpcz_store.cc:276] 0830 07:54:38.822158 (+ 0us) service_pool.cc:168] Inserting onto call queue
0830 07:54:39.327678 (+505520us) service_pool.cc:225] Handling call
0830 07:54:39.349666 (+ 21988us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0830 07:54:39.349697 (+ 31us) ts_tablet_manager.cc:676] Creating new metadata...
0830 07:54:39.756459 (+406762us) tablet_metadata.cc:641] Metadata flushed
0830 07:54:39.825828 (+ 69369us) tablet_replica.cc:206] Creating consensus instance
0830 07:54:39.825972 (+ 144us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20250830 07:54:39.845088 13449 tablet_service.cc:1468] Processing CreateTablet for tablet 6251a06d1efe44e38d35d962c468f8b2 (DEFAULT_TABLE table=default.Table_a1b7e99160f443da8add698947fe9e63 [id=b48c4464cfae4e0384974f9647660540]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:39.845537 13449 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6251a06d1efe44e38d35d962c468f8b2. 1 dirs total, 0 dirs full, 0 dirs failed
W20250830 07:54:39.850265 13230 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 70703eb1d47841a1a227e277ed6a268d consensus state has no leader
I20250830 07:54:39.850569 13230 master_service.cc:948] ReplaceTablet: received request to replace tablet de3a52a8e08a45808373902a0185e6f0 from {username='slave'} at 127.0.0.1:42126
I20250830 07:54:39.851802 13228 master_service.cc:948] ReplaceTablet: received request to replace tablet da5c7b084e1f4fda92fff35a9cb2c7fc from {username='slave'} at 127.0.0.1:42126
I20250830 07:54:39.852182 13231 master_service.cc:948] ReplaceTablet: received request to replace tablet 7c5e50cb605c4a40b47984f328eedd93 from {username='slave'} at 127.0.0.1:42126
I20250830 07:54:39.852499 13231 master_service.cc:948] ReplaceTablet: received request to replace tablet 70703eb1d47841a1a227e277ed6a268d from {username='slave'} at 127.0.0.1:42126
I20250830 07:54:39.853154 13464 rpcz_store.cc:276] 0830 07:54:38.812268 (+ 0us) service_pool.cc:168] Inserting onto call queue
0830 07:54:38.890400 (+ 78132us) service_pool.cc:225] Handling call
0830 07:54:38.890936 (+ 536us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0830 07:54:38.890963 (+ 27us) ts_tablet_manager.cc:676] Creating new metadata...
0830 07:54:39.412727 (+521764us) tablet_metadata.cc:641] Metadata flushed
0830 07:54:39.827236 (+414509us) tablet_replica.cc:206] Creating consensus instance
0830 07:54:39.827361 (+ 125us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20250830 07:54:39.853591 13233 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d64f20df166a46249c08444f44422fc3 consensus state has no leader
I20250830 07:54:39.853662 13464 tablet_service.cc:1468] Processing CreateTablet for tablet 852e353f6ee945628ddebdbdd1bd76fb (DEFAULT_TABLE table=default.Table_4abf499bcf8a4fd88fd739d3a1daee3a [id=768d7e569197455bb092328ca1b32ed0]), partition=RANGE (key) PARTITION UNBOUNDED
W20250830 07:54:39.853966 13232 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 04eadf45b82e4c319eb7b316a402d81a consensus state has no leader
I20250830 07:54:39.854112 13464 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 852e353f6ee945628ddebdbdd1bd76fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:39.854524 13226 catalog_manager.cc:5864] Not sending DeleteTablet requests; no consensus state for tablet 9e0f0f8a6ed64e5fb23d9c8bf0f913f4
I20250830 07:54:39.851826 13234 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet b83dfc54383d4e7b96523568aea5c9f3
I20250830 07:54:39.857122 13234 catalog_manager.cc:6652] ReplaceTablet: tablet b83dfc54383d4e7b96523568aea5c9f3 deleted and replaced by tablet 5dffbacf2fcd4a38a1d61cf5bb9c5eeb
I20250830 07:54:39.857704 13594 tablet_service.cc:1515] Processing DeleteTablet for tablet b83dfc54383d4e7b96523568aea5c9f3 with delete_type TABLET_DATA_DELETED (replaced by tablet 5dffbacf2fcd4a38a1d61cf5bb9c5eeb) from {username='slave'} at 127.0.0.1:45306
W20250830 07:54:39.858688 13220 catalog_manager.cc:4908] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet b83dfc54383d4e7b96523568aea5c9f3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b83dfc54383d4e7b96523568aea5c9f3 already in progress: creating tablet
I20250830 07:54:39.858928 13882 tablet_bootstrap.cc:492] T 6492bd11e50d4900927db0de3757aa24 P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:54:39.859073 13882 ts_tablet_manager.cc:1397] T 6492bd11e50d4900927db0de3757aa24 P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.021s user 0.001s sys 0.004s
I20250830 07:54:39.859885 13882 raft_consensus.cc:357] T 6492bd11e50d4900927db0de3757aa24 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:39.860067 13882 raft_consensus.cc:383] T 6492bd11e50d4900927db0de3757aa24 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:39.860339 13882 raft_consensus.cc:738] T 6492bd11e50d4900927db0de3757aa24 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:54:39.860754 13882 consensus_queue.cc:260] T 6492bd11e50d4900927db0de3757aa24 P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:39.861470 13882 ts_tablet_manager.cc:1428] T 6492bd11e50d4900927db0de3757aa24 P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20250830 07:54:39.861876 13882 tablet_bootstrap.cc:492] T e4f1ff6026bb45e28e63c27c83399d72 P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:54:39.864560 13451 tablet_service.cc:1468] Processing CreateTablet for tablet 689b4fee1dd04b3d9ccdea334b0f6b59 (DEFAULT_TABLE table=default.Table_3c6b83acc24c48e4ace89e977f29c549 [id=f64b358cd69f4bd292434b30333fde87]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:39.865000 13451 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 689b4fee1dd04b3d9ccdea334b0f6b59. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:39.869401 13882 tablet_bootstrap.cc:654] T e4f1ff6026bb45e28e63c27c83399d72 P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:39.870857 13740 tablet_service.cc:1515] Processing DeleteTablet for tablet b83dfc54383d4e7b96523568aea5c9f3 with delete_type TABLET_DATA_DELETED (replaced by tablet 5dffbacf2fcd4a38a1d61cf5bb9c5eeb) from {username='slave'} at 127.0.0.1:45460
W20250830 07:54:39.872262 13219 catalog_manager.cc:4908] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): delete failed for tablet b83dfc54383d4e7b96523568aea5c9f3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b83dfc54383d4e7b96523568aea5c9f3 already in progress: creating tablet
I20250830 07:54:39.872478 13739 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5baa35307a1425c8d52666d130d6d8a. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:39.875393 13466 rpcz_store.cc:276] 0830 07:54:38.693985 (+ 0us) service_pool.cc:168] Inserting onto call queue
0830 07:54:38.694516 (+ 531us) service_pool.cc:225] Handling call
0830 07:54:38.894967 (+200451us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0830 07:54:38.894996 (+ 29us) ts_tablet_manager.cc:676] Creating new metadata...
0830 07:54:39.772435 (+877439us) tablet_metadata.cc:641] Metadata flushed
0830 07:54:39.777164 (+ 4729us) tablet_replica.cc:206] Creating consensus instance
0830 07:54:39.782141 (+ 4977us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20250830 07:54:39.875609 13171 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "3ea183a890b84f408b20b55e9eb7c7ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 524 } } ignore_live_leader: false dest_uuid: "fea6152429cc4e79a25b18e02aafae57" is_pre_election: true
I20250830 07:54:39.876031 14198 ts_manager.cc:194] Registered new tserver with Master: 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:39.877007 13462 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 309) took 1093 ms. Trace:
I20250830 07:54:39.877620 13754 tablet_service.cc:1515] Processing DeleteTablet for tablet ca959e42c8764eeba0faee96caf8b39f with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:39 UTC) from {username='slave'} at 127.0.0.1:45460
I20250830 07:54:39.880026 13887 tablet_bootstrap.cc:492] T e4f1ff6026bb45e28e63c27c83399d72 P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:54:39.880605 13484 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "afb132e8a5b14a029e005e375f276348" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba"
W20250830 07:54:39.882568 13219 catalog_manager.cc:4908] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): delete failed for tablet ca959e42c8764eeba0faee96caf8b39f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ca959e42c8764eeba0faee96caf8b39f already in progress: creating tablet
I20250830 07:54:39.883286 13468 tablet_service.cc:1468] Processing CreateTablet for tablet 76ab56c469cf4675a4e21acbe0a8085d (DEFAULT_TABLE table=default.Table_d68a03611fb04e57a0bfba61c0921f5b [id=702da22d51af40638f69620d00fc50b5]), partition=RANGE (key) PARTITION UNBOUNDED
W20250830 07:54:39.887604 13234 catalog_manager.cc:5415] Ignoring report from unknown tablet 9b9c2ae8805a48f7959d6745677a96f2
W20250830 07:54:39.887703 13234 catalog_manager.cc:5415] Ignoring report from unknown tablet 1476bb480bf747838613948875001c30
W20250830 07:54:39.887900 13234 catalog_manager.cc:5415] Ignoring report from unknown tablet ed87c6793dd149a6a363f1977d816628
W20250830 07:54:39.888031 13234 catalog_manager.cc:5415] Ignoring report from unknown tablet e4f1ff6026bb45e28e63c27c83399d72
W20250830 07:54:39.888204 13234 catalog_manager.cc:5415] Ignoring report from unknown tablet ff0f9cccc8ed43b1a8cd38de0e9d4097
W20250830 07:54:39.890184 13234 catalog_manager.cc:5415] Ignoring report from unknown tablet c3b35ea656db4741a02e6746e1b049ec
I20250830 07:54:39.890187 13883 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37956 (request call id 279) took 1587 ms. Trace:
W20250830 07:54:39.890328 13234 catalog_manager.cc:5415] Ignoring report from unknown tablet d1ae3812d72b419798736328da64b53c
I20250830 07:54:39.890724 14382 raft_consensus.cc:2802] T 6492bd11e50d4900927db0de3757aa24 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:54:39.890787 13701 leader_election.cc:304] T c3b35ea656db4741a02e6746e1b049ec P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
W20250830 07:54:39.891780 13234 catalog_manager.cc:5415] Ignoring report from unknown tablet 9696d8531a174585b8fd83a2391c02f7
W20250830 07:54:39.891877 13234 catalog_manager.cc:5415] Ignoring report from unknown tablet b480f5eb03804baeb61cd0424d70faf5
W20250830 07:54:39.891955 13234 catalog_manager.cc:5415] Ignoring report from unknown tablet 3167b609ed184decb4ccdb4945933ebb
W20250830 07:54:39.892158 13234 catalog_manager.cc:5415] Ignoring report from unknown tablet 29d492735cd14bb6b4a2a9a3929f62f3
W20250830 07:54:39.892259 13234 catalog_manager.cc:5415] Ignoring report from unknown tablet d33a5d107c6849aca6eb48ffdf8a5463
W20250830 07:54:39.892339 13234 catalog_manager.cc:5415] Ignoring report from unknown tablet f398e12cd9f543738d5163354f8a9d9d
W20250830 07:54:39.892457 13234 catalog_manager.cc:5415] Ignoring report from unknown tablet 27da527d9fe045ae8c17f193d034f5ac
I20250830 07:54:39.892782 13234 catalog_manager.cc:5674] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743) does not have the latest schema for tablet cada6410e2884c508bb7dd38bea438ae (table default.Table_8f85f386d1e54a59a6e539b06a508623 [id=4678375d8d3d474290ad1a254de14054]). Expected version 2 got 0
W20250830 07:54:39.885195 13703 leader_election.cc:343] T e4f1ff6026bb45e28e63c27c83399d72 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
W20250830 07:54:39.894881 13701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.209.1:45325, user_credentials={real_user=slave}} blocked reactor thread for 180040us
I20250830 07:54:39.898449 13749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee44ab24333742909f773889ad5c3e00. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:39.898486 14287 raft_consensus.cc:2802] T c3b35ea656db4741a02e6746e1b049ec P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election won for term 1
I20250830 07:54:39.898658 14287 raft_consensus.cc:695] T c3b35ea656db4741a02e6746e1b049ec P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 LEADER]: Becoming Leader. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Running, Role: LEADER
I20250830 07:54:39.899271 13701 leader_election.cc:304] T b480f5eb03804baeb61cd0424d70faf5 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters:
I20250830 07:54:39.899556 14315 raft_consensus.cc:2802] T b480f5eb03804baeb61cd0424d70faf5 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:54:39.899681 14315 raft_consensus.cc:491] T b480f5eb03804baeb61cd0424d70faf5 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:54:39.899772 14315 raft_consensus.cc:3058] T b480f5eb03804baeb61cd0424d70faf5 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:39.901911 13703 leader_election.cc:304] T e4f1ff6026bb45e28e63c27c83399d72 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 2065c332f15a4739899af79f3669c3ba, 6b5e454d98894637b466ea27f1b647f9
I20250830 07:54:39.902383 13462 rpcz_store.cc:276] 0830 07:54:38.726902 (+ 0us) service_pool.cc:168] Inserting onto call queue
0830 07:54:38.727030 (+ 128us) service_pool.cc:225] Handling call
0830 07:54:38.784889 (+ 57859us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0830 07:54:38.784915 (+ 26us) ts_tablet_manager.cc:676] Creating new metadata...
0830 07:54:39.409953 (+625038us) tablet_metadata.cc:641] Metadata flushed
0830 07:54:39.820501 (+410548us) tablet_replica.cc:206] Creating consensus instance
0830 07:54:39.820706 (+ 205us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20250830 07:54:39.905905 13229 catalog_manager.cc:5864] Not sending DeleteTablet requests; no consensus state for tablet 0e17cd3406a9423b95ef894f3fb14fe2
I20250830 07:54:39.906774 13484 raft_consensus.cc:3058] T afb132e8a5b14a029e005e375f276348 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:39.907367 13468 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 76ab56c469cf4675a4e21acbe0a8085d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:39.907574 13887 ts_tablet_manager.cc:1397] T e4f1ff6026bb45e28e63c27c83399d72 P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.672s user 0.011s sys 0.009s
I20250830 07:54:39.908190 13466 tablet_service.cc:1468] Processing CreateTablet for tablet 52e910677ae34630a919d1d3f21b7e83 (DEFAULT_TABLE table=default.Table_3af4480a9af740f598919322e7fc5efc [id=b3fced981b2a4b44a8eab43675699ba5]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:39.908396 13883 rpcz_store.cc:276] 0830 07:54:38.281172 (+ 0us) service_pool.cc:168] Inserting onto call queue
0830 07:54:38.433476 (+152304us) service_pool.cc:225] Handling call
0830 07:54:39.837935 (+1404459us) ts_tablet_manager.cc:1145] Deleting tablet ec47a59c22ff4370bd21bc2a18336049
0830 07:54:39.837946 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0830 07:54:39.868812 (+ 30866us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1332539}
I20250830 07:54:39.908800 13883 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37956 (request call id 298) took 1401 ms. Trace:
I20250830 07:54:39.908905 13883 rpcz_store.cc:276] 0830 07:54:38.506900 (+ 0us) service_pool.cc:168] Inserting onto call queue
0830 07:54:38.507432 (+ 532us) service_pool.cc:225] Handling call
0830 07:54:39.908661 (+1401229us) ts_tablet_manager.cc:1145] Deleting tablet e862fa77e16945bd94e405aa3474f021
0830 07:54:39.908672 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0830 07:54:39.908771 (+ 99us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1400980}
I20250830 07:54:39.909211 13883 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37956 (request call id 302) took 1358 ms. Trace:
I20250830 07:54:39.909301 13883 rpcz_store.cc:276] 0830 07:54:38.550454 (+ 0us) service_pool.cc:168] Inserting onto call queue
0830 07:54:38.550513 (+ 59us) service_pool.cc:225] Handling call
0830 07:54:39.909090 (+1358577us) ts_tablet_manager.cc:1145] Deleting tablet 7c5e50cb605c4a40b47984f328eedd93
0830 07:54:39.909100 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0830 07:54:39.909184 (+ 84us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1358322}
I20250830 07:54:39.909591 13883 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37956 (request call id 303) took 1352 ms. Trace:
I20250830 07:54:39.909682 13883 rpcz_store.cc:276] 0830 07:54:38.557320 (+ 0us) service_pool.cc:168] Inserting onto call queue
0830 07:54:38.557383 (+ 63us) service_pool.cc:225] Handling call
0830 07:54:39.909506 (+1352123us) ts_tablet_manager.cc:1145] Deleting tablet a8660a6ff9254d4f9f0ef047b8682ed1
0830 07:54:39.909512 (+ 6us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0830 07:54:39.909562 (+ 50us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1351890}
I20250830 07:54:39.909963 13883 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37956 (request call id 300) took 1362 ms. Trace:
I20250830 07:54:39.910066 13883 rpcz_store.cc:276] 0830 07:54:38.547154 (+ 0us) service_pool.cc:168] Inserting onto call queue
0830 07:54:38.565525 (+ 18371us) service_pool.cc:225] Handling call
0830 07:54:39.909858 (+1344333us) ts_tablet_manager.cc:1145] Deleting tablet e6060a3dc6444483b8fb2944b8090cb6
0830 07:54:39.909866 (+ 8us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0830 07:54:39.909935 (+ 69us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1324584}
I20250830 07:54:39.902431 14512 raft_consensus.cc:491] T cada6410e2884c508bb7dd38bea438ae P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:39.896806 14382 raft_consensus.cc:491] T 6492bd11e50d4900927db0de3757aa24 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:54:39.899060 14287 consensus_queue.cc:237] T c3b35ea656db4741a02e6746e1b049ec P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:39.917852 13228 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet da5c7b084e1f4fda92fff35a9cb2c7fc
I20250830 07:54:39.918632 13231 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet 70703eb1d47841a1a227e277ed6a268d
I20250830 07:54:39.918807 13594 tablet_service.cc:1515] Processing DeleteTablet for tablet da5c7b084e1f4fda92fff35a9cb2c7fc with delete_type TABLET_DATA_DELETED (replaced by tablet 21fc5d35a63f4cdbbf2e61e75d292037) from {username='slave'} at 127.0.0.1:45306
I20250830 07:54:39.919149 13231 catalog_manager.cc:6652] ReplaceTablet: tablet 70703eb1d47841a1a227e277ed6a268d deleted and replaced by tablet 8028ac4c928a48f3a077d61aec24f3bd
W20250830 07:54:39.919556 13220 catalog_manager.cc:4908] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet da5c7b084e1f4fda92fff35a9cb2c7fc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet da5c7b084e1f4fda92fff35a9cb2c7fc already in progress: creating tablet
I20250830 07:54:39.919641 13228 catalog_manager.cc:6652] ReplaceTablet: tablet da5c7b084e1f4fda92fff35a9cb2c7fc deleted and replaced by tablet 21fc5d35a63f4cdbbf2e61e75d292037
I20250830 07:54:39.920116 13594 tablet_service.cc:1515] Processing DeleteTablet for tablet 70703eb1d47841a1a227e277ed6a268d with delete_type TABLET_DATA_DELETED (replaced by tablet 8028ac4c928a48f3a077d61aec24f3bd) from {username='slave'} at 127.0.0.1:45306
I20250830 07:54:39.920486 13230 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet de3a52a8e08a45808373902a0185e6f0
W20250830 07:54:39.921278 13220 catalog_manager.cc:4908] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet 70703eb1d47841a1a227e277ed6a268d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 70703eb1d47841a1a227e277ed6a268d already in progress: creating tablet
I20250830 07:54:39.921458 13230 catalog_manager.cc:6652] ReplaceTablet: tablet de3a52a8e08a45808373902a0185e6f0 deleted and replaced by tablet 53766699d42e4f6e9b42d9a98613726c
I20250830 07:54:39.921828 13594 tablet_service.cc:1515] Processing DeleteTablet for tablet de3a52a8e08a45808373902a0185e6f0 with delete_type TABLET_DATA_DELETED (replaced by tablet 53766699d42e4f6e9b42d9a98613726c) from {username='slave'} at 127.0.0.1:45306
W20250830 07:54:39.922392 13220 catalog_manager.cc:4908] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet de3a52a8e08a45808373902a0185e6f0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet de3a52a8e08a45808373902a0185e6f0 already in progress: creating tablet
W20250830 07:54:39.933947 13562 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.209.3:38743, user_credentials={real_user=slave}} blocked reactor thread for 193289us
I20250830 07:54:39.935719 14382 raft_consensus.cc:3058] T 6492bd11e50d4900927db0de3757aa24 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:39.939823 14198 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" instance_seqno: 1756540469993507) as {username='slave'} at 127.12.209.2:40303; Asking this server to re-register.
I20250830 07:54:39.939989 14382 raft_consensus.cc:513] T 6492bd11e50d4900927db0de3757aa24 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:39.940907 14382 leader_election.cc:290] T 6492bd11e50d4900927db0de3757aa24 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Requested vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967)
I20250830 07:54:39.912824 14512 raft_consensus.cc:513] T cada6410e2884c508bb7dd38bea438ae P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:39.942158 14512 leader_election.cc:290] T cada6410e2884c508bb7dd38bea438ae P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967)
I20250830 07:54:39.942602 14512 raft_consensus.cc:2747] T e4f1ff6026bb45e28e63c27c83399d72 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:54:39.944183 13244 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "3ea183a890b84f408b20b55e9eb7c7ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 524 } } ignore_live_leader: false dest_uuid: "5e9d6449ae824acab24c459a72075e88" is_pre_election: true
I20250830 07:54:39.945035 14113 leader_election.cc:304] T 00000000000000000000000000000000 P 3ea183a890b84f408b20b55e9eb7c7ed [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ea183a890b84f408b20b55e9eb7c7ed; no voters: 5e9d6449ae824acab24c459a72075e88, fea6152429cc4e79a25b18e02aafae57
I20250830 07:54:39.945513 14467 raft_consensus.cc:2747] T 00000000000000000000000000000000 P 3ea183a890b84f408b20b55e9eb7c7ed [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20250830 07:54:39.957592 13674 heartbeater.cc:461] Registering TS with master...
W20250830 07:54:39.957881 13230 catalog_manager.cc:5415] Ignoring report from unknown tablet d1ae3812d72b419798736328da64b53c
W20250830 07:54:39.958125 13230 catalog_manager.cc:5415] Ignoring report from unknown tablet 91ab8c468c8143b9ae11b839a95a26fd
W20250830 07:54:39.958264 13230 catalog_manager.cc:5415] Ignoring report from unknown tablet b480f5eb03804baeb61cd0424d70faf5
W20250830 07:54:39.958385 13230 catalog_manager.cc:5415] Ignoring report from unknown tablet 9b9c2ae8805a48f7959d6745677a96f2
W20250830 07:54:39.958480 13230 catalog_manager.cc:5415] Ignoring report from unknown tablet 2009012fddc24e4fb7ad0fab33a1103b
W20250830 07:54:39.958619 13230 catalog_manager.cc:5415] Ignoring report from unknown tablet 05da843c0fe4482a926e410e06b22461
I20250830 07:54:39.961481 13230 catalog_manager.cc:5674] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967) does not have the latest schema for tablet 6492bd11e50d4900927db0de3757aa24 (table default.Table_7dc4898210c641719d6d97c45dbd89c9 [id=b7dcb14885434162aac95c78a5a70ba9]). Expected version 7 got 0
I20250830 07:54:39.963265 14198 ts_manager.cc:194] Registered new tserver with Master: 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967)
I20250830 07:54:39.963079 13230 catalog_manager.cc:5674] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967) does not have the latest schema for tablet 7238db7e31484201a30cf4c035d82aff (table default.Table_6f8d287a31204172a037b156956fb0d9 [id=0e4bba403b27442cb6e7f5b50ff4a39f]). Expected version 1 got 0
I20250830 07:54:39.969604 13467 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 316) took 1165 ms. Trace:
I20250830 07:54:39.969787 13467 rpcz_store.cc:276] 0830 07:54:38.803994 (+ 0us) service_pool.cc:168] Inserting onto call queue
0830 07:54:38.804076 (+ 82us) service_pool.cc:225] Handling call
0830 07:54:38.843171 (+ 39095us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0830 07:54:38.843195 (+ 24us) ts_tablet_manager.cc:676] Creating new metadata...
0830 07:54:39.767616 (+924421us) tablet_metadata.cc:641] Metadata flushed
0830 07:54:39.969349 (+201733us) tablet_replica.cc:206] Creating consensus instance
0830 07:54:39.969537 (+ 188us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20250830 07:54:39.970345 13467 tablet_service.cc:1468] Processing CreateTablet for tablet f5baa35307a1425c8d52666d130d6d8a (DEFAULT_TABLE table=default.Table_6fdd8b95556645e3aca8b103373a8dac [id=6a35c4abd132478caba0152786455169]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:39.970763 13467 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5baa35307a1425c8d52666d130d6d8a. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:39.972651 13458 tablet_service.cc:1468] Processing CreateTablet for tablet 0208de98277c4d6889fb0289b6013ae1 (DEFAULT_TABLE table=default.Table_78284117ae8d41f7a9404cd74bf3f2a2 [id=f591e1acb3fc4cafa69f58ba9ff062c5]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:39.979025 13228 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_13f58d14bfbd46279e17abb34c722044" } modify_external_catalogs: true
I20250830 07:54:39.979082 13229 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_affac1e19f984bf38960e637cb801588" } new_table_name: "default.Table_6d953736964f4c279e9880e4ad210c6d" modify_external_catalogs: true
I20250830 07:54:39.979282 13228 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_13f58d14bfbd46279e17abb34c722044" } modify_external_catalogs: true
I20250830 07:54:39.982107 13231 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_caaf22211b564ae8a28d2c4987248a7b" } modify_external_catalogs: true
I20250830 07:54:39.982280 13231 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_caaf22211b564ae8a28d2c4987248a7b" } modify_external_catalogs: true
I20250830 07:54:39.987450 13228 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet a8baad9c419e436b9659d8d5582d4066
W20250830 07:54:39.988502 13229 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d1bf58d367f54ba8bad64887b9a8d9cc consensus state has no leader
I20250830 07:54:39.988737 13594 tablet_service.cc:1515] Processing DeleteTablet for tablet a8baad9c419e436b9659d8d5582d4066 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:39 UTC) from {username='slave'} at 127.0.0.1:45306
W20250830 07:54:39.990449 13220 catalog_manager.cc:4908] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet a8baad9c419e436b9659d8d5582d4066 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a8baad9c419e436b9659d8d5582d4066 already in progress: creating tablet
I20250830 07:54:39.991242 13455 tablet_service.cc:1468] Processing CreateTablet for tablet f66e1d07039841088a444ee0203a4eb0 (DEFAULT_TABLE table=default.Table_8b26aa88b9f34e35ac10a238c1b2b2a1 [id=49c7a085612145f3a514c47e91bf7f14]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:39.993723 13458 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0208de98277c4d6889fb0289b6013ae1. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:39.999651 13231 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet d2b8e6df64ef49e2ba36c093efd3c351
I20250830 07:54:40.000557 13594 tablet_service.cc:1515] Processing DeleteTablet for tablet d2b8e6df64ef49e2ba36c093efd3c351 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:39 UTC) from {username='slave'} at 127.0.0.1:45306
W20250830 07:54:40.001250 13220 catalog_manager.cc:4908] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet d2b8e6df64ef49e2ba36c093efd3c351 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d2b8e6df64ef49e2ba36c093efd3c351 already in progress: creating tablet
I20250830 07:54:40.002862 13462 tablet_service.cc:1468] Processing CreateTablet for tablet ee44ab24333742909f773889ad5c3e00 (DEFAULT_TABLE table=default.Table_ed86b365cefe4412bcc0629921f39f3b [id=caf655ebda6a46eebb1e01c23b4cb8ca]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:40.016022 13466 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52e910677ae34630a919d1d3f21b7e83. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:40.017308 13483 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "afb132e8a5b14a029e005e375f276348" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba"
I20250830 07:54:40.019428 13450 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 334) took 1174 ms. Trace:
I20250830 07:54:40.016624 13887 raft_consensus.cc:357] T e4f1ff6026bb45e28e63c27c83399d72 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:54:40.021831 14493 raft_consensus.cc:491] T 008827b3d09d464b9182fb42dc2170d5 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:40.022023 13454 tablet_service.cc:1468] Processing CreateTablet for tablet db7144b25ff34bed8c7b779ba9497ef4 (DEFAULT_TABLE table=default.Table_9aa8d17e919f4ae09cb9c42cf2ba54a5 [id=91fe2be3513e4073aba290fc05ab108b]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:40.022709 13462 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee44ab24333742909f773889ad5c3e00. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:40.023108 13464 tablet_service.cc:1515] Processing DeleteTablet for tablet 43e93d3038f7496ebb18319420ab67e0 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:38 UTC) from {username='slave'} at 127.0.0.1:37956
I20250830 07:54:40.029501 14493 raft_consensus.cc:513] T 008827b3d09d464b9182fb42dc2170d5 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:54:40.035684 13450 rpcz_store.cc:276] 0830 07:54:38.845230 (+ 0us) service_pool.cc:168] Inserting onto call queue
0830 07:54:39.395462 (+550232us) service_pool.cc:225] Handling call
0830 07:54:39.415765 (+ 20303us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0830 07:54:39.415794 (+ 29us) ts_tablet_manager.cc:676] Creating new metadata...
0830 07:54:39.766061 (+350267us) tablet_metadata.cc:641] Metadata flushed
0830 07:54:40.019249 (+253188us) tablet_replica.cc:206] Creating consensus instance
0830 07:54:40.019386 (+ 137us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20250830 07:54:40.037899 13218 catalog_manager.cc:4908] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): delete failed for tablet ec47a59c22ff4370bd21bc2a18336049 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ec47a59c22ff4370bd21bc2a18336049 already in progress: creating tablet
W20250830 07:54:40.038259 13218 catalog_manager.cc:4908] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): delete failed for tablet e862fa77e16945bd94e405aa3474f021 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e862fa77e16945bd94e405aa3474f021 already in progress: creating tablet
W20250830 07:54:40.038528 13218 catalog_manager.cc:4908] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): delete failed for tablet 7c5e50cb605c4a40b47984f328eedd93 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7c5e50cb605c4a40b47984f328eedd93 already in progress: creating tablet
W20250830 07:54:40.038760 13218 catalog_manager.cc:4895] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): delete failed for tablet a8660a6ff9254d4f9f0ef047b8682ed1 because the tablet was not found. No further retry: Not found: Tablet not found: a8660a6ff9254d4f9f0ef047b8682ed1
W20250830 07:54:40.038990 13218 catalog_manager.cc:4908] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): delete failed for tablet e6060a3dc6444483b8fb2944b8090cb6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e6060a3dc6444483b8fb2944b8090cb6 already in progress: creating tablet
W20250830 07:54:40.039633 13218 catalog_manager.cc:4908] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): delete failed for tablet 43e93d3038f7496ebb18319420ab67e0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 43e93d3038f7496ebb18319420ab67e0 already in progress: creating tablet
W20250830 07:54:40.040235 13461 consensus_meta.cc:287] T db4077bf8e184ac5809ef629222f2cc5 P 2065c332f15a4739899af79f3669c3ba: Time spent flushing consensus metadata: real 0.625s user 0.000s sys 0.004s
I20250830 07:54:40.042197 13455 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f66e1d07039841088a444ee0203a4eb0. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:40.049465 13484 raft_consensus.cc:2466] T afb132e8a5b14a029e005e375f276348 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b5e454d98894637b466ea27f1b647f9 in term 1.
I20250830 07:54:40.049624 13887 raft_consensus.cc:383] T e4f1ff6026bb45e28e63c27c83399d72 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:40.050338 13561 leader_election.cc:304] T afb132e8a5b14a029e005e375f276348 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 6b5e454d98894637b466ea27f1b647f9; no voters:
I20250830 07:54:40.050700 14480 raft_consensus.cc:2802] T afb132e8a5b14a029e005e375f276348 P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Leader election won for term 1
I20250830 07:54:40.052114 13450 tablet_service.cc:1515] Processing DeleteTablet for tablet 28c2f7a3a6dd444585f0f5d337b985e9 with delete_type TABLET_DATA_DELETED (replaced by tablet 2d91b0ba74034b85812a13719e21dc6c) from {username='slave'} at 127.0.0.1:37956
I20250830 07:54:40.050897 14480 raft_consensus.cc:695] T afb132e8a5b14a029e005e375f276348 P 6b5e454d98894637b466ea27f1b647f9 [term 1 LEADER]: Becoming Leader. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Running, Role: LEADER
I20250830 07:54:40.052466 14480 consensus_queue.cc:237] T afb132e8a5b14a029e005e375f276348 P 6b5e454d98894637b466ea27f1b647f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:40.052727 13454 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet db7144b25ff34bed8c7b779ba9497ef4. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:40.052765 13481 raft_consensus.cc:3058] T 008827b3d09d464b9182fb42dc2170d5 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:40.053084 13461 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 329) took 1229 ms. Trace:
I20250830 07:54:40.057010 13465 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 321) took 1231 ms. Trace:
I20250830 07:54:40.058521 13450 tablet_service.cc:1515] Processing DeleteTablet for tablet acca1a8240454b889c63c82d3c75087e with delete_type TABLET_DATA_DELETED (replaced by tablet b85843ab0e3a40e1b453cfdd71bbae5e) from {username='slave'} at 127.0.0.1:37956
I20250830 07:54:40.058817 13450 tablet_service.cc:1515] Processing DeleteTablet for tablet 97d49a1f600f4c13a4aafca99cedabe8 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:39 UTC) from {username='slave'} at 127.0.0.1:37956
I20250830 07:54:40.059654 13887 raft_consensus.cc:738] T e4f1ff6026bb45e28e63c27c83399d72 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:54:40.060176 13464 tablet_service.cc:1515] Processing DeleteTablet for tablet 95b6f084eb5240ea94c125eaa154ac9f with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:38 UTC) from {username='slave'} at 127.0.0.1:37956
I20250830 07:54:40.060925 13227 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_a73677e2b563409bb9c4ed171350ff2e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:40.061717 13227 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a73677e2b563409bb9c4ed171350ff2e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:40.063525 13228 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_121a01abce2f47d4a41ce33b35c8f89b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250830 07:54:40.063926 13225 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_d6a8ec58d60a4bb68d9863cf2a7dd7d5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:40.064082 13228 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_121a01abce2f47d4a41ce33b35c8f89b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250830 07:54:40.064568 13225 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d6a8ec58d60a4bb68d9863cf2a7dd7d5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:40.066831 13231 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_d49f355c492e4edead23a073107e2bec" } modify_external_catalogs: true
I20250830 07:54:40.067049 13231 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_d49f355c492e4edead23a073107e2bec" } modify_external_catalogs: true
I20250830 07:54:40.067705 13226 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_7f314a0042864cd5914a351090968456"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:40.068289 13226 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7f314a0042864cd5914a351090968456 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:40.070497 13229 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_062f0e529a09425da9da5b7ab68a6e38" } new_table_name: "default.Table_abfc383542944209880ab0ae6b4c3f29" modify_external_catalogs: true
I20250830 07:54:40.072464 13232 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_9450ad668d274eeab37e9b323612e8a7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:40.072953 13232 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9450ad668d274eeab37e9b323612e8a7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:40.074393 13233 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_41498bc7cf1b472ab9e9aa8286303e01"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:40.074836 13233 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_41498bc7cf1b472ab9e9aa8286303e01 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:40.077323 13234 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_2b82782993784298b5f2664d01b07707"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:40.077823 13234 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2b82782993784298b5f2664d01b07707 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250830 07:54:40.081601 13218 catalog_manager.cc:4908] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): delete failed for tablet 28c2f7a3a6dd444585f0f5d337b985e9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 28c2f7a3a6dd444585f0f5d337b985e9 already in progress: creating tablet
I20250830 07:54:40.053185 13461 rpcz_store.cc:276] 0830 07:54:38.822239 (+ 0us) service_pool.cc:168] Inserting onto call queue
0830 07:54:39.357802 (+535563us) service_pool.cc:225] Handling call
0830 07:54:39.364320 (+ 6518us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0830 07:54:39.364352 (+ 32us) ts_tablet_manager.cc:676] Creating new metadata...
0830 07:54:39.405158 (+ 40806us) tablet_metadata.cc:641] Metadata flushed
0830 07:54:40.051534 (+646376us) tablet_replica.cc:206] Creating consensus instance
0830 07:54:40.051675 (+ 141us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20250830 07:54:40.084846 13218 catalog_manager.cc:4908] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): delete failed for tablet acca1a8240454b889c63c82d3c75087e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet acca1a8240454b889c63c82d3c75087e already in progress: creating tablet
I20250830 07:54:40.087443 13464 tablet_service.cc:1515] Processing DeleteTablet for tablet ca959e42c8764eeba0faee96caf8b39f with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:39 UTC) from {username='slave'} at 127.0.0.1:37956
W20250830 07:54:40.090651 13218 catalog_manager.cc:4895] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): delete failed for tablet 97d49a1f600f4c13a4aafca99cedabe8 because the tablet was not found. No further retry: Not found: Tablet not found: 97d49a1f600f4c13a4aafca99cedabe8
W20250830 07:54:40.091099 13218 catalog_manager.cc:4908] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): delete failed for tablet 95b6f084eb5240ea94c125eaa154ac9f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 95b6f084eb5240ea94c125eaa154ac9f already in progress: creating tablet
I20250830 07:54:40.091192 13450 tablet_service.cc:1515] Processing DeleteTablet for tablet ef1ab62a5b7845e58d50f34206eaaa27 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:39 UTC) from {username='slave'} at 127.0.0.1:37956
I20250830 07:54:40.091878 13230 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_966292469ec54ce987013f67893e9903"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250830 07:54:40.092423 13887 consensus_queue.cc:260] T e4f1ff6026bb45e28e63c27c83399d72 P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
W20250830 07:54:40.092716 13230 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_966292469ec54ce987013f67893e9903 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:40.093004 13887 ts_tablet_manager.cc:1428] T e4f1ff6026bb45e28e63c27c83399d72 P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.185s user 0.002s sys 0.000s
I20250830 07:54:40.093372 13887 tablet_bootstrap.cc:492] T 62ee2d0fbd774d38a4a4c4a033584ef9 P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:54:40.095907 13737 tablet_service.cc:1515] Processing DeleteTablet for tablet 70703eb1d47841a1a227e277ed6a268d with delete_type TABLET_DATA_DELETED (replaced by tablet 8028ac4c928a48f3a077d61aec24f3bd) from {username='slave'} at 127.0.0.1:45460
I20250830 07:54:40.096527 13746 tablet_service.cc:1515] Processing DeleteTablet for tablet da5c7b084e1f4fda92fff35a9cb2c7fc with delete_type TABLET_DATA_DELETED (replaced by tablet 21fc5d35a63f4cdbbf2e61e75d292037) from {username='slave'} at 127.0.0.1:45460
W20250830 07:54:40.098594 13218 catalog_manager.cc:4908] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): delete failed for tablet ca959e42c8764eeba0faee96caf8b39f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ca959e42c8764eeba0faee96caf8b39f already in progress: creating tablet
W20250830 07:54:40.098927 13218 catalog_manager.cc:4908] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): delete failed for tablet ef1ab62a5b7845e58d50f34206eaaa27 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ef1ab62a5b7845e58d50f34206eaaa27 already in progress: creating tablet
W20250830 07:54:40.102370 13219 catalog_manager.cc:4908] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): delete failed for tablet 70703eb1d47841a1a227e277ed6a268d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 70703eb1d47841a1a227e277ed6a268d already in progress: creating tablet
I20250830 07:54:40.107115 13465 rpcz_store.cc:276] 0830 07:54:38.811728 (+ 0us) service_pool.cc:168] Inserting onto call queue
0830 07:54:38.830052 (+ 18324us) service_pool.cc:225] Handling call
0830 07:54:38.839741 (+ 9689us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0830 07:54:38.839772 (+ 31us) ts_tablet_manager.cc:676] Creating new metadata...
0830 07:54:39.906196 (+1066424us) tablet_metadata.cc:641] Metadata flushed
0830 07:54:40.043124 (+136928us) tablet_replica.cc:206] Creating consensus instance
0830 07:54:40.043279 (+ 155us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20250830 07:54:40.108559 13219 catalog_manager.cc:4908] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): delete failed for tablet da5c7b084e1f4fda92fff35a9cb2c7fc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet da5c7b084e1f4fda92fff35a9cb2c7fc already in progress: creating tablet
I20250830 07:54:40.109427 13754 tablet_service.cc:1515] Processing DeleteTablet for tablet de3a52a8e08a45808373902a0185e6f0 with delete_type TABLET_DATA_DELETED (replaced by tablet 53766699d42e4f6e9b42d9a98613726c) from {username='slave'} at 127.0.0.1:45460
I20250830 07:54:40.110682 13740 tablet_service.cc:1515] Processing DeleteTablet for tablet a8baad9c419e436b9659d8d5582d4066 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:39 UTC) from {username='slave'} at 127.0.0.1:45460
W20250830 07:54:40.112069 13219 catalog_manager.cc:4908] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): delete failed for tablet de3a52a8e08a45808373902a0185e6f0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet de3a52a8e08a45808373902a0185e6f0 already in progress: creating tablet
I20250830 07:54:40.114709 13886 tablet_bootstrap.cc:654] T ada52626bbc94105a8b9428b0bbdfb5e P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:40.115567 14535 raft_consensus.cc:491] T 1fa571e9490e499792225d7b786e8658 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:40.115721 14535 raft_consensus.cc:513] T 1fa571e9490e499792225d7b786e8658 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:40.119007 14535 leader_election.cc:290] T 1fa571e9490e499792225d7b786e8658 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967)
I20250830 07:54:40.119058 13450 tablet_service.cc:1515] Processing DeleteTablet for tablet 70703eb1d47841a1a227e277ed6a268d with delete_type TABLET_DATA_DELETED (replaced by tablet 8028ac4c928a48f3a077d61aec24f3bd) from {username='slave'} at 127.0.0.1:37956
W20250830 07:54:40.121937 13218 catalog_manager.cc:4908] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): delete failed for tablet 70703eb1d47841a1a227e277ed6a268d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 70703eb1d47841a1a227e277ed6a268d already in progress: creating tablet
W20250830 07:54:40.123068 13703 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.209.2:38967, user_credentials={real_user=slave}} blocked reactor thread for 375547us
W20250830 07:54:40.123432 13703 leader_election.cc:343] T 6492bd11e50d4900927db0de3757aa24 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:40.124142 14535 consensus_queue.cc:1035] T bee1b5f6f04740dba64cdcb094e26113 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20250830 07:54:40.124922 13703 leader_election.cc:343] T b480f5eb03804baeb61cd0424d70faf5 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:40.125909 13461 tablet_service.cc:1515] Processing DeleteTablet for tablet d2b8e6df64ef49e2ba36c093efd3c351 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:39 UTC) from {username='slave'} at 127.0.0.1:37956
W20250830 07:54:40.126653 13218 catalog_manager.cc:4908] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): delete failed for tablet d2b8e6df64ef49e2ba36c093efd3c351 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d2b8e6df64ef49e2ba36c093efd3c351 already in progress: creating tablet
I20250830 07:54:40.129042 13742 tablet_service.cc:1515] Processing DeleteTablet for tablet d2b8e6df64ef49e2ba36c093efd3c351 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:39 UTC) from {username='slave'} at 127.0.0.1:45460
W20250830 07:54:40.129715 13219 catalog_manager.cc:4908] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): delete failed for tablet a8baad9c419e436b9659d8d5582d4066 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a8baad9c419e436b9659d8d5582d4066 already in progress: creating tablet
W20250830 07:54:40.130609 13219 catalog_manager.cc:4908] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): delete failed for tablet d2b8e6df64ef49e2ba36c093efd3c351 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d2b8e6df64ef49e2ba36c093efd3c351 already in progress: creating tablet
I20250830 07:54:40.139523 13465 tablet_service.cc:1515] Processing DeleteTablet for tablet de3a52a8e08a45808373902a0185e6f0 with delete_type TABLET_DATA_DELETED (replaced by tablet 53766699d42e4f6e9b42d9a98613726c) from {username='slave'} at 127.0.0.1:37956
I20250830 07:54:40.131685 14493 leader_election.cc:290] T 008827b3d09d464b9182fb42dc2170d5 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
W20250830 07:54:40.151832 13218 catalog_manager.cc:4908] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): delete failed for tablet de3a52a8e08a45808373902a0185e6f0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet de3a52a8e08a45808373902a0185e6f0 already in progress: creating tablet
I20250830 07:54:40.156442 14517 catalog_manager.cc:1261] Loaded cluster ID: 90fa2c64725e4c7399db393bcf7c431d
I20250830 07:54:40.156617 14517 catalog_manager.cc:1554] T 00000000000000000000000000000000 P 3ea183a890b84f408b20b55e9eb7c7ed: loading cluster ID for follower catalog manager: success
W20250830 07:54:40.177822 13703 leader_election.cc:343] T afb132e8a5b14a029e005e375f276348 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:40.191075 14535 consensus_queue.cc:1035] T 008827b3d09d464b9182fb42dc2170d5 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.012s
W20250830 07:54:40.201349 13227 catalog_manager.cc:5415] Ignoring report from unknown tablet afb132e8a5b14a029e005e375f276348
I20250830 07:54:40.201984 13227 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_3e83417f25834382bd64da7edd1a18cb" } new_table_name: "default.Table_dea7d93cf4a54c2286537025b82a70ca" modify_external_catalogs: true
I20250830 07:54:40.203601 13228 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_99ddb5ec94474f889af2d0b33b0f6a99" } modify_external_catalogs: true
I20250830 07:54:40.203764 13228 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_99ddb5ec94474f889af2d0b33b0f6a99" } modify_external_catalogs: true
I20250830 07:54:40.205381 13225 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_eb8932f465204a54be74e9f5a9e2d130"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:40.205986 13225 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_eb8932f465204a54be74e9f5a9e2d130 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:40.207407 13226 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_718987422ffe497c86a1b4e53c47d620" } new_table_name: "default.Table_3fbd1233b99946efb6b91985da1eae8f" modify_external_catalogs: true
W20250830 07:54:40.209065 13229 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 74ea2298876a4066b297915c135d4618 consensus state has no leader
I20250830 07:54:40.209455 13229 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_e4f722cf97f34259b0ef37b76c007dee" } new_table_name: "default.Table_da41ab7e69f34ff880f61dd2168a0ea6" modify_external_catalogs: true
I20250830 07:54:40.210860 13232 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_232ac20d505c4e68b8d66bbebb4450db"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:40.211366 13232 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_232ac20d505c4e68b8d66bbebb4450db in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:40.212007 14546 tablet.cc:1722] T d4e35395930f4c37b34649da5718aa1f P 6b5e454d98894637b466ea27f1b647f9: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250830 07:54:40.217002 13231 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet f0144701d459480d96c1ece519951442
I20250830 07:54:40.217868 13231 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_c19f13a84191465baea4b6af0cfb9ee4" } modify_external_catalogs: true
I20250830 07:54:40.218030 13231 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_c19f13a84191465baea4b6af0cfb9ee4" } modify_external_catalogs: true
I20250830 07:54:40.225821 13234 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_a80b1e63a1564ede800990c7cfc0b9b3" } modify_external_catalogs: true
I20250830 07:54:40.226133 13234 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_a80b1e63a1564ede800990c7cfc0b9b3" } modify_external_catalogs: true
I20250830 07:54:39.789208 14262 rpcz_store.cc:276] 0830 07:54:37.538799 (+ 0us) service_pool.cc:168] Inserting onto call queue
0830 07:54:37.538856 (+ 57us) service_pool.cc:225] Handling call
0830 07:54:37.993025 (+454169us) raft_consensus.cc:1469] Updating replica for 485 ops
0830 07:54:38.007447 (+ 14422us) raft_consensus.cc:1532] Early marking committed up to index 39
0830 07:54:38.056811 (+ 49364us) write_op.cc:489] Releasing partition, row and schema locks
0830 07:54:38.056819 (+ 8us) write_op.cc:454] Released schema lock
0830 07:54:38.057007 (+ 188us) raft_consensus.cc:1537] Triggering prepare for 485 ops
0830 07:54:38.058719 (+ 1712us) write_op.cc:270] Start()
0830 07:54:38.058787 (+ 68us) write_op.cc:276] Timestamp: P: 1756540470882041 usec, L: 0
0830 07:54:38.064137 (+ 5350us) write_op.cc:270] Start()
0830 07:54:38.064202 (+ 65us) write_op.cc:276] Timestamp: P: 1756540470882545 usec, L: 0
0830 07:54:38.064438 (+ 236us) write_op.cc:270] Start()
0830 07:54:38.064463 (+ 25us) write_op.cc:276] Timestamp: P: 1756540470882967 usec, L: 0
0830 07:54:38.064596 (+ 133us) write_op.cc:270] Start()
0830 07:54:38.064617 (+ 21us) write_op.cc:276] Timestamp: P: 1756540470883422 usec, L: 0
0830 07:54:38.064789 (+ 172us) write_op.cc:270] Start()
0830 07:54:38.064810 (+ 21us) write_op.cc:276] Timestamp: P: 1756540470910751 usec, L: 0
0830 07:54:38.064977 (+ 167us) write_op.cc:270] Start()
0830 07:54:38.065004 (+ 27us) write_op.cc:276] Timestamp: P: 1756540470911270 usec, L: 0
0830 07:54:38.065153 (+ 149us) write_op.cc:270] Start()
0830 07:54:38.065191 (+ 38us) write_op.cc:276] Timestamp: P: 1756540470911726 usec, L: 0
0830 07:54:38.065348 (+ 157us) write_op.cc:270] Start()
0830 07:54:38.065370 (+ 22us) write_op.cc:276] Timestamp: P: 1756540470912101 usec, L: 0
0830 07:54:38.065538 (+ 168us) write_op.cc:270] Start()
0830 07:54:38.065559 (+ 21us) write_op.cc:276] Timestamp: P: 1756540470912530 usec, L: 0
0830 07:54:38.065695 (+ 136us) write_op.cc:270] Start()
0830 07:54:38.065716 (+ 21us) write_op.cc:276] Timestamp: P: 1756540470912946 usec, L: 0
0830 07:54:38.065885 (+ 169us) write_op.cc:270] Start()
0830 07:54:38.065902 (+ 17us) write_op.cc:276] Timestamp: P: 1756540470926862 usec, L: 0
0830 07:54:38.066244 (+ 342us) write_op.cc:270] Start()
0830 07:54:38.066325 (+ 81us) write_op.cc:276] Timestamp: P: 1756540470928029 usec, L: 0
0830 07:54:38.066567 (+ 242us) write_op.cc:270] Start()
0830 07:54:38.066592 (+ 25us) write_op.cc:276] Timestamp: P: 1756540470953570 usec, L: 0
0830 07:54:38.080791 (+ 14199us) write_op.cc:270] Start()
0830 07:54:38.080821 (+ 30us) write_op.cc:276] Timestamp: P: 1756540470990673 usec, L: 0
0830 07:54:38.080981 (+ 160us) write_op.cc:270] Start()
0830 07:54:38.081001 (+ 20us) write_op.cc:276] Timestamp: P: 1756540470998298 usec, L: 0
0830 07:54:38.081143 (+ 142us) write_op.cc:270] Start()
0830 07:54:38.081162 (+ 19us) write_op.cc:276] Timestamp: P: 1756540471027314 usec, L: 0
0830 07:54:38.081318 (+ 156us) write_op.cc:270] Start()
0830 07:54:38.081345 (+ 27us) write_op.cc:276] Timestamp: P: 1756540471030408 usec, L: 0
0830 07:54:38.081503 (+ 158us) write_op.cc:270] Start()
0830 07:54:38.081526 (+ 23us) write_op.cc:276] Timestamp: P: 1756540471033086 usec, L: 0
0830 07:54:38.081687 (+ 161us) write_op.cc:270] Start()
0830 07:54:38.081709 (+ 22us) write_op.cc:276] Timestamp: P: 1756540471033595 usec, L: 0
0830 07:54:38.081834 (+ 125us) write_op.cc:270] Start()
0830 07:54:38.081852 (+ 18us) write_op.cc:276] Timestamp: P: 1756540471069999 usec, L: 0
0830 07:54:38.081990 (+ 138us) write_op.cc:270] Start()
0830 07:54:38.086246 (+ 4256us) write_op.cc:276] Timestamp: P: 1756540471070730 usec, L: 0
0830 07:54:38.086463 (+ 217us) write_op.cc:270] Start()
0830 07:54:38.086486 (+ 23us) write_op.cc:276] Timestamp: P: 1756540471074496 usec, L: 0
0830 07:54:38.086631 (+ 145us) write_op.cc:270] Start()
0830 07:54:38.086691 (+ 60us) write_op.cc:276] Timestamp: P: 1756540471093397 usec, L: 0
0830 07:54:38.086892 (+ 201us) write_op.cc:270] Start()
0830 07:54:38.086924 (+ 32us) write_op.cc:276] Timestamp: P: 1756540471099422 usec, L: 0
0830 07:54:38.089403 (+ 2479us) write_op.cc:270] Start()
0830 07:54:38.089434 (+ 31us) write_op.cc:276] Timestamp: P: 1756540471104639 usec, L: 0
0830 07:54:38.089604 (+ 170us) write_op.cc:270] Start()
0830 07:54:38.089627 (+ 23us) write_op.cc:276] Timestamp: P: 1756540471112055 usec, L: 0
0830 07:54:38.089788 (+ 161us) write_op.cc:270] Start()
0830 07:54:38.089809 (+ 21us) write_op.cc:276] Timestamp: P: 1756540471113004 usec, L: 0
0830 07:54:38.089950 (+ 141us) write_op.cc:270] Start()
0830 07:54:38.089970 (+ 20us) write_op.cc:276] Timestamp: P: 1756540471113509 usec, L: 0
0830 07:54:38.090144 (+ 174us) write_op.cc:270] Start()
0830 07:54:38.090163 (+ 19us) write_op.cc:276] Timestamp: P: 1756540471113944 usec, L: 0
0830 07:54:38.090316 (+ 153us) write_op.cc:270] Start()
0830 07:54:38.090339 (+ 23us) write_op.cc:276] Timestamp: P: 1756540471124460 usec, L: 0
0830 07:54:38.090532 (+ 193us) write_op.cc:270] Start()
0830 07:54:38.090557 (+ 25us) write_op.cc:276] Timestamp: P: 1756540471127915 usec, L: 0
0830 07:54:38.090732 (+ 175us) write_op.cc:270] Start()
0830 07:54:38.095437 (+ 4705us) write_op.cc:276] Timestamp: P: 1756540471128454 usec, L: 0
0830 07:54:38.095687 (+ 250us) write_op.cc:270] Start()
0830 07:54:38.095712 (+ 25us) write_op.cc:276] Timestamp: P: 1756540471130590 usec, L: 0
0830 07:54:38.095826 (+ 114us) write_op.cc:270] Start()
0830 07:54:38.095843 (+ 17us) write_op.cc:276] Timestamp: P: 1756540471132164 usec, L: 0
0830 07:54:38.095957 (+ 114us) write_op.cc:270] Start()
0830 07:54:38.095972 (+ 15us) write_op.cc:276] Timestamp: P: 1756540471139539 usec, L: 0
0830 07:54:38.100758 (+ 4786us) write_op.cc:270] Start()
0830 07:54:38.100786 (+ 28us) write_op.cc:276] Timestamp: P: 1756540471155055 usec, L: 0
0830 07:54:38.100953 (+ 167us) write_op.cc:270] Start()
0830 07:54:38.100991 (+ 38us) write_op.cc:276] Timestamp: P: 1756540471160170 usec, L: 0
0830 07:54:38.101162 (+ 171us) write_op.cc:270] Start()
0830 07:54:38.101184 (+ 22us) write_op.cc:276] Timestamp: P: 1756540471160672 usec, L: 0
0830 07:54:38.101368 (+ 184us) write_op.cc:270] Start()
0830 07:54:38.101393 (+ 25us) write_op.cc:276] Timestamp: P: 1756540471161150 usec, L: 0
0830 07:54:38.101550 (+ 157us) write_op.cc:270] Start()
0830 07:54:38.101572 (+ 22us) write_op.cc:276] Timestamp: P: 1756540471161598 usec, L: 0
0830 07:54:38.101710 (+ 138us) write_op.cc:270] Start()
0830 07:54:38.101729 (+ 19us) write_op.cc:276] Timestamp: P: 1756540471162028 usec, L: 0
0830 07:54:38.101866 (+ 137us) write_op.cc:270] Start()
0830 07:54:38.101884 (+ 18us) write_op.cc:276] Timestamp: P: 1756540471162475 usec, L: 0
0830 07:54:38.102054 (+ 170us) write_op.cc:270] Start()
0830 07:54:38.102075 (+ 21us) write_op.cc:276] Timestamp: P: 1756540471191279 usec, L: 0
0830 07:54:38.102270 (+ 195us) write_op.cc:270] Start()
0830 07:54:38.102295 (+ 25us) write_op.cc:276] Timestamp: P: 1756540471193104 usec, L: 0
0830 07:54:38.102433 (+ 138us) write_op.cc:270] Start()
0830 07:54:38.102453 (+ 20us) write_op.cc:276] Timestamp: P: 1756540471196681 usec, L: 0
0830 07:54:38.102586 (+ 133us) write_op.cc:270] Start()
0830 07:54:38.102606 (+ 20us) write_op.cc:276] Timestamp: P: 1756540471210747 usec, L: 0
0830 07:54:38.102739 (+ 133us) write_op.cc:270] Start()
0830 07:54:38.102758 (+ 19us) write_op.cc:276] Timestamp: P: 1756540471215627 usec, L: 0
0830 07:54:38.102878 (+ 120us) write_op.cc:270] Start()
0830 07:54:38.102896 (+ 18us) write_op.cc:276] Timestamp: P: 1756540471227324 usec, L: 0
0830 07:54:38.103165 (+ 269us) write_op.cc:270] Start()
0830 07:54:38.103185 (+ 20us) write_op.cc:276] Timestamp: P: 1756540471228129 usec, L: 0
0830 07:54:38.123401 (+ 20216us) write_op.cc:270] Start()
0830 07:54:38.123449 (+ 48us) write_op.cc:276] Timestamp: P: 1756540471231901 usec, L: 0
0830 07:54:38.123668 (+ 219us) write_op.cc:270] Start()
0830 07:54:38.123690 (+ 22us) write_op.cc:276] Timestamp: P: 1756540471256690 usec, L: 0
0830 07:54:38.123813 (+ 123us) write_op.cc:270] Start()
0830 07:54:38.123831 (+ 18us) write_op.cc:276] Timestamp: P: 1756540471275657 usec, L: 0
0830 07:54:38.123959 (+ 128us) write_op.cc:270] Start()
0830 07:54:38.123980 (+ 21us) write_op.cc:276] Timestamp: P: 1756540471287575 usec, L: 0
0830 07:54:38.124130 (+ 150us) write_op.cc:270] Start()
0830 07:54:38.124150 (+ 20us) write_op.cc:276] Timestamp: P: 1756540471343928 usec, L: 0
0830 07:54:38.124298 (+ 148us) write_op.cc:270] Start()
0830 07:54:38.124318 (+ 20us) write_op.cc:276] Timestamp: P: 1756540471344583 usec, L: 0
0830 07:54:38.129941 (+ 5623us) write_op.cc:270] Start()
0830 07:54:38.129974 (+ 33us) write_op.cc:276] Timestamp: P: 1756540471345074 usec, L: 0
0830 07:54:38.130465 (+ 491us) write_op.cc:270] Start()
0830 07:54:38.130495 (+ 30us) write_op.cc:276] Timestamp: P: 1756540471345603 usec, L: 0
0830 07:54:38.130644 (+ 149us) write_op.cc:270] Start()
0830 07:54:38.130667 (+ 23us) write_op.cc:276] Timestamp: P: 1756540471346048 usec, L: 0
0830 07:54:38.130819 (+ 152us) write_op.cc:270] Start()
0830 07:54:38.130838 (+ 19us) write_op.cc:276] Timestamp: P: 1756540471348215 usec, L: 0
0830 07:54:38.130984 (+ 146us) write_op.cc:270] Start()
0830 07:54:38.131002 (+ 18us) write_op.cc:276] Timestamp: P: 1756540471348690 usec, L: 0
0830 07:54:38.131133 (+ 131us) write_op.cc:270] Start()
0830 07:54:38.131155 (+ 22us) write_op.cc:276] Timestamp: P: 1756540471382589 usec, L: 0
0830 07:54:38.131291 (+ 136us) write_op.cc:270] Start()
0830 07:54:38.131308 (+ 17us) write_op.cc:276] Timestamp: P: 1756540471425343 usec, L: 0
0830 07:54:38.131426 (+ 118us) write_op.cc:270] Start()
0830 07:54:38.131463 (+ 37us) write_op.cc:276] Timestamp: P: 1756540471426131 usec, L: 0
0830 07:54:38.131578 (+ 115us) write_op.cc:270] Start()
0830 07:54:38.131597 (+ 19us) write_op.cc:276] Timestamp: P: 1756540471426780 usec, L: 0
0830 07:54:38.131727 (+ 130us) write_op.cc:270] Start()
0830 07:54:38.131744 (+ 17us) write_op.cc:276] Timestamp: P: 1756540471427373 usec, L: 0
0830 07:54:38.131849 (+ 105us) write_op.cc:270] Start()
0830 07:54:38.131865 (+ 16us) write_op.cc:276] Timestamp: P: 1756540471428050 usec, L: 0
0830 07:54:38.131989 (+ 124us) write_op.cc:270] Start()
0830 07:54:38.132008 (+ 19us) write_op.cc:276] Timestamp: P: 1756540471432530 usec, L: 0
0830 07:54:38.132132 (+ 124us) write_op.cc:270] Start()
0830 07:54:38.158621 (+ 26489us) write_op.cc:276] Timestamp: P: 1756540471433134 usec, L: 0
0830 07:54:38.159003 (+ 382us) write_op.cc:270] Start()
0830 07:54:38.159037 (+ 34us) write_op.cc:276] Timestamp: P: 1756540471490482 usec, L: 0
0830 07:54:38.159226 (+ 189us) write_op.cc:270] Start()
0830 07:54:38.159243 (+ 17us) write_op.cc:276] Timestamp: P: 1756540471491169 usec, L: 0
0830 07:54:38.159405 (+ 162us) write_op.cc:270] Start()
0830 07:54:38.159427 (+ 22us) write_op.cc:276] Timestamp: P: 1756540471491739 usec, L: 0
0830 07:54:38.159567 (+ 140us) write_op.cc:270] Start()
0830 07:54:38.159588 (+ 21us) write_op.cc:276] Timestamp: P: 1756540471507395 usec, L: 0
0830 07:54:38.159735 (+ 147us) write_op.cc:270] Start()
0830 07:54:38.159756 (+ 21us) write_op.cc:276] Timestamp: P: 1756540471525261 usec, L: 0
0830 07:54:38.159881 (+ 125us) write_op.cc:270] Start()
0830 07:54:38.159900 (+ 19us) write_op.cc:276] Timestamp: P: 1756540471582023 usec, L: 0
0830 07:54:38.160083 (+ 183us) write_op.cc:270] Start()
0830 07:54:38.160127 (+ 44us) write_op.cc:276] Timestamp: P: 1756540471595403 usec, L: 0
0830 07:54:38.160482 (+ 355us) write_op.cc:270] Start()
0830 07:54:38.160513 (+ 31us) write_op.cc:276] Timestamp: P: 1756540471643685 usec, L: 0
0830 07:54:38.160678 (+ 165us) write_op.cc:270] Start()
0830 07:54:38.160701 (+ 23us) write_op.cc:276] Timestamp: P: 1756540471644507 usec, L: 0
0830 07:54:38.160850 (+ 149us) write_op.cc:270] Start()
0830 07:54:38.160874 (+ 24us) write_op.cc:276] Timestamp: P: 1756540471645178 usec, L: 0
0830 07:54:38.161020 (+ 146us) write_op.cc:270] Start()
0830 07:54:38.161065 (+ 45us) write_op.cc:276] Timestamp: P: 1756540471645866 usec, L: 0
0830 07:54:38.161231 (+ 166us) write_op.cc:270] Start()
0830 07:54:38.161254 (+ 23us) write_op.cc:276] Timestamp: P: 1756540471653121 usec, L: 0
0830 07:54:38.161438 (+ 184us) write_op.cc:270] Start()
0830 07:54:38.161461 (+ 23us) write_op.cc:276] Timestamp: P: 1756540471653760 usec, L: 0
0830 07:54:38.161648 (+ 187us) write_op.cc:270] Start()
0830 07:54:38.161672 (+ 24us) write_op.cc:276] Timestamp: P: 1756540471654350 usec, L: 0
0830 07:54:38.161831 (+ 159us) write_op.cc:270] Start()
0830 07:54:38.161856 (+ 25us) write_op.cc:276] Timestamp: P: 1756540471655658 usec, L: 0
0830 07:54:38.162009 (+ 153us) write_op.cc:270] Start()
0830 07:54:38.162028 (+ 19us) write_op.cc:276] Timestamp: P: 1756540471725343 usec, L: 0
0830 07:54:38.162161 (+ 133us) write_op.cc:270] Start()
0830 07:54:38.162182 (+ 21us) write_op.cc:276] Timestamp: P: 1756540471738836 usec, L: 0
0830 07:54:38.162328 (+ 146us) write_op.cc:270] Start()
0830 07:54:38.162346 (+ 18us) write_op.cc:276] Timestamp: P: 1756540471739692 usec, L: 0
0830 07:54:38.162495 (+ 149us) write_op.cc:270] Start()
0830 07:54:38.162516 (+ 21us) write_op.cc:276] Timestamp: P: 1756540471740308 usec, L: 0
0830 07:54:38.162643 (+ 127us) write_op.cc:270] Start()
0830 07:54:38.162665 (+ 22us) write_op.cc:276] Timestamp: P: 1756540471740856 usec, L: 0
0830 07:54:38.162810 (+ 145us) write_op.cc:270] Start()
0830 07:54:38.162838 (+ 28us) write_op.cc:276] Timestamp: P: 1756540471741477 usec, L: 0
0830 07:54:38.191233 (+ 28395us) write_op.cc:270] Start()
0830 07:54:38.191295 (+ 62us) write_op.cc:276] Timestamp: P: 1756540471742050 usec, L: 0
0830 07:54:38.191512 (+ 217us) write_op.cc:270] Start()
0830 07:54:38.191540 (+ 28us) write_op.cc:276] Timestamp: P: 1756540471753595 usec, L: 0
0830 07:54:38.191734 (+ 194us) write_op.cc:270] Start()
0830 07:54:38.191757 (+ 23us) write_op.cc:276] Timestamp: P: 1756540471754726 usec, L: 0
0830 07:54:38.191898 (+ 141us) write_op.cc:270] Start()
0830 07:54:38.191917 (+ 19us) write_op.cc:276] Timestamp: P: 1756540471768479 usec, L: 0
0830 07:54:38.192062 (+ 145us) write_op.cc:270] Start()
0830 07:54:38.192108 (+ 46us) write_op.cc:276] Timestamp: P: 1756540471770343 usec, L: 0
0830 07:54:38.192248 (+ 140us) write_op.cc:270] Start()
0830 07:54:38.192268 (+ 20us) write_op.cc:276] Timestamp: P: 1756540471817577 usec, L: 0
0830 07:54:38.192410 (+ 142us) write_op.cc:270] Start()
0830 07:54:38.192429 (+ 19us) write_op.cc:276] Timestamp: P: 1756540471819280 usec, L: 0
0830 07:54:38.192553 (+ 124us) write_op.cc:270] Start()
0830 07:54:38.192570 (+ 17us) write_op.cc:276] Timestamp: P: 1756540471853428 usec, L: 0
0830 07:54:38.192688 (+ 118us) write_op.cc:270] Start()
0830 07:54:38.192711 (+ 23us) write_op.cc:276] Timestamp: P: 1756540471855068 usec, L: 0
0830 07:54:38.192851 (+ 140us) write_op.cc:270] Start()
0830 07:54:38.192872 (+ 21us) write_op.cc:276] Timestamp: P: 1756540471856071 usec, L: 0
0830 07:54:38.193048 (+ 176us) write_op.cc:270] Start()
0830 07:54:38.193135 (+ 87us) write_op.cc:276] Timestamp: P: 1756540471924094 usec, L: 0
0830 07:54:38.193306 (+ 171us) write_op.cc:270] Start()
0830 07:54:38.193329 (+ 23us) write_op.cc:276] Timestamp: P: 1756540471925172 usec, L: 0
0830 07:54:38.193479 (+ 150us) write_op.cc:270] Start()
0830 07:54:38.193500 (+ 21us) write_op.cc:276] Timestamp: P: 1756540471925971 usec, L: 0
0830 07:54:38.193636 (+ 136us) write_op.cc:270] Start()
0830 07:54:38.193657 (+ 21us) write_op.cc:276] Timestamp: P: 1756540471926761 usec, L: 0
0830 07:54:38.193810 (+ 153us) write_op.cc:270] Start()
0830 07:54:38.193830 (+ 20us) write_op.cc:276] Timestamp: P: 1756540471976582 usec, L: 0
0830 07:54:38.194023 (+ 193us) write_op.cc:270] Start()
0830 07:54:38.194044 (+ 21us) write_op.cc:276] Timestamp: P: 1756540471977233 usec, L: 0
0830 07:54:38.194197 (+ 153us) write_op.cc:270] Start()
0830 07:54:38.194219 (+ 22us) write_op.cc:276] Timestamp: P: 1756540471977739 usec, L: 0
0830 07:54:38.194599 (+ 380us) write_op.cc:270] Start()
0830 07:54:38.194637 (+ 38us) write_op.cc:276] Timestamp: P: 1756540471978257 usec, L: 0
0830 07:54:38.194822 (+ 185us) write_op.cc:270] Start()
0830 07:54:38.194846 (+ 24us) write_op.cc:276] Timestamp: P: 1756540471978787 usec, L: 0
0830 07:54:38.195030 (+ 184us) write_op.cc:270] Start()
0830 07:54:38.195051 (+ 21us) write_op.cc:276] Timestamp: P: 1756540472004310 usec, L: 0
0830 07:54:38.195198 (+ 147us) write_op.cc:270] Start()
0830 07:54:38.195222 (+ 24us) write_op.cc:276] Timestamp: P: 1756540472008180 usec, L: 0
0830 07:54:38.195382 (+ 160us) write_op.cc:270] Start()
0830 07:54:38.195404 (+ 22us) write_op.cc:276] Timestamp: P: 1756540472008845 usec, L: 0
0830 07:54:38.195536 (+ 132us) write_op.cc:270] Start()
0830 07:54:38.195558 (+ 22us) write_op.cc:276] Timestamp: P: 1756540472009389 usec, L: 0
0830 07:54:38.195731 (+ 173us) write_op.cc:270] Start()
0830 07:54:38.195748 (+ 17us) write_op.cc:276] Timestamp: P: 1756540472015059 usec, L: 0
0830 07:54:38.195871 (+ 123us) write_op.cc:270] Start()
0830 07:54:38.195896 (+ 25us) write_op.cc:276] Timestamp: P: 1756540472015573 usec, L: 0
0830 07:54:38.196085 (+ 189us) write_op.cc:270] Start()
0830 07:54:38.196109 (+ 24us) write_op.cc:276] Timestamp: P: 1756540472015994 usec, L: 0
0830 07:54:38.214691 (+ 18582us) write_op.cc:270] Start()
0830 07:54:38.214740 (+ 49us) write_op.cc:276] Timestamp: P: 1756540472016416 usec, L: 0
0830 07:54:38.215058 (+ 318us) write_op.cc:270] Start()
0830 07:54:38.215079 (+ 21us) write_op.cc:276] Timestamp: P: 1756540472026833 usec, L: 0
0830 07:54:38.215491 (+ 412us) write_op.cc:270] Start()
0830 07:54:38.215545 (+ 54us) write_op.cc:276] Timestamp: P: 1756540472029766 usec, L: 0
0830 07:54:38.215730 (+ 185us) write_op.cc:270] Start()
0830 07:54:38.215755 (+ 25us) write_op.cc:276] Timestamp: P: 1756540472058219 usec, L: 0
0830 07:54:38.215888 (+ 133us) write_op.cc:270] Start()
0830 07:54:38.215907 (+ 19us) write_op.cc:276] Timestamp: P: 1756540472066316 usec, L: 0
0830 07:54:38.216037 (+ 130us) write_op.cc:270] Start()
0830 07:54:38.216060 (+ 23us) write_op.cc:276] Timestamp: P: 1756540472072961 usec, L: 0
0830 07:54:38.216222 (+ 162us) write_op.cc:270] Start()
0830 07:54:38.216246 (+ 24us) write_op.cc:276] Timestamp: P: 1756540472133575 usec, L: 0
0830 07:54:38.216442 (+ 196us) write_op.cc:270] Start()
0830 07:54:38.224148 (+ 7706us) write_op.cc:276] Timestamp: P: 1756540472183494 usec, L: 0
0830 07:54:38.224430 (+ 282us) write_op.cc:270] Start()
0830 07:54:38.224462 (+ 32us) write_op.cc:276] Timestamp: P: 1756540472184404 usec, L: 0
0830 07:54:38.224616 (+ 154us) write_op.cc:270] Start()
0830 07:54:38.224641 (+ 25us) write_op.cc:276] Timestamp: P: 1756540472307522 usec, L: 0
0830 07:54:38.224840 (+ 199us) write_op.cc:270] Start()
0830 07:54:38.224864 (+ 24us) write_op.cc:276] Timestamp: P: 1756540472308286 usec, L: 0
0830 07:54:38.225022 (+ 158us) write_op.cc:270] Start()
0830 07:54:38.225044 (+ 22us) write_op.cc:276] Timestamp: P: 1756540472358641 usec, L: 0
0830 07:54:38.225188 (+ 144us) write_op.cc:270] Start()
0830 07:54:38.225209 (+ 21us) write_op.cc:276] Timestamp: P: 1756540472361482 usec, L: 0
0830 07:54:38.225400 (+ 191us) write_op.cc:270] Start()
0830 07:54:38.225421 (+ 21us) write_op.cc:276] Timestamp: P: 1756540472374977 usec, L: 0
0830 07:54:38.225575 (+ 154us) write_op.cc:270] Start()
0830 07:54:38.225595 (+ 20us) write_op.cc:276] Timestamp: P: 1756540472376065 usec, L: 0
0830 07:54:38.225719 (+ 124us) write_op.cc:270] Start()
0830 07:54:38.225739 (+ 20us) write_op.cc:276] Timestamp: P: 1756540472377126 usec, L: 0
0830 07:54:38.225878 (+ 139us) write_op.cc:270] Start()
0830 07:54:38.225900 (+ 22us) write_op.cc:276] Timestamp: P: 1756540472402625 usec, L: 0
0830 07:54:38.226035 (+ 135us) write_op.cc:270] Start()
0830 07:54:38.226053 (+ 18us) write_op.cc:276] Timestamp: P: 1756540472403671 usec, L: 0
0830 07:54:38.226189 (+ 136us) write_op.cc:270] Start()
0830 07:54:38.226207 (+ 18us) write_op.cc:276] Timestamp: P: 1756540472404733 usec, L: 0
0830 07:54:38.226348 (+ 141us) write_op.cc:270] Start()
0830 07:54:38.226365 (+ 17us) write_op.cc:276] Timestamp: P: 1756540472405678 usec, L: 0
0830 07:54:38.226474 (+ 109us) write_op.cc:270] Start()
0830 07:54:38.226512 (+ 38us) write_op.cc:276] Timestamp: P: 1756540472406599 usec, L: 0
0830 07:54:38.226634 (+ 122us) write_op.cc:270] Start()
0830 07:54:38.226651 (+ 17us) write_op.cc:276] Timestamp: P: 1756540472410349 usec, L: 0
0830 07:54:38.226773 (+ 122us) write_op.cc:270] Start()
0830 07:54:38.226789 (+ 16us) write_op.cc:276] Timestamp: P: 1756540472565234 usec, L: 0
0830 07:54:38.226937 (+ 148us) write_op.cc:270] Start()
0830 07:54:38.226956 (+ 19us) write_op.cc:276] Timestamp: P: 1756540472576706 usec, L: 0
0830 07:54:38.227091 (+ 135us) write_op.cc:270] Start()
0830 07:54:38.227107 (+ 16us) write_op.cc:276] Timestamp: P: 1756540472580755 usec, L: 0
0830 07:54:38.227250 (+ 143us) write_op.cc:270] Start()
0830 07:54:38.227266 (+ 16us) write_op.cc:276] Timestamp: P: 1756540472581483 usec, L: 0
0830 07:54:38.227387 (+ 121us) write_op.cc:270] Start()
0830 07:54:38.227405 (+ 18us) write_op.cc:276] Timestamp: P: 1756540472588819 usec, L: 0
0830 07:54:38.228111 (+ 706us) write_op.cc:270] Start()
0830 07:54:38.228135 (+ 24us) write_op.cc:276] Timestamp: P: 1756540472589491 usec, L: 0
0830 07:54:38.228390 (+ 255us) write_op.cc:270] Start()
0830 07:54:38.228412 (+ 22us) write_op.cc:276] Timestamp: P: 1756540472590138 usec, L: 0
0830 07:54:38.228558 (+ 146us) write_op.cc:270] Start()
0830 07:54:38.228578 (+ 20us) write_op.cc:276] Timestamp: P: 1756540472656677 usec, L: 0
0830 07:54:38.228716 (+ 138us) write_op.cc:270] Start()
0830 07:54:38.228735 (+ 19us) write_op.cc:276] Timestamp: P: 1756540472731043 usec, L: 0
0830 07:54:38.228875 (+ 140us) write_op.cc:270] Start()
0830 07:54:38.228895 (+ 20us) write_op.cc:276] Timestamp: P: 1756540472791358 usec, L: 0
0830 07:54:38.229034 (+ 139us) write_op.cc:270] Start()
0830 07:54:38.229060 (+ 26us) write_op.cc:276] Timestamp: P: 1756540472792499 usec, L: 0
0830 07:54:38.229209 (+ 149us) write_op.cc:270] Start()
0830 07:54:38.229233 (+ 24us) write_op.cc:276] Timestamp: P: 1756540472793781 usec, L: 0
0830 07:54:38.229408 (+ 175us) write_op.cc:270] Start()
0830 07:54:38.229436 (+ 28us) write_op.cc:276] Timestamp: P: 1756540472795195 usec, L: 0
0830 07:54:38.229604 (+ 168us) write_op.cc:270] Start()
0830 07:54:38.229626 (+ 22us) write_op.cc:276] Timestamp: P: 1756540472796525 usec, L: 0
0830 07:54:38.229751 (+ 125us) write_op.cc:270] Start()
0830 07:54:38.229768 (+ 17us) write_op.cc:276] Timestamp: P: 1756540472797623 usec, L: 0
0830 07:54:38.232368 (+ 2600us) write_op.cc:270] Start()
0830 07:54:38.232400 (+ 32us) write_op.cc:276] Timestamp: P: 1756540472806526 usec, L: 0
0830 07:54:38.232560 (+ 160us) write_op.cc:270] Start()
0830 07:54:38.232715 (+ 155us) write_op.cc:276] Timestamp: P: 1756540472807918 usec, L: 0
0830 07:54:38.232886 (+ 171us) write_op.cc:270] Start()
0830 07:54:38.232907 (+ 21us) write_op.cc:276] Timestamp: P: 1756540472855611 usec, L: 0
0830 07:54:38.233050 (+ 143us) write_op.cc:270] Start()
0830 07:54:38.233074 (+ 24us) write_op.cc:276] Timestamp: P: 1756540472856784 usec, L: 0
0830 07:54:38.233201 (+ 127us) write_op.cc:270] Start()
0830 07:54:38.233217 (+ 16us) write_op.cc:276] Timestamp: P: 1756540472857646 usec, L: 0
0830 07:54:38.233388 (+ 171us) write_op.cc:270] Start()
0830 07:54:38.233407 (+ 19us) write_op.cc:276] Timestamp: P: 1756540472858620 usec, L: 0
0830 07:54:38.233559 (+ 152us) write_op.cc:270] Start()
0830 07:54:38.233577 (+ 18us) write_op.cc:276] Timestamp: P: 1756540472859546 usec, L: 0
0830 07:54:38.233701 (+ 124us) write_op.cc:270] Start()
0830 07:54:38.233719 (+ 18us) write_op.cc:276] Timestamp: P: 1756540472860712 usec, L: 0
0830 07:54:38.235310 (+ 1591us) write_op.cc:270] Start()
0830 07:54:38.235336 (+ 26us) write_op.cc:276] Timestamp: P: 1756540472862027 usec, L: 0
0830 07:54:38.235543 (+ 207us) write_op.cc:270] Start()
0830 07:54:38.235568 (+ 25us) write_op.cc:276] Timestamp: P: 1756540472863450 usec, L: 0
0830 07:54:38.235720 (+ 152us) write_op.cc:270] Start()
0830 07:54:38.235744 (+ 24us) write_op.cc:276] Timestamp: P: 1756540472887729 usec, L: 0
0830 07:54:38.235887 (+ 143us) write_op.cc:270] Start()
0830 07:54:38.235907 (+ 20us) write_op.cc:276] Timestamp: P: 1756540472888739 usec, L: 0
0830 07:54:38.236031 (+ 124us) write_op.cc:270] Start()
0830 07:54:38.236072 (+ 41us) write_op.cc:276] Timestamp: P: 1756540472889453 usec, L: 0
0830 07:54:38.236198 (+ 126us) write_op.cc:270] Start()
0830 07:54:38.236217 (+ 19us) write_op.cc:276] Timestamp: P: 1756540472890778 usec, L: 0
0830 07:54:38.236364 (+ 147us) write_op.cc:270] Start()
0830 07:54:38.236441 (+ 77us) write_op.cc:276] Timestamp: P: 1756540472891452 usec, L: 0
0830 07:54:38.437060 (+200619us) write_op.cc:270] Start()
0830 07:54:38.437099 (+ 39us) write_op.cc:276] Timestamp: P: 1756540472906969 usec, L: 0
0830 07:54:38.437319 (+ 220us) write_op.cc:270] Start()
0830 07:54:38.437338 (+ 19us) write_op.cc:276] Timestamp: P: 1756540472924654 usec, L: 0
0830 07:54:38.437457 (+ 119us) write_op.cc:270] Start()
0830 07:54:38.437474 (+ 17us) write_op.cc:276] Timestamp: P: 1756540472925261 usec, L: 0
0830 07:54:38.437577 (+ 103us) write_op.cc:270] Start()
0830 07:54:38.437593 (+ 16us) write_op.cc:276] Timestamp: P: 1756540472925700 usec, L: 0
0830 07:54:38.437695 (+ 102us) write_op.cc:270] Start()
0830 07:54:38.437712 (+ 17us) write_op.cc:276] Timestamp: P: 1756540472926177 usec, L: 0
0830 07:54:38.437848 (+ 136us) write_op.cc:270] Start()
0830 07:54:38.437865 (+ 17us) write_op.cc:276] Timestamp: P: 1756540472934204 usec, L: 0
0830 07:54:38.438438 (+ 573us) write_op.cc:270] Start()
0830 07:54:38.438464 (+ 26us) write_op.cc:276] Timestamp: P: 1756540472941940 usec, L: 0
0830 07:54:38.438615 (+ 151us) write_op.cc:270] Start()
0830 07:54:38.438632 (+ 17us) write_op.cc:276] Timestamp: P: 1756540472952215 usec, L: 0
0830 07:54:38.438721 (+ 89us) write_op.cc:270] Start()
0830 07:54:38.438733 (+ 12us) write_op.cc:276] Timestamp: P: 1756540472953644 usec, L: 0
0830 07:54:38.438839 (+ 106us) write_op.cc:270] Start()
0830 07:54:38.438851 (+ 12us) write_op.cc:276] Timestamp: P: 1756540472965230 usec, L: 0
0830 07:54:38.438984 (+ 133us) write_op.cc:270] Start()
0830 07:54:38.439001 (+ 17us) write_op.cc:276] Timestamp: P: 1756540472971734 usec, L: 0
0830 07:54:38.439110 (+ 109us) write_op.cc:270] Start()
0830 07:54:38.439123 (+ 13us) write_op.cc:276] Timestamp: P: 1756540472976901 usec, L: 0
0830 07:54:38.439253 (+ 130us) write_op.cc:270] Start()
0830 07:54:38.439275 (+ 22us) write_op.cc:276] Timestamp: P: 1756540472983387 usec, L: 0
0830 07:54:38.439411 (+ 136us) write_op.cc:270] Start()
0830 07:54:38.439430 (+ 19us) write_op.cc:276] Timestamp: P: 1756540472997177 usec, L: 0
0830 07:54:38.439560 (+ 130us) write_op.cc:270] Start()
0830 07:54:38.439573 (+ 13us) write_op.cc:276] Timestamp: P: 1756540473012106 usec, L: 0
0830 07:54:38.439653 (+ 80us) write_op.cc:270] Start()
0830 07:54:38.439664 (+ 11us) write_op.cc:276] Timestamp: P: 1756540473020610 usec, L: 0
0830 07:54:38.439730 (+ 66us) write_op.cc:270] Start()
0830 07:54:38.439740 (+ 10us) write_op.cc:276] Timestamp: P: 1756540473024766 usec, L: 0
0830 07:54:38.439814 (+ 74us) write_op.cc:270] Start()
0830 07:54:38.439824 (+ 10us) write_op.cc:276] Timestamp: P: 1756540473028285 usec, L: 0
0830 07:54:38.439907 (+ 83us) write_op.cc:270] Start()
0830 07:54:38.439918 (+ 11us) write_op.cc:276] Timestamp: P: 1756540473036407 usec, L: 0
0830 07:54:38.439989 (+ 71us) write_op.cc:270] Start()
0830 07:54:38.440000 (+ 11us) write_op.cc:276] Timestamp: P: 1756540473057055 usec, L: 0
0830 07:54:38.628636 (+188636us) write_op.cc:270] Start()
0830 07:54:38.628680 (+ 44us) write_op.cc:276] Timestamp: P: 1756540473059450 usec, L: 0
0830 07:54:38.628921 (+ 241us) write_op.cc:270] Start()
0830 07:54:38.628947 (+ 26us) write_op.cc:276] Timestamp: P: 1756540473059978 usec, L: 0
0830 07:54:38.629083 (+ 136us) write_op.cc:270] Start()
0830 07:54:38.629104 (+ 21us) write_op.cc:276] Timestamp: P: 1756540473075877 usec, L: 0
0830 07:54:38.629306 (+ 202us) write_op.cc:270] Start()
0830 07:54:38.629328 (+ 22us) write_op.cc:276] Timestamp: P: 1756540473085174 usec, L: 0
0830 07:54:38.629465 (+ 137us) write_op.cc:270] Start()
0830 07:54:38.629484 (+ 19us) write_op.cc:276] Timestamp: P: 1756540473090975 usec, L: 0
0830 07:54:38.629619 (+ 135us) write_op.cc:270] Start()
0830 07:54:38.629639 (+ 20us) write_op.cc:276] Timestamp: P: 1756540473101696 usec, L: 0
0830 07:54:38.629774 (+ 135us) write_op.cc:270] Start()
0830 07:54:38.629794 (+ 20us) write_op.cc:276] Timestamp: P: 1756540473102563 usec, L: 0
0830 07:54:38.629912 (+ 118us) write_op.cc:270] Start()
0830 07:54:38.629928 (+ 16us) write_op.cc:276] Timestamp: P: 1756540473108167 usec, L: 0
0830 07:54:38.630034 (+ 106us) write_op.cc:270] Start()
0830 07:54:38.630051 (+ 17us) write_op.cc:276] Timestam
I20250830 07:54:40.227514 13233 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_ebee83f51b6446a8afbf7c1f94b926a2" } modify_external_catalogs: true
I20250830 07:54:40.227664 13233 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_ebee83f51b6446a8afbf7c1f94b926a2" } modify_external_catalogs: true
I20250830 07:54:40.236440 14501 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 2 leader_uuid: "5e9d6449ae824acab24c459a72075e88" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fea6152429cc4e79a25b18e02aafae57" member_type: VOTER last_known_addr { host: "127.12.209.62" port: 39725 } } peers { permanent_uuid: "5e9d6449ae824acab24c459a72075e88" member_type: VOTER last_known_addr { host: "127.12.209.61" port: 44241 } } peers { permanent_uuid: "3ea183a890b84f408b20b55e9eb7c7ed" member_type: VOTER last_known_addr { host: "127.12.209.60" port: 43889 } } }
I20250830 07:54:40.236722 14501 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88 [sys.catalog]: This master's current role is: LEADER
I20250830 07:54:40.236996 13230 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_8204a5b070a84e9293e28fc53c97d88f" } new_table_name: "default.Table_67195b41a04042728399c4da5f841c6d" modify_external_catalogs: true
I20250830 07:54:40.239118 13456 tablet_service.cc:1515] Processing DeleteTablet for tablet b83dfc54383d4e7b96523568aea5c9f3 with delete_type TABLET_DATA_DELETED (replaced by tablet 5dffbacf2fcd4a38a1d61cf5bb9c5eeb) from {username='slave'} at 127.0.0.1:37956
I20250830 07:54:40.239720 13887 tablet_bootstrap.cc:654] T 62ee2d0fbd774d38a4a4c4a033584ef9 P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:40.241859 13459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 331) took 1338 ms. Trace:
I20250830 07:54:40.256027 14480 raft_consensus.cc:491] T 2009012fddc24e4fb7ad0fab33a1103b P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:40.256208 14480 raft_consensus.cc:513] T 2009012fddc24e4fb7ad0fab33a1103b P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:54:40.259208 14480 leader_election.cc:290] T 2009012fddc24e4fb7ad0fab33a1103b P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
I20250830 07:54:40.259372 13594 tablet_service.cc:1515] Processing DeleteTablet for tablet f0144701d459480d96c1ece519951442 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:40 UTC) from {username='slave'} at 127.0.0.1:45306
I20250830 07:54:40.259776 13453 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 351) took 1004 ms. Trace:
W20250830 07:54:40.260520 13218 catalog_manager.cc:4908] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): delete failed for tablet b83dfc54383d4e7b96523568aea5c9f3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b83dfc54383d4e7b96523568aea5c9f3 already in progress: creating tablet
W20250830 07:54:40.262229 13561 leader_election.cc:343] T 2009012fddc24e4fb7ad0fab33a1103b P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): Not found: Tablet not found: 2009012fddc24e4fb7ad0fab33a1103b
W20250830 07:54:40.263840 13220 catalog_manager.cc:4908] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet f0144701d459480d96c1ece519951442 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f0144701d459480d96c1ece519951442 already in progress: creating tablet
I20250830 07:54:40.265532 14315 raft_consensus.cc:513] T b480f5eb03804baeb61cd0424d70faf5 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
W20250830 07:54:40.266583 13752 consensus_meta.cc:287] T 76ab56c469cf4675a4e21acbe0a8085d P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent flushing consensus metadata: real 0.503s user 0.002s sys 0.001s
I20250830 07:54:40.267570 13753 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 348) took 1168 ms. Trace:
W20250830 07:54:40.268559 13703 consensus_peers.cc:489] T 91ab8c468c8143b9ae11b839a95a26fd P 9b057ade5dce45af9f8bf0bedf8b917f -> Peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Couldn't send request to peer 6b5e454d98894637b466ea27f1b647f9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20250830 07:54:40.269707 13703 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.209.2:38967, user_credentials={real_user=slave}} blocked reactor thread for 89187.5us
I20250830 07:54:40.269784 13742 tablet_service.cc:1515] Processing DeleteTablet for tablet f0144701d459480d96c1ece519951442 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:40 UTC) from {username='slave'} at 127.0.0.1:45460
I20250830 07:54:40.272071 13464 tablet_service.cc:1515] Processing DeleteTablet for tablet da5c7b084e1f4fda92fff35a9cb2c7fc with delete_type TABLET_DATA_DELETED (replaced by tablet 21fc5d35a63f4cdbbf2e61e75d292037) from {username='slave'} at 127.0.0.1:37956
I20250830 07:54:40.272709 13456 tablet_service.cc:1515] Processing DeleteTablet for tablet f0144701d459480d96c1ece519951442 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:40 UTC) from {username='slave'} at 127.0.0.1:37956
W20250830 07:54:40.273293 13219 catalog_manager.cc:4908] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): delete failed for tablet f0144701d459480d96c1ece519951442 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f0144701d459480d96c1ece519951442 already in progress: creating tablet
I20250830 07:54:40.269573 13753 rpcz_store.cc:276] 0830 07:54:39.157535 (+ 0us) service_pool.cc:168] Inserting onto call queue
0830 07:54:39.525855 (+368320us) service_pool.cc:225] Handling call
0830 07:54:39.536597 (+ 10742us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0830 07:54:39.536622 (+ 25us) ts_tablet_manager.cc:676] Creating new metadata...
0830 07:54:39.761590 (+224968us) tablet_metadata.cc:641] Metadata flushed
0830 07:54:40.252942 (+491352us) tablet_replica.cc:206] Creating consensus instance
0830 07:54:40.253075 (+ 133us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20250830 07:54:40.280717 13228 catalog_manager.cc:5864] Not sending DeleteTablet requests; no consensus state for tablet 688175963cac48ca82bed7c6d19e2ba0
W20250830 07:54:40.281507 13226 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a7dc529c40544bafbc9e7f0ab34086bd consensus state has no leader
I20250830 07:54:40.281718 14315 leader_election.cc:290] T b480f5eb03804baeb61cd0424d70faf5 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Requested vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
W20250830 07:54:40.281878 13229 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 1e48641532cd439e9b4074712033c737 consensus state has no leader
I20250830 07:54:40.282233 13231 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet 533811110191436d96665b3475ab597f
I20250830 07:54:40.282984 13233 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet ad3c81a3f8df466fb71472e756c77305
W20250830 07:54:40.283663 13227 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet e6b7646588fe4134b2db62ff84ca4791 consensus state has no leader
I20250830 07:54:40.286284 13459 rpcz_store.cc:276] 0830 07:54:38.822411 (+ 0us) service_pool.cc:168] Inserting onto call queue
0830 07:54:39.387212 (+564801us) service_pool.cc:225] Handling call
0830 07:54:39.415398 (+ 28186us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0830 07:54:39.415433 (+ 35us) ts_tablet_manager.cc:676] Creating new metadata...
0830 07:54:39.789179 (+373746us) tablet_metadata.cc:641] Metadata flushed
0830 07:54:40.160440 (+371261us) tablet_replica.cc:206] Creating consensus instance
0830 07:54:40.160612 (+ 172us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20250830 07:54:40.287663 13234 catalog_manager.cc:5864] Not sending DeleteTablet requests; no consensus state for tablet 7d05f281341a48b39f484db787c12253
I20250830 07:54:40.289623 13450 tablet_service.cc:1515] Processing DeleteTablet for tablet a8baad9c419e436b9659d8d5582d4066 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:39 UTC) from {username='slave'} at 127.0.0.1:37956
I20250830 07:54:40.293002 13457 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 342) took 1075 ms. Trace:
I20250830 07:54:40.293118 13457 rpcz_store.cc:276] 0830 07:54:39.208158 (+ 0us) service_pool.cc:168] Inserting onto call queue
0830 07:54:39.481187 (+273029us) service_pool.cc:225] Handling call
0830 07:54:39.519610 (+ 38423us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0830 07:54:39.519636 (+ 26us) ts_tablet_manager.cc:676] Creating new metadata...
0830 07:54:39.800989 (+281353us) tablet_metadata.cc:641] Metadata flushed
0830 07:54:40.282924 (+481935us) tablet_replica.cc:206] Creating consensus instance
0830 07:54:40.283139 (+ 215us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20250830 07:54:40.299036 13594 tablet_service.cc:1515] Processing DeleteTablet for tablet 533811110191436d96665b3475ab597f with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:40 UTC) from {username='slave'} at 127.0.0.1:45306
I20250830 07:54:40.300361 13606 tablet_service.cc:1515] Processing DeleteTablet for tablet ad3c81a3f8df466fb71472e756c77305 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:40 UTC) from {username='slave'} at 127.0.0.1:45306
W20250830 07:54:40.300401 13220 catalog_manager.cc:4908] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet 533811110191436d96665b3475ab597f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 533811110191436d96665b3475ab597f already in progress: creating tablet
I20250830 07:54:40.300550 13627 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "6492bd11e50d4900927db0de3757aa24" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9"
I20250830 07:54:40.301172 13234 master_service.cc:948] ReplaceTablet: received request to replace tablet 6492bd11e50d4900927db0de3757aa24 from {username='slave'} at 127.0.0.1:42126
I20250830 07:54:40.302004 13627 raft_consensus.cc:3058] T 6492bd11e50d4900927db0de3757aa24 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:40.300781 13628 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "cada6410e2884c508bb7dd38bea438ae" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:40.305063 13627 raft_consensus.cc:2466] T 6492bd11e50d4900927db0de3757aa24 P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 1.
I20250830 07:54:40.305644 13882 tablet_bootstrap.cc:492] T e4f1ff6026bb45e28e63c27c83399d72 P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
W20250830 07:54:40.305733 13220 catalog_manager.cc:4908] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet ad3c81a3f8df466fb71472e756c77305 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ad3c81a3f8df466fb71472e756c77305 already in progress: creating tablet
I20250830 07:54:40.306227 13882 ts_tablet_manager.cc:1397] T e4f1ff6026bb45e28e63c27c83399d72 P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.444s user 0.011s sys 0.041s
W20250830 07:54:40.307423 13218 catalog_manager.cc:4908] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): delete failed for tablet da5c7b084e1f4fda92fff35a9cb2c7fc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet da5c7b084e1f4fda92fff35a9cb2c7fc already in progress: creating tablet
I20250830 07:54:40.307554 13629 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "1fa571e9490e499792225d7b786e8658" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
W20250830 07:54:40.307672 13218 catalog_manager.cc:4908] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): delete failed for tablet f0144701d459480d96c1ece519951442 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f0144701d459480d96c1ece519951442 already in progress: creating tablet
I20250830 07:54:40.307722 13629 raft_consensus.cc:2466] T 1fa571e9490e499792225d7b786e8658 P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 1.
W20250830 07:54:40.308889 13423 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.209.2:38967, user_credentials={real_user=slave}} blocked reactor thread for 313438us
W20250830 07:54:40.310653 13218 catalog_manager.cc:4908] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): delete failed for tablet a8baad9c419e436b9659d8d5582d4066 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a8baad9c419e436b9659d8d5582d4066 already in progress: creating tablet
I20250830 07:54:40.310600 13453 rpcz_store.cc:276] 0830 07:54:39.237552 (+ 0us) service_pool.cc:168] Inserting onto call queue
0830 07:54:39.677517 (+439965us) service_pool.cc:225] Handling call
0830 07:54:39.768646 (+ 91129us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0830 07:54:39.770166 (+ 1520us) ts_tablet_manager.cc:676] Creating new metadata...
0830 07:54:40.133883 (+363717us) tablet_metadata.cc:641] Metadata flushed
0830 07:54:40.242002 (+108119us) tablet_replica.cc:206] Creating consensus instance
0830 07:54:40.242417 (+ 415us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20250830 07:54:40.311434 13753 tablet_service.cc:1515] Processing DeleteTablet for tablet 533811110191436d96665b3475ab597f with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:40 UTC) from {username='slave'} at 127.0.0.1:45460
I20250830 07:54:40.311636 13742 tablet_service.cc:1515] Processing DeleteTablet for tablet ad3c81a3f8df466fb71472e756c77305 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:40 UTC) from {username='slave'} at 127.0.0.1:45460
W20250830 07:54:40.312484 13219 catalog_manager.cc:4908] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): delete failed for tablet 533811110191436d96665b3475ab597f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 533811110191436d96665b3475ab597f already in progress: creating tablet
W20250830 07:54:40.312706 13219 catalog_manager.cc:4908] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): delete failed for tablet ad3c81a3f8df466fb71472e756c77305 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ad3c81a3f8df466fb71472e756c77305 already in progress: creating tablet
I20250830 07:54:40.308188 13882 raft_consensus.cc:357] T e4f1ff6026bb45e28e63c27c83399d72 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
W20250830 07:54:40.323026 13230 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d94215b0b1f142178f0b791518d1baf2 has no consensus state
I20250830 07:54:40.324045 13882 raft_consensus.cc:383] T e4f1ff6026bb45e28e63c27c83399d72 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:40.324157 13882 raft_consensus.cc:738] T e4f1ff6026bb45e28e63c27c83399d72 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:54:40.324638 13882 consensus_queue.cc:260] T e4f1ff6026bb45e28e63c27c83399d72 P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:54:40.325201 13882 ts_tablet_manager.cc:1428] T e4f1ff6026bb45e28e63c27c83399d72 P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.019s user 0.002s sys 0.000s
W20250830 07:54:40.334856 13230 catalog_manager.cc:5415] Ignoring report from unknown tablet c3b35ea656db4741a02e6746e1b049ec
I20250830 07:54:40.336885 13232 master_service.cc:948] ReplaceTablet: received request to replace tablet 533811110191436d96665b3475ab597f from {username='slave'} at 127.0.0.1:42126
I20250830 07:54:40.341138 13628 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "b480f5eb03804baeb61cd0424d70faf5" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9"
I20250830 07:54:40.342753 13882 tablet_bootstrap.cc:492] T cada6410e2884c508bb7dd38bea438ae P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:54:40.345299 13628 raft_consensus.cc:3058] T b480f5eb03804baeb61cd0424d70faf5 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:40.349071 13627 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "008827b3d09d464b9182fb42dc2170d5" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:40.350435 13774 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "008827b3d09d464b9182fb42dc2170d5" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:40.352664 13628 raft_consensus.cc:2466] T b480f5eb03804baeb61cd0424d70faf5 P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 1.
I20250830 07:54:40.352851 13882 tablet_bootstrap.cc:654] T cada6410e2884c508bb7dd38bea438ae P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:40.354089 13234 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet 6492bd11e50d4900927db0de3757aa24
I20250830 07:54:40.354614 13234 catalog_manager.cc:6652] ReplaceTablet: tablet 6492bd11e50d4900927db0de3757aa24 deleted and replaced by tablet e3926ab903df45a8b0c5e2a829ac7842
I20250830 07:54:40.355451 13606 tablet_service.cc:1515] Processing DeleteTablet for tablet 6492bd11e50d4900927db0de3757aa24 with delete_type TABLET_DATA_DELETED (replaced by tablet e3926ab903df45a8b0c5e2a829ac7842) from {username='slave'} at 127.0.0.1:45306
I20250830 07:54:40.355715 14497 tablet_replica.cc:331] T 6492bd11e50d4900927db0de3757aa24 P 6b5e454d98894637b466ea27f1b647f9: stopping tablet replica
I20250830 07:54:40.355926 14497 raft_consensus.cc:2241] T 6492bd11e50d4900927db0de3757aa24 P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250830 07:54:40.356087 14497 raft_consensus.cc:2270] T 6492bd11e50d4900927db0de3757aa24 P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250830 07:54:40.357082 14497 ts_tablet_manager.cc:1905] T 6492bd11e50d4900927db0de3757aa24 P 6b5e454d98894637b466ea27f1b647f9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250830 07:54:40.358397 14548 tablet.cc:1722] T d4e35395930f4c37b34649da5718aa1f P 2065c332f15a4739899af79f3669c3ba: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250830 07:54:40.359054 13742 tablet_service.cc:1515] Processing DeleteTablet for tablet 6492bd11e50d4900927db0de3757aa24 with delete_type TABLET_DATA_DELETED (replaced by tablet e3926ab903df45a8b0c5e2a829ac7842) from {username='slave'} at 127.0.0.1:45460
I20250830 07:54:40.358491 13773 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "afb132e8a5b14a029e005e375f276348" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f"
I20250830 07:54:40.364061 14505 tablet_replica.cc:331] T 6492bd11e50d4900927db0de3757aa24 P 9b057ade5dce45af9f8bf0bedf8b917f: stopping tablet replica
I20250830 07:54:40.364284 14505 raft_consensus.cc:2241] T 6492bd11e50d4900927db0de3757aa24 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Raft consensus shutting down.
I20250830 07:54:40.364549 13449 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 346) took 1082 ms. Trace:
I20250830 07:54:40.364935 14497 ts_tablet_manager.cc:1918] T 6492bd11e50d4900927db0de3757aa24 P 6b5e454d98894637b466ea27f1b647f9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
W20250830 07:54:40.365083 13230 catalog_manager.cc:5415] Ignoring report from unknown tablet 2afb1e75cfcc4e1abd265fbadb4170fa
I20250830 07:54:40.366099 14535 raft_consensus.cc:491] T 62ee2d0fbd774d38a4a4c4a033584ef9 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:40.366660 13453 tablet_service.cc:1515] Processing DeleteTablet for tablet 533811110191436d96665b3475ab597f with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:40 UTC) from {username='slave'} at 127.0.0.1:37956
W20250830 07:54:40.366708 13230 catalog_manager.cc:5415] Ignoring report from unknown tablet bcdac588f7c24d9d8572949e09b80a23
W20250830 07:54:40.366892 13230 catalog_manager.cc:5415] Ignoring report from unknown tablet d1ae3812d72b419798736328da64b53c
W20250830 07:54:40.367354 13230 catalog_manager.cc:5415] Ignoring report from unknown tablet afb132e8a5b14a029e005e375f276348
I20250830 07:54:40.369246 13457 tablet_service.cc:1515] Processing DeleteTablet for tablet ad3c81a3f8df466fb71472e756c77305 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:40 UTC) from {username='slave'} at 127.0.0.1:37956
I20250830 07:54:40.369483 13466 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 347) took 1118 ms. Trace:
I20250830 07:54:40.369611 13466 rpcz_store.cc:276] 0830 07:54:39.237076 (+ 0us) service_pool.cc:168] Inserting onto call queue
0830 07:54:39.875651 (+638575us) service_pool.cc:225] Handling call
0830 07:54:39.990956 (+115305us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0830 07:54:39.990997 (+ 41us) ts_tablet_manager.cc:676] Creating new metadata...
0830 07:54:40.352262 (+361265us) tablet_metadata.cc:641] Metadata flushed
0830 07:54:40.355295 (+ 3033us) tablet_replica.cc:206] Creating consensus instance
0830 07:54:40.355461 (+ 166us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20250830 07:54:40.370149 13449 rpcz_store.cc:276] 0830 07:54:39.236981 (+ 0us) service_pool.cc:168] Inserting onto call queue
0830 07:54:39.844827 (+607846us) service_pool.cc:225] Handling call
0830 07:54:39.845347 (+ 520us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0830 07:54:39.845375 (+ 28us) ts_tablet_manager.cc:676] Creating new metadata...
0830 07:54:39.912033 (+ 66658us) tablet_metadata.cc:641] Metadata flushed
0830 07:54:40.308501 (+396468us) tablet_replica.cc:206] Creating consensus instance
0830 07:54:40.319773 (+ 11272us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20250830 07:54:40.371415 13749 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 352) took 1049 ms. Trace:
I20250830 07:54:40.374038 13773 raft_consensus.cc:2391] T afb132e8a5b14a029e005e375f276348 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b5e454d98894637b466ea27f1b647f9 in current term 1: Already voted for candidate 9b057ade5dce45af9f8bf0bedf8b917f in this term.
I20250830 07:54:40.375353 13736 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 350) took 1202 ms. Trace:
I20250830 07:54:40.375830 14505 raft_consensus.cc:2270] T 6492bd11e50d4900927db0de3757aa24 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Raft consensus is shut down!
I20250830 07:54:40.376435 14505 ts_tablet_manager.cc:1905] T 6492bd11e50d4900927db0de3757aa24 P 9b057ade5dce45af9f8bf0bedf8b917f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250830 07:54:40.376451 14497 log.cc:1199] T 6492bd11e50d4900927db0de3757aa24 P 6b5e454d98894637b466ea27f1b647f9: Deleting WAL directory at /tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/ts-1/wal/wals/6492bd11e50d4900927db0de3757aa24
W20250830 07:54:40.376485 13218 catalog_manager.cc:4908] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): delete failed for tablet 533811110191436d96665b3475ab597f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 533811110191436d96665b3475ab597f already in progress: creating tablet
I20250830 07:54:40.376911 14497 ts_tablet_manager.cc:1939] T 6492bd11e50d4900927db0de3757aa24 P 6b5e454d98894637b466ea27f1b647f9: Deleting consensus metadata
I20250830 07:54:40.377110 13484 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "cada6410e2884c508bb7dd38bea438ae" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
W20250830 07:54:40.366343 13562 leader_election.cc:343] T 2009012fddc24e4fb7ad0fab33a1103b P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Not found: Tablet not found: 2009012fddc24e4fb7ad0fab33a1103b
I20250830 07:54:40.377944 13485 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "6492bd11e50d4900927db0de3757aa24" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba"
I20250830 07:54:40.378055 13484 raft_consensus.cc:2466] T cada6410e2884c508bb7dd38bea438ae P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 0.
I20250830 07:54:40.378121 13485 raft_consensus.cc:3058] T 6492bd11e50d4900927db0de3757aa24 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:40.378289 13220 catalog_manager.cc:4928] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): tablet 6492bd11e50d4900927db0de3757aa24 (table default.Table_7dc4898210c641719d6d97c45dbd89c9 [id=b7dcb14885434162aac95c78a5a70ba9]) successfully deleted
I20250830 07:54:40.378289 13562 leader_election.cc:304] T 2009012fddc24e4fb7ad0fab33a1103b P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b5e454d98894637b466ea27f1b647f9; no voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:54:40.378582 14445 raft_consensus.cc:2747] T 2009012fddc24e4fb7ad0fab33a1103b P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20250830 07:54:40.379544 13218 catalog_manager.cc:4908] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): delete failed for tablet ad3c81a3f8df466fb71472e756c77305 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ad3c81a3f8df466fb71472e756c77305 already in progress: creating tablet
W20250830 07:54:40.379734 13703 leader_election.cc:343] T cada6410e2884c508bb7dd38bea438ae P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:40.380067 13450 tablet_service.cc:1515] Processing DeleteTablet for tablet 6492bd11e50d4900927db0de3757aa24 with delete_type TABLET_DATA_DELETED (replaced by tablet e3926ab903df45a8b0c5e2a829ac7842) from {username='slave'} at 127.0.0.1:37956
I20250830 07:54:40.381875 13751 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 339) took 1297 ms. Trace:
I20250830 07:54:40.380311 13745 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 353) took 1036 ms. Trace:
I20250830 07:54:40.381108 14535 raft_consensus.cc:513] T 62ee2d0fbd774d38a4a4c4a033584ef9 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:40.386143 14535 leader_election.cc:290] T 62ee2d0fbd774d38a4a4c4a033584ef9 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967)
I20250830 07:54:40.386413 13750 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 354) took 1036 ms. Trace:
I20250830 07:54:40.386554 13750 rpcz_store.cc:276] 0830 07:54:39.347353 (+ 0us) service_pool.cc:168] Inserting onto call queue
0830 07:54:39.533997 (+186644us) service_pool.cc:225] Handling call
0830 07:54:39.573533 (+ 39536us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0830 07:54:39.573560 (+ 27us) ts_tablet_manager.cc:676] Creating new metadata...
0830 07:54:40.320954 (+747394us) tablet_metadata.cc:641] Metadata flushed
0830 07:54:40.383965 (+ 63011us) tablet_replica.cc:206] Creating consensus instance
0830 07:54:40.384179 (+ 214us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20250830 07:54:40.387099 13751 rpcz_store.cc:276] 0830 07:54:39.069656 (+ 0us) service_pool.cc:168] Inserting onto call queue
0830 07:54:39.137828 (+ 68172us) service_pool.cc:225] Handling call
0830 07:54:39.533340 (+395512us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0830 07:54:39.533542 (+ 202us) ts_tablet_manager.cc:676] Creating new metadata...
0830 07:54:39.894369 (+360827us) tablet_metadata.cc:641] Metadata flushed
0830 07:54:40.366684 (+472315us) tablet_replica.cc:206] Creating consensus instance
0830 07:54:40.366811 (+ 127us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20250830 07:54:40.387931 13736 rpcz_store.cc:276] 0830 07:54:39.172871 (+ 0us) service_pool.cc:168] Inserting onto call queue
0830 07:54:39.532505 (+359634us) service_pool.cc:225] Handling call
0830 07:54:39.543374 (+ 10869us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0830 07:54:39.543394 (+ 20us) ts_tablet_manager.cc:676] Creating new metadata...
0830 07:54:40.176294 (+632900us) tablet_metadata.cc:641] Metadata flushed
0830 07:54:40.375194 (+198900us) tablet_replica.cc:206] Creating consensus instance
0830 07:54:40.375318 (+ 124us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20250830 07:54:40.388556 13703 leader_election.cc:304] T 6492bd11e50d4900927db0de3757aa24 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f; no voters:
I20250830 07:54:40.389645 13883 tablet_replica.cc:331] T 6492bd11e50d4900927db0de3757aa24 P 2065c332f15a4739899af79f3669c3ba: stopping tablet replica
I20250830 07:54:40.389681 14493 consensus_queue.cc:1035] T 48b422b125154fbdbb9c995dc372d128 P 2065c332f15a4739899af79f3669c3ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20250830 07:54:40.389907 13749 rpcz_store.cc:276] 0830 07:54:39.321859 (+ 0us) service_pool.cc:168] Inserting onto call queue
0830 07:54:39.533104 (+211245us) service_pool.cc:225] Handling call
0830 07:54:39.551699 (+ 18595us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0830 07:54:39.551717 (+ 18us) ts_tablet_manager.cc:676] Creating new metadata...
0830 07:54:40.315055 (+763338us) tablet_metadata.cc:641] Metadata flushed
0830 07:54:40.371246 (+ 56191us) tablet_replica.cc:206] Creating consensus instance
0830 07:54:40.371376 (+ 130us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20250830 07:54:40.390636 13745 rpcz_store.cc:276] 0830 07:54:39.324343 (+ 0us) service_pool.cc:168] Inserting onto call queue
0830 07:54:39.533492 (+209149us) service_pool.cc:225] Handling call
0830 07:54:39.550844 (+ 17352us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0830 07:54:39.550868 (+ 24us) ts_tablet_manager.cc:676] Creating new metadata...
0830 07:54:40.332848 (+781980us) tablet_metadata.cc:641] Metadata flushed
0830 07:54:40.360441 (+ 27593us) tablet_replica.cc:206] Creating consensus instance
0830 07:54:40.360563 (+ 122us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20250830 07:54:40.392396 13747 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 349) took 1231 ms. Trace:
I20250830 07:54:40.392638 13747 rpcz_store.cc:276] 0830 07:54:39.160773 (+ 0us) service_pool.cc:168] Inserting onto call queue
0830 07:54:39.525269 (+364496us) service_pool.cc:225] Handling call
0830 07:54:39.545072 (+ 19803us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0830 07:54:39.545095 (+ 23us) ts_tablet_manager.cc:676] Creating new metadata...
0830 07:54:40.280828 (+735733us) tablet_metadata.cc:641] Metadata flushed
0830 07:54:40.392188 (+111360us) tablet_replica.cc:206] Creating consensus instance
0830 07:54:40.392351 (+ 163us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20250830 07:54:40.394529 14492 consensus_queue.cc:1035] T 7238db7e31484201a30cf4c035d82aff P 2065c332f15a4739899af79f3669c3ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.010s
I20250830 07:54:40.394860 14538 consensus_queue.cc:1035] T 05da843c0fe4482a926e410e06b22461 P 2065c332f15a4739899af79f3669c3ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.015s
I20250830 07:54:40.395777 13739 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 356) took 1036 ms. Trace:
I20250830 07:54:40.395865 13454 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 358) took 1139 ms. Trace:
I20250830 07:54:40.395990 13454 rpcz_store.cc:276] 0830 07:54:39.238386 (+ 0us) service_pool.cc:168] Inserting onto call queue
0830 07:54:39.976636 (+738250us) service_pool.cc:225] Handling call
0830 07:54:40.025472 (+ 48836us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0830 07:54:40.025498 (+ 26us) ts_tablet_manager.cc:676] Creating new metadata...
0830 07:54:40.361594 (+336096us) tablet_metadata.cc:641] Metadata flushed
0830 07:54:40.374010 (+ 12416us) tablet_replica.cc:206] Creating consensus instance
0830 07:54:40.377480 (+ 3470us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20250830 07:54:40.395925 13739 rpcz_store.cc:276] 0830 07:54:39.358595 (+ 0us) service_pool.cc:168] Inserting onto call queue
0830 07:54:39.578902 (+220307us) service_pool.cc:225] Handling call
0830 07:54:39.690084 (+111182us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0830 07:54:39.690122 (+ 38us) ts_tablet_manager.cc:676] Creating new metadata...
0830 07:54:40.338858 (+648736us) tablet_metadata.cc:641] Metadata flushed
0830 07:54:40.395331 (+ 56473us) tablet_replica.cc:206] Creating consensus instance
0830 07:54:40.395480 (+ 149us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20250830 07:54:40.398958 13467 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 357) took 1160 ms. Trace:
I20250830 07:54:40.399168 13460 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 354) took 1161 ms. Trace:
W20250830 07:54:40.399895 13703 raft_consensus.cc:2684] T 6492bd11e50d4900927db0de3757aa24 P 9b057ade5dce45af9f8bf0bedf8b917f: unable to run election callback: Service unavailable: Thread pool token was shut down
I20250830 07:54:40.400468 13703 leader_election.cc:304] T 1fa571e9490e499792225d7b786e8658 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f; no voters:
I20250830 07:54:40.400748 14535 raft_consensus.cc:2802] T 1fa571e9490e499792225d7b786e8658 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20250830 07:54:40.400846 14535 raft_consensus.cc:491] T 1fa571e9490e499792225d7b786e8658 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:54:40.400943 14535 raft_consensus.cc:3058] T 1fa571e9490e499792225d7b786e8658 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Advancing to term 2
I20250830 07:54:40.402711 14548 tablet.cc:1722] T 7238db7e31484201a30cf4c035d82aff P 2065c332f15a4739899af79f3669c3ba: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
W20250830 07:54:40.403384 13703 consensus_peers.cc:489] T 27da527d9fe045ae8c17f193d034f5ac P 9b057ade5dce45af9f8bf0bedf8b917f -> Peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Couldn't send request to peer 6b5e454d98894637b466ea27f1b647f9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20250830 07:54:40.404453 13703 leader_election.cc:304] T b480f5eb03804baeb61cd0424d70faf5 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f; no voters:
I20250830 07:54:40.405436 14535 raft_consensus.cc:513] T 1fa571e9490e499792225d7b786e8658 P 9b057ade5dce45af9f8bf0bedf8b917f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:40.405612 13234 master_service.cc:948] ReplaceTablet: received request to replace tablet ed87c6793dd149a6a363f1977d816628 from {username='slave'} at 127.0.0.1:42126
I20250830 07:54:40.406085 14535 leader_election.cc:290] T 1fa571e9490e499792225d7b786e8658 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 2 election: Requested vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967)
I20250830 07:54:40.406952 14533 raft_consensus.cc:2802] T b480f5eb03804baeb61cd0424d70faf5 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election won for term 1
I20250830 07:54:40.407105 14533 raft_consensus.cc:695] T b480f5eb03804baeb61cd0424d70faf5 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 LEADER]: Becoming Leader. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Running, Role: LEADER
I20250830 07:54:40.407187 13460 rpcz_store.cc:276] 0830 07:54:39.237899 (+ 0us) service_pool.cc:168] Inserting onto call queue
0830 07:54:39.841742 (+603843us) service_pool.cc:225] Handling call
0830 07:54:39.842310 (+ 568us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0830 07:54:39.842349 (+ 39us) ts_tablet_manager.cc:676] Creating new metadata...
0830 07:54:40.291338 (+448989us) tablet_metadata.cc:641] Metadata flushed
0830 07:54:40.398966 (+107628us) tablet_replica.cc:206] Creating consensus instance
0830 07:54:40.399129 (+ 163us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20250830 07:54:40.407379 14533 consensus_queue.cc:237] T b480f5eb03804baeb61cd0424d70faf5 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:54:40.409881 13467 rpcz_store.cc:276] 0830 07:54:39.238287 (+ 0us) service_pool.cc:168] Inserting onto call queue
0830 07:54:39.970055 (+731768us) service_pool.cc:225] Handling call
0830 07:54:39.970537 (+ 482us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0830 07:54:39.970565 (+ 28us) ts_tablet_manager.cc:676] Creating new metadata...
0830 07:54:40.257858 (+287293us) tablet_metadata.cc:641] Metadata flushed
0830 07:54:40.398739 (+140881us) tablet_replica.cc:206] Creating consensus instance
0830 07:54:40.398898 (+ 159us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20250830 07:54:40.410200 13452 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 340) took 1217 ms. Trace:
I20250830 07:54:40.410310 13452 rpcz_store.cc:276] 0830 07:54:39.182499 (+ 0us) service_pool.cc:168] Inserting onto call queue
0830 07:54:39.469702 (+287203us) service_pool.cc:225] Handling call
0830 07:54:39.470112 (+ 410us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0830 07:54:39.470133 (+ 21us) ts_tablet_manager.cc:676] Creating new metadata...
0830 07:54:40.131208 (+661075us) tablet_metadata.cc:641] Metadata flushed
0830 07:54:40.399937 (+268729us) tablet_replica.cc:206] Creating consensus instance
0830 07:54:40.400050 (+ 113us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20250830 07:54:40.413395 13455 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 352) took 1173 ms. Trace:
I20250830 07:54:40.413739 14485 consensus_queue.cc:1035] T bee1b5f6f04740dba64cdcb094e26113 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:54:40.414002 13458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 348) took 1174 ms. Trace:
I20250830 07:54:40.414188 14485 consensus_queue.cc:1035] T 91ab8c468c8143b9ae11b839a95a26fd P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:54:40.417007 13701 leader_election.cc:304] T afb132e8a5b14a029e005e375f276348 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 2065c332f15a4739899af79f3669c3ba, 6b5e454d98894637b466ea27f1b647f9
I20250830 07:54:40.420740 13234 master_service.cc:948] ReplaceTablet: received request to replace tablet 7ed22d9617024d55a8add137e7971061 from {username='slave'} at 127.0.0.1:42126
I20250830 07:54:40.417393 14535 consensus_queue.cc:1035] T 861809cc50764aa89140e587489e2d88 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:54:40.422655 14485 raft_consensus.cc:2747] T afb132e8a5b14a029e005e375f276348 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20250830 07:54:40.423837 13886 tablet_bootstrap.cc:492] T ada52626bbc94105a8b9428b0bbdfb5e P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:54:40.424052 13886 ts_tablet_manager.cc:1397] T ada52626bbc94105a8b9428b0bbdfb5e P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.670s user 0.005s sys 0.017s
W20250830 07:54:40.424248 13701 leader_election.cc:343] T 1fa571e9490e499792225d7b786e8658 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): Not found: Tablet not found: 1fa571e9490e499792225d7b786e8658
I20250830 07:54:40.426803 13701 leader_election.cc:304] T cada6410e2884c508bb7dd38bea438ae P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:54:40.427101 13232 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_034019ccacd345d5873db4d09f70ee1f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250830 07:54:40.427711 14485 raft_consensus.cc:2802] T cada6410e2884c508bb7dd38bea438ae P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election won for term 1
W20250830 07:54:40.427752 13232 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_034019ccacd345d5873db4d09f70ee1f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:40.427834 14485 raft_consensus.cc:491] T cada6410e2884c508bb7dd38bea438ae P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:54:40.427927 14485 raft_consensus.cc:3058] T cada6410e2884c508bb7dd38bea438ae P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:40.429086 13886 raft_consensus.cc:357] T ada52626bbc94105a8b9428b0bbdfb5e P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:40.429303 13886 raft_consensus.cc:383] T ada52626bbc94105a8b9428b0bbdfb5e P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:40.429217 13227 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_618200045a4b44908fc6e99de0c2788e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250830 07:54:40.429384 13886 raft_consensus.cc:738] T ada52626bbc94105a8b9428b0bbdfb5e P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:54:40.429625 13886 consensus_queue.cc:260] T ada52626bbc94105a8b9428b0bbdfb5e P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
W20250830 07:54:40.429769 13227 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_618200045a4b44908fc6e99de0c2788e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:40.430233 13886 ts_tablet_manager.cc:1428] T ada52626bbc94105a8b9428b0bbdfb5e P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.006s user 0.001s sys 0.001s
I20250830 07:54:40.430553 13886 tablet_bootstrap.cc:492] T 30c2558c28944ff39d1a4a4ca9ac604e P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:54:40.430855 13233 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_be7f4af6142d4aeebbac1b6060ceeb88"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:40.431329 13233 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_be7f4af6142d4aeebbac1b6060ceeb88 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:40.432186 14485 raft_consensus.cc:513] T cada6410e2884c508bb7dd38bea438ae P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:40.432838 14485 leader_election.cc:290] T cada6410e2884c508bb7dd38bea438ae P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Requested vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967)
I20250830 07:54:40.433657 13231 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_096dfd73ca964fb68fcfac3eafbf487e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:40.434104 13231 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_096dfd73ca964fb68fcfac3eafbf487e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:40.435421 13229 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_b25c4cfbc9cf443d904f57da99dd6bee" } new_table_name: "default.Table_6fe8dfbe1873453d8f1a683a12a6288a" modify_external_catalogs: true
I20250830 07:54:40.436795 13226 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_da448c80c657460bb81499960d034919" } modify_external_catalogs: true
I20250830 07:54:40.436996 13226 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_da448c80c657460bb81499960d034919" } modify_external_catalogs: true
I20250830 07:54:40.438431 13225 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_651494fab40e4ef091db8287b4f5cd39"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:40.439831 13225 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_651494fab40e4ef091db8287b4f5cd39 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:40.440950 14287 raft_consensus.cc:491] T 050e72b96c2d479896b3a54d85e6f6dd P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:40.441134 14287 raft_consensus.cc:513] T 050e72b96c2d479896b3a54d85e6f6dd P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:40.441391 13228 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_9fd86b145c4a4e1dbbf6a088b47de21b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250830 07:54:40.441670 14287 leader_election.cc:290] T 050e72b96c2d479896b3a54d85e6f6dd P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967)
W20250830 07:54:40.441799 13228 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9fd86b145c4a4e1dbbf6a088b47de21b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:40.444200 13234 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_2e83ff4fc25644689ac5cc5740c35987"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:40.444680 13234 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2e83ff4fc25644689ac5cc5740c35987 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:40.432188 13886 tablet_bootstrap.cc:654] T 30c2558c28944ff39d1a4a4ca9ac604e P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:40.446936 14517 catalog_manager.cc:1576] T 00000000000000000000000000000000 P 3ea183a890b84f408b20b55e9eb7c7ed: acquiring CA information for follower catalog manager: success
I20250830 07:54:40.457360 13230 catalog_manager.cc:6127] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: default.Table_fc298c4951614456914be830598a020a [id=e946db3cd3504a69a61a7ed2cabcada7] alter complete (version 1)
I20250830 07:54:40.458122 13230 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_78d044c012894bfd8972b2253087fa0c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:40.458660 13230 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_78d044c012894bfd8972b2253087fa0c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250830 07:54:40.470374 13229 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 0d16bc64dd6e43f7ba313b77c2bbb728 has no consensus state
I20250830 07:54:40.470664 13229 master_service.cc:948] ReplaceTablet: received request to replace tablet 0507245aa8c74aeb9f3eafba0682590d from {username='slave'} at 127.0.0.1:42126
I20250830 07:54:40.472424 13468 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 356) took 1234 ms. Trace:
I20250830 07:54:40.472571 13455 rpcz_store.cc:276] 0830 07:54:39.237677 (+ 0us) service_pool.cc:168] Inserting onto call queue
0830 07:54:39.889044 (+651367us) service_pool.cc:225] Handling call
0830 07:54:40.008929 (+119885us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0830 07:54:40.008958 (+ 29us) ts_tablet_manager.cc:676] Creating new metadata...
0830 07:54:40.401252 (+392294us) tablet_metadata.cc:641] Metadata flushed
0830 07:54:40.410428 (+ 9176us) tablet_replica.cc:206] Creating consensus instance
0830 07:54:40.410815 (+ 387us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20250830 07:54:40.476181 13226 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet 74f2fcc22fd545fb8ca7c20619843023
I20250830 07:54:40.477504 13739 tablet_service.cc:1515] Processing DeleteTablet for tablet 74f2fcc22fd545fb8ca7c20619843023 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:40 UTC) from {username='slave'} at 127.0.0.1:45460
I20250830 07:54:40.477612 13458 rpcz_store.cc:276] 0830 07:54:39.237212 (+ 0us) service_pool.cc:168] Inserting onto call queue
0830 07:54:39.881099 (+643887us) service_pool.cc:225] Handling call
0830 07:54:39.972833 (+ 91734us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0830 07:54:39.972855 (+ 22us) ts_tablet_manager.cc:676] Creating new metadata...
0830 07:54:40.305633 (+332778us) tablet_metadata.cc:641] Metadata flushed
0830 07:54:40.408058 (+102425us) tablet_replica.cc:206] Creating consensus instance
0830 07:54:40.411709 (+ 3651us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20250830 07:54:40.478077 13485 raft_consensus.cc:2466] T 6492bd11e50d4900927db0de3757aa24 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 1.
I20250830 07:54:40.479135 13883 raft_consensus.cc:2241] T 6492bd11e50d4900927db0de3757aa24 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Raft consensus shutting down.
I20250830 07:54:40.479669 13883 raft_consensus.cc:2270] T 6492bd11e50d4900927db0de3757aa24 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20250830 07:54:40.481233 13883 ts_tablet_manager.cc:1905] T 6492bd11e50d4900927db0de3757aa24 P 2065c332f15a4739899af79f3669c3ba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250830 07:54:40.483234 13468 rpcz_store.cc:276] 0830 07:54:39.238135 (+ 0us) service_pool.cc:168] Inserting onto call queue
0830 07:54:39.877399 (+639264us) service_pool.cc:225] Handling call
0830 07:54:39.883493 (+ 6094us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0830 07:54:39.883516 (+ 23us) ts_tablet_manager.cc:676] Creating new metadata...
0830 07:54:40.382602 (+499086us) tablet_metadata.cc:641] Metadata flushed
0830 07:54:40.472172 (+ 89570us) tablet_replica.cc:206] Creating consensus instance
0830 07:54:40.472377 (+ 205us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20250830 07:54:40.483635 13462 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 353) took 1239 ms. Trace:
I20250830 07:54:40.483753 13462 rpcz_store.cc:276] 0830 07:54:39.237782 (+ 0us) service_pool.cc:168] Inserting onto call queue
0830 07:54:39.902615 (+664833us) service_pool.cc:225] Handling call
0830 07:54:40.003106 (+100491us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0830 07:54:40.003133 (+ 27us) ts_tablet_manager.cc:676] Creating new metadata...
0830 07:54:40.392328 (+389195us) tablet_metadata.cc:641] Metadata flushed
0830 07:54:40.477393 (+ 85065us) tablet_replica.cc:206] Creating consensus instance
0830 07:54:40.477536 (+ 143us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20250830 07:54:40.484220 13628 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "62ee2d0fbd774d38a4a4c4a033584ef9" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:40.485014 13606 tablet_service.cc:1515] Processing DeleteTablet for tablet 74f2fcc22fd545fb8ca7c20619843023 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:40 UTC) from {username='slave'} at 127.0.0.1:45306
W20250830 07:54:40.486402 13220 catalog_manager.cc:4908] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet 74f2fcc22fd545fb8ca7c20619843023 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 74f2fcc22fd545fb8ca7c20619843023 already in progress: creating tablet
I20250830 07:54:40.488858 14546 tablet.cc:1722] T 7238db7e31484201a30cf4c035d82aff P 6b5e454d98894637b466ea27f1b647f9: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250830 07:54:40.488936 13233 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_27b3b751051e48bd8597cd51939e2c7d" } new_table_name: "default.Table_a20eaa028a44468fb031dccbf893a83b" modify_external_catalogs: true
W20250830 07:54:40.490177 13703 leader_election.cc:343] T 62ee2d0fbd774d38a4a4c4a033584ef9 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:40.491142 13227 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_2d468f4cd05e4f9aa354321ddccdc59c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:40.491663 13227 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2d468f4cd05e4f9aa354321ddccdc59c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:40.491677 13628 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "1fa571e9490e499792225d7b786e8658" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9"
I20250830 07:54:40.491866 13628 raft_consensus.cc:3058] T 1fa571e9490e499792225d7b786e8658 P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Advancing to term 2
I20250830 07:54:40.490840 13231 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_a22710bc37024873ab4d641d2c9aad8d" } new_table_name: "default.Table_df0e35c42b3d47589ce170267c3c7b76" modify_external_catalogs: true
I20250830 07:54:40.493896 13229 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_c440d46b5982439c94ff44ddba2ddd28" } modify_external_catalogs: true
I20250830 07:54:40.494046 13229 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_c440d46b5982439c94ff44ddba2ddd28" } modify_external_catalogs: true
I20250830 07:54:40.494630 13628 raft_consensus.cc:2466] T 1fa571e9490e499792225d7b786e8658 P 6b5e454d98894637b466ea27f1b647f9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 2.
I20250830 07:54:40.495219 13232 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_c01144cf05e74ffea49c8b6a709652e2" } new_table_name: "default.Table_9988c7c93c1e4a8e93d8402ee3bff2e8" modify_external_catalogs: true
I20250830 07:54:40.496425 13226 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_7dc4898210c641719d6d97c45dbd89c9" } modify_external_catalogs: true
I20250830 07:54:40.496558 13226 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_7dc4898210c641719d6d97c45dbd89c9" } modify_external_catalogs: true
W20250830 07:54:40.497118 13703 leader_election.cc:343] T 050e72b96c2d479896b3a54d85e6f6dd P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Not found: Tablet not found: 050e72b96c2d479896b3a54d85e6f6dd
I20250830 07:54:40.497536 13703 leader_election.cc:304] T 1fa571e9490e499792225d7b786e8658 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f; no voters:
I20250830 07:54:40.498483 14535 raft_consensus.cc:2802] T 1fa571e9490e499792225d7b786e8658 P 9b057ade5dce45af9f8bf0bedf8b917f [term 2 FOLLOWER]: Leader election won for term 2
I20250830 07:54:40.498661 14535 raft_consensus.cc:695] T 1fa571e9490e499792225d7b786e8658 P 9b057ade5dce45af9f8bf0bedf8b917f [term 2 LEADER]: Becoming Leader. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Running, Role: LEADER
I20250830 07:54:40.499078 14535 consensus_queue.cc:237] T 1fa571e9490e499792225d7b786e8658 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:40.499524 13624 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "cada6410e2884c508bb7dd38bea438ae" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9"
W20250830 07:54:40.500327 13703 leader_election.cc:343] T cada6410e2884c508bb7dd38bea438ae P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:40.512836 13225 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_6f8d287a31204172a037b156956fb0d9" } modify_external_catalogs: true
I20250830 07:54:40.513046 13225 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_6f8d287a31204172a037b156956fb0d9" } modify_external_catalogs: true
I20250830 07:54:40.529443 13755 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 357) took 1153 ms. Trace:
I20250830 07:54:40.529703 13755 rpcz_store.cc:276] 0830 07:54:39.376321 (+ 0us) service_pool.cc:168] Inserting onto call queue
0830 07:54:39.607739 (+231418us) service_pool.cc:225] Handling call
0830 07:54:39.608577 (+ 838us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0830 07:54:39.608604 (+ 27us) ts_tablet_manager.cc:676] Creating new metadata...
0830 07:54:40.343825 (+735221us) tablet_metadata.cc:641] Metadata flushed
0830 07:54:40.529177 (+185352us) tablet_replica.cc:206] Creating consensus instance
0830 07:54:40.529385 (+ 208us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20250830 07:54:40.542320 13228 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_5b1f6f284dc946afa2daaea18a0164e2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:40.543018 13228 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5b1f6f284dc946afa2daaea18a0164e2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:40.544770 13234 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_31c70ac145a8402ca709a5ffdeaaffb3" } modify_external_catalogs: true
I20250830 07:54:40.544934 13234 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_31c70ac145a8402ca709a5ffdeaaffb3" } modify_external_catalogs: true
I20250830 07:54:40.553251 13882 tablet_bootstrap.cc:492] T cada6410e2884c508bb7dd38bea438ae P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:54:40.553630 14505 ts_tablet_manager.cc:1918] T 6492bd11e50d4900927db0de3757aa24 P 9b057ade5dce45af9f8bf0bedf8b917f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250830 07:54:40.553884 14505 log.cc:1199] T 6492bd11e50d4900927db0de3757aa24 P 9b057ade5dce45af9f8bf0bedf8b917f: Deleting WAL directory at /tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/ts-2/wal/wals/6492bd11e50d4900927db0de3757aa24
I20250830 07:54:40.554373 14505 ts_tablet_manager.cc:1939] T 6492bd11e50d4900927db0de3757aa24 P 9b057ade5dce45af9f8bf0bedf8b917f: Deleting consensus metadata
I20250830 07:54:40.557664 13882 ts_tablet_manager.cc:1397] T cada6410e2884c508bb7dd38bea438ae P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.228s user 0.013s sys 0.001s
I20250830 07:54:40.558513 13882 raft_consensus.cc:357] T cada6410e2884c508bb7dd38bea438ae P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:40.558696 13882 raft_consensus.cc:383] T cada6410e2884c508bb7dd38bea438ae P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:40.558790 13882 raft_consensus.cc:738] T cada6410e2884c508bb7dd38bea438ae P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:54:40.567370 13882 consensus_queue.cc:260] T cada6410e2884c508bb7dd38bea438ae P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:40.572157 13883 ts_tablet_manager.cc:1918] T 6492bd11e50d4900927db0de3757aa24 P 2065c332f15a4739899af79f3669c3ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250830 07:54:40.573137 13886 tablet_bootstrap.cc:492] T 30c2558c28944ff39d1a4a4ca9ac604e P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:54:40.573308 13886 ts_tablet_manager.cc:1397] T 30c2558c28944ff39d1a4a4ca9ac604e P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.143s user 0.007s sys 0.020s
W20250830 07:54:40.574115 13703 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.209.2:38967, user_credentials={real_user=slave}} blocked reactor thread for 52367.4us
I20250830 07:54:40.574151 13882 ts_tablet_manager.cc:1428] T cada6410e2884c508bb7dd38bea438ae P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.016s user 0.001s sys 0.001s
I20250830 07:54:40.574437 13882 tablet_bootstrap.cc:492] T c3b35ea656db4741a02e6746e1b049ec P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:54:40.577510 13882 tablet_bootstrap.cc:654] T c3b35ea656db4741a02e6746e1b049ec P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:40.589937 13886 raft_consensus.cc:357] T 30c2558c28944ff39d1a4a4ca9ac604e P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:40.590140 13886 raft_consensus.cc:383] T 30c2558c28944ff39d1a4a4ca9ac604e P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:40.590250 13886 raft_consensus.cc:738] T 30c2558c28944ff39d1a4a4ca9ac604e P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:54:40.590487 13886 consensus_queue.cc:260] T 30c2558c28944ff39d1a4a4ca9ac604e P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:40.591252 13886 ts_tablet_manager.cc:1428] T 30c2558c28944ff39d1a4a4ca9ac604e P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.018s user 0.001s sys 0.001s
I20250830 07:54:40.591598 13886 tablet_bootstrap.cc:492] T b38c8d003413428dae9e47f58e197c2c P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:54:40.592726 13883 log.cc:1199] T 6492bd11e50d4900927db0de3757aa24 P 2065c332f15a4739899af79f3669c3ba: Deleting WAL directory at /tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/ts-0/wal/wals/6492bd11e50d4900927db0de3757aa24
I20250830 07:54:40.593264 13886 tablet_bootstrap.cc:654] T b38c8d003413428dae9e47f58e197c2c P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:40.593408 13883 ts_tablet_manager.cc:1939] T 6492bd11e50d4900927db0de3757aa24 P 2065c332f15a4739899af79f3669c3ba: Deleting consensus metadata
I20250830 07:54:40.598326 13219 catalog_manager.cc:4928] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): tablet 6492bd11e50d4900927db0de3757aa24 (table default.Table_7dc4898210c641719d6d97c45dbd89c9 [id=b7dcb14885434162aac95c78a5a70ba9]) successfully deleted
W20250830 07:54:40.602308 13219 catalog_manager.cc:4908] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): delete failed for tablet 74f2fcc22fd545fb8ca7c20619843023 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 74f2fcc22fd545fb8ca7c20619843023 already in progress: creating tablet
I20250830 07:54:40.604210 13629 raft_consensus.cc:3058] T 91ab8c468c8143b9ae11b839a95a26fd P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:40.608611 14565 raft_consensus.cc:491] T ada52626bbc94105a8b9428b0bbdfb5e P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:40.608820 14565 raft_consensus.cc:513] T ada52626bbc94105a8b9428b0bbdfb5e P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
W20250830 07:54:40.609953 13230 catalog_manager.cc:5415] Ignoring report from unknown tablet 008827b3d09d464b9182fb42dc2170d5
W20250830 07:54:40.610107 13230 catalog_manager.cc:5415] Ignoring report from unknown tablet ff2267fb411942ff826e2a72bcb89cd7
W20250830 07:54:40.610208 13230 catalog_manager.cc:5415] Ignoring report from unknown tablet 861809cc50764aa89140e587489e2d88
W20250830 07:54:40.610360 13230 catalog_manager.cc:5415] Ignoring report from unknown tablet e4f1ff6026bb45e28e63c27c83399d72
W20250830 07:54:40.611442 13422 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.209.3:38743, user_credentials={real_user=slave}} blocked reactor thread for 227151us
I20250830 07:54:40.612144 13422 leader_election.cc:304] T 008827b3d09d464b9182fb42dc2170d5 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba; no voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f
W20250830 07:54:40.612365 13230 catalog_manager.cc:5415] Ignoring report from unknown tablet 05da843c0fe4482a926e410e06b22461
W20250830 07:54:40.612524 13230 catalog_manager.cc:5415] Ignoring report from unknown tablet bee1b5f6f04740dba64cdcb094e26113
I20250830 07:54:40.615710 14565 leader_election.cc:290] T ada52626bbc94105a8b9428b0bbdfb5e P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
I20250830 07:54:40.616321 13485 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "b480f5eb03804baeb61cd0424d70faf5" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba"
I20250830 07:54:40.616508 13485 raft_consensus.cc:3058] T b480f5eb03804baeb61cd0424d70faf5 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:40.619839 13485 raft_consensus.cc:2466] T b480f5eb03804baeb61cd0424d70faf5 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 1.
I20250830 07:54:40.620730 13627 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "ada52626bbc94105a8b9428b0bbdfb5e" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
W20250830 07:54:40.622056 13703 leader_election.cc:343] T ada52626bbc94105a8b9428b0bbdfb5e P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:40.622479 14561 raft_consensus.cc:2747] T 008827b3d09d464b9182fb42dc2170d5 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20250830 07:54:40.625787 13233 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 8eb010d7955d47a89ff1d01be1b5b01e consensus state has no leader
I20250830 07:54:40.627135 13882 tablet_bootstrap.cc:492] T c3b35ea656db4741a02e6746e1b049ec P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:54:40.627789 13882 ts_tablet_manager.cc:1397] T c3b35ea656db4741a02e6746e1b049ec P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.053s user 0.006s sys 0.004s
I20250830 07:54:40.628520 13882 raft_consensus.cc:357] T c3b35ea656db4741a02e6746e1b049ec P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:40.628705 13882 raft_consensus.cc:383] T c3b35ea656db4741a02e6746e1b049ec P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:40.628779 13882 raft_consensus.cc:738] T c3b35ea656db4741a02e6746e1b049ec P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:54:40.629004 13882 consensus_queue.cc:260] T c3b35ea656db4741a02e6746e1b049ec P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:40.629462 13882 ts_tablet_manager.cc:1428] T c3b35ea656db4741a02e6746e1b049ec P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20250830 07:54:40.629734 13882 tablet_bootstrap.cc:492] T 27da527d9fe045ae8c17f193d034f5ac P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:54:40.631189 13882 tablet_bootstrap.cc:654] T 27da527d9fe045ae8c17f193d034f5ac P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:40.632165 13233 catalog_manager.cc:5674] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743) does not have the latest schema for tablet d4e35395930f4c37b34649da5718aa1f (table default.Table_fc298c4951614456914be830598a020a [id=e946db3cd3504a69a61a7ed2cabcada7]). Expected version 1 got 0
I20250830 07:54:40.632400 13887 tablet_bootstrap.cc:492] T 62ee2d0fbd774d38a4a4c4a033584ef9 P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:54:40.632524 13887 ts_tablet_manager.cc:1397] T 62ee2d0fbd774d38a4a4c4a033584ef9 P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.539s user 0.005s sys 0.012s
I20250830 07:54:40.633080 13233 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_d6a8ec58d60a4bb68d9863cf2a7dd7d5" } new_table_name: "default.Table_9f782ecc45e54615a182e9ad36d446aa" modify_external_catalogs: true
I20250830 07:54:40.633222 13887 raft_consensus.cc:357] T 62ee2d0fbd774d38a4a4c4a033584ef9 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:40.633379 13887 raft_consensus.cc:383] T 62ee2d0fbd774d38a4a4c4a033584ef9 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:40.633452 13887 raft_consensus.cc:738] T 62ee2d0fbd774d38a4a4c4a033584ef9 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:54:40.633610 13887 consensus_queue.cc:260] T 62ee2d0fbd774d38a4a4c4a033584ef9 P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:40.639053 13481 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "62ee2d0fbd774d38a4a4c4a033584ef9" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:54:40.642355 13227 master_service.cc:948] ReplaceTablet: received request to replace tablet ec4a3975961d4f85ad9da94835417574 from {username='slave'} at 127.0.0.1:42126
I20250830 07:54:40.654664 14517 catalog_manager.cc:1604] T 00000000000000000000000000000000 P 3ea183a890b84f408b20b55e9eb7c7ed: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20250830 07:54:40.658547 14576 tablet.cc:1722] T d4e35395930f4c37b34649da5718aa1f P 9b057ade5dce45af9f8bf0bedf8b917f: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250830 07:54:40.665350 13882 tablet_bootstrap.cc:492] T 27da527d9fe045ae8c17f193d034f5ac P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:54:40.665486 13882 ts_tablet_manager.cc:1397] T 27da527d9fe045ae8c17f193d034f5ac P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.036s user 0.002s sys 0.000s
I20250830 07:54:40.666186 13882 raft_consensus.cc:357] T 27da527d9fe045ae8c17f193d034f5ac P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:40.666356 13882 raft_consensus.cc:383] T 27da527d9fe045ae8c17f193d034f5ac P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:40.666422 13882 raft_consensus.cc:738] T 27da527d9fe045ae8c17f193d034f5ac P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:54:40.666592 13882 consensus_queue.cc:260] T 27da527d9fe045ae8c17f193d034f5ac P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:40.667172 13882 ts_tablet_manager.cc:1428] T 27da527d9fe045ae8c17f193d034f5ac P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20250830 07:54:40.643886 13887 ts_tablet_manager.cc:1428] T 62ee2d0fbd774d38a4a4c4a033584ef9 P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.011s user 0.001s sys 0.001s
I20250830 07:54:40.668695 13887 tablet_bootstrap.cc:492] T 2be43f828f204f599017b6a04cf2ddf9 P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:54:40.670452 13887 tablet_bootstrap.cc:654] T 2be43f828f204f599017b6a04cf2ddf9 P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:40.671415 13882 tablet_bootstrap.cc:492] T 62ee2d0fbd774d38a4a4c4a033584ef9 P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:54:40.673090 13882 tablet_bootstrap.cc:654] T 62ee2d0fbd774d38a4a4c4a033584ef9 P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:40.673813 14445 raft_consensus.cc:491] T 69f2105c5eeb47e9a848ae7bf8779996 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:40.681625 14445 raft_consensus.cc:513] T 69f2105c5eeb47e9a848ae7bf8779996 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:40.682314 14445 leader_election.cc:290] T 69f2105c5eeb47e9a848ae7bf8779996 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:40.675802 14526 raft_consensus.cc:491] T c3b35ea656db4741a02e6746e1b049ec P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:40.682665 14526 raft_consensus.cc:513] T c3b35ea656db4741a02e6746e1b049ec P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:40.683153 13887 tablet_bootstrap.cc:492] T 2be43f828f204f599017b6a04cf2ddf9 P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:54:40.683317 13887 ts_tablet_manager.cc:1397] T 2be43f828f204f599017b6a04cf2ddf9 P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.015s user 0.003s sys 0.003s
I20250830 07:54:40.683375 14526 leader_election.cc:290] T c3b35ea656db4741a02e6746e1b049ec P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
W20250830 07:54:40.683735 13561 leader_election.cc:343] T 69f2105c5eeb47e9a848ae7bf8779996 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): Not found: Tablet not found: 69f2105c5eeb47e9a848ae7bf8779996
I20250830 07:54:40.683884 13488 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "c3b35ea656db4741a02e6746e1b049ec" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:54:40.684139 13488 raft_consensus.cc:2391] T c3b35ea656db4741a02e6746e1b049ec P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b5e454d98894637b466ea27f1b647f9 in current term 1: Already voted for candidate 9b057ade5dce45af9f8bf0bedf8b917f in this term.
I20250830 07:54:40.684937 13887 raft_consensus.cc:357] T 2be43f828f204f599017b6a04cf2ddf9 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:40.685184 13887 raft_consensus.cc:383] T 2be43f828f204f599017b6a04cf2ddf9 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:40.685307 13887 raft_consensus.cc:738] T 2be43f828f204f599017b6a04cf2ddf9 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:54:40.668316 13481 raft_consensus.cc:2466] T 62ee2d0fbd774d38a4a4c4a033584ef9 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 0.
I20250830 07:54:40.685611 13773 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "c3b35ea656db4741a02e6746e1b049ec" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:40.685586 13887 consensus_queue.cc:260] T 2be43f828f204f599017b6a04cf2ddf9 P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:40.686105 13887 ts_tablet_manager.cc:1428] T 2be43f828f204f599017b6a04cf2ddf9 P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20250830 07:54:40.686524 13887 tablet_bootstrap.cc:492] T 04c9d954106a4417a34ff80bc98e2ce8 P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
W20250830 07:54:40.687002 13562 leader_election.cc:343] T 69f2105c5eeb47e9a848ae7bf8779996 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Not found: Tablet not found: 69f2105c5eeb47e9a848ae7bf8779996
I20250830 07:54:40.687230 13562 leader_election.cc:304] T 69f2105c5eeb47e9a848ae7bf8779996 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b5e454d98894637b466ea27f1b647f9; no voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:54:40.687702 13562 leader_election.cc:304] T c3b35ea656db4741a02e6746e1b049ec P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b5e454d98894637b466ea27f1b647f9; no voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:54:40.688218 14526 raft_consensus.cc:2747] T 69f2105c5eeb47e9a848ae7bf8779996 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:54:40.688444 14526 raft_consensus.cc:3058] T c3b35ea656db4741a02e6746e1b049ec P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:40.691848 14526 raft_consensus.cc:2747] T c3b35ea656db4741a02e6746e1b049ec P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:54:40.693215 14445 raft_consensus.cc:491] T cada6410e2884c508bb7dd38bea438ae P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:40.693363 14445 raft_consensus.cc:513] T cada6410e2884c508bb7dd38bea438ae P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:40.693904 14445 leader_election.cc:290] T cada6410e2884c508bb7dd38bea438ae P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:40.695621 13481 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "cada6410e2884c508bb7dd38bea438ae" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:54:40.695607 13773 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "cada6410e2884c508bb7dd38bea438ae" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:40.695865 13773 raft_consensus.cc:2391] T cada6410e2884c508bb7dd38bea438ae P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b5e454d98894637b466ea27f1b647f9 in current term 1: Already voted for candidate 9b057ade5dce45af9f8bf0bedf8b917f in this term.
I20250830 07:54:40.696177 13482 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "cada6410e2884c508bb7dd38bea438ae" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba"
I20250830 07:54:40.698589 13482 raft_consensus.cc:3058] T cada6410e2884c508bb7dd38bea438ae P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:40.701822 13482 raft_consensus.cc:2466] T cada6410e2884c508bb7dd38bea438ae P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 1.
I20250830 07:54:40.702636 13481 raft_consensus.cc:2391] T cada6410e2884c508bb7dd38bea438ae P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b5e454d98894637b466ea27f1b647f9 in current term 1: Already voted for candidate 9b057ade5dce45af9f8bf0bedf8b917f in this term.
I20250830 07:54:40.703075 13561 leader_election.cc:304] T cada6410e2884c508bb7dd38bea438ae P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b5e454d98894637b466ea27f1b647f9; no voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:54:40.703506 14526 raft_consensus.cc:3058] T cada6410e2884c508bb7dd38bea438ae P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:40.706209 14526 raft_consensus.cc:2747] T cada6410e2884c508bb7dd38bea438ae P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:54:40.708784 13481 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "ada52626bbc94105a8b9428b0bbdfb5e" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:54:40.698453 13887 tablet_bootstrap.cc:654] T 04c9d954106a4417a34ff80bc98e2ce8 P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
W20250830 07:54:40.717584 13231 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 2aea1a69d22544899b0218be7e0f8799 has no consensus state
I20250830 07:54:40.717988 13231 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_ac25d9b6411c4b45be69794a94042fad"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:40.718600 13231 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ac25d9b6411c4b45be69794a94042fad in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:40.719225 13886 tablet_bootstrap.cc:492] T b38c8d003413428dae9e47f58e197c2c P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:54:40.719396 13886 ts_tablet_manager.cc:1397] T b38c8d003413428dae9e47f58e197c2c P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.128s user 0.005s sys 0.002s
I20250830 07:54:40.720479 13229 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet 8cce7e5537794e9484f5a7c82b9e6e1d
I20250830 07:54:40.721240 13606 tablet_service.cc:1515] Processing DeleteTablet for tablet 8cce7e5537794e9484f5a7c82b9e6e1d with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:40 UTC) from {username='slave'} at 127.0.0.1:45306
I20250830 07:54:40.721215 13229 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_337eac5fc73e489cadc40b6760448942"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:40.721698 13229 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_337eac5fc73e489cadc40b6760448942 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250830 07:54:40.722059 13220 catalog_manager.cc:4908] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet 8cce7e5537794e9484f5a7c82b9e6e1d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8cce7e5537794e9484f5a7c82b9e6e1d already in progress: creating tablet
W20250830 07:54:40.722863 13232 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 439fc51afa6b435e81bc38b9e88d4041 has no consensus state
I20250830 07:54:40.723258 13232 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_481f218fb1b94c81b8f0932c67bb5b55"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:40.723717 13232 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_481f218fb1b94c81b8f0932c67bb5b55 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:40.725225 13227 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_af6ae1f5434745bb8a3262612e7e4e36" } new_table_name: "default.Table_e582f68dd18641078c3c802f15f55c1a" modify_external_catalogs: true
I20250830 07:54:40.726475 13886 raft_consensus.cc:357] T b38c8d003413428dae9e47f58e197c2c P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:40.730736 13755 tablet_service.cc:1515] Processing DeleteTablet for tablet 8cce7e5537794e9484f5a7c82b9e6e1d with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:40 UTC) from {username='slave'} at 127.0.0.1:45460
I20250830 07:54:40.735934 13886 raft_consensus.cc:383] T b38c8d003413428dae9e47f58e197c2c P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:40.736188 13886 raft_consensus.cc:738] T b38c8d003413428dae9e47f58e197c2c P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:54:40.736688 13886 consensus_queue.cc:260] T b38c8d003413428dae9e47f58e197c2c P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
W20250830 07:54:40.737548 13219 catalog_manager.cc:4908] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): delete failed for tablet 8cce7e5537794e9484f5a7c82b9e6e1d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8cce7e5537794e9484f5a7c82b9e6e1d already in progress: creating tablet
I20250830 07:54:40.738124 13886 ts_tablet_manager.cc:1428] T b38c8d003413428dae9e47f58e197c2c P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.019s user 0.002s sys 0.000s
I20250830 07:54:40.742871 13886 tablet_bootstrap.cc:492] T ad3c81a3f8df466fb71472e756c77305 P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:54:40.750268 13218 catalog_manager.cc:4928] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): tablet 6492bd11e50d4900927db0de3757aa24 (table default.Table_7dc4898210c641719d6d97c45dbd89c9 [id=b7dcb14885434162aac95c78a5a70ba9]) successfully deleted
I20250830 07:54:40.753446 14535 consensus_queue.cc:1035] T 27da527d9fe045ae8c17f193d034f5ac P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:54:40.753648 13887 tablet_bootstrap.cc:492] T 04c9d954106a4417a34ff80bc98e2ce8 P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:54:40.753847 13887 ts_tablet_manager.cc:1397] T 04c9d954106a4417a34ff80bc98e2ce8 P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.067s user 0.003s sys 0.002s
W20250830 07:54:40.754873 13701 leader_election.cc:343] T 1fa571e9490e499792225d7b786e8658 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): Not found: Tablet not found: 1fa571e9490e499792225d7b786e8658
I20250830 07:54:40.754823 13887 raft_consensus.cc:357] T 04c9d954106a4417a34ff80bc98e2ce8 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:40.755672 13887 raft_consensus.cc:383] T 04c9d954106a4417a34ff80bc98e2ce8 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:40.755650 13701 leader_election.cc:304] T 62ee2d0fbd774d38a4a4c4a033584ef9 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:54:40.755952 13887 raft_consensus.cc:738] T 04c9d954106a4417a34ff80bc98e2ce8 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:54:40.756127 14535 raft_consensus.cc:2802] T 62ee2d0fbd774d38a4a4c4a033584ef9 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:54:40.756485 14535 raft_consensus.cc:491] T 62ee2d0fbd774d38a4a4c4a033584ef9 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:54:40.756644 14535 raft_consensus.cc:3058] T 62ee2d0fbd774d38a4a4c4a033584ef9 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:40.759321 13887 consensus_queue.cc:260] T 04c9d954106a4417a34ff80bc98e2ce8 P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:40.759898 14535 raft_consensus.cc:513] T 62ee2d0fbd774d38a4a4c4a033584ef9 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:40.760418 13887 ts_tablet_manager.cc:1428] T 04c9d954106a4417a34ff80bc98e2ce8 P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
I20250830 07:54:40.761608 13887 tablet_bootstrap.cc:492] T 853503f3f98a49219b077af980180400 P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:54:40.761691 13629 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "62ee2d0fbd774d38a4a4c4a033584ef9" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9"
I20250830 07:54:40.756307 13886 tablet_bootstrap.cc:654] T ad3c81a3f8df466fb71472e756c77305 P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
W20250830 07:54:40.762351 13703 leader_election.cc:343] T 62ee2d0fbd774d38a4a4c4a033584ef9 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:40.762591 14535 leader_election.cc:290] T 62ee2d0fbd774d38a4a4c4a033584ef9 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Requested vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967)
I20250830 07:54:40.762795 13882 tablet_bootstrap.cc:492] T 62ee2d0fbd774d38a4a4c4a033584ef9 P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:54:40.763031 13882 ts_tablet_manager.cc:1397] T 62ee2d0fbd774d38a4a4c4a033584ef9 P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.096s user 0.006s sys 0.007s
W20250830 07:54:40.763500 13701 leader_election.cc:343] T 050e72b96c2d479896b3a54d85e6f6dd P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): Not found: Tablet not found: 050e72b96c2d479896b3a54d85e6f6dd
I20250830 07:54:40.763612 13701 leader_election.cc:304] T 050e72b96c2d479896b3a54d85e6f6dd P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 2065c332f15a4739899af79f3669c3ba, 6b5e454d98894637b466ea27f1b647f9
W20250830 07:54:40.763912 13219 catalog_manager.cc:4726] Async tablet task AlterTable RPC for tablet 2aea1a69d22544899b0218be7e0f8799 (table default.Table_df0e35c42b3d47589ce170267c3c7b76 [id=eab69737d0014874b68b8c9af5763f09], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 2aea1a69d22544899b0218be7e0f8799 has no consensus state
I20250830 07:54:40.763926 13882 raft_consensus.cc:357] T 62ee2d0fbd774d38a4a4c4a033584ef9 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:40.764040 14535 raft_consensus.cc:2747] T 050e72b96c2d479896b3a54d85e6f6dd P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:54:40.764133 13882 raft_consensus.cc:383] T 62ee2d0fbd774d38a4a4c4a033584ef9 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:40.764230 13882 raft_consensus.cc:738] T 62ee2d0fbd774d38a4a4c4a033584ef9 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:54:40.764478 13882 consensus_queue.cc:260] T 62ee2d0fbd774d38a4a4c4a033584ef9 P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:40.765151 13882 ts_tablet_manager.cc:1428] T 62ee2d0fbd774d38a4a4c4a033584ef9 P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20250830 07:54:40.766578 13226 catalog_manager.cc:5864] Not sending DeleteTablet requests; no consensus state for tablet e3926ab903df45a8b0c5e2a829ac7842
I20250830 07:54:40.766726 13887 tablet_bootstrap.cc:654] T 853503f3f98a49219b077af980180400 P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:40.767097 13882 tablet_bootstrap.cc:492] T ea8ccd7ef791471291bca049bdf7f643 P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
W20250830 07:54:40.768504 13226 catalog_manager.cc:5415] Ignoring report from unknown tablet 3167b609ed184decb4ccdb4945933ebb
W20250830 07:54:40.768616 13226 catalog_manager.cc:5415] Ignoring report from unknown tablet f53e7423d1f54566a667195f7cf5e1ce
W20250830 07:54:40.768684 13226 catalog_manager.cc:5415] Ignoring report from unknown tablet d33a5d107c6849aca6eb48ffdf8a5463
W20250830 07:54:40.769178 13226 catalog_manager.cc:5415] Ignoring report from unknown tablet dfccff3bd0cb4c7d998633b015de3cfa
W20250830 07:54:40.769264 13226 catalog_manager.cc:5415] Ignoring report from unknown tablet c82ac0102b4442449073e44d8a3d9065
W20250830 07:54:40.769338 13226 catalog_manager.cc:5415] Ignoring report from unknown tablet d876f6259bd94799a4e37dc9d14b8efe
W20250830 07:54:40.769402 13226 catalog_manager.cc:5415] Ignoring report from unknown tablet 4ab63ff59d4e4ec2b7b64d605545a870
W20250830 07:54:40.769477 13226 catalog_manager.cc:5415] Ignoring report from unknown tablet d3b47314f7cd4e969d973c0a340137f1
W20250830 07:54:40.769526 13226 catalog_manager.cc:5415] Ignoring report from unknown tablet ef16b9e2d444489699f4db1ac26d5f6c
W20250830 07:54:40.769591 13226 catalog_manager.cc:5415] Ignoring report from unknown tablet e134ab64aa1b4ce89e295b43cbc3fffb
W20250830 07:54:40.769646 13226 catalog_manager.cc:5415] Ignoring report from unknown tablet 05da843c0fe4482a926e410e06b22461
W20250830 07:54:40.769707 13226 catalog_manager.cc:5415] Ignoring report from unknown tablet 508ce3cc87734e5b8cec40e74522549a
W20250830 07:54:40.769748 13226 catalog_manager.cc:5415] Ignoring report from unknown tablet 1933d49d319b4bd7b717dda2b83859f3
I20250830 07:54:40.770144 13882 tablet_bootstrap.cc:654] T ea8ccd7ef791471291bca049bdf7f643 P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:40.770491 13228 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_ebc7e2e80254427c933db947a11b2ef3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:40.771070 13228 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ebc7e2e80254427c933db947a11b2ef3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:40.773439 13226 catalog_manager.cc:5674] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325) does not have the latest schema for tablet d4e35395930f4c37b34649da5718aa1f (table default.Table_fc298c4951614456914be830598a020a [id=e946db3cd3504a69a61a7ed2cabcada7]). Expected version 1 got 0
I20250830 07:54:40.775584 13225 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet 7238db7e31484201a30cf4c035d82aff
I20250830 07:54:40.776221 13225 master_service.cc:948] ReplaceTablet: received request to replace tablet 008827b3d09d464b9182fb42dc2170d5 from {username='slave'} at 127.0.0.1:42126
I20250830 07:54:40.776242 13606 tablet_service.cc:1515] Processing DeleteTablet for tablet 7238db7e31484201a30cf4c035d82aff with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:40 UTC) from {username='slave'} at 127.0.0.1:45306
I20250830 07:54:40.776513 14497 tablet_replica.cc:331] T 7238db7e31484201a30cf4c035d82aff P 6b5e454d98894637b466ea27f1b647f9: stopping tablet replica
I20250830 07:54:40.776479 14576 tablet.cc:1722] T 7238db7e31484201a30cf4c035d82aff P 9b057ade5dce45af9f8bf0bedf8b917f: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250830 07:54:40.776701 14497 raft_consensus.cc:2241] T 7238db7e31484201a30cf4c035d82aff P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250830 07:54:40.776676 13225 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_147915363787467ea640b4240b6fd5a2" } modify_external_catalogs: true
I20250830 07:54:40.776825 13225 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_147915363787467ea640b4240b6fd5a2" } modify_external_catalogs: true
I20250830 07:54:40.776904 14497 raft_consensus.cc:2270] T 7238db7e31484201a30cf4c035d82aff P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250830 07:54:40.777802 14497 ts_tablet_manager.cc:1905] T 7238db7e31484201a30cf4c035d82aff P 6b5e454d98894637b466ea27f1b647f9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250830 07:54:40.778854 13226 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_a0b8d1d1cefc406db62d3d2882feb096"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:40.779394 13226 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a0b8d1d1cefc406db62d3d2882feb096 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:40.781849 13230 master_service.cc:948] ReplaceTablet: received request to replace tablet 05da843c0fe4482a926e410e06b22461 from {username='slave'} at 127.0.0.1:42126
I20250830 07:54:40.782343 13230 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_06f5b3c7c1d64d37b8f57cd4c75a3074"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:40.784350 13230 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_06f5b3c7c1d64d37b8f57cd4c75a3074 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:40.786017 13755 tablet_service.cc:1515] Processing DeleteTablet for tablet 7238db7e31484201a30cf4c035d82aff with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:40 UTC) from {username='slave'} at 127.0.0.1:45460
I20250830 07:54:40.786255 14505 tablet_replica.cc:331] T 7238db7e31484201a30cf4c035d82aff P 9b057ade5dce45af9f8bf0bedf8b917f: stopping tablet replica
I20250830 07:54:40.786468 14505 raft_consensus.cc:2241] T 7238db7e31484201a30cf4c035d82aff P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Raft consensus shutting down.
I20250830 07:54:40.786612 14505 raft_consensus.cc:2270] T 7238db7e31484201a30cf4c035d82aff P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Raft consensus is shut down!
I20250830 07:54:40.787536 13882 tablet_bootstrap.cc:492] T ea8ccd7ef791471291bca049bdf7f643 P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:54:40.788558 14497 ts_tablet_manager.cc:1918] T 7238db7e31484201a30cf4c035d82aff P 6b5e454d98894637b466ea27f1b647f9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250830 07:54:40.789199 14497 log.cc:1199] T 7238db7e31484201a30cf4c035d82aff P 6b5e454d98894637b466ea27f1b647f9: Deleting WAL directory at /tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/ts-1/wal/wals/7238db7e31484201a30cf4c035d82aff
I20250830 07:54:40.789053 13882 ts_tablet_manager.cc:1397] T ea8ccd7ef791471291bca049bdf7f643 P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.022s user 0.006s sys 0.000s
I20250830 07:54:40.789938 14497 ts_tablet_manager.cc:1939] T 7238db7e31484201a30cf4c035d82aff P 6b5e454d98894637b466ea27f1b647f9: Deleting consensus metadata
I20250830 07:54:40.790179 13882 raft_consensus.cc:357] T ea8ccd7ef791471291bca049bdf7f643 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:40.790364 13882 raft_consensus.cc:383] T ea8ccd7ef791471291bca049bdf7f643 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:40.790462 13882 raft_consensus.cc:738] T ea8ccd7ef791471291bca049bdf7f643 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:54:40.791428 13701 leader_election.cc:304] T cada6410e2884c508bb7dd38bea438ae P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:54:40.791507 13220 catalog_manager.cc:4928] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): tablet 7238db7e31484201a30cf4c035d82aff (table default.Table_6f8d287a31204172a037b156956fb0d9 [id=0e4bba403b27442cb6e7f5b50ff4a39f]) successfully deleted
I20250830 07:54:40.791864 14535 raft_consensus.cc:2802] T cada6410e2884c508bb7dd38bea438ae P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election won for term 1
I20250830 07:54:40.792062 14535 raft_consensus.cc:695] T cada6410e2884c508bb7dd38bea438ae P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 LEADER]: Becoming Leader. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Running, Role: LEADER
I20250830 07:54:40.792333 14535 consensus_queue.cc:237] T cada6410e2884c508bb7dd38bea438ae P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:40.794445 13882 consensus_queue.cc:260] T ea8ccd7ef791471291bca049bdf7f643 P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:40.795169 13882 ts_tablet_manager.cc:1428] T ea8ccd7ef791471291bca049bdf7f643 P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
I20250830 07:54:40.795445 13882 tablet_bootstrap.cc:492] T e4c5eedb7f4d4397b19b8a3e0ddf9458 P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:54:40.798499 14505 ts_tablet_manager.cc:1905] T 7238db7e31484201a30cf4c035d82aff P 9b057ade5dce45af9f8bf0bedf8b917f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250830 07:54:40.799152 13882 tablet_bootstrap.cc:654] T e4c5eedb7f4d4397b19b8a3e0ddf9458 P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:40.799623 13462 tablet_service.cc:1515] Processing DeleteTablet for tablet 74f2fcc22fd545fb8ca7c20619843023 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:40 UTC) from {username='slave'} at 127.0.0.1:37956
I20250830 07:54:40.802384 13886 tablet_bootstrap.cc:492] T ad3c81a3f8df466fb71472e756c77305 P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:54:40.802524 13886 ts_tablet_manager.cc:1397] T ad3c81a3f8df466fb71472e756c77305 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.060s user 0.003s sys 0.001s
I20250830 07:54:40.805047 13462 tablet_service.cc:1515] Processing DeleteTablet for tablet 8cce7e5537794e9484f5a7c82b9e6e1d with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:40 UTC) from {username='slave'} at 127.0.0.1:37956
I20250830 07:54:40.805629 14402 raft_consensus.cc:491] T e4f1ff6026bb45e28e63c27c83399d72 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:40.805708 13234 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet c9a8f144d50c4d3d81fbf43ce29a2ad2
I20250830 07:54:40.805784 14402 raft_consensus.cc:513] T e4f1ff6026bb45e28e63c27c83399d72 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:54:40.806793 14505 ts_tablet_manager.cc:1918] T 7238db7e31484201a30cf4c035d82aff P 9b057ade5dce45af9f8bf0bedf8b917f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250830 07:54:40.806802 14402 leader_election.cc:290] T e4f1ff6026bb45e28e63c27c83399d72 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:40.807060 14505 log.cc:1199] T 7238db7e31484201a30cf4c035d82aff P 9b057ade5dce45af9f8bf0bedf8b917f: Deleting WAL directory at /tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/ts-2/wal/wals/7238db7e31484201a30cf4c035d82aff
I20250830 07:54:40.807134 13629 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "e4f1ff6026bb45e28e63c27c83399d72" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:40.807340 13629 raft_consensus.cc:2466] T e4f1ff6026bb45e28e63c27c83399d72 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2065c332f15a4739899af79f3669c3ba in term 0.
I20250830 07:54:40.807703 14505 ts_tablet_manager.cc:1939] T 7238db7e31484201a30cf4c035d82aff P 9b057ade5dce45af9f8bf0bedf8b917f: Deleting consensus metadata
I20250830 07:54:40.807741 13423 leader_election.cc:304] T e4f1ff6026bb45e28e63c27c83399d72 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 6b5e454d98894637b466ea27f1b647f9; no voters:
W20250830 07:54:40.807904 13234 catalog_manager.cc:5415] Ignoring report from unknown tablet 91ab8c468c8143b9ae11b839a95a26fd
W20250830 07:54:40.808048 13234 catalog_manager.cc:5415] Ignoring report from unknown tablet 008827b3d09d464b9182fb42dc2170d5
I20250830 07:54:40.808018 14402 raft_consensus.cc:2802] T e4f1ff6026bb45e28e63c27c83399d72 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election won for term 1
W20250830 07:54:40.808104 13234 catalog_manager.cc:5415] Ignoring report from unknown tablet bee1b5f6f04740dba64cdcb094e26113
I20250830 07:54:40.808126 14402 raft_consensus.cc:491] T e4f1ff6026bb45e28e63c27c83399d72 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20250830 07:54:40.808197 13234 catalog_manager.cc:5415] Ignoring report from unknown tablet c3b35ea656db4741a02e6746e1b049ec
I20250830 07:54:40.808214 14402 raft_consensus.cc:3058] T e4f1ff6026bb45e28e63c27c83399d72 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
W20250830 07:54:40.808293 13234 catalog_manager.cc:5415] Ignoring report from unknown tablet 27da527d9fe045ae8c17f193d034f5ac
I20250830 07:54:40.808902 13234 catalog_manager.cc:5674] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967) does not have the latest schema for tablet cada6410e2884c508bb7dd38bea438ae (table default.Table_8f85f386d1e54a59a6e539b06a508623 [id=4678375d8d3d474290ad1a254de14054]). Expected version 2 got 0
I20250830 07:54:40.811334 13462 tablet_service.cc:1515] Processing DeleteTablet for tablet 7238db7e31484201a30cf4c035d82aff with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:40 UTC) from {username='slave'} at 127.0.0.1:37956
I20250830 07:54:40.811592 13883 tablet_replica.cc:331] T 7238db7e31484201a30cf4c035d82aff P 2065c332f15a4739899af79f3669c3ba: stopping tablet replica
I20250830 07:54:40.811774 13883 raft_consensus.cc:2241] T 7238db7e31484201a30cf4c035d82aff P 2065c332f15a4739899af79f3669c3ba [term 1 LEADER]: Raft consensus shutting down.
I20250830 07:54:40.812044 13883 raft_consensus.cc:2270] T 7238db7e31484201a30cf4c035d82aff P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20250830 07:54:40.812835 13883 ts_tablet_manager.cc:1905] T 7238db7e31484201a30cf4c035d82aff P 2065c332f15a4739899af79f3669c3ba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250830 07:54:40.813822 13606 tablet_service.cc:1515] Processing DeleteTablet for tablet c9a8f144d50c4d3d81fbf43ce29a2ad2 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:40 UTC) from {username='slave'} at 127.0.0.1:45306
I20250830 07:54:40.813647 13219 catalog_manager.cc:4928] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): tablet 7238db7e31484201a30cf4c035d82aff (table default.Table_6f8d287a31204172a037b156956fb0d9 [id=0e4bba403b27442cb6e7f5b50ff4a39f]) successfully deleted
I20250830 07:54:40.814530 14497 tablet_replica.cc:331] T c9a8f144d50c4d3d81fbf43ce29a2ad2 P 6b5e454d98894637b466ea27f1b647f9: stopping tablet replica
I20250830 07:54:40.814713 14497 raft_consensus.cc:2241] T c9a8f144d50c4d3d81fbf43ce29a2ad2 P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250830 07:54:40.814878 14497 raft_consensus.cc:2270] T c9a8f144d50c4d3d81fbf43ce29a2ad2 P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250830 07:54:40.815055 13755 tablet_service.cc:1515] Processing DeleteTablet for tablet c9a8f144d50c4d3d81fbf43ce29a2ad2 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:40 UTC) from {username='slave'} at 127.0.0.1:45460
I20250830 07:54:40.815321 14402 raft_consensus.cc:513] T e4f1ff6026bb45e28e63c27c83399d72 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:54:40.815441 14497 ts_tablet_manager.cc:1905] T c9a8f144d50c4d3d81fbf43ce29a2ad2 P 6b5e454d98894637b466ea27f1b647f9: Deleting tablet data with delete state TABLET_DATA_DELETED
W20250830 07:54:40.815658 13234 catalog_manager.cc:5415] Ignoring report from unknown tablet ed87c6793dd149a6a363f1977d816628
W20250830 07:54:40.815754 13234 catalog_manager.cc:5415] Ignoring report from unknown tablet 6f2d855ab3c04123b2f9ea22cda6ef04
W20250830 07:54:40.815814 13234 catalog_manager.cc:5415] Ignoring report from unknown tablet 1476bb480bf747838613948875001c30
W20250830 07:54:40.815882 13234 catalog_manager.cc:5415] Ignoring report from unknown tablet 9696d8531a174585b8fd83a2391c02f7
W20250830 07:54:40.815951 13234 catalog_manager.cc:5415] Ignoring report from unknown tablet 27da527d9fe045ae8c17f193d034f5ac
W20250830 07:54:40.816097 13234 catalog_manager.cc:5415] Ignoring report from unknown tablet 29d492735cd14bb6b4a2a9a3929f62f3
W20250830 07:54:40.816339 13234 catalog_manager.cc:5415] Ignoring report from unknown tablet 91ab8c468c8143b9ae11b839a95a26fd
I20250830 07:54:40.816286 13629 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "e4f1ff6026bb45e28e63c27c83399d72" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9"
I20250830 07:54:40.816334 14402 leader_election.cc:290] T e4f1ff6026bb45e28e63c27c83399d72 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 election: Requested vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:40.816440 13629 raft_consensus.cc:3058] T e4f1ff6026bb45e28e63c27c83399d72 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Advancing to term 1
W20250830 07:54:40.816533 13234 catalog_manager.cc:5415] Ignoring report from unknown tablet b38c8d003413428dae9e47f58e197c2c
W20250830 07:54:40.816586 13234 catalog_manager.cc:5415] Ignoring report from unknown tablet 05da843c0fe4482a926e410e06b22461
W20250830 07:54:40.816643 13234 catalog_manager.cc:5415] Ignoring report from unknown tablet 6f4c400c0e5e43319fa521b5cab694b4
W20250830 07:54:40.816733 13234 catalog_manager.cc:5415] Ignoring report from unknown tablet bee1b5f6f04740dba64cdcb094e26113
W20250830 07:54:40.816805 13234 catalog_manager.cc:5415] Ignoring report from unknown tablet 30c2558c28944ff39d1a4a4ca9ac604e
W20250830 07:54:40.816848 13234 catalog_manager.cc:5415] Ignoring report from unknown tablet 9b9c2ae8805a48f7959d6745677a96f2
W20250830 07:54:40.816898 13234 catalog_manager.cc:5415] Ignoring report from unknown tablet 4c2c85732d454cd98efc2646af9450ed
W20250830 07:54:40.816938 13234 catalog_manager.cc:5415] Ignoring report from unknown tablet 008827b3d09d464b9182fb42dc2170d5
W20250830 07:54:40.816994 13234 catalog_manager.cc:5415] Ignoring report from unknown tablet 1fa571e9490e499792225d7b786e8658
W20250830 07:54:40.817046 13234 catalog_manager.cc:5415] Ignoring report from unknown tablet 861809cc50764aa89140e587489e2d88
W20250830 07:54:40.817130 13234 catalog_manager.cc:5415] Ignoring report from unknown tablet b480f5eb03804baeb61cd0424d70faf5
W20250830 07:54:40.817171 13234 catalog_manager.cc:5415] Ignoring report from unknown tablet f398e12cd9f543738d5163354f8a9d9d
W20250830 07:54:40.817224 13234 catalog_manager.cc:5415] Ignoring report from unknown tablet ff0f9cccc8ed43b1a8cd38de0e9d4097
W20250830 07:54:40.817312 13234 catalog_manager.cc:5415] Ignoring report from unknown tablet c3b35ea656db4741a02e6746e1b049ec
I20250830 07:54:40.818495 14526 raft_consensus.cc:491] T 62ee2d0fbd774d38a4a4c4a033584ef9 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:40.818645 14526 raft_consensus.cc:513] T 62ee2d0fbd774d38a4a4c4a033584ef9 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:40.819211 14526 leader_election.cc:290] T 62ee2d0fbd774d38a4a4c4a033584ef9 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:40.820000 13770 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "62ee2d0fbd774d38a4a4c4a033584ef9" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:40.820214 13770 raft_consensus.cc:2391] T 62ee2d0fbd774d38a4a4c4a033584ef9 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b5e454d98894637b466ea27f1b647f9 in current term 1: Already voted for candidate 9b057ade5dce45af9f8bf0bedf8b917f in this term.
I20250830 07:54:40.820740 13629 raft_consensus.cc:2466] T e4f1ff6026bb45e28e63c27c83399d72 P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2065c332f15a4739899af79f3669c3ba in term 1.
I20250830 07:54:40.820832 13883 ts_tablet_manager.cc:1918] T 7238db7e31484201a30cf4c035d82aff P 2065c332f15a4739899af79f3669c3ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250830 07:54:40.820968 13883 log.cc:1199] T 7238db7e31484201a30cf4c035d82aff P 2065c332f15a4739899af79f3669c3ba: Deleting WAL directory at /tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/ts-0/wal/wals/7238db7e31484201a30cf4c035d82aff
I20250830 07:54:40.821256 13755 tablet_service.cc:1515] Processing DeleteTablet for tablet 7238db7e31484201a30cf4c035d82aff with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:40 UTC) from {username='slave'} at 127.0.0.1:45460
I20250830 07:54:40.821518 13423 leader_election.cc:304] T e4f1ff6026bb45e28e63c27c83399d72 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 6b5e454d98894637b466ea27f1b647f9; no voters:
I20250830 07:54:40.821813 13883 ts_tablet_manager.cc:1939] T 7238db7e31484201a30cf4c035d82aff P 2065c332f15a4739899af79f3669c3ba: Deleting consensus metadata
I20250830 07:54:40.822846 13485 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "62ee2d0fbd774d38a4a4c4a033584ef9" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:54:40.823117 13485 raft_consensus.cc:2466] T 62ee2d0fbd774d38a4a4c4a033584ef9 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b5e454d98894637b466ea27f1b647f9 in term 0.
I20250830 07:54:40.823145 14402 raft_consensus.cc:2802] T e4f1ff6026bb45e28e63c27c83399d72 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election won for term 1
I20250830 07:54:40.823307 13886 raft_consensus.cc:357] T ad3c81a3f8df466fb71472e756c77305 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:40.823483 13886 raft_consensus.cc:383] T ad3c81a3f8df466fb71472e756c77305 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:40.823694 14402 raft_consensus.cc:695] T e4f1ff6026bb45e28e63c27c83399d72 P 2065c332f15a4739899af79f3669c3ba [term 1 LEADER]: Becoming Leader. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Running, Role: LEADER
I20250830 07:54:40.824004 13886 raft_consensus.cc:738] T ad3c81a3f8df466fb71472e756c77305 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:54:40.824011 13561 leader_election.cc:304] T 62ee2d0fbd774d38a4a4c4a033584ef9 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 6b5e454d98894637b466ea27f1b647f9; no voters: 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:54:40.824019 14402 consensus_queue.cc:237] T e4f1ff6026bb45e28e63c27c83399d72 P 2065c332f15a4739899af79f3669c3ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:54:40.824235 13886 consensus_queue.cc:260] T ad3c81a3f8df466fb71472e756c77305 P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:40.824371 14526 raft_consensus.cc:2802] T 62ee2d0fbd774d38a4a4c4a033584ef9 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:54:40.824473 14526 raft_consensus.cc:491] T 62ee2d0fbd774d38a4a4c4a033584ef9 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:54:40.824553 14526 raft_consensus.cc:3058] T 62ee2d0fbd774d38a4a4c4a033584ef9 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:40.824954 13886 ts_tablet_manager.cc:1428] T ad3c81a3f8df466fb71472e756c77305 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.022s user 0.003s sys 0.000s
I20250830 07:54:40.825220 13886 tablet_bootstrap.cc:492] T 7af74bdde363493f8061eba450ecf4b4 P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:54:40.826794 13886 tablet_bootstrap.cc:654] T 7af74bdde363493f8061eba450ecf4b4 P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:40.827531 14505 tablet_replica.cc:331] T c9a8f144d50c4d3d81fbf43ce29a2ad2 P 9b057ade5dce45af9f8bf0bedf8b917f: stopping tablet replica
I20250830 07:54:40.828190 14505 raft_consensus.cc:2241] T c9a8f144d50c4d3d81fbf43ce29a2ad2 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 LEADER]: Raft consensus shutting down.
I20250830 07:54:40.828630 14505 raft_consensus.cc:2270] T c9a8f144d50c4d3d81fbf43ce29a2ad2 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Raft consensus is shut down!
W20250830 07:54:40.828749 13233 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet b2248b305c9f448a9e30661142ad10ea has no consensus state
I20250830 07:54:40.829111 13233 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_605f96f8ddea45cfa2a0862488a409f6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250830 07:54:40.829209 14505 ts_tablet_manager.cc:1905] T c9a8f144d50c4d3d81fbf43ce29a2ad2 P 9b057ade5dce45af9f8bf0bedf8b917f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250830 07:54:40.830821 14526 raft_consensus.cc:513] T 62ee2d0fbd774d38a4a4c4a033584ef9 P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:40.832739 14526 leader_election.cc:290] T 62ee2d0fbd774d38a4a4c4a033584ef9 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 election: Requested vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:40.833326 13488 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "62ee2d0fbd774d38a4a4c4a033584ef9" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba"
I20250830 07:54:40.833576 13488 raft_consensus.cc:3058] T 62ee2d0fbd774d38a4a4c4a033584ef9 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:40.835110 13882 tablet_bootstrap.cc:492] T e4c5eedb7f4d4397b19b8a3e0ddf9458 P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:54:40.835276 13882 ts_tablet_manager.cc:1397] T e4c5eedb7f4d4397b19b8a3e0ddf9458 P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.040s user 0.003s sys 0.002s
W20250830 07:54:40.835727 13233 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_605f96f8ddea45cfa2a0862488a409f6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:40.835983 13882 raft_consensus.cc:357] T e4c5eedb7f4d4397b19b8a3e0ddf9458 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:40.836413 13488 raft_consensus.cc:2466] T 62ee2d0fbd774d38a4a4c4a033584ef9 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b5e454d98894637b466ea27f1b647f9 in term 1.
I20250830 07:54:40.836678 13882 raft_consensus.cc:383] T e4c5eedb7f4d4397b19b8a3e0ddf9458 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:40.836787 13561 leader_election.cc:304] T 62ee2d0fbd774d38a4a4c4a033584ef9 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 6b5e454d98894637b466ea27f1b647f9; no voters:
I20250830 07:54:40.837131 14526 raft_consensus.cc:2802] T 62ee2d0fbd774d38a4a4c4a033584ef9 P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Leader election won for term 1
I20250830 07:54:40.837539 13887 tablet_bootstrap.cc:492] T 853503f3f98a49219b077af980180400 P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:54:40.837642 14526 raft_consensus.cc:695] T 62ee2d0fbd774d38a4a4c4a033584ef9 P 6b5e454d98894637b466ea27f1b647f9 [term 1 LEADER]: Becoming Leader. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Running, Role: LEADER
I20250830 07:54:40.837965 14526 consensus_queue.cc:237] T 62ee2d0fbd774d38a4a4c4a033584ef9 P 6b5e454d98894637b466ea27f1b647f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:40.836808 13882 raft_consensus.cc:738] T e4c5eedb7f4d4397b19b8a3e0ddf9458 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:54:40.843364 13882 consensus_queue.cc:260] T e4c5eedb7f4d4397b19b8a3e0ddf9458 P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:40.843909 13882 ts_tablet_manager.cc:1428] T e4c5eedb7f4d4397b19b8a3e0ddf9458 P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.009s user 0.002s sys 0.000s
W20250830 07:54:40.843919 13218 catalog_manager.cc:4908] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): delete failed for tablet 74f2fcc22fd545fb8ca7c20619843023 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 74f2fcc22fd545fb8ca7c20619843023 already in progress: creating tablet
I20250830 07:54:40.844271 13882 tablet_bootstrap.cc:492] T dbe542c478874482b078296a7a0e9ec9 P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
W20250830 07:54:40.844692 13218 catalog_manager.cc:4908] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): delete failed for tablet 8cce7e5537794e9484f5a7c82b9e6e1d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8cce7e5537794e9484f5a7c82b9e6e1d already in progress: creating tablet
I20250830 07:54:40.845044 13887 ts_tablet_manager.cc:1397] T 853503f3f98a49219b077af980180400 P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.084s user 0.007s sys 0.002s
I20250830 07:54:40.845350 13234 catalog_manager.cc:5674] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967) does not have the latest schema for tablet ea8ccd7ef791471291bca049bdf7f643 (table default.Table_523d7bc660f94c9db577f499e22c772f [id=3582c72cab4b4e1084021b098ec30f87]). Expected version 2 got 0
I20250830 07:54:40.846004 13882 tablet_bootstrap.cc:654] T dbe542c478874482b078296a7a0e9ec9 P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:40.845562 13218 catalog_manager.cc:4928] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): tablet 7238db7e31484201a30cf4c035d82aff (table default.Table_6f8d287a31204172a037b156956fb0d9 [id=0e4bba403b27442cb6e7f5b50ff4a39f]) successfully deleted
I20250830 07:54:40.846551 13887 raft_consensus.cc:357] T 853503f3f98a49219b077af980180400 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
W20250830 07:54:40.848856 13701 leader_election.cc:343] T ada52626bbc94105a8b9428b0bbdfb5e P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:40.849217 13231 master_service.cc:948] ReplaceTablet: received request to replace tablet d37fe59b4f964f30bb1ed4cb00868b75 from {username='slave'} at 127.0.0.1:42126
I20250830 07:54:40.849224 13701 leader_election.cc:304] T ada52626bbc94105a8b9428b0bbdfb5e P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 2065c332f15a4739899af79f3669c3ba, 6b5e454d98894637b466ea27f1b647f9
I20250830 07:54:40.855805 14567 raft_consensus.cc:2747] T ada52626bbc94105a8b9428b0bbdfb5e P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:54:40.855780 13771 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "e4f1ff6026bb45e28e63c27c83399d72" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f"
I20250830 07:54:40.856606 13775 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "e4f1ff6026bb45e28e63c27c83399d72" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:40.856055 13770 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "62ee2d0fbd774d38a4a4c4a033584ef9" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f"
I20250830 07:54:40.857038 13770 raft_consensus.cc:2391] T 62ee2d0fbd774d38a4a4c4a033584ef9 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b5e454d98894637b466ea27f1b647f9 in current term 1: Already voted for candidate 9b057ade5dce45af9f8bf0bedf8b917f in this term.
I20250830 07:54:40.857205 13771 raft_consensus.cc:3058] T e4f1ff6026bb45e28e63c27c83399d72 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:40.860267 14497 ts_tablet_manager.cc:1918] T c9a8f144d50c4d3d81fbf43ce29a2ad2 P 6b5e454d98894637b466ea27f1b647f9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250830 07:54:40.860450 14497 log.cc:1199] T c9a8f144d50c4d3d81fbf43ce29a2ad2 P 6b5e454d98894637b466ea27f1b647f9: Deleting WAL directory at /tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/ts-1/wal/wals/c9a8f144d50c4d3d81fbf43ce29a2ad2
I20250830 07:54:40.860893 14497 ts_tablet_manager.cc:1939] T c9a8f144d50c4d3d81fbf43ce29a2ad2 P 6b5e454d98894637b466ea27f1b647f9: Deleting consensus metadata
I20250830 07:54:40.861446 13220 catalog_manager.cc:4928] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): tablet c9a8f144d50c4d3d81fbf43ce29a2ad2 (table default.Table_31c70ac145a8402ca709a5ffdeaaffb3 [id=d2dbb756d66b483ebe44d45ddfa5c17c]) successfully deleted
I20250830 07:54:40.870409 13887 raft_consensus.cc:383] T 853503f3f98a49219b077af980180400 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:40.870631 13887 raft_consensus.cc:738] T 853503f3f98a49219b077af980180400 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:54:40.871377 13771 raft_consensus.cc:2466] T e4f1ff6026bb45e28e63c27c83399d72 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2065c332f15a4739899af79f3669c3ba in term 1.
I20250830 07:54:40.872828 13887 consensus_queue.cc:260] T 853503f3f98a49219b077af980180400 P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:40.873468 13887 ts_tablet_manager.cc:1428] T 853503f3f98a49219b077af980180400 P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.028s user 0.001s sys 0.001s
I20250830 07:54:40.874138 13886 tablet_bootstrap.cc:492] T 7af74bdde363493f8061eba450ecf4b4 P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:54:40.874307 13886 ts_tablet_manager.cc:1397] T 7af74bdde363493f8061eba450ecf4b4 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.049s user 0.003s sys 0.002s
I20250830 07:54:40.875032 13886 raft_consensus.cc:357] T 7af74bdde363493f8061eba450ecf4b4 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:40.875221 13886 raft_consensus.cc:383] T 7af74bdde363493f8061eba450ecf4b4 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:40.875303 13886 raft_consensus.cc:738] T 7af74bdde363493f8061eba450ecf4b4 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:54:40.875676 13886 consensus_queue.cc:260] T 7af74bdde363493f8061eba450ecf4b4 P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:40.879701 13886 ts_tablet_manager.cc:1428] T 7af74bdde363493f8061eba450ecf4b4 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20250830 07:54:40.880051 13886 tablet_bootstrap.cc:492] T 66499e87e3d7422ca7a449cc2e89e709 P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:54:40.881187 13887 tablet_bootstrap.cc:492] T 66499e87e3d7422ca7a449cc2e89e709 P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:54:40.882652 13886 tablet_bootstrap.cc:654] T 66499e87e3d7422ca7a449cc2e89e709 P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:40.885232 14505 ts_tablet_manager.cc:1918] T c9a8f144d50c4d3d81fbf43ce29a2ad2 P 9b057ade5dce45af9f8bf0bedf8b917f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250830 07:54:40.885414 14505 log.cc:1199] T c9a8f144d50c4d3d81fbf43ce29a2ad2 P 9b057ade5dce45af9f8bf0bedf8b917f: Deleting WAL directory at /tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/ts-2/wal/wals/c9a8f144d50c4d3d81fbf43ce29a2ad2
I20250830 07:54:40.885915 14505 ts_tablet_manager.cc:1939] T c9a8f144d50c4d3d81fbf43ce29a2ad2 P 9b057ade5dce45af9f8bf0bedf8b917f: Deleting consensus metadata
I20250830 07:54:40.891952 13887 tablet_bootstrap.cc:654] T 66499e87e3d7422ca7a449cc2e89e709 P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:40.898754 13485 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "62ee2d0fbd774d38a4a4c4a033584ef9" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba"
I20250830 07:54:40.899454 13485 raft_consensus.cc:2391] T 62ee2d0fbd774d38a4a4c4a033584ef9 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 9b057ade5dce45af9f8bf0bedf8b917f in current term 1: Already voted for candidate 6b5e454d98894637b466ea27f1b647f9 in this term.
I20250830 07:54:40.907449 13219 catalog_manager.cc:4928] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): tablet c9a8f144d50c4d3d81fbf43ce29a2ad2 (table default.Table_31c70ac145a8402ca709a5ffdeaaffb3 [id=d2dbb756d66b483ebe44d45ddfa5c17c]) successfully deleted
W20250830 07:54:40.907953 13219 catalog_manager.cc:4895] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): delete failed for tablet 7238db7e31484201a30cf4c035d82aff because the tablet was not found. No further retry: Not found: Tablet not found: 7238db7e31484201a30cf4c035d82aff
I20250830 07:54:40.910873 13462 tablet_service.cc:1515] Processing DeleteTablet for tablet c9a8f144d50c4d3d81fbf43ce29a2ad2 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:40 UTC) from {username='slave'} at 127.0.0.1:37956
I20250830 07:54:40.911141 13883 tablet_replica.cc:331] T c9a8f144d50c4d3d81fbf43ce29a2ad2 P 2065c332f15a4739899af79f3669c3ba: stopping tablet replica
I20250830 07:54:40.911345 13883 raft_consensus.cc:2241] T c9a8f144d50c4d3d81fbf43ce29a2ad2 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Raft consensus shutting down.
I20250830 07:54:40.911510 13883 raft_consensus.cc:2270] T c9a8f144d50c4d3d81fbf43ce29a2ad2 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20250830 07:54:40.912058 13883 ts_tablet_manager.cc:1905] T c9a8f144d50c4d3d81fbf43ce29a2ad2 P 2065c332f15a4739899af79f3669c3ba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250830 07:54:40.918090 13701 leader_election.cc:304] T 62ee2d0fbd774d38a4a4c4a033584ef9 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 2065c332f15a4739899af79f3669c3ba, 6b5e454d98894637b466ea27f1b647f9
I20250830 07:54:40.918298 13887 tablet_bootstrap.cc:492] T 66499e87e3d7422ca7a449cc2e89e709 P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:54:40.918426 13887 ts_tablet_manager.cc:1397] T 66499e87e3d7422ca7a449cc2e89e709 P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.045s user 0.002s sys 0.010s
I20250830 07:54:40.918450 14315 raft_consensus.cc:2747] T 62ee2d0fbd774d38a4a4c4a033584ef9 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20250830 07:54:40.931545 13887 raft_consensus.cc:357] T 66499e87e3d7422ca7a449cc2e89e709 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:40.931823 13887 raft_consensus.cc:383] T 66499e87e3d7422ca7a449cc2e89e709 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:40.931991 13887 raft_consensus.cc:738] T 66499e87e3d7422ca7a449cc2e89e709 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
W20250830 07:54:40.933200 13232 catalog_manager.cc:5415] Ignoring report from unknown tablet 04c9d954106a4417a34ff80bc98e2ce8
W20250830 07:54:40.933297 13232 catalog_manager.cc:5415] Ignoring report from unknown tablet 861809cc50764aa89140e587489e2d88
W20250830 07:54:40.933424 13232 catalog_manager.cc:5415] Ignoring report from unknown tablet bee1b5f6f04740dba64cdcb094e26113
W20250830 07:54:40.933486 13232 catalog_manager.cc:5415] Ignoring report from unknown tablet 008827b3d09d464b9182fb42dc2170d5
W20250830 07:54:40.933549 13232 catalog_manager.cc:5415] Ignoring report from unknown tablet e4f1ff6026bb45e28e63c27c83399d72
W20250830 07:54:40.933590 13232 catalog_manager.cc:5415] Ignoring report from unknown tablet 9b9c2ae8805a48f7959d6745677a96f2
W20250830 07:54:40.933671 13232 catalog_manager.cc:5415] Ignoring report from unknown tablet b4ab964a64a64e00a78ffd2b220aef46
W20250830 07:54:40.933782 13232 catalog_manager.cc:5415] Ignoring report from unknown tablet 91ab8c468c8143b9ae11b839a95a26fd
I20250830 07:54:40.934374 13883 ts_tablet_manager.cc:1918] T c9a8f144d50c4d3d81fbf43ce29a2ad2 P 2065c332f15a4739899af79f3669c3ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
W20250830 07:54:40.934413 13232 catalog_manager.cc:5415] Ignoring report from unknown tablet 3167b609ed184decb4ccdb4945933ebb
W20250830 07:54:40.934496 13232 catalog_manager.cc:5415] Ignoring report from unknown tablet d33a5d107c6849aca6eb48ffdf8a5463
I20250830 07:54:40.934520 13883 log.cc:1199] T c9a8f144d50c4d3d81fbf43ce29a2ad2 P 2065c332f15a4739899af79f3669c3ba: Deleting WAL directory at /tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/ts-0/wal/wals/c9a8f144d50c4d3d81fbf43ce29a2ad2
W20250830 07:54:40.934625 13232 catalog_manager.cc:5415] Ignoring report from unknown tablet ef16b9e2d444489699f4db1ac26d5f6c
W20250830 07:54:40.934684 13232 catalog_manager.cc:5415] Ignoring report from unknown tablet 05da843c0fe4482a926e410e06b22461
I20250830 07:54:40.935040 13887 consensus_queue.cc:260] T 66499e87e3d7422ca7a449cc2e89e709 P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:40.935628 13887 ts_tablet_manager.cc:1428] T 66499e87e3d7422ca7a449cc2e89e709 P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.017s user 0.001s sys 0.000s
I20250830 07:54:40.937045 13229 catalog_manager.cc:5582] T cada6410e2884c508bb7dd38bea438ae P 9b057ade5dce45af9f8bf0bedf8b917f reported cstate change: term changed from 0 to 1, leader changed from <none> to 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3). New cstate: current_term: 1 leader_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } health_report { overall_health: HEALTHY } } }
I20250830 07:54:40.937449 13229 catalog_manager.cc:5674] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743) does not have the latest schema for tablet cada6410e2884c508bb7dd38bea438ae (table default.Table_8f85f386d1e54a59a6e539b06a508623 [id=4678375d8d3d474290ad1a254de14054]). Expected version 2 got 0
W20250830 07:54:40.937665 13227 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 7aed56dba39e40518e9c3325bcccd74a consensus state has no leader
I20250830 07:54:40.937899 13227 master_service.cc:948] ReplaceTablet: received request to replace tablet 49165f0001044d72b68263a60ef56457 from {username='slave'} at 127.0.0.1:42126
I20250830 07:54:40.938228 14445 raft_consensus.cc:491] T 27da527d9fe045ae8c17f193d034f5ac P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:40.938407 14445 raft_consensus.cc:513] T 27da527d9fe045ae8c17f193d034f5ac P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:40.939137 14445 leader_election.cc:290] T 27da527d9fe045ae8c17f193d034f5ac P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:40.940526 13887 tablet_bootstrap.cc:492] T dbe542c478874482b078296a7a0e9ec9 P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:54:40.940562 13771 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "27da527d9fe045ae8c17f193d034f5ac" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:40.941102 13232 catalog_manager.cc:5674] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325) does not have the latest schema for tablet 2be43f828f204f599017b6a04cf2ddf9 (table default.Table_517ee5a88dc8431fb14bc9f85c62b395 [id=cbd8b881bf8a456d9930d5a6b27ab7d4]). Expected version 2 got 0
I20250830 07:54:40.940490 13488 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "27da527d9fe045ae8c17f193d034f5ac" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:54:40.942364 13562 leader_election.cc:304] T 27da527d9fe045ae8c17f193d034f5ac P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b5e454d98894637b466ea27f1b647f9; no voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:54:40.942857 14480 raft_consensus.cc:2747] T 27da527d9fe045ae8c17f193d034f5ac P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:54:40.943598 13232 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_3e4b0ec8a89347c39ca293dd697bb734"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:40.944411 13232 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3e4b0ec8a89347c39ca293dd697bb734 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:40.949002 13887 tablet_bootstrap.cc:654] T dbe542c478874482b078296a7a0e9ec9 P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
W20250830 07:54:40.954638 13234 catalog_manager.cc:5415] Ignoring report from unknown tablet e4c5eedb7f4d4397b19b8a3e0ddf9458
I20250830 07:54:40.955045 13234 catalog_manager.cc:5582] T 62ee2d0fbd774d38a4a4c4a033584ef9 P 6b5e454d98894637b466ea27f1b647f9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2). New cstate: current_term: 1 leader_uuid: "6b5e454d98894637b466ea27f1b647f9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } health_report { overall_health: UNKNOWN } } }
I20250830 07:54:40.959714 13886 tablet_bootstrap.cc:492] T 66499e87e3d7422ca7a449cc2e89e709 P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:54:40.959860 13886 ts_tablet_manager.cc:1397] T 66499e87e3d7422ca7a449cc2e89e709 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.080s user 0.002s sys 0.001s
I20250830 07:54:40.960734 13886 raft_consensus.cc:357] T 66499e87e3d7422ca7a449cc2e89e709 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:40.960922 13886 raft_consensus.cc:383] T 66499e87e3d7422ca7a449cc2e89e709 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:40.961024 13886 raft_consensus.cc:738] T 66499e87e3d7422ca7a449cc2e89e709 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:54:40.961742 13886 consensus_queue.cc:260] T 66499e87e3d7422ca7a449cc2e89e709 P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:40.965248 13225 catalog_manager.cc:5864] Not sending DeleteTablet requests; no consensus state for tablet 21fc5d35a63f4cdbbf2e61e75d292037
I20250830 07:54:40.970706 13882 tablet_bootstrap.cc:492] T dbe542c478874482b078296a7a0e9ec9 P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:54:40.970853 13882 ts_tablet_manager.cc:1397] T dbe542c478874482b078296a7a0e9ec9 P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.127s user 0.002s sys 0.010s
I20250830 07:54:40.971632 13882 raft_consensus.cc:357] T dbe542c478874482b078296a7a0e9ec9 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:40.971803 13882 raft_consensus.cc:383] T dbe542c478874482b078296a7a0e9ec9 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:40.972446 13882 raft_consensus.cc:738] T dbe542c478874482b078296a7a0e9ec9 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:54:40.972666 13882 consensus_queue.cc:260] T dbe542c478874482b078296a7a0e9ec9 P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:40.973196 13882 ts_tablet_manager.cc:1428] T dbe542c478874482b078296a7a0e9ec9 P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20250830 07:54:40.973482 13882 tablet_bootstrap.cc:492] T ada52626bbc94105a8b9428b0bbdfb5e P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:54:40.975481 13883 ts_tablet_manager.cc:1939] T c9a8f144d50c4d3d81fbf43ce29a2ad2 P 2065c332f15a4739899af79f3669c3ba: Deleting consensus metadata
I20250830 07:54:40.976944 13218 catalog_manager.cc:4928] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): tablet c9a8f144d50c4d3d81fbf43ce29a2ad2 (table default.Table_31c70ac145a8402ca709a5ffdeaaffb3 [id=d2dbb756d66b483ebe44d45ddfa5c17c]) successfully deleted
I20250830 07:54:40.983426 13886 ts_tablet_manager.cc:1428] T 66499e87e3d7422ca7a449cc2e89e709 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.023s user 0.001s sys 0.001s
I20250830 07:54:40.985841 13882 tablet_bootstrap.cc:654] T ada52626bbc94105a8b9428b0bbdfb5e P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:40.988082 13886 tablet_bootstrap.cc:492] T e4c5eedb7f4d4397b19b8a3e0ddf9458 P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:54:40.988131 13887 tablet_bootstrap.cc:492] T dbe542c478874482b078296a7a0e9ec9 P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:54:40.988422 13887 ts_tablet_manager.cc:1397] T dbe542c478874482b078296a7a0e9ec9 P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.048s user 0.002s sys 0.001s
I20250830 07:54:40.989223 13887 raft_consensus.cc:357] T dbe542c478874482b078296a7a0e9ec9 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:40.989898 13887 raft_consensus.cc:383] T dbe542c478874482b078296a7a0e9ec9 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:40.990043 13887 raft_consensus.cc:738] T dbe542c478874482b078296a7a0e9ec9 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:54:40.990347 13887 consensus_queue.cc:260] T dbe542c478874482b078296a7a0e9ec9 P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:40.991521 13225 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_0a409df4f056485face66acaeadfeda9" } new_table_name: "default.Table_4c8064376b504b74bea14908e716c0b3" modify_external_catalogs: true
I20250830 07:54:40.991714 14194 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "2065c332f15a4739899af79f3669c3ba" instance_seqno: 1756540469523715) as {username='slave'} at 127.12.209.1:46253; Asking this server to re-register.
I20250830 07:54:40.992290 14605 raft_consensus.cc:491] T 00000000000000000000000000000000 P 3ea183a890b84f408b20b55e9eb7c7ed [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5e9d6449ae824acab24c459a72075e88)
I20250830 07:54:40.992460 14605 raft_consensus.cc:513] T 00000000000000000000000000000000 P 3ea183a890b84f408b20b55e9eb7c7ed [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fea6152429cc4e79a25b18e02aafae57" member_type: VOTER last_known_addr { host: "127.12.209.62" port: 39725 } } peers { permanent_uuid: "5e9d6449ae824acab24c459a72075e88" member_type: VOTER last_known_addr { host: "127.12.209.61" port: 44241 } } peers { permanent_uuid: "3ea183a890b84f408b20b55e9eb7c7ed" member_type: VOTER last_known_addr { host: "127.12.209.60" port: 43889 } }
I20250830 07:54:40.993170 13887 ts_tablet_manager.cc:1428] T dbe542c478874482b078296a7a0e9ec9 P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20250830 07:54:40.993292 14605 leader_election.cc:290] T 00000000000000000000000000000000 P 3ea183a890b84f408b20b55e9eb7c7ed [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fea6152429cc4e79a25b18e02aafae57 (127.12.209.62:39725), 5e9d6449ae824acab24c459a72075e88 (127.12.209.61:44241)
I20250830 07:54:40.993486 13887 tablet_bootstrap.cc:492] T 14ed24577c8f49f49c83242a26877614 P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:54:40.994601 13244 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "3ea183a890b84f408b20b55e9eb7c7ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 724 } } ignore_live_leader: false dest_uuid: "5e9d6449ae824acab24c459a72075e88" is_pre_election: true
I20250830 07:54:40.995718 13226 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_a48a10790646488c8d1a00093e81fffa"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:40.996307 13226 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a48a10790646488c8d1a00093e81fffa in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:40.995249 13536 heartbeater.cc:461] Registering TS with master...
I20250830 07:54:41.002493 14194 ts_manager.cc:194] Registered new tserver with Master: 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
W20250830 07:54:41.003819 13228 catalog_manager.cc:5415] Ignoring report from unknown tablet 853503f3f98a49219b077af980180400
W20250830 07:54:41.003911 13228 catalog_manager.cc:5415] Ignoring report from unknown tablet bee1b5f6f04740dba64cdcb094e26113
W20250830 07:54:41.003959 13228 catalog_manager.cc:5415] Ignoring report from unknown tablet 008827b3d09d464b9182fb42dc2170d5
W20250830 07:54:41.004042 13228 catalog_manager.cc:5415] Ignoring report from unknown tablet 27da527d9fe045ae8c17f193d034f5ac
W20250830 07:54:41.004089 13228 catalog_manager.cc:5415] Ignoring report from unknown tablet 91ab8c468c8143b9ae11b839a95a26fd
I20250830 07:54:41.005081 13228 master_service.cc:948] ReplaceTablet: received request to replace tablet ca959e42c8764eeba0faee96caf8b39f from {username='slave'} at 127.0.0.1:42126
I20250830 07:54:41.005533 14526 raft_consensus.cc:491] T ea8ccd7ef791471291bca049bdf7f643 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:41.005649 13228 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_8fc143e40fc14b37bac695b6f7604eed" } new_table_name: "default.Table_e671b5354b7b4ebe8814ab52385e56fe" modify_external_catalogs: true
I20250830 07:54:41.005947 14526 raft_consensus.cc:513] T ea8ccd7ef791471291bca049bdf7f643 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:41.006805 14526 leader_election.cc:290] T ea8ccd7ef791471291bca049bdf7f643 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:41.007557 13485 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "ea8ccd7ef791471291bca049bdf7f643" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
W20250830 07:54:41.008244 13561 leader_election.cc:343] T ea8ccd7ef791471291bca049bdf7f643 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:41.008508 13172 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "3ea183a890b84f408b20b55e9eb7c7ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 724 } } ignore_live_leader: false dest_uuid: "fea6152429cc4e79a25b18e02aafae57" is_pre_election: true
I20250830 07:54:41.009049 14127 leader_election.cc:304] T 00000000000000000000000000000000 P 3ea183a890b84f408b20b55e9eb7c7ed [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ea183a890b84f408b20b55e9eb7c7ed; no voters: 5e9d6449ae824acab24c459a72075e88, fea6152429cc4e79a25b18e02aafae57
I20250830 07:54:41.012142 14526 raft_consensus.cc:491] T 02be33dc658d428fa55e59784a2342f6 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:41.012410 14526 raft_consensus.cc:513] T 02be33dc658d428fa55e59784a2342f6 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:41.013435 14526 leader_election.cc:290] T 02be33dc658d428fa55e59784a2342f6 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
W20250830 07:54:41.013793 13561 leader_election.cc:343] T 02be33dc658d428fa55e59784a2342f6 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): Not found: Tablet not found: 02be33dc658d428fa55e59784a2342f6
I20250830 07:54:41.024345 13882 tablet_bootstrap.cc:492] T ada52626bbc94105a8b9428b0bbdfb5e P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:54:41.024521 13882 ts_tablet_manager.cc:1397] T ada52626bbc94105a8b9428b0bbdfb5e P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.051s user 0.002s sys 0.003s
I20250830 07:54:41.025307 13882 raft_consensus.cc:357] T ada52626bbc94105a8b9428b0bbdfb5e P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:41.026754 13882 raft_consensus.cc:383] T ada52626bbc94105a8b9428b0bbdfb5e P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:41.027211 13882 raft_consensus.cc:738] T ada52626bbc94105a8b9428b0bbdfb5e P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:54:41.027493 13882 consensus_queue.cc:260] T ada52626bbc94105a8b9428b0bbdfb5e P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:41.028164 13882 ts_tablet_manager.cc:1428] T ada52626bbc94105a8b9428b0bbdfb5e P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.004s user 0.000s sys 0.002s
I20250830 07:54:41.028646 13882 tablet_bootstrap.cc:492] T 853503f3f98a49219b077af980180400 P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:54:41.030320 13882 tablet_bootstrap.cc:654] T 853503f3f98a49219b077af980180400 P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:41.045010 14605 raft_consensus.cc:2747] T 00000000000000000000000000000000 P 3ea183a890b84f408b20b55e9eb7c7ed [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20250830 07:54:41.058815 13230 catalog_manager.cc:5674] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325) does not have the latest schema for tablet dbe542c478874482b078296a7a0e9ec9 (table default.Table_54bd02c58de341ec93ced1d662a7e671 [id=b80ba51884ef4042818f8def0b0ebf0e]). Expected version 2 got 0
I20250830 07:54:41.059587 13230 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_9d44727222db4c239a8c0e2c980d03e8" } modify_external_catalogs: true
I20250830 07:54:41.059772 13230 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_9d44727222db4c239a8c0e2c980d03e8" } modify_external_catalogs: true
I20250830 07:54:41.067095 13882 tablet_bootstrap.cc:492] T 853503f3f98a49219b077af980180400 P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:54:41.067250 13882 ts_tablet_manager.cc:1397] T 853503f3f98a49219b077af980180400 P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.039s user 0.004s sys 0.000s
I20250830 07:54:41.068630 13882 raft_consensus.cc:357] T 853503f3f98a49219b077af980180400 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:41.070534 13882 raft_consensus.cc:383] T 853503f3f98a49219b077af980180400 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:41.070647 13882 raft_consensus.cc:738] T 853503f3f98a49219b077af980180400 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:54:41.070863 13882 consensus_queue.cc:260] T 853503f3f98a49219b077af980180400 P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:40.996018 13887 tablet_bootstrap.cc:654] T 14ed24577c8f49f49c83242a26877614 P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:41.075184 13882 ts_tablet_manager.cc:1428] T 853503f3f98a49219b077af980180400 P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.008s user 0.002s sys 0.000s
I20250830 07:54:41.076390 14567 consensus_queue.cc:1035] T c3b35ea656db4741a02e6746e1b049ec P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.081s
I20250830 07:54:41.078032 13882 tablet_bootstrap.cc:492] T 6dda55ec2da34c8aba9f39a63e144a7c P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
W20250830 07:54:41.080862 13562 leader_election.cc:343] T 02be33dc658d428fa55e59784a2342f6 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Not found: Tablet not found: 02be33dc658d428fa55e59784a2342f6
I20250830 07:54:41.081032 13562 leader_election.cc:304] T 02be33dc658d428fa55e59784a2342f6 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b5e454d98894637b466ea27f1b647f9; no voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:54:41.081458 14526 raft_consensus.cc:2747] T 02be33dc658d428fa55e59784a2342f6 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:54:41.082391 13882 tablet_bootstrap.cc:654] T 6dda55ec2da34c8aba9f39a63e144a7c P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:41.089720 13770 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "ea8ccd7ef791471291bca049bdf7f643" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
W20250830 07:54:41.090353 13562 leader_election.cc:343] T ea8ccd7ef791471291bca049bdf7f643 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:41.090530 13562 leader_election.cc:304] T ea8ccd7ef791471291bca049bdf7f643 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b5e454d98894637b466ea27f1b647f9; no voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:54:41.090884 14526 raft_consensus.cc:2747] T ea8ccd7ef791471291bca049bdf7f643 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20250830 07:54:41.091125 13233 catalog_manager.cc:5415] Ignoring report from unknown tablet ef16b9e2d444489699f4db1ac26d5f6c
I20250830 07:54:41.091581 13233 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_2ec941924ad14c3eafbc20ba5404a4bc" } new_table_name: "default.Table_7e8dccc6af2d49159b06563cd36240a7" modify_external_catalogs: true
I20250830 07:54:41.094188 13886 tablet_bootstrap.cc:654] T e4c5eedb7f4d4397b19b8a3e0ddf9458 P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:41.094194 14526 consensus_queue.cc:1035] T afb132e8a5b14a029e005e375f276348 P 6b5e454d98894637b466ea27f1b647f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:54:41.102885 13231 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet d37fe59b4f964f30bb1ed4cb00868b75
I20250830 07:54:41.103470 13231 catalog_manager.cc:6652] ReplaceTablet: tablet d37fe59b4f964f30bb1ed4cb00868b75 deleted and replaced by tablet d7afb311a699495aa8376db6ab206d94
I20250830 07:54:41.104089 13755 tablet_service.cc:1515] Processing DeleteTablet for tablet d37fe59b4f964f30bb1ed4cb00868b75 with delete_type TABLET_DATA_DELETED (replaced by tablet d7afb311a699495aa8376db6ab206d94) from {username='slave'} at 127.0.0.1:45460
I20250830 07:54:41.104228 13462 tablet_service.cc:1515] Processing DeleteTablet for tablet d37fe59b4f964f30bb1ed4cb00868b75 with delete_type TABLET_DATA_DELETED (replaced by tablet d7afb311a699495aa8376db6ab206d94) from {username='slave'} at 127.0.0.1:37956
I20250830 07:54:41.104350 13606 tablet_service.cc:1515] Processing DeleteTablet for tablet d37fe59b4f964f30bb1ed4cb00868b75 with delete_type TABLET_DATA_DELETED (replaced by tablet d7afb311a699495aa8376db6ab206d94) from {username='slave'} at 127.0.0.1:45306
W20250830 07:54:41.104825 13219 catalog_manager.cc:4908] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): delete failed for tablet d37fe59b4f964f30bb1ed4cb00868b75 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d37fe59b4f964f30bb1ed4cb00868b75 already in progress: creating tablet
W20250830 07:54:41.105391 13220 catalog_manager.cc:4908] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet d37fe59b4f964f30bb1ed4cb00868b75 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d37fe59b4f964f30bb1ed4cb00868b75 already in progress: creating tablet
W20250830 07:54:41.105849 13218 catalog_manager.cc:4908] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): delete failed for tablet d37fe59b4f964f30bb1ed4cb00868b75 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d37fe59b4f964f30bb1ed4cb00868b75 already in progress: creating tablet
I20250830 07:54:41.107126 13231 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_41498bc7cf1b472ab9e9aa8286303e01" } modify_external_catalogs: true
I20250830 07:54:41.107311 13231 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_41498bc7cf1b472ab9e9aa8286303e01" } modify_external_catalogs: true
I20250830 07:54:41.107583 14535 consensus_queue.cc:1035] T c3b35ea656db4741a02e6746e1b049ec P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:54:41.118815 14526 consensus_queue.cc:1035] T afb132e8a5b14a029e005e375f276348 P 6b5e454d98894637b466ea27f1b647f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20250830 07:54:41.120390 13229 catalog_manager.cc:5415] Ignoring report from unknown tablet c3b35ea656db4741a02e6746e1b049ec
I20250830 07:54:41.120918 13229 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_406d183190bf4e01a97000963dd33d13"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:41.121486 13229 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_406d183190bf4e01a97000963dd33d13 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:41.124706 13887 tablet_bootstrap.cc:492] T 14ed24577c8f49f49c83242a26877614 P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:54:41.124949 13887 ts_tablet_manager.cc:1397] T 14ed24577c8f49f49c83242a26877614 P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.132s user 0.000s sys 0.004s
I20250830 07:54:41.125491 14526 raft_consensus.cc:491] T 853503f3f98a49219b077af980180400 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:41.125648 14526 raft_consensus.cc:513] T 853503f3f98a49219b077af980180400 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:41.126276 14526 leader_election.cc:290] T 853503f3f98a49219b077af980180400 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:41.126997 13485 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "853503f3f98a49219b077af980180400" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:54:41.127283 13771 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "853503f3f98a49219b077af980180400" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:41.127710 13485 raft_consensus.cc:2466] T 853503f3f98a49219b077af980180400 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b5e454d98894637b466ea27f1b647f9 in term 0.
W20250830 07:54:41.127743 13562 leader_election.cc:343] T 853503f3f98a49219b077af980180400 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:41.127091 13887 raft_consensus.cc:357] T 14ed24577c8f49f49c83242a26877614 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:41.128154 13561 leader_election.cc:304] T 853503f3f98a49219b077af980180400 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 6b5e454d98894637b466ea27f1b647f9; no voters: 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:54:41.128206 13887 raft_consensus.cc:383] T 14ed24577c8f49f49c83242a26877614 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:41.128448 13887 raft_consensus.cc:738] T 14ed24577c8f49f49c83242a26877614 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:54:41.128633 14526 raft_consensus.cc:2802] T 853503f3f98a49219b077af980180400 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:54:41.128731 14526 raft_consensus.cc:491] T 853503f3f98a49219b077af980180400 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:54:41.128842 14526 raft_consensus.cc:3058] T 853503f3f98a49219b077af980180400 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:41.129086 13887 consensus_queue.cc:260] T 14ed24577c8f49f49c83242a26877614 P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:41.131439 14526 raft_consensus.cc:513] T 853503f3f98a49219b077af980180400 P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:41.132299 13485 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "853503f3f98a49219b077af980180400" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba"
I20250830 07:54:41.132561 14526 leader_election.cc:290] T 853503f3f98a49219b077af980180400 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 election: Requested vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:41.132648 13771 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "853503f3f98a49219b077af980180400" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f"
W20250830 07:54:41.133684 13562 leader_election.cc:343] T 853503f3f98a49219b077af980180400 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:41.134503 13626 raft_consensus.cc:3058] T 27da527d9fe045ae8c17f193d034f5ac P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:41.134786 13485 raft_consensus.cc:3058] T 853503f3f98a49219b077af980180400 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:41.136397 13227 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet 49165f0001044d72b68263a60ef56457
I20250830 07:54:41.136865 13227 catalog_manager.cc:6652] ReplaceTablet: tablet 49165f0001044d72b68263a60ef56457 deleted and replaced by tablet 7676b4d6a75c4c6aacced1f2a1beb555
I20250830 07:54:41.138065 13755 tablet_service.cc:1515] Processing DeleteTablet for tablet 49165f0001044d72b68263a60ef56457 with delete_type TABLET_DATA_DELETED (replaced by tablet 7676b4d6a75c4c6aacced1f2a1beb555) from {username='slave'} at 127.0.0.1:45460
I20250830 07:54:41.138473 13462 tablet_service.cc:1515] Processing DeleteTablet for tablet 49165f0001044d72b68263a60ef56457 with delete_type TABLET_DATA_DELETED (replaced by tablet 7676b4d6a75c4c6aacced1f2a1beb555) from {username='slave'} at 127.0.0.1:37956
I20250830 07:54:41.138598 13606 tablet_service.cc:1515] Processing DeleteTablet for tablet 49165f0001044d72b68263a60ef56457 with delete_type TABLET_DATA_DELETED (replaced by tablet 7676b4d6a75c4c6aacced1f2a1beb555) from {username='slave'} at 127.0.0.1:45306
W20250830 07:54:41.138976 13219 catalog_manager.cc:4908] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): delete failed for tablet 49165f0001044d72b68263a60ef56457 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 49165f0001044d72b68263a60ef56457 already in progress: creating tablet
I20250830 07:54:41.139271 13485 raft_consensus.cc:2466] T 853503f3f98a49219b077af980180400 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b5e454d98894637b466ea27f1b647f9 in term 1.
W20250830 07:54:41.139302 13220 catalog_manager.cc:4908] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet 49165f0001044d72b68263a60ef56457 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 49165f0001044d72b68263a60ef56457 already in progress: creating tablet
W20250830 07:54:41.139307 13218 catalog_manager.cc:4908] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): delete failed for tablet 49165f0001044d72b68263a60ef56457 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 49165f0001044d72b68263a60ef56457 already in progress: creating tablet
I20250830 07:54:41.139621 13887 ts_tablet_manager.cc:1428] T 14ed24577c8f49f49c83242a26877614 P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.006s user 0.001s sys 0.001s
I20250830 07:54:41.139639 13561 leader_election.cc:304] T 853503f3f98a49219b077af980180400 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 6b5e454d98894637b466ea27f1b647f9; no voters: 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:54:41.140089 14526 raft_consensus.cc:2802] T 853503f3f98a49219b077af980180400 P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Leader election won for term 1
I20250830 07:54:41.140362 14526 raft_consensus.cc:695] T 853503f3f98a49219b077af980180400 P 6b5e454d98894637b466ea27f1b647f9 [term 1 LEADER]: Becoming Leader. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Running, Role: LEADER
I20250830 07:54:41.141024 13887 tablet_bootstrap.cc:492] T 30c2558c28944ff39d1a4a4ca9ac604e P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:54:41.144888 13227 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_b2b6c71b45ea47a088960316d6b712a5" } modify_external_catalogs: true
I20250830 07:54:41.145063 13227 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_b2b6c71b45ea47a088960316d6b712a5" } modify_external_catalogs: true
I20250830 07:54:41.146348 13882 tablet_bootstrap.cc:492] T 6dda55ec2da34c8aba9f39a63e144a7c P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:54:41.146517 13882 ts_tablet_manager.cc:1397] T 6dda55ec2da34c8aba9f39a63e144a7c P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.071s user 0.005s sys 0.000s
I20250830 07:54:41.147375 13882 raft_consensus.cc:357] T 6dda55ec2da34c8aba9f39a63e144a7c P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:41.147579 13882 raft_consensus.cc:383] T 6dda55ec2da34c8aba9f39a63e144a7c P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:41.147670 13882 raft_consensus.cc:738] T 6dda55ec2da34c8aba9f39a63e144a7c P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:54:41.149276 13887 tablet_bootstrap.cc:654] T 30c2558c28944ff39d1a4a4ca9ac604e P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:41.152158 13886 tablet_bootstrap.cc:492] T e4c5eedb7f4d4397b19b8a3e0ddf9458 P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:54:41.152148 14526 consensus_queue.cc:237] T 853503f3f98a49219b077af980180400 P 6b5e454d98894637b466ea27f1b647f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:41.152313 13886 ts_tablet_manager.cc:1397] T e4c5eedb7f4d4397b19b8a3e0ddf9458 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.164s user 0.001s sys 0.005s
I20250830 07:54:41.152976 13886 raft_consensus.cc:357] T e4c5eedb7f4d4397b19b8a3e0ddf9458 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:41.153165 13886 raft_consensus.cc:383] T e4c5eedb7f4d4397b19b8a3e0ddf9458 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:41.153241 13886 raft_consensus.cc:738] T e4c5eedb7f4d4397b19b8a3e0ddf9458 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:54:41.157831 13232 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_4320c5ce2b254d82870834c4a358fefa" } modify_external_catalogs: true
I20250830 07:54:41.158007 13232 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_4320c5ce2b254d82870834c4a358fefa" } modify_external_catalogs: true
I20250830 07:54:41.158553 14565 raft_consensus.cc:491] T a04bf79de30a42a98e71f622efc90c22 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:41.158735 14565 raft_consensus.cc:513] T a04bf79de30a42a98e71f622efc90c22 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:41.159529 14565 leader_election.cc:290] T a04bf79de30a42a98e71f622efc90c22 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
W20250830 07:54:41.161213 13703 leader_election.cc:343] T a04bf79de30a42a98e71f622efc90c22 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Not found: Tablet not found: a04bf79de30a42a98e71f622efc90c22
W20250830 07:54:41.161886 13701 leader_election.cc:343] T a04bf79de30a42a98e71f622efc90c22 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): Not found: Tablet not found: a04bf79de30a42a98e71f622efc90c22
I20250830 07:54:41.162020 13701 leader_election.cc:304] T a04bf79de30a42a98e71f622efc90c22 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 2065c332f15a4739899af79f3669c3ba, 6b5e454d98894637b466ea27f1b647f9
I20250830 07:54:41.162438 14565 raft_consensus.cc:2747] T a04bf79de30a42a98e71f622efc90c22 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20250830 07:54:41.171258 13886 consensus_queue.cc:260] T e4c5eedb7f4d4397b19b8a3e0ddf9458 P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:41.170653 13882 consensus_queue.cc:260] T 6dda55ec2da34c8aba9f39a63e144a7c P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:41.172511 13882 ts_tablet_manager.cc:1428] T 6dda55ec2da34c8aba9f39a63e144a7c P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.026s user 0.002s sys 0.000s
I20250830 07:54:41.172816 13882 tablet_bootstrap.cc:492] T ad3c81a3f8df466fb71472e756c77305 P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:54:41.174489 13882 tablet_bootstrap.cc:654] T ad3c81a3f8df466fb71472e756c77305 P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:41.176123 13886 ts_tablet_manager.cc:1428] T e4c5eedb7f4d4397b19b8a3e0ddf9458 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.024s user 0.001s sys 0.001s
W20250830 07:54:41.186900 13234 catalog_manager.cc:5415] Ignoring report from unknown tablet afb132e8a5b14a029e005e375f276348
W20250830 07:54:41.187017 13234 catalog_manager.cc:5415] Ignoring report from unknown tablet c3b35ea656db4741a02e6746e1b049ec
I20250830 07:54:41.187537 13234 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_14aee7781209444194ef305d8eab1ef1" } new_table_name: "default.Table_7d9f9b1fda5b4fc183fa2b56c3b6642f" modify_external_catalogs: true
I20250830 07:54:41.190608 13886 tablet_bootstrap.cc:492] T 6dda55ec2da34c8aba9f39a63e144a7c P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:54:41.195050 14567 raft_consensus.cc:491] T 4d4b00bdadb24ec892d87c9be2ed7dd9 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:41.195173 14567 raft_consensus.cc:513] T 4d4b00bdadb24ec892d87c9be2ed7dd9 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:41.195757 14567 leader_election.cc:290] T 4d4b00bdadb24ec892d87c9be2ed7dd9 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967)
I20250830 07:54:41.195897 14492 raft_consensus.cc:491] T 04c9d954106a4417a34ff80bc98e2ce8 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:41.196132 14492 raft_consensus.cc:513] T 04c9d954106a4417a34ff80bc98e2ce8 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:41.196755 14492 leader_election.cc:290] T 04c9d954106a4417a34ff80bc98e2ce8 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
W20250830 07:54:41.197306 13703 leader_election.cc:343] T 4d4b00bdadb24ec892d87c9be2ed7dd9 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Not found: Tablet not found: 4d4b00bdadb24ec892d87c9be2ed7dd9
I20250830 07:54:41.197278 13629 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "04c9d954106a4417a34ff80bc98e2ce8" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:41.197626 13771 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "04c9d954106a4417a34ff80bc98e2ce8" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
W20250830 07:54:41.197656 13423 leader_election.cc:343] T 04c9d954106a4417a34ff80bc98e2ce8 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
W20250830 07:54:41.198071 13422 leader_election.cc:343] T 04c9d954106a4417a34ff80bc98e2ce8 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:41.198230 13422 leader_election.cc:304] T 04c9d954106a4417a34ff80bc98e2ce8 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba; no voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:54:41.199448 14492 raft_consensus.cc:2747] T 04c9d954106a4417a34ff80bc98e2ce8 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20250830 07:54:41.200450 13701 leader_election.cc:343] T 4d4b00bdadb24ec892d87c9be2ed7dd9 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): Not found: Tablet not found: 4d4b00bdadb24ec892d87c9be2ed7dd9
I20250830 07:54:41.200587 13701 leader_election.cc:304] T 4d4b00bdadb24ec892d87c9be2ed7dd9 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 2065c332f15a4739899af79f3669c3ba, 6b5e454d98894637b466ea27f1b647f9
I20250830 07:54:41.201015 14567 raft_consensus.cc:2747] T 4d4b00bdadb24ec892d87c9be2ed7dd9 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20250830 07:54:41.213761 13225 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet e7e9d2e9b1ca4ddfb0c6a7bced613c35 has no consensus state
I20250830 07:54:41.213837 13886 tablet_bootstrap.cc:654] T 6dda55ec2da34c8aba9f39a63e144a7c P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
W20250830 07:54:41.215665 13225 catalog_manager.cc:5415] Ignoring report from unknown tablet afb132e8a5b14a029e005e375f276348
W20250830 07:54:41.215799 13225 catalog_manager.cc:5415] Ignoring report from unknown tablet f398e12cd9f543738d5163354f8a9d9d
W20250830 07:54:41.215857 13225 catalog_manager.cc:5415] Ignoring report from unknown tablet 91ab8c468c8143b9ae11b839a95a26fd
W20250830 07:54:41.215906 13225 catalog_manager.cc:5415] Ignoring report from unknown tablet bee1b5f6f04740dba64cdcb094e26113
W20250830 07:54:41.215962 13225 catalog_manager.cc:5415] Ignoring report from unknown tablet 27da527d9fe045ae8c17f193d034f5ac
I20250830 07:54:41.217535 13755 tablet_service.cc:1515] Processing DeleteTablet for tablet ad3c81a3f8df466fb71472e756c77305 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:40 UTC) from {username='slave'} at 127.0.0.1:45460
I20250830 07:54:41.217830 14505 tablet_replica.cc:331] T ad3c81a3f8df466fb71472e756c77305 P 9b057ade5dce45af9f8bf0bedf8b917f: stopping tablet replica
I20250830 07:54:41.218092 14505 raft_consensus.cc:2241] T ad3c81a3f8df466fb71472e756c77305 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Raft consensus shutting down.
I20250830 07:54:41.218277 14505 raft_consensus.cc:2270] T ad3c81a3f8df466fb71472e756c77305 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Raft consensus is shut down!
I20250830 07:54:41.220494 14505 ts_tablet_manager.cc:1905] T ad3c81a3f8df466fb71472e756c77305 P 9b057ade5dce45af9f8bf0bedf8b917f: Deleting tablet data with delete state TABLET_DATA_DELETED
W20250830 07:54:41.221594 13225 catalog_manager.cc:5415] Ignoring report from unknown tablet afb132e8a5b14a029e005e375f276348
W20250830 07:54:41.225178 13226 catalog_manager.cc:5415] Ignoring report from unknown tablet e4c5eedb7f4d4397b19b8a3e0ddf9458
W20250830 07:54:41.225328 13226 catalog_manager.cc:5415] Ignoring report from unknown tablet c3b35ea656db4741a02e6746e1b049ec
W20250830 07:54:41.225378 13226 catalog_manager.cc:5415] Ignoring report from unknown tablet afb132e8a5b14a029e005e375f276348
I20250830 07:54:41.225785 13226 master_service.cc:948] ReplaceTablet: received request to replace tablet cb3c48982add45379c0e1b117ec40c1a from {username='slave'} at 127.0.0.1:42126
I20250830 07:54:41.226258 13226 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_accd635a5d39461a8ecd9d947700d768"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:41.226861 13226 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_accd635a5d39461a8ecd9d947700d768 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:41.231164 13886 tablet_bootstrap.cc:492] T 6dda55ec2da34c8aba9f39a63e144a7c P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:54:41.231357 13886 ts_tablet_manager.cc:1397] T 6dda55ec2da34c8aba9f39a63e144a7c P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.041s user 0.001s sys 0.004s
I20250830 07:54:41.234599 13225 catalog_manager.cc:5674] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325) does not have the latest schema for tablet 14ed24577c8f49f49c83242a26877614 (table default.Table_4428c29c8358411282f00fd33a6badd4 [id=bcee72f9b1c6407f98435a1494b42407]). Expected version 1 got 0
I20250830 07:54:41.235519 13886 raft_consensus.cc:357] T 6dda55ec2da34c8aba9f39a63e144a7c P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:41.235810 13886 raft_consensus.cc:383] T 6dda55ec2da34c8aba9f39a63e144a7c P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:41.235913 13886 raft_consensus.cc:738] T 6dda55ec2da34c8aba9f39a63e144a7c P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:54:41.236223 14505 ts_tablet_manager.cc:1918] T ad3c81a3f8df466fb71472e756c77305 P 9b057ade5dce45af9f8bf0bedf8b917f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250830 07:54:41.236121 13225 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_cff60520ee6942269d4b80f84cf356c1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:41.236603 13225 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_cff60520ee6942269d4b80f84cf356c1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:41.237774 14505 log.cc:1199] T ad3c81a3f8df466fb71472e756c77305 P 9b057ade5dce45af9f8bf0bedf8b917f: Deleting WAL directory at /tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/ts-2/wal/wals/ad3c81a3f8df466fb71472e756c77305
I20250830 07:54:41.237771 13886 consensus_queue.cc:260] T 6dda55ec2da34c8aba9f39a63e144a7c P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:41.242378 13882 tablet_bootstrap.cc:492] T ad3c81a3f8df466fb71472e756c77305 P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:54:41.242527 13882 ts_tablet_manager.cc:1397] T ad3c81a3f8df466fb71472e756c77305 P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.070s user 0.003s sys 0.000s
I20250830 07:54:41.243314 13882 raft_consensus.cc:357] T ad3c81a3f8df466fb71472e756c77305 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:41.243512 13882 raft_consensus.cc:383] T ad3c81a3f8df466fb71472e756c77305 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:41.243615 13882 raft_consensus.cc:738] T ad3c81a3f8df466fb71472e756c77305 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
W20250830 07:54:41.260356 13228 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d7afb311a699495aa8376db6ab206d94 has no consensus state
W20250830 07:54:41.262218 13228 catalog_manager.cc:5415] Ignoring report from unknown tablet 27da527d9fe045ae8c17f193d034f5ac
W20250830 07:54:41.262302 13228 catalog_manager.cc:5415] Ignoring report from unknown tablet 853503f3f98a49219b077af980180400
W20250830 07:54:41.262409 13228 catalog_manager.cc:5415] Ignoring report from unknown tablet d1ae3812d72b419798736328da64b53c
W20250830 07:54:41.262501 13228 catalog_manager.cc:5415] Ignoring report from unknown tablet c3b35ea656db4741a02e6746e1b049ec
I20250830 07:54:41.262869 13228 catalog_manager.cc:5674] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967) does not have the latest schema for tablet dbe542c478874482b078296a7a0e9ec9 (table default.Table_54bd02c58de341ec93ced1d662a7e671 [id=b80ba51884ef4042818f8def0b0ebf0e]). Expected version 2 got 0
I20250830 07:54:41.238621 14505 ts_tablet_manager.cc:1939] T ad3c81a3f8df466fb71472e756c77305 P 9b057ade5dce45af9f8bf0bedf8b917f: Deleting consensus metadata
I20250830 07:54:41.272069 13886 ts_tablet_manager.cc:1428] T 6dda55ec2da34c8aba9f39a63e144a7c P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.041s user 0.003s sys 0.000s
I20250830 07:54:41.250571 14567 raft_consensus.cc:491] T b38c8d003413428dae9e47f58e197c2c P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:41.272800 14567 raft_consensus.cc:513] T b38c8d003413428dae9e47f58e197c2c P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:41.273139 13219 catalog_manager.cc:4928] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): tablet ad3c81a3f8df466fb71472e756c77305 (table default.Table_ebee83f51b6446a8afbf7c1f94b926a2 [id=2693b8974d444e21b284d246f53eca65]) successfully deleted
I20250830 07:54:41.273429 14567 leader_election.cc:290] T b38c8d003413428dae9e47f58e197c2c P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
I20250830 07:54:41.273645 13882 consensus_queue.cc:260] T ad3c81a3f8df466fb71472e756c77305 P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:41.274207 13882 ts_tablet_manager.cc:1428] T ad3c81a3f8df466fb71472e756c77305 P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.032s user 0.002s sys 0.000s
I20250830 07:54:41.274160 13488 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "b38c8d003413428dae9e47f58e197c2c" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:54:41.274479 13882 tablet_bootstrap.cc:492] T 04c9d954106a4417a34ff80bc98e2ce8 P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:54:41.274791 13627 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "b38c8d003413428dae9e47f58e197c2c" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
W20250830 07:54:41.274837 13701 leader_election.cc:343] T b38c8d003413428dae9e47f58e197c2c P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): Illegal state: must be running to vote when last-logged opid is not known
W20250830 07:54:41.275290 13703 leader_election.cc:343] T b38c8d003413428dae9e47f58e197c2c P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:41.275418 13703 leader_election.cc:304] T b38c8d003413428dae9e47f58e197c2c P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 2065c332f15a4739899af79f3669c3ba, 6b5e454d98894637b466ea27f1b647f9
I20250830 07:54:41.275794 14567 raft_consensus.cc:2747] T b38c8d003413428dae9e47f58e197c2c P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:54:41.276090 13882 tablet_bootstrap.cc:654] T 04c9d954106a4417a34ff80bc98e2ce8 P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:41.281436 13887 tablet_bootstrap.cc:492] T 30c2558c28944ff39d1a4a4ca9ac604e P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:54:41.281672 13887 ts_tablet_manager.cc:1397] T 30c2558c28944ff39d1a4a4ca9ac604e P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.141s user 0.014s sys 0.015s
I20250830 07:54:41.284016 13887 raft_consensus.cc:357] T 30c2558c28944ff39d1a4a4ca9ac604e P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:41.284319 13887 raft_consensus.cc:383] T 30c2558c28944ff39d1a4a4ca9ac604e P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:41.284456 13887 raft_consensus.cc:738] T 30c2558c28944ff39d1a4a4ca9ac604e P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:54:41.285127 13230 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet d0238794efb14150af6138b0d8bd80ec
I20250830 07:54:41.285141 13887 consensus_queue.cc:260] T 30c2558c28944ff39d1a4a4ca9ac604e P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:41.286463 13755 tablet_service.cc:1515] Processing DeleteTablet for tablet d0238794efb14150af6138b0d8bd80ec with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:41 UTC) from {username='slave'} at 127.0.0.1:45460
I20250830 07:54:41.286698 14505 tablet_replica.cc:331] T d0238794efb14150af6138b0d8bd80ec P 9b057ade5dce45af9f8bf0bedf8b917f: stopping tablet replica
W20250830 07:54:41.286804 13233 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 4b9d9d4b65964fd49d8e25092a14d774 has no consensus state
I20250830 07:54:41.286875 14505 raft_consensus.cc:2241] T d0238794efb14150af6138b0d8bd80ec P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Raft consensus shutting down.
I20250830 07:54:41.287118 14505 raft_consensus.cc:2270] T d0238794efb14150af6138b0d8bd80ec P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Raft consensus is shut down!
I20250830 07:54:41.287649 14505 ts_tablet_manager.cc:1905] T d0238794efb14150af6138b0d8bd80ec P 9b057ade5dce45af9f8bf0bedf8b917f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250830 07:54:41.288271 13462 tablet_service.cc:1515] Processing DeleteTablet for tablet d0238794efb14150af6138b0d8bd80ec with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:41 UTC) from {username='slave'} at 127.0.0.1:37956
I20250830 07:54:41.288851 13883 tablet_replica.cc:331] T d0238794efb14150af6138b0d8bd80ec P 2065c332f15a4739899af79f3669c3ba: stopping tablet replica
I20250830 07:54:41.289070 13883 raft_consensus.cc:2241] T d0238794efb14150af6138b0d8bd80ec P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Raft consensus shutting down.
I20250830 07:54:41.289321 13883 raft_consensus.cc:2270] T d0238794efb14150af6138b0d8bd80ec P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20250830 07:54:41.289402 13606 tablet_service.cc:1515] Processing DeleteTablet for tablet d0238794efb14150af6138b0d8bd80ec with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:41 UTC) from {username='slave'} at 127.0.0.1:45306
I20250830 07:54:41.289659 14497 tablet_replica.cc:331] T d0238794efb14150af6138b0d8bd80ec P 6b5e454d98894637b466ea27f1b647f9: stopping tablet replica
I20250830 07:54:41.289824 13883 ts_tablet_manager.cc:1905] T d0238794efb14150af6138b0d8bd80ec P 2065c332f15a4739899af79f3669c3ba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250830 07:54:41.289839 14497 raft_consensus.cc:2241] T d0238794efb14150af6138b0d8bd80ec P 6b5e454d98894637b466ea27f1b647f9 [term 1 LEADER]: Raft consensus shutting down.
I20250830 07:54:41.290144 14497 raft_consensus.cc:2270] T d0238794efb14150af6138b0d8bd80ec P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250830 07:54:41.290644 14497 ts_tablet_manager.cc:1905] T d0238794efb14150af6138b0d8bd80ec P 6b5e454d98894637b466ea27f1b647f9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250830 07:54:41.291359 13228 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_5fc8290ebbd341c787c0eb26490c0236"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:41.292490 13228 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5fc8290ebbd341c787c0eb26490c0236 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:41.296525 13883 ts_tablet_manager.cc:1918] T d0238794efb14150af6138b0d8bd80ec P 2065c332f15a4739899af79f3669c3ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20250830 07:54:41.296669 13883 log.cc:1199] T d0238794efb14150af6138b0d8bd80ec P 2065c332f15a4739899af79f3669c3ba: Deleting WAL directory at /tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/ts-0/wal/wals/d0238794efb14150af6138b0d8bd80ec
I20250830 07:54:41.297104 13883 ts_tablet_manager.cc:1939] T d0238794efb14150af6138b0d8bd80ec P 2065c332f15a4739899af79f3669c3ba: Deleting consensus metadata
I20250830 07:54:41.297297 14505 ts_tablet_manager.cc:1918] T d0238794efb14150af6138b0d8bd80ec P 9b057ade5dce45af9f8bf0bedf8b917f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20250830 07:54:41.297437 14505 log.cc:1199] T d0238794efb14150af6138b0d8bd80ec P 9b057ade5dce45af9f8bf0bedf8b917f: Deleting WAL directory at /tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/ts-2/wal/wals/d0238794efb14150af6138b0d8bd80ec
I20250830 07:54:41.298110 13218 catalog_manager.cc:4928] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): tablet d0238794efb14150af6138b0d8bd80ec (table default.Table_9d44727222db4c239a8c0e2c980d03e8 [id=8628f6e9686d43b6aa84cd3202db8e80]) successfully deleted
I20250830 07:54:41.298169 14497 ts_tablet_manager.cc:1918] T d0238794efb14150af6138b0d8bd80ec P 6b5e454d98894637b466ea27f1b647f9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20250830 07:54:41.298255 13887 ts_tablet_manager.cc:1428] T 30c2558c28944ff39d1a4a4ca9ac604e P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.016s user 0.001s sys 0.001s
I20250830 07:54:41.298290 14497 log.cc:1199] T d0238794efb14150af6138b0d8bd80ec P 6b5e454d98894637b466ea27f1b647f9: Deleting WAL directory at /tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/ts-1/wal/wals/d0238794efb14150af6138b0d8bd80ec
I20250830 07:54:41.298586 13887 tablet_bootstrap.cc:492] T ada52626bbc94105a8b9428b0bbdfb5e P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:54:41.298710 14497 ts_tablet_manager.cc:1939] T d0238794efb14150af6138b0d8bd80ec P 6b5e454d98894637b466ea27f1b647f9: Deleting consensus metadata
I20250830 07:54:41.299328 13220 catalog_manager.cc:4928] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): tablet d0238794efb14150af6138b0d8bd80ec (table default.Table_9d44727222db4c239a8c0e2c980d03e8 [id=8628f6e9686d43b6aa84cd3202db8e80]) successfully deleted
I20250830 07:54:41.299800 13886 tablet_bootstrap.cc:492] T 04c9d954106a4417a34ff80bc98e2ce8 P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:54:41.308109 13231 catalog_manager.cc:5864] Not sending DeleteTablet requests; no consensus state for tablet 2379dbd410c74540847c6ec4ea5d7b80
I20250830 07:54:41.311363 13227 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet d1153d8cd2994377ac0dcbfeeda1fd52
I20250830 07:54:41.311614 13887 tablet_bootstrap.cc:654] T ada52626bbc94105a8b9428b0bbdfb5e P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:41.312062 13227 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_c6ae99ff685c419c85e78e738f8a077e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:41.312634 13227 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c6ae99ff685c419c85e78e738f8a077e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:41.314321 13606 tablet_service.cc:1515] Processing DeleteTablet for tablet d1153d8cd2994377ac0dcbfeeda1fd52 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:41 UTC) from {username='slave'} at 127.0.0.1:45306
I20250830 07:54:41.314970 13462 tablet_service.cc:1515] Processing DeleteTablet for tablet d1153d8cd2994377ac0dcbfeeda1fd52 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:41 UTC) from {username='slave'} at 127.0.0.1:37956
W20250830 07:54:41.315841 13231 catalog_manager.cc:5415] Ignoring report from unknown tablet 30c2558c28944ff39d1a4a4ca9ac604e
I20250830 07:54:41.316221 13231 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_80adb7e372ef4a98bd60fe6337d06400" } modify_external_catalogs: true
I20250830 07:54:41.316363 13231 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_80adb7e372ef4a98bd60fe6337d06400" } modify_external_catalogs: true
I20250830 07:54:41.316435 13882 tablet_bootstrap.cc:492] T 04c9d954106a4417a34ff80bc98e2ce8 P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:54:41.316593 13882 ts_tablet_manager.cc:1397] T 04c9d954106a4417a34ff80bc98e2ce8 P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.042s user 0.003s sys 0.000s
I20250830 07:54:41.317399 13882 raft_consensus.cc:357] T 04c9d954106a4417a34ff80bc98e2ce8 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:41.317600 13882 raft_consensus.cc:383] T 04c9d954106a4417a34ff80bc98e2ce8 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:41.317670 13882 raft_consensus.cc:738] T 04c9d954106a4417a34ff80bc98e2ce8 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:54:41.317734 13229 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_eb8932f465204a54be74e9f5a9e2d130" } new_table_name: "default.Table_d2e35b9bab8b4f559b34fe632e69f973" modify_external_catalogs: true
W20250830 07:54:41.319134 13218 catalog_manager.cc:4908] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): delete failed for tablet d1153d8cd2994377ac0dcbfeeda1fd52 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d1153d8cd2994377ac0dcbfeeda1fd52 already in progress: creating tablet
W20250830 07:54:41.320858 13233 catalog_manager.cc:5415] Ignoring report from unknown tablet 6dda55ec2da34c8aba9f39a63e144a7c
W20250830 07:54:41.324653 13230 catalog_manager.cc:5415] Ignoring report from unknown tablet afb132e8a5b14a029e005e375f276348
W20250830 07:54:41.325006 13230 catalog_manager.cc:5415] Ignoring report from unknown tablet 6dda55ec2da34c8aba9f39a63e144a7c
W20250830 07:54:41.325151 13230 catalog_manager.cc:5415] Ignoring report from unknown tablet 27da527d9fe045ae8c17f193d034f5ac
W20250830 07:54:41.325260 13230 catalog_manager.cc:5415] Ignoring report from unknown tablet c3b35ea656db4741a02e6746e1b049ec
W20250830 07:54:41.328997 13230 catalog_manager.cc:5415] Ignoring report from unknown tablet 30c2558c28944ff39d1a4a4ca9ac604e
I20250830 07:54:41.329654 13230 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_bb4930ea8d0c4023a4492cfe51d6ed2e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:41.330582 13230 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bb4930ea8d0c4023a4492cfe51d6ed2e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:41.330099 13233 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_069a84d6c4a74ddaa7d7ea9c964da0db"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:41.330981 13233 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_069a84d6c4a74ddaa7d7ea9c964da0db in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250830 07:54:41.332532 13220 catalog_manager.cc:4908] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet d1153d8cd2994377ac0dcbfeeda1fd52 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d1153d8cd2994377ac0dcbfeeda1fd52 already in progress: creating tablet
I20250830 07:54:41.335566 13232 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet db4077bf8e184ac5809ef629222f2cc5
I20250830 07:54:41.338022 13606 tablet_service.cc:1515] Processing DeleteTablet for tablet db4077bf8e184ac5809ef629222f2cc5 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:41 UTC) from {username='slave'} at 127.0.0.1:45306
I20250830 07:54:41.338521 13232 master_service.cc:948] ReplaceTablet: received request to replace tablet ea8ccd7ef791471291bca049bdf7f643 from {username='slave'} at 127.0.0.1:42126
I20250830 07:54:41.339488 13606 tablet_service.cc:1515] Processing DeleteTablet for tablet ad3c81a3f8df466fb71472e756c77305 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:40 UTC) from {username='slave'} at 127.0.0.1:45306
W20250830 07:54:41.339625 13220 catalog_manager.cc:4908] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet db4077bf8e184ac5809ef629222f2cc5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet db4077bf8e184ac5809ef629222f2cc5 already in progress: creating tablet
I20250830 07:54:41.339795 14497 tablet_replica.cc:331] T ad3c81a3f8df466fb71472e756c77305 P 6b5e454d98894637b466ea27f1b647f9: stopping tablet replica
I20250830 07:54:41.340057 14497 raft_consensus.cc:2241] T ad3c81a3f8df466fb71472e756c77305 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250830 07:54:41.340186 13462 tablet_service.cc:1515] Processing DeleteTablet for tablet db4077bf8e184ac5809ef629222f2cc5 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:41 UTC) from {username='slave'} at 127.0.0.1:37956
I20250830 07:54:41.340333 14497 raft_consensus.cc:2270] T ad3c81a3f8df466fb71472e756c77305 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Raft consensus is shut down!
W20250830 07:54:41.340790 13218 catalog_manager.cc:4908] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): delete failed for tablet db4077bf8e184ac5809ef629222f2cc5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet db4077bf8e184ac5809ef629222f2cc5 already in progress: creating tablet
I20250830 07:54:41.341905 13887 tablet_bootstrap.cc:492] T ada52626bbc94105a8b9428b0bbdfb5e P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:54:41.342039 13887 ts_tablet_manager.cc:1397] T ada52626bbc94105a8b9428b0bbdfb5e P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.044s user 0.003s sys 0.000s
I20250830 07:54:41.344367 13887 raft_consensus.cc:357] T ada52626bbc94105a8b9428b0bbdfb5e P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:41.344539 13887 raft_consensus.cc:383] T ada52626bbc94105a8b9428b0bbdfb5e P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:41.344627 13887 raft_consensus.cc:738] T ada52626bbc94105a8b9428b0bbdfb5e P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:54:41.344830 13887 consensus_queue.cc:260] T ada52626bbc94105a8b9428b0bbdfb5e P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:41.345160 13739 tablet_service.cc:1515] Processing DeleteTablet for tablet db4077bf8e184ac5809ef629222f2cc5 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:41 UTC) from {username='slave'} at 127.0.0.1:45460
I20250830 07:54:41.346714 13755 tablet_service.cc:1515] Processing DeleteTablet for tablet d1153d8cd2994377ac0dcbfeeda1fd52 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:41 UTC) from {username='slave'} at 127.0.0.1:45460
I20250830 07:54:41.349087 13887 ts_tablet_manager.cc:1428] T ada52626bbc94105a8b9428b0bbdfb5e P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.007s user 0.002s sys 0.000s
I20250830 07:54:41.349669 13887 tablet_bootstrap.cc:492] T ad3c81a3f8df466fb71472e756c77305 P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:54:41.349704 14505 ts_tablet_manager.cc:1939] T d0238794efb14150af6138b0d8bd80ec P 9b057ade5dce45af9f8bf0bedf8b917f: Deleting consensus metadata
I20250830 07:54:41.349799 13886 tablet_bootstrap.cc:654] T 04c9d954106a4417a34ff80bc98e2ce8 P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:41.350433 13882 consensus_queue.cc:260] T 04c9d954106a4417a34ff80bc98e2ce8 P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:41.351491 13887 tablet_bootstrap.cc:654] T ad3c81a3f8df466fb71472e756c77305 P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:41.354280 13219 catalog_manager.cc:4928] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): tablet d0238794efb14150af6138b0d8bd80ec (table default.Table_9d44727222db4c239a8c0e2c980d03e8 [id=8628f6e9686d43b6aa84cd3202db8e80]) successfully deleted
I20250830 07:54:41.354411 14497 ts_tablet_manager.cc:1905] T ad3c81a3f8df466fb71472e756c77305 P 6b5e454d98894637b466ea27f1b647f9: Deleting tablet data with delete state TABLET_DATA_DELETED
W20250830 07:54:41.354534 13219 catalog_manager.cc:4908] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): delete failed for tablet db4077bf8e184ac5809ef629222f2cc5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet db4077bf8e184ac5809ef629222f2cc5 already in progress: creating tablet
W20250830 07:54:41.354769 13219 catalog_manager.cc:4908] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): delete failed for tablet d1153d8cd2994377ac0dcbfeeda1fd52 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d1153d8cd2994377ac0dcbfeeda1fd52 already in progress: creating tablet
I20250830 07:54:41.355031 14492 raft_consensus.cc:491] T 66499e87e3d7422ca7a449cc2e89e709 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:41.355165 14492 raft_consensus.cc:513] T 66499e87e3d7422ca7a449cc2e89e709 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:41.355729 14492 leader_election.cc:290] T 66499e87e3d7422ca7a449cc2e89e709 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:41.356541 13770 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "66499e87e3d7422ca7a449cc2e89e709" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:41.356740 13770 raft_consensus.cc:2466] T 66499e87e3d7422ca7a449cc2e89e709 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2065c332f15a4739899af79f3669c3ba in term 0.
I20250830 07:54:41.357285 13422 leader_election.cc:304] T 66499e87e3d7422ca7a449cc2e89e709 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters:
I20250830 07:54:41.357762 14502 raft_consensus.cc:2802] T 66499e87e3d7422ca7a449cc2e89e709 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:54:41.357854 14502 raft_consensus.cc:491] T 66499e87e3d7422ca7a449cc2e89e709 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:54:41.357923 14502 raft_consensus.cc:3058] T 66499e87e3d7422ca7a449cc2e89e709 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:41.359500 13626 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "66499e87e3d7422ca7a449cc2e89e709" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
W20250830 07:54:41.360258 13423 leader_election.cc:343] T 66499e87e3d7422ca7a449cc2e89e709 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
W20250830 07:54:41.360309 13234 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f1fe024f0de048a5a0931ee38752d5a1 consensus state has no leader
I20250830 07:54:41.362290 14502 raft_consensus.cc:513] T 66499e87e3d7422ca7a449cc2e89e709 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:41.362984 14502 leader_election.cc:290] T 66499e87e3d7422ca7a449cc2e89e709 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 election: Requested vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:41.364607 13770 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "66499e87e3d7422ca7a449cc2e89e709" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f"
I20250830 07:54:41.364832 13770 raft_consensus.cc:3058] T 66499e87e3d7422ca7a449cc2e89e709 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:41.367597 13627 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "66499e87e3d7422ca7a449cc2e89e709" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9"
W20250830 07:54:41.368086 13423 leader_election.cc:343] T 66499e87e3d7422ca7a449cc2e89e709 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:41.368899 13770 raft_consensus.cc:2466] T 66499e87e3d7422ca7a449cc2e89e709 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2065c332f15a4739899af79f3669c3ba in term 1.
I20250830 07:54:41.369302 13422 leader_election.cc:304] T 66499e87e3d7422ca7a449cc2e89e709 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:54:41.369737 14502 raft_consensus.cc:2802] T 66499e87e3d7422ca7a449cc2e89e709 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election won for term 1
I20250830 07:54:41.369957 14502 raft_consensus.cc:695] T 66499e87e3d7422ca7a449cc2e89e709 P 2065c332f15a4739899af79f3669c3ba [term 1 LEADER]: Becoming Leader. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Running, Role: LEADER
I20250830 07:54:41.370258 14502 consensus_queue.cc:237] T 66499e87e3d7422ca7a449cc2e89e709 P 2065c332f15a4739899af79f3669c3ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:41.372328 14567 raft_consensus.cc:491] T 7af74bdde363493f8061eba450ecf4b4 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:41.372452 14567 raft_consensus.cc:513] T 7af74bdde363493f8061eba450ecf4b4 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:41.372992 14567 leader_election.cc:290] T 7af74bdde363493f8061eba450ecf4b4 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
I20250830 07:54:41.373366 13627 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "7af74bdde363493f8061eba450ecf4b4" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:41.373581 13485 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "7af74bdde363493f8061eba450ecf4b4" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
W20250830 07:54:41.374019 13701 leader_election.cc:343] T 7af74bdde363493f8061eba450ecf4b4 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): Illegal state: must be running to vote when last-logged opid is not known
W20250830 07:54:41.374179 13703 leader_election.cc:343] T 7af74bdde363493f8061eba450ecf4b4 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:41.374300 13703 leader_election.cc:304] T 7af74bdde363493f8061eba450ecf4b4 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 2065c332f15a4739899af79f3669c3ba, 6b5e454d98894637b466ea27f1b647f9
I20250830 07:54:41.374622 14567 raft_consensus.cc:2747] T 7af74bdde363493f8061eba450ecf4b4 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:54:41.382989 13882 ts_tablet_manager.cc:1428] T 04c9d954106a4417a34ff80bc98e2ce8 P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.066s user 0.003s sys 0.000s
I20250830 07:54:41.383298 13882 tablet_bootstrap.cc:492] T 2be43f828f204f599017b6a04cf2ddf9 P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:54:41.393002 13882 tablet_bootstrap.cc:654] T 2be43f828f204f599017b6a04cf2ddf9 P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:41.395285 13887 tablet_bootstrap.cc:492] T ad3c81a3f8df466fb71472e756c77305 P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:54:41.395440 13887 ts_tablet_manager.cc:1397] T ad3c81a3f8df466fb71472e756c77305 P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.046s user 0.005s sys 0.000s
I20250830 07:54:41.396222 13887 raft_consensus.cc:357] T ad3c81a3f8df466fb71472e756c77305 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:41.396409 13887 raft_consensus.cc:383] T ad3c81a3f8df466fb71472e756c77305 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:41.396485 13887 raft_consensus.cc:738] T ad3c81a3f8df466fb71472e756c77305 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
W20250830 07:54:41.406597 13234 catalog_manager.cc:5415] Ignoring report from unknown tablet 861809cc50764aa89140e587489e2d88
W20250830 07:54:41.406713 13234 catalog_manager.cc:5415] Ignoring report from unknown tablet ff0f9cccc8ed43b1a8cd38de0e9d4097
W20250830 07:54:41.406761 13234 catalog_manager.cc:5415] Ignoring report from unknown tablet 6dda55ec2da34c8aba9f39a63e144a7c
I20250830 07:54:41.407209 13234 master_service.cc:948] ReplaceTablet: received request to replace tablet ca959e42c8764eeba0faee96caf8b39f from {username='slave'} at 127.0.0.1:42126
I20250830 07:54:41.407742 13234 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_03d5ae4a6e604180be10c3a025359f5b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:41.408298 13234 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_03d5ae4a6e604180be10c3a025359f5b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:41.408667 13225 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_1baaad25c30a45fa8d70fd9fafe5fc89"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:41.409174 13225 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1baaad25c30a45fa8d70fd9fafe5fc89 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:41.410723 13231 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet 8ae468b43b4c450ca7591b543c2539d9
I20250830 07:54:41.411871 13462 tablet_service.cc:1515] Processing DeleteTablet for tablet 8ae468b43b4c450ca7591b543c2539d9 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:41 UTC) from {username='slave'} at 127.0.0.1:37956
I20250830 07:54:41.412586 13606 tablet_service.cc:1515] Processing DeleteTablet for tablet 8ae468b43b4c450ca7591b543c2539d9 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:41 UTC) from {username='slave'} at 127.0.0.1:45306
I20250830 07:54:41.412923 13755 tablet_service.cc:1515] Processing DeleteTablet for tablet 8ae468b43b4c450ca7591b543c2539d9 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:41 UTC) from {username='slave'} at 127.0.0.1:45460
W20250830 07:54:41.413089 13218 catalog_manager.cc:4908] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): delete failed for tablet 8ae468b43b4c450ca7591b543c2539d9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8ae468b43b4c450ca7591b543c2539d9 already in progress: creating tablet
W20250830 07:54:41.414469 13219 catalog_manager.cc:4908] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): delete failed for tablet 8ae468b43b4c450ca7591b543c2539d9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8ae468b43b4c450ca7591b543c2539d9 already in progress: creating tablet
W20250830 07:54:41.414888 13227 catalog_manager.cc:5415] Ignoring report from unknown tablet 04c9d954106a4417a34ff80bc98e2ce8
W20250830 07:54:41.415357 13229 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet fac764a2d269411c86b85ceeaec0b014 has no consensus state
W20250830 07:54:41.420485 13229 catalog_manager.cc:5415] Ignoring report from unknown tablet 04c9d954106a4417a34ff80bc98e2ce8
I20250830 07:54:41.421741 13231 master_service.cc:948] ReplaceTablet: received request to replace tablet 6f4c400c0e5e43319fa521b5cab694b4 from {username='slave'} at 127.0.0.1:42126
I20250830 07:54:41.423552 13232 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet ea8ccd7ef791471291bca049bdf7f643
I20250830 07:54:41.424046 13232 catalog_manager.cc:6652] ReplaceTablet: tablet ea8ccd7ef791471291bca049bdf7f643 deleted and replaced by tablet 690cf258639a4c1ea5a0ac4f2fd39f88
I20250830 07:54:41.424683 13606 tablet_service.cc:1515] Processing DeleteTablet for tablet ea8ccd7ef791471291bca049bdf7f643 with delete_type TABLET_DATA_DELETED (replaced by tablet 690cf258639a4c1ea5a0ac4f2fd39f88) from {username='slave'} at 127.0.0.1:45306
I20250830 07:54:41.424714 13462 tablet_service.cc:1515] Processing DeleteTablet for tablet ea8ccd7ef791471291bca049bdf7f643 with delete_type TABLET_DATA_DELETED (replaced by tablet 690cf258639a4c1ea5a0ac4f2fd39f88) from {username='slave'} at 127.0.0.1:37956
I20250830 07:54:41.424784 13755 tablet_service.cc:1515] Processing DeleteTablet for tablet ea8ccd7ef791471291bca049bdf7f643 with delete_type TABLET_DATA_DELETED (replaced by tablet 690cf258639a4c1ea5a0ac4f2fd39f88) from {username='slave'} at 127.0.0.1:45460
W20250830 07:54:41.425207 13218 catalog_manager.cc:4908] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): delete failed for tablet ea8ccd7ef791471291bca049bdf7f643 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ea8ccd7ef791471291bca049bdf7f643 already in progress: creating tablet
W20250830 07:54:41.425441 13219 catalog_manager.cc:4908] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): delete failed for tablet ea8ccd7ef791471291bca049bdf7f643 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ea8ccd7ef791471291bca049bdf7f643 already in progress: creating tablet
I20250830 07:54:41.425796 13882 tablet_bootstrap.cc:492] T 2be43f828f204f599017b6a04cf2ddf9 P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:54:41.425927 13882 ts_tablet_manager.cc:1397] T 2be43f828f204f599017b6a04cf2ddf9 P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.043s user 0.004s sys 0.002s
I20250830 07:54:41.426733 13882 raft_consensus.cc:357] T 2be43f828f204f599017b6a04cf2ddf9 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:41.426954 13882 raft_consensus.cc:383] T 2be43f828f204f599017b6a04cf2ddf9 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:41.427060 13882 raft_consensus.cc:738] T 2be43f828f204f599017b6a04cf2ddf9 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:54:41.427436 14492 raft_consensus.cc:491] T ada52626bbc94105a8b9428b0bbdfb5e P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:41.427569 14492 raft_consensus.cc:513] T ada52626bbc94105a8b9428b0bbdfb5e P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:41.428216 14492 leader_election.cc:290] T ada52626bbc94105a8b9428b0bbdfb5e P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:41.428831 13627 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "ada52626bbc94105a8b9428b0bbdfb5e" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:41.429041 13627 raft_consensus.cc:2466] T ada52626bbc94105a8b9428b0bbdfb5e P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2065c332f15a4739899af79f3669c3ba in term 0.
I20250830 07:54:41.429579 13423 leader_election.cc:304] T ada52626bbc94105a8b9428b0bbdfb5e P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 6b5e454d98894637b466ea27f1b647f9; no voters:
I20250830 07:54:41.430325 14492 raft_consensus.cc:2802] T ada52626bbc94105a8b9428b0bbdfb5e P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:54:41.430464 14492 raft_consensus.cc:491] T ada52626bbc94105a8b9428b0bbdfb5e P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:54:41.430559 14492 raft_consensus.cc:3058] T ada52626bbc94105a8b9428b0bbdfb5e P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:41.433108 14492 raft_consensus.cc:513] T ada52626bbc94105a8b9428b0bbdfb5e P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:41.434652 13627 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "ada52626bbc94105a8b9428b0bbdfb5e" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9"
I20250830 07:54:41.434818 13627 raft_consensus.cc:3058] T ada52626bbc94105a8b9428b0bbdfb5e P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:41.438069 13234 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_8f85f386d1e54a59a6e539b06a508623" } new_table_name: "default.Table_0e39abf281604c1792ea7cbac795787e" modify_external_catalogs: true
I20250830 07:54:41.439725 13225 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_74e19ec0844742e8ac529d2291bf2897"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:41.440227 13225 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_74e19ec0844742e8ac529d2291bf2897 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:41.441781 14492 leader_election.cc:290] T ada52626bbc94105a8b9428b0bbdfb5e P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 election: Requested vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:41.441805 13771 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "ada52626bbc94105a8b9428b0bbdfb5e" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f"
I20250830 07:54:41.441907 13627 raft_consensus.cc:2466] T ada52626bbc94105a8b9428b0bbdfb5e P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2065c332f15a4739899af79f3669c3ba in term 1.
I20250830 07:54:41.442014 13771 raft_consensus.cc:3058] T ada52626bbc94105a8b9428b0bbdfb5e P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:41.442102 13770 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "ada52626bbc94105a8b9428b0bbdfb5e" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:41.442265 13423 leader_election.cc:304] T ada52626bbc94105a8b9428b0bbdfb5e P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 6b5e454d98894637b466ea27f1b647f9; no voters:
I20250830 07:54:41.442870 14492 raft_consensus.cc:2802] T ada52626bbc94105a8b9428b0bbdfb5e P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election won for term 1
I20250830 07:54:41.443011 14492 raft_consensus.cc:695] T ada52626bbc94105a8b9428b0bbdfb5e P 2065c332f15a4739899af79f3669c3ba [term 1 LEADER]: Becoming Leader. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Running, Role: LEADER
I20250830 07:54:41.443279 14492 consensus_queue.cc:237] T ada52626bbc94105a8b9428b0bbdfb5e P 2065c332f15a4739899af79f3669c3ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:41.444573 13771 raft_consensus.cc:2466] T ada52626bbc94105a8b9428b0bbdfb5e P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2065c332f15a4739899af79f3669c3ba in term 1.
I20250830 07:54:41.446079 13887 consensus_queue.cc:260] T ad3c81a3f8df466fb71472e756c77305 P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:41.451797 13485 raft_consensus.cc:1273] T cada6410e2884c508bb7dd38bea438ae P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Refusing update from remote peer 9b057ade5dce45af9f8bf0bedf8b917f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250830 07:54:41.452329 14567 consensus_queue.cc:1035] T cada6410e2884c508bb7dd38bea438ae P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:54:41.459036 13882 consensus_queue.cc:260] T 2be43f828f204f599017b6a04cf2ddf9 P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:41.459630 13626 raft_consensus.cc:1273] T cada6410e2884c508bb7dd38bea438ae P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Refusing update from remote peer 9b057ade5dce45af9f8bf0bedf8b917f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250830 07:54:41.460131 13882 ts_tablet_manager.cc:1428] T 2be43f828f204f599017b6a04cf2ddf9 P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.034s user 0.002s sys 0.000s
I20250830 07:54:41.460141 14567 consensus_queue.cc:1035] T cada6410e2884c508bb7dd38bea438ae P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:54:41.460458 13882 tablet_bootstrap.cc:492] T 66499e87e3d7422ca7a449cc2e89e709 P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:54:41.464891 13234 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_5fc8290ebbd341c787c0eb26490c0236" } new_table_name: "default.Table_9f4a5e8a32704592b674c2d22739cf35" modify_external_catalogs: true
I20250830 07:54:41.470468 13225 catalog_manager.cc:5582] T 66499e87e3d7422ca7a449cc2e89e709 P 2065c332f15a4739899af79f3669c3ba reported cstate change: term changed from 0 to 1, leader changed from <none> to 2065c332f15a4739899af79f3669c3ba (127.12.209.1). New cstate: current_term: 1 leader_uuid: "2065c332f15a4739899af79f3669c3ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } health_report { overall_health: UNKNOWN } } }
I20250830 07:54:41.474587 13230 catalog_manager.cc:5674] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967) does not have the latest schema for tablet 2be43f828f204f599017b6a04cf2ddf9 (table default.Table_517ee5a88dc8431fb14bc9f85c62b395 [id=cbd8b881bf8a456d9930d5a6b27ab7d4]). Expected version 2 got 0
I20250830 07:54:41.472312 14497 ts_tablet_manager.cc:1918] T ad3c81a3f8df466fb71472e756c77305 P 6b5e454d98894637b466ea27f1b647f9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250830 07:54:41.479563 14497 log.cc:1199] T ad3c81a3f8df466fb71472e756c77305 P 6b5e454d98894637b466ea27f1b647f9: Deleting WAL directory at /tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/ts-1/wal/wals/ad3c81a3f8df466fb71472e756c77305
I20250830 07:54:41.479832 14567 raft_consensus.cc:491] T 30c2558c28944ff39d1a4a4ca9ac604e P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:41.479962 14567 raft_consensus.cc:513] T 30c2558c28944ff39d1a4a4ca9ac604e P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:41.480576 14567 leader_election.cc:290] T 30c2558c28944ff39d1a4a4ca9ac604e P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
I20250830 07:54:41.481554 13484 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "30c2558c28944ff39d1a4a4ca9ac604e" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:54:41.481773 13484 raft_consensus.cc:2466] T 30c2558c28944ff39d1a4a4ca9ac604e P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 0.
I20250830 07:54:41.482249 13701 leader_election.cc:304] T 30c2558c28944ff39d1a4a4ca9ac604e P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters:
I20250830 07:54:41.482648 14567 raft_consensus.cc:2802] T 30c2558c28944ff39d1a4a4ca9ac604e P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:54:41.482755 14567 raft_consensus.cc:491] T 30c2558c28944ff39d1a4a4ca9ac604e P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:54:41.482832 14567 raft_consensus.cc:3058] T 30c2558c28944ff39d1a4a4ca9ac604e P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:41.485608 14567 raft_consensus.cc:513] T 30c2558c28944ff39d1a4a4ca9ac604e P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:41.487504 14567 leader_election.cc:290] T 30c2558c28944ff39d1a4a4ca9ac604e P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Requested vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
I20250830 07:54:41.488417 14497 ts_tablet_manager.cc:1939] T ad3c81a3f8df466fb71472e756c77305 P 6b5e454d98894637b466ea27f1b647f9: Deleting consensus metadata
I20250830 07:54:41.498118 13886 tablet_bootstrap.cc:492] T 04c9d954106a4417a34ff80bc98e2ce8 P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:54:41.498533 13886 ts_tablet_manager.cc:1397] T 04c9d954106a4417a34ff80bc98e2ce8 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.199s user 0.002s sys 0.010s
I20250830 07:54:41.500214 13886 raft_consensus.cc:357] T 04c9d954106a4417a34ff80bc98e2ce8 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:41.500839 13886 raft_consensus.cc:383] T 04c9d954106a4417a34ff80bc98e2ce8 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:41.501044 13886 raft_consensus.cc:738] T 04c9d954106a4417a34ff80bc98e2ce8 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:54:41.501544 13886 consensus_queue.cc:260] T 04c9d954106a4417a34ff80bc98e2ce8 P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
W20250830 07:54:41.510587 13230 catalog_manager.cc:5415] Ignoring report from unknown tablet 04c9d954106a4417a34ff80bc98e2ce8
I20250830 07:54:41.511334 13886 ts_tablet_manager.cc:1428] T 04c9d954106a4417a34ff80bc98e2ce8 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.012s user 0.001s sys 0.000s
I20250830 07:54:41.511981 13886 tablet_bootstrap.cc:492] T 752727eef0734ff3b7b35b1d5f66aea6 P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:54:41.513689 13886 tablet_bootstrap.cc:654] T 752727eef0734ff3b7b35b1d5f66aea6 P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:41.515098 13232 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_517ee5a88dc8431fb14bc9f85c62b395" } modify_external_catalogs: true
I20250830 07:54:41.515332 13232 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_517ee5a88dc8431fb14bc9f85c62b395" } modify_external_catalogs: true
I20250830 07:54:41.515628 13231 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_5486f1dec4564e6db48bab52a8b297eb" } new_table_name: "default.Table_d978d625ae9f4ac5ad252d8e982685f7" modify_external_catalogs: true
I20250830 07:54:41.515996 13229 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_50694aef0f8f4d3ba65034dc94d0efb4" } modify_external_catalogs: true
I20250830 07:54:41.516131 13229 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_50694aef0f8f4d3ba65034dc94d0efb4" } modify_external_catalogs: true
W20250830 07:54:41.520745 13228 catalog_manager.cc:5415] Ignoring report from unknown tablet ff2267fb411942ff826e2a72bcb89cd7
I20250830 07:54:41.521225 13233 master_service.cc:948] ReplaceTablet: received request to replace tablet 6ccbaf109e36453ea6645dfd090f5a1a from {username='slave'} at 127.0.0.1:42126
W20250830 07:54:41.523753 13234 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 8c01157324ba45bda5b3a9a328bf319b has no consensus state
I20250830 07:54:41.526969 13227 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_a99c09edb9f7481a8eb146367454eece"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:41.527498 13227 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a99c09edb9f7481a8eb146367454eece in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:41.528640 13234 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_be7f4af6142d4aeebbac1b6060ceeb88" } modify_external_catalogs: true
I20250830 07:54:41.528786 13234 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_be7f4af6142d4aeebbac1b6060ceeb88" } modify_external_catalogs: true
I20250830 07:54:41.529841 13887 ts_tablet_manager.cc:1428] T ad3c81a3f8df466fb71472e756c77305 P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.134s user 0.000s sys 0.002s
I20250830 07:54:41.530184 13887 tablet_bootstrap.cc:492] T b38c8d003413428dae9e47f58e197c2c P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:54:41.532013 14497 tablet_replica.cc:331] T ea8ccd7ef791471291bca049bdf7f643 P 6b5e454d98894637b466ea27f1b647f9: stopping tablet replica
I20250830 07:54:41.532202 14497 raft_consensus.cc:2241] T ea8ccd7ef791471291bca049bdf7f643 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250830 07:54:41.532361 14497 raft_consensus.cc:2270] T ea8ccd7ef791471291bca049bdf7f643 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250830 07:54:41.532819 14497 ts_tablet_manager.cc:1905] T ea8ccd7ef791471291bca049bdf7f643 P 6b5e454d98894637b466ea27f1b647f9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250830 07:54:41.533156 13220 catalog_manager.cc:4928] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): tablet ad3c81a3f8df466fb71472e756c77305 (table default.Table_ebee83f51b6446a8afbf7c1f94b926a2 [id=2693b8974d444e21b284d246f53eca65]) successfully deleted
W20250830 07:54:41.533418 13220 catalog_manager.cc:4908] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet 8ae468b43b4c450ca7591b543c2539d9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8ae468b43b4c450ca7591b543c2539d9 already in progress: creating tablet
I20250830 07:54:41.537806 13887 tablet_bootstrap.cc:654] T b38c8d003413428dae9e47f58e197c2c P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:41.518654 14640 tablet.cc:1722] T cada6410e2884c508bb7dd38bea438ae P 9b057ade5dce45af9f8bf0bedf8b917f: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20250830 07:54:41.556138 13488 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "30c2558c28944ff39d1a4a4ca9ac604e" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba"
I20250830 07:54:41.556363 13488 raft_consensus.cc:3058] T 30c2558c28944ff39d1a4a4ca9ac604e P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
W20250830 07:54:41.556701 13226 catalog_manager.cc:5415] Ignoring report from unknown tablet 04c9d954106a4417a34ff80bc98e2ce8
I20250830 07:54:41.557024 13226 catalog_manager.cc:5674] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743) does not have the latest schema for tablet cada6410e2884c508bb7dd38bea438ae (table default.Table_0e39abf281604c1792ea7cbac795787e [id=4678375d8d3d474290ad1a254de14054]). Expected version 3 got 0
I20250830 07:54:41.557621 13226 master_service.cc:948] ReplaceTablet: received request to replace tablet d3f207cee78a43a1b5e030c09752c78c from {username='slave'} at 127.0.0.1:42126
W20250830 07:54:41.560817 13231 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 2d91b0ba74034b85812a13719e21dc6c has no consensus state
I20250830 07:54:41.561883 13233 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet 6ccbaf109e36453ea6645dfd090f5a1a
I20250830 07:54:41.562299 13233 catalog_manager.cc:6652] ReplaceTablet: tablet 6ccbaf109e36453ea6645dfd090f5a1a deleted and replaced by tablet 370441c443be46c2a33132fbc5c41f89
I20250830 07:54:41.562762 13229 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet 04eadf45b82e4c319eb7b316a402d81a
I20250830 07:54:41.564153 13594 tablet_service.cc:1515] Processing DeleteTablet for tablet 04eadf45b82e4c319eb7b316a402d81a with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:41 UTC) from {username='slave'} at 127.0.0.1:45306
I20250830 07:54:41.508143 13629 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "30c2558c28944ff39d1a4a4ca9ac604e" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9"
I20250830 07:54:41.519146 14641 tablet.cc:1722] T cada6410e2884c508bb7dd38bea438ae P 6b5e454d98894637b466ea27f1b647f9: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
W20250830 07:54:41.564810 13703 leader_election.cc:343] T 30c2558c28944ff39d1a4a4ca9ac604e P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:41.527587 13882 tablet_bootstrap.cc:654] T 66499e87e3d7422ca7a449cc2e89e709 P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:41.564150 13606 tablet_service.cc:1515] Processing DeleteTablet for tablet 6ccbaf109e36453ea6645dfd090f5a1a with delete_type TABLET_DATA_DELETED (replaced by tablet 370441c443be46c2a33132fbc5c41f89) from {username='slave'} at 127.0.0.1:45306
I20250830 07:54:41.565639 13229 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_7b399745f2fc4d5190617bafbae2c454" } new_table_name: "default.Table_f8d552f66f96486cb2b5984a52b993ce" modify_external_catalogs: true
I20250830 07:54:41.565670 13225 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_fdf6b173da034defb96d857c29760d5e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:41.566267 13225 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fdf6b173da034defb96d857c29760d5e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:41.567564 13462 tablet_service.cc:1515] Processing DeleteTablet for tablet 6ccbaf109e36453ea6645dfd090f5a1a with delete_type TABLET_DATA_DELETED (replaced by tablet 370441c443be46c2a33132fbc5c41f89) from {username='slave'} at 127.0.0.1:37956
I20250830 07:54:41.567824 13468 tablet_service.cc:1515] Processing DeleteTablet for tablet 04eadf45b82e4c319eb7b316a402d81a with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:41 UTC) from {username='slave'} at 127.0.0.1:37956
I20250830 07:54:41.568446 13755 tablet_service.cc:1515] Processing DeleteTablet for tablet 6ccbaf109e36453ea6645dfd090f5a1a with delete_type TABLET_DATA_DELETED (replaced by tablet 370441c443be46c2a33132fbc5c41f89) from {username='slave'} at 127.0.0.1:45460
I20250830 07:54:41.568609 13739 tablet_service.cc:1515] Processing DeleteTablet for tablet 04eadf45b82e4c319eb7b316a402d81a with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:41 UTC) from {username='slave'} at 127.0.0.1:45460
W20250830 07:54:41.568941 13701 consensus_peers.cc:489] T 1fa571e9490e499792225d7b786e8658 P 9b057ade5dce45af9f8bf0bedf8b917f -> Peer 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): Couldn't send request to peer 2065c332f15a4739899af79f3669c3ba. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1fa571e9490e499792225d7b786e8658. This is attempt 1: this message will repeat every 5th retry.
I20250830 07:54:41.569236 13233 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_0502d3a9e685480c8fd80584b1333d84"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250830 07:54:41.569413 14533 consensus_queue.cc:1035] T b480f5eb03804baeb61cd0424d70faf5 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20250830 07:54:41.569738 13233 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0502d3a9e685480c8fd80584b1333d84 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:41.571105 14533 consensus_queue.cc:1035] T b480f5eb03804baeb61cd0424d70faf5 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:54:41.571146 13228 catalog_manager.cc:5674] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967) does not have the latest schema for tablet cada6410e2884c508bb7dd38bea438ae (table default.Table_0e39abf281604c1792ea7cbac795787e [id=4678375d8d3d474290ad1a254de14054]). Expected version 3 got 0
I20250830 07:54:41.571405 13232 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet 2be43f828f204f599017b6a04cf2ddf9
I20250830 07:54:41.572568 13606 tablet_service.cc:1515] Processing DeleteTablet for tablet 2be43f828f204f599017b6a04cf2ddf9 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:41 UTC) from {username='slave'} at 127.0.0.1:45306
I20250830 07:54:41.573164 13739 tablet_service.cc:1515] Processing DeleteTablet for tablet 2be43f828f204f599017b6a04cf2ddf9 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:41 UTC) from {username='slave'} at 127.0.0.1:45460
I20250830 07:54:41.575631 14497 ts_tablet_manager.cc:1918] T ea8ccd7ef791471291bca049bdf7f643 P 6b5e454d98894637b466ea27f1b647f9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250830 07:54:41.576195 14497 log.cc:1199] T ea8ccd7ef791471291bca049bdf7f643 P 6b5e454d98894637b466ea27f1b647f9: Deleting WAL directory at /tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/ts-1/wal/wals/ea8ccd7ef791471291bca049bdf7f643
W20250830 07:54:41.576969 13218 catalog_manager.cc:4908] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): delete failed for tablet 6ccbaf109e36453ea6645dfd090f5a1a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6ccbaf109e36453ea6645dfd090f5a1a already in progress: creating tablet
I20250830 07:54:41.577178 13230 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_707da4392f44468095ba243aacef5dd9" } modify_external_catalogs: true
W20250830 07:54:41.577256 13218 catalog_manager.cc:4908] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): delete failed for tablet 04eadf45b82e4c319eb7b316a402d81a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 04eadf45b82e4c319eb7b316a402d81a already in progress: creating tablet
I20250830 07:54:41.577304 13468 tablet_service.cc:1515] Processing DeleteTablet for tablet 2be43f828f204f599017b6a04cf2ddf9 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:41 UTC) from {username='slave'} at 127.0.0.1:37956
I20250830 07:54:41.577381 13230 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_707da4392f44468095ba243aacef5dd9" } modify_external_catalogs: true
I20250830 07:54:41.577553 13883 tablet_replica.cc:331] T 2be43f828f204f599017b6a04cf2ddf9 P 2065c332f15a4739899af79f3669c3ba: stopping tablet replica
I20250830 07:54:41.577800 13883 raft_consensus.cc:2241] T 2be43f828f204f599017b6a04cf2ddf9 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Raft consensus shutting down.
I20250830 07:54:41.577950 13883 raft_consensus.cc:2270] T 2be43f828f204f599017b6a04cf2ddf9 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Raft consensus is shut down!
I20250830 07:54:41.578199 14497 ts_tablet_manager.cc:1939] T ea8ccd7ef791471291bca049bdf7f643 P 6b5e454d98894637b466ea27f1b647f9: Deleting consensus metadata
I20250830 07:54:41.578505 13883 ts_tablet_manager.cc:1905] T 2be43f828f204f599017b6a04cf2ddf9 P 2065c332f15a4739899af79f3669c3ba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250830 07:54:41.579315 13220 catalog_manager.cc:4928] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): tablet ea8ccd7ef791471291bca049bdf7f643 (table default.Table_523d7bc660f94c9db577f499e22c772f [id=3582c72cab4b4e1084021b098ec30f87]) successfully deleted
W20250830 07:54:41.582190 13220 catalog_manager.cc:4908] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet 04eadf45b82e4c319eb7b316a402d81a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 04eadf45b82e4c319eb7b316a402d81a already in progress: creating tablet
I20250830 07:54:41.583256 14445 raft_consensus.cc:491] T e4c5eedb7f4d4397b19b8a3e0ddf9458 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:41.583432 14445 raft_consensus.cc:513] T e4c5eedb7f4d4397b19b8a3e0ddf9458 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
W20250830 07:54:41.583547 13220 catalog_manager.cc:4908] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet 6ccbaf109e36453ea6645dfd090f5a1a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6ccbaf109e36453ea6645dfd090f5a1a already in progress: creating tablet
I20250830 07:54:41.584138 14445 leader_election.cc:290] T e4c5eedb7f4d4397b19b8a3e0ddf9458 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:41.584923 14497 tablet_replica.cc:331] T 2be43f828f204f599017b6a04cf2ddf9 P 6b5e454d98894637b466ea27f1b647f9: stopping tablet replica
I20250830 07:54:41.584920 13481 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "e4c5eedb7f4d4397b19b8a3e0ddf9458" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
W20250830 07:54:41.585438 13561 leader_election.cc:343] T e4c5eedb7f4d4397b19b8a3e0ddf9458 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:41.585561 14497 raft_consensus.cc:2241] T 2be43f828f204f599017b6a04cf2ddf9 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250830 07:54:41.586310 14497 raft_consensus.cc:2270] T 2be43f828f204f599017b6a04cf2ddf9 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250830 07:54:41.587049 13770 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "e4c5eedb7f4d4397b19b8a3e0ddf9458" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:41.587291 13770 raft_consensus.cc:2466] T e4c5eedb7f4d4397b19b8a3e0ddf9458 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b5e454d98894637b466ea27f1b647f9 in term 0.
I20250830 07:54:41.587679 13562 leader_election.cc:304] T e4c5eedb7f4d4397b19b8a3e0ddf9458 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 2065c332f15a4739899af79f3669c3ba
I20250830 07:54:41.588419 13234 catalog_manager.cc:5864] Not sending DeleteTablet requests; no consensus state for tablet d23bbd17408f40c3a08fb7987230fd21
I20250830 07:54:41.588624 14497 ts_tablet_manager.cc:1905] T 2be43f828f204f599017b6a04cf2ddf9 P 6b5e454d98894637b466ea27f1b647f9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250830 07:54:41.588922 14445 raft_consensus.cc:2802] T e4c5eedb7f4d4397b19b8a3e0ddf9458 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:54:41.589040 14445 raft_consensus.cc:491] T e4c5eedb7f4d4397b19b8a3e0ddf9458 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:54:41.589161 14445 raft_consensus.cc:3058] T e4c5eedb7f4d4397b19b8a3e0ddf9458 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:41.592849 14445 raft_consensus.cc:513] T e4c5eedb7f4d4397b19b8a3e0ddf9458 P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:41.593866 13481 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "e4c5eedb7f4d4397b19b8a3e0ddf9458" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba"
W20250830 07:54:41.594378 13219 catalog_manager.cc:4908] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): delete failed for tablet 6ccbaf109e36453ea6645dfd090f5a1a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6ccbaf109e36453ea6645dfd090f5a1a already in progress: creating tablet
W20250830 07:54:41.594424 13561 leader_election.cc:343] T e4c5eedb7f4d4397b19b8a3e0ddf9458 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:41.594575 14445 leader_election.cc:290] T e4c5eedb7f4d4397b19b8a3e0ddf9458 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 election: Requested vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
W20250830 07:54:41.594606 13219 catalog_manager.cc:4908] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): delete failed for tablet 04eadf45b82e4c319eb7b316a402d81a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 04eadf45b82e4c319eb7b316a402d81a already in progress: creating tablet
W20250830 07:54:41.594806 13219 catalog_manager.cc:4908] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): delete failed for tablet 2be43f828f204f599017b6a04cf2ddf9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2be43f828f204f599017b6a04cf2ddf9 already in progress: creating tablet
I20250830 07:54:41.595027 13770 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "e4c5eedb7f4d4397b19b8a3e0ddf9458" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f"
I20250830 07:54:41.595228 13770 raft_consensus.cc:3058] T e4c5eedb7f4d4397b19b8a3e0ddf9458 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:41.506542 13627 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "30c2558c28944ff39d1a4a4ca9ac604e" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
W20250830 07:54:41.598170 13703 leader_election.cc:343] T 30c2558c28944ff39d1a4a4ca9ac604e P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:41.604118 13770 raft_consensus.cc:2466] T e4c5eedb7f4d4397b19b8a3e0ddf9458 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b5e454d98894637b466ea27f1b647f9 in term 1.
I20250830 07:54:41.604528 13562 leader_election.cc:304] T e4c5eedb7f4d4397b19b8a3e0ddf9458 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 2065c332f15a4739899af79f3669c3ba
I20250830 07:54:41.605151 14445 raft_consensus.cc:2802] T e4c5eedb7f4d4397b19b8a3e0ddf9458 P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Leader election won for term 1
I20250830 07:54:41.605401 14445 raft_consensus.cc:695] T e4c5eedb7f4d4397b19b8a3e0ddf9458 P 6b5e454d98894637b466ea27f1b647f9 [term 1 LEADER]: Becoming Leader. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Running, Role: LEADER
I20250830 07:54:41.605684 14445 consensus_queue.cc:237] T e4c5eedb7f4d4397b19b8a3e0ddf9458 P 6b5e454d98894637b466ea27f1b647f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:41.605875 13234 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_10777f2bd6954c8688868aced29c2ae0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:41.606413 13234 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_10777f2bd6954c8688868aced29c2ae0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:41.608956 13883 ts_tablet_manager.cc:1918] T 2be43f828f204f599017b6a04cf2ddf9 P 2065c332f15a4739899af79f3669c3ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250830 07:54:41.609158 13883 log.cc:1199] T 2be43f828f204f599017b6a04cf2ddf9 P 2065c332f15a4739899af79f3669c3ba: Deleting WAL directory at /tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/ts-0/wal/wals/2be43f828f204f599017b6a04cf2ddf9
I20250830 07:54:41.609316 14492 raft_consensus.cc:491] T ad3c81a3f8df466fb71472e756c77305 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:41.609521 14492 raft_consensus.cc:513] T ad3c81a3f8df466fb71472e756c77305 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:41.609817 13883 ts_tablet_manager.cc:1939] T 2be43f828f204f599017b6a04cf2ddf9 P 2065c332f15a4739899af79f3669c3ba: Deleting consensus metadata
I20250830 07:54:41.610211 14492 leader_election.cc:290] T ad3c81a3f8df466fb71472e756c77305 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
W20250830 07:54:41.611409 13423 leader_election.cc:343] T ad3c81a3f8df466fb71472e756c77305 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Not found: Tablet not found: ad3c81a3f8df466fb71472e756c77305
I20250830 07:54:41.613478 13228 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_1de56737f9f24ca3936c6c21ecfc7c69" } modify_external_catalogs: true
I20250830 07:54:41.613667 13228 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_1de56737f9f24ca3936c6c21ecfc7c69" } modify_external_catalogs: true
I20250830 07:54:41.615374 13218 catalog_manager.cc:4928] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): tablet 2be43f828f204f599017b6a04cf2ddf9 (table default.Table_517ee5a88dc8431fb14bc9f85c62b395 [id=cbd8b881bf8a456d9930d5a6b27ab7d4]) successfully deleted
W20250830 07:54:41.615856 13422 leader_election.cc:343] T ad3c81a3f8df466fb71472e756c77305 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Not found: Tablet not found: ad3c81a3f8df466fb71472e756c77305
I20250830 07:54:41.615957 13422 leader_election.cc:304] T ad3c81a3f8df466fb71472e756c77305 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba; no voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:54:41.616174 14492 raft_consensus.cc:2747] T ad3c81a3f8df466fb71472e756c77305 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:54:41.616209 14497 ts_tablet_manager.cc:1918] T 2be43f828f204f599017b6a04cf2ddf9 P 6b5e454d98894637b466ea27f1b647f9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250830 07:54:41.616343 14497 log.cc:1199] T 2be43f828f204f599017b6a04cf2ddf9 P 6b5e454d98894637b466ea27f1b647f9: Deleting WAL directory at /tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/ts-1/wal/wals/2be43f828f204f599017b6a04cf2ddf9
I20250830 07:54:41.616695 14497 ts_tablet_manager.cc:1939] T 2be43f828f204f599017b6a04cf2ddf9 P 6b5e454d98894637b466ea27f1b647f9: Deleting consensus metadata
I20250830 07:54:41.617228 13488 raft_consensus.cc:2466] T 30c2558c28944ff39d1a4a4ca9ac604e P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 1.
I20250830 07:54:41.619241 13232 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_a1b7e99160f443da8add698947fe9e63" } new_table_name: "default.Table_81a5aa0cda9840df824cfce03907e9fa" modify_external_catalogs: true
I20250830 07:54:41.622757 13227 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_98f42247a5704c41af9ab81bd583d43e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:41.623238 13227 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_98f42247a5704c41af9ab81bd583d43e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:41.623752 13220 catalog_manager.cc:4928] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): tablet 2be43f828f204f599017b6a04cf2ddf9 (table default.Table_517ee5a88dc8431fb14bc9f85c62b395 [id=cbd8b881bf8a456d9930d5a6b27ab7d4]) successfully deleted
I20250830 07:54:41.625341 13226 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_925a614f5a234282998fac421779f5f3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:41.625936 13231 catalog_manager.cc:5415] Ignoring report from unknown tablet f398e12cd9f543738d5163354f8a9d9d
W20250830 07:54:41.626219 13226 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_925a614f5a234282998fac421779f5f3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:41.625706 13701 leader_election.cc:304] T 30c2558c28944ff39d1a4a4ca9ac604e P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:54:41.626689 14533 raft_consensus.cc:2802] T 30c2558c28944ff39d1a4a4ca9ac604e P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election won for term 1
I20250830 07:54:41.626847 14533 raft_consensus.cc:695] T 30c2558c28944ff39d1a4a4ca9ac604e P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 LEADER]: Becoming Leader. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Running, Role: LEADER
I20250830 07:54:41.627132 14533 consensus_queue.cc:237] T 30c2558c28944ff39d1a4a4ca9ac604e P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:41.630383 13231 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_d81bfba061f8474fa55717de3d2e7b02"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:41.630963 13231 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d81bfba061f8474fa55717de3d2e7b02 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:41.658547 13230 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet 5235e1a32f044f0cbf882e338c482003
I20250830 07:54:41.659336 13230 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_ed76689fb0754162aa9b23002b8d6013"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250830 07:54:41.659483 14567 raft_consensus.cc:491] T 5aef6fd239ba43478cd978fa5d29b26e P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:41.659528 13225 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_d30882d7f1574d4da847ceec1f93e509"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250830 07:54:41.659632 14567 raft_consensus.cc:513] T 5aef6fd239ba43478cd978fa5d29b26e P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
W20250830 07:54:41.659950 13230 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ed76689fb0754162aa9b23002b8d6013 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:41.660368 14567 leader_election.cc:290] T 5aef6fd239ba43478cd978fa5d29b26e P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
I20250830 07:54:41.660396 13233 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_f0b390998fd444f6bd6a1b82953067c2" } new_table_name: "default.Table_312a5248361141058060b702704a3b35" modify_external_catalogs: true
I20250830 07:54:41.660759 14567 raft_consensus.cc:491] T 6dda55ec2da34c8aba9f39a63e144a7c P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:41.660907 14567 raft_consensus.cc:513] T 6dda55ec2da34c8aba9f39a63e144a7c P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
W20250830 07:54:41.659972 13225 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d30882d7f1574d4da847ceec1f93e509 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:41.661963 14567 leader_election.cc:290] T 6dda55ec2da34c8aba9f39a63e144a7c P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967)
I20250830 07:54:41.661898 13234 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_87a9206ca75f43159bde4f474e94ddec"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:41.662408 13234 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_87a9206ca75f43159bde4f474e94ddec in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:41.663339 13739 tablet_service.cc:1515] Processing DeleteTablet for tablet 5235e1a32f044f0cbf882e338c482003 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:41 UTC) from {username='slave'} at 127.0.0.1:45460
I20250830 07:54:41.663695 13228 catalog_manager.cc:5864] Not sending DeleteTablet requests; no consensus state for tablet 3b2baa41d01d4822aa508fc3b576b95b
W20250830 07:54:41.664134 13229 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 5dffbacf2fcd4a38a1d61cf5bb9c5eeb has no consensus state
W20250830 07:54:41.668865 13219 catalog_manager.cc:4908] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): delete failed for tablet 5235e1a32f044f0cbf882e338c482003 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5235e1a32f044f0cbf882e338c482003 already in progress: creating tablet
W20250830 07:54:41.670047 13232 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 6251a06d1efe44e38d35d962c468f8b2 consensus state has no leader
I20250830 07:54:41.674980 13468 tablet_service.cc:1515] Processing DeleteTablet for tablet 5235e1a32f044f0cbf882e338c482003 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:41 UTC) from {username='slave'} at 127.0.0.1:37956
W20250830 07:54:41.678520 13232 catalog_manager.cc:5415] Ignoring report from unknown tablet 30c2558c28944ff39d1a4a4ca9ac604e
I20250830 07:54:41.679180 13481 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "6dda55ec2da34c8aba9f39a63e144a7c" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
W20250830 07:54:41.679714 13218 catalog_manager.cc:4908] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): delete failed for tablet 5235e1a32f044f0cbf882e338c482003 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5235e1a32f044f0cbf882e338c482003 already in progress: creating tablet
W20250830 07:54:41.679766 13701 leader_election.cc:343] T 5aef6fd239ba43478cd978fa5d29b26e P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): Not found: Tablet not found: 5aef6fd239ba43478cd978fa5d29b26e
W20250830 07:54:41.680379 13701 leader_election.cc:343] T 6dda55ec2da34c8aba9f39a63e144a7c P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): Illegal state: must be running to vote when last-logged opid is not known
W20250830 07:54:41.686415 13233 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 7676b4d6a75c4c6aacced1f2a1beb555 has no consensus state
W20250830 07:54:41.692899 13703 leader_election.cc:343] T 5aef6fd239ba43478cd978fa5d29b26e P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Not found: Tablet not found: 5aef6fd239ba43478cd978fa5d29b26e
I20250830 07:54:41.693058 13703 leader_election.cc:304] T 5aef6fd239ba43478cd978fa5d29b26e P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 2065c332f15a4739899af79f3669c3ba, 6b5e454d98894637b466ea27f1b647f9
I20250830 07:54:41.693534 14533 raft_consensus.cc:2747] T 5aef6fd239ba43478cd978fa5d29b26e P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:54:41.694097 13626 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "6dda55ec2da34c8aba9f39a63e144a7c" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:41.694770 13626 raft_consensus.cc:2466] T 6dda55ec2da34c8aba9f39a63e144a7c P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 0.
I20250830 07:54:41.695199 13703 leader_election.cc:304] T 6dda55ec2da34c8aba9f39a63e144a7c P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 2065c332f15a4739899af79f3669c3ba
I20250830 07:54:41.695989 14533 raft_consensus.cc:2802] T 6dda55ec2da34c8aba9f39a63e144a7c P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:54:41.696146 14533 raft_consensus.cc:491] T 6dda55ec2da34c8aba9f39a63e144a7c P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:54:41.696297 14533 raft_consensus.cc:3058] T 6dda55ec2da34c8aba9f39a63e144a7c P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:41.697016 13606 tablet_service.cc:1515] Processing DeleteTablet for tablet 5235e1a32f044f0cbf882e338c482003 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:41 UTC) from {username='slave'} at 127.0.0.1:45306
I20250830 07:54:41.700977 13232 catalog_manager.cc:6127] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: default.Table_0e39abf281604c1792ea7cbac795787e [id=4678375d8d3d474290ad1a254de14054] alter complete (version 3)
I20250830 07:54:41.701894 14533 raft_consensus.cc:513] T 6dda55ec2da34c8aba9f39a63e144a7c P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:41.703233 14533 leader_election.cc:290] T 6dda55ec2da34c8aba9f39a63e144a7c P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Requested vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967)
I20250830 07:54:41.703696 13481 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "6dda55ec2da34c8aba9f39a63e144a7c" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba"
W20250830 07:54:41.704295 13701 leader_election.cc:343] T 6dda55ec2da34c8aba9f39a63e144a7c P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:41.709461 13124 external_mini_cluster.cc:1699] Attempting to check leaks for /tmp/dist-test-taskbivBUj/build/asan/bin/kudu pid 13999
W20250830 07:54:41.713685 13232 catalog_manager.cc:5415] Ignoring report from unknown tablet b480f5eb03804baeb61cd0424d70faf5
W20250830 07:54:41.715607 13220 catalog_manager.cc:4908] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet 5235e1a32f044f0cbf882e338c482003 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5235e1a32f044f0cbf882e338c482003 already in progress: creating tablet
I20250830 07:54:41.716956 14640 tablet.cc:1717] T cada6410e2884c508bb7dd38bea438ae P 9b057ade5dce45af9f8bf0bedf8b917f: Skipping requested alter to schema version 3, tablet already version 3
I20250830 07:54:41.718080 13624 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "6dda55ec2da34c8aba9f39a63e144a7c" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9"
I20250830 07:54:41.721683 13882 tablet_bootstrap.cc:492] T 66499e87e3d7422ca7a449cc2e89e709 P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:54:41.722849 13882 ts_tablet_manager.cc:1397] T 66499e87e3d7422ca7a449cc2e89e709 P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.262s user 0.007s sys 0.010s
I20250830 07:54:41.723820 13882 raft_consensus.cc:357] T 66499e87e3d7422ca7a449cc2e89e709 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:41.725499 13234 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_fc298c4951614456914be830598a020a" } new_table_name: "default.Table_beafa4a487df443aaf66f0c49eb97cca" modify_external_catalogs: true
I20250830 07:54:41.726251 13882 raft_consensus.cc:383] T 66499e87e3d7422ca7a449cc2e89e709 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:41.726344 13882 raft_consensus.cc:738] T 66499e87e3d7422ca7a449cc2e89e709 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:54:41.726545 13624 raft_consensus.cc:3058] T 6dda55ec2da34c8aba9f39a63e144a7c P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Advancing to term 1
W20250830 07:54:41.728673 13232 catalog_manager.cc:5415] Ignoring report from unknown tablet b480f5eb03804baeb61cd0424d70faf5
I20250830 07:54:41.733906 13886 tablet_bootstrap.cc:492] T 752727eef0734ff3b7b35b1d5f66aea6 P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:54:41.734058 13886 ts_tablet_manager.cc:1397] T 752727eef0734ff3b7b35b1d5f66aea6 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.222s user 0.003s sys 0.030s
W20250830 07:54:41.728766 13232 catalog_manager.cc:5415] Ignoring report from unknown tablet e4c5eedb7f4d4397b19b8a3e0ddf9458
W20250830 07:54:41.731909 13225 catalog_manager.cc:5415] Ignoring report from unknown tablet d33a5d107c6849aca6eb48ffdf8a5463
W20250830 07:54:41.735318 13225 catalog_manager.cc:5415] Ignoring report from unknown tablet 05da843c0fe4482a926e410e06b22461
I20250830 07:54:41.735946 13887 tablet_bootstrap.cc:492] T b38c8d003413428dae9e47f58e197c2c P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:54:41.736105 13887 ts_tablet_manager.cc:1397] T b38c8d003413428dae9e47f58e197c2c P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.206s user 0.012s sys 0.020s
I20250830 07:54:41.736265 13225 catalog_manager.cc:5582] T ada52626bbc94105a8b9428b0bbdfb5e P 2065c332f15a4739899af79f3669c3ba reported cstate change: term changed from 0 to 1, leader changed from <none> to 2065c332f15a4739899af79f3669c3ba (127.12.209.1). New cstate: current_term: 1 leader_uuid: "2065c332f15a4739899af79f3669c3ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } health_report { overall_health: UNKNOWN } } }
I20250830 07:54:41.736824 13225 catalog_manager.cc:5674] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325) does not have the latest schema for tablet cada6410e2884c508bb7dd38bea438ae (table default.Table_0e39abf281604c1792ea7cbac795787e [id=4678375d8d3d474290ad1a254de14054]). Expected version 3 got 0
I20250830 07:54:41.738014 13882 consensus_queue.cc:260] T 66499e87e3d7422ca7a449cc2e89e709 P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:41.738538 13882 ts_tablet_manager.cc:1428] T 66499e87e3d7422ca7a449cc2e89e709 P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.016s user 0.002s sys 0.000s
I20250830 07:54:41.740330 13882 tablet_bootstrap.cc:492] T 14ed24577c8f49f49c83242a26877614 P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:54:41.740460 13886 raft_consensus.cc:357] T 752727eef0734ff3b7b35b1d5f66aea6 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:41.740626 13886 raft_consensus.cc:383] T 752727eef0734ff3b7b35b1d5f66aea6 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:41.740715 13886 raft_consensus.cc:738] T 752727eef0734ff3b7b35b1d5f66aea6 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:54:41.742810 14641 tablet.cc:1717] T cada6410e2884c508bb7dd38bea438ae P 6b5e454d98894637b466ea27f1b647f9: Skipping requested alter to schema version 3, tablet already version 3
I20250830 07:54:41.744179 14402 raft_consensus.cc:491] T 14ed24577c8f49f49c83242a26877614 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:41.744401 14402 raft_consensus.cc:513] T 14ed24577c8f49f49c83242a26877614 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:41.745105 14402 leader_election.cc:290] T 14ed24577c8f49f49c83242a26877614 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:41.747392 13624 raft_consensus.cc:2466] T 6dda55ec2da34c8aba9f39a63e144a7c P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 1.
I20250830 07:54:41.747642 13886 consensus_queue.cc:260] T 752727eef0734ff3b7b35b1d5f66aea6 P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:41.745906 13887 raft_consensus.cc:357] T b38c8d003413428dae9e47f58e197c2c P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:41.747895 13887 raft_consensus.cc:383] T b38c8d003413428dae9e47f58e197c2c P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:41.748004 13887 raft_consensus.cc:738] T b38c8d003413428dae9e47f58e197c2c P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:54:41.748545 13886 ts_tablet_manager.cc:1428] T 752727eef0734ff3b7b35b1d5f66aea6 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.014s user 0.001s sys 0.001s
I20250830 07:54:41.749787 13770 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "14ed24577c8f49f49c83242a26877614" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:41.749996 13887 consensus_queue.cc:260] T b38c8d003413428dae9e47f58e197c2c P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:41.750438 13886 tablet_bootstrap.cc:492] T 2be43f828f204f599017b6a04cf2ddf9 P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:54:41.756479 13882 tablet_bootstrap.cc:654] T 14ed24577c8f49f49c83242a26877614 P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:41.764461 13230 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_a73677e2b563409bb9c4ed171350ff2e" } new_table_name: "default.Table_6113d94cac75499baf2aee4b46a92217" modify_external_catalogs: true
I20250830 07:54:41.752485 13887 ts_tablet_manager.cc:1428] T b38c8d003413428dae9e47f58e197c2c P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.007s user 0.001s sys 0.001s
I20250830 07:54:41.766394 13225 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_10777f2bd6954c8688868aced29c2ae0" } modify_external_catalogs: true
I20250830 07:54:41.766636 13225 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_10777f2bd6954c8688868aced29c2ae0" } modify_external_catalogs: true
I20250830 07:54:41.766716 13887 tablet_bootstrap.cc:492] T 6dda55ec2da34c8aba9f39a63e144a7c P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
W20250830 07:54:41.767918 13219 catalog_manager.cc:4726] Async tablet task AlterTable RPC for tablet 7676b4d6a75c4c6aacced1f2a1beb555 (table default.Table_312a5248361141058060b702704a3b35 [id=16c0b33e1e744e61b48b7cb029228977], current schema version=2) failed: Not found: failed to reset TS proxy: No leader found: Tablet 7676b4d6a75c4c6aacced1f2a1beb555 has no consensus state
I20250830 07:54:41.768842 13887 tablet_bootstrap.cc:654] T 6dda55ec2da34c8aba9f39a63e144a7c P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
W20250830 07:54:41.752630 13422 leader_election.cc:343] T 14ed24577c8f49f49c83242a26877614 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:41.771097 13468 tablet_service.cc:1515] Processing DeleteTablet for tablet ad3c81a3f8df466fb71472e756c77305 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:40 UTC) from {username='slave'} at 127.0.0.1:37956
I20250830 07:54:41.771736 13883 tablet_replica.cc:331] T ad3c81a3f8df466fb71472e756c77305 P 2065c332f15a4739899af79f3669c3ba: stopping tablet replica
I20250830 07:54:41.771919 13883 raft_consensus.cc:2241] T ad3c81a3f8df466fb71472e756c77305 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Raft consensus shutting down.
I20250830 07:54:41.772097 13883 raft_consensus.cc:2270] T ad3c81a3f8df466fb71472e756c77305 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Raft consensus is shut down!
I20250830 07:54:41.772349 13234 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_f9f639c72f2a46a0bb1606c0f1e92ee0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250830 07:54:41.772876 13883 ts_tablet_manager.cc:1905] T ad3c81a3f8df466fb71472e756c77305 P 2065c332f15a4739899af79f3669c3ba: Deleting tablet data with delete state TABLET_DATA_DELETED
W20250830 07:54:41.772879 13234 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f9f639c72f2a46a0bb1606c0f1e92ee0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:41.775147 13233 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_d81bfba061f8474fa55717de3d2e7b02" } modify_external_catalogs: true
I20250830 07:54:41.775339 13233 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_d81bfba061f8474fa55717de3d2e7b02" } modify_external_catalogs: true
I20250830 07:54:41.777709 14643 consensus_queue.cc:1035] T e4f1ff6026bb45e28e63c27c83399d72 P 2065c332f15a4739899af79f3669c3ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:54:41.766286 14526 raft_consensus.cc:491] T 04c9d954106a4417a34ff80bc98e2ce8 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:41.778093 14526 raft_consensus.cc:513] T 04c9d954106a4417a34ff80bc98e2ce8 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:41.778813 14526 leader_election.cc:290] T 04c9d954106a4417a34ff80bc98e2ce8 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:41.779208 13488 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "04c9d954106a4417a34ff80bc98e2ce8" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:54:41.779426 13488 raft_consensus.cc:2466] T 04c9d954106a4417a34ff80bc98e2ce8 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b5e454d98894637b466ea27f1b647f9 in term 0.
I20250830 07:54:41.770350 13624 raft_consensus.cc:1273] T 1fa571e9490e499792225d7b786e8658 P 6b5e454d98894637b466ea27f1b647f9 [term 2 FOLLOWER]: Refusing update from remote peer 9b057ade5dce45af9f8bf0bedf8b917f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20250830 07:54:41.770756 13627 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "14ed24577c8f49f49c83242a26877614" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:41.779917 13561 leader_election.cc:304] T 04c9d954106a4417a34ff80bc98e2ce8 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 6b5e454d98894637b466ea27f1b647f9; no voters:
I20250830 07:54:41.780159 14526 raft_consensus.cc:2802] T 04c9d954106a4417a34ff80bc98e2ce8 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:54:41.780277 14526 raft_consensus.cc:491] T 04c9d954106a4417a34ff80bc98e2ce8 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:54:41.780364 14526 raft_consensus.cc:3058] T 04c9d954106a4417a34ff80bc98e2ce8 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:41.782374 14641 tablet.cc:1722] T d4e35395930f4c37b34649da5718aa1f P 6b5e454d98894637b466ea27f1b647f9: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
W20250830 07:54:41.782593 13423 leader_election.cc:343] T 14ed24577c8f49f49c83242a26877614 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:41.782729 13423 leader_election.cc:304] T 14ed24577c8f49f49c83242a26877614 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba; no voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:54:41.783094 14643 raft_consensus.cc:2747] T 14ed24577c8f49f49c83242a26877614 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:54:41.783515 14526 raft_consensus.cc:513] T 04c9d954106a4417a34ff80bc98e2ce8 P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:41.785322 13883 ts_tablet_manager.cc:1918] T ad3c81a3f8df466fb71472e756c77305 P 2065c332f15a4739899af79f3669c3ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250830 07:54:41.785491 13883 log.cc:1199] T ad3c81a3f8df466fb71472e756c77305 P 2065c332f15a4739899af79f3669c3ba: Deleting WAL directory at /tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/ts-0/wal/wals/ad3c81a3f8df466fb71472e756c77305
I20250830 07:54:41.785419 13488 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "04c9d954106a4417a34ff80bc98e2ce8" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba"
I20250830 07:54:41.785669 13488 raft_consensus.cc:3058] T 04c9d954106a4417a34ff80bc98e2ce8 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:41.785759 14526 leader_election.cc:290] T 04c9d954106a4417a34ff80bc98e2ce8 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 election: Requested vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:41.788304 13488 raft_consensus.cc:2466] T 04c9d954106a4417a34ff80bc98e2ce8 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b5e454d98894637b466ea27f1b647f9 in term 1.
I20250830 07:54:41.788734 13561 leader_election.cc:304] T 04c9d954106a4417a34ff80bc98e2ce8 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 6b5e454d98894637b466ea27f1b647f9; no voters:
I20250830 07:54:41.789160 14526 raft_consensus.cc:2802] T 04c9d954106a4417a34ff80bc98e2ce8 P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Leader election won for term 1
I20250830 07:54:41.789567 14526 raft_consensus.cc:695] T 04c9d954106a4417a34ff80bc98e2ce8 P 6b5e454d98894637b466ea27f1b647f9 [term 1 LEADER]: Becoming Leader. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Running, Role: LEADER
I20250830 07:54:41.789906 14526 consensus_queue.cc:237] T 04c9d954106a4417a34ff80bc98e2ce8 P 6b5e454d98894637b466ea27f1b647f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:41.790423 13226 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_a48a10790646488c8d1a00093e81fffa" } modify_external_catalogs: true
I20250830 07:54:41.790597 13226 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_a48a10790646488c8d1a00093e81fffa" } modify_external_catalogs: true
I20250830 07:54:41.792667 13883 ts_tablet_manager.cc:1939] T ad3c81a3f8df466fb71472e756c77305 P 2065c332f15a4739899af79f3669c3ba: Deleting consensus metadata
I20250830 07:54:41.793236 13703 leader_election.cc:304] T 6dda55ec2da34c8aba9f39a63e144a7c P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 2065c332f15a4739899af79f3669c3ba
I20250830 07:54:41.794356 14567 raft_consensus.cc:2802] T 6dda55ec2da34c8aba9f39a63e144a7c P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election won for term 1
I20250830 07:54:41.794541 14567 raft_consensus.cc:695] T 6dda55ec2da34c8aba9f39a63e144a7c P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 LEADER]: Becoming Leader. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Running, Role: LEADER
I20250830 07:54:41.770169 14402 raft_consensus.cc:491] T dbe542c478874482b078296a7a0e9ec9 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:41.795271 14402 raft_consensus.cc:513] T dbe542c478874482b078296a7a0e9ec9 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:41.796097 14402 leader_election.cc:290] T dbe542c478874482b078296a7a0e9ec9 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:41.798367 13218 catalog_manager.cc:4928] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): tablet ad3c81a3f8df466fb71472e756c77305 (table default.Table_ebee83f51b6446a8afbf7c1f94b926a2 [id=2693b8974d444e21b284d246f53eca65]) successfully deleted
W20250830 07:54:41.798885 13232 catalog_manager.cc:5415] Ignoring report from unknown tablet d1ae3812d72b419798736328da64b53c
I20250830 07:54:41.801005 13627 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "dbe542c478874482b078296a7a0e9ec9" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:41.801229 13627 raft_consensus.cc:2466] T dbe542c478874482b078296a7a0e9ec9 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2065c332f15a4739899af79f3669c3ba in term 0.
I20250830 07:54:41.802157 13423 leader_election.cc:304] T dbe542c478874482b078296a7a0e9ec9 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 6b5e454d98894637b466ea27f1b647f9; no voters:
I20250830 07:54:41.802525 14646 raft_consensus.cc:2802] T dbe542c478874482b078296a7a0e9ec9 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:54:41.802618 14646 raft_consensus.cc:491] T dbe542c478874482b078296a7a0e9ec9 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:54:41.802716 14646 raft_consensus.cc:3058] T dbe542c478874482b078296a7a0e9ec9 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:41.805284 14646 raft_consensus.cc:513] T dbe542c478874482b078296a7a0e9ec9 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:41.805872 14646 leader_election.cc:290] T dbe542c478874482b078296a7a0e9ec9 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 election: Requested vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:41.806341 13627 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "dbe542c478874482b078296a7a0e9ec9" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9"
I20250830 07:54:41.806486 13627 raft_consensus.cc:3058] T dbe542c478874482b078296a7a0e9ec9 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:41.809087 13627 raft_consensus.cc:2466] T dbe542c478874482b078296a7a0e9ec9 P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2065c332f15a4739899af79f3669c3ba in term 1.
I20250830 07:54:41.809580 13423 leader_election.cc:304] T dbe542c478874482b078296a7a0e9ec9 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 6b5e454d98894637b466ea27f1b647f9; no voters:
I20250830 07:54:41.810429 14646 raft_consensus.cc:2802] T dbe542c478874482b078296a7a0e9ec9 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election won for term 1
I20250830 07:54:41.810627 14646 raft_consensus.cc:695] T dbe542c478874482b078296a7a0e9ec9 P 2065c332f15a4739899af79f3669c3ba [term 1 LEADER]: Becoming Leader. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Running, Role: LEADER
W20250830 07:54:41.810959 13230 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a3ac09a6d8604297aa8736d1f60484e2 has no consensus state
I20250830 07:54:41.810945 14646 consensus_queue.cc:237] T dbe542c478874482b078296a7a0e9ec9 P 2065c332f15a4739899af79f3669c3ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:41.812549 14659 tablet.cc:1722] T cada6410e2884c508bb7dd38bea438ae P 2065c332f15a4739899af79f3669c3ba: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20250830 07:54:41.813006 13225 catalog_manager.cc:5864] Not sending DeleteTablet requests; no consensus state for tablet e1291bd629db42f7a5af1e1525699ceb
I20250830 07:54:41.817916 13233 catalog_manager.cc:5864] Not sending DeleteTablet requests; no consensus state for tablet eec2e936bc894a80816ec45ecbc9ea47
I20250830 07:54:41.820611 13226 catalog_manager.cc:5864] Not sending DeleteTablet requests; no consensus state for tablet cc3cef06b048456fbb66eb03f1758c4a
I20250830 07:54:41.822441 14663 tablet.cc:1722] T d4e35395930f4c37b34649da5718aa1f P 2065c332f15a4739899af79f3669c3ba: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
W20250830 07:54:41.825960 13226 catalog_manager.cc:5415] Ignoring report from unknown tablet b4ab964a64a64e00a78ffd2b220aef46
W20250830 07:54:41.826061 13226 catalog_manager.cc:5415] Ignoring report from unknown tablet b480f5eb03804baeb61cd0424d70faf5
W20250830 07:54:41.826164 13226 catalog_manager.cc:5415] Ignoring report from unknown tablet b38c8d003413428dae9e47f58e197c2c
I20250830 07:54:41.826458 13226 catalog_manager.cc:5674] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325) does not have the latest schema for tablet cada6410e2884c508bb7dd38bea438ae (table default.Table_0e39abf281604c1792ea7cbac795787e [id=4678375d8d3d474290ad1a254de14054]). Expected version 3 got 0
I20250830 07:54:41.836022 13226 catalog_manager.cc:5582] T dbe542c478874482b078296a7a0e9ec9 P 2065c332f15a4739899af79f3669c3ba reported cstate change: term changed from 0 to 1, leader changed from <none> to 2065c332f15a4739899af79f3669c3ba (127.12.209.1). New cstate: current_term: 1 leader_uuid: "2065c332f15a4739899af79f3669c3ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } health_report { overall_health: UNKNOWN } } }
I20250830 07:54:41.836758 13226 catalog_manager.cc:5674] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325) does not have the latest schema for tablet dbe542c478874482b078296a7a0e9ec9 (table default.Table_54bd02c58de341ec93ced1d662a7e671 [id=b80ba51884ef4042818f8def0b0ebf0e]). Expected version 2 got 0
I20250830 07:54:41.809978 13770 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "dbe542c478874482b078296a7a0e9ec9" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:41.809834 14567 consensus_queue.cc:237] T 6dda55ec2da34c8aba9f39a63e144a7c P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:41.810984 14565 consensus_queue.cc:1035] T 1fa571e9490e499792225d7b786e8658 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.042s
I20250830 07:54:41.811048 13775 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "04c9d954106a4417a34ff80bc98e2ce8" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:41.839558 13882 tablet_bootstrap.cc:492] T 14ed24577c8f49f49c83242a26877614 P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:54:41.839773 13882 ts_tablet_manager.cc:1397] T 14ed24577c8f49f49c83242a26877614 P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.101s user 0.002s sys 0.006s
I20250830 07:54:41.840682 13882 raft_consensus.cc:357] T 14ed24577c8f49f49c83242a26877614 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:41.840873 13882 raft_consensus.cc:383] T 14ed24577c8f49f49c83242a26877614 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:41.840992 13882 raft_consensus.cc:738] T 14ed24577c8f49f49c83242a26877614 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:54:41.841213 13882 consensus_queue.cc:260] T 14ed24577c8f49f49c83242a26877614 P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
W20250830 07:54:41.841434 13422 leader_election.cc:343] T dbe542c478874482b078296a7a0e9ec9 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:41.841917 13882 ts_tablet_manager.cc:1428] T 14ed24577c8f49f49c83242a26877614 P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.002s user 0.000s sys 0.003s
I20250830 07:54:41.842274 13882 tablet_bootstrap.cc:492] T e862fa77e16945bd94e405aa3474f021 P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:54:41.845788 13887 tablet_bootstrap.cc:492] T 6dda55ec2da34c8aba9f39a63e144a7c P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:54:41.846508 13887 ts_tablet_manager.cc:1397] T 6dda55ec2da34c8aba9f39a63e144a7c P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.080s user 0.003s sys 0.001s
I20250830 07:54:41.850520 13887 raft_consensus.cc:357] T 6dda55ec2da34c8aba9f39a63e144a7c P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:41.854969 13887 raft_consensus.cc:383] T 6dda55ec2da34c8aba9f39a63e144a7c P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20250830 07:54:41.855005 13233 catalog_manager.cc:5415] Ignoring report from unknown tablet 04c9d954106a4417a34ff80bc98e2ce8
W20250830 07:54:41.855085 13233 catalog_manager.cc:5415] Ignoring report from unknown tablet e4f1ff6026bb45e28e63c27c83399d72
I20250830 07:54:41.855075 13887 raft_consensus.cc:738] T 6dda55ec2da34c8aba9f39a63e144a7c P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:54:41.855697 13887 consensus_queue.cc:260] T 6dda55ec2da34c8aba9f39a63e144a7c P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:41.856231 13887 ts_tablet_manager.cc:1428] T 6dda55ec2da34c8aba9f39a63e144a7c P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.009s user 0.002s sys 0.000s
I20250830 07:54:41.857242 13775 raft_consensus.cc:2466] T 04c9d954106a4417a34ff80bc98e2ce8 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b5e454d98894637b466ea27f1b647f9 in term 0.
I20250830 07:54:41.858294 13772 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "04c9d954106a4417a34ff80bc98e2ce8" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f"
I20250830 07:54:41.858973 13770 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "dbe542c478874482b078296a7a0e9ec9" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f"
W20250830 07:54:41.859792 13422 leader_election.cc:343] T dbe542c478874482b078296a7a0e9ec9 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:41.861964 14646 consensus_queue.cc:1035] T e4f1ff6026bb45e28e63c27c83399d72 P 2065c332f15a4739899af79f3669c3ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:54:41.865872 13234 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_0e39abf281604c1792ea7cbac795787e" } modify_external_catalogs: true
I20250830 07:54:41.866021 13234 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_0e39abf281604c1792ea7cbac795787e" } modify_external_catalogs: true
I20250830 07:54:41.866945 13887 tablet_bootstrap.cc:492] T f56cab43580a4ee3a912fc5e58a3bd9d P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:54:41.867687 13225 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_205eff07ab794c6fb99d60b9d2f2b4ec"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:41.868211 13225 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_205eff07ab794c6fb99d60b9d2f2b4ec in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:41.870594 13230 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_6c8e3e90a0954fe79ae9491c5b839979"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:41.871057 13230 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6c8e3e90a0954fe79ae9491c5b839979 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:41.872184 13232 master_service.cc:948] ReplaceTablet: received request to replace tablet 4b403cadfb7b42f8896b2ee16b50ecb1 from {username='slave'} at 127.0.0.1:42126
I20250830 07:54:41.872313 13227 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_ed86b365cefe4412bcc0629921f39f3b" } modify_external_catalogs: true
I20250830 07:54:41.872447 13227 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_ed86b365cefe4412bcc0629921f39f3b" } modify_external_catalogs: true
I20250830 07:54:41.873672 13231 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_4abf499bcf8a4fd88fd739d3a1daee3a" } new_table_name: "default.Table_f85973cf63a24b8f8f1a9ad8d8561abb" modify_external_catalogs: true
I20250830 07:54:41.875116 13229 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_92300192de164f969afb0aeaebfd701f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250830 07:54:41.875190 13228 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_a20eaa028a44468fb031dccbf893a83b" } new_table_name: "default.Table_4f298420002a4cc9b05f343a524ae6d1" modify_external_catalogs: true
W20250830 07:54:41.875557 13229 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_92300192de164f969afb0aeaebfd701f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:41.883214 13887 tablet_bootstrap.cc:654] T f56cab43580a4ee3a912fc5e58a3bd9d P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:41.892289 13772 raft_consensus.cc:3058] T 04c9d954106a4417a34ff80bc98e2ce8 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:41.909703 13886 tablet_bootstrap.cc:654] T 2be43f828f204f599017b6a04cf2ddf9 P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:41.917388 13226 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_fbed2e93681c42ae83a5a169b6a3fb25"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:41.917979 13226 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fbed2e93681c42ae83a5a169b6a3fb25 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250830 07:54:41.919314 13225 catalog_manager.cc:5415] Ignoring report from unknown tablet f398e12cd9f543738d5163354f8a9d9d
W20250830 07:54:41.919458 13225 catalog_manager.cc:5415] Ignoring report from unknown tablet 752727eef0734ff3b7b35b1d5f66aea6
I20250830 07:54:41.919902 13234 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet cada6410e2884c508bb7dd38bea438ae
I20250830 07:54:41.920233 13225 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_2a3e3a79103b4c378e0cf2beabac7ed2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250830 07:54:41.920639 13234 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_6dbeeb382b9a4cef84a165dc351d2c20"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:41.921180 13225 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2a3e3a79103b4c378e0cf2beabac7ed2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:41.921916 13468 tablet_service.cc:1515] Processing DeleteTablet for tablet cada6410e2884c508bb7dd38bea438ae with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:41 UTC) from {username='slave'} at 127.0.0.1:37956
I20250830 07:54:41.922200 13883 tablet_replica.cc:331] T cada6410e2884c508bb7dd38bea438ae P 2065c332f15a4739899af79f3669c3ba: stopping tablet replica
W20250830 07:54:41.921181 13234 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6dbeeb382b9a4cef84a165dc351d2c20 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:41.922413 13883 raft_consensus.cc:2241] T cada6410e2884c508bb7dd38bea438ae P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Raft consensus shutting down.
I20250830 07:54:41.922596 13883 raft_consensus.cc:2270] T cada6410e2884c508bb7dd38bea438ae P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20250830 07:54:41.923432 13230 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_153646ff157d493ba4c4f4ec4368cc52"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:41.923887 13230 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_153646ff157d493ba4c4f4ec4368cc52 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:41.925195 13233 catalog_manager.cc:6127] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: default.Table_beafa4a487df443aaf66f0c49eb97cca [id=e946db3cd3504a69a61a7ed2cabcada7] alter complete (version 2)
I20250830 07:54:41.927170 14663 tablet.cc:1717] T cada6410e2884c508bb7dd38bea438ae P 2065c332f15a4739899af79f3669c3ba: Skipping requested alter to schema version 3, tablet already version 3
W20250830 07:54:41.929183 13233 catalog_manager.cc:5415] Ignoring report from unknown tablet ef16b9e2d444489699f4db1ac26d5f6c
W20250830 07:54:41.929515 13233 catalog_manager.cc:5415] Ignoring report from unknown tablet 6dda55ec2da34c8aba9f39a63e144a7c
I20250830 07:54:41.930995 13233 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_3c6b83acc24c48e4ace89e977f29c549" } new_table_name: "default.Table_a0ed85ec15944f419c32ba7fd1d9b4c1" modify_external_catalogs: true
I20250830 07:54:41.931385 13232 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet 4b403cadfb7b42f8896b2ee16b50ecb1
I20250830 07:54:41.931912 13232 catalog_manager.cc:6652] ReplaceTablet: tablet 4b403cadfb7b42f8896b2ee16b50ecb1 deleted and replaced by tablet 6f8b6f233e5c49b39b3ef6314508e9d9
I20250830 07:54:41.932153 13232 master_service.cc:948] ReplaceTablet: received request to replace tablet 4b7eff24965f4f3ebfbf70dc82b7cce3 from {username='slave'} at 127.0.0.1:42126
I20250830 07:54:41.932569 13232 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_b8991c6c42d9443fa2651b93326d4556"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:41.933059 13232 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b8991c6c42d9443fa2651b93326d4556 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:41.934616 13468 tablet_service.cc:1515] Processing DeleteTablet for tablet 4b403cadfb7b42f8896b2ee16b50ecb1 with delete_type TABLET_DATA_DELETED (replaced by tablet 6f8b6f233e5c49b39b3ef6314508e9d9) from {username='slave'} at 127.0.0.1:37956
I20250830 07:54:41.935118 13227 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet ee44ab24333742909f773889ad5c3e00
I20250830 07:54:41.935858 13468 tablet_service.cc:1515] Processing DeleteTablet for tablet ee44ab24333742909f773889ad5c3e00 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:41 UTC) from {username='slave'} at 127.0.0.1:37956
W20250830 07:54:41.936223 14666 log.cc:927] Time spent T 04c9d954106a4417a34ff80bc98e2ce8 P 6b5e454d98894637b466ea27f1b647f9: Append to log took a long time: real 0.074s user 0.000s sys 0.000s
I20250830 07:54:41.937050 13883 ts_tablet_manager.cc:1905] T cada6410e2884c508bb7dd38bea438ae P 2065c332f15a4739899af79f3669c3ba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250830 07:54:41.937999 13227 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_42c639c9b9ec4ebfbfb9ae1452fcec86"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:41.938493 13227 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_42c639c9b9ec4ebfbfb9ae1452fcec86 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250830 07:54:41.939175 13231 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 852e353f6ee945628ddebdbdd1bd76fb consensus state has no leader
I20250830 07:54:41.939281 14313 generic_service.cc:196] Checking for leaks (request via RPC)
I20250830 07:54:41.939435 13231 master_service.cc:948] ReplaceTablet: received request to replace tablet 1520d7257f864ea4ba4b9a5d0443f8a7 from {username='slave'} at 127.0.0.1:42126
W20250830 07:54:41.940973 13228 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 8eb010d7955d47a89ff1d01be1b5b01e consensus state has no leader
I20250830 07:54:41.946393 13883 ts_tablet_manager.cc:1918] T cada6410e2884c508bb7dd38bea438ae P 2065c332f15a4739899af79f3669c3ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20250830 07:54:41.946672 13883 log.cc:1199] T cada6410e2884c508bb7dd38bea438ae P 2065c332f15a4739899af79f3669c3ba: Deleting WAL directory at /tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/ts-0/wal/wals/cada6410e2884c508bb7dd38bea438ae
I20250830 07:54:41.947218 13883 ts_tablet_manager.cc:1939] T cada6410e2884c508bb7dd38bea438ae P 2065c332f15a4739899af79f3669c3ba: Deleting consensus metadata
W20250830 07:54:41.950932 13226 catalog_manager.cc:5415] Ignoring report from unknown tablet e4f1ff6026bb45e28e63c27c83399d72
I20250830 07:54:41.951313 13218 catalog_manager.cc:4928] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): tablet cada6410e2884c508bb7dd38bea438ae (table default.Table_0e39abf281604c1792ea7cbac795787e [id=4678375d8d3d474290ad1a254de14054]) successfully deleted
W20250830 07:54:41.952109 13218 catalog_manager.cc:4908] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): delete failed for tablet 4b403cadfb7b42f8896b2ee16b50ecb1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4b403cadfb7b42f8896b2ee16b50ecb1 already in progress: creating tablet
W20250830 07:54:41.952356 13218 catalog_manager.cc:4908] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): delete failed for tablet ee44ab24333742909f773889ad5c3e00 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ee44ab24333742909f773889ad5c3e00 already in progress: creating tablet
I20250830 07:54:41.959021 13234 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_6d953736964f4c279e9880e4ad210c6d" } new_table_name: "default.Table_bb2c4c96345947ad8dea62244c6d7476" modify_external_catalogs: true
W20250830 07:54:41.961340 13233 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 689b4fee1dd04b3d9ccdea334b0f6b59 consensus state has no leader
I20250830 07:54:41.974143 13772 raft_consensus.cc:2466] T 04c9d954106a4417a34ff80bc98e2ce8 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b5e454d98894637b466ea27f1b647f9 in term 1.
I20250830 07:54:41.974164 13739 tablet_service.cc:1515] Processing DeleteTablet for tablet cada6410e2884c508bb7dd38bea438ae with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:41 UTC) from {username='slave'} at 127.0.0.1:45460
I20250830 07:54:41.974958 13739 tablet_service.cc:1515] Processing DeleteTablet for tablet 4b403cadfb7b42f8896b2ee16b50ecb1 with delete_type TABLET_DATA_DELETED (replaced by tablet 6f8b6f233e5c49b39b3ef6314508e9d9) from {username='slave'} at 127.0.0.1:45460
I20250830 07:54:41.975319 13755 tablet_service.cc:1515] Processing DeleteTablet for tablet ee44ab24333742909f773889ad5c3e00 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:41 UTC) from {username='slave'} at 127.0.0.1:45460
I20250830 07:54:41.975739 14505 tablet_replica.cc:331] T cada6410e2884c508bb7dd38bea438ae P 9b057ade5dce45af9f8bf0bedf8b917f: stopping tablet replica
I20250830 07:54:41.976615 13231 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet 1520d7257f864ea4ba4b9a5d0443f8a7
I20250830 07:54:41.976773 14505 raft_consensus.cc:2241] T cada6410e2884c508bb7dd38bea438ae P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 LEADER]: Raft consensus shutting down.
I20250830 07:54:41.977099 13231 catalog_manager.cc:6652] ReplaceTablet: tablet 1520d7257f864ea4ba4b9a5d0443f8a7 deleted and replaced by tablet 76dd9dd481fc427fb20f5091e4a3b738
I20250830 07:54:41.977134 14505 raft_consensus.cc:2270] T cada6410e2884c508bb7dd38bea438ae P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Raft consensus is shut down!
W20250830 07:54:41.977788 13234 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d1bf58d367f54ba8bad64887b9a8d9cc consensus state has no leader
I20250830 07:54:41.978628 13468 tablet_service.cc:1515] Processing DeleteTablet for tablet 1520d7257f864ea4ba4b9a5d0443f8a7 with delete_type TABLET_DATA_DELETED (replaced by tablet 76dd9dd481fc427fb20f5091e4a3b738) from {username='slave'} at 127.0.0.1:37956
W20250830 07:54:41.979476 13218 catalog_manager.cc:4908] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): delete failed for tablet 1520d7257f864ea4ba4b9a5d0443f8a7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1520d7257f864ea4ba4b9a5d0443f8a7 already in progress: creating tablet
I20250830 07:54:41.980270 13887 tablet_bootstrap.cc:492] T f56cab43580a4ee3a912fc5e58a3bd9d P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:54:41.980473 13887 ts_tablet_manager.cc:1397] T f56cab43580a4ee3a912fc5e58a3bd9d P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.114s user 0.004s sys 0.011s
I20250830 07:54:41.981339 13887 raft_consensus.cc:357] T f56cab43580a4ee3a912fc5e58a3bd9d P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:41.982415 13887 raft_consensus.cc:383] T f56cab43580a4ee3a912fc5e58a3bd9d P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:41.982822 13887 raft_consensus.cc:738] T f56cab43580a4ee3a912fc5e58a3bd9d P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:54:41.983371 13887 consensus_queue.cc:260] T f56cab43580a4ee3a912fc5e58a3bd9d P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:41.989856 14505 ts_tablet_manager.cc:1905] T cada6410e2884c508bb7dd38bea438ae P 9b057ade5dce45af9f8bf0bedf8b917f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250830 07:54:41.990918 13755 tablet_service.cc:1515] Processing DeleteTablet for tablet 1520d7257f864ea4ba4b9a5d0443f8a7 with delete_type TABLET_DATA_DELETED (replaced by tablet 76dd9dd481fc427fb20f5091e4a3b738) from {username='slave'} at 127.0.0.1:45460
I20250830 07:54:41.993974 13887 ts_tablet_manager.cc:1428] T f56cab43580a4ee3a912fc5e58a3bd9d P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.013s user 0.001s sys 0.001s
I20250830 07:54:42.002966 13887 tablet_bootstrap.cc:492] T d3f207cee78a43a1b5e030c09752c78c P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:54:42.004976 13882 tablet_bootstrap.cc:654] T e862fa77e16945bd94e405aa3474f021 P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:42.005967 14445 consensus_queue.cc:1035] T 62ee2d0fbd774d38a4a4c4a033584ef9 P 6b5e454d98894637b466ea27f1b647f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.034s
I20250830 07:54:42.006847 13887 tablet_bootstrap.cc:654] T d3f207cee78a43a1b5e030c09752c78c P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
W20250830 07:54:42.012634 13234 catalog_manager.cc:5415] Ignoring report from unknown tablet e4f1ff6026bb45e28e63c27c83399d72
W20250830 07:54:42.012753 13234 catalog_manager.cc:5415] Ignoring report from unknown tablet 6dda55ec2da34c8aba9f39a63e144a7c
I20250830 07:54:42.015022 13606 tablet_service.cc:1515] Processing DeleteTablet for tablet cada6410e2884c508bb7dd38bea438ae with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:41 UTC) from {username='slave'} at 127.0.0.1:45306
I20250830 07:54:42.020462 14526 raft_consensus.cc:491] T 66499e87e3d7422ca7a449cc2e89e709 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:42.023130 13887 tablet_bootstrap.cc:492] T d3f207cee78a43a1b5e030c09752c78c P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:54:42.023379 13887 ts_tablet_manager.cc:1397] T d3f207cee78a43a1b5e030c09752c78c P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.020s user 0.003s sys 0.007s
I20250830 07:54:42.024269 13887 raft_consensus.cc:357] T d3f207cee78a43a1b5e030c09752c78c P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:42.024572 13887 raft_consensus.cc:383] T d3f207cee78a43a1b5e030c09752c78c P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:42.024649 14505 ts_tablet_manager.cc:1918] T cada6410e2884c508bb7dd38bea438ae P 9b057ade5dce45af9f8bf0bedf8b917f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20250830 07:54:42.024709 13887 raft_consensus.cc:738] T d3f207cee78a43a1b5e030c09752c78c P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:54:42.025111 13887 consensus_queue.cc:260] T d3f207cee78a43a1b5e030c09752c78c P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:42.029619 14505 log.cc:1199] T cada6410e2884c508bb7dd38bea438ae P 9b057ade5dce45af9f8bf0bedf8b917f: Deleting WAL directory at /tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/ts-2/wal/wals/cada6410e2884c508bb7dd38bea438ae
W20250830 07:54:42.029836 13234 catalog_manager.cc:5415] Ignoring report from unknown tablet b480f5eb03804baeb61cd0424d70faf5
I20250830 07:54:42.030078 14505 ts_tablet_manager.cc:1939] T cada6410e2884c508bb7dd38bea438ae P 9b057ade5dce45af9f8bf0bedf8b917f: Deleting consensus metadata
I20250830 07:54:42.031059 13219 catalog_manager.cc:4928] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): tablet cada6410e2884c508bb7dd38bea438ae (table default.Table_0e39abf281604c1792ea7cbac795787e [id=4678375d8d3d474290ad1a254de14054]) successfully deleted
W20250830 07:54:42.031805 13219 catalog_manager.cc:4908] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): delete failed for tablet 4b403cadfb7b42f8896b2ee16b50ecb1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4b403cadfb7b42f8896b2ee16b50ecb1 already in progress: creating tablet
W20250830 07:54:42.032051 13219 catalog_manager.cc:4908] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): delete failed for tablet ee44ab24333742909f773889ad5c3e00 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ee44ab24333742909f773889ad5c3e00 already in progress: creating tablet
W20250830 07:54:42.032248 13219 catalog_manager.cc:4908] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): delete failed for tablet 1520d7257f864ea4ba4b9a5d0443f8a7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1520d7257f864ea4ba4b9a5d0443f8a7 already in progress: creating tablet
I20250830 07:54:42.034446 13887 ts_tablet_manager.cc:1428] T d3f207cee78a43a1b5e030c09752c78c P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.011s user 0.001s sys 0.001s
I20250830 07:54:42.036129 13887 tablet_bootstrap.cc:492] T 8dddcfe56522436287aea212e316a729 P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:54:42.038091 13887 tablet_bootstrap.cc:654] T 8dddcfe56522436287aea212e316a729 P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:42.039577 13231 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_8ae535ae9db2427a99899af4ecafb4e2" } modify_external_catalogs: true
I20250830 07:54:42.039793 13231 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_8ae535ae9db2427a99899af4ecafb4e2" } modify_external_catalogs: true
I20250830 07:54:42.039749 13227 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_b59b0e75bbee4971912072e1174aad74"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250830 07:54:42.039990 13233 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_ee2734eae1204d188a3c3e1aade9d7ec" } modify_external_catalogs: true
I20250830 07:54:42.040179 13233 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_ee2734eae1204d188a3c3e1aade9d7ec" } modify_external_catalogs: true
W20250830 07:54:42.040313 13227 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b59b0e75bbee4971912072e1174aad74 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:42.041644 13232 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_4e84ca71cc784cd78c5223e4b6c49f49" } new_table_name: "default.Table_32ff7c454b324d9f8b37a9d40f3bdc35" modify_external_catalogs: true
I20250830 07:54:42.044124 13230 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_2c4b8a7c25664cc4babc5c58ec16a720" } modify_external_catalogs: true
I20250830 07:54:42.044305 13230 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_2c4b8a7c25664cc4babc5c58ec16a720" } modify_external_catalogs: true
I20250830 07:54:42.044879 13886 tablet_bootstrap.cc:492] T 2be43f828f204f599017b6a04cf2ddf9 P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:54:42.045552 14497 tablet_replica.cc:331] T cada6410e2884c508bb7dd38bea438ae P 6b5e454d98894637b466ea27f1b647f9: stopping tablet replica
I20250830 07:54:42.045806 14497 raft_consensus.cc:2241] T cada6410e2884c508bb7dd38bea438ae P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250830 07:54:42.047435 14497 raft_consensus.cc:2270] T cada6410e2884c508bb7dd38bea438ae P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250830 07:54:42.048161 14643 raft_consensus.cc:491] T 6dda55ec2da34c8aba9f39a63e144a7c P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20250830 07:54:42.048321 13234 catalog_manager.cc:5415] Ignoring report from unknown tablet d3f207cee78a43a1b5e030c09752c78c
I20250830 07:54:42.048321 14643 raft_consensus.cc:513] T 6dda55ec2da34c8aba9f39a63e144a7c P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:42.048975 14643 leader_election.cc:290] T 6dda55ec2da34c8aba9f39a63e144a7c P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:42.050424 13606 tablet_service.cc:1515] Processing DeleteTablet for tablet 4b403cadfb7b42f8896b2ee16b50ecb1 with delete_type TABLET_DATA_DELETED (replaced by tablet 6f8b6f233e5c49b39b3ef6314508e9d9) from {username='slave'} at 127.0.0.1:45306
I20250830 07:54:42.052048 14497 ts_tablet_manager.cc:1905] T cada6410e2884c508bb7dd38bea438ae P 6b5e454d98894637b466ea27f1b647f9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250830 07:54:42.053334 14445 consensus_queue.cc:1035] T 62ee2d0fbd774d38a4a4c4a033584ef9 P 6b5e454d98894637b466ea27f1b647f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
W20250830 07:54:42.054854 13234 catalog_manager.cc:5415] Ignoring report from unknown tablet d3f207cee78a43a1b5e030c09752c78c
I20250830 07:54:42.059057 13594 tablet_service.cc:1515] Processing DeleteTablet for tablet ee44ab24333742909f773889ad5c3e00 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:41 UTC) from {username='slave'} at 127.0.0.1:45306
I20250830 07:54:42.063776 13606 tablet_service.cc:1515] Processing DeleteTablet for tablet 1520d7257f864ea4ba4b9a5d0443f8a7 with delete_type TABLET_DATA_DELETED (replaced by tablet 76dd9dd481fc427fb20f5091e4a3b738) from {username='slave'} at 127.0.0.1:45306
I20250830 07:54:42.064985 13628 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "6dda55ec2da34c8aba9f39a63e144a7c" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:42.065253 13628 raft_consensus.cc:2391] T 6dda55ec2da34c8aba9f39a63e144a7c P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2065c332f15a4739899af79f3669c3ba in current term 1: Already voted for candidate 9b057ade5dce45af9f8bf0bedf8b917f in this term.
I20250830 07:54:42.068893 13887 tablet_bootstrap.cc:492] T 8dddcfe56522436287aea212e316a729 P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:54:42.069120 13887 ts_tablet_manager.cc:1397] T 8dddcfe56522436287aea212e316a729 P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.034s user 0.005s sys 0.002s
I20250830 07:54:42.071930 14526 raft_consensus.cc:513] T 66499e87e3d7422ca7a449cc2e89e709 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:42.075278 13887 raft_consensus.cc:357] T 8dddcfe56522436287aea212e316a729 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:42.075452 13485 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "66499e87e3d7422ca7a449cc2e89e709" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:54:42.075536 13887 raft_consensus.cc:383] T 8dddcfe56522436287aea212e316a729 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:42.075707 13887 raft_consensus.cc:738] T 8dddcfe56522436287aea212e316a729 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:54:42.075985 13887 consensus_queue.cc:260] T 8dddcfe56522436287aea212e316a729 P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:42.076854 14526 leader_election.cc:290] T 66499e87e3d7422ca7a449cc2e89e709 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:42.080471 13226 catalog_manager.cc:5674] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325) does not have the latest schema for tablet 8dddcfe56522436287aea212e316a729 (table default.Table_e0d2400861094b258fca0704d88ed743 [id=c483c08824f24586855e3575a590b294]). Expected version 2 got 0
I20250830 07:54:42.084681 13887 ts_tablet_manager.cc:1428] T 8dddcfe56522436287aea212e316a729 P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.015s user 0.002s sys 0.000s
I20250830 07:54:42.074393 14497 ts_tablet_manager.cc:1918] T cada6410e2884c508bb7dd38bea438ae P 6b5e454d98894637b466ea27f1b647f9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20250830 07:54:42.085939 14497 log.cc:1199] T cada6410e2884c508bb7dd38bea438ae P 6b5e454d98894637b466ea27f1b647f9: Deleting WAL directory at /tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/ts-1/wal/wals/cada6410e2884c508bb7dd38bea438ae
I20250830 07:54:42.086562 14497 ts_tablet_manager.cc:1939] T cada6410e2884c508bb7dd38bea438ae P 6b5e454d98894637b466ea27f1b647f9: Deleting consensus metadata
I20250830 07:54:42.087877 13220 catalog_manager.cc:4928] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): tablet cada6410e2884c508bb7dd38bea438ae (table default.Table_0e39abf281604c1792ea7cbac795787e [id=4678375d8d3d474290ad1a254de14054]) successfully deleted
W20250830 07:54:42.089262 13220 catalog_manager.cc:4908] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet 4b403cadfb7b42f8896b2ee16b50ecb1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4b403cadfb7b42f8896b2ee16b50ecb1 already in progress: creating tablet
W20250830 07:54:42.090358 13220 catalog_manager.cc:4908] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet ee44ab24333742909f773889ad5c3e00 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ee44ab24333742909f773889ad5c3e00 already in progress: creating tablet
W20250830 07:54:42.091437 13220 catalog_manager.cc:4908] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet 1520d7257f864ea4ba4b9a5d0443f8a7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1520d7257f864ea4ba4b9a5d0443f8a7 already in progress: creating tablet
I20250830 07:54:42.091732 13887 tablet_bootstrap.cc:492] T ffc5945a032e47d4bd3397d7c887dc62 P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:54:42.093768 13226 catalog_manager.cc:5674] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325) does not have the latest schema for tablet 8dddcfe56522436287aea212e316a729 (table default.Table_e0d2400861094b258fca0704d88ed743 [id=c483c08824f24586855e3575a590b294]). Expected version 2 got 0
I20250830 07:54:42.093562 13887 tablet_bootstrap.cc:654] T ffc5945a032e47d4bd3397d7c887dc62 P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:42.104305 13887 tablet_bootstrap.cc:492] T ffc5945a032e47d4bd3397d7c887dc62 P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:54:42.104534 13887 ts_tablet_manager.cc:1397] T ffc5945a032e47d4bd3397d7c887dc62 P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.013s user 0.004s sys 0.006s
I20250830 07:54:42.105897 13887 raft_consensus.cc:357] T ffc5945a032e47d4bd3397d7c887dc62 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:42.106865 13887 raft_consensus.cc:383] T ffc5945a032e47d4bd3397d7c887dc62 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:42.107028 13887 raft_consensus.cc:738] T ffc5945a032e47d4bd3397d7c887dc62 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:54:42.107369 13887 consensus_queue.cc:260] T ffc5945a032e47d4bd3397d7c887dc62 P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:42.111860 13887 ts_tablet_manager.cc:1428] T ffc5945a032e47d4bd3397d7c887dc62 P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.007s user 0.002s sys 0.000s
I20250830 07:54:42.112243 13887 tablet_bootstrap.cc:492] T ea8ccd7ef791471291bca049bdf7f643 P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:54:42.113817 14526 consensus_queue.cc:1035] T 853503f3f98a49219b077af980180400 P 6b5e454d98894637b466ea27f1b647f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20250830 07:54:42.114792 13226 catalog_manager.cc:5415] Ignoring report from unknown tablet ffc5945a032e47d4bd3397d7c887dc62
I20250830 07:54:42.115772 13226 master_service.cc:948] ReplaceTablet: received request to replace tablet 007435e198b9440db055711a98e3148a from {username='slave'} at 127.0.0.1:42126
I20250830 07:54:42.118788 13233 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet 48b422b125154fbdbb9c995dc372d128
I20250830 07:54:42.119807 13468 tablet_service.cc:1515] Processing DeleteTablet for tablet 48b422b125154fbdbb9c995dc372d128 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:42 UTC) from {username='slave'} at 127.0.0.1:37956
I20250830 07:54:42.120074 13606 tablet_service.cc:1515] Processing DeleteTablet for tablet 48b422b125154fbdbb9c995dc372d128 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:42 UTC) from {username='slave'} at 127.0.0.1:45306
I20250830 07:54:42.120363 13883 tablet_replica.cc:331] T 48b422b125154fbdbb9c995dc372d128 P 2065c332f15a4739899af79f3669c3ba: stopping tablet replica
I20250830 07:54:42.120599 13883 raft_consensus.cc:2241] T 48b422b125154fbdbb9c995dc372d128 P 2065c332f15a4739899af79f3669c3ba [term 1 LEADER]: Raft consensus shutting down.
I20250830 07:54:42.120959 13883 raft_consensus.cc:2270] T 48b422b125154fbdbb9c995dc372d128 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Raft consensus is shut down!
W20250830 07:54:42.121156 13232 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 3bca390f6d4343cba7a9fb07f0d4d72b has no consensus state
I20250830 07:54:42.121497 13230 catalog_manager.cc:5864] Not sending DeleteTablet requests; no consensus state for tablet c41821a964b7470d9d5ff2889a81579c
I20250830 07:54:42.121515 13883 ts_tablet_manager.cc:1905] T 48b422b125154fbdbb9c995dc372d128 P 2065c332f15a4739899af79f3669c3ba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250830 07:54:42.121804 13887 tablet_bootstrap.cc:654] T ea8ccd7ef791471291bca049bdf7f643 P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:42.118782 13231 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet 057bcce2860345da860acc262dc4d339
I20250830 07:54:42.124897 13468 tablet_service.cc:1515] Processing DeleteTablet for tablet 057bcce2860345da860acc262dc4d339 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:42 UTC) from {username='slave'} at 127.0.0.1:37956
I20250830 07:54:42.125201 13606 tablet_service.cc:1515] Processing DeleteTablet for tablet 057bcce2860345da860acc262dc4d339 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:42 UTC) from {username='slave'} at 127.0.0.1:45306
W20250830 07:54:42.127521 13231 catalog_manager.cc:5415] Ignoring report from unknown tablet 1fa571e9490e499792225d7b786e8658
W20250830 07:54:42.127660 13231 catalog_manager.cc:5415] Ignoring report from unknown tablet e4f1ff6026bb45e28e63c27c83399d72
I20250830 07:54:42.127921 13231 catalog_manager.cc:5674] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967) does not have the latest schema for tablet 14ed24577c8f49f49c83242a26877614 (table default.Table_4428c29c8358411282f00fd33a6badd4 [id=bcee72f9b1c6407f98435a1494b42407]). Expected version 1 got 0
I20250830 07:54:42.131229 14497 tablet_replica.cc:331] T 48b422b125154fbdbb9c995dc372d128 P 6b5e454d98894637b466ea27f1b647f9: stopping tablet replica
I20250830 07:54:42.131605 14497 raft_consensus.cc:2241] T 48b422b125154fbdbb9c995dc372d128 P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250830 07:54:42.131892 14497 raft_consensus.cc:2270] T 48b422b125154fbdbb9c995dc372d128 P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250830 07:54:42.135095 14497 ts_tablet_manager.cc:1905] T 48b422b125154fbdbb9c995dc372d128 P 6b5e454d98894637b466ea27f1b647f9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250830 07:54:42.139703 13883 ts_tablet_manager.cc:1918] T 48b422b125154fbdbb9c995dc372d128 P 2065c332f15a4739899af79f3669c3ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250830 07:54:42.139909 13883 log.cc:1199] T 48b422b125154fbdbb9c995dc372d128 P 2065c332f15a4739899af79f3669c3ba: Deleting WAL directory at /tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/ts-0/wal/wals/48b422b125154fbdbb9c995dc372d128
I20250830 07:54:42.140502 13883 ts_tablet_manager.cc:1939] T 48b422b125154fbdbb9c995dc372d128 P 2065c332f15a4739899af79f3669c3ba: Deleting consensus metadata
I20250830 07:54:42.144450 13218 catalog_manager.cc:4928] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): tablet 48b422b125154fbdbb9c995dc372d128 (table default.Table_ee2734eae1204d188a3c3e1aade9d7ec [id=ee5e5b17ad024d64bef5883d6d68e559]) successfully deleted
W20250830 07:54:42.144783 13218 catalog_manager.cc:4908] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): delete failed for tablet 057bcce2860345da860acc262dc4d339 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 057bcce2860345da860acc262dc4d339 already in progress: creating tablet
I20250830 07:54:42.151029 13233 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_dea7d93cf4a54c2286537025b82a70ca" } new_table_name: "default.Table_337ffcdb618e443ab9f21511ef2f615c" modify_external_catalogs: true
I20250830 07:54:42.153769 13226 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_3fbd1233b99946efb6b91985da1eae8f" } new_table_name: "default.Table_ce89cbd80466451bb90a1f15fc7bc98c" modify_external_catalogs: true
I20250830 07:54:42.155920 13230 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_b8991c6c42d9443fa2651b93326d4556" } modify_external_catalogs: true
I20250830 07:54:42.156100 13230 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_b8991c6c42d9443fa2651b93326d4556" } modify_external_catalogs: true
I20250830 07:54:42.157171 13232 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_09c158a41a074beaabc02c2079b0d5c8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:42.157683 13232 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_09c158a41a074beaabc02c2079b0d5c8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:42.159561 13227 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_d601d7d0f55744e5b227aa7b31516c20" } modify_external_catalogs: true
I20250830 07:54:42.159715 13227 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_d601d7d0f55744e5b227aa7b31516c20" } modify_external_catalogs: true
I20250830 07:54:42.160696 13882 tablet_bootstrap.cc:492] T e862fa77e16945bd94e405aa3474f021 P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:54:42.160866 13882 ts_tablet_manager.cc:1397] T e862fa77e16945bd94e405aa3474f021 P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.319s user 0.010s sys 0.003s
I20250830 07:54:42.161669 13882 raft_consensus.cc:357] T e862fa77e16945bd94e405aa3474f021 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:42.161877 13882 raft_consensus.cc:383] T e862fa77e16945bd94e405aa3474f021 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:42.161957 13882 raft_consensus.cc:738] T e862fa77e16945bd94e405aa3474f021 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:54:42.162242 13882 consensus_queue.cc:260] T e862fa77e16945bd94e405aa3474f021 P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:42.162716 13882 ts_tablet_manager.cc:1428] T e862fa77e16945bd94e405aa3474f021 P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
W20250830 07:54:42.162981 13234 catalog_manager.cc:5415] Ignoring report from unknown tablet 853503f3f98a49219b077af980180400
W20250830 07:54:42.163065 13234 catalog_manager.cc:5415] Ignoring report from unknown tablet ffc5945a032e47d4bd3397d7c887dc62
I20250830 07:54:42.170157 13772 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "6dda55ec2da34c8aba9f39a63e144a7c" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
W20250830 07:54:42.170334 13234 catalog_manager.cc:5415] Ignoring report from unknown tablet 853503f3f98a49219b077af980180400
I20250830 07:54:42.171049 13755 tablet_service.cc:1515] Processing DeleteTablet for tablet 48b422b125154fbdbb9c995dc372d128 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:42 UTC) from {username='slave'} at 127.0.0.1:45460
I20250830 07:54:42.171054 13231 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_7ca088845834445cb9cb88eccd1e7e8a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:42.171535 13231 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7ca088845834445cb9cb88eccd1e7e8a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:42.171751 13422 leader_election.cc:304] T 6dda55ec2da34c8aba9f39a63e144a7c P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba; no voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:54:42.172264 14646 raft_consensus.cc:3058] T 6dda55ec2da34c8aba9f39a63e144a7c P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:42.174753 13886 ts_tablet_manager.cc:1397] T 2be43f828f204f599017b6a04cf2ddf9 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.295s user 0.004s sys 0.027s
I20250830 07:54:42.175019 14646 raft_consensus.cc:2747] T 6dda55ec2da34c8aba9f39a63e144a7c P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:54:42.174983 14640 tablet.cc:1722] T d4e35395930f4c37b34649da5718aa1f P 9b057ade5dce45af9f8bf0bedf8b917f: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20250830 07:54:42.176868 13225 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_4a85f0b02480477f8740a7e741f992f0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:42.177703 13234 catalog_manager.cc:5415] Ignoring report from unknown tablet e862fa77e16945bd94e405aa3474f021
I20250830 07:54:42.177660 13229 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_51365a3c8c03499fb338a0498ee0ed07"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250830 07:54:42.177958 13228 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_dfe393a221e54d719df225ec7723bdf1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:42.178135 13229 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_51365a3c8c03499fb338a0498ee0ed07 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250830 07:54:42.178383 13228 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_dfe393a221e54d719df225ec7723bdf1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250830 07:54:42.179893 13225 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4a85f0b02480477f8740a7e741f992f0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:42.180892 14646 consensus_queue.cc:1035] T 66499e87e3d7422ca7a449cc2e89e709 P 2065c332f15a4739899af79f3669c3ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20250830 07:54:42.187633 13234 catalog_manager.cc:5415] Ignoring report from unknown tablet 853503f3f98a49219b077af980180400
I20250830 07:54:42.191232 13234 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_a3d67b6062f44266afff85d510239f6e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250830 07:54:42.191506 14505 tablet_replica.cc:331] T 48b422b125154fbdbb9c995dc372d128 P 9b057ade5dce45af9f8bf0bedf8b917f: stopping tablet replica
I20250830 07:54:42.191721 14505 raft_consensus.cc:2241] T 48b422b125154fbdbb9c995dc372d128 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Raft consensus shutting down.
W20250830 07:54:42.191833 13234 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a3d67b6062f44266afff85d510239f6e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:42.191919 14505 raft_consensus.cc:2270] T 48b422b125154fbdbb9c995dc372d128 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Raft consensus is shut down!
I20250830 07:54:42.192451 14505 ts_tablet_manager.cc:1905] T 48b422b125154fbdbb9c995dc372d128 P 9b057ade5dce45af9f8bf0bedf8b917f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250830 07:54:42.195727 13230 catalog_manager.cc:5864] Not sending DeleteTablet requests; no consensus state for tablet f224503ee9e94065a86171fe758b6bae
I20250830 07:54:42.196060 13230 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_9988c7c93c1e4a8e93d8402ee3bff2e8" } new_table_name: "default.Table_215b44de73fc4fe88b61c20067b961dd" modify_external_catalogs: true
W20250830 07:54:42.196156 13233 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet e6b7646588fe4134b2db62ff84ca4791 consensus state has no leader
I20250830 07:54:42.196718 13233 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_9eae6b032d184bee81196ba47638cdb3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250830 07:54:42.196844 13227 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet 53a933afa4b74095baf0f54736d99bf0
W20250830 07:54:42.197173 13233 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9eae6b032d184bee81196ba47638cdb3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:42.197564 13232 master_service.cc:948] ReplaceTablet: received request to replace tablet e4f1ff6026bb45e28e63c27c83399d72 from {username='slave'} at 127.0.0.1:42126
I20250830 07:54:42.197714 13227 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_29b9901c90514282855f50d19ebedb4c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:42.198271 13227 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_29b9901c90514282855f50d19ebedb4c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:42.198833 13232 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_bc55377123bb4f3cbbcd992cedbab17e" } new_table_name: "default.Table_89e31bbe0cde4122a2d98a13059c5b87" modify_external_catalogs: true
I20250830 07:54:42.199591 13755 tablet_service.cc:1515] Processing DeleteTablet for tablet 057bcce2860345da860acc262dc4d339 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:42 UTC) from {username='slave'} at 127.0.0.1:45460
I20250830 07:54:42.199736 13468 tablet_service.cc:1515] Processing DeleteTablet for tablet 53a933afa4b74095baf0f54736d99bf0 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:42 UTC) from {username='slave'} at 127.0.0.1:37956
I20250830 07:54:42.199982 13606 tablet_service.cc:1515] Processing DeleteTablet for tablet 53a933afa4b74095baf0f54736d99bf0 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:42 UTC) from {username='slave'} at 127.0.0.1:45306
I20250830 07:54:42.200354 13771 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "66499e87e3d7422ca7a449cc2e89e709" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:42.201349 13755 tablet_service.cc:1515] Processing DeleteTablet for tablet 53a933afa4b74095baf0f54736d99bf0 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:42 UTC) from {username='slave'} at 127.0.0.1:45460
W20250830 07:54:42.202415 13562 consensus_peers.cc:489] T 853503f3f98a49219b077af980180400 P 6b5e454d98894637b466ea27f1b647f9 -> Peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Couldn't send request to peer 9b057ade5dce45af9f8bf0bedf8b917f. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20250830 07:54:42.202705 13562 leader_election.cc:304] T 66499e87e3d7422ca7a449cc2e89e709 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b5e454d98894637b466ea27f1b647f9; no voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f
W20250830 07:54:42.202764 13226 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a7dc529c40544bafbc9e7f0ab34086bd consensus state has no leader
I20250830 07:54:42.202979 14480 raft_consensus.cc:2747] T 66499e87e3d7422ca7a449cc2e89e709 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:54:42.203130 13226 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_3abc6459ae534133b6d4f903931c1389"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:42.203565 13226 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3abc6459ae534133b6d4f903931c1389 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:42.204988 13882 tablet_bootstrap.cc:492] T 8dddcfe56522436287aea212e316a729 P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
W20250830 07:54:42.206058 13218 catalog_manager.cc:4908] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): delete failed for tablet 53a933afa4b74095baf0f54736d99bf0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 53a933afa4b74095baf0f54736d99bf0 already in progress: creating tablet
I20250830 07:54:42.207581 13882 tablet_bootstrap.cc:654] T 8dddcfe56522436287aea212e316a729 P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:42.208720 13886 raft_consensus.cc:357] T 2be43f828f204f599017b6a04cf2ddf9 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:42.208963 13886 raft_consensus.cc:383] T 2be43f828f204f599017b6a04cf2ddf9 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:42.209046 13886 raft_consensus.cc:738] T 2be43f828f204f599017b6a04cf2ddf9 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:54:42.209476 13886 consensus_queue.cc:260] T 2be43f828f204f599017b6a04cf2ddf9 P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:42.210341 13886 ts_tablet_manager.cc:1428] T 2be43f828f204f599017b6a04cf2ddf9 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.035s user 0.002s sys 0.000s
I20250830 07:54:42.210672 13886 tablet_bootstrap.cc:492] T 853503f3f98a49219b077af980180400 P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:54:42.212512 13886 tablet_bootstrap.cc:654] T 853503f3f98a49219b077af980180400 P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:42.219424 13231 master_service.cc:948] ReplaceTablet: received request to replace tablet 533811110191436d96665b3475ab597f from {username='slave'} at 127.0.0.1:42126
W20250830 07:54:42.222143 13231 catalog_manager.cc:5415] Ignoring report from unknown tablet e862fa77e16945bd94e405aa3474f021
W20250830 07:54:42.222252 13231 catalog_manager.cc:5415] Ignoring report from unknown tablet 1fa571e9490e499792225d7b786e8658
I20250830 07:54:42.226902 14505 ts_tablet_manager.cc:1918] T 48b422b125154fbdbb9c995dc372d128 P 9b057ade5dce45af9f8bf0bedf8b917f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250830 07:54:42.229974 14497 ts_tablet_manager.cc:1918] T 48b422b125154fbdbb9c995dc372d128 P 6b5e454d98894637b466ea27f1b647f9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250830 07:54:42.230134 14497 log.cc:1199] T 48b422b125154fbdbb9c995dc372d128 P 6b5e454d98894637b466ea27f1b647f9: Deleting WAL directory at /tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/ts-1/wal/wals/48b422b125154fbdbb9c995dc372d128
I20250830 07:54:42.230517 14497 ts_tablet_manager.cc:1939] T 48b422b125154fbdbb9c995dc372d128 P 6b5e454d98894637b466ea27f1b647f9: Deleting consensus metadata
I20250830 07:54:42.231051 13220 catalog_manager.cc:4928] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): tablet 48b422b125154fbdbb9c995dc372d128 (table default.Table_ee2734eae1204d188a3c3e1aade9d7ec [id=ee5e5b17ad024d64bef5883d6d68e559]) successfully deleted
I20250830 07:54:42.232465 13624 raft_consensus.cc:3058] T 66499e87e3d7422ca7a449cc2e89e709 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Advancing to term 1
W20250830 07:54:42.235888 13232 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 087bb1e80d2d44bf8619b0341ff99527 consensus state has no leader
W20250830 07:54:42.237609 13230 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 439fc51afa6b435e81bc38b9e88d4041 has no consensus state
I20250830 07:54:42.243011 14402 consensus_queue.cc:1035] T 66499e87e3d7422ca7a449cc2e89e709 P 2065c332f15a4739899af79f3669c3ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20250830 07:54:42.243726 13220 catalog_manager.cc:4908] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet 057bcce2860345da860acc262dc4d339 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 057bcce2860345da860acc262dc4d339 already in progress: creating tablet
I20250830 07:54:42.254015 14505 log.cc:1199] T 48b422b125154fbdbb9c995dc372d128 P 9b057ade5dce45af9f8bf0bedf8b917f: Deleting WAL directory at /tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/ts-2/wal/wals/48b422b125154fbdbb9c995dc372d128
I20250830 07:54:42.254563 14505 ts_tablet_manager.cc:1939] T 48b422b125154fbdbb9c995dc372d128 P 9b057ade5dce45af9f8bf0bedf8b917f: Deleting consensus metadata
I20250830 07:54:42.258127 13219 catalog_manager.cc:4928] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): tablet 48b422b125154fbdbb9c995dc372d128 (table default.Table_ee2734eae1204d188a3c3e1aade9d7ec [id=ee5e5b17ad024d64bef5883d6d68e559]) successfully deleted
I20250830 07:54:42.242568 13886 tablet_bootstrap.cc:492] T 853503f3f98a49219b077af980180400 P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:54:42.259083 13886 ts_tablet_manager.cc:1397] T 853503f3f98a49219b077af980180400 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.048s user 0.004s sys 0.000s
I20250830 07:54:42.259940 13886 raft_consensus.cc:357] T 853503f3f98a49219b077af980180400 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:42.260130 13886 raft_consensus.cc:383] T 853503f3f98a49219b077af980180400 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:42.260241 13886 raft_consensus.cc:738] T 853503f3f98a49219b077af980180400 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:54:42.260499 13886 consensus_queue.cc:260] T 853503f3f98a49219b077af980180400 P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:42.261215 13886 ts_tablet_manager.cc:1428] T 853503f3f98a49219b077af980180400 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20250830 07:54:42.261520 13886 tablet_bootstrap.cc:492] T ea8ccd7ef791471291bca049bdf7f643 P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
W20250830 07:54:42.262768 13219 catalog_manager.cc:4908] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): delete failed for tablet 057bcce2860345da860acc262dc4d339 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 057bcce2860345da860acc262dc4d339 already in progress: creating tablet
I20250830 07:54:42.263340 13886 tablet_bootstrap.cc:654] T ea8ccd7ef791471291bca049bdf7f643 P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
W20250830 07:54:42.263423 13219 catalog_manager.cc:4908] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): delete failed for tablet 53a933afa4b74095baf0f54736d99bf0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 53a933afa4b74095baf0f54736d99bf0 already in progress: creating tablet
W20250830 07:54:42.267508 13220 catalog_manager.cc:4908] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet 53a933afa4b74095baf0f54736d99bf0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 53a933afa4b74095baf0f54736d99bf0 already in progress: creating tablet
I20250830 07:54:42.268983 13887 tablet_bootstrap.cc:492] T ea8ccd7ef791471291bca049bdf7f643 P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:54:42.269174 13887 ts_tablet_manager.cc:1397] T ea8ccd7ef791471291bca049bdf7f643 P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.157s user 0.015s sys 0.014s
I20250830 07:54:42.270169 13887 raft_consensus.cc:357] T ea8ccd7ef791471291bca049bdf7f643 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:42.270406 13887 raft_consensus.cc:383] T ea8ccd7ef791471291bca049bdf7f643 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:42.270540 13887 raft_consensus.cc:738] T ea8ccd7ef791471291bca049bdf7f643 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:54:42.270797 13887 consensus_queue.cc:260] T ea8ccd7ef791471291bca049bdf7f643 P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:42.271478 13887 ts_tablet_manager.cc:1428] T ea8ccd7ef791471291bca049bdf7f643 P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20250830 07:54:42.271785 13887 tablet_bootstrap.cc:492] T e4c5eedb7f4d4397b19b8a3e0ddf9458 P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:54:42.273550 13887 tablet_bootstrap.cc:654] T e4c5eedb7f4d4397b19b8a3e0ddf9458 P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:42.275373 13882 tablet_bootstrap.cc:492] T 8dddcfe56522436287aea212e316a729 P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:54:42.275568 13882 ts_tablet_manager.cc:1397] T 8dddcfe56522436287aea212e316a729 P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.071s user 0.004s sys 0.000s
I20250830 07:54:42.276420 13882 raft_consensus.cc:357] T 8dddcfe56522436287aea212e316a729 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:42.276634 13882 raft_consensus.cc:383] T 8dddcfe56522436287aea212e316a729 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:42.276757 13882 raft_consensus.cc:738] T 8dddcfe56522436287aea212e316a729 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:54:42.277016 13882 consensus_queue.cc:260] T 8dddcfe56522436287aea212e316a729 P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:42.277657 13882 ts_tablet_manager.cc:1428] T 8dddcfe56522436287aea212e316a729 P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20250830 07:54:42.277938 13882 tablet_bootstrap.cc:492] T cf5613278b4c4f3bbe751b1ae6f3c313 P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:54:42.279524 13882 tablet_bootstrap.cc:654] T cf5613278b4c4f3bbe751b1ae6f3c313 P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
W20250830 07:54:42.292316 13230 catalog_manager.cc:5415] Ignoring report from unknown tablet 853503f3f98a49219b077af980180400
W20250830 07:54:42.292460 13230 catalog_manager.cc:5415] Ignoring report from unknown tablet ff0f9cccc8ed43b1a8cd38de0e9d4097
W20250830 07:54:42.292559 13230 catalog_manager.cc:5415] Ignoring report from unknown tablet 27da527d9fe045ae8c17f193d034f5ac
W20250830 07:54:42.292642 13230 catalog_manager.cc:5415] Ignoring report from unknown tablet 1fa571e9490e499792225d7b786e8658
I20250830 07:54:42.294456 13226 master_service.cc:948] ReplaceTablet: received request to replace tablet 689b4fee1dd04b3d9ccdea334b0f6b59 from {username='slave'} at 127.0.0.1:42126
I20250830 07:54:42.294519 13755 tablet_service.cc:1515] Processing DeleteTablet for tablet 2be43f828f204f599017b6a04cf2ddf9 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:41 UTC) from {username='slave'} at 127.0.0.1:45460
I20250830 07:54:42.297863 14505 tablet_replica.cc:331] T 2be43f828f204f599017b6a04cf2ddf9 P 9b057ade5dce45af9f8bf0bedf8b917f: stopping tablet replica
I20250830 07:54:42.298161 14505 raft_consensus.cc:2241] T 2be43f828f204f599017b6a04cf2ddf9 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Raft consensus shutting down.
I20250830 07:54:42.298364 14505 raft_consensus.cc:2270] T 2be43f828f204f599017b6a04cf2ddf9 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Raft consensus is shut down!
I20250830 07:54:42.306249 13234 master_service.cc:948] ReplaceTablet: received request to replace tablet 9e055d6089f541f799eddb5778eb2148 from {username='slave'} at 127.0.0.1:42126
I20250830 07:54:42.306346 14505 ts_tablet_manager.cc:1905] T 2be43f828f204f599017b6a04cf2ddf9 P 9b057ade5dce45af9f8bf0bedf8b917f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250830 07:54:42.314770 13887 tablet_bootstrap.cc:492] T e4c5eedb7f4d4397b19b8a3e0ddf9458 P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:54:42.314951 13887 ts_tablet_manager.cc:1397] T e4c5eedb7f4d4397b19b8a3e0ddf9458 P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.043s user 0.002s sys 0.000s
I20250830 07:54:42.315671 13887 raft_consensus.cc:357] T e4c5eedb7f4d4397b19b8a3e0ddf9458 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:42.315858 13887 raft_consensus.cc:383] T e4c5eedb7f4d4397b19b8a3e0ddf9458 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:42.315923 13887 raft_consensus.cc:738] T e4c5eedb7f4d4397b19b8a3e0ddf9458 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:54:42.316143 13887 consensus_queue.cc:260] T e4c5eedb7f4d4397b19b8a3e0ddf9458 P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:42.317817 13468 tablet_service.cc:1515] Processing DeleteTablet for tablet ea8ccd7ef791471291bca049bdf7f643 with delete_type TABLET_DATA_DELETED (replaced by tablet 690cf258639a4c1ea5a0ac4f2fd39f88) from {username='slave'} at 127.0.0.1:37956
I20250830 07:54:42.318127 13883 tablet_replica.cc:331] T ea8ccd7ef791471291bca049bdf7f643 P 2065c332f15a4739899af79f3669c3ba: stopping tablet replica
I20250830 07:54:42.318367 13883 raft_consensus.cc:2241] T ea8ccd7ef791471291bca049bdf7f643 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Raft consensus shutting down.
I20250830 07:54:42.327001 13883 raft_consensus.cc:2270] T ea8ccd7ef791471291bca049bdf7f643 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Raft consensus is shut down!
I20250830 07:54:42.327234 14644 raft_consensus.cc:491] T ffc5945a032e47d4bd3397d7c887dc62 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:42.327378 14644 raft_consensus.cc:513] T ffc5945a032e47d4bd3397d7c887dc62 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:42.327744 13883 ts_tablet_manager.cc:1905] T ea8ccd7ef791471291bca049bdf7f643 P 2065c332f15a4739899af79f3669c3ba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250830 07:54:42.328068 14644 leader_election.cc:290] T ffc5945a032e47d4bd3397d7c887dc62 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:42.327385 14645 raft_consensus.cc:491] T b38c8d003413428dae9e47f58e197c2c P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:42.328488 14645 raft_consensus.cc:513] T b38c8d003413428dae9e47f58e197c2c P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:42.328819 13624 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "ffc5945a032e47d4bd3397d7c887dc62" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:42.329123 14645 leader_election.cc:290] T b38c8d003413428dae9e47f58e197c2c P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
W20250830 07:54:42.329562 13423 leader_election.cc:343] T ffc5945a032e47d4bd3397d7c887dc62 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:42.331190 14645 raft_consensus.cc:491] T f56cab43580a4ee3a912fc5e58a3bd9d P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:42.331339 14645 raft_consensus.cc:513] T f56cab43580a4ee3a912fc5e58a3bd9d P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:42.332208 14645 leader_election.cc:290] T f56cab43580a4ee3a912fc5e58a3bd9d P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:42.328356 13887 ts_tablet_manager.cc:1428] T e4c5eedb7f4d4397b19b8a3e0ddf9458 P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.013s user 0.001s sys 0.000s
W20250830 07:54:42.333990 13230 catalog_manager.cc:5415] Ignoring report from unknown tablet e4c5eedb7f4d4397b19b8a3e0ddf9458
I20250830 07:54:42.334223 13628 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f56cab43580a4ee3a912fc5e58a3bd9d" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
W20250830 07:54:42.334637 13423 leader_election.cc:343] T f56cab43580a4ee3a912fc5e58a3bd9d P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:42.335799 13624 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "b38c8d003413428dae9e47f58e197c2c" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
W20250830 07:54:42.336225 13423 leader_election.cc:343] T b38c8d003413428dae9e47f58e197c2c P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:42.336359 13883 ts_tablet_manager.cc:1918] T ea8ccd7ef791471291bca049bdf7f643 P 2065c332f15a4739899af79f3669c3ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250830 07:54:42.336509 13883 log.cc:1199] T ea8ccd7ef791471291bca049bdf7f643 P 2065c332f15a4739899af79f3669c3ba: Deleting WAL directory at /tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/ts-0/wal/wals/ea8ccd7ef791471291bca049bdf7f643
I20250830 07:54:42.336881 13883 ts_tablet_manager.cc:1939] T ea8ccd7ef791471291bca049bdf7f643 P 2065c332f15a4739899af79f3669c3ba: Deleting consensus metadata
I20250830 07:54:42.337456 13887 tablet_bootstrap.cc:492] T 7af74bdde363493f8061eba450ecf4b4 P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:54:42.337772 13218 catalog_manager.cc:4928] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): tablet ea8ccd7ef791471291bca049bdf7f643 (table default.Table_523d7bc660f94c9db577f499e22c772f [id=3582c72cab4b4e1084021b098ec30f87]) successfully deleted
I20250830 07:54:42.338099 13882 tablet_bootstrap.cc:492] T cf5613278b4c4f3bbe751b1ae6f3c313 P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:54:42.338249 13882 ts_tablet_manager.cc:1397] T cf5613278b4c4f3bbe751b1ae6f3c313 P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.060s user 0.003s sys 0.000s
I20250830 07:54:42.339046 13882 raft_consensus.cc:357] T cf5613278b4c4f3bbe751b1ae6f3c313 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:42.339267 13882 raft_consensus.cc:383] T cf5613278b4c4f3bbe751b1ae6f3c313 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:42.339362 13882 raft_consensus.cc:738] T cf5613278b4c4f3bbe751b1ae6f3c313 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:54:42.339592 13882 consensus_queue.cc:260] T cf5613278b4c4f3bbe751b1ae6f3c313 P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:42.340008 13882 ts_tablet_manager.cc:1428] T cf5613278b4c4f3bbe751b1ae6f3c313 P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20250830 07:54:42.340240 13882 tablet_bootstrap.cc:492] T 69d6daeb7c774fd48ed296f52ed7c6a6 P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:54:42.341398 13882 tablet_bootstrap.cc:654] T 69d6daeb7c774fd48ed296f52ed7c6a6 P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:42.343859 13771 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "ffc5945a032e47d4bd3397d7c887dc62" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:42.344477 13774 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f56cab43580a4ee3a912fc5e58a3bd9d" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:42.343901 13770 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "b38c8d003413428dae9e47f58e197c2c" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
W20250830 07:54:42.345269 13422 leader_election.cc:343] T ffc5945a032e47d4bd3397d7c887dc62 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:42.345394 13422 leader_election.cc:304] T ffc5945a032e47d4bd3397d7c887dc62 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba; no voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:54:42.345697 14645 raft_consensus.cc:2747] T ffc5945a032e47d4bd3397d7c887dc62 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20250830 07:54:42.345899 13422 leader_election.cc:343] T f56cab43580a4ee3a912fc5e58a3bd9d P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:42.346001 13422 leader_election.cc:304] T f56cab43580a4ee3a912fc5e58a3bd9d P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba; no voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:54:42.346203 14645 raft_consensus.cc:2747] T f56cab43580a4ee3a912fc5e58a3bd9d P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:54:42.347127 13770 raft_consensus.cc:2466] T b38c8d003413428dae9e47f58e197c2c P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2065c332f15a4739899af79f3669c3ba in term 0.
I20250830 07:54:42.347540 13422 leader_election.cc:304] T b38c8d003413428dae9e47f58e197c2c P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:54:42.347801 14645 raft_consensus.cc:2802] T b38c8d003413428dae9e47f58e197c2c P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:54:42.347885 14645 raft_consensus.cc:491] T b38c8d003413428dae9e47f58e197c2c P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:54:42.348003 14645 raft_consensus.cc:3058] T b38c8d003413428dae9e47f58e197c2c P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:42.348137 13887 tablet_bootstrap.cc:654] T 7af74bdde363493f8061eba450ecf4b4 P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:42.349995 13231 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_f61a294aa5624e5fa7b38c70b72a4bc2" } new_table_name: "default.Table_c58784366d3c49dda4c9d4afc16520a3" modify_external_catalogs: true
I20250830 07:54:42.350690 14645 raft_consensus.cc:513] T b38c8d003413428dae9e47f58e197c2c P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:42.351217 13232 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_2c46d09a19884723bb6778784b0e3fa0" } modify_external_catalogs: true
I20250830 07:54:42.351426 13232 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_2c46d09a19884723bb6778784b0e3fa0" } modify_external_catalogs: true
I20250830 07:54:42.351850 13233 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_312a5248361141058060b702704a3b35" } modify_external_catalogs: true
I20250830 07:54:42.351971 13233 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_312a5248361141058060b702704a3b35" } modify_external_catalogs: true
W20250830 07:54:42.352771 13234 catalog_manager.cc:5415] Ignoring report from unknown tablet e4c5eedb7f4d4397b19b8a3e0ddf9458
I20250830 07:54:42.354023 14645 leader_election.cc:290] T b38c8d003413428dae9e47f58e197c2c P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 election: Requested vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:42.354331 13770 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "b38c8d003413428dae9e47f58e197c2c" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f"
I20250830 07:54:42.354501 13770 raft_consensus.cc:3058] T b38c8d003413428dae9e47f58e197c2c P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:42.357450 13770 raft_consensus.cc:2466] T b38c8d003413428dae9e47f58e197c2c P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2065c332f15a4739899af79f3669c3ba in term 1.
I20250830 07:54:42.357824 13422 leader_election.cc:304] T b38c8d003413428dae9e47f58e197c2c P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters:
I20250830 07:54:42.358070 14645 raft_consensus.cc:2802] T b38c8d003413428dae9e47f58e197c2c P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election won for term 1
I20250830 07:54:42.358197 14645 raft_consensus.cc:695] T b38c8d003413428dae9e47f58e197c2c P 2065c332f15a4739899af79f3669c3ba [term 1 LEADER]: Becoming Leader. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Running, Role: LEADER
I20250830 07:54:42.358392 14645 consensus_queue.cc:237] T b38c8d003413428dae9e47f58e197c2c P 2065c332f15a4739899af79f3669c3ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
W20250830 07:54:42.358777 13231 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 52df62f7f1aa4b38be89f6198cf01f24 has no consensus state
I20250830 07:54:42.359638 13230 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_abfc383542944209880ab0ae6b4c3f29" } modify_external_catalogs: true
I20250830 07:54:42.359807 13230 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_abfc383542944209880ab0ae6b4c3f29" } modify_external_catalogs: true
I20250830 07:54:42.360154 13882 tablet_bootstrap.cc:492] T 69d6daeb7c774fd48ed296f52ed7c6a6 P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:54:42.360289 13882 ts_tablet_manager.cc:1397] T 69d6daeb7c774fd48ed296f52ed7c6a6 P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.020s user 0.002s sys 0.001s
I20250830 07:54:42.360459 13234 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_85b01c51682445e4a4f1672b286b0c56"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250830 07:54:42.360992 13882 raft_consensus.cc:357] T 69d6daeb7c774fd48ed296f52ed7c6a6 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:42.361212 13882 raft_consensus.cc:383] T 69d6daeb7c774fd48ed296f52ed7c6a6 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:42.361323 13882 raft_consensus.cc:738] T 69d6daeb7c774fd48ed296f52ed7c6a6 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:54:42.361496 13624 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "b38c8d003413428dae9e47f58e197c2c" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9"
I20250830 07:54:42.361523 13882 consensus_queue.cc:260] T 69d6daeb7c774fd48ed296f52ed7c6a6 P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:42.361991 14505 ts_tablet_manager.cc:1918] T 2be43f828f204f599017b6a04cf2ddf9 P 9b057ade5dce45af9f8bf0bedf8b917f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
W20250830 07:54:42.362031 13423 leader_election.cc:343] T b38c8d003413428dae9e47f58e197c2c P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:42.362211 14505 log.cc:1199] T 2be43f828f204f599017b6a04cf2ddf9 P 9b057ade5dce45af9f8bf0bedf8b917f: Deleting WAL directory at /tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/ts-2/wal/wals/2be43f828f204f599017b6a04cf2ddf9
I20250830 07:54:42.362566 14505 ts_tablet_manager.cc:1939] T 2be43f828f204f599017b6a04cf2ddf9 P 9b057ade5dce45af9f8bf0bedf8b917f: Deleting consensus metadata
I20250830 07:54:42.363549 13219 catalog_manager.cc:4928] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): tablet 2be43f828f204f599017b6a04cf2ddf9 (table default.Table_517ee5a88dc8431fb14bc9f85c62b395 [id=cbd8b881bf8a456d9930d5a6b27ab7d4]) successfully deleted
W20250830 07:54:42.366758 13234 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_85b01c51682445e4a4f1672b286b0c56 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:42.367131 13886 tablet_bootstrap.cc:492] T ea8ccd7ef791471291bca049bdf7f643 P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:54:42.367285 13886 ts_tablet_manager.cc:1397] T ea8ccd7ef791471291bca049bdf7f643 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.106s user 0.006s sys 0.002s
I20250830 07:54:42.367973 13886 raft_consensus.cc:357] T ea8ccd7ef791471291bca049bdf7f643 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:42.368150 13886 raft_consensus.cc:383] T ea8ccd7ef791471291bca049bdf7f643 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:42.368227 13886 raft_consensus.cc:738] T ea8ccd7ef791471291bca049bdf7f643 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:54:42.369148 13887 tablet_bootstrap.cc:492] T 7af74bdde363493f8061eba450ecf4b4 P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:54:42.369323 13887 ts_tablet_manager.cc:1397] T 7af74bdde363493f8061eba450ecf4b4 P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.032s user 0.000s sys 0.007s
I20250830 07:54:42.369865 13886 consensus_queue.cc:260] T ea8ccd7ef791471291bca049bdf7f643 P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:42.370613 13886 ts_tablet_manager.cc:1428] T ea8ccd7ef791471291bca049bdf7f643 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20250830 07:54:42.372481 13887 raft_consensus.cc:357] T 7af74bdde363493f8061eba450ecf4b4 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:42.376499 13887 raft_consensus.cc:383] T 7af74bdde363493f8061eba450ecf4b4 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:42.376582 13887 raft_consensus.cc:738] T 7af74bdde363493f8061eba450ecf4b4 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:54:42.376789 13887 consensus_queue.cc:260] T 7af74bdde363493f8061eba450ecf4b4 P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:42.377378 13887 ts_tablet_manager.cc:1428] T 7af74bdde363493f8061eba450ecf4b4 P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.008s user 0.001s sys 0.001s
I20250830 07:54:42.377885 13755 tablet_service.cc:1515] Processing DeleteTablet for tablet ea8ccd7ef791471291bca049bdf7f643 with delete_type TABLET_DATA_DELETED (replaced by tablet 690cf258639a4c1ea5a0ac4f2fd39f88) from {username='slave'} at 127.0.0.1:45460
I20250830 07:54:42.379801 13887 tablet_bootstrap.cc:492] T 73853894da074ecd8147a94ac28bfab8 P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
W20250830 07:54:42.383039 13234 catalog_manager.cc:5415] Ignoring report from unknown tablet b38c8d003413428dae9e47f58e197c2c
I20250830 07:54:42.383528 13887 tablet_bootstrap.cc:654] T 73853894da074ecd8147a94ac28bfab8 P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:42.389339 13886 tablet_bootstrap.cc:492] T 14ed24577c8f49f49c83242a26877614 P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:54:42.390467 13485 raft_consensus.cc:3058] T e4c5eedb7f4d4397b19b8a3e0ddf9458 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:42.393801 14445 consensus_queue.cc:1035] T e4c5eedb7f4d4397b19b8a3e0ddf9458 P 6b5e454d98894637b466ea27f1b647f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:54:42.398216 13882 ts_tablet_manager.cc:1428] T 69d6daeb7c774fd48ed296f52ed7c6a6 P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.038s user 0.001s sys 0.001s
I20250830 07:54:42.399112 13231 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_618200045a4b44908fc6e99de0c2788e" } modify_external_catalogs: true
I20250830 07:54:42.399341 13231 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_618200045a4b44908fc6e99de0c2788e" } modify_external_catalogs: true
I20250830 07:54:42.400171 13225 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_4a85f0b02480477f8740a7e741f992f0" } new_table_name: "default.Table_fb1775ef38e248bcbde37a9fc64ee5c1" modify_external_catalogs: true
I20250830 07:54:42.403417 13228 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_d10c794df1544c4caa5eecb2190cbaec"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:42.404127 13228 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d10c794df1544c4caa5eecb2190cbaec in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:42.405301 13229 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_87a9206ca75f43159bde4f474e94ddec" } modify_external_catalogs: true
I20250830 07:54:42.405432 13229 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_87a9206ca75f43159bde4f474e94ddec" } modify_external_catalogs: true
I20250830 07:54:42.408583 14505 tablet_replica.cc:331] T ea8ccd7ef791471291bca049bdf7f643 P 9b057ade5dce45af9f8bf0bedf8b917f: stopping tablet replica
I20250830 07:54:42.408842 14505 raft_consensus.cc:2241] T ea8ccd7ef791471291bca049bdf7f643 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Raft consensus shutting down.
W20250830 07:54:42.409488 13225 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 8a6a2a2dc6e0411b8ad8364cbf2cec36 has no consensus state
I20250830 07:54:42.408407 14480 consensus_queue.cc:1035] T e4c5eedb7f4d4397b19b8a3e0ddf9458 P 6b5e454d98894637b466ea27f1b647f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:54:42.410151 13882 tablet_bootstrap.cc:492] T b38c8d003413428dae9e47f58e197c2c P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:54:42.410378 14505 raft_consensus.cc:2270] T ea8ccd7ef791471291bca049bdf7f643 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Raft consensus is shut down!
I20250830 07:54:42.412146 13882 tablet_bootstrap.cc:654] T b38c8d003413428dae9e47f58e197c2c P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:42.412742 14505 ts_tablet_manager.cc:1905] T ea8ccd7ef791471291bca049bdf7f643 P 9b057ade5dce45af9f8bf0bedf8b917f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250830 07:54:42.413503 13886 tablet_bootstrap.cc:654] T 14ed24577c8f49f49c83242a26877614 P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:42.416879 13225 master_service.cc:948] ReplaceTablet: received request to replace tablet d3b47314f7cd4e969d973c0a340137f1 from {username='slave'} at 127.0.0.1:42126
I20250830 07:54:42.418358 13225 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_d30882d7f1574d4da847ceec1f93e509" } new_table_name: "default.Table_f6bd1f04d55045ef97fc62076520c6a6" modify_external_catalogs: true
I20250830 07:54:42.420197 13887 tablet_bootstrap.cc:492] T 73853894da074ecd8147a94ac28bfab8 P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:54:42.420372 13887 ts_tablet_manager.cc:1397] T 73853894da074ecd8147a94ac28bfab8 P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.041s user 0.001s sys 0.005s
I20250830 07:54:42.421167 13887 raft_consensus.cc:357] T 73853894da074ecd8147a94ac28bfab8 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:42.421382 13887 raft_consensus.cc:383] T 73853894da074ecd8147a94ac28bfab8 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:42.421463 13887 raft_consensus.cc:738] T 73853894da074ecd8147a94ac28bfab8 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:54:42.421696 13887 consensus_queue.cc:260] T 73853894da074ecd8147a94ac28bfab8 P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:42.424757 14644 consensus_queue.cc:1035] T ada52626bbc94105a8b9428b0bbdfb5e P 2065c332f15a4739899af79f3669c3ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:54:42.425748 13228 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_2383bf6f9b124a47aad389ba74ef460a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:42.426390 13228 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2383bf6f9b124a47aad389ba74ef460a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:42.427035 13887 ts_tablet_manager.cc:1428] T 73853894da074ecd8147a94ac28bfab8 P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.007s user 0.001s sys 0.001s
I20250830 07:54:42.427373 13887 tablet_bootstrap.cc:492] T cf5613278b4c4f3bbe751b1ae6f3c313 P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:54:42.429055 13887 tablet_bootstrap.cc:654] T cf5613278b4c4f3bbe751b1ae6f3c313 P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
W20250830 07:54:42.429108 13225 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 240a6bfad8fa478598a67a27c2dedf62 has no consensus state
I20250830 07:54:42.429546 13225 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_980396fb4a82408bbe55bf0260c7431f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:42.430155 13225 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_980396fb4a82408bbe55bf0260c7431f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:42.441160 14505 ts_tablet_manager.cc:1918] T ea8ccd7ef791471291bca049bdf7f643 P 9b057ade5dce45af9f8bf0bedf8b917f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250830 07:54:42.441942 14480 raft_consensus.cc:491] T 14ed24577c8f49f49c83242a26877614 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:42.442087 14480 raft_consensus.cc:513] T 14ed24577c8f49f49c83242a26877614 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:42.442386 13882 tablet_bootstrap.cc:492] T b38c8d003413428dae9e47f58e197c2c P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:54:42.442536 13882 ts_tablet_manager.cc:1397] T b38c8d003413428dae9e47f58e197c2c P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.032s user 0.004s sys 0.001s
I20250830 07:54:42.442803 14480 leader_election.cc:290] T 14ed24577c8f49f49c83242a26877614 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:42.443661 13485 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "14ed24577c8f49f49c83242a26877614" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:54:42.443874 13485 raft_consensus.cc:2466] T 14ed24577c8f49f49c83242a26877614 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b5e454d98894637b466ea27f1b647f9 in term 0.
I20250830 07:54:42.444062 13228 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_3bb6252818564f6c898bfd231839d740"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250830 07:54:42.444478 13561 leader_election.cc:304] T 14ed24577c8f49f49c83242a26877614 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 6b5e454d98894637b466ea27f1b647f9; no voters:
I20250830 07:54:42.444888 14480 raft_consensus.cc:2802] T 14ed24577c8f49f49c83242a26877614 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:54:42.445004 14480 raft_consensus.cc:491] T 14ed24577c8f49f49c83242a26877614 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20250830 07:54:42.445056 13228 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3bb6252818564f6c898bfd231839d740 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:42.445122 14480 raft_consensus.cc:3058] T 14ed24577c8f49f49c83242a26877614 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:42.446874 13225 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_9ea8aaa6727d4d4c9a728c1deb363c95"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:42.447376 13225 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9ea8aaa6727d4d4c9a728c1deb363c95 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:42.448542 14480 raft_consensus.cc:513] T 14ed24577c8f49f49c83242a26877614 P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:42.453130 14480 leader_election.cc:290] T 14ed24577c8f49f49c83242a26877614 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 election: Requested vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:42.453450 13485 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "14ed24577c8f49f49c83242a26877614" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba"
I20250830 07:54:42.453815 13485 raft_consensus.cc:3058] T 14ed24577c8f49f49c83242a26877614 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
W20250830 07:54:42.456140 13422 consensus_peers.cc:489] T dbe542c478874482b078296a7a0e9ec9 P 2065c332f15a4739899af79f3669c3ba -> Peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Couldn't send request to peer 9b057ade5dce45af9f8bf0bedf8b917f. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20250830 07:54:42.459399 13628 raft_consensus.cc:1273] T dbe542c478874482b078296a7a0e9ec9 P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Refusing update from remote peer 2065c332f15a4739899af79f3669c3ba: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250830 07:54:42.460224 14645 consensus_queue.cc:1035] T dbe542c478874482b078296a7a0e9ec9 P 2065c332f15a4739899af79f3669c3ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:54:42.462966 13887 tablet_bootstrap.cc:492] T cf5613278b4c4f3bbe751b1ae6f3c313 P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:54:42.463141 13887 ts_tablet_manager.cc:1397] T cf5613278b4c4f3bbe751b1ae6f3c313 P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.036s user 0.006s sys 0.004s
I20250830 07:54:42.464150 13887 raft_consensus.cc:357] T cf5613278b4c4f3bbe751b1ae6f3c313 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:42.464367 13887 raft_consensus.cc:383] T cf5613278b4c4f3bbe751b1ae6f3c313 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:42.464473 13887 raft_consensus.cc:738] T cf5613278b4c4f3bbe751b1ae6f3c313 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:54:42.464727 13887 consensus_queue.cc:260] T cf5613278b4c4f3bbe751b1ae6f3c313 P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:42.465281 13887 ts_tablet_manager.cc:1428] T cf5613278b4c4f3bbe751b1ae6f3c313 P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20250830 07:54:42.465538 13228 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_3d2bb182df644a38ac75060c11bb7ac8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:42.466145 13228 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3d2bb182df644a38ac75060c11bb7ac8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:42.467262 13485 raft_consensus.cc:2466] T 14ed24577c8f49f49c83242a26877614 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b5e454d98894637b466ea27f1b647f9 in term 1.
I20250830 07:54:42.468127 13561 leader_election.cc:304] T 14ed24577c8f49f49c83242a26877614 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 6b5e454d98894637b466ea27f1b647f9; no voters:
I20250830 07:54:42.468582 14480 raft_consensus.cc:2802] T 14ed24577c8f49f49c83242a26877614 P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Leader election won for term 1
I20250830 07:54:42.468832 14480 raft_consensus.cc:695] T 14ed24577c8f49f49c83242a26877614 P 6b5e454d98894637b466ea27f1b647f9 [term 1 LEADER]: Becoming Leader. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Running, Role: LEADER
I20250830 07:54:42.469141 14480 consensus_queue.cc:237] T 14ed24577c8f49f49c83242a26877614 P 6b5e454d98894637b466ea27f1b647f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:42.469993 13887 tablet_bootstrap.cc:492] T e862fa77e16945bd94e405aa3474f021 P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:54:42.471626 13887 tablet_bootstrap.cc:654] T e862fa77e16945bd94e405aa3474f021 P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:42.481688 14645 consensus_queue.cc:1035] T ada52626bbc94105a8b9428b0bbdfb5e P 2065c332f15a4739899af79f3669c3ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:54:42.486479 13225 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_be854d521db44926811d0dee9cb0fa54"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:42.487139 13225 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_be854d521db44926811d0dee9cb0fa54 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:42.487867 13228 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_0ad54505afd34d1792f97395a95b26bb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:42.488399 13228 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0ad54505afd34d1792f97395a95b26bb in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:42.495427 14645 raft_consensus.cc:491] T d3f207cee78a43a1b5e030c09752c78c P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:42.495574 14645 raft_consensus.cc:513] T d3f207cee78a43a1b5e030c09752c78c P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:42.496191 14645 leader_election.cc:290] T d3f207cee78a43a1b5e030c09752c78c P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:42.497334 13624 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "d3f207cee78a43a1b5e030c09752c78c" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
W20250830 07:54:42.497851 13423 leader_election.cc:343] T d3f207cee78a43a1b5e030c09752c78c P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
W20250830 07:54:42.503933 13228 catalog_manager.cc:5415] Ignoring report from unknown tablet e4c5eedb7f4d4397b19b8a3e0ddf9458
I20250830 07:54:42.504464 13228 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_925a614f5a234282998fac421779f5f3" } new_table_name: "default.Table_98722818dc7c4e3284220440947a4cbf" modify_external_catalogs: true
I20250830 07:54:42.505563 14480 raft_consensus.cc:491] T 8dddcfe56522436287aea212e316a729 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:42.505710 14480 raft_consensus.cc:513] T 8dddcfe56522436287aea212e316a729 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:42.506791 14480 leader_election.cc:290] T 8dddcfe56522436287aea212e316a729 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:42.507171 13485 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "8dddcfe56522436287aea212e316a729" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:54:42.507432 13485 raft_consensus.cc:2466] T 8dddcfe56522436287aea212e316a729 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b5e454d98894637b466ea27f1b647f9 in term 0.
I20250830 07:54:42.507841 13561 leader_election.cc:304] T 8dddcfe56522436287aea212e316a729 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 6b5e454d98894637b466ea27f1b647f9; no voters:
I20250830 07:54:42.508659 14674 raft_consensus.cc:2802] T 8dddcfe56522436287aea212e316a729 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:54:42.508757 14674 raft_consensus.cc:491] T 8dddcfe56522436287aea212e316a729 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:54:42.508853 14674 raft_consensus.cc:3058] T 8dddcfe56522436287aea212e316a729 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:42.511747 14674 raft_consensus.cc:513] T 8dddcfe56522436287aea212e316a729 P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:42.511942 13887 tablet_bootstrap.cc:492] T e862fa77e16945bd94e405aa3474f021 P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:54:42.512099 13887 ts_tablet_manager.cc:1397] T e862fa77e16945bd94e405aa3474f021 P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.042s user 0.001s sys 0.006s
I20250830 07:54:42.512683 14674 leader_election.cc:290] T 8dddcfe56522436287aea212e316a729 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 election: Requested vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:42.512867 13887 raft_consensus.cc:357] T e862fa77e16945bd94e405aa3474f021 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:42.513056 13887 raft_consensus.cc:383] T e862fa77e16945bd94e405aa3474f021 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:42.513140 13887 raft_consensus.cc:738] T e862fa77e16945bd94e405aa3474f021 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:54:42.513347 13485 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "8dddcfe56522436287aea212e316a729" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba"
I20250830 07:54:42.513552 13485 raft_consensus.cc:3058] T 8dddcfe56522436287aea212e316a729 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:42.514256 13225 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_a86aa67f6fd64b1c9306f26e900a021c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:42.514947 13225 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a86aa67f6fd64b1c9306f26e900a021c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:42.515328 13887 consensus_queue.cc:260] T e862fa77e16945bd94e405aa3474f021 P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:42.516292 14711 tablet.cc:1722] T dbe542c478874482b078296a7a0e9ec9 P 2065c332f15a4739899af79f3669c3ba: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20250830 07:54:42.523620 14712 tablet.cc:1722] T dbe542c478874482b078296a7a0e9ec9 P 6b5e454d98894637b466ea27f1b647f9: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
W20250830 07:54:42.527426 13228 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f192693039a24e3cb0bec646c8d11056 has no consensus state
I20250830 07:54:42.528146 13228 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_215b44de73fc4fe88b61c20067b961dd" } new_table_name: "default.Table_65886201d1784503987a2258f7c62a85" modify_external_catalogs: true
W20250830 07:54:42.529105 13225 catalog_manager.cc:5415] Ignoring report from unknown tablet e4c5eedb7f4d4397b19b8a3e0ddf9458
I20250830 07:54:42.517021 13485 raft_consensus.cc:2466] T 8dddcfe56522436287aea212e316a729 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b5e454d98894637b466ea27f1b647f9 in term 1.
I20250830 07:54:42.539384 13561 leader_election.cc:304] T 8dddcfe56522436287aea212e316a729 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 6b5e454d98894637b466ea27f1b647f9; no voters:
I20250830 07:54:42.535346 13887 ts_tablet_manager.cc:1428] T e862fa77e16945bd94e405aa3474f021 P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.023s user 0.001s sys 0.001s
I20250830 07:54:42.540004 13887 tablet_bootstrap.cc:492] T 8f215330505848619ad44569d3167591 P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:54:42.546490 14480 raft_consensus.cc:2802] T 8dddcfe56522436287aea212e316a729 P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Leader election won for term 1
I20250830 07:54:42.546761 14480 raft_consensus.cc:695] T 8dddcfe56522436287aea212e316a729 P 6b5e454d98894637b466ea27f1b647f9 [term 1 LEADER]: Becoming Leader. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Running, Role: LEADER
I20250830 07:54:42.547508 13887 tablet_bootstrap.cc:654] T 8f215330505848619ad44569d3167591 P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:42.547801 14480 consensus_queue.cc:237] T 8dddcfe56522436287aea212e316a729 P 6b5e454d98894637b466ea27f1b647f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
W20250830 07:54:42.550372 13228 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 439fc51afa6b435e81bc38b9e88d4041 has no consensus state
I20250830 07:54:42.550961 13228 master_service.cc:948] ReplaceTablet: received request to replace tablet 66d59910b4b2451a851e9d2728d50f42 from {username='slave'} at 127.0.0.1:42126
I20250830 07:54:42.550877 13882 raft_consensus.cc:357] T b38c8d003413428dae9e47f58e197c2c P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:42.551198 13882 raft_consensus.cc:383] T b38c8d003413428dae9e47f58e197c2c P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:42.551295 13882 raft_consensus.cc:738] T b38c8d003413428dae9e47f58e197c2c P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:54:42.551664 13882 consensus_queue.cc:260] T b38c8d003413428dae9e47f58e197c2c P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:42.552539 13882 ts_tablet_manager.cc:1428] T b38c8d003413428dae9e47f58e197c2c P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.110s user 0.002s sys 0.000s
I20250830 07:54:42.552881 13882 tablet_bootstrap.cc:492] T 7af74bdde363493f8061eba450ecf4b4 P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:54:42.560317 14505 log.cc:1199] T ea8ccd7ef791471291bca049bdf7f643 P 9b057ade5dce45af9f8bf0bedf8b917f: Deleting WAL directory at /tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/ts-2/wal/wals/ea8ccd7ef791471291bca049bdf7f643
I20250830 07:54:42.560331 13225 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_1ec96f693c91430b9170e6812cd247d8" } new_table_name: "default.Table_774eed33394d4f4a839a3a0b14b5ad71" modify_external_catalogs: true
I20250830 07:54:42.560873 14505 ts_tablet_manager.cc:1939] T ea8ccd7ef791471291bca049bdf7f643 P 9b057ade5dce45af9f8bf0bedf8b917f: Deleting consensus metadata
I20250830 07:54:42.561972 13219 catalog_manager.cc:4928] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): tablet ea8ccd7ef791471291bca049bdf7f643 (table default.Table_523d7bc660f94c9db577f499e22c772f [id=3582c72cab4b4e1084021b098ec30f87]) successfully deleted
I20250830 07:54:42.443291 13772 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "14ed24577c8f49f49c83242a26877614" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:42.447942 14565 raft_consensus.cc:491] T 752727eef0734ff3b7b35b1d5f66aea6 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:42.562589 14565 raft_consensus.cc:513] T 752727eef0734ff3b7b35b1d5f66aea6 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:42.563221 14565 leader_election.cc:290] T 752727eef0734ff3b7b35b1d5f66aea6 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967)
I20250830 07:54:42.452980 13774 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "14ed24577c8f49f49c83242a26877614" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f"
W20250830 07:54:42.463523 13703 consensus_peers.cc:489] T 30c2558c28944ff39d1a4a4ca9ac604e P 9b057ade5dce45af9f8bf0bedf8b917f -> Peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Couldn't send request to peer 6b5e454d98894637b466ea27f1b647f9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20250830 07:54:42.563648 13703 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.209.2:38967, user_credentials={real_user=slave}} blocked reactor thread for 100137us
I20250830 07:54:42.496915 13775 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "d3f207cee78a43a1b5e030c09752c78c" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:42.565692 13774 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "8dddcfe56522436287aea212e316a729" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:42.566171 13772 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "8dddcfe56522436287aea212e316a729" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f"
W20250830 07:54:42.566955 13422 leader_election.cc:343] T d3f207cee78a43a1b5e030c09752c78c P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:42.567117 13422 leader_election.cc:304] T d3f207cee78a43a1b5e030c09752c78c P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba; no voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:54:42.567838 14644 raft_consensus.cc:2747] T d3f207cee78a43a1b5e030c09752c78c P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:54:42.568792 13228 master_service.cc:948] ReplaceTablet: received request to replace tablet 008827b3d09d464b9182fb42dc2170d5 from {username='slave'} at 127.0.0.1:42126
I20250830 07:54:42.569032 13628 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "752727eef0734ff3b7b35b1d5f66aea6" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
W20250830 07:54:42.569100 13562 leader_election.cc:343] T 14ed24577c8f49f49c83242a26877614 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Illegal state: must be running to vote when last-logged opid is not known
W20250830 07:54:42.569383 13562 leader_election.cc:343] T 14ed24577c8f49f49c83242a26877614 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Illegal state: must be running to vote when last-logged opid is not known
W20250830 07:54:42.569624 13562 leader_election.cc:343] T 8dddcfe56522436287aea212e316a729 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Illegal state: must be running to vote when last-logged opid is not known
W20250830 07:54:42.569890 13562 leader_election.cc:343] T 8dddcfe56522436287aea212e316a729 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Illegal state: must be running to vote when last-logged opid is not known
W20250830 07:54:42.570298 13703 leader_election.cc:343] T 752727eef0734ff3b7b35b1d5f66aea6 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
W20250830 07:54:42.570349 13225 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 2048c04578104c78aa6504fd9d5953a3 consensus state has no leader
I20250830 07:54:42.571228 13485 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "752727eef0734ff3b7b35b1d5f66aea6" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
W20250830 07:54:42.571692 13701 leader_election.cc:343] T 752727eef0734ff3b7b35b1d5f66aea6 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:42.571798 13701 leader_election.cc:304] T 752727eef0734ff3b7b35b1d5f66aea6 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 2065c332f15a4739899af79f3669c3ba, 6b5e454d98894637b466ea27f1b647f9
I20250830 07:54:42.572225 14565 raft_consensus.cc:2747] T 752727eef0734ff3b7b35b1d5f66aea6 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:54:42.525600 13886 tablet_bootstrap.cc:492] T 14ed24577c8f49f49c83242a26877614 P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:54:42.572592 13886 ts_tablet_manager.cc:1397] T 14ed24577c8f49f49c83242a26877614 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.184s user 0.006s sys 0.001s
I20250830 07:54:42.574222 13225 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_dc6cbe0df3e54f26a96f0b91dcec8d56"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:42.574713 13225 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_dc6cbe0df3e54f26a96f0b91dcec8d56 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:42.573441 13886 raft_consensus.cc:357] T 14ed24577c8f49f49c83242a26877614 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:42.575088 13886 raft_consensus.cc:383] T 14ed24577c8f49f49c83242a26877614 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:42.575215 13886 raft_consensus.cc:738] T 14ed24577c8f49f49c83242a26877614 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:54:42.575498 13886 consensus_queue.cc:260] T 14ed24577c8f49f49c83242a26877614 P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:42.579823 14644 raft_consensus.cc:491] T e862fa77e16945bd94e405aa3474f021 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:42.579998 14644 raft_consensus.cc:513] T e862fa77e16945bd94e405aa3474f021 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:42.580569 14644 leader_election.cc:290] T e862fa77e16945bd94e405aa3474f021 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:42.582271 13772 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "e862fa77e16945bd94e405aa3474f021" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:42.582325 13628 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "e862fa77e16945bd94e405aa3474f021" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:42.582499 13628 raft_consensus.cc:2466] T e862fa77e16945bd94e405aa3474f021 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2065c332f15a4739899af79f3669c3ba in term 0.
W20250830 07:54:42.582723 13422 leader_election.cc:343] T e862fa77e16945bd94e405aa3474f021 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:42.582885 13422 leader_election.cc:304] T e862fa77e16945bd94e405aa3474f021 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 6b5e454d98894637b466ea27f1b647f9; no voters: 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:54:42.583230 14674 raft_consensus.cc:491] T cf5613278b4c4f3bbe751b1ae6f3c313 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:42.583247 14644 raft_consensus.cc:2802] T e862fa77e16945bd94e405aa3474f021 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:54:42.583331 14644 raft_consensus.cc:491] T e862fa77e16945bd94e405aa3474f021 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:54:42.583418 14644 raft_consensus.cc:3058] T e862fa77e16945bd94e405aa3474f021 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:42.583369 14674 raft_consensus.cc:513] T cf5613278b4c4f3bbe751b1ae6f3c313 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:42.583949 14674 leader_election.cc:290] T cf5613278b4c4f3bbe751b1ae6f3c313 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:42.584345 13485 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "cf5613278b4c4f3bbe751b1ae6f3c313" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:54:42.584535 13485 raft_consensus.cc:2466] T cf5613278b4c4f3bbe751b1ae6f3c313 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b5e454d98894637b466ea27f1b647f9 in term 0.
I20250830 07:54:42.584504 13772 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "cf5613278b4c4f3bbe751b1ae6f3c313" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:42.584921 13561 leader_election.cc:304] T cf5613278b4c4f3bbe751b1ae6f3c313 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 6b5e454d98894637b466ea27f1b647f9; no voters:
W20250830 07:54:42.585090 13562 leader_election.cc:343] T cf5613278b4c4f3bbe751b1ae6f3c313 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:42.585405 14674 raft_consensus.cc:2802] T cf5613278b4c4f3bbe751b1ae6f3c313 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:54:42.585496 14674 raft_consensus.cc:491] T cf5613278b4c4f3bbe751b1ae6f3c313 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:54:42.585593 14674 raft_consensus.cc:3058] T cf5613278b4c4f3bbe751b1ae6f3c313 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:42.586429 14644 raft_consensus.cc:513] T e862fa77e16945bd94e405aa3474f021 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:42.588349 14674 raft_consensus.cc:513] T cf5613278b4c4f3bbe751b1ae6f3c313 P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:42.589558 13481 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "cf5613278b4c4f3bbe751b1ae6f3c313" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba"
I20250830 07:54:42.589704 13481 raft_consensus.cc:3058] T cf5613278b4c4f3bbe751b1ae6f3c313 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:42.589919 13772 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "cf5613278b4c4f3bbe751b1ae6f3c313" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f"
W20250830 07:54:42.590561 13562 leader_election.cc:343] T cf5613278b4c4f3bbe751b1ae6f3c313 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:42.591419 14674 leader_election.cc:290] T cf5613278b4c4f3bbe751b1ae6f3c313 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 election: Requested vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:42.592783 13481 raft_consensus.cc:2466] T cf5613278b4c4f3bbe751b1ae6f3c313 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b5e454d98894637b466ea27f1b647f9 in term 1.
I20250830 07:54:42.593192 13561 leader_election.cc:304] T cf5613278b4c4f3bbe751b1ae6f3c313 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 6b5e454d98894637b466ea27f1b647f9; no voters: 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:54:42.594429 14674 raft_consensus.cc:2802] T cf5613278b4c4f3bbe751b1ae6f3c313 P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Leader election won for term 1
I20250830 07:54:42.594650 14674 raft_consensus.cc:695] T cf5613278b4c4f3bbe751b1ae6f3c313 P 6b5e454d98894637b466ea27f1b647f9 [term 1 LEADER]: Becoming Leader. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Running, Role: LEADER
I20250830 07:54:42.594898 14674 consensus_queue.cc:237] T cf5613278b4c4f3bbe751b1ae6f3c313 P 6b5e454d98894637b466ea27f1b647f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:42.597316 13886 ts_tablet_manager.cc:1428] T 14ed24577c8f49f49c83242a26877614 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.025s user 0.001s sys 0.000s
I20250830 07:54:42.597653 13886 tablet_bootstrap.cc:492] T d3f207cee78a43a1b5e030c09752c78c P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:54:42.599475 13886 tablet_bootstrap.cc:654] T d3f207cee78a43a1b5e030c09752c78c P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:42.604033 13882 tablet_bootstrap.cc:654] T 7af74bdde363493f8061eba450ecf4b4 P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:42.606142 13887 tablet_bootstrap.cc:492] T 8f215330505848619ad44569d3167591 P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:54:42.606315 13887 ts_tablet_manager.cc:1397] T 8f215330505848619ad44569d3167591 P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.066s user 0.004s sys 0.001s
I20250830 07:54:42.607985 13887 raft_consensus.cc:357] T 8f215330505848619ad44569d3167591 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:42.608199 13887 raft_consensus.cc:383] T 8f215330505848619ad44569d3167591 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:42.608312 13887 raft_consensus.cc:738] T 8f215330505848619ad44569d3167591 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:54:42.608820 14644 leader_election.cc:290] T e862fa77e16945bd94e405aa3474f021 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 election: Requested vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:42.609084 13628 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "e862fa77e16945bd94e405aa3474f021" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9"
I20250830 07:54:42.609073 13887 consensus_queue.cc:260] T 8f215330505848619ad44569d3167591 P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:42.609259 13628 raft_consensus.cc:3058] T e862fa77e16945bd94e405aa3474f021 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:42.609630 13887 ts_tablet_manager.cc:1428] T 8f215330505848619ad44569d3167591 P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20250830 07:54:42.609895 13887 tablet_bootstrap.cc:492] T cb3c48982add45379c0e1b117ec40c1a P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:54:42.611866 13628 raft_consensus.cc:2466] T e862fa77e16945bd94e405aa3474f021 P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2065c332f15a4739899af79f3669c3ba in term 1.
I20250830 07:54:42.612396 13772 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "e862fa77e16945bd94e405aa3474f021" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f"
I20250830 07:54:42.613049 13228 catalog_manager.cc:5674] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743) does not have the latest schema for tablet 14ed24577c8f49f49c83242a26877614 (table default.Table_4428c29c8358411282f00fd33a6badd4 [id=bcee72f9b1c6407f98435a1494b42407]). Expected version 1 got 0
I20250830 07:54:42.614353 13887 tablet_bootstrap.cc:654] T cb3c48982add45379c0e1b117ec40c1a P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
W20250830 07:54:42.615671 13422 leader_election.cc:343] T e862fa77e16945bd94e405aa3474f021 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:42.615711 13228 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_dfe4a0834a4e426184d5c247a9327e4f" } new_table_name: "default.Table_99d5f73171164be2bacb3d06d32875b6" modify_external_catalogs: true
I20250830 07:54:42.617524 13232 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet 4639d1b6add8447c9ce071af71a99869
I20250830 07:54:42.620098 13227 catalog_manager.cc:5674] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967) does not have the latest schema for tablet 8dddcfe56522436287aea212e316a729 (table default.Table_e0d2400861094b258fca0704d88ed743 [id=c483c08824f24586855e3575a590b294]). Expected version 2 got 0
I20250830 07:54:42.620802 13606 tablet_service.cc:1515] Processing DeleteTablet for tablet 4639d1b6add8447c9ce071af71a99869 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:42 UTC) from {username='slave'} at 127.0.0.1:45306
I20250830 07:54:42.621907 13423 leader_election.cc:304] T e862fa77e16945bd94e405aa3474f021 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 6b5e454d98894637b466ea27f1b647f9; no voters: 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:54:42.622339 13755 tablet_service.cc:1515] Processing DeleteTablet for tablet 4639d1b6add8447c9ce071af71a99869 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:42 UTC) from {username='slave'} at 127.0.0.1:45460
W20250830 07:54:42.622920 13219 catalog_manager.cc:4895] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): delete failed for tablet 4639d1b6add8447c9ce071af71a99869 because the tablet was not found. No further retry: Not found: Tablet not found: 4639d1b6add8447c9ce071af71a99869
I20250830 07:54:42.623037 13227 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_d298f39e826645b180dcd8eba4030ebb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:42.623518 13227 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d298f39e826645b180dcd8eba4030ebb in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250830 07:54:42.624229 13220 catalog_manager.cc:4895] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet 4639d1b6add8447c9ce071af71a99869 because the tablet was not found. No further retry: Not found: Tablet not found: 4639d1b6add8447c9ce071af71a99869
I20250830 07:54:42.624867 13468 tablet_service.cc:1515] Processing DeleteTablet for tablet 4639d1b6add8447c9ce071af71a99869 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:42 UTC) from {username='slave'} at 127.0.0.1:37956
I20250830 07:54:42.627063 13229 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet 6720d2b945814305845beea0a2cb9912
I20250830 07:54:42.628211 13226 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet 689b4fee1dd04b3d9ccdea334b0f6b59
I20250830 07:54:42.628579 13226 catalog_manager.cc:6652] ReplaceTablet: tablet 689b4fee1dd04b3d9ccdea334b0f6b59 deleted and replaced by tablet ed4b18f7e82e4633b05ebec96686320e
I20250830 07:54:42.628785 13468 tablet_service.cc:1515] Processing DeleteTablet for tablet 6720d2b945814305845beea0a2cb9912 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:42 UTC) from {username='slave'} at 127.0.0.1:37956
W20250830 07:54:42.628917 13218 catalog_manager.cc:4895] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): delete failed for tablet 4639d1b6add8447c9ce071af71a99869 because the tablet was not found. No further retry: Not found: Tablet not found: 4639d1b6add8447c9ce071af71a99869
I20250830 07:54:42.629432 13755 tablet_service.cc:1515] Processing DeleteTablet for tablet 6720d2b945814305845beea0a2cb9912 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:42 UTC) from {username='slave'} at 127.0.0.1:45460
W20250830 07:54:42.630040 13219 catalog_manager.cc:4895] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): delete failed for tablet 6720d2b945814305845beea0a2cb9912 because the tablet was not found. No further retry: Not found: Tablet not found: 6720d2b945814305845beea0a2cb9912
I20250830 07:54:42.630106 13755 tablet_service.cc:1515] Processing DeleteTablet for tablet 689b4fee1dd04b3d9ccdea334b0f6b59 with delete_type TABLET_DATA_DELETED (replaced by tablet ed4b18f7e82e4633b05ebec96686320e) from {username='slave'} at 127.0.0.1:45460
I20250830 07:54:42.630347 13468 tablet_service.cc:1515] Processing DeleteTablet for tablet 689b4fee1dd04b3d9ccdea334b0f6b59 with delete_type TABLET_DATA_DELETED (replaced by tablet ed4b18f7e82e4633b05ebec96686320e) from {username='slave'} at 127.0.0.1:37956
I20250830 07:54:42.630400 13594 tablet_service.cc:1515] Processing DeleteTablet for tablet 689b4fee1dd04b3d9ccdea334b0f6b59 with delete_type TABLET_DATA_DELETED (replaced by tablet ed4b18f7e82e4633b05ebec96686320e) from {username='slave'} at 127.0.0.1:45306
W20250830 07:54:42.630640 13219 catalog_manager.cc:4908] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): delete failed for tablet 689b4fee1dd04b3d9ccdea334b0f6b59 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 689b4fee1dd04b3d9ccdea334b0f6b59 already in progress: creating tablet
I20250830 07:54:42.630805 13606 tablet_service.cc:1515] Processing DeleteTablet for tablet 6720d2b945814305845beea0a2cb9912 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:42 UTC) from {username='slave'} at 127.0.0.1:45306
W20250830 07:54:42.631623 13218 catalog_manager.cc:4895] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): delete failed for tablet 6720d2b945814305845beea0a2cb9912 because the tablet was not found. No further retry: Not found: Tablet not found: 6720d2b945814305845beea0a2cb9912
I20250830 07:54:42.631644 14645 raft_consensus.cc:2802] T e862fa77e16945bd94e405aa3474f021 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election won for term 1
W20250830 07:54:42.631894 13218 catalog_manager.cc:4908] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): delete failed for tablet 689b4fee1dd04b3d9ccdea334b0f6b59 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 689b4fee1dd04b3d9ccdea334b0f6b59 already in progress: creating tablet
I20250830 07:54:42.631913 14645 raft_consensus.cc:695] T e862fa77e16945bd94e405aa3474f021 P 2065c332f15a4739899af79f3669c3ba [term 1 LEADER]: Becoming Leader. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Running, Role: LEADER
I20250830 07:54:42.632182 14645 consensus_queue.cc:237] T e862fa77e16945bd94e405aa3474f021 P 2065c332f15a4739899af79f3669c3ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
W20250830 07:54:42.634265 13226 catalog_manager.cc:5415] Ignoring report from unknown tablet 8f215330505848619ad44569d3167591
W20250830 07:54:42.635845 13226 catalog_manager.cc:5415] Ignoring report from unknown tablet d33a5d107c6849aca6eb48ffdf8a5463
W20250830 07:54:42.635954 13226 catalog_manager.cc:5415] Ignoring report from unknown tablet e862fa77e16945bd94e405aa3474f021
W20250830 07:54:42.636106 13226 catalog_manager.cc:5415] Ignoring report from unknown tablet cf5613278b4c4f3bbe751b1ae6f3c313
W20250830 07:54:42.636204 13226 catalog_manager.cc:5415] Ignoring report from unknown tablet 73853894da074ecd8147a94ac28bfab8
W20250830 07:54:42.636301 13226 catalog_manager.cc:5415] Ignoring report from unknown tablet e4c5eedb7f4d4397b19b8a3e0ddf9458
I20250830 07:54:42.636660 13231 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet 75359721445e48d2bc0dd6fd17649bc1
W20250830 07:54:42.636884 13228 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 283aa82b808e49528ceb19133748ffc8 consensus state has no leader
I20250830 07:54:42.638124 13231 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_ce89cbd80466451bb90a1f15fc7bc98c" } new_table_name: "default.Table_5231dd03c13a46d699125d43090db9f1" modify_external_catalogs: true
I20250830 07:54:42.639443 13233 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet 7676b4d6a75c4c6aacced1f2a1beb555
I20250830 07:54:42.636656 13230 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet 74ea2298876a4066b297915c135d4618
I20250830 07:54:42.641891 13755 tablet_service.cc:1515] Processing DeleteTablet for tablet 75359721445e48d2bc0dd6fd17649bc1 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:42 UTC) from {username='slave'} at 127.0.0.1:45460
I20250830 07:54:42.642160 13739 tablet_service.cc:1515] Processing DeleteTablet for tablet 7676b4d6a75c4c6aacced1f2a1beb555 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:42 UTC) from {username='slave'} at 127.0.0.1:45460
I20250830 07:54:42.642386 13747 tablet_service.cc:1515] Processing DeleteTablet for tablet 74ea2298876a4066b297915c135d4618 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:42 UTC) from {username='slave'} at 127.0.0.1:45460
W20250830 07:54:42.642553 13219 catalog_manager.cc:4895] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): delete failed for tablet 75359721445e48d2bc0dd6fd17649bc1 because the tablet was not found. No further retry: Not found: Tablet not found: 75359721445e48d2bc0dd6fd17649bc1
W20250830 07:54:42.643391 13220 catalog_manager.cc:4908] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet 689b4fee1dd04b3d9ccdea334b0f6b59 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 689b4fee1dd04b3d9ccdea334b0f6b59 already in progress: creating tablet
W20250830 07:54:42.643607 13220 catalog_manager.cc:4895] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet 6720d2b945814305845beea0a2cb9912 because the tablet was not found. No further retry: Not found: Tablet not found: 6720d2b945814305845beea0a2cb9912
I20250830 07:54:42.643673 13468 tablet_service.cc:1515] Processing DeleteTablet for tablet 75359721445e48d2bc0dd6fd17649bc1 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:42 UTC) from {username='slave'} at 127.0.0.1:37956
I20250830 07:54:42.643906 13462 tablet_service.cc:1515] Processing DeleteTablet for tablet 7676b4d6a75c4c6aacced1f2a1beb555 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:42 UTC) from {username='slave'} at 127.0.0.1:37956
I20250830 07:54:42.644116 13458 tablet_service.cc:1515] Processing DeleteTablet for tablet 74ea2298876a4066b297915c135d4618 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:42 UTC) from {username='slave'} at 127.0.0.1:37956
I20250830 07:54:42.644307 13594 tablet_service.cc:1515] Processing DeleteTablet for tablet 7676b4d6a75c4c6aacced1f2a1beb555 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:42 UTC) from {username='slave'} at 127.0.0.1:45306
I20250830 07:54:42.644393 13604 tablet_service.cc:1515] Processing DeleteTablet for tablet 74ea2298876a4066b297915c135d4618 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:42 UTC) from {username='slave'} at 127.0.0.1:45306
I20250830 07:54:42.644546 13606 tablet_service.cc:1515] Processing DeleteTablet for tablet 75359721445e48d2bc0dd6fd17649bc1 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:42 UTC) from {username='slave'} at 127.0.0.1:45306
W20250830 07:54:42.645473 13218 catalog_manager.cc:4895] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): delete failed for tablet 75359721445e48d2bc0dd6fd17649bc1 because the tablet was not found. No further retry: Not found: Tablet not found: 75359721445e48d2bc0dd6fd17649bc1
I20250830 07:54:42.645807 13887 tablet_bootstrap.cc:492] T cb3c48982add45379c0e1b117ec40c1a P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:54:42.645949 13887 ts_tablet_manager.cc:1397] T cb3c48982add45379c0e1b117ec40c1a P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.036s user 0.003s sys 0.000s
W20250830 07:54:42.646184 13218 catalog_manager.cc:4895] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): delete failed for tablet 7676b4d6a75c4c6aacced1f2a1beb555 because the tablet was not found. No further retry: Not found: Tablet not found: 7676b4d6a75c4c6aacced1f2a1beb555
W20250830 07:54:42.646411 13218 catalog_manager.cc:4908] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): delete failed for tablet 74ea2298876a4066b297915c135d4618 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 74ea2298876a4066b297915c135d4618 already in progress: creating tablet
W20250830 07:54:42.646849 13219 catalog_manager.cc:4895] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): delete failed for tablet 7676b4d6a75c4c6aacced1f2a1beb555 because the tablet was not found. No further retry: Not found: Tablet not found: 7676b4d6a75c4c6aacced1f2a1beb555
I20250830 07:54:42.646859 13887 raft_consensus.cc:357] T cb3c48982add45379c0e1b117ec40c1a P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
W20250830 07:54:42.647081 13219 catalog_manager.cc:4908] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): delete failed for tablet 74ea2298876a4066b297915c135d4618 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 74ea2298876a4066b297915c135d4618 already in progress: creating tablet
I20250830 07:54:42.647086 13887 raft_consensus.cc:383] T cb3c48982add45379c0e1b117ec40c1a P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:42.647169 13887 raft_consensus.cc:738] T cb3c48982add45379c0e1b117ec40c1a P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:54:42.647261 14565 raft_consensus.cc:491] T 14ed24577c8f49f49c83242a26877614 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:42.647394 14565 raft_consensus.cc:513] T 14ed24577c8f49f49c83242a26877614 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:42.647436 13887 consensus_queue.cc:260] T cb3c48982add45379c0e1b117ec40c1a P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:42.647935 13887 ts_tablet_manager.cc:1428] T cb3c48982add45379c0e1b117ec40c1a P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20250830 07:54:42.648068 14565 leader_election.cc:290] T 14ed24577c8f49f49c83242a26877614 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967)
I20250830 07:54:42.648224 13887 tablet_bootstrap.cc:492] T 99f307a8cbb34addaafab82b3ed18241 P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:54:42.650187 13481 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "14ed24577c8f49f49c83242a26877614" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:54:42.650352 13628 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "14ed24577c8f49f49c83242a26877614" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:42.650444 13481 raft_consensus.cc:2391] T 14ed24577c8f49f49c83242a26877614 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b057ade5dce45af9f8bf0bedf8b917f in current term 1: Already voted for candidate 6b5e454d98894637b466ea27f1b647f9 in this term.
I20250830 07:54:42.650715 13887 tablet_bootstrap.cc:654] T 99f307a8cbb34addaafab82b3ed18241 P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:42.651118 13701 leader_election.cc:304] T 14ed24577c8f49f49c83242a26877614 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 2065c332f15a4739899af79f3669c3ba, 6b5e454d98894637b466ea27f1b647f9
I20250830 07:54:42.651494 14565 raft_consensus.cc:3058] T 14ed24577c8f49f49c83242a26877614 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:42.653214 13230 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_7c5efa2ac47f4d1583ab3a89270e94f9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:42.653707 13230 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7c5efa2ac47f4d1583ab3a89270e94f9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:42.654006 14565 raft_consensus.cc:2747] T 14ed24577c8f49f49c83242a26877614 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:54:42.654739 13233 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_5aa473e5c4f245cdaba8e696d6775c87"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:42.655247 13233 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5aa473e5c4f245cdaba8e696d6775c87 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250830 07:54:42.656761 13220 catalog_manager.cc:4895] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet 7676b4d6a75c4c6aacced1f2a1beb555 because the tablet was not found. No further retry: Not found: Tablet not found: 7676b4d6a75c4c6aacced1f2a1beb555
W20250830 07:54:42.656972 13220 catalog_manager.cc:4908] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet 74ea2298876a4066b297915c135d4618 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 74ea2298876a4066b297915c135d4618 already in progress: creating tablet
W20250830 07:54:42.657176 13220 catalog_manager.cc:4895] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet 75359721445e48d2bc0dd6fd17649bc1 because the tablet was not found. No further retry: Not found: Tablet not found: 75359721445e48d2bc0dd6fd17649bc1
I20250830 07:54:42.658006 14526 consensus_queue.cc:1035] T 04c9d954106a4417a34ff80bc98e2ce8 P 6b5e454d98894637b466ea27f1b647f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:54:42.659915 13228 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_632fd974aa4a410b8b2c30d251ba9ad7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:42.660424 13228 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_632fd974aa4a410b8b2c30d251ba9ad7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:42.663285 13232 catalog_manager.cc:5674] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743) does not have the latest schema for tablet 14ed24577c8f49f49c83242a26877614 (table default.Table_4428c29c8358411282f00fd33a6badd4 [id=bcee72f9b1c6407f98435a1494b42407]). Expected version 1 got 0
I20250830 07:54:42.665675 13886 tablet_bootstrap.cc:492] T d3f207cee78a43a1b5e030c09752c78c P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:54:42.665841 13886 ts_tablet_manager.cc:1397] T d3f207cee78a43a1b5e030c09752c78c P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.068s user 0.003s sys 0.000s
I20250830 07:54:42.666662 13886 raft_consensus.cc:357] T d3f207cee78a43a1b5e030c09752c78c P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:42.666857 13886 raft_consensus.cc:383] T d3f207cee78a43a1b5e030c09752c78c P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:42.666960 13886 raft_consensus.cc:738] T d3f207cee78a43a1b5e030c09752c78c P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:54:42.667238 13886 consensus_queue.cc:260] T d3f207cee78a43a1b5e030c09752c78c P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:42.667733 13886 ts_tablet_manager.cc:1428] T d3f207cee78a43a1b5e030c09752c78c P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20250830 07:54:42.668057 13886 tablet_bootstrap.cc:492] T e862fa77e16945bd94e405aa3474f021 P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:54:42.671878 13886 tablet_bootstrap.cc:654] T e862fa77e16945bd94e405aa3474f021 P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
W20250830 07:54:42.679471 13229 catalog_manager.cc:5415] Ignoring report from unknown tablet b38c8d003413428dae9e47f58e197c2c
W20250830 07:54:42.679679 13229 catalog_manager.cc:5415] Ignoring report from unknown tablet ff2267fb411942ff826e2a72bcb89cd7
W20250830 07:54:42.679783 13229 catalog_manager.cc:5415] Ignoring report from unknown tablet e4c5eedb7f4d4397b19b8a3e0ddf9458
W20250830 07:54:42.680815 13229 catalog_manager.cc:5415] Ignoring report from unknown tablet cf5613278b4c4f3bbe751b1ae6f3c313
I20250830 07:54:42.684710 13228 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_83d0da7d392c4cf7837921ac75c21714"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:42.685694 13231 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a7dc529c40544bafbc9e7f0ab34086bd consensus state has no leader
W20250830 07:54:42.686586 13228 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_83d0da7d392c4cf7837921ac75c21714 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:42.687613 14480 consensus_queue.cc:1035] T 04c9d954106a4417a34ff80bc98e2ce8 P 6b5e454d98894637b466ea27f1b647f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20250830 07:54:42.688400 13227 catalog_manager.cc:5415] Ignoring report from unknown tablet d3f207cee78a43a1b5e030c09752c78c
I20250830 07:54:42.688781 13229 catalog_manager.cc:5582] T 8dddcfe56522436287aea212e316a729 P 6b5e454d98894637b466ea27f1b647f9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2). New cstate: current_term: 1 leader_uuid: "6b5e454d98894637b466ea27f1b647f9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } health_report { overall_health: UNKNOWN } } }
I20250830 07:54:42.689272 13229 catalog_manager.cc:5674] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967) does not have the latest schema for tablet 8dddcfe56522436287aea212e316a729 (table default.Table_e0d2400861094b258fca0704d88ed743 [id=c483c08824f24586855e3575a590b294]). Expected version 2 got 0
I20250830 07:54:42.689502 13229 catalog_manager.cc:5674] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967) does not have the latest schema for tablet 69d6daeb7c774fd48ed296f52ed7c6a6 (table default.Table_c8fac6974ea94c7e863c1ded184f9230 [id=761247d93d9f4f788ecceabebf1de486]). Expected version 3 got 0
I20250830 07:54:42.689781 13229 catalog_manager.cc:5582] T 14ed24577c8f49f49c83242a26877614 P 6b5e454d98894637b466ea27f1b647f9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2). New cstate: current_term: 1 leader_uuid: "6b5e454d98894637b466ea27f1b647f9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } health_report { overall_health: UNKNOWN } } }
I20250830 07:54:42.690228 13229 catalog_manager.cc:5674] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967) does not have the latest schema for tablet 14ed24577c8f49f49c83242a26877614 (table default.Table_4428c29c8358411282f00fd33a6badd4 [id=bcee72f9b1c6407f98435a1494b42407]). Expected version 1 got 0
I20250830 07:54:42.691123 13226 catalog_manager.cc:6127] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: default.Table_54bd02c58de341ec93ced1d662a7e671 [id=b80ba51884ef4042818f8def0b0ebf0e] alter complete (version 2)
I20250830 07:54:42.695968 13404 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet 6720d2b945814305845beea0a2cb9912
I20250830 07:54:42.696732 13404 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet 4639d1b6add8447c9ce071af71a99869
I20250830 07:54:42.697209 13404 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet 7676b4d6a75c4c6aacced1f2a1beb555
I20250830 07:54:42.697561 13606 tablet_service.cc:1515] Processing DeleteTablet for tablet 6720d2b945814305845beea0a2cb9912 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:42 UTC) from {username='slave'} at 127.0.0.1:45306
I20250830 07:54:42.697620 13458 tablet_service.cc:1515] Processing DeleteTablet for tablet 6720d2b945814305845beea0a2cb9912 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:42 UTC) from {username='slave'} at 127.0.0.1:37956
I20250830 07:54:42.697871 13747 tablet_service.cc:1515] Processing DeleteTablet for tablet 6720d2b945814305845beea0a2cb9912 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:42 UTC) from {username='slave'} at 127.0.0.1:45460
I20250830 07:54:42.698658 13226 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_e6e8ed8d3fb245729dfbc091e5e237a3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:42.699156 13220 catalog_manager.cc:4895] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet 6720d2b945814305845beea0a2cb9912 because the tablet was not found. No further retry: Not found: Tablet not found: 6720d2b945814305845beea0a2cb9912
W20250830 07:54:42.699209 13226 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e6e8ed8d3fb245729dfbc091e5e237a3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:42.699466 13882 tablet_bootstrap.cc:492] T 7af74bdde363493f8061eba450ecf4b4 P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:54:42.699631 13882 ts_tablet_manager.cc:1397] T 7af74bdde363493f8061eba450ecf4b4 P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.147s user 0.003s sys 0.001s
W20250830 07:54:42.700420 13218 catalog_manager.cc:4895] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): delete failed for tablet 6720d2b945814305845beea0a2cb9912 because the tablet was not found. No further retry: Not found: Tablet not found: 6720d2b945814305845beea0a2cb9912
I20250830 07:54:42.700402 13882 raft_consensus.cc:357] T 7af74bdde363493f8061eba450ecf4b4 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:42.700605 13882 raft_consensus.cc:383] T 7af74bdde363493f8061eba450ecf4b4 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:42.700599 13458 tablet_service.cc:1515] Processing DeleteTablet for tablet 4639d1b6add8447c9ce071af71a99869 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:42 UTC) from {username='slave'} at 127.0.0.1:37956
W20250830 07:54:42.700659 13219 catalog_manager.cc:4895] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): delete failed for tablet 6720d2b945814305845beea0a2cb9912 because the tablet was not found. No further retry: Not found: Tablet not found: 6720d2b945814305845beea0a2cb9912
I20250830 07:54:42.700686 13882 raft_consensus.cc:738] T 7af74bdde363493f8061eba450ecf4b4 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:54:42.700892 13882 consensus_queue.cc:260] T 7af74bdde363493f8061eba450ecf4b4 P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:42.701152 13404 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet 75359721445e48d2bc0dd6fd17649bc1
I20250830 07:54:42.701411 13882 ts_tablet_manager.cc:1428] T 7af74bdde363493f8061eba450ecf4b4 P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20250830 07:54:42.701644 13747 tablet_service.cc:1515] Processing DeleteTablet for tablet 4639d1b6add8447c9ce071af71a99869 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:42 UTC) from {username='slave'} at 127.0.0.1:45460
I20250830 07:54:42.701680 13882 tablet_bootstrap.cc:492] T 30c2558c28944ff39d1a4a4ca9ac604e P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:54:42.701996 13606 tablet_service.cc:1515] Processing DeleteTablet for tablet 4639d1b6add8447c9ce071af71a99869 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:42 UTC) from {username='slave'} at 127.0.0.1:45306
W20250830 07:54:42.703377 13218 catalog_manager.cc:4895] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): delete failed for tablet 4639d1b6add8447c9ce071af71a99869 because the tablet was not found. No further retry: Not found: Tablet not found: 4639d1b6add8447c9ce071af71a99869
I20250830 07:54:42.703650 13882 tablet_bootstrap.cc:654] T 30c2558c28944ff39d1a4a4ca9ac604e P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:42.704190 13227 master_service.cc:948] ReplaceTablet: received request to replace tablet 91ab8c468c8143b9ae11b839a95a26fd from {username='slave'} at 127.0.0.1:42126
I20250830 07:54:42.705917 13739 tablet_service.cc:1515] Processing DeleteTablet for tablet 75359721445e48d2bc0dd6fd17649bc1 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:42 UTC) from {username='slave'} at 127.0.0.1:45460
I20250830 07:54:42.706141 13755 tablet_service.cc:1468] Processing CreateTablet for tablet 2b4103f07e96490488913059a95af0c3 (DEFAULT_TABLE table=default.Table_42c639c9b9ec4ebfbfb9ae1452fcec86 [id=003a7527bdad46eb986233b2a6841f63]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:42.706522 13755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b4103f07e96490488913059a95af0c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:42.706599 13747 tablet_service.cc:1515] Processing DeleteTablet for tablet 7676b4d6a75c4c6aacced1f2a1beb555 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:42 UTC) from {username='slave'} at 127.0.0.1:45460
W20250830 07:54:42.708173 13220 catalog_manager.cc:4895] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet 4639d1b6add8447c9ce071af71a99869 because the tablet was not found. No further retry: Not found: Tablet not found: 4639d1b6add8447c9ce071af71a99869
I20250830 07:54:42.709129 13458 tablet_service.cc:1515] Processing DeleteTablet for tablet 7676b4d6a75c4c6aacced1f2a1beb555 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:42 UTC) from {username='slave'} at 127.0.0.1:37956
I20250830 07:54:42.709352 13462 tablet_service.cc:1515] Processing DeleteTablet for tablet 75359721445e48d2bc0dd6fd17649bc1 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:42 UTC) from {username='slave'} at 127.0.0.1:37956
I20250830 07:54:42.709997 13468 tablet_service.cc:1468] Processing CreateTablet for tablet f32ebc2605c34a68aed50379f028052c (DEFAULT_TABLE table=default.Table_6dbeeb382b9a4cef84a165dc351d2c20 [id=7b96f5645f234823a13345b9e7a256c5]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:42.710376 13468 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f32ebc2605c34a68aed50379f028052c. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:42.710620 13604 tablet_service.cc:1515] Processing DeleteTablet for tablet 75359721445e48d2bc0dd6fd17649bc1 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:42 UTC) from {username='slave'} at 127.0.0.1:45306
I20250830 07:54:42.711131 13595 tablet_service.cc:1468] Processing CreateTablet for tablet f32ebc2605c34a68aed50379f028052c (DEFAULT_TABLE table=default.Table_6dbeeb382b9a4cef84a165dc351d2c20 [id=7b96f5645f234823a13345b9e7a256c5]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:42.711236 13594 tablet_service.cc:1468] Processing CreateTablet for tablet 2b4103f07e96490488913059a95af0c3 (DEFAULT_TABLE table=default.Table_42c639c9b9ec4ebfbfb9ae1452fcec86 [id=003a7527bdad46eb986233b2a6841f63]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:42.711666 13606 tablet_service.cc:1515] Processing DeleteTablet for tablet 7676b4d6a75c4c6aacced1f2a1beb555 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:42 UTC) from {username='slave'} at 127.0.0.1:45306
I20250830 07:54:42.711678 13593 tablet_service.cc:1468] Processing CreateTablet for tablet 14d4d2506e2a47ea906bfb81d5509829 (DEFAULT_TABLE table=default.Table_6c8e3e90a0954fe79ae9491c5b839979 [id=500ddbae128e48818139dd9f227f094e]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:42.712229 13604 tablet_service.cc:1468] Processing CreateTablet for tablet 208995abd6d44dbea3b5ebbea27d6a39 (DEFAULT_TABLE table=default.Table_2a3e3a79103b4c378e0cf2beabac7ed2 [id=f3fe2e87e9bb4f329ff368cc3ee08980]), partition=RANGE (key) PARTITION UNBOUNDED
W20250830 07:54:42.714423 13124 external_mini_cluster.cc:1715] Unable to check leaks on /tmp/dist-test-taskbivBUj/build/asan/bin/kudu pid 13999: Timed out: CheckLeaks RPC to 127.12.209.60:43889 timed out after 1.000s (SENT)
I20250830 07:54:42.714615 13124 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskbivBUj/build/asan/bin/kudu with pid 13999
W20250830 07:54:42.714574 13219 catalog_manager.cc:4895] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): delete failed for tablet 4639d1b6add8447c9ce071af71a99869 because the tablet was not found. No further retry: Not found: Tablet not found: 4639d1b6add8447c9ce071af71a99869
I20250830 07:54:42.715595 13462 tablet_service.cc:1468] Processing CreateTablet for tablet 208995abd6d44dbea3b5ebbea27d6a39 (DEFAULT_TABLE table=default.Table_2a3e3a79103b4c378e0cf2beabac7ed2 [id=f3fe2e87e9bb4f329ff368cc3ee08980]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:42.715956 13462 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 208995abd6d44dbea3b5ebbea27d6a39. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:42.717128 13745 tablet_service.cc:1468] Processing CreateTablet for tablet 14d4d2506e2a47ea906bfb81d5509829 (DEFAULT_TABLE table=default.Table_6c8e3e90a0954fe79ae9491c5b839979 [id=500ddbae128e48818139dd9f227f094e]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:42.717468 13745 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 14d4d2506e2a47ea906bfb81d5509829. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:42.717491 13739 tablet_service.cc:1468] Processing CreateTablet for tablet 208995abd6d44dbea3b5ebbea27d6a39 (DEFAULT_TABLE table=default.Table_2a3e3a79103b4c378e0cf2beabac7ed2 [id=f3fe2e87e9bb4f329ff368cc3ee08980]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:42.717864 13739 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 208995abd6d44dbea3b5ebbea27d6a39. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:42.719192 13742 tablet_service.cc:1468] Processing CreateTablet for tablet a0cf1de8485941eb8a557a6e2f783047 (DEFAULT_TABLE table=default.Table_a99c09edb9f7481a8eb146367454eece [id=ba28abd8a8d54350a385834452ef59bd]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:42.719513 13742 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0cf1de8485941eb8a557a6e2f783047. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:42.719871 13747 tablet_service.cc:1468] Processing CreateTablet for tablet f32ebc2605c34a68aed50379f028052c (DEFAULT_TABLE table=default.Table_6dbeeb382b9a4cef84a165dc351d2c20 [id=7b96f5645f234823a13345b9e7a256c5]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:42.720317 13747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f32ebc2605c34a68aed50379f028052c. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:42.723177 13749 tablet_service.cc:1468] Processing CreateTablet for tablet 15f8fd7d9e6242c6b6c51251d618ef09 (DEFAULT_TABLE table=default.Table_205eff07ab794c6fb99d60b9d2f2b4ec [id=0f895438aebd4f25924798a8d368243c]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:42.723264 13458 tablet_service.cc:1468] Processing CreateTablet for tablet 2b4103f07e96490488913059a95af0c3 (DEFAULT_TABLE table=default.Table_42c639c9b9ec4ebfbfb9ae1452fcec86 [id=003a7527bdad46eb986233b2a6841f63]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:42.723512 13749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 15f8fd7d9e6242c6b6c51251d618ef09. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:42.725840 13600 tablet_service.cc:1468] Processing CreateTablet for tablet e72402ca3cdf452fa8f4534c67226253 (DEFAULT_TABLE table=default.Table_98f42247a5704c41af9ab81bd583d43e [id=8756c0faac90406687c1455181040701]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:42.726388 13602 tablet_service.cc:1468] Processing CreateTablet for tablet a0cf1de8485941eb8a557a6e2f783047 (DEFAULT_TABLE table=default.Table_a99c09edb9f7481a8eb146367454eece [id=ba28abd8a8d54350a385834452ef59bd]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:42.726612 13736 tablet_service.cc:1468] Processing CreateTablet for tablet 240a6bfad8fa478598a67a27c2dedf62 (DEFAULT_TABLE table=default.Table_f6bd1f04d55045ef97fc62076520c6a6 [id=5cf34164ee9a4670ae243486fc71bd5f]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:42.726800 13458 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b4103f07e96490488913059a95af0c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:42.726961 13736 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 240a6bfad8fa478598a67a27c2dedf62. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:42.727136 13606 tablet_service.cc:1468] Processing CreateTablet for tablet 15f8fd7d9e6242c6b6c51251d618ef09 (DEFAULT_TABLE table=default.Table_205eff07ab794c6fb99d60b9d2f2b4ec [id=0f895438aebd4f25924798a8d368243c]), partition=RANGE (key) PARTITION UNBOUNDED
W20250830 07:54:42.727679 13220 catalog_manager.cc:4895] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet 75359721445e48d2bc0dd6fd17649bc1 because the tablet was not found. No further retry: Not found: Tablet not found: 75359721445e48d2bc0dd6fd17649bc1
W20250830 07:54:42.727932 13220 catalog_manager.cc:4895] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet 7676b4d6a75c4c6aacced1f2a1beb555 because the tablet was not found. No further retry: Not found: Tablet not found: 7676b4d6a75c4c6aacced1f2a1beb555
W20250830 07:54:42.728497 13219 catalog_manager.cc:4895] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): delete failed for tablet 75359721445e48d2bc0dd6fd17649bc1 because the tablet was not found. No further retry: Not found: Tablet not found: 75359721445e48d2bc0dd6fd17649bc1
W20250830 07:54:42.728740 13219 catalog_manager.cc:4895] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): delete failed for tablet 7676b4d6a75c4c6aacced1f2a1beb555 because the tablet was not found. No further retry: Not found: Tablet not found: 7676b4d6a75c4c6aacced1f2a1beb555
I20250830 07:54:42.730310 13455 tablet_service.cc:1468] Processing CreateTablet for tablet 15f8fd7d9e6242c6b6c51251d618ef09 (DEFAULT_TABLE table=default.Table_205eff07ab794c6fb99d60b9d2f2b4ec [id=0f895438aebd4f25924798a8d368243c]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:42.730580 13751 tablet_service.cc:1468] Processing CreateTablet for tablet e72402ca3cdf452fa8f4534c67226253 (DEFAULT_TABLE table=default.Table_98f42247a5704c41af9ab81bd583d43e [id=8756c0faac90406687c1455181040701]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:42.730676 13455 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 15f8fd7d9e6242c6b6c51251d618ef09. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:42.730886 13751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e72402ca3cdf452fa8f4534c67226253. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:42.731194 13460 tablet_service.cc:1468] Processing CreateTablet for tablet 1cf23cf78eee46be953bd701aa6bef07 (DEFAULT_TABLE table=default.Table_0502d3a9e685480c8fd80584b1333d84 [id=420148e4624b4ca49a3737f232d799de]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:42.731432 13452 tablet_service.cc:1468] Processing CreateTablet for tablet 240a6bfad8fa478598a67a27c2dedf62 (DEFAULT_TABLE table=default.Table_f6bd1f04d55045ef97fc62076520c6a6 [id=5cf34164ee9a4670ae243486fc71bd5f]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:42.731560 13460 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1cf23cf78eee46be953bd701aa6bef07. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:42.731750 13452 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 240a6bfad8fa478598a67a27c2dedf62. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:42.732002 13454 tablet_service.cc:1468] Processing CreateTablet for tablet a0cf1de8485941eb8a557a6e2f783047 (DEFAULT_TABLE table=default.Table_a99c09edb9f7481a8eb146367454eece [id=ba28abd8a8d54350a385834452ef59bd]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:42.732344 13454 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0cf1de8485941eb8a557a6e2f783047. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:42.734724 13228 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_9450ad668d274eeab37e9b323612e8a7" } new_table_name: "default.Table_200f184b944748a08e37e88ac1a2d08d" modify_external_catalogs: true
W20250830 07:54:42.735144 13218 catalog_manager.cc:4895] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): delete failed for tablet 7676b4d6a75c4c6aacced1f2a1beb555 because the tablet was not found. No further retry: Not found: Tablet not found: 7676b4d6a75c4c6aacced1f2a1beb555
I20250830 07:54:42.735244 13750 tablet_service.cc:1468] Processing CreateTablet for tablet 1cf23cf78eee46be953bd701aa6bef07 (DEFAULT_TABLE table=default.Table_0502d3a9e685480c8fd80584b1333d84 [id=420148e4624b4ca49a3737f232d799de]), partition=RANGE (key) PARTITION UNBOUNDED
W20250830 07:54:42.735381 13218 catalog_manager.cc:4895] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): delete failed for tablet 75359721445e48d2bc0dd6fd17649bc1 because the tablet was not found. No further retry: Not found: Tablet not found: 75359721445e48d2bc0dd6fd17649bc1
I20250830 07:54:42.735548 13750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1cf23cf78eee46be953bd701aa6bef07. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:42.739192 13596 tablet_service.cc:1468] Processing CreateTablet for tablet 240a6bfad8fa478598a67a27c2dedf62 (DEFAULT_TABLE table=default.Table_f6bd1f04d55045ef97fc62076520c6a6 [id=5cf34164ee9a4670ae243486fc71bd5f]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:42.739723 13590 tablet_service.cc:1468] Processing CreateTablet for tablet 1cf23cf78eee46be953bd701aa6bef07 (DEFAULT_TABLE table=default.Table_0502d3a9e685480c8fd80584b1333d84 [id=420148e4624b4ca49a3737f232d799de]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:42.740702 13233 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_6041884eb99a4da5b48436b99054e999"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250830 07:54:42.741070 14644 raft_consensus.cc:491] T 8f215330505848619ad44569d3167591 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20250830 07:54:42.741245 13233 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6041884eb99a4da5b48436b99054e999 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:42.741555 14567 raft_consensus.cc:491] T d3f207cee78a43a1b5e030c09752c78c P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:42.743343 14567 raft_consensus.cc:513] T d3f207cee78a43a1b5e030c09752c78c P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
W20250830 07:54:42.743832 13228 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 91da20bcd25341b5a0f6605b3ec58fb3 consensus state has no leader
I20250830 07:54:42.743914 14567 leader_election.cc:290] T d3f207cee78a43a1b5e030c09752c78c P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
I20250830 07:54:42.744896 14533 raft_consensus.cc:491] T 853503f3f98a49219b077af980180400 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:42.745477 13467 tablet_service.cc:1468] Processing CreateTablet for tablet e72402ca3cdf452fa8f4534c67226253 (DEFAULT_TABLE table=default.Table_98f42247a5704c41af9ab81bd583d43e [id=8756c0faac90406687c1455181040701]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:42.745800 13457 tablet_service.cc:1468] Processing CreateTablet for tablet ddedd1f141c147c69f178c6cd2b287da (DEFAULT_TABLE table=default.Table_069a84d6c4a74ddaa7d7ea9c964da0db [id=308370ffd790440fb37a3153ee738145]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:42.745044 14533 raft_consensus.cc:513] T 853503f3f98a49219b077af980180400 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:42.746436 13449 tablet_service.cc:1468] Processing CreateTablet for tablet 579324e1f6474d398db10da3093650dd (DEFAULT_TABLE table=default.Table_1baaad25c30a45fa8d70fd9fafe5fc89 [id=274be5b4f30a43e3b96675f7732476b1]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:42.746474 13450 tablet_service.cc:1468] Processing CreateTablet for tablet 5fee48de90014f94b796e726a4d16b85 (DEFAULT_TABLE table=default.Table_74e19ec0844742e8ac529d2291bf2897 [id=947411a7cb36432db1274cde791076da]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:42.747630 13227 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_e8e9b4f20799486282c3998dac420480"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250830 07:54:42.748306 13628 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "d3f207cee78a43a1b5e030c09752c78c" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
W20250830 07:54:42.748802 13227 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e8e9b4f20799486282c3998dac420480 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:42.750044 13601 tablet_service.cc:1468] Processing CreateTablet for tablet 5fee48de90014f94b796e726a4d16b85 (DEFAULT_TABLE table=default.Table_74e19ec0844742e8ac529d2291bf2897 [id=947411a7cb36432db1274cde791076da]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:42.750571 13603 tablet_service.cc:1468] Processing CreateTablet for tablet 579324e1f6474d398db10da3093650dd (DEFAULT_TABLE table=default.Table_1baaad25c30a45fa8d70fd9fafe5fc89 [id=274be5b4f30a43e3b96675f7732476b1]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:42.752961 14526 raft_consensus.cc:491] T 69d6daeb7c774fd48ed296f52ed7c6a6 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:42.753130 14526 raft_consensus.cc:513] T 69d6daeb7c774fd48ed296f52ed7c6a6 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:42.753257 13226 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_10cf790ce076449ba68094fc91ebade3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250830 07:54:42.753751 14526 leader_election.cc:290] T 69d6daeb7c774fd48ed296f52ed7c6a6 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
W20250830 07:54:42.754068 13226 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_10cf790ce076449ba68094fc91ebade3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:42.754556 13607 tablet_service.cc:1468] Processing CreateTablet for tablet fbb1cc8f8eea4a0795f6f8e213b8180f (DEFAULT_TABLE table=default.Table_03d5ae4a6e604180be10c3a025359f5b [id=60d4b91855134b03860cf7dab25e1775]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:42.754642 13597 tablet_service.cc:1468] Processing CreateTablet for tablet 2f3bec2c98574a9393e0fae77e228ce0 (DEFAULT_TABLE table=default.Table_c6ae99ff685c419c85e78e738f8a077e [id=5fc49aaf98964a31a35fcc0405ac23ae]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:42.754961 13599 tablet_service.cc:1468] Processing CreateTablet for tablet ddedd1f141c147c69f178c6cd2b287da (DEFAULT_TABLE table=default.Table_069a84d6c4a74ddaa7d7ea9c964da0db [id=308370ffd790440fb37a3153ee738145]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:42.755333 13608 tablet_service.cc:1468] Processing CreateTablet for tablet f332d1b56d924c91a79cf6572dea1cd2 (DEFAULT_TABLE table=default.Table_cff60520ee6942269d4b80f84cf356c1 [id=50c1ce3c8e8c415391e55896a54ba43e]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:42.755347 13233 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_b272b07ca0614cafb8c14f4e2132d255" } new_table_name: "default.Table_a7d9a21ec2e74f30a2ce61cdcdd33685" modify_external_catalogs: true
I20250830 07:54:42.756068 13591 tablet_service.cc:1468] Processing CreateTablet for tablet 66432e73deea433d9df565d5fcace647 (DEFAULT_TABLE table=default.Table_accd635a5d39461a8ecd9d947700d768 [id=10edfc6489fe4f348614d3db93a8fdb8]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:42.756814 13592 tablet_service.cc:1468] Processing CreateTablet for tablet 5e2da5434e95445aa4deafce7fde0c6c (DEFAULT_TABLE table=default.Table_3e4b0ec8a89347c39ca293dd697bb734 [id=e6a4eb5417774271a0f2e116829bdb14]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:42.757233 13609 tablet_service.cc:1468] Processing CreateTablet for tablet 509e08290f3842cfbde8b74ff9f4f70f (DEFAULT_TABLE table=default.Table_ebc7e2e80254427c933db947a11b2ef3 [id=16e67cb400234cb08c29407662708529]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:42.757737 13605 tablet_service.cc:1468] Processing CreateTablet for tablet 2c4c3c61cddf42668d3a09f4fbc5f641 (DEFAULT_TABLE table=default.Table_481f218fb1b94c81b8f0932c67bb5b55 [id=da55ca35442546899b18ebd8a52e8d0c]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:42.758205 13598 tablet_service.cc:1468] Processing CreateTablet for tablet d171ad1667fa44c993ec5fd7d701d8e0 (DEFAULT_TABLE table=default.Table_92300192de164f969afb0aeaebfd701f [id=8de51280a0014a9db6181db50fbf74f8]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:42.762391 14644 raft_consensus.cc:513] T 8f215330505848619ad44569d3167591 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:42.763156 14644 leader_election.cc:290] T 8f215330505848619ad44569d3167591 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:42.763324 14402 raft_consensus.cc:491] T 73853894da074ecd8147a94ac28bfab8 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:42.763463 14402 raft_consensus.cc:513] T 73853894da074ecd8147a94ac28bfab8 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:42.764175 14402 leader_election.cc:290] T 73853894da074ecd8147a94ac28bfab8 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:42.764385 13466 tablet_service.cc:1468] Processing CreateTablet for tablet fbb1cc8f8eea4a0795f6f8e213b8180f (DEFAULT_TABLE table=default.Table_03d5ae4a6e604180be10c3a025359f5b [id=60d4b91855134b03860cf7dab25e1775]), partition=RANGE (key) PARTITION UNBOUNDED
W20250830 07:54:42.770612 13221 catalog_manager.cc:4726] Async tablet task AlterTable RPC for tablet 2d91b0ba74034b85812a13719e21dc6c (table default.Table_d978d625ae9f4ac5ad252d8e982685f7 [id=9fd46fc815604123bcb15dc7ecd892a9], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 2d91b0ba74034b85812a13719e21dc6c consensus state has no leader
I20250830 07:54:42.770896 13624 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "73853894da074ecd8147a94ac28bfab8" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
W20250830 07:54:42.772536 13233 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 7e9d6af1d7fc4d4b961583b44f2f962a consensus state has no leader
I20250830 07:54:42.777252 13467 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e72402ca3cdf452fa8f4534c67226253. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:42.778478 13233 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_bb4930ea8d0c4023a4492cfe51d6ed2e" } new_table_name: "default.Table_6b7fef7c0eba4cd5b26659f55457349d" modify_external_catalogs: true
I20250830 07:54:42.795140 13450 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5fee48de90014f94b796e726a4d16b85. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:42.795964 13628 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "8f215330505848619ad44569d3167591" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:42.784505 13481 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "69d6daeb7c774fd48ed296f52ed7c6a6" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
W20250830 07:54:42.796797 13561 leader_election.cc:343] T 69d6daeb7c774fd48ed296f52ed7c6a6 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): Illegal state: must be running to vote when last-logged opid is not known
W20250830 07:54:42.797909 13233 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet bac72b4ba9ba4ca69f93e799dccb0e93 consensus state has no leader
I20250830 07:54:42.799607 13595 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f32ebc2605c34a68aed50379f028052c. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:42.799829 13592 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e2da5434e95445aa4deafce7fde0c6c. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:42.800081 13600 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e72402ca3cdf452fa8f4534c67226253. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:42.800639 13594 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b4103f07e96490488913059a95af0c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:42.801285 13597 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f3bec2c98574a9393e0fae77e228ce0. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:42.801533 13591 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 66432e73deea433d9df565d5fcace647. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:42.801817 13598 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d171ad1667fa44c993ec5fd7d701d8e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:42.802356 13593 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 14d4d2506e2a47ea906bfb81d5509829. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:42.802560 13609 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 509e08290f3842cfbde8b74ff9f4f70f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:42.802888 13602 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0cf1de8485941eb8a557a6e2f783047. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:42.803270 13599 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ddedd1f141c147c69f178c6cd2b287da. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:42.803642 13606 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 15f8fd7d9e6242c6b6c51251d618ef09. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:42.803867 13608 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f332d1b56d924c91a79cf6572dea1cd2. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:42.804744 13605 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c4c3c61cddf42668d3a09f4fbc5f641. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:42.805285 13607 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fbb1cc8f8eea4a0795f6f8e213b8180f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:42.806314 13603 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 579324e1f6474d398db10da3093650dd. 1 dirs total, 0 dirs full, 0 dirs failed
W20250830 07:54:42.797974 13423 leader_election.cc:343] T 73853894da074ecd8147a94ac28bfab8 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:42.807287 13485 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "d3f207cee78a43a1b5e030c09752c78c" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:54:42.808338 13449 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 579324e1f6474d398db10da3093650dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:42.808755 13601 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5fee48de90014f94b796e726a4d16b85. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:42.809254 13596 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 240a6bfad8fa478598a67a27c2dedf62. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:42.809892 13604 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 208995abd6d44dbea3b5ebbea27d6a39. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:42.810475 13590 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1cf23cf78eee46be953bd701aa6bef07. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:42.810228 13233 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_fe33866fc1ed45899e8aaa719eab9640"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:42.811970 13233 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fe33866fc1ed45899e8aaa719eab9640 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:42.812628 13462 tablet_service.cc:1468] Processing CreateTablet for tablet 14d4d2506e2a47ea906bfb81d5509829 (DEFAULT_TABLE table=default.Table_6c8e3e90a0954fe79ae9491c5b839979 [id=500ddbae128e48818139dd9f227f094e]), partition=RANGE (key) PARTITION UNBOUNDED
W20250830 07:54:42.817045 13703 leader_election.cc:343] T d3f207cee78a43a1b5e030c09752c78c P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
W20250830 07:54:42.817199 13703 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.209.2:38967, user_credentials={real_user=slave}} blocked reactor thread for 67704.1us
I20250830 07:54:42.818233 13774 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "69d6daeb7c774fd48ed296f52ed7c6a6" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:42.818954 13886 tablet_bootstrap.cc:492] T e862fa77e16945bd94e405aa3474f021 P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
W20250830 07:54:42.819906 13562 leader_election.cc:343] T 69d6daeb7c774fd48ed296f52ed7c6a6 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:42.822789 13453 tablet_service.cc:1468] Processing CreateTablet for tablet 2f3bec2c98574a9393e0fae77e228ce0 (DEFAULT_TABLE table=default.Table_c6ae99ff685c419c85e78e738f8a077e [id=5fc49aaf98964a31a35fcc0405ac23ae]), partition=RANGE (key) PARTITION UNBOUNDED
W20250830 07:54:42.823153 13423 leader_election.cc:343] T 8f215330505848619ad44569d3167591 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:42.825611 13562 leader_election.cc:304] T 69d6daeb7c774fd48ed296f52ed7c6a6 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b5e454d98894637b466ea27f1b647f9; no voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f
W20250830 07:54:42.830032 13219 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.12.209.60:43889 (error 108) [suppressed 5 similar messages]
I20250830 07:54:42.832454 13227 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_d978d625ae9f4ac5ad252d8e982685f7" } modify_external_catalogs: true
I20250830 07:54:42.833148 13227 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_d978d625ae9f4ac5ad252d8e982685f7" } modify_external_catalogs: true
I20250830 07:54:42.834877 13228 master_service.cc:948] ReplaceTablet: received request to replace tablet 04c9d954106a4417a34ff80bc98e2ce8 from {username='slave'} at 127.0.0.1:42126
I20250830 07:54:42.835805 13226 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_7d9f9b1fda5b4fc183fa2b56c3b6642f" } modify_external_catalogs: true
I20250830 07:54:42.835970 13226 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_7d9f9b1fda5b4fc183fa2b56c3b6642f" } modify_external_catalogs: true
I20250830 07:54:42.836937 14480 raft_consensus.cc:2747] T 69d6daeb7c774fd48ed296f52ed7c6a6 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:54:42.840426 13228 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_2e83ff4fc25644689ac5cc5740c35987" } modify_external_catalogs: true
I20250830 07:54:42.840584 13228 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_2e83ff4fc25644689ac5cc5740c35987" } modify_external_catalogs: true
I20250830 07:54:42.844465 13231 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_de0f48eea7d242d18e0801cf1190d363" } new_table_name: "default.Table_c2d3c80608cf49c4832bcc433c7533ae" modify_external_catalogs: true
I20250830 07:54:42.847802 13230 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_3a3bd36d028a41e39d051f15093ea71d" } modify_external_catalogs: true
I20250830 07:54:42.847900 13232 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_df1448b0d1b44810b3ce8ad508249df6" } modify_external_catalogs: true
I20250830 07:54:42.847985 13230 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_3a3bd36d028a41e39d051f15093ea71d" } modify_external_catalogs: true
I20250830 07:54:42.848090 13232 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_df1448b0d1b44810b3ce8ad508249df6" } modify_external_catalogs: true
W20250830 07:54:42.850771 13562 connection.cc:537] client connection to 127.12.209.60:43889 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20250830 07:54:42.841495 13592 tablet_service.cc:1468] Processing CreateTablet for tablet 846338e46b834ae0b5f4e74c7f1325d2 (DEFAULT_TABLE table=default.Table_337eac5fc73e489cadc40b6760448942 [id=70484f58c3a94163bb156908d0468a06]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:42.855669 13226 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet f1fe024f0de048a5a0931ee38752d5a1
I20250830 07:54:42.857808 13752 tablet_service.cc:1468] Processing CreateTablet for tablet 579324e1f6474d398db10da3093650dd (DEFAULT_TABLE table=default.Table_1baaad25c30a45fa8d70fd9fafe5fc89 [id=274be5b4f30a43e3b96675f7732476b1]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:42.858649 13740 tablet_service.cc:1468] Processing CreateTablet for tablet fbb1cc8f8eea4a0795f6f8e213b8180f (DEFAULT_TABLE table=default.Table_03d5ae4a6e604180be10c3a025359f5b [id=60d4b91855134b03860cf7dab25e1775]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:42.859833 13738 tablet_service.cc:1468] Processing CreateTablet for tablet 5e2da5434e95445aa4deafce7fde0c6c (DEFAULT_TABLE table=default.Table_3e4b0ec8a89347c39ca293dd697bb734 [id=e6a4eb5417774271a0f2e116829bdb14]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:42.860482 13748 tablet_service.cc:1468] Processing CreateTablet for tablet 2c4c3c61cddf42668d3a09f4fbc5f641 (DEFAULT_TABLE table=default.Table_481f218fb1b94c81b8f0932c67bb5b55 [id=da55ca35442546899b18ebd8a52e8d0c]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:42.861654 13485 raft_consensus.cc:2466] T d3f207cee78a43a1b5e030c09752c78c P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 0.
I20250830 07:54:42.864737 14533 leader_election.cc:290] T 853503f3f98a49219b077af980180400 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
I20250830 07:54:42.865869 14567 consensus_queue.cc:1035] T 6dda55ec2da34c8aba9f39a63e144a7c P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.020s
I20250830 07:54:42.866849 13754 tablet_service.cc:1468] Processing CreateTablet for tablet ddedd1f141c147c69f178c6cd2b287da (DEFAULT_TABLE table=default.Table_069a84d6c4a74ddaa7d7ea9c964da0db [id=308370ffd790440fb37a3153ee738145]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:42.868317 13886 ts_tablet_manager.cc:1397] T e862fa77e16945bd94e405aa3474f021 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.152s user 0.001s sys 0.007s
W20250830 07:54:42.871321 13231 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 11042d702d4048c99644f0f06a6212d6 consensus state has no leader
I20250830 07:54:42.871448 13744 tablet_service.cc:1468] Processing CreateTablet for tablet d171ad1667fa44c993ec5fd7d701d8e0 (DEFAULT_TABLE table=default.Table_92300192de164f969afb0aeaebfd701f [id=8de51280a0014a9db6181db50fbf74f8]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:42.871874 13230 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet e4ca3110247640fbae4241448e8d5ef7
I20250830 07:54:42.872558 13456 tablet_service.cc:1468] Processing CreateTablet for tablet 66432e73deea433d9df565d5fcace647 (DEFAULT_TABLE table=default.Table_accd635a5d39461a8ecd9d947700d768 [id=10edfc6489fe4f348614d3db93a8fdb8]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:42.872682 13753 tablet_service.cc:1468] Processing CreateTablet for tablet 5fee48de90014f94b796e726a4d16b85 (DEFAULT_TABLE table=default.Table_74e19ec0844742e8ac529d2291bf2897 [id=947411a7cb36432db1274cde791076da]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:42.873652 13228 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet 2c31d119743f49589703c434ac6c7548
I20250830 07:54:42.874532 13231 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_56e73ea16ebe4add985e2b7b30163924"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:42.875025 13231 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_56e73ea16ebe4add985e2b7b30163924 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:42.876834 13232 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet 65f1ee59e6e9498381d686f16a865e23
I20250830 07:54:42.877887 13459 tablet_service.cc:1468] Processing CreateTablet for tablet f332d1b56d924c91a79cf6572dea1cd2 (DEFAULT_TABLE table=default.Table_cff60520ee6942269d4b80f84cf356c1 [id=50c1ce3c8e8c415391e55896a54ba43e]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:42.878998 13746 tablet_service.cc:1468] Processing CreateTablet for tablet 2f3bec2c98574a9393e0fae77e228ce0 (DEFAULT_TABLE table=default.Table_c6ae99ff685c419c85e78e738f8a077e [id=5fc49aaf98964a31a35fcc0405ac23ae]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:42.879374 13737 tablet_service.cc:1468] Processing CreateTablet for tablet f332d1b56d924c91a79cf6572dea1cd2 (DEFAULT_TABLE table=default.Table_cff60520ee6942269d4b80f84cf356c1 [id=50c1ce3c8e8c415391e55896a54ba43e]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:42.879710 13735 tablet_service.cc:1468] Processing CreateTablet for tablet 66432e73deea433d9df565d5fcace647 (DEFAULT_TABLE table=default.Table_accd635a5d39461a8ecd9d947700d768 [id=10edfc6489fe4f348614d3db93a8fdb8]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:42.879951 13466 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fbb1cc8f8eea4a0795f6f8e213b8180f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:42.880038 13741 tablet_service.cc:1468] Processing CreateTablet for tablet 509e08290f3842cfbde8b74ff9f4f70f (DEFAULT_TABLE table=default.Table_ebc7e2e80254427c933db947a11b2ef3 [id=16e67cb400234cb08c29407662708529]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:42.881215 13457 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ddedd1f141c147c69f178c6cd2b287da. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:42.881582 13464 tablet_service.cc:1468] Processing CreateTablet for tablet 5e2da5434e95445aa4deafce7fde0c6c (DEFAULT_TABLE table=default.Table_3e4b0ec8a89347c39ca293dd697bb734 [id=e6a4eb5417774271a0f2e116829bdb14]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:42.883196 13227 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet 2d91b0ba74034b85812a13719e21dc6c
I20250830 07:54:42.884869 13232 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_1860135c2b3f41f5b32ce70d590fa24e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:42.885385 13232 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1860135c2b3f41f5b32ce70d590fa24e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:42.885352 13228 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_390f65cc8d874afe83a062923fd229f9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:42.885819 13228 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_390f65cc8d874afe83a062923fd229f9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:42.886689 13233 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_3c833cc95d704af1bb3a4d77ab6b804a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:42.887414 13233 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3c833cc95d704af1bb3a4d77ab6b804a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:42.888432 13230 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_6599f3cf995f409296d8e841380b6d7f" } new_table_name: "default.Table_58c5a4814ca14dfc8b2dc02bc9c03c1b" modify_external_catalogs: true
I20250830 07:54:42.890491 13752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 579324e1f6474d398db10da3093650dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:42.892409 13741 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 509e08290f3842cfbde8b74ff9f4f70f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:42.896004 13886 raft_consensus.cc:357] T e862fa77e16945bd94e405aa3474f021 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:42.896195 13886 raft_consensus.cc:383] T e862fa77e16945bd94e405aa3474f021 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:42.897863 13886 raft_consensus.cc:738] T e862fa77e16945bd94e405aa3474f021 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:54:42.898129 13886 consensus_queue.cc:260] T e862fa77e16945bd94e405aa3474f021 P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:42.904277 13227 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_fdd5806cae9b42f88d2c947a8241f783"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:42.904790 13227 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fdd5806cae9b42f88d2c947a8241f783 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250830 07:54:42.908223 13219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.209.60:43889, user_credentials={real_user=slave}} blocked reactor thread for 78148us
I20250830 07:54:42.909497 13886 ts_tablet_manager.cc:1428] T e862fa77e16945bd94e405aa3474f021 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.030s user 0.000s sys 0.002s
I20250830 07:54:42.909801 13886 tablet_bootstrap.cc:492] T dbe542c478874482b078296a7a0e9ec9 P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:54:42.909879 13735 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 66432e73deea433d9df565d5fcace647. 1 dirs total, 0 dirs full, 0 dirs failed
W20250830 07:54:42.910302 13230 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 62bc8168176e4678a77827c5b7cc0f3e consensus state has no leader
I20250830 07:54:42.912261 13230 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_b755f70318f4435689e640c0b4283116"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:42.912741 13230 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b755f70318f4435689e640c0b4283116 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:42.915760 13746 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f3bec2c98574a9393e0fae77e228ce0. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:42.931095 13737 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f332d1b56d924c91a79cf6572dea1cd2. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:42.942539 13750 tablet_service.cc:1468] Processing CreateTablet for tablet 846338e46b834ae0b5f4e74c7f1325d2 (DEFAULT_TABLE table=default.Table_337eac5fc73e489cadc40b6760448942 [id=70484f58c3a94163bb156908d0468a06]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:42.943425 13744 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d171ad1667fa44c993ec5fd7d701d8e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:42.945760 13230 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_ee107090683f4625a3815e28e838c84a" } new_table_name: "default.Table_db9c792360074c4fada04b5bfd7ee523" modify_external_catalogs: true
I20250830 07:54:42.949213 13459 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f332d1b56d924c91a79cf6572dea1cd2. 1 dirs total, 0 dirs full, 0 dirs failed
W20250830 07:54:42.951309 13230 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 1fee3e58f31b4befa42ffbb8d7bd6f4e consensus state has no leader
I20250830 07:54:42.951686 13751 tablet_service.cc:1468] Processing CreateTablet for tablet ed364f03bdad42b88e181b7d0e1e4011 (DEFAULT_TABLE table=default.Table_78d044c012894bfd8972b2253087fa0c [id=41f959f5cad14060ae3f4bf1b0151b9f]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:42.954499 13736 tablet_service.cc:1468] Processing CreateTablet for tablet 2e63eac2579844ef83bf43f1e6d58634 (DEFAULT_TABLE table=default.Table_651494fab40e4ef091db8287b4f5cd39 [id=84d2d8be0cc741f2b518900993a28ceb]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:42.955055 13230 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_10d018ad6a2449c8b777834b7fd2ec40"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250830 07:54:42.955435 13753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5fee48de90014f94b796e726a4d16b85. 1 dirs total, 0 dirs full, 0 dirs failed
W20250830 07:54:42.955643 13230 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_10d018ad6a2449c8b777834b7fd2ec40 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250830 07:54:42.958468 13219 consensus_peers.cc:489] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88 -> Peer 3ea183a890b84f408b20b55e9eb7c7ed (127.12.209.60:43889): Couldn't send request to peer 3ea183a890b84f408b20b55e9eb7c7ed. Status: Network error: Client connection negotiation failed: client connection to 127.12.209.60:43889: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20250830 07:54:42.958896 13745 tablet_service.cc:1468] Processing CreateTablet for tablet 3d9c884ac05e44ddb59f96588fdd6f4b (DEFAULT_TABLE table=default.Table_ac25d9b6411c4b45be69794a94042fad [id=ddd28d01f88646cf86e7dbfc7faabefd]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:42.964200 13451 tablet_service.cc:1468] Processing CreateTablet for tablet 2c4c3c61cddf42668d3a09f4fbc5f641 (DEFAULT_TABLE table=default.Table_481f218fb1b94c81b8f0932c67bb5b55 [id=da55ca35442546899b18ebd8a52e8d0c]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:42.965780 13453 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f3bec2c98574a9393e0fae77e228ce0. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:42.966070 13462 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 14d4d2506e2a47ea906bfb81d5509829. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:42.966172 13461 tablet_service.cc:1468] Processing CreateTablet for tablet d171ad1667fa44c993ec5fd7d701d8e0 (DEFAULT_TABLE table=default.Table_92300192de164f969afb0aeaebfd701f [id=8de51280a0014a9db6181db50fbf74f8]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:42.976574 13230 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_2b82782993784298b5f2664d01b07707" } new_table_name: "default.Table_bec8b25cbc67460488f70626c8ad7859" modify_external_catalogs: true
I20250830 07:54:42.979076 13754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ddedd1f141c147c69f178c6cd2b287da. 1 dirs total, 0 dirs full, 0 dirs failed
W20250830 07:54:42.983044 13230 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 78fe9f6325c243a490f361aa79295c36 consensus state has no leader
I20250830 07:54:42.964646 13463 tablet_service.cc:1468] Processing CreateTablet for tablet 846338e46b834ae0b5f4e74c7f1325d2 (DEFAULT_TABLE table=default.Table_337eac5fc73e489cadc40b6760448942 [id=70484f58c3a94163bb156908d0468a06]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:42.988296 13458 tablet_service.cc:1468] Processing CreateTablet for tablet c56e3a30c18640e68c8b0c4ff4251d96 (DEFAULT_TABLE table=default.Table_232ac20d505c4e68b8d66bbebb4450db [id=6ab3df99a7464522801789d5e7a55435]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:42.999251 13230 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_ba631e9ef6834bae8385a9ecb17e8f1e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250830 07:54:42.999624 13227 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_ab15c29b389643c5a0603f49cc80372e" } new_table_name: "default.Table_a2e96e9e547e4a07a6ccd9839e3d909c" modify_external_catalogs: true
W20250830 07:54:42.999909 13230 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ba631e9ef6834bae8385a9ecb17e8f1e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:42.987346 13628 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "853503f3f98a49219b077af980180400" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:43.004742 13882 tablet_bootstrap.cc:492] T 30c2558c28944ff39d1a4a4ca9ac604e P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:54:42.994858 13465 tablet_service.cc:1468] Processing CreateTablet for tablet 509e08290f3842cfbde8b74ff9f4f70f (DEFAULT_TABLE table=default.Table_ebc7e2e80254427c933db947a11b2ef3 [id=16e67cb400234cb08c29407662708529]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:43.008751 13882 ts_tablet_manager.cc:1397] T 30c2558c28944ff39d1a4a4ca9ac604e P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.303s user 0.014s sys 0.019s
I20250830 07:54:42.978083 13749 tablet_service.cc:1468] Processing CreateTablet for tablet e74a3e4b3b234c41aca30f772525652e (DEFAULT_TABLE table=default.Table_9fd86b145c4a4e1dbbf6a088b47de21b [id=a525ce62131345f3862b4dccf9b97a73]), partition=RANGE (key) PARTITION UNBOUNDED
W20250830 07:54:43.012919 13227 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f56cab43580a4ee3a912fc5e58a3bd9d consensus state has no leader
I20250830 07:54:43.018208 13230 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_c74208cd42834eccbc9ff4f256fb93ef"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:43.018805 13230 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c74208cd42834eccbc9ff4f256fb93ef in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:43.024325 13882 raft_consensus.cc:357] T 30c2558c28944ff39d1a4a4ca9ac604e P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:43.025599 13592 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 846338e46b834ae0b5f4e74c7f1325d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:43.028409 13882 raft_consensus.cc:383] T 30c2558c28944ff39d1a4a4ca9ac604e P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:43.028574 13882 raft_consensus.cc:738] T 30c2558c28944ff39d1a4a4ca9ac604e P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:54:43.028836 13882 consensus_queue.cc:260] T 30c2558c28944ff39d1a4a4ca9ac604e P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:43.029531 13882 ts_tablet_manager.cc:1428] T 30c2558c28944ff39d1a4a4ca9ac604e P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.021s user 0.002s sys 0.000s
I20250830 07:54:43.029881 13882 tablet_bootstrap.cc:492] T 752727eef0734ff3b7b35b1d5f66aea6 P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:54:43.031728 13882 tablet_bootstrap.cc:654] T 752727eef0734ff3b7b35b1d5f66aea6 P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
W20250830 07:54:43.034111 13563 service_pool.cc:137] CreateTablet request on kudu.tserver.TabletServerAdminService from 127.0.0.1:45306 dropped due to backpressure: service queue is full with 50 items
I20250830 07:54:43.035071 13563 service_pool.cc:138] CreateTablet request on kudu.tserver.TabletServerAdminService from 127.0.0.1:45306 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 435)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 436)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 437)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 438)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 439)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 440)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 441)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 442)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 443)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 444)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 445)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 446)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 448)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 447)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 449)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 452)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 450)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 451)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 453)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 454)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 455)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 456)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 457)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 458)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45306 (request call id 459)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 460)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 461)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 462)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 463)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 464)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 465)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 466)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 467)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 468)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 469)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 470)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 471)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 472)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 473)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45306 (request call id 474)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45306 (request call id 475)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45306 (request call id 476)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45306 (request call id 477)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 478)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 479)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 480)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 481)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 482)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 483)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 484)
I20250830 07:54:43.036551 13563 service_pool.cc:138] CreateTablet request on kudu.tserver.TabletServerAdminService from 127.0.0.1:45306 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 435)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 436)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 437)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 438)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 439)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 440)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 441)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 442)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 443)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 444)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 445)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 446)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 448)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 447)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 449)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 452)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 450)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 451)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 453)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 454)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 455)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 456)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 457)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 458)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45306 (request call id 459)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 460)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 461)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 462)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 463)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 464)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 465)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 466)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 467)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 468)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 469)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 470)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 471)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 472)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 473)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45306 (request call id 474)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45306 (request call id 475)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45306 (request call id 476)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45306 (request call id 477)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 478)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 479)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 480)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 481)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 482)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 483)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 484)
I20250830 07:54:43.039453 13227 master_service.cc:948] ReplaceTablet: received request to replace tablet e6b7646588fe4134b2db62ff84ca4791 from {username='slave'} at 127.0.0.1:42126
I20250830 07:54:43.060029 13230 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_f8d552f66f96486cb2b5984a52b993ce" } modify_external_catalogs: true
I20250830 07:54:43.060284 13230 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_f8d552f66f96486cb2b5984a52b993ce" } modify_external_catalogs: true
I20250830 07:54:43.067337 13461 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d171ad1667fa44c993ec5fd7d701d8e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:43.067836 13468 tablet_service.cc:1468] Processing CreateTablet for tablet ed364f03bdad42b88e181b7d0e1e4011 (DEFAULT_TABLE table=default.Table_78d044c012894bfd8972b2253087fa0c [id=41f959f5cad14060ae3f4bf1b0151b9f]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:43.069386 13458 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c56e3a30c18640e68c8b0c4ff4251d96. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:43.069679 13465 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 509e08290f3842cfbde8b74ff9f4f70f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:43.071118 13227 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet e6b7646588fe4134b2db62ff84ca4791
I20250830 07:54:43.071887 13227 catalog_manager.cc:6652] ReplaceTablet: tablet e6b7646588fe4134b2db62ff84ca4791 deleted and replaced by tablet 6bb062f9c4e342489422c8faabfb1b9b
I20250830 07:54:43.091846 13748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c4c3c61cddf42668d3a09f4fbc5f641. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:43.094265 13463 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 846338e46b834ae0b5f4e74c7f1325d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:43.097429 13742 tablet_service.cc:1468] Processing CreateTablet for tablet 2c31d119743f49589703c434ac6c7548 (DEFAULT_TABLE table=default.Table_2e83ff4fc25644689ac5cc5740c35987 [id=520502437680422291b45879b235a264]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:43.099505 13231 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_c442bb1874724c3d9b586558e26bc632"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:43.100049 13231 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c442bb1874724c3d9b586558e26bc632 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:43.101931 13232 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_232ac20d505c4e68b8d66bbebb4450db" } modify_external_catalogs: true
I20250830 07:54:43.102108 13232 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_232ac20d505c4e68b8d66bbebb4450db" } modify_external_catalogs: true
I20250830 07:54:43.103173 13228 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_dfe2a98f84744faeb4200202374bb186" } modify_external_catalogs: true
I20250830 07:54:43.103368 13228 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_dfe2a98f84744faeb4200202374bb186" } modify_external_catalogs: true
I20250830 07:54:43.104189 13600 tablet_service.cc:1468] Processing CreateTablet for tablet 3d9c884ac05e44ddb59f96588fdd6f4b (DEFAULT_TABLE table=default.Table_ac25d9b6411c4b45be69794a94042fad [id=ddd28d01f88646cf86e7dbfc7faabefd]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:43.104537 13233 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_0b763c9c5ec849f9830f2670d074b17c" } new_table_name: "default.Table_ad1e059ca08e421ab7fe406c6dd762ac" modify_external_catalogs: true
I20250830 07:54:43.104794 13226 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_99d5f73171164be2bacb3d06d32875b6" } modify_external_catalogs: true
I20250830 07:54:43.104987 13226 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_99d5f73171164be2bacb3d06d32875b6" } modify_external_catalogs: true
I20250830 07:54:43.109021 13742 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c31d119743f49589703c434ac6c7548. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:43.109877 13451 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c4c3c61cddf42668d3a09f4fbc5f641. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:43.108145 13747 tablet_service.cc:1468] Processing CreateTablet for tablet 1db4109dc43b489d89c5de9eeb64a771 (DEFAULT_TABLE table=default.Table_096dfd73ca964fb68fcfac3eafbf487e [id=7e34bca08d3b445e9dddfc588ffe20ba]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:43.111172 13462 tablet_service.cc:1468] Processing CreateTablet for tablet 3d9c884ac05e44ddb59f96588fdd6f4b (DEFAULT_TABLE table=default.Table_ac25d9b6411c4b45be69794a94042fad [id=ddd28d01f88646cf86e7dbfc7faabefd]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:43.112299 13227 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_42c639c9b9ec4ebfbfb9ae1452fcec86" } modify_external_catalogs: true
I20250830 07:54:43.112519 13749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e74a3e4b3b234c41aca30f772525652e. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:43.112491 13227 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_42c639c9b9ec4ebfbfb9ae1452fcec86" } modify_external_catalogs: true
I20250830 07:54:43.115273 13230 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet 5dffbacf2fcd4a38a1d61cf5bb9c5eeb
I20250830 07:54:43.118983 13225 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_26823b419608403ea304b5f2135fe73d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250830 07:54:43.118798 13234 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_eabaaf87b5374194a21b1a2d0f2868c9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:43.119520 13225 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_26823b419608403ea304b5f2135fe73d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250830 07:54:43.119623 13234 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_eabaaf87b5374194a21b1a2d0f2868c9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:43.122789 13232 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet c56e3a30c18640e68c8b0c4ff4251d96
W20250830 07:54:43.123273 13233 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 135d754d83ad422eb05909d2daa19d34 consensus state has no leader
I20250830 07:54:43.124866 13755 tablet_service.cc:1468] Processing CreateTablet for tablet c56e3a30c18640e68c8b0c4ff4251d96 (DEFAULT_TABLE table=default.Table_232ac20d505c4e68b8d66bbebb4450db [id=6ab3df99a7464522801789d5e7a55435]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:43.125270 13755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c56e3a30c18640e68c8b0c4ff4251d96. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:43.124333 13456 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 66432e73deea433d9df565d5fcace647. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:43.124029 13452 tablet_service.cc:1468] Processing CreateTablet for tablet e74a3e4b3b234c41aca30f772525652e (DEFAULT_TABLE table=default.Table_9fd86b145c4a4e1dbbf6a088b47de21b [id=a525ce62131345f3862b4dccf9b97a73]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:43.128261 13230 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_9ce68aedbeda402e84a735a411e55042"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:43.128772 13230 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9ce68aedbeda402e84a735a411e55042 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:43.130623 13233 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_9f4a5e8a32704592b674c2d22739cf35" } new_table_name: "default.Table_b6dea313c9d743c1aeb4496f06880746" modify_external_catalogs: true
I20250830 07:54:43.130741 13232 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_853367df8be040c2ac006a7215f9792e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:43.131232 13232 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_853367df8be040c2ac006a7215f9792e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:43.131947 13449 tablet_service.cc:1468] Processing CreateTablet for tablet 2c31d119743f49589703c434ac6c7548 (DEFAULT_TABLE table=default.Table_2e83ff4fc25644689ac5cc5740c35987 [id=520502437680422291b45879b235a264]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:43.132514 13229 master_service.cc:948] ReplaceTablet: received request to replace tablet 042fd7ff08fc4695b87bb8f9d225ef12 from {username='slave'} at 127.0.0.1:42126
I20250830 07:54:43.142302 13228 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet d206f6b6e7524a27a9f95787bcd5de77
I20250830 07:54:43.142542 13226 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet 283aa82b808e49528ceb19133748ffc8
I20250830 07:54:43.142302 13227 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet 2b4103f07e96490488913059a95af0c3
I20250830 07:54:43.147073 13594 tablet_service.cc:1468] Processing CreateTablet for tablet 2c31d119743f49589703c434ac6c7548 (DEFAULT_TABLE table=default.Table_2e83ff4fc25644689ac5cc5740c35987 [id=520502437680422291b45879b235a264]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:43.149880 13606 tablet_service.cc:1468] Processing CreateTablet for tablet bdeb89bbb3ad4e67bbc74b78454eeb7e (DEFAULT_TABLE table=default.Table_966292469ec54ce987013f67893e9903 [id=4bd46f4fed854dc0b2313fff05cb3606]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:43.150960 13600 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d9c884ac05e44ddb59f96588fdd6f4b. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:43.152295 13468 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed364f03bdad42b88e181b7d0e1e4011. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:43.153067 13603 tablet_service.cc:1468] Processing CreateTablet for tablet 2e63eac2579844ef83bf43f1e6d58634 (DEFAULT_TABLE table=default.Table_651494fab40e4ef091db8287b4f5cd39 [id=84d2d8be0cc741f2b518900993a28ceb]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:43.153450 13609 tablet_service.cc:1468] Processing CreateTablet for tablet 1db4109dc43b489d89c5de9eeb64a771 (DEFAULT_TABLE table=default.Table_096dfd73ca964fb68fcfac3eafbf487e [id=7e34bca08d3b445e9dddfc588ffe20ba]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:43.153853 13608 tablet_service.cc:1468] Processing CreateTablet for tablet c56e3a30c18640e68c8b0c4ff4251d96 (DEFAULT_TABLE table=default.Table_232ac20d505c4e68b8d66bbebb4450db [id=6ab3df99a7464522801789d5e7a55435]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:43.153965 13452 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e74a3e4b3b234c41aca30f772525652e. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:43.160478 13454 tablet_service.cc:1468] Processing CreateTablet for tablet 2e63eac2579844ef83bf43f1e6d58634 (DEFAULT_TABLE table=default.Table_651494fab40e4ef091db8287b4f5cd39 [id=84d2d8be0cc741f2b518900993a28ceb]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:43.161103 13449 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c31d119743f49589703c434ac6c7548. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:43.153918 13604 tablet_service.cc:1468] Processing CreateTablet for tablet e74a3e4b3b234c41aca30f772525652e (DEFAULT_TABLE table=default.Table_9fd86b145c4a4e1dbbf6a088b47de21b [id=a525ce62131345f3862b4dccf9b97a73]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:43.156790 13599 tablet_service.cc:1468] Processing CreateTablet for tablet 0ac39adafe144280b39f5c3fe5804087 (DEFAULT_TABLE table=default.Table_7f314a0042864cd5914a351090968456 [id=53ccd9bb84274bfb9dd9f56d7647dec7]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:43.158764 13594 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c31d119743f49589703c434ac6c7548. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:43.158393 13602 tablet_service.cc:1468] Processing CreateTablet for tablet 8c01157324ba45bda5b3a9a328bf319b (DEFAULT_TABLE table=default.Table_9f4a5e8a32704592b674c2d22739cf35 [id=39d9a0921db14d48a09f2d6e1b8af62d]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:43.166103 13228 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_98a00559f592459ba64aaa784044fc41"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:43.166610 13228 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_98a00559f592459ba64aaa784044fc41 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:43.167188 13227 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_1c93edc0678341fea10a950688a68c08" } new_table_name: "default.Table_261e750e5d584609b5bd31ea2833252e" modify_external_catalogs: true
I20250830 07:54:43.167526 13598 tablet_service.cc:1468] Processing CreateTablet for tablet 1fee3e58f31b4befa42ffbb8d7bd6f4e (DEFAULT_TABLE table=default.Table_ee107090683f4625a3815e28e838c84a [id=b13f82c88cfe49b3a5ee2949a3429966]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:43.167939 13226 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_ad790949dd984cfda29f3c9a85e62db6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:43.168360 13226 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ad790949dd984cfda29f3c9a85e62db6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:43.169742 13231 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_c3e43a932d5644ad91c579d006d272a2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:43.170161 13231 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c3e43a932d5644ad91c579d006d272a2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:43.172619 13747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1db4109dc43b489d89c5de9eeb64a771. 1 dirs total, 0 dirs full, 0 dirs failed
W20250830 07:54:43.173022 13422 service_pool.cc:137] CreateTablet request on kudu.tserver.TabletServerAdminService from 127.0.0.1:37956 dropped due to backpressure: service queue is full with 50 items
I20250830 07:54:43.173382 13462 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d9c884ac05e44ddb59f96588fdd6f4b. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:43.170107 13590 tablet_service.cc:1468] Processing CreateTablet for tablet b6717031830f4c57967e87ce077ddb21 (DEFAULT_TABLE table=default.Table_121a01abce2f47d4a41ce33b35c8f89b [id=c132602d81cc4e268753e66e98d27556]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:43.175840 13591 tablet_service.cc:1468] Processing CreateTablet for tablet ed364f03bdad42b88e181b7d0e1e4011 (DEFAULT_TABLE table=default.Table_78d044c012894bfd8972b2253087fa0c [id=41f959f5cad14060ae3f4bf1b0151b9f]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:43.176491 13741 tablet_service.cc:1468] Processing CreateTablet for tablet bdeb89bbb3ad4e67bbc74b78454eeb7e (DEFAULT_TABLE table=default.Table_966292469ec54ce987013f67893e9903 [id=4bd46f4fed854dc0b2313fff05cb3606]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:43.177119 13457 tablet_service.cc:1468] Processing CreateTablet for tablet 1db4109dc43b489d89c5de9eeb64a771 (DEFAULT_TABLE table=default.Table_096dfd73ca964fb68fcfac3eafbf487e [id=7e34bca08d3b445e9dddfc588ffe20ba]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:43.180882 13602 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c01157324ba45bda5b3a9a328bf319b. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:43.181042 13751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed364f03bdad42b88e181b7d0e1e4011. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:43.181700 13592 tablet_service.cc:1468] Processing CreateTablet for tablet 0c70140d87d34bde919714f08a5c94d4 (DEFAULT_TABLE table=default.Table_9fe110ab062c400d8861f86ac328ea71 [id=d7785a68dc484acbb9153d943fee972d]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:43.182950 13741 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bdeb89bbb3ad4e67bbc74b78454eeb7e. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:43.184600 13606 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bdeb89bbb3ad4e67bbc74b78454eeb7e. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:43.184958 13454 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e63eac2579844ef83bf43f1e6d58634. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:43.185007 13738 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e2da5434e95445aa4deafce7fde0c6c. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:43.185204 13457 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1db4109dc43b489d89c5de9eeb64a771. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:43.186509 13596 tablet_service.cc:1468] Processing CreateTablet for tablet 439fc51afa6b435e81bc38b9e88d4041 (DEFAULT_TABLE table=default.Table_65886201d1784503987a2258f7c62a85 [id=85257e9cbb7e44ffadaab62e99b0726c]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:43.193014 13605 tablet_service.cc:1468] Processing CreateTablet for tablet ba4e1fccb8f046d6b63afe67c1f9d538 (DEFAULT_TABLE table=default.Table_456a93d36cbe4e58a192a0c6bc9518fa [id=a66fee2a40d848e8ae7f55b295c4c65e]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:43.194376 13593 tablet_service.cc:1468] Processing CreateTablet for tablet 52df62f7f1aa4b38be89f6198cf01f24 (DEFAULT_TABLE table=default.Table_c58784366d3c49dda4c9d4afc16520a3 [id=0345f468e2de4e38814123f678c2da1c]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:43.194705 13608 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c56e3a30c18640e68c8b0c4ff4251d96. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:43.195119 13603 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e63eac2579844ef83bf43f1e6d58634. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:43.195648 13601 tablet_service.cc:1468] Processing CreateTablet for tablet d1d5e0d40a91457da65a0e925289309e (DEFAULT_TABLE table=default.Table_d1157e0797784cdca583812222959656 [id=4d84553c809c466382bfdbfa8257fed2]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:43.197563 13597 tablet_service.cc:1468] Processing CreateTablet for tablet 2aea1a69d22544899b0218be7e0f8799 (DEFAULT_TABLE table=default.Table_df0e35c42b3d47589ce170267c3c7b76 [id=eab69737d0014874b68b8c9af5763f09]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:43.197925 13609 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1db4109dc43b489d89c5de9eeb64a771. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:43.198213 13604 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e74a3e4b3b234c41aca30f772525652e. 1 dirs total, 0 dirs full, 0 dirs failed
W20250830 07:54:43.199265 13702 service_pool.cc:137] CreateTablet request on kudu.tserver.TabletServerAdminService from 127.0.0.1:45460 dropped due to backpressure: service queue is full with 50 items
I20250830 07:54:43.199406 13702 service_pool.cc:138] CreateTablet request on kudu.tserver.TabletServerAdminService from 127.0.0.1:45460 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 442)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 443)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 444)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 445)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 446)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 447)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 448)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 449)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 450)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 451)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 452)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 453)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 454)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 455)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 456)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 457)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 458)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 459)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45460 (request call id 460)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 461)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 462)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 463)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 464)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 465)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 466)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 467)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 468)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 469)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 470)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 471)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 472)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 473)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45460 (request call id 474)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45460 (request call id 475)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45460 (request call id 476)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45460 (request call id 477)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 478)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 479)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 480)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 481)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 482)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 483)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 484)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 485)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 486)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 487)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 488)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 489)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 490)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 491)
I20250830 07:54:43.201706 13599 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ac39adafe144280b39f5c3fe5804087. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:43.205093 13608 tablet_service.cc:1468] Processing CreateTablet for tablet b2248b305c9f448a9e30661142ad10ea (DEFAULT_TABLE table=default.Table_9f782ecc45e54615a182e9ad36d446aa [id=13ee9ffcec254806a35d27b45cd6669b]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:43.173162 13422 service_pool.cc:138] CreateTablet request on kudu.tserver.TabletServerAdminService from 127.0.0.1:37956 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 440)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 441)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 442)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 451)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 448)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 450)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 443)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 444)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 445)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 446)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 447)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 449)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 452)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 453)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 454)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 455)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 456)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 457)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 458)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37956 (request call id 459)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 460)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 461)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 462)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 463)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 464)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 465)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 466)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 467)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 468)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 469)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 470)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 471)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 472)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37956 (request call id 473)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37956 (request call id 474)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37956 (request call id 475)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37956 (request call id 476)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 477)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 478)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 479)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 480)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 481)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 482)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 483)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 484)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 485)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 486)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 487)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 488)
I20250830 07:54:43.210615 13745 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d9c884ac05e44ddb59f96588fdd6f4b. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:43.212693 13740 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fbb1cc8f8eea4a0795f6f8e213b8180f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:43.218504 13234 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_e582f68dd18641078c3c802f15f55c1a" } new_table_name: "default.Table_725c911448e748acb9cafa0e244f9912" modify_external_catalogs: true
I20250830 07:54:43.220281 13230 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_20a3756852a8404a9000ae7e154cfc5f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:43.220497 13233 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 8c01157324ba45bda5b3a9a328bf319b consensus state has no leader
W20250830 07:54:43.220815 13230 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_20a3756852a8404a9000ae7e154cfc5f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:43.223942 13225 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_9f782ecc45e54615a182e9ad36d446aa" } new_table_name: "default.Table_fac26069a6524a66878ca41a78358f44" modify_external_catalogs: true
I20250830 07:54:43.208395 13598 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1fee3e58f31b4befa42ffbb8d7bd6f4e. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:43.183068 13607 tablet_service.cc:1468] Processing CreateTablet for tablet 6720d2b945814305845beea0a2cb9912 (DEFAULT_TABLE table=default.Table_87a9206ca75f43159bde4f474e94ddec [id=996d39e74e5646399ea495ace468a319]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:43.210479 13600 tablet_service.cc:1468] Processing CreateTablet for tablet 63168840534246b59a2fdbfdfeebff47 (DEFAULT_TABLE table=default.Table_41eb28f070d04bf69d643c4208052120 [id=fe274567d2a84f62b0c585f361464b6c]), partition=RANGE (key) PARTITION UNBOUNDED
W20250830 07:54:43.220017 13562 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.209.3:38743, user_credentials={real_user=slave}} blocked reactor thread for 163628us
I20250830 07:54:43.227314 13605 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba4e1fccb8f046d6b63afe67c1f9d538. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:43.230510 13601 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1d5e0d40a91457da65a0e925289309e. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:43.231734 13593 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52df62f7f1aa4b38be89f6198cf01f24. 1 dirs total, 0 dirs full, 0 dirs failed
W20250830 07:54:43.235713 13227 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet b678fd915c534a2dac8521c21ab93396 consensus state has no leader
I20250830 07:54:43.236660 13596 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 439fc51afa6b435e81bc38b9e88d4041. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:43.236953 13592 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0c70140d87d34bde919714f08a5c94d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:43.237105 13227 master_service.cc:948] ReplaceTablet: received request to replace tablet 0208de98277c4d6889fb0289b6013ae1 from {username='slave'} at 127.0.0.1:42126
I20250830 07:54:43.237973 13467 tablet_service.cc:1468] Processing CreateTablet for tablet bdeb89bbb3ad4e67bbc74b78454eeb7e (DEFAULT_TABLE table=default.Table_966292469ec54ce987013f67893e9903 [id=4bd46f4fed854dc0b2313fff05cb3606]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:43.239055 13607 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6720d2b945814305845beea0a2cb9912. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:43.241654 13597 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2aea1a69d22544899b0218be7e0f8799. 1 dirs total, 0 dirs full, 0 dirs failed
W20250830 07:54:43.254927 13234 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 7aed56dba39e40518e9c3325bcccd74a consensus state has no leader
I20250830 07:54:43.255518 13229 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet 042fd7ff08fc4695b87bb8f9d225ef12
I20250830 07:54:43.256122 13229 catalog_manager.cc:6652] ReplaceTablet: tablet 042fd7ff08fc4695b87bb8f9d225ef12 deleted and replaced by tablet f2ebc809f1074db78720920286d9385b
I20250830 07:54:43.258610 13230 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_3fbed79aa89e46a380f08c35b61be998"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:43.259559 13230 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3fbed79aa89e46a380f08c35b61be998 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:43.263430 14643 raft_consensus.cc:491] T 7af74bdde363493f8061eba450ecf4b4 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:43.264748 13590 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6717031830f4c57967e87ce077ddb21. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:43.266070 13464 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e2da5434e95445aa4deafce7fde0c6c. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:43.267650 13736 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e63eac2579844ef83bf43f1e6d58634. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:43.200531 13702 service_pool.cc:138] CreateTablet request on kudu.tserver.TabletServerAdminService from 127.0.0.1:45460 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 442)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 443)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 444)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 445)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 446)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 447)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 448)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 449)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 450)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 451)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 452)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 453)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 454)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 455)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 456)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 457)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 458)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 459)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45460 (request call id 460)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 461)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 462)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 463)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 464)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 465)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 466)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 467)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 468)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 469)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 470)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 471)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 472)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 473)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45460 (request call id 474)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45460 (request call id 475)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45460 (request call id 476)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45460 (request call id 477)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 478)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 479)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 480)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 481)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 482)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 483)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 484)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 485)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 486)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 487)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 488)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 489)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 490)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 491)
I20250830 07:54:43.272195 13750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 846338e46b834ae0b5f4e74c7f1325d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:43.273247 13467 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bdeb89bbb3ad4e67bbc74b78454eeb7e. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:43.273919 13450 tablet_service.cc:1468] Processing CreateTablet for tablet 0ac39adafe144280b39f5c3fe5804087 (DEFAULT_TABLE table=default.Table_7f314a0042864cd5914a351090968456 [id=53ccd9bb84274bfb9dd9f56d7647dec7]), partition=RANGE (key) PARTITION UNBOUNDED
W20250830 07:54:43.286664 13225 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet b2248b305c9f448a9e30661142ad10ea consensus state has no leader
I20250830 07:54:43.292011 13563 service_pool.cc:138] CreateTablet request on kudu.tserver.TabletServerAdminService from 127.0.0.1:45306 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 460)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 461)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 462)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 463)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 464)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 465)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 466)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 467)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 468)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 469)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 470)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 471)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 472)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 473)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45306 (request call id 474)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45306 (request call id 475)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45306 (request call id 476)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45306 (request call id 477)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 478)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 479)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 480)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 481)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 482)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 483)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 484)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 487)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 488)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 489)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 490)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 491)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 492)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 493)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 494)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 495)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 496)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 497)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 498)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 499)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 500)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 501)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 502)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 503)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 504)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 505)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 506)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 507)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 508)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 509)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 510)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 511)
I20250830 07:54:43.294484 13607 tablet_service.cc:1468] Processing CreateTablet for tablet adbacbbb13d840a29d8d7d08ea04f6b1 (DEFAULT_TABLE table=default.Table_fbed2e93681c42ae83a5a169b6a3fb25 [id=6e2decb9b0f0464e8da6f7e4bc404a52]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:43.295769 13702 service_pool.cc:138] CreateTablet request on kudu.tserver.TabletServerAdminService from 127.0.0.1:45460 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 445)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 446)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 447)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 448)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 449)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 450)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 451)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 452)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 453)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 454)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 455)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 456)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 457)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 458)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 459)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45460 (request call id 460)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 461)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 462)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 463)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 464)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 465)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 466)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 467)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 468)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 469)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 470)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 471)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 472)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 473)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45460 (request call id 474)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45460 (request call id 475)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45460 (request call id 476)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45460 (request call id 477)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 478)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 479)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 480)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 481)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 482)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 483)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 484)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 485)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 486)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 487)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 488)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 489)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 490)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 491)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 494)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 495)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 496)
W20250830 07:54:43.296681 13739 consensus_meta.cc:287] T 208995abd6d44dbea3b5ebbea27d6a39 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent flushing consensus metadata: real 0.535s user 0.002s sys 0.011s
I20250830 07:54:43.304224 13604 tablet_service.cc:1468] Processing CreateTablet for tablet 50dfc24a0b9645e4860cd99b1df3bd61 (DEFAULT_TABLE table=default.Table_e9dc95fecbf6406997ec10252d8e788e [id=ce63b0b5f48c4ca59ae638b89bd0e615]), partition=RANGE (key) PARTITION UNBOUNDED
W20250830 07:54:43.309785 13230 catalog_manager.cc:5415] Ignoring report from unknown tablet 04c9d954106a4417a34ff80bc98e2ce8
I20250830 07:54:43.310644 13594 tablet_service.cc:1468] Processing CreateTablet for tablet 3bca390f6d4343cba7a9fb07f0d4d72b (DEFAULT_TABLE table=default.Table_32ff7c454b324d9f8b37a9d40f3bdc35 [id=ea6cad75a28f479ab977561b6b4193bc]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:43.310935 13595 tablet_service.cc:1515] Processing DeleteTablet for tablet f1fe024f0de048a5a0931ee38752d5a1 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:42 UTC) from {username='slave'} at 127.0.0.1:45306
I20250830 07:54:43.311071 13600 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 63168840534246b59a2fdbfdfeebff47. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:43.311192 13601 tablet_service.cc:1468] Processing CreateTablet for tablet cd9903bdfaef4139a1a582c54689da4a (DEFAULT_TABLE table=default.Table_dbadc01ffe94447080e199d005d9e87c [id=c5f7d20d95784a619699a6da83965e49]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:43.311344 13599 tablet_service.cc:1468] Processing CreateTablet for tablet dcb8b326dbec4d40af26b4f143157468 (DEFAULT_TABLE table=default.Table_2d468f4cd05e4f9aa354321ddccdc59c [id=6af7c90adabf47c9a41d01c9d3f40642]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:43.315409 13752 tablet_service.cc:1468] Processing CreateTablet for tablet b6717031830f4c57967e87ce077ddb21 (DEFAULT_TABLE table=default.Table_121a01abce2f47d4a41ce33b35c8f89b [id=c132602d81cc4e268753e66e98d27556]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:43.319237 13603 tablet_service.cc:1468] Processing CreateTablet for tablet 55bd3f378b854476a24f657f5e23843d (DEFAULT_TABLE table=default.Table_ffed9a8a8cb2455082f2fd5db500bcb2 [id=ee89c0d972a9408cb30b0b97b4bf23ed]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:43.320152 13230 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_c3e43a932d5644ad91c579d006d272a2" } modify_external_catalogs: true
I20250830 07:54:43.320421 13230 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_c3e43a932d5644ad91c579d006d272a2" } modify_external_catalogs: true
I20250830 07:54:43.321870 13592 tablet_service.cc:1468] Processing CreateTablet for tablet 4b9d9d4b65964fd49d8e25092a14d774 (DEFAULT_TABLE table=default.Table_7e8dccc6af2d49159b06563cd36240a7 [id=8e7fbc2351124d2081e7b3bbf3a4c0f6]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:43.324360 13598 tablet_service.cc:1468] Processing CreateTablet for tablet 135d754d83ad422eb05909d2daa19d34 (DEFAULT_TABLE table=default.Table_0b763c9c5ec849f9830f2670d074b17c [id=dc7b513bb4204424b5b292e5751f5fa6]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:43.319252 14643 raft_consensus.cc:513] T 7af74bdde363493f8061eba450ecf4b4 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:43.326942 13596 tablet_service.cc:1468] Processing CreateTablet for tablet ccc9091018cb48ffb2affd98e8bbfa05 (DEFAULT_TABLE table=default.Table_dcc3f90b74de4848b1d750ec0aa814f4 [id=f7e584e9473f446cb4b78e99377d4b1b]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:43.283349 13422 service_pool.cc:138] CreateTablet request on kudu.tserver.TabletServerAdminService from 127.0.0.1:37956 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 442)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 451)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 448)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 450)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 443)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 444)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 445)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 446)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 447)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 449)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 452)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 453)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 454)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 455)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 456)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 457)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 458)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37956 (request call id 459)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 460)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 461)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 462)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 463)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 464)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 465)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 466)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 467)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 468)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 469)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 470)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 471)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 472)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37956 (request call id 473)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37956 (request call id 474)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37956 (request call id 475)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37956 (request call id 476)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 477)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 478)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 479)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 480)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 481)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 482)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 483)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 484)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 485)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 486)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 487)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 488)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 490)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 491)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 492)
I20250830 07:54:43.327546 13595 tablet_service.cc:1468] Processing CreateTablet for tablet 1ca83bbf848744f38206ceb4126271be (DEFAULT_TABLE table=default.Table_58be973418b94b6d9c25747a596793b6 [id=0138d045d5414fec8933b6d1fbac4ee6]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:43.327680 13422 service_pool.cc:138] CreateTablet request on kudu.tserver.TabletServerAdminService from 127.0.0.1:37956 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 442)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 451)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 448)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 450)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 443)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 444)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 445)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 446)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 447)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 449)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 452)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 453)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 454)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 455)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 456)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 457)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 458)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37956 (request call id 459)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 460)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 461)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 462)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 463)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 464)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 465)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 466)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 467)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 468)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 469)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 470)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 471)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 472)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37956 (request call id 473)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37956 (request call id 474)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37956 (request call id 475)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37956 (request call id 476)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 477)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 478)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 479)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 480)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 481)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 482)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 483)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 484)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 485)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 486)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 487)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 488)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 490)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 491)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 492)
I20250830 07:54:43.331094 13225 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_651494fab40e4ef091db8287b4f5cd39" } new_table_name: "default.Table_8e96034c87ae45fd8aa588594762fa85" modify_external_catalogs: true
I20250830 07:54:43.333060 13754 tablet_service.cc:1468] Processing CreateTablet for tablet 1fee3e58f31b4befa42ffbb8d7bd6f4e (DEFAULT_TABLE table=default.Table_ee107090683f4625a3815e28e838c84a [id=b13f82c88cfe49b3a5ee2949a3429966]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:43.333200 13753 tablet_service.cc:1468] Processing CreateTablet for tablet 0ac39adafe144280b39f5c3fe5804087 (DEFAULT_TABLE table=default.Table_7f314a0042864cd5914a351090968456 [id=53ccd9bb84274bfb9dd9f56d7647dec7]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:43.333477 13754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1fee3e58f31b4befa42ffbb8d7bd6f4e. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:43.333776 13753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ac39adafe144280b39f5c3fe5804087. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:43.336143 13422 service_pool.cc:138] CreateTablet request on kudu.tserver.TabletServerAdminService from 127.0.0.1:37956 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 450)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 443)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 444)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 445)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 446)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 447)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 449)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 452)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 453)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 454)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 455)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 456)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 457)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 458)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37956 (request call id 459)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 460)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 461)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 462)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 463)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 464)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 465)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 466)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 467)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 468)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 469)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 470)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 471)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 472)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37956 (request call id 473)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37956 (request call id 474)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37956 (request call id 475)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37956 (request call id 476)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 477)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 478)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 479)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 480)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 481)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 482)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 483)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 484)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 485)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 486)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 487)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 488)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 490)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 491)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 492)
I20250830 07:54:43.338018 13422 service_pool.cc:138] CreateTablet request on kudu.tserver.TabletServerAdminService from 127.0.0.1:37956 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 450)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 443)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 444)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 445)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 446)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 447)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 449)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 452)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 453)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 454)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 455)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 456)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 457)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 458)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37956 (request call id 459)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 460)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 461)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 462)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 463)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 464)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 465)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 466)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 467)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 468)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 469)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 470)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 471)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 472)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37956 (request call id 473)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37956 (request call id 474)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37956 (request call id 475)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37956 (request call id 476)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 477)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 478)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 479)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 480)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 481)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 482)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 483)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 484)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 485)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 486)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 487)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 488)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 490)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 491)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 492)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 496)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 497)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 498)
I20250830 07:54:43.348605 13450 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ac39adafe144280b39f5c3fe5804087. 1 dirs total, 0 dirs full, 0 dirs failed
W20250830 07:54:43.348829 13887 thread.cc:608] log-alloc [worker] (thread pool) Time spent starting thread: real 0.622s user 0.020s sys 0.033s
I20250830 07:54:43.349313 13466 tablet_service.cc:1468] Processing CreateTablet for tablet 439fc51afa6b435e81bc38b9e88d4041 (DEFAULT_TABLE table=default.Table_65886201d1784503987a2258f7c62a85 [id=85257e9cbb7e44ffadaab62e99b0726c]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:43.349665 13466 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 439fc51afa6b435e81bc38b9e88d4041. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:43.349961 13234 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_e2b0521d564549e69deaff73c4506d20"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250830 07:54:43.350143 13227 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_429185b39740488c933444abe9883526" } modify_external_catalogs: true
I20250830 07:54:43.350306 13227 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_429185b39740488c933444abe9883526" } modify_external_catalogs: true
W20250830 07:54:43.350528 13234 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e2b0521d564549e69deaff73c4506d20 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:43.350591 14643 leader_election.cc:290] T 7af74bdde363493f8061eba450ecf4b4 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:43.351660 13226 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_9aa8d17e919f4ae09cb9c42cf2ba54a5" } modify_external_catalogs: true
I20250830 07:54:43.351805 13226 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_9aa8d17e919f4ae09cb9c42cf2ba54a5" } modify_external_catalogs: true
I20250830 07:54:43.352087 13735 tablet_service.cc:1468] Processing CreateTablet for tablet 6720d2b945814305845beea0a2cb9912 (DEFAULT_TABLE table=default.Table_87a9206ca75f43159bde4f474e94ddec [id=996d39e74e5646399ea495ace468a319]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:43.355682 13737 tablet_service.cc:1468] Processing CreateTablet for tablet 8c01157324ba45bda5b3a9a328bf319b (DEFAULT_TABLE table=default.Table_9f4a5e8a32704592b674c2d22739cf35 [id=39d9a0921db14d48a09f2d6e1b8af62d]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:43.356503 13460 tablet_service.cc:1468] Processing CreateTablet for tablet 8c01157324ba45bda5b3a9a328bf319b (DEFAULT_TABLE table=default.Table_9f4a5e8a32704592b674c2d22739cf35 [id=39d9a0921db14d48a09f2d6e1b8af62d]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:43.358448 13886 tablet_bootstrap.cc:654] T dbe542c478874482b078296a7a0e9ec9 P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:43.361526 13462 tablet_service.cc:1468] Processing CreateTablet for tablet 52df62f7f1aa4b38be89f6198cf01f24 (DEFAULT_TABLE table=default.Table_c58784366d3c49dda4c9d4afc16520a3 [id=0345f468e2de4e38814123f678c2da1c]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:43.367017 13231 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_f9f639c72f2a46a0bb1606c0f1e92ee0" } modify_external_catalogs: true
I20250830 07:54:43.367211 13231 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_f9f639c72f2a46a0bb1606c0f1e92ee0" } modify_external_catalogs: true
I20250830 07:54:43.373080 13746 tablet_service.cc:1468] Processing CreateTablet for tablet 63168840534246b59a2fdbfdfeebff47 (DEFAULT_TABLE table=default.Table_41eb28f070d04bf69d643c4208052120 [id=fe274567d2a84f62b0c585f361464b6c]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:43.379892 13449 tablet_service.cc:1468] Processing CreateTablet for tablet b6717031830f4c57967e87ce077ddb21 (DEFAULT_TABLE table=default.Table_121a01abce2f47d4a41ce33b35c8f89b [id=c132602d81cc4e268753e66e98d27556]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:43.355217 13422 service_pool.cc:138] CreateTablet request on kudu.tserver.TabletServerAdminService from 127.0.0.1:37956 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 444)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 445)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 446)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 447)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 449)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 452)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 453)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 454)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 455)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 456)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 457)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 458)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37956 (request call id 459)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 460)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 461)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 462)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 463)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 464)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 465)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 466)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 467)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 468)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 469)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 470)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 471)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 472)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37956 (request call id 473)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37956 (request call id 474)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37956 (request call id 475)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37956 (request call id 476)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 477)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 478)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 479)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 480)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 481)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 482)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 483)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 484)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 485)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 486)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 487)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 488)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 490)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 491)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 492)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 496)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 497)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 498)
I20250830 07:54:43.384773 13454 tablet_service.cc:1468] Processing CreateTablet for tablet ba4e1fccb8f046d6b63afe67c1f9d538 (DEFAULT_TABLE table=default.Table_456a93d36cbe4e58a192a0c6bc9518fa [id=a66fee2a40d848e8ae7f55b295c4c65e]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:43.385511 13752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6717031830f4c57967e87ce077ddb21. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:43.387187 13746 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 63168840534246b59a2fdbfdfeebff47. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:43.387872 13737 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c01157324ba45bda5b3a9a328bf319b. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:43.391125 13459 tablet_service.cc:1468] Processing CreateTablet for tablet 1fee3e58f31b4befa42ffbb8d7bd6f4e (DEFAULT_TABLE table=default.Table_ee107090683f4625a3815e28e838c84a [id=b13f82c88cfe49b3a5ee2949a3429966]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:43.394467 13455 tablet_service.cc:1468] Processing CreateTablet for tablet 6720d2b945814305845beea0a2cb9912 (DEFAULT_TABLE table=default.Table_87a9206ca75f43159bde4f474e94ddec [id=996d39e74e5646399ea495ace468a319]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:43.395668 13453 tablet_service.cc:1468] Processing CreateTablet for tablet d1d5e0d40a91457da65a0e925289309e (DEFAULT_TABLE table=default.Table_d1157e0797784cdca583812222959656 [id=4d84553c809c466382bfdbfa8257fed2]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:43.395956 13460 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c01157324ba45bda5b3a9a328bf319b. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:43.393548 13458 tablet_service.cc:1468] Processing CreateTablet for tablet 2aea1a69d22544899b0218be7e0f8799 (DEFAULT_TABLE table=default.Table_df0e35c42b3d47589ce170267c3c7b76 [id=eab69737d0014874b68b8c9af5763f09]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:43.398283 13463 tablet_service.cc:1468] Processing CreateTablet for tablet 0c70140d87d34bde919714f08a5c94d4 (DEFAULT_TABLE table=default.Table_9fe110ab062c400d8861f86ac328ea71 [id=d7785a68dc484acbb9153d943fee972d]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:43.401378 13739 tablet_service.cc:1468] Processing CreateTablet for tablet d1d5e0d40a91457da65a0e925289309e (DEFAULT_TABLE table=default.Table_d1157e0797784cdca583812222959656 [id=4d84553c809c466382bfdbfa8257fed2]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:43.334730 13702 service_pool.cc:138] CreateTablet request on kudu.tserver.TabletServerAdminService from 127.0.0.1:45460 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 449)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 450)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 451)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 452)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 453)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 454)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 455)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 456)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 457)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 458)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 459)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45460 (request call id 460)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 461)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 462)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 463)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 464)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 465)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 466)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 467)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 468)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 469)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 470)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 471)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 472)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 473)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45460 (request call id 474)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45460 (request call id 475)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45460 (request call id 476)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45460 (request call id 477)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 478)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 479)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 480)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 481)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 482)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 483)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 484)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 485)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 486)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 487)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 488)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 489)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 490)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 491)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 494)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 495)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 496)
I20250830 07:54:43.404973 13606 tablet_service.cc:1468] Processing CreateTablet for tablet d94215b0b1f142178f0b791518d1baf2 (DEFAULT_TABLE table=default.Table_67195b41a04042728399c4da5f841c6d [id=168217776db64da7a80e9f5263c4976b]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:43.405176 13462 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52df62f7f1aa4b38be89f6198cf01f24. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:43.405336 13597 tablet_service.cc:1468] Processing CreateTablet for tablet 34199145292d4ddb8c603e5c581f1d15 (DEFAULT_TABLE table=default.Table_9a69fe1a51464ff9bd75cc9902331abf [id=344b9d0cfa1e4ada84a648d6b0c4ab9d]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:43.408358 13738 tablet_service.cc:1468] Processing CreateTablet for tablet ba4e1fccb8f046d6b63afe67c1f9d538 (DEFAULT_TABLE table=default.Table_456a93d36cbe4e58a192a0c6bc9518fa [id=a66fee2a40d848e8ae7f55b295c4c65e]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:43.409170 13461 tablet_service.cc:1468] Processing CreateTablet for tablet 50dfc24a0b9645e4860cd99b1df3bd61 (DEFAULT_TABLE table=default.Table_e9dc95fecbf6406997ec10252d8e788e [id=ce63b0b5f48c4ca59ae638b89bd0e615]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:43.410594 13751 tablet_service.cc:1468] Processing CreateTablet for tablet 0c70140d87d34bde919714f08a5c94d4 (DEFAULT_TABLE table=default.Table_9fe110ab062c400d8861f86ac328ea71 [id=d7785a68dc484acbb9153d943fee972d]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:43.411008 13452 tablet_service.cc:1468] Processing CreateTablet for tablet b2248b305c9f448a9e30661142ad10ea (DEFAULT_TABLE table=default.Table_9f782ecc45e54615a182e9ad36d446aa [id=13ee9ffcec254806a35d27b45cd6669b]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:43.413420 13741 tablet_service.cc:1468] Processing CreateTablet for tablet 52df62f7f1aa4b38be89f6198cf01f24 (DEFAULT_TABLE table=default.Table_c58784366d3c49dda4c9d4afc16520a3 [id=0345f468e2de4e38814123f678c2da1c]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:43.414692 13748 tablet_service.cc:1468] Processing CreateTablet for tablet 439fc51afa6b435e81bc38b9e88d4041 (DEFAULT_TABLE table=default.Table_65886201d1784503987a2258f7c62a85 [id=85257e9cbb7e44ffadaab62e99b0726c]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:43.418674 13465 tablet_service.cc:1468] Processing CreateTablet for tablet 63168840534246b59a2fdbfdfeebff47 (DEFAULT_TABLE table=default.Table_41eb28f070d04bf69d643c4208052120 [id=fe274567d2a84f62b0c585f361464b6c]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:43.422276 13742 tablet_service.cc:1468] Processing CreateTablet for tablet 2aea1a69d22544899b0218be7e0f8799 (DEFAULT_TABLE table=default.Table_df0e35c42b3d47589ce170267c3c7b76 [id=eab69737d0014874b68b8c9af5763f09]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:43.424908 13228 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_78d044c012894bfd8972b2253087fa0c" } new_table_name: "default.Table_d72c9e458203404188b2329054b05d20" modify_external_catalogs: true
I20250830 07:54:43.425581 13627 raft_consensus.cc:3058] T b38c8d003413428dae9e47f58e197c2c P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:43.426339 13232 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_3c2f79a13fe642769065e2bc5fb22872"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:43.426951 13232 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3c2f79a13fe642769065e2bc5fb22872 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:43.428416 13601 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd9903bdfaef4139a1a582c54689da4a. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:43.428701 13233 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_ecc415dc4d894e3c851f48708e0c22c3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:43.429164 13233 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ecc415dc4d894e3c851f48708e0c22c3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:43.429513 13597 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34199145292d4ddb8c603e5c581f1d15. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:43.429708 13599 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dcb8b326dbec4d40af26b4f143157468. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:43.430629 13459 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1fee3e58f31b4befa42ffbb8d7bd6f4e. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:43.442492 13124 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskbivBUj/build/asan/bin/kudu
/tmp/dist-test-taskbivBUj/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.209.60:43889
--webserver_interface=127.12.209.60
--webserver_port=32915
--builtin_ntp_servers=127.12.209.20:33943
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.209.62:39725,127.12.209.61:44241,127.12.209.60:43889
--hive_metastore_notification_log_poll_period_seconds=1
--enable_metadata_cleanup_for_deleted_tables_and_tablets=true
--catalog_manager_bg_task_wait_ms=10
--metadata_for_deleted_table_and_tablet_reserved_secs=0
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
I20250830 07:54:43.442672 13468 tablet_service.cc:1468] Processing CreateTablet for tablet dcb8b326dbec4d40af26b4f143157468 (DEFAULT_TABLE table=default.Table_2d468f4cd05e4f9aa354321ddccdc59c [id=6af7c90adabf47c9a41d01c9d3f40642]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:43.446457 13457 tablet_service.cc:1468] Processing CreateTablet for tablet d94215b0b1f142178f0b791518d1baf2 (DEFAULT_TABLE table=default.Table_67195b41a04042728399c4da5f841c6d [id=168217776db64da7a80e9f5263c4976b]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:43.447255 13887 tablet_bootstrap.cc:492] T 99f307a8cbb34addaafab82b3ed18241 P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:54:43.453233 13456 tablet_service.cc:1468] Processing CreateTablet for tablet 3bca390f6d4343cba7a9fb07f0d4d72b (DEFAULT_TABLE table=default.Table_32ff7c454b324d9f8b37a9d40f3bdc35 [id=ea6cad75a28f479ab977561b6b4193bc]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:43.457499 13454 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba4e1fccb8f046d6b63afe67c1f9d538. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:43.465641 14706 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 2 leader_uuid: "5e9d6449ae824acab24c459a72075e88" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fea6152429cc4e79a25b18e02aafae57" member_type: VOTER last_known_addr { host: "127.12.209.62" port: 39725 } } peers { permanent_uuid: "5e9d6449ae824acab24c459a72075e88" member_type: VOTER last_known_addr { host: "127.12.209.61" port: 44241 } } peers { permanent_uuid: "3ea183a890b84f408b20b55e9eb7c7ed" member_type: VOTER last_known_addr { host: "127.12.209.60" port: 43889 } } }
I20250830 07:54:43.465899 14706 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88 [sys.catalog]: This master's current role is: LEADER
I20250830 07:54:43.467772 13456 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3bca390f6d4343cba7a9fb07f0d4d72b. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:43.455787 13422 service_pool.cc:138] CreateTablet request on kudu.tserver.TabletServerAdminService from 127.0.0.1:37956 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 458)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37956 (request call id 459)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 460)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 461)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 462)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 463)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 464)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 465)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 466)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 467)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 468)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 469)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 470)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 471)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 472)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37956 (request call id 473)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37956 (request call id 474)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37956 (request call id 475)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37956 (request call id 476)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 477)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 478)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 479)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 480)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 481)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 482)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 483)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 484)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 485)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 486)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 487)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 488)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 490)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 491)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 492)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 496)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 497)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 498)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 502)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 501)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 503)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 504)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 505)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 506)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 507)
I20250830 07:54:43.470355 13229 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_1860135c2b3f41f5b32ce70d590fa24e" } modify_external_catalogs: true
I20250830 07:54:43.473959 13229 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_1860135c2b3f41f5b32ce70d590fa24e" } modify_external_catalogs: true
I20250830 07:54:43.482268 14674 raft_consensus.cc:491] T 7af74bdde363493f8061eba450ecf4b4 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:43.482482 14674 raft_consensus.cc:513] T 7af74bdde363493f8061eba450ecf4b4 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:43.485453 13604 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 50dfc24a0b9645e4860cd99b1df3bd61. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:43.404153 13563 service_pool.cc:138] CreateTablet request on kudu.tserver.TabletServerAdminService from 127.0.0.1:45306 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 468)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 469)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 470)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 471)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 472)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 473)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45306 (request call id 474)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45306 (request call id 475)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45306 (request call id 476)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45306 (request call id 477)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 478)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 479)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 480)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 481)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 482)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 483)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 484)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 487)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 488)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 489)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 490)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 491)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 492)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 493)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 494)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 495)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 496)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 497)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 498)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 499)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 500)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 501)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 502)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 503)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 504)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 505)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 506)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 507)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 508)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 509)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 510)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 511)
I20250830 07:54:43.470753 13887 ts_tablet_manager.cc:1397] T 99f307a8cbb34addaafab82b3ed18241 P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.799s user 0.023s sys 0.034s
I20250830 07:54:43.490082 13453 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1d5e0d40a91457da65a0e925289309e. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:43.494259 13606 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d94215b0b1f142178f0b791518d1baf2. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:43.493630 13464 tablet_service.cc:1515] Processing DeleteTablet for tablet f1fe024f0de048a5a0931ee38752d5a1 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:42 UTC) from {username='slave'} at 127.0.0.1:37956
I20250830 07:54:43.499325 13593 tablet_service.cc:1468] Processing CreateTablet for tablet af449cc407c046eeb5cdfdacffc617a4 (DEFAULT_TABLE table=default.Table_0cebf3f048d64286a08f66238dbbc35f [id=b246fa3864ad42649b0a9925ce921a9a]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:43.499614 13608 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b2248b305c9f448a9e30661142ad10ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:43.499809 13460 tablet_service.cc:1468] Processing CreateTablet for tablet adbacbbb13d840a29d8d7d08ea04f6b1 (DEFAULT_TABLE table=default.Table_fbed2e93681c42ae83a5a169b6a3fb25 [id=6e2decb9b0f0464e8da6f7e4bc404a52]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:43.499254 14674 leader_election.cc:290] T 7af74bdde363493f8061eba450ecf4b4 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:43.505528 14445 consensus_queue.cc:1035] T 8dddcfe56522436287aea212e316a729 P 6b5e454d98894637b466ea27f1b647f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:54:43.504393 13459 tablet_service.cc:1468] Processing CreateTablet for tablet 34199145292d4ddb8c603e5c581f1d15 (DEFAULT_TABLE table=default.Table_9a69fe1a51464ff9bd75cc9902331abf [id=344b9d0cfa1e4ada84a648d6b0c4ab9d]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:43.506374 13563 service_pool.cc:138] DeleteTablet request on kudu.tserver.TabletServerAdminService from 127.0.0.1:45306 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 469)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 470)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 471)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 472)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 473)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45306 (request call id 474)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45306 (request call id 475)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45306 (request call id 476)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45306 (request call id 477)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 478)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 479)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 480)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 481)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 482)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 483)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 484)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 487)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 488)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 489)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 490)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 491)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 492)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 493)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 494)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 495)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 496)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 497)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 498)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 499)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 500)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 501)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 502)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 503)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 504)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 505)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 506)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 507)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 508)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 509)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 510)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 511)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 514)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 515)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 516)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 517)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 518)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 519)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 520)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 521)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 522)
I20250830 07:54:43.507328 13563 service_pool.cc:138] DeleteTablet request on kudu.tserver.TabletServerAdminService from 127.0.0.1:45306 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 469)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 470)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 471)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 472)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 473)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45306 (request call id 474)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45306 (request call id 475)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45306 (request call id 476)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45306 (request call id 477)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 478)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 479)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 480)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 481)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 482)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 483)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 484)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 487)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 488)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 489)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 490)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 491)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 492)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 493)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 494)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 495)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 496)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 497)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 498)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 499)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 500)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 501)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 502)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 503)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 504)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 505)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 506)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 507)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 508)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 509)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 510)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 511)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 514)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 515)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 516)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 517)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 518)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 519)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 520)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 521)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 522)
I20250830 07:54:43.508220 13563 service_pool.cc:138] DeleteTablet request on kudu.tserver.TabletServerAdminService from 127.0.0.1:45306 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 469)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 470)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 471)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 472)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 473)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45306 (request call id 474)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45306 (request call id 475)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45306 (request call id 476)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45306 (request call id 477)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 478)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 479)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 480)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 481)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 482)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 483)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 484)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 487)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 488)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 489)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 490)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 491)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 492)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 493)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 494)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 495)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 496)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 497)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 498)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 499)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 500)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 501)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 502)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 503)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 504)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 505)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 506)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 507)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 508)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 509)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 510)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 511)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 514)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 515)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 516)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 517)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 518)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 519)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 520)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 521)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 522)
I20250830 07:54:43.509121 13563 service_pool.cc:138] DeleteTablet request on kudu.tserver.TabletServerAdminService from 127.0.0.1:45306 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 469)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 470)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 471)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 472)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 473)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45306 (request call id 474)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45306 (request call id 475)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45306 (request call id 476)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45306 (request call id 477)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 478)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 479)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 480)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 481)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 482)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 483)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 484)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 487)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 488)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 489)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 490)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 491)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 492)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 493)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 494)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 495)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 496)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 497)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 498)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 499)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 500)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 501)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 502)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 503)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 504)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 505)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 506)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 507)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 508)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 509)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 510)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 511)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 514)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 515)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 516)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 517)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 518)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 519)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 520)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 521)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 522)
I20250830 07:54:43.509889 13563 service_pool.cc:138] DeleteTablet request on kudu.tserver.TabletServerAdminService from 127.0.0.1:45306 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 469)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 470)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 471)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 472)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 473)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45306 (request call id 474)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45306 (request call id 475)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45306 (request call id 476)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45306 (request call id 477)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 478)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 479)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 480)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 481)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 482)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 483)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 484)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 487)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 488)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 489)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 490)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 491)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 492)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 493)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 494)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 495)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 496)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 497)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 498)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 499)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 500)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 501)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 502)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 503)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 504)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 505)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 506)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 507)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 508)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 509)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 510)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 511)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 514)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 515)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 516)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 517)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 518)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 519)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 520)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 521)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 522)
I20250830 07:54:43.497661 13621 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "7af74bdde363493f8061eba450ecf4b4" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:43.511740 13596 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ccc9091018cb48ffb2affd98e8bbfa05. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:43.519280 13621 raft_consensus.cc:2466] T 7af74bdde363493f8061eba450ecf4b4 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2065c332f15a4739899af79f3669c3ba in term 0.
I20250830 07:54:43.520165 13595 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ca83bbf848744f38206ceb4126271be. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:43.522209 13887 raft_consensus.cc:357] T 99f307a8cbb34addaafab82b3ed18241 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:43.523098 13451 tablet_service.cc:1468] Processing CreateTablet for tablet cd9903bdfaef4139a1a582c54689da4a (DEFAULT_TABLE table=default.Table_dbadc01ffe94447080e199d005d9e87c [id=c5f7d20d95784a619699a6da83965e49]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:43.525895 13481 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "7af74bdde363493f8061eba450ecf4b4" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:54:43.526103 13481 raft_consensus.cc:2466] T 7af74bdde363493f8061eba450ecf4b4 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b5e454d98894637b466ea27f1b647f9 in term 0.
I20250830 07:54:43.526584 13423 leader_election.cc:304] T 7af74bdde363493f8061eba450ecf4b4 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 6b5e454d98894637b466ea27f1b647f9; no voters:
I20250830 07:54:43.528640 13561 leader_election.cc:304] T 7af74bdde363493f8061eba450ecf4b4 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 6b5e454d98894637b466ea27f1b647f9; no voters:
I20250830 07:54:43.534106 14674 raft_consensus.cc:2802] T 7af74bdde363493f8061eba450ecf4b4 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:54:43.535167 14645 raft_consensus.cc:2802] T 7af74bdde363493f8061eba450ecf4b4 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:54:43.535123 13450 tablet_service.cc:1468] Processing CreateTablet for tablet 55bd3f378b854476a24f657f5e23843d (DEFAULT_TABLE table=default.Table_ffed9a8a8cb2455082f2fd5db500bcb2 [id=ee89c0d972a9408cb30b0b97b4bf23ed]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:43.535288 14645 raft_consensus.cc:491] T 7af74bdde363493f8061eba450ecf4b4 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:54:43.535424 14645 raft_consensus.cc:3058] T 7af74bdde363493f8061eba450ecf4b4 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:43.535566 13887 raft_consensus.cc:383] T 99f307a8cbb34addaafab82b3ed18241 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:43.536080 13887 raft_consensus.cc:738] T 99f307a8cbb34addaafab82b3ed18241 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:54:43.537128 13887 consensus_queue.cc:260] T 99f307a8cbb34addaafab82b3ed18241 P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:43.540930 13455 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6720d2b945814305845beea0a2cb9912. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:43.542176 13459 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34199145292d4ddb8c603e5c581f1d15. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:43.543138 13593 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af449cc407c046eeb5cdfdacffc617a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:43.543793 13451 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd9903bdfaef4139a1a582c54689da4a. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:43.549362 14645 raft_consensus.cc:513] T 7af74bdde363493f8061eba450ecf4b4 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:43.550149 14674 raft_consensus.cc:491] T 7af74bdde363493f8061eba450ecf4b4 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:54:43.550307 14674 raft_consensus.cc:3058] T 7af74bdde363493f8061eba450ecf4b4 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:43.550494 13458 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2aea1a69d22544899b0218be7e0f8799. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:43.554288 13621 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "7af74bdde363493f8061eba450ecf4b4" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9"
I20250830 07:54:43.523185 13422 service_pool.cc:138] CreateTablet request on kudu.tserver.TabletServerAdminService from 127.0.0.1:37956 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 463)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 464)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 465)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 466)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 467)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 468)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 469)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 470)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 471)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 472)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37956 (request call id 473)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37956 (request call id 474)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37956 (request call id 475)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37956 (request call id 476)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 477)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 478)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 479)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 480)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 481)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 482)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 483)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 484)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 485)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 486)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 487)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 488)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 490)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 491)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 492)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 496)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 497)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 498)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 502)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 501)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 503)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 504)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 505)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 506)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 507)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 509)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 510)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 511)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 512)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 513)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 514)
I20250830 07:54:43.558980 13605 tablet_service.cc:1468] Processing CreateTablet for tablet f479eef0171c401bbd27beec4486a8b2 (DEFAULT_TABLE table=default.Table_6a958507c89649f0b5da3534949c2122 [id=1cda9ceec18b4e37973268cb198bdac7]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:43.561493 13602 tablet_service.cc:1468] Processing CreateTablet for tablet a36f38ada7314165a5e9d6ee7bbf69e3 (DEFAULT_TABLE table=default.Table_b0514d974e9d4da1b8599e38ea5657cb [id=b5dab764ada7465d9634966caa73865b]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:43.572813 13887 ts_tablet_manager.cc:1428] T 99f307a8cbb34addaafab82b3ed18241 P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.058s user 0.001s sys 0.002s
I20250830 07:54:43.573359 13450 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 55bd3f378b854476a24f657f5e23843d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:43.460928 13744 tablet_service.cc:1468] Processing CreateTablet for tablet 50dfc24a0b9645e4860cd99b1df3bd61 (DEFAULT_TABLE table=default.Table_e9dc95fecbf6406997ec10252d8e788e [id=ce63b0b5f48c4ca59ae638b89bd0e615]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:43.510196 13735 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6720d2b945814305845beea0a2cb9912. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:43.592537 13422 service_pool.cc:138] DeleteTablet request on kudu.tserver.TabletServerAdminService from 127.0.0.1:37956 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 464)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 465)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 466)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 467)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 468)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 469)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 470)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 471)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 472)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37956 (request call id 473)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37956 (request call id 474)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37956 (request call id 475)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37956 (request call id 476)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 477)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 478)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 479)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 480)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 481)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 482)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 483)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 484)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 485)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 486)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 487)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 488)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 490)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 491)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 492)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 496)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 497)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 498)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 502)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 501)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 503)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 504)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 505)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 506)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 507)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 509)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 510)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 511)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 512)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 513)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 514)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 516)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 517)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 518)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 519)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 520)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 521)
I20250830 07:54:43.594396 13464 tablet_service.cc:1468] Processing CreateTablet for tablet 4b9d9d4b65964fd49d8e25092a14d774 (DEFAULT_TABLE table=default.Table_7e8dccc6af2d49159b06563cd36240a7 [id=8e7fbc2351124d2081e7b3bbf3a4c0f6]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:43.595242 14645 leader_election.cc:290] T 7af74bdde363493f8061eba450ecf4b4 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 election: Requested vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:43.607600 14644 raft_consensus.cc:491] T 99f307a8cbb34addaafab82b3ed18241 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:43.607657 13887 tablet_bootstrap.cc:492] T 533811110191436d96665b3475ab597f P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:54:43.607769 14644 raft_consensus.cc:513] T 99f307a8cbb34addaafab82b3ed18241 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:43.608433 14644 leader_election.cc:290] T 99f307a8cbb34addaafab82b3ed18241 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:43.607862 13422 service_pool.cc:138] DeleteTablet request on kudu.tserver.TabletServerAdminService from 127.0.0.1:37956 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 465)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 466)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 467)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 468)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 469)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 470)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 471)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 472)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37956 (request call id 473)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37956 (request call id 474)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37956 (request call id 475)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37956 (request call id 476)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 477)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 478)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 479)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 480)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 481)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 482)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 483)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 484)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 485)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 486)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 487)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 488)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 490)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 491)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 492)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 496)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 497)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 498)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 502)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 501)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 503)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 504)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 505)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 506)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 507)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 509)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 510)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 511)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 512)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 513)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 514)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 516)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 517)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 518)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 519)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 520)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 521)
I20250830 07:54:43.609093 13461 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 50dfc24a0b9645e4860cd99b1df3bd61. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:43.611044 13466 tablet_service.cc:1468] Processing CreateTablet for tablet 135d754d83ad422eb05909d2daa19d34 (DEFAULT_TABLE table=default.Table_0b763c9c5ec849f9830f2670d074b17c [id=dc7b513bb4204424b5b292e5751f5fa6]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:43.613551 13772 raft_consensus.cc:3058] T 853503f3f98a49219b077af980180400 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:43.626503 13770 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "7af74bdde363493f8061eba450ecf4b4" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:43.622874 13736 tablet_service.cc:1468] Processing CreateTablet for tablet 3bca390f6d4343cba7a9fb07f0d4d72b (DEFAULT_TABLE table=default.Table_32ff7c454b324d9f8b37a9d40f3bdc35 [id=ea6cad75a28f479ab977561b6b4193bc]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:43.609134 13422 service_pool.cc:138] DeleteTablet request on kudu.tserver.TabletServerAdminService from 127.0.0.1:37956 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 465)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 466)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 467)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 468)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 469)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 470)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 471)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 472)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37956 (request call id 473)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37956 (request call id 474)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37956 (request call id 475)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37956 (request call id 476)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 477)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 478)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 479)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 480)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 481)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 482)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 483)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 484)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 485)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 486)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 487)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 488)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 490)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 491)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 492)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 496)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 497)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 498)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 502)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 501)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 503)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 504)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 505)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 506)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 507)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 509)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 510)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 511)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 512)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 513)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 514)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 516)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 517)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 518)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 519)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 520)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 521)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37956 (request call id 524)
I20250830 07:54:43.640588 13770 raft_consensus.cc:2466] T 7af74bdde363493f8061eba450ecf4b4 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b5e454d98894637b466ea27f1b647f9 in term 0.
I20250830 07:54:43.640805 14315 raft_consensus.cc:491] T e862fa77e16945bd94e405aa3474f021 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:43.646570 13750 tablet_service.cc:1468] Processing CreateTablet for tablet dcb8b326dbec4d40af26b4f143157468 (DEFAULT_TABLE table=default.Table_2d468f4cd05e4f9aa354321ddccdc59c [id=6af7c90adabf47c9a41d01c9d3f40642]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:43.648897 13452 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b2248b305c9f448a9e30661142ad10ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:43.649772 13463 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0c70140d87d34bde919714f08a5c94d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:43.650763 13468 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dcb8b326dbec4d40af26b4f143157468. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:43.650388 13422 service_pool.cc:138] DeleteTablet request on kudu.tserver.TabletServerAdminService from 127.0.0.1:37956 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 465)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 466)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 467)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 468)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 469)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 470)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 471)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 472)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37956 (request call id 473)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37956 (request call id 474)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37956 (request call id 475)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37956 (request call id 476)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 477)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 478)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 479)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 480)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 481)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 482)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 483)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 484)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 485)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 486)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 487)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 488)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 490)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 491)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 492)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 496)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 497)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 498)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 502)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 501)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 503)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 504)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 505)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 506)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 507)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 509)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 510)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 511)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 512)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 513)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 514)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 516)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 517)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 518)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 519)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 520)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 521)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37956 (request call id 524)
I20250830 07:54:43.662382 13887 tablet_bootstrap.cc:654] T 533811110191436d96665b3475ab597f P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:43.661805 13751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0c70140d87d34bde919714f08a5c94d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:43.667774 13598 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 135d754d83ad422eb05909d2daa19d34. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:43.673789 14480 consensus_queue.cc:1035] T 14ed24577c8f49f49c83242a26877614 P 6b5e454d98894637b466ea27f1b647f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:54:43.676474 13882 tablet_bootstrap.cc:492] T 752727eef0734ff3b7b35b1d5f66aea6 P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:54:43.676487 13605 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f479eef0171c401bbd27beec4486a8b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:43.676692 13882 ts_tablet_manager.cc:1397] T 752727eef0734ff3b7b35b1d5f66aea6 P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.647s user 0.012s sys 0.017s
I20250830 07:54:43.677608 13882 raft_consensus.cc:357] T 752727eef0734ff3b7b35b1d5f66aea6 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:43.677790 13882 raft_consensus.cc:383] T 752727eef0734ff3b7b35b1d5f66aea6 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:43.677903 13882 raft_consensus.cc:738] T 752727eef0734ff3b7b35b1d5f66aea6 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:54:43.678107 13882 consensus_queue.cc:260] T 752727eef0734ff3b7b35b1d5f66aea6 P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:43.678716 13882 ts_tablet_manager.cc:1428] T 752727eef0734ff3b7b35b1d5f66aea6 P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20250830 07:54:43.679654 14526 raft_consensus.cc:491] T 2009012fddc24e4fb7ad0fab33a1103b P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:43.683455 14526 raft_consensus.cc:513] T 2009012fddc24e4fb7ad0fab33a1103b P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:54:43.684222 14526 leader_election.cc:290] T 2009012fddc24e4fb7ad0fab33a1103b P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
I20250830 07:54:43.687925 13460 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet adbacbbb13d840a29d8d7d08ea04f6b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:43.563436 13563 service_pool.cc:138] DeleteTablet request on kudu.tserver.TabletServerAdminService from 127.0.0.1:45306 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 472)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 473)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45306 (request call id 474)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45306 (request call id 475)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45306 (request call id 476)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45306 (request call id 477)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 478)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 479)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 480)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 481)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 482)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 483)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 484)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 487)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 488)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 489)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 490)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 491)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 492)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 493)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 494)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 495)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 496)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 497)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 498)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 499)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 500)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 501)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 502)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 503)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 504)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 505)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 506)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 507)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 508)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 509)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 510)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 511)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 514)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 515)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 516)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 517)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 518)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 519)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 520)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 521)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 522)
I20250830 07:54:43.699714 13422 service_pool.cc:138] DeleteTablet request on kudu.tserver.TabletServerAdminService from 127.0.0.1:37956 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 467)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 468)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 469)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 470)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 471)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 472)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37956 (request call id 473)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37956 (request call id 474)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37956 (request call id 475)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37956 (request call id 476)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 477)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 478)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 479)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 480)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 481)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 482)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 483)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 484)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 485)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 486)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 487)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 488)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 490)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 491)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 492)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 496)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 497)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 498)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 502)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 501)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 503)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 504)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 505)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 506)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 507)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 509)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 510)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 511)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 512)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 513)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 514)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 516)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 517)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 518)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 519)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 520)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 521)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37956 (request call id 524)
W20250830 07:54:43.708106 13561 leader_election.cc:343] T 2009012fddc24e4fb7ad0fab33a1103b P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): Not found: Tablet not found: 2009012fddc24e4fb7ad0fab33a1103b
I20250830 07:54:43.709380 13467 tablet_service.cc:1468] Processing CreateTablet for tablet ccc9091018cb48ffb2affd98e8bbfa05 (DEFAULT_TABLE table=default.Table_dcc3f90b74de4848b1d750ec0aa814f4 [id=f7e584e9473f446cb4b78e99377d4b1b]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:43.710635 13464 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b9d9d4b65964fd49d8e25092a14d774. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:43.712323 13592 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b9d9d4b65964fd49d8e25092a14d774. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:43.715047 13466 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 135d754d83ad422eb05909d2daa19d34. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:43.716624 13462 tablet_service.cc:1468] Processing CreateTablet for tablet 1ca83bbf848744f38206ceb4126271be (DEFAULT_TABLE table=default.Table_58be973418b94b6d9c25747a596793b6 [id=0138d045d5414fec8933b6d1fbac4ee6]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:43.724977 13882 tablet_bootstrap.cc:492] T cb3c48982add45379c0e1b117ec40c1a P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:54:43.727499 13603 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 55bd3f378b854476a24f657f5e23843d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:43.727643 14733 raft_consensus.cc:491] T b38c8d003413428dae9e47f58e197c2c P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:43.727747 13602 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a36f38ada7314165a5e9d6ee7bbf69e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:43.727850 14733 raft_consensus.cc:513] T b38c8d003413428dae9e47f58e197c2c P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:43.738327 13887 tablet_bootstrap.cc:492] T 533811110191436d96665b3475ab597f P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:54:43.738936 14733 leader_election.cc:290] T b38c8d003413428dae9e47f58e197c2c P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:43.741768 13453 tablet_service.cc:1468] Processing CreateTablet for tablet af449cc407c046eeb5cdfdacffc617a4 (DEFAULT_TABLE table=default.Table_0cebf3f048d64286a08f66238dbbc35f [id=b246fa3864ad42649b0a9925ce921a9a]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:43.742301 13456 tablet_service.cc:1468] Processing CreateTablet for tablet 0d16bc64dd6e43f7ba313b77c2bbb728 (DEFAULT_TABLE table=default.Table_6fe8dfbe1873453d8f1a683a12a6288a [id=93a678d18ca94d9f9c1f763808c070d6]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:43.742813 13451 tablet_service.cc:1468] Processing CreateTablet for tablet f479eef0171c401bbd27beec4486a8b2 (DEFAULT_TABLE table=default.Table_6a958507c89649f0b5da3534949c2122 [id=1cda9ceec18b4e37973268cb198bdac7]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:43.743321 13600 tablet_service.cc:1468] Processing CreateTablet for tablet 3f70097c1b3a48dfbc1ad129fa7a3730 (DEFAULT_TABLE table=default.Table_605f96f8ddea45cfa2a0862488a409f6 [id=80c106705320406faebc87088138d10f]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:43.744429 14674 raft_consensus.cc:513] T 7af74bdde363493f8061eba450ecf4b4 P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:43.746520 13591 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed364f03bdad42b88e181b7d0e1e4011. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:43.747164 13621 raft_consensus.cc:2391] T 7af74bdde363493f8061eba450ecf4b4 P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 2065c332f15a4739899af79f3669c3ba in current term 1: Already voted for candidate 6b5e454d98894637b466ea27f1b647f9 in this term.
I20250830 07:54:43.748176 13887 ts_tablet_manager.cc:1397] T 533811110191436d96665b3475ab597f P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.165s user 0.005s sys 0.004s
I20250830 07:54:43.748590 14674 leader_election.cc:290] T 7af74bdde363493f8061eba450ecf4b4 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 election: Requested vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:43.754365 13599 tablet_service.cc:1468] Processing CreateTablet for tablet ad7a45187569416bad6c71db9f8ab702 (DEFAULT_TABLE table=default.Table_a0b8d1d1cefc406db62d3d2882feb096 [id=a75583fe901a49158a797a2577b7e5f5]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:43.756431 13597 tablet_service.cc:1515] Processing DeleteTablet for tablet e4ca3110247640fbae4241448e8d5ef7 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:42 UTC) from {username='slave'} at 127.0.0.1:45306
I20250830 07:54:43.757301 13597 tablet_service.cc:1515] Processing DeleteTablet for tablet 2c31d119743f49589703c434ac6c7548 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:42 UTC) from {username='slave'} at 127.0.0.1:45306
I20250830 07:54:43.757501 13597 tablet_service.cc:1515] Processing DeleteTablet for tablet 65f1ee59e6e9498381d686f16a865e23 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:42 UTC) from {username='slave'} at 127.0.0.1:45306
I20250830 07:54:43.762333 13600 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f70097c1b3a48dfbc1ad129fa7a3730. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:43.768167 13604 tablet_service.cc:1468] Processing CreateTablet for tablet 122bec4220c74dfaa8228f6d153cd50e (DEFAULT_TABLE table=default.Table_b520311338ac432283a508831f98574e [id=77861ebf6e5646c285d6e72dec5a67bc]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:43.772017 13597 tablet_service.cc:1515] Processing DeleteTablet for tablet 2d91b0ba74034b85812a13719e21dc6c with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:42 UTC) from {username='slave'} at 127.0.0.1:45306
I20250830 07:54:43.772411 13599 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad7a45187569416bad6c71db9f8ab702. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:43.772992 13467 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ccc9091018cb48ffb2affd98e8bbfa05. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:43.776014 13738 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba4e1fccb8f046d6b63afe67c1f9d538. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:43.775934 14315 raft_consensus.cc:513] T e862fa77e16945bd94e405aa3474f021 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:43.776325 13741 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52df62f7f1aa4b38be89f6198cf01f24. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:43.779839 13744 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 50dfc24a0b9645e4860cd99b1df3bd61. 1 dirs total, 0 dirs full, 0 dirs failed
W20250830 07:54:43.783960 13219 catalog_manager.cc:4726] Async tablet task AlterTable RPC for tablet 2048c04578104c78aa6504fd9d5953a3 (table default.Table_774eed33394d4f4a839a3a0b14b5ad71 [id=2f37d76cb66742b5ac3d9f0714c6394d], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 2048c04578104c78aa6504fd9d5953a3 consensus state has no leader
W20250830 07:54:43.785893 13220 catalog_manager.cc:4908] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet f1fe024f0de048a5a0931ee38752d5a1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f1fe024f0de048a5a0931ee38752d5a1 already in progress: creating tablet
I20250830 07:54:43.786531 13597 tablet_service.cc:1468] Processing CreateTablet for tablet 8ee98b748d0245bc8bf9eeac727b495e (DEFAULT_TABLE table=default.Table_b59b0e75bbee4971912072e1174aad74 [id=dadcb9b0dfca4aabbdafef5727a1fc3c]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:43.787314 13604 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 122bec4220c74dfaa8228f6d153cd50e. 1 dirs total, 0 dirs full, 0 dirs failed
W20250830 07:54:43.793107 13218 catalog_manager.cc:4908] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): delete failed for tablet f1fe024f0de048a5a0931ee38752d5a1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f1fe024f0de048a5a0931ee38752d5a1 already in progress: creating tablet
I20250830 07:54:43.793700 13608 tablet_service.cc:1468] Processing CreateTablet for tablet e7e9d2e9b1ca4ddfb0c6a7bced613c35 (DEFAULT_TABLE table=default.Table_4c8064376b504b74bea14908e716c0b3 [id=8d8684f2399d4af3b6dab1912ab6c7d6]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:43.795197 13742 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2aea1a69d22544899b0218be7e0f8799. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:43.796574 13736 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3bca390f6d4343cba7a9fb07f0d4d72b. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:43.799584 13748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 439fc51afa6b435e81bc38b9e88d4041. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:43.800532 13739 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1d5e0d40a91457da65a0e925289309e. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:43.807832 13609 tablet_service.cc:1468] Processing CreateTablet for tablet 0d16bc64dd6e43f7ba313b77c2bbb728 (DEFAULT_TABLE table=default.Table_6fe8dfbe1873453d8f1a683a12a6288a [id=93a678d18ca94d9f9c1f763808c070d6]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:43.809676 13745 tablet_service.cc:1468] Processing CreateTablet for tablet b2248b305c9f448a9e30661142ad10ea (DEFAULT_TABLE table=default.Table_9f782ecc45e54615a182e9ad36d446aa [id=13ee9ffcec254806a35d27b45cd6669b]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:43.820559 13456 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d16bc64dd6e43f7ba313b77c2bbb728. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:43.822867 13770 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "8f215330505848619ad44569d3167591" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:43.825691 13750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dcb8b326dbec4d40af26b4f143157468. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:43.832784 14315 leader_election.cc:290] T e862fa77e16945bd94e405aa3474f021 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
I20250830 07:54:43.834331 13745 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b2248b305c9f448a9e30661142ad10ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:43.856129 13597 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ee98b748d0245bc8bf9eeac727b495e. 1 dirs total, 0 dirs full, 0 dirs failed
W20250830 07:54:43.862984 13771 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.518s user 0.017s sys 0.014s
I20250830 07:54:43.871209 13608 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7e9d2e9b1ca4ddfb0c6a7bced613c35. 1 dirs total, 0 dirs full, 0 dirs failed
W20250830 07:54:43.871145 13771 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.533s user 0.017s sys 0.014s
I20250830 07:54:43.878048 13459 tablet_service.cc:1468] Processing CreateTablet for tablet a36f38ada7314165a5e9d6ee7bbf69e3 (DEFAULT_TABLE table=default.Table_b0514d974e9d4da1b8599e38ea5657cb [id=b5dab764ada7465d9634966caa73865b]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:43.877609 13458 tablet_service.cc:1468] Processing CreateTablet for tablet 3f70097c1b3a48dfbc1ad129fa7a3730 (DEFAULT_TABLE table=default.Table_605f96f8ddea45cfa2a0862488a409f6 [id=80c106705320406faebc87088138d10f]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:43.879300 13887 raft_consensus.cc:357] T 533811110191436d96665b3475ab597f P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:43.879540 13887 raft_consensus.cc:383] T 533811110191436d96665b3475ab597f P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:43.879638 13887 raft_consensus.cc:738] T 533811110191436d96665b3475ab597f P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:54:43.880704 13457 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d94215b0b1f142178f0b791518d1baf2. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:43.881738 13882 tablet_bootstrap.cc:654] T cb3c48982add45379c0e1b117ec40c1a P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:43.883944 13607 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet adbacbbb13d840a29d8d7d08ea04f6b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:43.885774 13453 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af449cc407c046eeb5cdfdacffc617a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:43.885810 13590 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 443) took 1080 ms. Trace:
W20250830 07:54:43.887555 13886 thread.cc:641] log-alloc [worker] (thread pool) Time spent creating pthread: real 0.518s user 0.003s sys 0.023s
I20250830 07:54:43.887598 13459 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a36f38ada7314165a5e9d6ee7bbf69e3. 1 dirs total, 0 dirs full, 0 dirs failed
W20250830 07:54:43.888394 13886 thread.cc:608] log-alloc [worker] (thread pool) Time spent starting thread: real 0.526s user 0.003s sys 0.024s
I20250830 07:54:43.888650 13451 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f479eef0171c401bbd27beec4486a8b2. 1 dirs total, 0 dirs full, 0 dirs failed
W20250830 07:54:43.888638 13749 consensus_meta.cc:287] T e74a3e4b3b234c41aca30f772525652e P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent flushing consensus metadata: real 0.530s user 0.001s sys 0.003s
I20250830 07:54:43.889249 13462 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ca83bbf848744f38206ceb4126271be. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:43.889338 13755 tablet_service.cc:1468] Processing CreateTablet for tablet d94215b0b1f142178f0b791518d1baf2 (DEFAULT_TABLE table=default.Table_67195b41a04042728399c4da5f841c6d [id=168217776db64da7a80e9f5263c4976b]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:43.889958 13458 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f70097c1b3a48dfbc1ad129fa7a3730. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:43.902781 13886 tablet_bootstrap.cc:492] T dbe542c478874482b078296a7a0e9ec9 P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:54:43.903715 13886 ts_tablet_manager.cc:1397] T dbe542c478874482b078296a7a0e9ec9 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.993s user 0.008s sys 0.028s
W20250830 07:54:43.906147 13737 consensus_meta.cc:287] T 8c01157324ba45bda5b3a9a328bf319b P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent flushing consensus metadata: real 0.505s user 0.004s sys 0.002s
I20250830 07:54:43.906831 13737 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 444) took 1049 ms. Trace:
I20250830 07:54:43.907302 13737 rpcz_store.cc:276] 0830 07:54:42.856989 (+ 0us) service_pool.cc:168] Inserting onto call queue
0830 07:54:43.286775 (+429786us) service_pool.cc:225] Handling call
0830 07:54:43.355910 (+ 69135us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0830 07:54:43.355934 (+ 24us) ts_tablet_manager.cc:676] Creating new metadata...
0830 07:54:43.400344 (+ 44410us) tablet_metadata.cc:641] Metadata flushed
0830 07:54:43.906407 (+506063us) tablet_replica.cc:206] Creating consensus instance
0830 07:54:43.906769 (+ 362us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20250830 07:54:43.912288 13753 consensus_meta.cc:287] T 0ac39adafe144280b39f5c3fe5804087 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent flushing consensus metadata: real 0.512s user 0.005s sys 0.000s
I20250830 07:54:43.912941 13753 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 442) took 1056 ms. Trace:
I20250830 07:54:43.913323 13753 rpcz_store.cc:276] 0830 07:54:42.856767 (+ 0us) service_pool.cc:168] Inserting onto call queue
0830 07:54:43.277933 (+421166us) service_pool.cc:225] Handling call
0830 07:54:43.333349 (+ 55416us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0830 07:54:43.333365 (+ 16us) ts_tablet_manager.cc:676] Creating new metadata...
0830 07:54:43.391679 (+ 58314us) tablet_metadata.cc:641] Metadata flushed
0830 07:54:43.912656 (+520977us) tablet_replica.cc:206] Creating consensus instance
0830 07:54:43.912882 (+ 226us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20250830 07:54:43.894667 13702 service_pool.cc:138] CreateTablet request on kudu.tserver.TabletServerAdminService from 127.0.0.1:45460 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 459)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45460 (request call id 460)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 461)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 462)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 463)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 464)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 465)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 466)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 467)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 468)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 469)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 470)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 471)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 472)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 473)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45460 (request call id 474)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45460 (request call id 475)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45460 (request call id 476)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45460 (request call id 477)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 478)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 479)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 480)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 481)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 482)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 483)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 484)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 485)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 486)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 487)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 488)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 489)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 490)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 491)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 494)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 495)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 496)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 499)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 500)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 501)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 502)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 503)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 504)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 505)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 506)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 507)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 508)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 509)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 510)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 511)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 512)
I20250830 07:54:43.921729 13740 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 424) took 1066 ms. Trace:
I20250830 07:54:43.921859 13740 rpcz_store.cc:276] 0830 07:54:42.854989 (+ 0us) service_pool.cc:168] Inserting onto call queue
0830 07:54:42.858358 (+ 3369us) service_pool.cc:225] Handling call
0830 07:54:42.858876 (+ 518us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0830 07:54:42.858897 (+ 21us) ts_tablet_manager.cc:676] Creating new metadata...
0830 07:54:43.638659 (+779762us) tablet_metadata.cc:641] Metadata flushed
0830 07:54:43.921553 (+282894us) tablet_replica.cc:206] Creating consensus instance
0830 07:54:43.921691 (+ 138us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20250830 07:54:43.924800 13754 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 445) took 1067 ms. Trace:
I20250830 07:54:43.926995 13747 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 439) took 1070 ms. Trace:
I20250830 07:54:43.927187 13747 rpcz_store.cc:276] 0830 07:54:42.856456 (+ 0us) service_pool.cc:168] Inserting onto call queue
0830 07:54:43.068017 (+211561us) service_pool.cc:225] Handling call
0830 07:54:43.110660 (+ 42643us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0830 07:54:43.110681 (+ 21us) ts_tablet_manager.cc:676] Creating new metadata...
0830 07:54:43.664124 (+553443us) tablet_metadata.cc:641] Metadata flushed
0830 07:54:43.926854 (+262730us) tablet_replica.cc:206] Creating consensus instance
0830 07:54:43.926963 (+ 109us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20250830 07:54:43.927953 13749 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 437) took 1071 ms. Trace:
I20250830 07:54:43.928099 13749 rpcz_store.cc:276] 0830 07:54:42.856275 (+ 0us) service_pool.cc:168] Inserting onto call queue
0830 07:54:42.938386 (+ 82111us) service_pool.cc:225] Handling call
0830 07:54:43.101859 (+163473us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0830 07:54:43.101896 (+ 37us) ts_tablet_manager.cc:676] Creating new metadata...
0830 07:54:43.346556 (+244660us) tablet_metadata.cc:641] Metadata flushed
0830 07:54:43.927785 (+581229us) tablet_replica.cc:206] Creating consensus instance
0830 07:54:43.927898 (+ 113us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20250830 07:54:43.928610 13754 rpcz_store.cc:276] 0830 07:54:42.857102 (+ 0us) service_pool.cc:168] Inserting onto call queue
0830 07:54:43.330463 (+473361us) service_pool.cc:225] Handling call
0830 07:54:43.333259 (+ 2796us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0830 07:54:43.333280 (+ 21us) ts_tablet_manager.cc:676] Creating new metadata...
0830 07:54:43.654603 (+321323us) tablet_metadata.cc:641] Metadata flushed
0830 07:54:43.924610 (+270007us) tablet_replica.cc:206] Creating consensus instance
0830 07:54:43.924762 (+ 152us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20250830 07:54:43.936004 13887 consensus_queue.cc:260] T 533811110191436d96665b3475ab597f P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:43.937716 13887 ts_tablet_manager.cc:1428] T 533811110191436d96665b3475ab597f P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.188s user 0.002s sys 0.000s
I20250830 07:54:43.939823 13755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d94215b0b1f142178f0b791518d1baf2. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:43.942677 13886 raft_consensus.cc:357] T dbe542c478874482b078296a7a0e9ec9 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:43.942869 13886 raft_consensus.cc:383] T dbe542c478874482b078296a7a0e9ec9 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:43.942968 13886 raft_consensus.cc:738] T dbe542c478874482b078296a7a0e9ec9 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:54:43.943192 13886 consensus_queue.cc:260] T dbe542c478874482b078296a7a0e9ec9 P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:43.943701 13886 ts_tablet_manager.cc:1428] T dbe542c478874482b078296a7a0e9ec9 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.040s user 0.001s sys 0.000s
I20250830 07:54:43.944011 13886 tablet_bootstrap.cc:492] T 99f307a8cbb34addaafab82b3ed18241 P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:54:43.945844 13886 tablet_bootstrap.cc:654] T 99f307a8cbb34addaafab82b3ed18241 P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:43.949280 13751 tablet_service.cc:1515] Processing DeleteTablet for tablet f1fe024f0de048a5a0931ee38752d5a1 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:42 UTC) from {username='slave'} at 127.0.0.1:45460
I20250830 07:54:43.949222 13741 tablet_service.cc:1468] Processing CreateTablet for tablet adbacbbb13d840a29d8d7d08ea04f6b1 (DEFAULT_TABLE table=default.Table_fbed2e93681c42ae83a5a169b6a3fb25 [id=6e2decb9b0f0464e8da6f7e4bc404a52]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:43.949746 13741 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet adbacbbb13d840a29d8d7d08ea04f6b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:43.950302 13887 tablet_bootstrap.cc:492] T 69d6daeb7c774fd48ed296f52ed7c6a6 P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:54:43.952932 13740 tablet_service.cc:1468] Processing CreateTablet for tablet 34199145292d4ddb8c603e5c581f1d15 (DEFAULT_TABLE table=default.Table_9a69fe1a51464ff9bd75cc9902331abf [id=344b9d0cfa1e4ada84a648d6b0c4ab9d]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:43.953312 13740 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34199145292d4ddb8c603e5c581f1d15. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:43.955346 13749 tablet_service.cc:1468] Processing CreateTablet for tablet cd9903bdfaef4139a1a582c54689da4a (DEFAULT_TABLE table=default.Table_dbadc01ffe94447080e199d005d9e87c [id=c5f7d20d95784a619699a6da83965e49]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:43.955731 13749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd9903bdfaef4139a1a582c54689da4a. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:43.955727 13454 tablet_service.cc:1468] Processing CreateTablet for tablet ad7a45187569416bad6c71db9f8ab702 (DEFAULT_TABLE table=default.Table_a0b8d1d1cefc406db62d3d2882feb096 [id=a75583fe901a49158a797a2577b7e5f5]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:43.957998 13450 tablet_service.cc:1515] Processing DeleteTablet for tablet e4ca3110247640fbae4241448e8d5ef7 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:42 UTC) from {username='slave'} at 127.0.0.1:37956
I20250830 07:54:43.960594 13738 tablet_service.cc:1468] Processing CreateTablet for tablet 55bd3f378b854476a24f657f5e23843d (DEFAULT_TABLE table=default.Table_ffed9a8a8cb2455082f2fd5db500bcb2 [id=ee89c0d972a9408cb30b0b97b4bf23ed]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:43.961465 13738 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 55bd3f378b854476a24f657f5e23843d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:43.965409 13740 tablet_service.cc:1468] Processing CreateTablet for tablet 4b9d9d4b65964fd49d8e25092a14d774 (DEFAULT_TABLE table=default.Table_7e8dccc6af2d49159b06563cd36240a7 [id=8e7fbc2351124d2081e7b3bbf3a4c0f6]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:43.965847 13740 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b9d9d4b65964fd49d8e25092a14d774. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:43.968987 13455 tablet_service.cc:1468] Processing CreateTablet for tablet 122bec4220c74dfaa8228f6d153cd50e (DEFAULT_TABLE table=default.Table_b520311338ac432283a508831f98574e [id=77861ebf6e5646c285d6e72dec5a67bc]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:43.971336 13746 tablet_service.cc:1468] Processing CreateTablet for tablet 135d754d83ad422eb05909d2daa19d34 (DEFAULT_TABLE table=default.Table_0b763c9c5ec849f9830f2670d074b17c [id=dc7b513bb4204424b5b292e5751f5fa6]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:43.971704 13746 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 135d754d83ad422eb05909d2daa19d34. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:43.972239 13465 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 63168840534246b59a2fdbfdfeebff47. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:43.915707 13702 service_pool.cc:138] CreateTablet request on kudu.tserver.TabletServerAdminService from 127.0.0.1:45460 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 459)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45460 (request call id 460)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 461)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 462)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 463)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 464)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 465)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 466)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 467)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 468)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 469)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 470)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 471)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 472)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 473)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45460 (request call id 474)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45460 (request call id 475)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45460 (request call id 476)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45460 (request call id 477)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 478)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 479)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 480)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 481)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 482)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 483)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 484)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 485)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 486)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 487)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 488)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 489)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 490)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 491)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 494)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 495)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 496)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 499)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 500)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 501)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 502)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 503)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 504)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 505)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 506)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 507)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 508)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 509)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 510)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 511)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 512)
I20250830 07:54:43.981417 13450 tablet_service.cc:1515] Processing DeleteTablet for tablet 2c31d119743f49589703c434ac6c7548 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:42 UTC) from {username='slave'} at 127.0.0.1:37956
I20250830 07:54:43.981770 13461 tablet_service.cc:1515] Processing DeleteTablet for tablet 2d91b0ba74034b85812a13719e21dc6c with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:42 UTC) from {username='slave'} at 127.0.0.1:37956
I20250830 07:54:43.980966 13590 rpcz_store.cc:276] 0830 07:54:42.776389 (+ 0us) service_pool.cc:168] Inserting onto call queue
0830 07:54:43.156688 (+380299us) service_pool.cc:225] Handling call
0830 07:54:43.174191 (+ 17503us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0830 07:54:43.174214 (+ 23us) ts_tablet_manager.cc:676] Creating new metadata...
0830 07:54:43.737072 (+562858us) tablet_metadata.cc:641] Metadata flushed
0830 07:54:43.856870 (+119798us) tablet_replica.cc:206] Creating consensus instance
0830 07:54:43.857044 (+ 174us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20250830 07:54:43.983095 13609 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d16bc64dd6e43f7ba313b77c2bbb728. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:43.986596 13454 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad7a45187569416bad6c71db9f8ab702. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:43.987833 13450 tablet_service.cc:1468] Processing CreateTablet for tablet 8ee98b748d0245bc8bf9eeac727b495e (DEFAULT_TABLE table=default.Table_b59b0e75bbee4971912072e1174aad74 [id=dadcb9b0dfca4aabbdafef5727a1fc3c]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:43.988888 13461 tablet_service.cc:1468] Processing CreateTablet for tablet e7e9d2e9b1ca4ddfb0c6a7bced613c35 (DEFAULT_TABLE table=default.Table_4c8064376b504b74bea14908e716c0b3 [id=8d8684f2399d4af3b6dab1912ab6c7d6]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:43.989251 13452 tablet_service.cc:1515] Processing DeleteTablet for tablet 65f1ee59e6e9498381d686f16a865e23 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:42 UTC) from {username='slave'} at 127.0.0.1:37956
I20250830 07:54:43.989672 13452 tablet_service.cc:1468] Processing CreateTablet for tablet a3ac09a6d8604297aa8736d1f60484e2 (DEFAULT_TABLE table=default.Table_6113d94cac75499baf2aee4b46a92217 [id=b1c1f115c63b467f879094c549ed8352]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:43.994989 13464 tablet_service.cc:1468] Processing CreateTablet for tablet 76dd9dd481fc427fb20f5091e4a3b738 (DEFAULT_TABLE table=default.Table_d72b020da8b34ec291b8c8dcd8e0d459 [id=1740a0f9c36b44a7ab5b65366950cc95]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:43.996263 13598 tablet_service.cc:1468] Processing CreateTablet for tablet a3ac09a6d8604297aa8736d1f60484e2 (DEFAULT_TABLE table=default.Table_6113d94cac75499baf2aee4b46a92217 [id=b1c1f115c63b467f879094c549ed8352]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:43.997036 13887 tablet_bootstrap.cc:654] T 69d6daeb7c774fd48ed296f52ed7c6a6 P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:43.998839 13593 tablet_service.cc:1468] Processing CreateTablet for tablet 7e9d6af1d7fc4d4b961583b44f2f962a (DEFAULT_TABLE table=default.Table_a7d9a21ec2e74f30a2ce61cdcdd33685 [id=957201242ea748618cc610a5002a8684]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:44.006695 13484 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "b38c8d003413428dae9e47f58e197c2c" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:54:44.007053 13482 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "7af74bdde363493f8061eba450ecf4b4" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba"
I20250830 07:54:44.007485 13482 raft_consensus.cc:2391] T 7af74bdde363493f8061eba450ecf4b4 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b5e454d98894637b466ea27f1b647f9 in current term 1: Already voted for candidate 2065c332f15a4739899af79f3669c3ba in this term.
I20250830 07:54:44.012624 13590 tablet_service.cc:1468] Processing CreateTablet for tablet 76dd9dd481fc427fb20f5091e4a3b738 (DEFAULT_TABLE table=default.Table_d72b020da8b34ec291b8c8dcd8e0d459 [id=1740a0f9c36b44a7ab5b65366950cc95]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:44.015370 13594 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3bca390f6d4343cba7a9fb07f0d4d72b. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:44.017195 14758 raft_consensus.cc:491] T cb3c48982add45379c0e1b117ec40c1a P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:44.017331 14758 raft_consensus.cc:513] T cb3c48982add45379c0e1b117ec40c1a P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:44.017715 13482 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "853503f3f98a49219b077af980180400" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:54:44.017946 14758 leader_election.cc:290] T cb3c48982add45379c0e1b117ec40c1a P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
W20250830 07:54:44.021070 13218 catalog_manager.cc:4908] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): delete failed for tablet e4ca3110247640fbae4241448e8d5ef7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e4ca3110247640fbae4241448e8d5ef7 already in progress: creating tablet
W20250830 07:54:44.022104 13218 catalog_manager.cc:4908] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): delete failed for tablet 2c31d119743f49589703c434ac6c7548 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2c31d119743f49589703c434ac6c7548 already in progress: creating tablet
W20250830 07:54:44.022526 13218 catalog_manager.cc:4895] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): delete failed for tablet 2d91b0ba74034b85812a13719e21dc6c because the tablet was not found. No further retry: Not found: Tablet not found: 2d91b0ba74034b85812a13719e21dc6c
W20250830 07:54:44.023141 13218 catalog_manager.cc:4908] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): delete failed for tablet 65f1ee59e6e9498381d686f16a865e23 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 65f1ee59e6e9498381d686f16a865e23 already in progress: creating tablet
I20250830 07:54:44.026830 13449 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6717031830f4c57967e87ce077ddb21. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:44.027637 13455 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 122bec4220c74dfaa8228f6d153cd50e. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:44.028601 13461 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7e9d2e9b1ca4ddfb0c6a7bced613c35. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:44.029842 13452 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a3ac09a6d8604297aa8736d1f60484e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:44.030671 13450 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ee98b748d0245bc8bf9eeac727b495e. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:44.031639 13464 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 76dd9dd481fc427fb20f5091e4a3b738. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:44.035415 13601 tablet_service.cc:1468] Processing CreateTablet for tablet f192693039a24e3cb0bec646c8d11056 (DEFAULT_TABLE table=default.Table_98722818dc7c4e3284220440947a4cbf [id=9eba8c5b208640b69c94f332fdc4e56e]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:44.036026 13606 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 458) took 1012 ms. Trace:
I20250830 07:54:44.036177 13596 tablet_service.cc:1468] Processing CreateTablet for tablet 0f34ed0fe6e9400fae5c0edebb615ebd (DEFAULT_TABLE table=default.Table_153646ff157d493ba4c4f4ec4368cc52 [id=ffff902660804d0f9f4b0bcd5053cb72]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:44.038726 13456 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 468) took 1048 ms. Trace:
I20250830 07:54:44.039834 13606 rpcz_store.cc:276] 0830 07:54:43.000657 (+ 0us) service_pool.cc:168] Inserting onto call queue
0830 07:54:43.257340 (+256683us) service_pool.cc:225] Handling call
0830 07:54:43.405219 (+147879us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0830 07:54:43.405243 (+ 24us) ts_tablet_manager.cc:676] Creating new metadata...
0830 07:54:43.761432 (+356189us) tablet_metadata.cc:641] Metadata flushed
0830 07:54:44.013111 (+251679us) tablet_replica.cc:206] Creating consensus instance
0830 07:54:44.013236 (+ 125us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20250830 07:54:44.039929 14763 raft_consensus.cc:491] T 00000000000000000000000000000000 P fea6152429cc4e79a25b18e02aafae57 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5e9d6449ae824acab24c459a72075e88)
I20250830 07:54:44.040202 14763 raft_consensus.cc:513] T 00000000000000000000000000000000 P fea6152429cc4e79a25b18e02aafae57 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fea6152429cc4e79a25b18e02aafae57" member_type: VOTER last_known_addr { host: "127.12.209.62" port: 39725 } } peers { permanent_uuid: "5e9d6449ae824acab24c459a72075e88" member_type: VOTER last_known_addr { host: "127.12.209.61" port: 44241 } } peers { permanent_uuid: "3ea183a890b84f408b20b55e9eb7c7ed" member_type: VOTER last_known_addr { host: "127.12.209.60" port: 43889 } }
I20250830 07:54:44.039331 13605 tablet_service.cc:1468] Processing CreateTablet for tablet 283aa82b808e49528ceb19133748ffc8 (DEFAULT_TABLE table=default.Table_99d5f73171164be2bacb3d06d32875b6 [id=0e9e08a5b9354c8da540f1e0e8cc6733]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:44.041594 14763 leader_election.cc:290] T 00000000000000000000000000000000 P fea6152429cc4e79a25b18e02aafae57 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5e9d6449ae824acab24c459a72075e88 (127.12.209.61:44241), 3ea183a890b84f408b20b55e9eb7c7ed (127.12.209.60:43889)
I20250830 07:54:44.041781 13606 tablet_service.cc:1468] Processing CreateTablet for tablet 508d21af038c4801a9680ce275eb504c (DEFAULT_TABLE table=default.Table_87c4d4c8f9434a7887c620edd83eebaf [id=d1d894519e174e219cb1bd20b8b4504c]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:44.041885 13244 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "fea6152429cc4e79a25b18e02aafae57" candidate_term: 3 candidate_status { last_received { term: 2 index: 989 } } ignore_live_leader: false dest_uuid: "5e9d6449ae824acab24c459a72075e88" is_pre_election: true
I20250830 07:54:44.043247 13598 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a3ac09a6d8604297aa8736d1f60484e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:44.049047 13595 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 467) took 1024 ms. Trace:
I20250830 07:54:44.049580 13595 rpcz_store.cc:276] 0830 07:54:43.024471 (+ 0us) service_pool.cc:168] Inserting onto call queue
0830 07:54:43.327328 (+302857us) service_pool.cc:225] Handling call
0830 07:54:43.327721 (+ 393us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0830 07:54:43.327745 (+ 24us) ts_tablet_manager.cc:676] Creating new metadata...
0830 07:54:43.758964 (+431219us) tablet_metadata.cc:641] Metadata flushed
0830 07:54:44.048879 (+289915us) tablet_replica.cc:206] Creating consensus instance
0830 07:54:44.049011 (+ 132us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20250830 07:54:44.050020 13595 tablet_service.cc:1468] Processing CreateTablet for tablet b678fd915c534a2dac8521c21ab93396 (DEFAULT_TABLE table=default.Table_1c93edc0678341fea10a950688a68c08 [id=b966d9c7fdf5493e9c0d825ac703fb28]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:44.053784 13590 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 76dd9dd481fc427fb20f5091e4a3b738. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:44.065577 13605 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 283aa82b808e49528ceb19133748ffc8. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:44.068112 13230 catalog_manager.cc:5864] Not sending DeleteTablet requests; no consensus state for tablet 17474d3010e844f39f51382314e602e1
I20250830 07:54:44.072651 13596 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f34ed0fe6e9400fae5c0edebb615ebd. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:44.073745 13603 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 463) took 1048 ms. Trace:
I20250830 07:54:44.073841 13603 rpcz_store.cc:276] 0830 07:54:43.024057 (+ 0us) service_pool.cc:168] Inserting onto call queue
0830 07:54:43.319003 (+294946us) service_pool.cc:225] Handling call
0830 07:54:43.319428 (+ 425us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0830 07:54:43.319450 (+ 22us) ts_tablet_manager.cc:676] Creating new metadata...
0830 07:54:43.870241 (+550791us) tablet_metadata.cc:641] Metadata flushed
0830 07:54:44.057413 (+187172us) tablet_replica.cc:206] Creating consensus instance
0830 07:54:44.072125 (+ 14712us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20250830 07:54:44.075006 13603 tablet_service.cc:1468] Processing CreateTablet for tablet e24d68b8f5ba4df59a9aeec8ebd6403d (DEFAULT_TABLE table=default.Table_c8928475736a40768e1ad90aed18fa32 [id=390d0083d26c4c39b58622c2cd50365e]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:44.081607 13456 rpcz_store.cc:276] 0830 07:54:42.989910 (+ 0us) service_pool.cc:168] Inserting onto call queue
0830 07:54:43.735785 (+745875us) service_pool.cc:225] Handling call
0830 07:54:43.742532 (+ 6747us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0830 07:54:43.742560 (+ 28us) ts_tablet_manager.cc:676] Creating new metadata...
0830 07:54:43.960118 (+217558us) tablet_metadata.cc:641] Metadata flushed
0830 07:54:44.038535 (+ 78417us) tablet_replica.cc:206] Creating consensus instance
0830 07:54:44.038675 (+ 140us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20250830 07:54:44.081755 13608 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 480) took 1048 ms. Trace:
I20250830 07:54:44.081846 13608 rpcz_store.cc:276] 0830 07:54:43.033327 (+ 0us) service_pool.cc:168] Inserting onto call queue
0830 07:54:43.793456 (+760129us) service_pool.cc:225] Handling call
0830 07:54:43.793937 (+ 481us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0830 07:54:43.793958 (+ 21us) ts_tablet_manager.cc:676] Creating new metadata...
0830 07:54:44.079361 (+285403us) tablet_metadata.cc:641] Metadata flushed
0830 07:54:44.081600 (+ 2239us) tablet_replica.cc:206] Creating consensus instance
0830 07:54:44.081709 (+ 109us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20250830 07:54:44.082211 13608 tablet_service.cc:1468] Processing CreateTablet for tablet 986878a23a0b47ee865e09277b027bb0 (DEFAULT_TABLE table=default.Table_06f5b3c7c1d64d37b8f57cd4c75a3074 [id=e3c7fb8fde774dfe863e3ca5f792b119]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:44.083976 13458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 471) took 1044 ms. Trace:
I20250830 07:54:44.091784 13606 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 508d21af038c4801a9680ce275eb504c. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:44.093101 13458 rpcz_store.cc:276] 0830 07:54:43.039906 (+ 0us) service_pool.cc:168] Inserting onto call queue
0830 07:54:43.828888 (+788982us) service_pool.cc:225] Handling call
0830 07:54:43.880336 (+ 51448us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0830 07:54:43.880358 (+ 22us) ts_tablet_manager.cc:676] Creating new metadata...
0830 07:54:44.057244 (+176886us) tablet_metadata.cc:641] Metadata flushed
0830 07:54:44.083801 (+ 26557us) tablet_replica.cc:206] Creating consensus instance
0830 07:54:44.083930 (+ 129us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20250830 07:54:44.093834 13458 tablet_service.cc:1468] Processing CreateTablet for tablet 0f34ed0fe6e9400fae5c0edebb615ebd (DEFAULT_TABLE table=default.Table_153646ff157d493ba4c4f4ec4368cc52 [id=ffff902660804d0f9f4b0bcd5053cb72]), partition=RANGE (key) PARTITION UNBOUNDED
W20250830 07:54:44.094764 13562 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.209.3:38743, user_credentials={real_user=slave}} blocked reactor thread for 417953us
I20250830 07:54:44.095448 13602 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 471) took 1062 ms. Trace:
W20250830 07:54:44.096311 13220 catalog_manager.cc:4908] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet e4ca3110247640fbae4241448e8d5ef7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e4ca3110247640fbae4241448e8d5ef7 already in progress: creating tablet
W20250830 07:54:44.096707 13220 catalog_manager.cc:4908] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet 2c31d119743f49589703c434ac6c7548 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2c31d119743f49589703c434ac6c7548 already in progress: creating tablet
W20250830 07:54:44.097091 13220 catalog_manager.cc:4908] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet 65f1ee59e6e9498381d686f16a865e23 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 65f1ee59e6e9498381d686f16a865e23 already in progress: creating tablet
W20250830 07:54:44.097673 13220 catalog_manager.cc:4895] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet 2d91b0ba74034b85812a13719e21dc6c because the tablet was not found. No further retry: Not found: Tablet not found: 2d91b0ba74034b85812a13719e21dc6c
I20250830 07:54:44.098982 13458 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f34ed0fe6e9400fae5c0edebb615ebd. 1 dirs total, 0 dirs full, 0 dirs failed
W20250830 07:54:44.103673 13225 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 2e63eac2579844ef83bf43f1e6d58634 consensus state has no leader
I20250830 07:54:44.104810 13227 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet 23d2c7013c9c4b4aacf47e6ac7ab5a0b
I20250830 07:54:44.105531 13601 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f192693039a24e3cb0bec646c8d11056. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:44.111301 13604 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 478) took 1061 ms. Trace:
I20250830 07:54:44.070197 13453 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 467) took 1080 ms. Trace:
I20250830 07:54:44.073104 13459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 470) took 1047 ms. Trace:
I20250830 07:54:44.081455 13462 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 466) took 1091 ms. Trace:
I20250830 07:54:44.084175 13455 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 477) took 1043 ms. Trace:
I20250830 07:54:44.112063 13590 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 481) took 1054 ms. Trace:
I20250830 07:54:44.112043 13602 rpcz_store.cc:276] 0830 07:54:43.032523 (+ 0us) service_pool.cc:168] Inserting onto call queue
0830 07:54:43.561244 (+528721us) service_pool.cc:225] Handling call
0830 07:54:43.561981 (+ 737us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0830 07:54:43.681324 (+119343us) ts_tablet_manager.cc:676] Creating new metadata...
0830 07:54:44.015141 (+333817us) tablet_metadata.cc:641] Metadata flushed
0830 07:54:44.095314 (+ 80173us) tablet_replica.cc:206] Creating consensus instance
0830 07:54:44.095411 (+ 97us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20250830 07:54:44.084713 13456 tablet_service.cc:1468] Processing CreateTablet for tablet 7e9d6af1d7fc4d4b961583b44f2f962a (DEFAULT_TABLE table=default.Table_a7d9a21ec2e74f30a2ce61cdcdd33685 [id=957201242ea748618cc610a5002a8684]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:44.086010 13467 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 465) took 1096 ms. Trace:
I20250830 07:54:44.086979 13457 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 457) took 1101 ms. Trace:
I20250830 07:54:44.092919 13460 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 458) took 1107 ms. Trace:
I20250830 07:54:44.050197 13463 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 448) took 1065 ms. Trace:
I20250830 07:54:44.062234 13466 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 464) took 1072 ms. Trace:
I20250830 07:54:44.044190 13451 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 469) took 1054 ms. Trace:
I20250830 07:54:44.064399 13468 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 456) took 1079 ms. Trace:
I20250830 07:54:44.112600 13602 tablet_service.cc:1468] Processing CreateTablet for tablet 6fb5cd3618584dd3a0ee43a10f7a2660 (DEFAULT_TABLE table=default.Table_7abf2e48a940411181ec19ecfe22ce3f [id=fb22b8356fa341be882cccb6467e2135]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:44.112145 13590 rpcz_store.cc:276] 0830 07:54:43.033411 (+ 0us) service_pool.cc:168] Inserting onto call queue
0830 07:54:43.991565 (+958154us) service_pool.cc:225] Handling call
0830 07:54:44.034955 (+ 43390us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0830 07:54:44.034985 (+ 30us) ts_tablet_manager.cc:676] Creating new metadata...
0830 07:54:44.084360 (+ 49375us) tablet_metadata.cc:641] Metadata flushed
0830 07:54:44.087652 (+ 3292us) tablet_replica.cc:206] Creating consensus instance
0830 07:54:44.087764 (+ 112us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20250830 07:54:44.111975 13604 rpcz_store.cc:276] 0830 07:54:43.033151 (+ 0us) service_pool.cc:168] Inserting onto call queue
0830 07:54:43.761625 (+728474us) service_pool.cc:225] Handling call
0830 07:54:43.768376 (+ 6751us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0830 07:54:43.768399 (+ 23us) ts_tablet_manager.cc:676] Creating new metadata...
0830 07:54:44.009857 (+241458us) tablet_metadata.cc:641] Metadata flushed
0830 07:54:44.094342 (+ 84485us) tablet_replica.cc:206] Creating consensus instance
0830 07:54:44.094447 (+ 105us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20250830 07:54:44.113667 13462 rpcz_store.cc:276] 0830 07:54:42.989643 (+ 0us) service_pool.cc:168] Inserting onto call queue
0830 07:54:43.684338 (+694695us) service_pool.cc:225] Handling call
0830 07:54:43.720995 (+ 36657us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0830 07:54:43.721039 (+ 44us) ts_tablet_manager.cc:676] Creating new metadata...
0830 07:54:43.972683 (+251644us) tablet_metadata.cc:641] Metadata flushed
0830 07:54:44.081243 (+108560us) tablet_replica.cc:206] Creating consensus instance
0830 07:54:44.081389 (+ 146us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20250830 07:54:44.114235 13456 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e9d6af1d7fc4d4b961583b44f2f962a. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:44.117107 13226 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet db7144b25ff34bed8c7b779ba9497ef4
I20250830 07:54:44.117372 13595 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b678fd915c534a2dac8521c21ab93396. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:44.118306 13231 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet 0c32e597f17e4e75a0f584b6b7b02c36
I20250830 07:54:44.118450 13466 rpcz_store.cc:276] 0830 07:54:42.989425 (+ 0us) service_pool.cc:168] Inserting onto call queue
0830 07:54:43.598813 (+609388us) service_pool.cc:225] Handling call
0830 07:54:43.612503 (+ 13690us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0830 07:54:43.612748 (+ 245us) ts_tablet_manager.cc:676] Creating new metadata...
0830 07:54:43.980453 (+367705us) tablet_metadata.cc:641] Metadata flushed
0830 07:54:44.062027 (+ 81574us) tablet_replica.cc:206] Creating consensus instance
0830 07:54:44.062167 (+ 140us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20250830 07:54:44.118916 13463 rpcz_store.cc:276] 0830 07:54:42.984397 (+ 0us) service_pool.cc:168] Inserting onto call queue
0830 07:54:43.339764 (+355367us) service_pool.cc:225] Handling call
0830 07:54:43.398623 (+ 58859us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0830 07:54:43.398643 (+ 20us) ts_tablet_manager.cc:676] Creating new metadata...
0830 07:54:43.978443 (+579800us) tablet_metadata.cc:641] Metadata flushed
0830 07:54:44.050046 (+ 71603us) tablet_replica.cc:206] Creating consensus instance
0830 07:54:44.050151 (+ 105us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20250830 07:54:44.119509 13451 rpcz_store.cc:276] 0830 07:54:42.990006 (+ 0us) service_pool.cc:168] Inserting onto call queue
0830 07:54:43.739887 (+749881us) service_pool.cc:225] Handling call
0830 07:54:43.743089 (+ 3202us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0830 07:54:43.743117 (+ 28us) ts_tablet_manager.cc:676] Creating new metadata...
0830 07:54:44.040259 (+297142us) tablet_metadata.cc:641] Metadata flushed
0830 07:54:44.043911 (+ 3652us) tablet_replica.cc:206] Creating consensus instance
0830 07:54:44.044118 (+ 207us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20250830 07:54:44.120520 13604 tablet_service.cc:1468] Processing CreateTablet for tablet 370441c443be46c2a33132fbc5c41f89 (DEFAULT_TABLE table=default.Table_f21862e4d3614f3599c1f8c6b3a0d624 [id=5a0934cf98934953bdf1cd9b5abf2192]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:44.123253 13453 rpcz_store.cc:276] 0830 07:54:42.989762 (+ 0us) service_pool.cc:168] Inserting onto call queue
0830 07:54:43.727141 (+737379us) service_pool.cc:225] Handling call
0830 07:54:43.742042 (+ 14901us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0830 07:54:43.742076 (+ 34us) ts_tablet_manager.cc:676] Creating new metadata...
0830 07:54:44.067310 (+325234us) tablet_metadata.cc:641] Metadata flushed
0830 07:54:44.069999 (+ 2689us) tablet_replica.cc:206] Creating consensus instance
0830 07:54:44.070135 (+ 136us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20250830 07:54:44.126969 13603 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e24d68b8f5ba4df59a9aeec8ebd6403d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:44.128638 13454 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 472) took 1088 ms. Trace:
I20250830 07:54:44.128835 13590 tablet_service.cc:1468] Processing CreateTablet for tablet 4df6d481baab40e2b2c1309d1a8c5351 (DEFAULT_TABLE table=default.Table_ed76689fb0754162aa9b23002b8d6013 [id=34800e0b41c14e6db8e310f0d414c59b]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:44.131352 13600 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 472) took 1087 ms. Trace:
I20250830 07:54:44.131357 13234 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_b209e8dbb7be40408440ef087e11bbd4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250830 07:54:44.131795 13593 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e9d6af1d7fc4d4b961583b44f2f962a. 1 dirs total, 0 dirs full, 0 dirs failed
W20250830 07:54:44.131908 13228 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ed364f03bdad42b88e181b7d0e1e4011 consensus state has no leader
I20250830 07:54:44.132300 13228 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_d07e338c217149ec81b084cb18a19650"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:44.132802 13228 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d07e338c217149ec81b084cb18a19650 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250830 07:54:44.133481 13225 catalog_manager.cc:5415] Ignoring report from unknown tablet 04c9d954106a4417a34ff80bc98e2ce8
W20250830 07:54:44.133553 13225 catalog_manager.cc:5415] Ignoring report from unknown tablet cb3c48982add45379c0e1b117ec40c1a
W20250830 07:54:44.133618 13225 catalog_manager.cc:5415] Ignoring report from unknown tablet e862fa77e16945bd94e405aa3474f021
I20250830 07:54:44.134043 13225 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_22efde9aeb06437dbc97066b9c9cbddf"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250830 07:54:44.134083 13600 rpcz_store.cc:276] 0830 07:54:43.032611 (+ 0us) service_pool.cc:168] Inserting onto call queue
0830 07:54:43.743039 (+710428us) service_pool.cc:225] Handling call
0830 07:54:43.743543 (+ 504us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0830 07:54:43.743564 (+ 21us) ts_tablet_manager.cc:676] Creating new metadata...
0830 07:54:44.022364 (+278800us) tablet_metadata.cc:641] Metadata flushed
0830 07:54:44.118738 (+ 96374us) tablet_replica.cc:206] Creating consensus instance
0830 07:54:44.120381 (+ 1643us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20250830 07:54:44.134106 13233 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_a99c09edb9f7481a8eb146367454eece" } new_table_name: "default.Table_a3e896cc4e73408889eef5912ca3a88b" modify_external_catalogs: true
I20250830 07:54:44.134268 13232 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_b520311338ac432283a508831f98574e" } new_table_name: "default.Table_e359f3fbb38e496e92cff1e88815b083" modify_external_catalogs: true
W20250830 07:54:44.134527 13225 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_22efde9aeb06437dbc97066b9c9cbddf in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250830 07:54:44.131908 13234 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b209e8dbb7be40408440ef087e11bbd4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250830 07:54:44.136793 13230 catalog_manager.cc:5415] Ignoring report from unknown tablet 6dda55ec2da34c8aba9f39a63e144a7c
W20250830 07:54:44.136868 13230 catalog_manager.cc:5415] Ignoring report from unknown tablet 30c2558c28944ff39d1a4a4ca9ac604e
W20250830 07:54:44.136933 13230 catalog_manager.cc:5415] Ignoring report from unknown tablet d1ae3812d72b419798736328da64b53c
W20250830 07:54:44.136981 13230 catalog_manager.cc:5415] Ignoring report from unknown tablet 04c9d954106a4417a34ff80bc98e2ce8
I20250830 07:54:44.137411 13230 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_25b24b8e1e304d03b728de795c0f63a8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250830 07:54:44.129287 13459 rpcz_store.cc:276] 0830 07:54:43.039761 (+ 0us) service_pool.cc:168] Inserting onto call queue
0830 07:54:43.781820 (+742059us) service_pool.cc:225] Handling call
0830 07:54:43.878262 (+ 96442us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0830 07:54:43.878298 (+ 36us) ts_tablet_manager.cc:676] Creating new metadata...
0830 07:54:43.971057 (+ 92759us) tablet_metadata.cc:641] Metadata flushed
0830 07:54:44.072891 (+101834us) tablet_replica.cc:206] Creating consensus instance
0830 07:54:44.073055 (+ 164us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20250830 07:54:44.137876 13230 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_25b24b8e1e304d03b728de795c0f63a8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:44.138055 13459 tablet_service.cc:1468] Processing CreateTablet for tablet 986878a23a0b47ee865e09277b027bb0 (DEFAULT_TABLE table=default.Table_06f5b3c7c1d64d37b8f57cd4c75a3074 [id=e3c7fb8fde774dfe863e3ca5f792b119]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:44.138432 13459 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 986878a23a0b47ee865e09277b027bb0. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:44.138899 13597 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 479) took 1105 ms. Trace:
I20250830 07:54:44.139051 13227 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_4184c9e2d90c4ecfb3b3199ce5517ba5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:44.139484 13227 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4184c9e2d90c4ecfb3b3199ce5517ba5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:44.129426 13461 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 479) took 1069 ms. Trace:
I20250830 07:54:44.140142 13461 rpcz_store.cc:276] 0830 07:54:43.040508 (+ 0us) service_pool.cc:168] Inserting onto call queue
0830 07:54:43.981902 (+941394us) service_pool.cc:225] Handling call
0830 07:54:43.989059 (+ 7157us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0830 07:54:43.989080 (+ 21us) ts_tablet_manager.cc:676] Creating new metadata...
0830 07:54:44.087094 (+ 98014us) tablet_metadata.cc:641] Metadata flushed
0830 07:54:44.110254 (+ 23160us) tablet_replica.cc:206] Creating consensus instance
0830 07:54:44.110367 (+ 113us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20250830 07:54:44.140529 13604 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 370441c443be46c2a33132fbc5c41f89. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:44.140514 13461 tablet_service.cc:1468] Processing CreateTablet for tablet 6fb5cd3618584dd3a0ee43a10f7a2660 (DEFAULT_TABLE table=default.Table_7abf2e48a940411181ec19ecfe22ce3f [id=fb22b8356fa341be882cccb6467e2135]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:44.140852 13461 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6fb5cd3618584dd3a0ee43a10f7a2660. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:44.140802 13231 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_b19e6f39256d44a697ead8d4386d6899"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:44.141371 13231 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b19e6f39256d44a697ead8d4386d6899 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:44.142418 13226 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_10d018ad6a2449c8b777834b7fd2ec40" } new_table_name: "default.Table_c08e2c34885940b5aec6ab02c4f3edf6" modify_external_catalogs: true
I20250830 07:54:44.129525 13455 rpcz_store.cc:276] 0830 07:54:43.040331 (+ 0us) service_pool.cc:168] Inserting onto call queue
0830 07:54:43.968789 (+928458us) service_pool.cc:225] Handling call
0830 07:54:43.969170 (+ 381us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0830 07:54:43.969190 (+ 20us) ts_tablet_manager.cc:676] Creating new metadata...
0830 07:54:44.081542 (+112352us) tablet_metadata.cc:641] Metadata flushed
0830 07:54:44.084011 (+ 2469us) tablet_replica.cc:206] Creating consensus instance
0830 07:54:44.084145 (+ 134us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20250830 07:54:44.143282 13455 tablet_service.cc:1468] Processing CreateTablet for tablet fac764a2d269411c86b85ceeaec0b014 (DEFAULT_TABLE table=default.Table_d2e35b9bab8b4f559b34fe632e69f973 [id=79ead01cb7c54bba8701da6c74224b2b]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:44.143652 13455 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fac764a2d269411c86b85ceeaec0b014. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:44.129791 13457 rpcz_store.cc:276] 0830 07:54:42.985336 (+ 0us) service_pool.cc:168] Inserting onto call queue
0830 07:54:43.446146 (+460810us) service_pool.cc:225] Handling call
0830 07:54:43.446671 (+ 525us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0830 07:54:43.446692 (+ 21us) ts_tablet_manager.cc:676] Creating new metadata...
0830 07:54:44.046352 (+599660us) tablet_metadata.cc:641] Metadata flushed
0830 07:54:44.086794 (+ 40442us) tablet_replica.cc:206] Creating consensus instance
0830 07:54:44.086937 (+ 143us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20250830 07:54:44.145859 13457 tablet_service.cc:1468] Processing CreateTablet for tablet a5eea1950d1945f1b755fd34597b2fb4 (DEFAULT_TABLE table=default.Table_3fc8320fad174384a19616004d3b6e4e [id=965e15b7139f4b7aa3653373dbbea5e0]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:44.146314 13457 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a5eea1950d1945f1b755fd34597b2fb4. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:44.129918 13460 rpcz_store.cc:276] 0830 07:54:42.985441 (+ 0us) service_pool.cc:168] Inserting onto call queue
0830 07:54:43.489726 (+504285us) service_pool.cc:225] Handling call
0830 07:54:43.500082 (+ 10356us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0830 07:54:43.500111 (+ 29us) ts_tablet_manager.cc:676] Creating new metadata...
0830 07:54:43.892424 (+392313us) tablet_metadata.cc:641] Metadata flushed
0830 07:54:44.092766 (+200342us) tablet_replica.cc:206] Creating consensus instance
0830 07:54:44.092885 (+ 119us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20250830 07:54:44.148806 13460 tablet_service.cc:1468] Processing CreateTablet for tablet 690cf258639a4c1ea5a0ac4f2fd39f88 (DEFAULT_TABLE table=default.Table_523d7bc660f94c9db577f499e22c772f [id=3582c72cab4b4e1084021b098ec30f87]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:44.149369 13460 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 690cf258639a4c1ea5a0ac4f2fd39f88. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:44.151360 13599 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 473) took 1111 ms. Trace:
I20250830 07:54:44.151521 13599 rpcz_store.cc:276] 0830 07:54:43.032713 (+ 0us) service_pool.cc:168] Inserting onto call queue
0830 07:54:43.752162 (+719449us) service_pool.cc:225] Handling call
0830 07:54:43.754567 (+ 2405us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0830 07:54:43.754596 (+ 29us) ts_tablet_manager.cc:676] Creating new metadata...
0830 07:54:44.052129 (+297533us) tablet_metadata.cc:641] Metadata flushed
0830 07:54:44.143548 (+ 91419us) tablet_replica.cc:206] Creating consensus instance
0830 07:54:44.143716 (+ 168us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20250830 07:54:44.153313 13591 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 435) took 1391 ms. Trace:
I20250830 07:54:44.153451 13591 rpcz_store.cc:276] 0830 07:54:42.757234 (+ 0us) service_pool.cc:168] Inserting onto call queue
0830 07:54:43.038595 (+281361us) service_pool.cc:225] Handling call
0830 07:54:43.176329 (+137734us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0830 07:54:43.176349 (+ 20us) ts_tablet_manager.cc:676] Creating new metadata...
0830 07:54:44.069266 (+892917us) tablet_metadata.cc:641] Metadata flushed
0830 07:54:44.148050 (+ 78784us) tablet_replica.cc:206] Creating consensus instance
0830 07:54:44.148177 (+ 127us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20250830 07:54:44.130053 13468 rpcz_store.cc:276] 0830 07:54:42.985222 (+ 0us) service_pool.cc:168] Inserting onto call queue
0830 07:54:43.442407 (+457185us) service_pool.cc:225] Handling call
0830 07:54:43.442879 (+ 472us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0830 07:54:43.444283 (+ 1404us) ts_tablet_manager.cc:676] Creating new metadata...
0830 07:54:43.945568 (+501285us) tablet_metadata.cc:641] Metadata flushed
0830 07:54:44.064255 (+118687us) tablet_replica.cc:206] Creating consensus instance
0830 07:54:44.064372 (+ 117us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20250830 07:54:44.154197 13597 rpcz_store.cc:276] 0830 07:54:43.033222 (+ 0us) service_pool.cc:168] Inserting onto call queue
0830 07:54:43.772166 (+738944us) service_pool.cc:225] Handling call
0830 07:54:43.786742 (+ 14576us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0830 07:54:43.786773 (+ 31us) ts_tablet_manager.cc:676] Creating new metadata...
0830 07:54:44.070353 (+283580us) tablet_metadata.cc:641] Metadata flushed
0830 07:54:44.138701 (+ 68348us) tablet_replica.cc:206] Creating consensus instance
0830 07:54:44.138853 (+ 152us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20250830 07:54:44.154259 13468 tablet_service.cc:1468] Processing CreateTablet for tablet 838616d8274648fc9ea4f1583bdb97f9 (DEFAULT_TABLE table=default.Table_5b1f6f284dc946afa2daaea18a0164e2 [id=447ff69ae6a14f93b768dd1357195a84]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:44.154548 13468 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 838616d8274648fc9ea4f1583bdb97f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:44.154800 13229 catalog_manager.cc:5864] Not sending DeleteTablet requests; no consensus state for tablet 9148ce0624ab4a3f806b99bbe0cdc96f
I20250830 07:54:44.155865 13602 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6fb5cd3618584dd3a0ee43a10f7a2660. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:44.160197 13592 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 464) took 1133 ms. Trace:
I20250830 07:54:44.160480 13592 rpcz_store.cc:276] 0830 07:54:43.024166 (+ 0us) service_pool.cc:168] Inserting onto call queue
0830 07:54:43.321604 (+297438us) service_pool.cc:225] Handling call
0830 07:54:43.322040 (+ 436us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0830 07:54:43.322065 (+ 25us) ts_tablet_manager.cc:676] Creating new metadata...
0830 07:54:44.067836 (+745771us) tablet_metadata.cc:641] Metadata flushed
0830 07:54:44.157959 (+ 90123us) tablet_replica.cc:206] Creating consensus instance
0830 07:54:44.158082 (+ 123us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":2505}
I20250830 07:54:44.130170 13462 tablet_service.cc:1468] Processing CreateTablet for tablet c6355878115a4907ae1f0a45fb2c6492 (DEFAULT_TABLE table=default.Table_844cfa31981f4db594c87b260d390b06 [id=346b4d93dd41412aa8f8a2c74fff72e9]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:44.162515 13462 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c6355878115a4907ae1f0a45fb2c6492. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:44.163825 13607 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 460) took 1158 ms. Trace:
I20250830 07:54:44.130316 13466 tablet_service.cc:1468] Processing CreateTablet for tablet bac72b4ba9ba4ca69f93e799dccb0e93 (DEFAULT_TABLE table=default.Table_6b7fef7c0eba4cd5b26659f55457349d [id=e39f1c24862b4b0b9ac3104df120461b]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:44.164907 13466 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bac72b4ba9ba4ca69f93e799dccb0e93. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:44.166297 13607 rpcz_store.cc:276] 0830 07:54:43.000842 (+ 0us) service_pool.cc:168] Inserting onto call queue
0830 07:54:43.294230 (+293388us) service_pool.cc:225] Handling call
0830 07:54:43.294679 (+ 449us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0830 07:54:43.294712 (+ 33us) ts_tablet_manager.cc:676] Creating new metadata...
0830 07:54:44.064571 (+769859us) tablet_metadata.cc:641] Metadata flushed
0830 07:54:44.158784 (+ 94213us) tablet_replica.cc:206] Creating consensus instance
0830 07:54:44.158913 (+ 129us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":2455}
I20250830 07:54:44.130499 13463 tablet_service.cc:1468] Processing CreateTablet for tablet f192693039a24e3cb0bec646c8d11056 (DEFAULT_TABLE table=default.Table_98722818dc7c4e3284220440947a4cbf [id=9eba8c5b208640b69c94f332fdc4e56e]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:44.168126 13463 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f192693039a24e3cb0bec646c8d11056. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:44.168514 13590 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4df6d481baab40e2b2c1309d1a8c5351. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:44.170667 13588 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.ListTablets from 127.0.0.1:45302 (request call id 135) took 1184 ms. Trace:
I20250830 07:54:44.130767 13451 tablet_service.cc:1468] Processing CreateTablet for tablet 283aa82b808e49528ceb19133748ffc8 (DEFAULT_TABLE table=default.Table_99d5f73171164be2bacb3d06d32875b6 [id=0e9e08a5b9354c8da540f1e0e8cc6733]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:44.172312 13451 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 283aa82b808e49528ceb19133748ffc8. 1 dirs total, 0 dirs full, 0 dirs failed
W20250830 07:54:44.176782 13562 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.209.3:38743, user_credentials={real_user=slave}} blocked reactor thread for 57053.7us
I20250830 07:54:44.177423 13628 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "99f307a8cbb34addaafab82b3ed18241" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:44.181180 13599 tablet_service.cc:1468] Processing CreateTablet for tablet dad2dfa1a19d45778933780b1029d924 (DEFAULT_TABLE table=default.Table_fdf6b173da034defb96d857c29760d5e [id=057b3ca5735944209509cf2d47ae25fa]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:44.131541 13453 tablet_service.cc:1468] Processing CreateTablet for tablet 508d21af038c4801a9680ce275eb504c (DEFAULT_TABLE table=default.Table_87c4d4c8f9434a7887c620edd83eebaf [id=d1d894519e174e219cb1bd20b8b4504c]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:44.129657 13467 rpcz_store.cc:276] 0830 07:54:42.989552 (+ 0us) service_pool.cc:168] Inserting onto call queue
0830 07:54:43.658409 (+668857us) service_pool.cc:225] Handling call
0830 07:54:43.709625 (+ 51216us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0830 07:54:43.709666 (+ 41us) ts_tablet_manager.cc:676] Creating new metadata...
0830 07:54:44.052095 (+342429us) tablet_metadata.cc:641] Metadata flushed
0830 07:54:44.054873 (+ 2778us) tablet_replica.cc:206] Creating consensus instance
0830 07:54:44.085963 (+ 31090us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20250830 07:54:44.181890 13605 tablet_service.cc:1468] Processing CreateTablet for tablet fac764a2d269411c86b85ceeaec0b014 (DEFAULT_TABLE table=default.Table_d2e35b9bab8b4f559b34fe632e69f973 [id=79ead01cb7c54bba8701da6c74224b2b]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:44.182420 13467 tablet_service.cc:1468] Processing CreateTablet for tablet 7676b4d6a75c4c6aacced1f2a1beb555 (DEFAULT_TABLE table=default.Table_312a5248361141058060b702704a3b35 [id=16c0b33e1e744e61b48b7cb029228977]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:44.182499 13591 tablet_service.cc:1468] Processing CreateTablet for tablet a5eea1950d1945f1b755fd34597b2fb4 (DEFAULT_TABLE table=default.Table_3fc8320fad174384a19616004d3b6e4e [id=965e15b7139f4b7aa3653373dbbea5e0]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:44.183010 13467 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7676b4d6a75c4c6aacced1f2a1beb555. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:44.183121 13597 tablet_service.cc:1468] Processing CreateTablet for tablet 690cf258639a4c1ea5a0ac4f2fd39f88 (DEFAULT_TABLE table=default.Table_523d7bc660f94c9db577f499e22c772f [id=3582c72cab4b4e1084021b098ec30f87]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:44.183805 13607 tablet_service.cc:1468] Processing CreateTablet for tablet 11042d702d4048c99644f0f06a6212d6 (DEFAULT_TABLE table=default.Table_c2d3c80608cf49c4832bcc433c7533ae [id=40624d7f141348df82e85be3a796c840]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:44.184545 13592 tablet_service.cc:1468] Processing CreateTablet for tablet 4639d1b6add8447c9ce071af71a99869 (DEFAULT_TABLE table=default.Table_2c46d09a19884723bb6778784b0e3fa0 [id=ee45206ce57f4424bb08794e35e2e66a]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:44.184633 13453 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 508d21af038c4801a9680ce275eb504c. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:44.185315 13600 tablet_service.cc:1468] Processing CreateTablet for tablet 7676b4d6a75c4c6aacced1f2a1beb555 (DEFAULT_TABLE table=default.Table_312a5248361141058060b702704a3b35 [id=16c0b33e1e744e61b48b7cb029228977]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:44.185456 13454 rpcz_store.cc:276] 0830 07:54:43.039984 (+ 0us) service_pool.cc:168] Inserting onto call queue
0830 07:54:43.955519 (+915535us) service_pool.cc:225] Handling call
0830 07:54:43.955894 (+ 375us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0830 07:54:43.955916 (+ 22us) ts_tablet_manager.cc:676] Creating new metadata...
0830 07:54:44.089971 (+134055us) tablet_metadata.cc:641] Metadata flushed
0830 07:54:44.128471 (+ 38500us) tablet_replica.cc:206] Creating consensus instance
0830 07:54:44.128607 (+ 136us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20250830 07:54:44.185766 14754 raft_consensus.cc:491] T 30c2558c28944ff39d1a4a4ca9ac604e P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:44.191165 13454 tablet_service.cc:1468] Processing CreateTablet for tablet 78fe9f6325c243a490f361aa79295c36 (DEFAULT_TABLE table=default.Table_2b82782993784298b5f2664d01b07707 [id=41b94badffbc4d1aad72f5ecc891a07e]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:44.190827 13588 rpcz_store.cc:276] 0830 07:54:42.975438 (+ 0us) service_pool.cc:168] Inserting onto call queue
0830 07:54:42.976615 (+ 1177us) service_pool.cc:225] Handling call
0830 07:54:44.160105 (+1183490us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20250830 07:54:44.195174 13599 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dad2dfa1a19d45778933780b1029d924. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:44.199710 13752 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 443) took 1342 ms. Trace:
I20250830 07:54:44.199833 13752 rpcz_store.cc:276] 0830 07:54:42.856873 (+ 0us) service_pool.cc:168] Inserting onto call queue
0830 07:54:43.284847 (+427974us) service_pool.cc:225] Handling call
0830 07:54:43.346973 (+ 62126us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0830 07:54:43.347009 (+ 36us) ts_tablet_manager.cc:676] Creating new metadata...
0830 07:54:43.868757 (+521748us) tablet_metadata.cc:641] Metadata flushed
0830 07:54:44.199545 (+330788us) tablet_replica.cc:206] Creating consensus instance
0830 07:54:44.199674 (+ 129us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20250830 07:54:44.200240 13752 tablet_service.cc:1468] Processing CreateTablet for tablet f479eef0171c401bbd27beec4486a8b2 (DEFAULT_TABLE table=default.Table_6a958507c89649f0b5da3534949c2122 [id=1cda9ceec18b4e37973268cb198bdac7]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:44.195407 13450 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 478) took 1153 ms. Trace:
I20250830 07:54:44.200572 13752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f479eef0171c401bbd27beec4486a8b2. 1 dirs total, 0 dirs full, 0 dirs failed
W20250830 07:54:44.203832 13702 service_pool.cc:137] DeleteTablet request on kudu.tserver.TabletServerAdminService from 127.0.0.1:45460 dropped due to backpressure: service queue is full with 50 items [suppressed 5 similar messages]
I20250830 07:54:44.205224 13591 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a5eea1950d1945f1b755fd34597b2fb4. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:44.205761 13702 service_pool.cc:138] DeleteTablet request on kudu.tserver.TabletServerAdminService from 127.0.0.1:45460 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 471)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 472)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 473)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45460 (request call id 474)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45460 (request call id 475)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45460 (request call id 476)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45460 (request call id 477)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 478)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 479)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 480)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 481)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 482)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 483)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 484)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 485)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 486)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 487)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 488)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 489)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 490)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 491)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 494)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 495)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 496)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 499)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 500)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 501)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 502)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 503)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 504)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 505)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 506)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 507)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 508)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 509)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 510)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 511)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 512)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 515)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 516)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 517)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 518)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 519)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 520)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 521)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 522)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45460 (request call id 523)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45460 (request call id 524)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45460 (request call id 525)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45460 (request call id 526)
W20250830 07:54:44.206388 13148 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.12.209.60:43889: connect: Connection refused (error 111) [suppressed 7 similar messages]
I20250830 07:54:44.206533 13753 tablet_service.cc:1468] Processing CreateTablet for tablet 1ca83bbf848744f38206ceb4126271be (DEFAULT_TABLE table=default.Table_58be973418b94b6d9c25747a596793b6 [id=0138d045d5414fec8933b6d1fbac4ee6]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:44.207571 13454 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78fe9f6325c243a490f361aa79295c36. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:44.207633 13747 tablet_service.cc:1468] Processing CreateTablet for tablet ccc9091018cb48ffb2affd98e8bbfa05 (DEFAULT_TABLE table=default.Table_dcc3f90b74de4848b1d750ec0aa814f4 [id=f7e584e9473f446cb4b78e99377d4b1b]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:44.208575 13737 tablet_service.cc:1468] Processing CreateTablet for tablet 0d16bc64dd6e43f7ba313b77c2bbb728 (DEFAULT_TABLE table=default.Table_6fe8dfbe1873453d8f1a683a12a6288a [id=93a678d18ca94d9f9c1f763808c070d6]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:44.210990 13456 tablet_service.cc:1468] Processing CreateTablet for tablet e24d68b8f5ba4df59a9aeec8ebd6403d (DEFAULT_TABLE table=default.Table_c8928475736a40768e1ad90aed18fa32 [id=390d0083d26c4c39b58622c2cd50365e]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:44.211335 13754 tablet_service.cc:1468] Processing CreateTablet for tablet af449cc407c046eeb5cdfdacffc617a4 (DEFAULT_TABLE table=default.Table_0cebf3f048d64286a08f66238dbbc35f [id=b246fa3864ad42649b0a9925ce921a9a]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:44.211829 13456 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e24d68b8f5ba4df59a9aeec8ebd6403d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:44.213747 13607 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11042d702d4048c99644f0f06a6212d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:44.185997 14754 raft_consensus.cc:513] T 30c2558c28944ff39d1a4a4ca9ac604e P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:44.216069 13450 rpcz_store.cc:276] 0830 07:54:43.040411 (+ 0us) service_pool.cc:168] Inserting onto call queue
0830 07:54:43.981597 (+941186us) service_pool.cc:225] Handling call
0830 07:54:43.988043 (+ 6446us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0830 07:54:43.988078 (+ 35us) ts_tablet_manager.cc:676] Creating new metadata...
0830 07:54:44.091734 (+103656us) tablet_metadata.cc:641] Metadata flushed
0830 07:54:44.194088 (+102354us) tablet_replica.cc:206] Creating consensus instance
0830 07:54:44.194209 (+ 121us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20250830 07:54:44.221251 13450 tablet_service.cc:1468] Processing CreateTablet for tablet 7dc061ebaa334c109d1e457e2dc860df (DEFAULT_TABLE table=default.Table_406d183190bf4e01a97000963dd33d13 [id=d1b9fcbd33df447984a15bc7504aa31c]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:44.221596 13747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ccc9091018cb48ffb2affd98e8bbfa05. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:44.221848 13450 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7dc061ebaa334c109d1e457e2dc860df. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:44.207254 13464 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 480) took 1060 ms. Trace:
I20250830 07:54:44.222936 13592 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4639d1b6add8447c9ce071af71a99869. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:44.225718 13464 rpcz_store.cc:276] 0830 07:54:43.139540 (+ 0us) service_pool.cc:168] Inserting onto call queue
0830 07:54:43.986335 (+846795us) service_pool.cc:225] Handling call
0830 07:54:43.998582 (+ 12247us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0830 07:54:43.998605 (+ 23us) ts_tablet_manager.cc:676] Creating new metadata...
0830 07:54:44.096412 (+ 97807us) tablet_metadata.cc:641] Metadata flushed
0830 07:54:44.199910 (+103498us) tablet_replica.cc:206] Creating consensus instance
0830 07:54:44.200069 (+ 159us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20250830 07:54:44.226960 13737 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d16bc64dd6e43f7ba313b77c2bbb728. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:44.228128 13468 tablet_service.cc:1468] Processing CreateTablet for tablet 9bc54e40f9eb4271aa3132986c249e51 (DEFAULT_TABLE table=default.Table_034019ccacd345d5873db4d09f70ee1f [id=f27ebd3627c84206b8623634701e7de5]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:44.230093 13229 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_2a1215c34df8484ca99228faa7e3747b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:44.230731 13229 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2a1215c34df8484ca99228faa7e3747b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:44.237490 13228 master_service.cc:948] ReplaceTablet: received request to replace tablet f52dd8eeb64a4b8a92babf34387b6c5b from {username='slave'} at 127.0.0.1:42126
W20250830 07:54:44.240609 13148 leader_election.cc:336] T 00000000000000000000000000000000 P fea6152429cc4e79a25b18e02aafae57 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 3ea183a890b84f408b20b55e9eb7c7ed (127.12.209.60:43889): Network error: Client connection negotiation failed: client connection to 127.12.209.60:43889: connect: Connection refused (error 111)
I20250830 07:54:44.240762 13148 leader_election.cc:304] T 00000000000000000000000000000000 P fea6152429cc4e79a25b18e02aafae57 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fea6152429cc4e79a25b18e02aafae57; no voters: 3ea183a890b84f408b20b55e9eb7c7ed, 5e9d6449ae824acab24c459a72075e88
I20250830 07:54:44.241029 14763 raft_consensus.cc:2747] T 00000000000000000000000000000000 P fea6152429cc4e79a25b18e02aafae57 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20250830 07:54:44.243346 13468 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9bc54e40f9eb4271aa3132986c249e51. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:44.245074 13887 tablet_bootstrap.cc:492] T 69d6daeb7c774fd48ed296f52ed7c6a6 P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:54:44.245406 13598 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 482) took 1211 ms. Trace:
I20250830 07:54:44.245486 13735 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 446) took 1376 ms. Trace:
I20250830 07:54:44.245574 13735 rpcz_store.cc:276] 0830 07:54:42.857217 (+ 0us) service_pool.cc:168] Inserting onto call queue
0830 07:54:43.330771 (+473554us) service_pool.cc:225] Handling call
0830 07:54:43.356390 (+ 25619us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0830 07:54:43.356420 (+ 30us) ts_tablet_manager.cc:676] Creating new metadata...
0830 07:54:44.186862 (+830442us) tablet_metadata.cc:641] Metadata flushed
0830 07:54:44.233804 (+ 46942us) tablet_replica.cc:206] Creating consensus instance
0830 07:54:44.233912 (+ 108us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20250830 07:54:44.253482 13452 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 481) took 1079 ms. Trace:
I20250830 07:54:44.254580 13753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ca83bbf848744f38206ceb4126271be. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:44.238792 13740 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 464) took 1073 ms. Trace:
I20250830 07:54:44.255499 13452 rpcz_store.cc:276] 0830 07:54:43.162388 (+ 0us) service_pool.cc:168] Inserting onto call queue
0830 07:54:43.989428 (+827040us) service_pool.cc:225] Handling call
0830 07:54:43.989857 (+ 429us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0830 07:54:43.997807 (+ 7950us) ts_tablet_manager.cc:676] Creating new metadata...
0830 07:54:44.098347 (+100540us) tablet_metadata.cc:641] Metadata flushed
0830 07:54:44.234826 (+136479us) tablet_replica.cc:206] Creating consensus instance
0830 07:54:44.241770 (+ 6944us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20250830 07:54:44.255977 13452 tablet_service.cc:1468] Processing CreateTablet for tablet b85843ab0e3a40e1b453cfdd71bbae5e (DEFAULT_TABLE table=default.Table_2e6009ad55fd42afb9f5d177f2b8c272 [id=9c9207d3b60e4781b1cc610cff92c8e6]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:44.257176 13452 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b85843ab0e3a40e1b453cfdd71bbae5e. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:44.257302 13754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af449cc407c046eeb5cdfdacffc617a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:44.260785 13464 tablet_service.cc:1468] Processing CreateTablet for tablet e2ef8300fb994f98b3565ad708f880cf (DEFAULT_TABLE table=default.Table_2c14c2548447473a998f5b39993d1b72 [id=158681f88c0d4c3998a0b9709f1b703d]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:44.260980 13740 rpcz_store.cc:276] 0830 07:54:43.154927 (+ 0us) service_pool.cc:168] Inserting onto call queue
0830 07:54:43.965080 (+810153us) service_pool.cc:225] Handling call
0830 07:54:43.965644 (+ 564us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0830 07:54:43.965671 (+ 27us) ts_tablet_manager.cc:676] Creating new metadata...
0830 07:54:43.969211 (+ 3540us) tablet_metadata.cc:641] Metadata flushed
0830 07:54:44.212181 (+242970us) tablet_replica.cc:206] Creating consensus instance
0830 07:54:44.228202 (+ 16021us) spinlock_profiling.cc:243] Waited 6.11 ms on lock 0x61800000d518. stack: 00007fd0bf5707d6 00007fd0bf570590 00007fd0be5633ad 0000000000972d94 0000000000972d5d 000000000097272a 00007fd0bf5590dd 00007fd0bf55a14e 00007fd0d2c1f8cd 00007fd0d2ba11b3 00007fd0cedeade9 00007fd0ceddf028 00007fd0cede0967 00007fd0ced34a62 00007fd0c8f346a6 00007fd0c8f343d5
0830 07:54:44.228286 (+ 84us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":14056704}
I20250830 07:54:44.261360 13746 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 465) took 1101 ms. Trace:
I20250830 07:54:44.261437 13746 rpcz_store.cc:276] 0830 07:54:43.155028 (+ 0us) service_pool.cc:168] Inserting onto call queue
0830 07:54:43.971084 (+816056us) service_pool.cc:225] Handling call
0830 07:54:43.971520 (+ 436us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0830 07:54:43.971545 (+ 25us) ts_tablet_manager.cc:676] Creating new metadata...
0830 07:54:43.974873 (+ 3328us) tablet_metadata.cc:641] Metadata flushed
0830 07:54:44.256553 (+281680us) tablet_replica.cc:206] Creating consensus instance
0830 07:54:44.256668 (+ 115us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20250830 07:54:44.228021 13702 service_pool.cc:138] DeleteTablet request on kudu.tserver.TabletServerAdminService from 127.0.0.1:45460 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 471)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 472)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 473)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45460 (request call id 474)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45460 (request call id 475)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45460 (request call id 476)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45460 (request call id 477)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 478)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 479)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 480)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 481)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 482)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 483)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 484)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 485)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 486)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 487)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 488)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 489)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 490)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 491)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 494)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 495)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 496)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 499)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 500)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 501)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 502)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 503)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 504)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 505)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 506)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 507)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 508)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 509)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 510)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 511)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 512)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 515)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 516)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 517)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 518)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 519)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 520)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 521)
Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 522)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45460 (request call id 523)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45460 (request call id 524)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45460 (request call id 525)
Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45460 (request call id 526)
I20250830 07:54:44.265682 13460 tablet_service.cc:1468] Processing CreateTablet for tablet 0c32e597f17e4e75a0f584b6b7b02c36 (DEFAULT_TABLE table=default.Table_f9f639c72f2a46a0bb1606c0f1e92ee0 [id=71cc7b5209c44469889014ae93315aab]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:44.266211 13459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 491) took 1052 ms. Trace:
I20250830 07:54:44.268157 13462 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 484) took 1096 ms. Trace:
I20250830 07:54:44.270393 13746 tablet_service.cc:1468] Processing CreateTablet for tablet a36f38ada7314165a5e9d6ee7bbf69e3 (DEFAULT_TABLE table=default.Table_b0514d974e9d4da1b8599e38ea5657cb [id=b5dab764ada7465d9634966caa73865b]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:44.270740 13746 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a36f38ada7314165a5e9d6ee7bbf69e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:44.271415 13735 tablet_service.cc:1468] Processing CreateTablet for tablet 3f70097c1b3a48dfbc1ad129fa7a3730 (DEFAULT_TABLE table=default.Table_605f96f8ddea45cfa2a0862488a409f6 [id=80c106705320406faebc87088138d10f]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:44.271736 13735 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f70097c1b3a48dfbc1ad129fa7a3730. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:44.273625 13745 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 454) took 1172 ms. Trace:
I20250830 07:54:44.273789 13745 rpcz_store.cc:276] 0830 07:54:43.101262 (+ 0us) service_pool.cc:168] Inserting onto call queue
0830 07:54:43.437895 (+336633us) service_pool.cc:225] Handling call
0830 07:54:43.811085 (+373190us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0830 07:54:43.811111 (+ 26us) ts_tablet_manager.cc:676] Creating new metadata...
0830 07:54:43.937388 (+126277us) tablet_metadata.cc:641] Metadata flushed
0830 07:54:44.273448 (+336060us) tablet_replica.cc:206] Creating consensus instance
0830 07:54:44.273572 (+ 124us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20250830 07:54:44.274160 13745 tablet_service.cc:1515] Processing DeleteTablet for tablet e4ca3110247640fbae4241448e8d5ef7 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:42 UTC) from {username='slave'} at 127.0.0.1:45460
I20250830 07:54:44.274327 13462 rpcz_store.cc:276] 0830 07:54:43.163742 (+ 0us) service_pool.cc:168] Inserting onto call queue
0830 07:54:44.113926 (+950184us) service_pool.cc:225] Handling call
0830 07:54:44.162372 (+ 48446us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0830 07:54:44.162390 (+ 18us) ts_tablet_manager.cc:676] Creating new metadata...
0830 07:54:44.238307 (+ 75917us) tablet_metadata.cc:641] Metadata flushed
0830 07:54:44.259887 (+ 21580us) tablet_replica.cc:206] Creating consensus instance
0830 07:54:44.260015 (+ 128us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20250830 07:54:44.279592 13606 tablet_service.cc:1468] Processing CreateTablet for tablet 838616d8274648fc9ea4f1583bdb97f9 (DEFAULT_TABLE table=default.Table_5b1f6f284dc946afa2daaea18a0164e2 [id=447ff69ae6a14f93b768dd1357195a84]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:44.280098 14754 leader_election.cc:290] T 30c2558c28944ff39d1a4a4ca9ac604e P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:44.280340 13596 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 484) took 1195 ms. Trace:
I20250830 07:54:44.280472 13596 rpcz_store.cc:276] 0830 07:54:43.033636 (+ 0us) service_pool.cc:168] Inserting onto call queue
0830 07:54:44.011722 (+978086us) service_pool.cc:225] Handling call
0830 07:54:44.040199 (+ 28477us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0830 07:54:44.040218 (+ 19us) ts_tablet_manager.cc:676] Creating new metadata...
0830 07:54:44.172020 (+131802us) tablet_metadata.cc:641] Metadata flushed
0830 07:54:44.228740 (+ 56720us) tablet_replica.cc:206] Creating consensus instance
0830 07:54:44.228885 (+ 145us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20250830 07:54:44.280985 13596 tablet_service.cc:1468] Processing CreateTablet for tablet 78fe9f6325c243a490f361aa79295c36 (DEFAULT_TABLE table=default.Table_2b82782993784298b5f2664d01b07707 [id=41b94badffbc4d1aad72f5ecc891a07e]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:44.281312 13601 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 487) took 1016 ms. Trace:
I20250830 07:54:44.281451 13601 rpcz_store.cc:276] 0830 07:54:43.224596 (+ 0us) service_pool.cc:168] Inserting onto call queue
0830 07:54:44.021570 (+796974us) service_pool.cc:225] Handling call
0830 07:54:44.035618 (+ 14048us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0830 07:54:44.035641 (+ 23us) ts_tablet_manager.cc:676] Creating new metadata...
0830 07:54:44.174089 (+138448us) tablet_metadata.cc:641] Metadata flushed
0830 07:54:44.238941 (+ 64852us) tablet_replica.cc:206] Creating consensus instance
0830 07:54:44.239095 (+ 154us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20250830 07:54:44.281905 13601 tablet_service.cc:1468] Processing CreateTablet for tablet 7dc061ebaa334c109d1e457e2dc860df (DEFAULT_TABLE table=default.Table_406d183190bf4e01a97000963dd33d13 [id=d1b9fcbd33df447984a15bc7504aa31c]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:44.282473 13598 rpcz_store.cc:276] 0830 07:54:43.033482 (+ 0us) service_pool.cc:168] Inserting onto call queue
0830 07:54:43.996014 (+962532us) service_pool.cc:225] Handling call
0830 07:54:43.996486 (+ 472us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0830 07:54:43.996514 (+ 28us) ts_tablet_manager.cc:676] Creating new metadata...
0830 07:54:44.197383 (+200869us) tablet_metadata.cc:641] Metadata flushed
0830 07:54:44.245258 (+ 47875us) tablet_replica.cc:206] Creating consensus instance
0830 07:54:44.245375 (+ 117us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20250830 07:54:44.283036 13597 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 690cf258639a4c1ea5a0ac4f2fd39f88. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:44.283354 13887 ts_tablet_manager.cc:1397] T 69d6daeb7c774fd48ed296f52ed7c6a6 P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.307s user 0.007s sys 0.006s
I20250830 07:54:44.283495 13459 rpcz_store.cc:276] 0830 07:54:43.215354 (+ 0us) service_pool.cc:168] Inserting onto call queue
0830 07:54:44.137810 (+922456us) service_pool.cc:225] Handling call
0830 07:54:44.138228 (+ 418us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0830 07:54:44.138250 (+ 22us) ts_tablet_manager.cc:676] Creating new metadata...
0830 07:54:44.192914 (+ 54664us) tablet_metadata.cc:641] Metadata flushed
0830 07:54:44.260675 (+ 67761us) tablet_replica.cc:206] Creating consensus instance
0830 07:54:44.261598 (+ 923us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20250830 07:54:44.284216 13459 tablet_service.cc:1468] Processing CreateTablet for tablet 75359721445e48d2bc0dd6fd17649bc1 (DEFAULT_TABLE table=default.Table_618200045a4b44908fc6e99de0c2788e [id=554293853df24d7a8c6721d441ef8622]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:44.284602 13451 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 487) took 1111 ms. Trace:
I20250830 07:54:44.284741 13451 rpcz_store.cc:276] 0830 07:54:43.164079 (+ 0us) service_pool.cc:168] Inserting onto call queue
0830 07:54:44.119813 (+955734us) service_pool.cc:225] Handling call
0830 07:54:44.172140 (+ 52327us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0830 07:54:44.172162 (+ 22us) ts_tablet_manager.cc:676] Creating new metadata...
0830 07:54:44.250287 (+ 78125us) tablet_metadata.cc:641] Metadata flushed
0830 07:54:44.275814 (+ 25527us) tablet_replica.cc:206] Creating consensus instance
0830 07:54:44.275907 (+ 93us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20250830 07:54:44.285199 13463 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 486) took 1115 ms. Trace:
I20250830 07:54:44.285374 13463 rpcz_store.cc:276] 0830 07:54:43.163911 (+ 0us) service_pool.cc:168] Inserting onto call queue
0830 07:54:44.119327 (+955416us) service_pool.cc:225] Handling call
0830 07:54:44.167947 (+ 48620us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0830 07:54:44.167968 (+ 21us) ts_tablet_manager.cc:676] Creating new metadata...
0830 07:54:44.171359 (+ 3391us) tablet_metadata.cc:641] Metadata flushed
0830 07:54:44.279562 (+108203us) tablet_replica.cc:206] Creating consensus instance
0830 07:54:44.279703 (+ 141us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20250830 07:54:44.285842 13463 tablet_service.cc:1468] Processing CreateTablet for tablet 6f8b6f233e5c49b39b3ef6314508e9d9 (DEFAULT_TABLE table=default.Table_106c5d91b7314b3398e48ac2c97aa95b [id=7f24e7d037584d65b1c480cf52b59fa9]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:44.286346 13462 tablet_service.cc:1468] Processing CreateTablet for tablet 8028ac4c928a48f3a077d61aec24f3bd (DEFAULT_TABLE table=default.Table_3ab80fb58bfa45f0aa3aaeef49d0b416 [id=f8ee1dbbf2df48dea75fa01ffbfdebd9]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:44.291280 13460 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0c32e597f17e4e75a0f584b6b7b02c36. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:44.296937 13586 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.ListTablets from 127.0.0.1:45302 (request call id 136) took 1224 ms. Trace:
I20250830 07:54:44.297091 13586 rpcz_store.cc:276] 0830 07:54:43.072428 (+ 0us) service_pool.cc:168] Inserting onto call queue
0830 07:54:43.079778 (+ 7350us) service_pool.cc:225] Handling call
0830 07:54:44.296891 (+1217113us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20250830 07:54:44.297580 13451 tablet_service.cc:1468] Processing CreateTablet for tablet 5dffbacf2fcd4a38a1d61cf5bb9c5eeb (DEFAULT_TABLE table=default.Table_f8d552f66f96486cb2b5984a52b993ce [id=803bcda3ed6641749163c3162af467f2]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:44.305176 13466 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 485) took 1128 ms. Trace:
I20250830 07:54:44.305500 13466 rpcz_store.cc:276] 0830 07:54:43.163844 (+ 0us) service_pool.cc:168] Inserting onto call queue
0830 07:54:44.118723 (+954879us) service_pool.cc:225] Handling call
0830 07:54:44.164761 (+ 46038us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0830 07:54:44.164780 (+ 19us) ts_tablet_manager.cc:676] Creating new metadata...
0830 07:54:44.180726 (+ 15946us) tablet_metadata.cc:641] Metadata flushed
0830 07:54:44.291180 (+110454us) tablet_replica.cc:206] Creating consensus instance
0830 07:54:44.292300 (+ 1120us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20250830 07:54:44.306026 13466 tablet_service.cc:1468] Processing CreateTablet for tablet 91da20bcd25341b5a0f6605b3ec58fb3 (DEFAULT_TABLE table=default.Table_200f184b944748a08e37e88ac1a2d08d [id=c83fcb4f43b54817b7aeb042d5e0ec85]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:44.307039 13467 tablet_service.cc:1468] Processing CreateTablet for tablet 53766699d42e4f6e9b42d9a98613726c (DEFAULT_TABLE table=default.Table_a4097958af86408498f5bc26a4fc0871 [id=0ca73c1fbe9f48ad82737dca6997e50e]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:44.307351 13459 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75359721445e48d2bc0dd6fd17649bc1. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:44.308552 13467 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 53766699d42e4f6e9b42d9a98613726c. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:44.310178 13458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 483) took 1146 ms. Trace:
I20250830 07:54:44.311218 13458 rpcz_store.cc:276] 0830 07:54:43.163652 (+ 0us) service_pool.cc:168] Inserting onto call queue
0830 07:54:44.093565 (+929913us) service_pool.cc:225] Handling call
0830 07:54:44.098772 (+ 5207us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0830 07:54:44.098795 (+ 23us) ts_tablet_manager.cc:676] Creating new metadata...
0830 07:54:44.187824 (+ 89029us) tablet_metadata.cc:641] Metadata flushed
0830 07:54:44.309846 (+122022us) tablet_replica.cc:206] Creating consensus instance
0830 07:54:44.310145 (+ 299us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20250830 07:54:44.311779 13458 tablet_service.cc:1468] Processing CreateTablet for tablet 1f5471a94dc24a28bce5f9dcaa10334a (DEFAULT_TABLE table=default.Table_8edbcf7950a04e75982f77c91ac9ff84 [id=c048285db66d4bc09170a2bb1e50fe58]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:44.313541 13608 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 986878a23a0b47ee865e09277b027bb0. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:44.282904 13598 tablet_service.cc:1468] Processing CreateTablet for tablet e2ef8300fb994f98b3565ad708f880cf (DEFAULT_TABLE table=default.Table_2c14c2548447473a998f5b39993d1b72 [id=158681f88c0d4c3998a0b9709f1b703d]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:44.313721 13457 tablet_service.cc:1468] Processing CreateTablet for tablet b4c345013ff04cf991989f456aa2d420 (DEFAULT_TABLE table=default.Table_005af599605e4bd090ba828f70a19003 [id=edbafe796f4049feb1d4331956940568]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:44.314025 13600 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7676b4d6a75c4c6aacced1f2a1beb555. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:44.320454 13605 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fac764a2d269411c86b85ceeaec0b014. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:44.326346 13464 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e2ef8300fb994f98b3565ad708f880cf. 1 dirs total, 0 dirs full, 0 dirs failed
W20250830 07:54:44.327097 13423 leader_election.cc:343] T 99f307a8cbb34addaafab82b3ed18241 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
W20250830 07:54:44.327333 13233 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a0cf1de8485941eb8a557a6e2f783047 consensus state has no leader
I20250830 07:54:44.329562 14756 consensus_queue.cc:1035] T b38c8d003413428dae9e47f58e197c2c P 2065c332f15a4739899af79f3669c3ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
I20250830 07:54:44.331563 13887 raft_consensus.cc:357] T 69d6daeb7c774fd48ed296f52ed7c6a6 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:44.332108 13887 raft_consensus.cc:383] T 69d6daeb7c774fd48ed296f52ed7c6a6 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:44.332214 13887 raft_consensus.cc:738] T 69d6daeb7c774fd48ed296f52ed7c6a6 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:54:44.332559 13463 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f8b6f233e5c49b39b3ef6314508e9d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:44.333266 13887 consensus_queue.cc:260] T 69d6daeb7c774fd48ed296f52ed7c6a6 P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
W20250830 07:54:44.341161 13232 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 122bec4220c74dfaa8228f6d153cd50e consensus state has no leader
I20250830 07:54:44.344364 13596 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78fe9f6325c243a490f361aa79295c36. 1 dirs total, 0 dirs full, 0 dirs failed
W20250830 07:54:44.344652 13233 catalog_manager.cc:5415] Ignoring report from unknown tablet 04c9d954106a4417a34ff80bc98e2ce8
W20250830 07:54:44.344743 13233 catalog_manager.cc:5415] Ignoring report from unknown tablet d3f207cee78a43a1b5e030c09752c78c
I20250830 07:54:44.344389 13613 raft_consensus.cc:3058] T 30c2558c28944ff39d1a4a4ca9ac604e P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:44.345317 13233 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_b6f012ba5b2741d2a5b1ed74a2dcd9eb" } new_table_name: "default.Table_4f53e333521540848fc99c0bf37c1639" modify_external_catalogs: true
I20250830 07:54:44.346666 13232 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_5b1f6f284dc946afa2daaea18a0164e2" } modify_external_catalogs: true
I20250830 07:54:44.346875 13232 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_5b1f6f284dc946afa2daaea18a0164e2" } modify_external_catalogs: true
I20250830 07:54:44.337002 13622 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "cb3c48982add45379c0e1b117ec40c1a" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:44.347090 13595 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 490) took 1116 ms. Trace:
I20250830 07:54:44.347126 13593 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 483) took 1308 ms. Trace:
I20250830 07:54:44.347210 13602 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 493) took 1053 ms. Trace:
I20250830 07:54:44.348047 13591 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 498) took 1052 ms. Trace:
I20250830 07:54:44.349136 13230 master_service.cc:948] ReplaceTablet: received request to replace tablet 7ef98dbbdf5848038a2da6140e126301 from {username='slave'} at 127.0.0.1:42126
I20250830 07:54:44.349224 13601 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7dc061ebaa334c109d1e457e2dc860df. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:44.340731 13612 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "e862fa77e16945bd94e405aa3474f021" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:44.350081 13595 rpcz_store.cc:276] 0830 07:54:43.226769 (+ 0us) service_pool.cc:168] Inserting onto call queue
0830 07:54:44.049784 (+823015us) service_pool.cc:225] Handling call
0830 07:54:44.050182 (+ 398us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0830 07:54:44.050205 (+ 23us) ts_tablet_manager.cc:676] Creating new metadata...
0830 07:54:44.189783 (+139578us) tablet_metadata.cc:641] Metadata flushed
0830 07:54:44.268323 (+ 78540us) tablet_replica.cc:206] Creating consensus instance
0830 07:54:44.342751 (+ 74428us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20250830 07:54:44.350221 13612 raft_consensus.cc:2391] T e862fa77e16945bd94e405aa3474f021 P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b057ade5dce45af9f8bf0bedf8b917f in current term 1: Already voted for candidate 2065c332f15a4739899af79f3669c3ba in this term.
I20250830 07:54:44.350926 13466 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 91da20bcd25341b5a0f6605b3ec58fb3. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:44.351691 13591 rpcz_store.cc:276] 0830 07:54:43.289978 (+ 0us) service_pool.cc:168] Inserting onto call queue
0830 07:54:44.182296 (+892318us) service_pool.cc:225] Handling call
0830 07:54:44.182705 (+ 409us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0830 07:54:44.182723 (+ 18us) ts_tablet_manager.cc:676] Creating new metadata...
0830 07:54:44.231985 (+ 49262us) tablet_metadata.cc:641] Metadata flushed
0830 07:54:44.258614 (+ 26629us) tablet_replica.cc:206] Creating consensus instance
0830 07:54:44.342578 (+ 83964us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20250830 07:54:44.352340 13606 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 838616d8274648fc9ea4f1583bdb97f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:44.353789 13234 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_af9972a41d74405e9c2896ec5d2a227c" } modify_external_catalogs: true
I20250830 07:54:44.353929 13234 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_af9972a41d74405e9c2896ec5d2a227c" } modify_external_catalogs: true
I20250830 07:54:44.354534 13882 tablet_bootstrap.cc:492] T cb3c48982add45379c0e1b117ec40c1a P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:54:44.353415 13595 tablet_service.cc:1468] Processing CreateTablet for tablet 9bc54e40f9eb4271aa3132986c249e51 (DEFAULT_TABLE table=default.Table_034019ccacd345d5873db4d09f70ee1f [id=f27ebd3627c84206b8623634701e7de5]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:44.356122 13230 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_b12f5a566e884916a19242caa716466a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:44.356600 13230 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b12f5a566e884916a19242caa716466a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:44.358021 13609 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 469) took 1311 ms. Trace:
I20250830 07:54:44.358156 13462 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8028ac4c928a48f3a077d61aec24f3bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:44.358419 13607 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 500) took 1063 ms. Trace:
I20250830 07:54:44.358819 13887 ts_tablet_manager.cc:1428] T 69d6daeb7c774fd48ed296f52ed7c6a6 P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.044s user 0.001s sys 0.001s
I20250830 07:54:44.359866 13597 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 499) took 1069 ms. Trace:
I20250830 07:54:44.360069 13604 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 495) took 1056 ms. Trace:
I20250830 07:54:44.360152 13604 rpcz_store.cc:276] 0830 07:54:43.289600 (+ 0us) service_pool.cc:168] Inserting onto call queue
0830 07:54:44.116759 (+827159us) service_pool.cc:225] Handling call
0830 07:54:44.120676 (+ 3917us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0830 07:54:44.120696 (+ 20us) ts_tablet_manager.cc:676] Creating new metadata...
0830 07:54:44.252269 (+131573us) tablet_metadata.cc:641] Metadata flushed
0830 07:54:44.254453 (+ 2184us) tablet_replica.cc:206] Creating consensus instance
0830 07:54:44.345862 (+ 91409us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20250830 07:54:44.361042 13604 tablet_service.cc:1468] Processing CreateTablet for tablet 2d91b0ba74034b85812a13719e21dc6c (DEFAULT_TABLE table=default.Table_d978d625ae9f4ac5ad252d8e982685f7 [id=9fd46fc815604123bcb15dc7ecd892a9]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:44.361593 13603 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 491) took 1115 ms. Trace:
I20250830 07:54:44.361682 13603 rpcz_store.cc:276] 0830 07:54:43.226969 (+ 0us) service_pool.cc:168] Inserting onto call queue
0830 07:54:44.074026 (+847057us) service_pool.cc:225] Handling call
0830 07:54:44.075175 (+ 1149us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0830 07:54:44.075195 (+ 20us) ts_tablet_manager.cc:676] Creating new metadata...
0830 07:54:44.219067 (+143872us) tablet_metadata.cc:641] Metadata flushed
0830 07:54:44.265451 (+ 46384us) tablet_replica.cc:206] Creating consensus instance
0830 07:54:44.342697 (+ 77246us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20250830 07:54:44.362349 13599 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 496) took 1053 ms. Trace:
I20250830 07:54:44.362510 13609 rpcz_store.cc:276] 0830 07:54:43.032325 (+ 0us) service_pool.cc:168] Inserting onto call queue
0830 07:54:43.557035 (+524710us) service_pool.cc:225] Handling call
0830 07:54:43.808106 (+251071us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0830 07:54:43.808134 (+ 28us) ts_tablet_manager.cc:676] Creating new metadata...
0830 07:54:44.275426 (+467292us) tablet_metadata.cc:641] Metadata flushed
0830 07:54:44.277670 (+ 2244us) tablet_replica.cc:206] Creating consensus instance
0830 07:54:44.343042 (+ 65372us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20250830 07:54:44.362833 13603 tablet_service.cc:1468] Processing CreateTablet for tablet 0c32e597f17e4e75a0f584b6b7b02c36 (DEFAULT_TABLE table=default.Table_f9f639c72f2a46a0bb1606c0f1e92ee0 [id=71cc7b5209c44469889014ae93315aab]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:44.364632 13227 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_bb2c4c96345947ad8dea62244c6d7476" } modify_external_catalogs: true
I20250830 07:54:44.364771 13227 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_bb2c4c96345947ad8dea62244c6d7476" } modify_external_catalogs: true
I20250830 07:54:44.367065 13602 rpcz_store.cc:276] 0830 07:54:43.289338 (+ 0us) service_pool.cc:168] Inserting onto call queue
0830 07:54:44.112338 (+823000us) service_pool.cc:225] Handling call
0830 07:54:44.112880 (+ 542us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0830 07:54:44.112901 (+ 21us) ts_tablet_manager.cc:676] Creating new metadata...
0830 07:54:44.234187 (+121286us) tablet_metadata.cc:641] Metadata flushed
0830 07:54:44.260526 (+ 26339us) tablet_replica.cc:206] Creating consensus instance
0830 07:54:44.342642 (+ 82116us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20250830 07:54:44.367368 13231 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_32ff7c454b324d9f8b37a9d40f3bdc35" } modify_external_catalogs: true
I20250830 07:54:44.367435 13602 tablet_service.cc:1468] Processing CreateTablet for tablet 6f8b6f233e5c49b39b3ef6314508e9d9 (DEFAULT_TABLE table=default.Table_106c5d91b7314b3398e48ac2c97aa95b [id=7f24e7d037584d65b1c480cf52b59fa9]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:44.367515 13231 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_32ff7c454b324d9f8b37a9d40f3bdc35" } modify_external_catalogs: true
I20250830 07:54:44.367967 13598 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e2ef8300fb994f98b3565ad708f880cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:44.373517 13598 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 506) took 1082 ms. Trace:
I20250830 07:54:44.373649 13595 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9bc54e40f9eb4271aa3132986c249e51. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:44.374490 13599 rpcz_store.cc:276] 0830 07:54:43.289693 (+ 0us) service_pool.cc:168] Inserting onto call queue
0830 07:54:44.180887 (+891194us) service_pool.cc:225] Handling call
0830 07:54:44.181467 (+ 580us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0830 07:54:44.181486 (+ 19us) ts_tablet_manager.cc:676] Creating new metadata...
0830 07:54:44.293390 (+111904us) tablet_metadata.cc:641] Metadata flushed
0830 07:54:44.343178 (+ 49788us) tablet_replica.cc:206] Creating consensus instance
0830 07:54:44.343281 (+ 103us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20250830 07:54:44.374585 13603 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0c32e597f17e4e75a0f584b6b7b02c36. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:44.376087 13457 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4c345013ff04cf991989f456aa2d420. 1 dirs total, 0 dirs full, 0 dirs failed
W20250830 07:54:44.376978 13226 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d1a99857f707440d9edd0b30d918b2ff has no consensus state
I20250830 07:54:44.377296 13226 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_523d7bc660f94c9db577f499e22c772f" } new_table_name: "default.Table_f74084db77354c9b936dae1bc93c5103" modify_external_catalogs: true
I20250830 07:54:44.379904 13465 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 447) took 1366 ms. Trace:
I20250830 07:54:44.380611 13225 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_e326fff272534f8ba6bbb330b4be2815"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:44.381111 13225 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e326fff272534f8ba6bbb330b4be2815 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:44.382467 13451 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5dffbacf2fcd4a38a1d61cf5bb9c5eeb. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:44.381664 13604 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d91b0ba74034b85812a13719e21dc6c. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:44.384625 13465 rpcz_store.cc:276] 0830 07:54:42.984309 (+ 0us) service_pool.cc:168] Inserting onto call queue
0830 07:54:43.387965 (+403656us) service_pool.cc:225] Handling call
0830 07:54:43.423168 (+ 35203us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0830 07:54:43.423197 (+ 29us) ts_tablet_manager.cc:676] Creating new metadata...
0830 07:54:44.270099 (+846902us) tablet_metadata.cc:641] Metadata flushed
0830 07:54:44.350675 (+ 80576us) tablet_replica.cc:206] Creating consensus instance
0830 07:54:44.350781 (+ 106us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20250830 07:54:44.381938 13600 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 502) took 1084 ms. Trace:
I20250830 07:54:44.384183 13595 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 507) took 1093 ms. Trace:
I20250830 07:54:44.275851 13740 tablet_service.cc:1468] Processing CreateTablet for tablet ad7a45187569416bad6c71db9f8ab702 (DEFAULT_TABLE table=default.Table_a0b8d1d1cefc406db62d3d2882feb096 [id=a75583fe901a49158a797a2577b7e5f5]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:44.278643 14761 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45460 (request call id 460) took 1125 ms. Trace:
W20250830 07:54:44.298363 13702 connection.cc:232] RPC call timeout handler was delayed by -1.3689199510000094s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1s for a response
I20250830 07:54:44.299542 13741 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 459) took 1140 ms. Trace:
I20250830 07:54:44.300642 13739 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 447) took 1440 ms. Trace:
I20250830 07:54:44.303856 13744 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 455) took 1181 ms. Trace:
I20250830 07:54:44.389252 13602 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f8b6f233e5c49b39b3ef6314508e9d9. 1 dirs total, 0 dirs full, 0 dirs failed
W20250830 07:54:44.314172 13701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.209.1:45325, user_credentials={real_user=slave}} blocked reactor thread for 429566us
I20250830 07:54:44.330981 13748 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 452) took 1243 ms. Trace:
I20250830 07:54:44.389425 13465 tablet_service.cc:1468] Processing CreateTablet for tablet d72ef294123b4bcdb8ff63af5de9c621 (DEFAULT_TABLE table=default.Table_83d1032daed546d9ac781ef43a37179b [id=22bbb1ac25e74341b0e5b522388588c7]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:44.333640 13742 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 453) took 1207 ms. Trace:
I20250830 07:54:44.337523 13771 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "b38c8d003413428dae9e47f58e197c2c" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:44.339066 13749 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 461) took 1144 ms. Trace:
I20250830 07:54:44.378748 13773 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "7af74bdde363493f8061eba450ecf4b4" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f"
I20250830 07:54:44.383359 13765 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "30c2558c28944ff39d1a4a4ca9ac604e" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:44.390740 13592 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 501) took 1055 ms. Trace:
I20250830 07:54:44.390826 13592 rpcz_store.cc:276] 0830 07:54:43.290335 (+ 0us) service_pool.cc:168] Inserting onto call queue
0830 07:54:44.184326 (+893991us) service_pool.cc:225] Handling call
0830 07:54:44.184792 (+ 466us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0830 07:54:44.184815 (+ 23us) ts_tablet_manager.cc:676] Creating new metadata...
0830 07:54:44.262799 (+ 77984us) tablet_metadata.cc:641] Metadata flushed
0830 07:54:44.340398 (+ 77599us) tablet_replica.cc:206] Creating consensus instance
0830 07:54:44.345952 (+ 5554us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20250830 07:54:44.391237 13592 tablet_service.cc:1468] Processing CreateTablet for tablet d7afb311a699495aa8376db6ab206d94 (DEFAULT_TABLE table=default.Table_e671b5354b7b4ebe8814ab52385e56fe [id=3abbecb154a042428e6d68d43bf105fb]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:44.391543 13592 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d7afb311a699495aa8376db6ab206d94. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:44.392326 13887 tablet_bootstrap.cc:492] T 53a933afa4b74095baf0f54736d99bf0 P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:54:44.392482 13455 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 496) took 1046 ms. Trace:
I20250830 07:54:44.392398 13593 rpcz_store.cc:276] 0830 07:54:43.033559 (+ 0us) service_pool.cc:168] Inserting onto call queue
0830 07:54:43.998597 (+965038us) service_pool.cc:225] Handling call
0830 07:54:43.999066 (+ 469us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0830 07:54:43.999091 (+ 25us) ts_tablet_manager.cc:676] Creating new metadata...
0830 07:54:44.192982 (+193891us) tablet_metadata.cc:641] Metadata flushed
0830 07:54:44.256336 (+ 63354us) tablet_replica.cc:206] Creating consensus instance
0830 07:54:44.342399 (+ 86063us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20250830 07:54:44.392727 13455 rpcz_store.cc:276] 0830 07:54:43.337637 (+ 0us) service_pool.cc:168] Inserting onto call queue
0830 07:54:44.143082 (+805445us) service_pool.cc:225] Handling call
0830 07:54:44.143463 (+ 381us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0830 07:54:44.143494 (+ 31us) ts_tablet_manager.cc:676] Creating new metadata...
0830 07:54:44.261427 (+117933us) tablet_metadata.cc:641] Metadata flushed
0830 07:54:44.383338 (+121911us) tablet_replica.cc:206] Creating consensus instance
0830 07:54:44.384571 (+ 1233us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20250830 07:54:44.392910 13593 tablet_service.cc:1468] Processing CreateTablet for tablet 91da20bcd25341b5a0f6605b3ec58fb3 (DEFAULT_TABLE table=default.Table_200f184b944748a08e37e88ac1a2d08d [id=c83fcb4f43b54817b7aeb042d5e0ec85]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:44.393149 13455 tablet_service.cc:1468] Processing CreateTablet for tablet 559fdab1ef804325978db705431a0ad8 (DEFAULT_TABLE table=default.Table_ceb6b6a4e5014de182da8b467ca360f1 [id=7be8407046b4444e96e2bdee08cc5900]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:44.393818 13609 tablet_service.cc:1468] Processing CreateTablet for tablet 8028ac4c928a48f3a077d61aec24f3bd (DEFAULT_TABLE table=default.Table_3ab80fb58bfa45f0aa3aaeef49d0b416 [id=f8ee1dbbf2df48dea75fa01ffbfdebd9]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:44.394222 13609 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8028ac4c928a48f3a077d61aec24f3bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:44.395022 13453 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 488) took 1214 ms. Trace:
I20250830 07:54:44.395121 13453 rpcz_store.cc:276] 0830 07:54:43.164147 (+ 0us) service_pool.cc:168] Inserting onto call queue
0830 07:54:44.123494 (+959347us) service_pool.cc:225] Handling call
0830 07:54:44.184488 (+ 60994us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0830 07:54:44.184506 (+ 18us) ts_tablet_manager.cc:676] Creating new metadata...
0830 07:54:44.299164 (+114658us) tablet_metadata.cc:641] Metadata flushed
0830 07:54:44.378838 (+ 79674us) tablet_replica.cc:206] Creating consensus instance
0830 07:54:44.379101 (+ 263us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20250830 07:54:44.395268 13591 tablet_service.cc:1468] Processing CreateTablet for tablet b85843ab0e3a40e1b453cfdd71bbae5e (DEFAULT_TABLE table=default.Table_2e6009ad55fd42afb9f5d177f2b8c272 [id=9c9207d3b60e4781b1cc610cff92c8e6]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:44.395570 13591 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b85843ab0e3a40e1b453cfdd71bbae5e. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:44.395627 13453 tablet_service.cc:1468] Processing CreateTablet for tablet d075a38c613c46398ec533c1e00a24c6 (DEFAULT_TABLE table=default.Table_85cff6310828487f93c6d44cd1770ecb [id=cf2276b202ea4aca98c0d7f5d23aeb89]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:44.395938 13458 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f5471a94dc24a28bce5f9dcaa10334a. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:44.384572 13607 rpcz_store.cc:276] 0830 07:54:43.290208 (+ 0us) service_pool.cc:168] Inserting onto call queue
0830 07:54:44.183593 (+893385us) service_pool.cc:225] Handling call
0830 07:54:44.184067 (+ 474us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0830 07:54:44.184090 (+ 23us) ts_tablet_manager.cc:676] Creating new metadata...
0830 07:54:44.289565 (+105475us) tablet_metadata.cc:641] Metadata flushed
0830 07:54:44.353285 (+ 63720us) tablet_replica.cc:206] Creating consensus instance
0830 07:54:44.353389 (+ 104us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20250830 07:54:44.399130 13882 ts_tablet_manager.cc:1397] T cb3c48982add45379c0e1b117ec40c1a P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.650s user 0.005s sys 0.010s
I20250830 07:54:44.399665 13887 tablet_bootstrap.cc:654] T 53a933afa4b74095baf0f54736d99bf0 P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:44.400635 13455 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 559fdab1ef804325978db705431a0ad8. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:44.405164 13465 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d72ef294123b4bcdb8ff63af5de9c621. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:44.407405 13607 tablet_service.cc:1468] Processing CreateTablet for tablet 1f5471a94dc24a28bce5f9dcaa10334a (DEFAULT_TABLE table=default.Table_8edbcf7950a04e75982f77c91ac9ff84 [id=c048285db66d4bc09170a2bb1e50fe58]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:44.408193 13468 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 506) took 1021 ms. Trace:
W20250830 07:54:44.411218 13229 catalog_manager.cc:5415] Ignoring report from unknown tablet d33a5d107c6849aca6eb48ffdf8a5463
W20250830 07:54:44.411304 13229 catalog_manager.cc:5415] Ignoring report from unknown tablet 533811110191436d96665b3475ab597f
W20250830 07:54:44.411445 13229 catalog_manager.cc:5415] Ignoring report from unknown tablet ef16b9e2d444489699f4db1ac26d5f6c
W20250830 07:54:44.411507 13229 catalog_manager.cc:5415] Ignoring report from unknown tablet b4ab964a64a64e00a78ffd2b220aef46
W20250830 07:54:44.411559 13229 catalog_manager.cc:5415] Ignoring report from unknown tablet 04c9d954106a4417a34ff80bc98e2ce8
I20250830 07:54:44.412117 13229 catalog_manager.cc:5674] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325) does not have the latest schema for tablet 8dddcfe56522436287aea212e316a729 (table default.Table_e0d2400861094b258fca0704d88ed743 [id=c483c08824f24586855e3575a590b294]). Expected version 2 got 0
I20250830 07:54:44.412247 13229 catalog_manager.cc:5674] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325) does not have the latest schema for tablet 99f307a8cbb34addaafab82b3ed18241 (table default.Table_4e2c5e0840fe4d3398519818e193f4dd [id=2a10f84461764fd5ab5a59499a370034]). Expected version 1 got 0
I20250830 07:54:44.412349 13229 catalog_manager.cc:5674] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325) does not have the latest schema for tablet 69d6daeb7c774fd48ed296f52ed7c6a6 (table default.Table_c8fac6974ea94c7e863c1ded184f9230 [id=761247d93d9f4f788ecceabebf1de486]). Expected version 3 got 0
I20250830 07:54:44.414501 13229 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_34028d46b5fa400a959628ad3dded830"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:44.415181 13229 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_34028d46b5fa400a959628ad3dded830 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:44.423946 13228 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet f52dd8eeb64a4b8a92babf34387b6c5b
I20250830 07:54:44.424535 13228 catalog_manager.cc:6652] ReplaceTablet: tablet f52dd8eeb64a4b8a92babf34387b6c5b deleted and replaced by tablet 40ce920462584c25b19befa4146b340f
I20250830 07:54:44.424934 13228 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_f85973cf63a24b8f8f1a9ad8d8561abb" } modify_external_catalogs: true
I20250830 07:54:44.425091 13590 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 494) took 1047 ms. Trace:
I20250830 07:54:44.425163 13228 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_f85973cf63a24b8f8f1a9ad8d8561abb" } modify_external_catalogs: true
I20250830 07:54:44.425207 13590 rpcz_store.cc:276] 0830 07:54:43.289494 (+ 0us) service_pool.cc:168] Inserting onto call queue
0830 07:54:44.113183 (+823689us) service_pool.cc:225] Handling call
0830 07:54:44.129037 (+ 15854us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0830 07:54:44.129065 (+ 28us) ts_tablet_manager.cc:676] Creating new metadata...
0830 07:54:44.247770 (+118705us) tablet_metadata.cc:641] Metadata flushed
0830 07:54:44.250893 (+ 3123us) tablet_replica.cc:206] Creating consensus instance
0830 07:54:44.336914 (+ 86021us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20250830 07:54:44.426466 13590 tablet_service.cc:1468] Processing CreateTablet for tablet b4c345013ff04cf991989f456aa2d420 (DEFAULT_TABLE table=default.Table_005af599605e4bd090ba828f70a19003 [id=edbafe796f4049feb1d4331956940568]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:44.427529 13599 tablet_service.cc:1468] Processing CreateTablet for tablet 53766699d42e4f6e9b42d9a98613726c (DEFAULT_TABLE table=default.Table_a4097958af86408498f5bc26a4fc0871 [id=0ca73c1fbe9f48ad82737dca6997e50e]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:44.426187 13598 rpcz_store.cc:276] 0830 07:54:43.290959 (+ 0us) service_pool.cc:168] Inserting onto call queue
0830 07:54:44.282734 (+991775us) service_pool.cc:225] Handling call
0830 07:54:44.345678 (+ 62944us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0830 07:54:44.345704 (+ 26us) ts_tablet_manager.cc:676] Creating new metadata...
0830 07:54:44.371049 (+ 25345us) tablet_metadata.cc:641] Metadata flushed
0830 07:54:44.373375 (+ 2326us) tablet_replica.cc:206] Creating consensus instance
0830 07:54:44.373485 (+ 110us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":10880}
W20250830 07:54:44.431530 13233 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 91705fc35a1b4977b89bac1765c886c0 consensus state has no leader
I20250830 07:54:44.431805 13233 master_service.cc:948] ReplaceTablet: received request to replace tablet d3b47314f7cd4e969d973c0a340137f1 from {username='slave'} at 127.0.0.1:42126
I20250830 07:54:44.434652 13132 master_runner.cc:186] Error getting master registration for 127.12.209.60:43889: Network error: Client connection negotiation failed: client connection to 127.12.209.60:43889: connect: Connection refused (error 111),
I20250830 07:54:44.434804 13132 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20250830 07:54:44.436656 13600 rpcz_store.cc:276] 0830 07:54:43.290490 (+ 0us) service_pool.cc:168] Inserting onto call queue
0830 07:54:44.185042 (+894552us) service_pool.cc:225] Handling call
0830 07:54:44.185543 (+ 501us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0830 07:54:44.185566 (+ 23us) ts_tablet_manager.cc:676] Creating new metadata...
0830 07:54:44.317451 (+131885us) tablet_metadata.cc:641] Metadata flushed
0830 07:54:44.320237 (+ 2786us) tablet_replica.cc:206] Creating consensus instance
0830 07:54:44.375377 (+ 55140us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20250830 07:54:44.437052 13600 tablet_service.cc:1468] Processing CreateTablet for tablet 559fdab1ef804325978db705431a0ad8 (DEFAULT_TABLE table=default.Table_ceb6b6a4e5014de182da8b467ca360f1 [id=7be8407046b4444e96e2bdee08cc5900]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:44.437788 13597 rpcz_store.cc:276] 0830 07:54:43.290102 (+ 0us) service_pool.cc:168] Inserting onto call queue
0830 07:54:44.182932 (+892830us) service_pool.cc:225] Handling call
0830 07:54:44.183354 (+ 422us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0830 07:54:44.183381 (+ 27us) ts_tablet_manager.cc:676] Creating new metadata...
0830 07:54:44.286172 (+102791us) tablet_metadata.cc:641] Metadata flushed
0830 07:54:44.359718 (+ 73546us) tablet_replica.cc:206] Creating consensus instance
0830 07:54:44.359828 (+ 110us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20250830 07:54:44.438167 13597 tablet_service.cc:1468] Processing CreateTablet for tablet d075a38c613c46398ec533c1e00a24c6 (DEFAULT_TABLE table=default.Table_85cff6310828487f93c6d44cd1770ecb [id=cf2276b202ea4aca98c0d7f5d23aeb89]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:44.443761 13771 raft_consensus.cc:2466] T b38c8d003413428dae9e47f58e197c2c P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b5e454d98894637b466ea27f1b647f9 in term 1.
I20250830 07:54:44.443802 13744 rpcz_store.cc:276] 0830 07:54:43.106038 (+ 0us) service_pool.cc:168] Inserting onto call queue
0830 07:54:43.445772 (+339734us) service_pool.cc:225] Handling call
0830 07:54:43.641772 (+196000us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0830 07:54:43.641820 (+ 48us) ts_tablet_manager.cc:676] Creating new metadata...
0830 07:54:44.192259 (+550439us) tablet_metadata.cc:641] Metadata flushed
0830 07:54:44.286851 (+ 94592us) tablet_replica.cc:206] Creating consensus instance
0830 07:54:44.286988 (+ 137us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20250830 07:54:44.443778 13748 rpcz_store.cc:276] 0830 07:54:43.087328 (+ 0us) service_pool.cc:168] Inserting onto call queue
0830 07:54:43.414246 (+326918us) service_pool.cc:225] Handling call
0830 07:54:43.518796 (+104550us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0830 07:54:43.518822 (+ 26us) ts_tablet_manager.cc:676] Creating new metadata...
0830 07:54:44.291046 (+772224us) tablet_metadata.cc:641] Metadata flushed
0830 07:54:44.330776 (+ 39730us) tablet_replica.cc:206] Creating consensus instance
0830 07:54:44.330892 (+ 116us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20250830 07:54:44.444367 13591 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 508) took 1150 ms. Trace:
I20250830 07:54:44.447330 13739 rpcz_store.cc:276] 0830 07:54:42.920912 (+ 0us) service_pool.cc:168] Inserting onto call queue
0830 07:54:43.332660 (+411748us) service_pool.cc:225] Handling call
0830 07:54:43.401589 (+ 68929us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0830 07:54:43.401614 (+ 25us) ts_tablet_manager.cc:676] Creating new metadata...
0830 07:54:44.192945 (+791331us) tablet_metadata.cc:641] Metadata flushed
0830 07:54:44.297265 (+104320us) tablet_replica.cc:206] Creating consensus instance
0830 07:54:44.297378 (+ 113us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20250830 07:54:44.447520 13741 rpcz_store.cc:276] 0830 07:54:43.152996 (+ 0us) service_pool.cc:168] Inserting onto call queue
0830 07:54:43.948839 (+795843us) service_pool.cc:225] Handling call
0830 07:54:43.949532 (+ 693us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0830 07:54:43.949560 (+ 28us) ts_tablet_manager.cc:676] Creating new metadata...
0830 07:54:44.189338 (+239778us) tablet_metadata.cc:641] Metadata flushed
0830 07:54:44.293437 (+104099us) tablet_replica.cc:206] Creating consensus instance
0830 07:54:44.293544 (+ 107us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20250830 07:54:44.448184 13742 rpcz_store.cc:276] 0830 07:54:43.096087 (+ 0us) service_pool.cc:168] Inserting onto call queue
0830 07:54:43.421484 (+325397us) service_pool.cc:225] Handling call
0830 07:54:43.642004 (+220520us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0830 07:54:43.642056 (+ 52us) ts_tablet_manager.cc:676] Creating new metadata...
0830 07:54:44.301204 (+659148us) tablet_metadata.cc:641] Metadata flushed
0830 07:54:44.303494 (+ 2290us) tablet_replica.cc:206] Creating consensus instance
0830 07:54:44.303595 (+ 101us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20250830 07:54:44.448612 13751 tablet_service.cc:1515] Processing DeleteTablet for tablet 2c31d119743f49589703c434ac6c7548 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:42 UTC) from {username='slave'} at 127.0.0.1:45460
I20250830 07:54:44.448916 13749 rpcz_store.cc:276] 0830 07:54:43.154625 (+ 0us) service_pool.cc:168] Inserting onto call queue
0830 07:54:43.955106 (+800481us) service_pool.cc:225] Handling call
0830 07:54:43.955572 (+ 466us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0830 07:54:43.955597 (+ 25us) ts_tablet_manager.cc:676] Creating new metadata...
0830 07:54:43.959975 (+ 4378us) tablet_metadata.cc:641] Metadata flushed
0830 07:54:44.298615 (+338640us) tablet_replica.cc:206] Creating consensus instance
0830 07:54:44.298735 (+ 120us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20250830 07:54:44.447839 13591 rpcz_store.cc:276] 0830 07:54:43.291261 (+ 0us) service_pool.cc:168] Inserting onto call queue
0830 07:54:44.351896 (+1060635us) service_pool.cc:225] Handling call
0830 07:54:44.395422 (+ 43526us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0830 07:54:44.395442 (+ 20us) ts_tablet_manager.cc:676] Creating new metadata...
0830 07:54:44.439686 (+ 44244us) tablet_metadata.cc:641] Metadata flushed
0830 07:54:44.441975 (+ 2289us) tablet_replica.cc:206] Creating consensus instance
0830 07:54:44.442100 (+ 125us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20250830 07:54:44.455749 13598 tablet_service.cc:1468] Processing CreateTablet for tablet d72ef294123b4bcdb8ff63af5de9c621 (DEFAULT_TABLE table=default.Table_83d1032daed546d9ac781ef43a37179b [id=22bbb1ac25e74341b0e5b522388588c7]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:44.456485 13752 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 470) took 1292 ms. Trace:
I20250830 07:54:44.456667 13593 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 91da20bcd25341b5a0f6605b3ec58fb3. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:44.456976 13744 tablet_service.cc:1515] Processing DeleteTablet for tablet 2d91b0ba74034b85812a13719e21dc6c with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:42 UTC) from {username='slave'} at 127.0.0.1:45460
I20250830 07:54:44.458170 13748 tablet_service.cc:1468] Processing CreateTablet for tablet 122bec4220c74dfaa8228f6d153cd50e (DEFAULT_TABLE table=default.Table_b520311338ac432283a508831f98574e [id=77861ebf6e5646c285d6e72dec5a67bc]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:44.459275 13594 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 456) took 1377 ms. Trace:
I20250830 07:54:44.459355 13594 rpcz_store.cc:276] 0830 07:54:43.000244 (+ 0us) service_pool.cc:168] Inserting onto call queue
0830 07:54:43.251224 (+250980us) service_pool.cc:225] Handling call
0830 07:54:43.312960 (+ 61736us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0830 07:54:43.312982 (+ 22us) ts_tablet_manager.cc:676] Creating new metadata...
0830 07:54:44.269783 (+956801us) tablet_metadata.cc:641] Metadata flushed
0830 07:54:44.375241 (+105458us) tablet_replica.cc:206] Creating consensus instance
0830 07:54:44.377195 (+ 1954us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20250830 07:54:44.463402 13744 tablet_service.cc:1468] Processing CreateTablet for tablet 0f34ed0fe6e9400fae5c0edebb615ebd (DEFAULT_TABLE table=default.Table_153646ff157d493ba4c4f4ec4368cc52 [id=ffff902660804d0f9f4b0bcd5053cb72]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:44.464175 13742 tablet_service.cc:1468] Processing CreateTablet for tablet e7e9d2e9b1ca4ddfb0c6a7bced613c35 (DEFAULT_TABLE table=default.Table_4c8064376b504b74bea14908e716c0b3 [id=8d8684f2399d4af3b6dab1912ab6c7d6]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:44.465487 13597 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d075a38c613c46398ec533c1e00a24c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:44.465817 13740 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad7a45187569416bad6c71db9f8ab702. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:44.448499 14761 rpcz_store.cc:276] 0830 07:54:43.153109 (+ 0us) service_pool.cc:168] Inserting onto call queue
0830 07:54:43.949175 (+796066us) service_pool.cc:225] Handling call
0830 07:54:44.278456 (+329281us) ts_tablet_manager.cc:1145] Deleting tablet f1fe024f0de048a5a0931ee38752d5a1
0830 07:54:44.278471 (+ 15us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0830 07:54:44.278594 (+ 123us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":329037,"thread_start_us":364667,"threads_started":1}
I20250830 07:54:44.474574 13600 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 559fdab1ef804325978db705431a0ad8. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:44.475780 13601 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 505) took 1128 ms. Trace:
I20250830 07:54:44.477291 13744 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f34ed0fe6e9400fae5c0edebb615ebd. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:44.479023 13594 tablet_service.cc:1468] Processing CreateTablet for tablet c6355878115a4907ae1f0a45fb2c6492 (DEFAULT_TABLE table=default.Table_844cfa31981f4db594c87b260d390b06 [id=346b4d93dd41412aa8f8a2c74fff72e9]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:44.480448 13773 raft_consensus.cc:3058] T 7af74bdde363493f8061eba450ecf4b4 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:44.485496 13595 rpcz_store.cc:276] 0830 07:54:43.291086 (+ 0us) service_pool.cc:168] Inserting onto call queue
0830 07:54:44.350286 (+1059200us) service_pool.cc:225] Handling call
0830 07:54:44.354748 (+ 4462us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0830 07:54:44.354765 (+ 17us) ts_tablet_manager.cc:676] Creating new metadata...
0830 07:54:44.378418 (+ 23653us) tablet_metadata.cc:641] Metadata flushed
0830 07:54:44.384034 (+ 5616us) tablet_replica.cc:206] Creating consensus instance
0830 07:54:44.384145 (+ 111us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20250830 07:54:44.410627 13452 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 507) took 1024 ms. Trace:
I20250830 07:54:44.434258 14756 raft_consensus.cc:491] T 533811110191436d96665b3475ab597f P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:44.487126 13595 tablet_service.cc:1468] Processing CreateTablet for tablet bac72b4ba9ba4ca69f93e799dccb0e93 (DEFAULT_TABLE table=default.Table_6b7fef7c0eba4cd5b26659f55457349d [id=e39f1c24862b4b0b9ac3104df120461b]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:44.445195 13450 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 504) took 1059 ms. Trace:
I20250830 07:54:44.485913 13601 rpcz_store.cc:276] 0830 07:54:43.290810 (+ 0us) service_pool.cc:168] Inserting onto call queue
0830 07:54:44.281705 (+990895us) service_pool.cc:225] Handling call
0830 07:54:44.345433 (+ 63728us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0830 07:54:44.345461 (+ 28us) ts_tablet_manager.cc:676] Creating new metadata...
0830 07:54:44.365796 (+ 20335us) tablet_metadata.cc:641] Metadata flushed
0830 07:54:44.419481 (+ 53685us) tablet_replica.cc:206] Creating consensus instance
0830 07:54:44.419621 (+ 140us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20250830 07:54:44.455391 13449 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 442) took 1491 ms. Trace:
I20250830 07:54:44.457923 13461 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 492) took 1189 ms. Trace:
I20250830 07:54:44.459097 13453 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d075a38c613c46398ec533c1e00a24c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:44.460718 13454 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 503) took 1074 ms. Trace:
I20250830 07:54:44.487776 13601 tablet_service.cc:1468] Processing CreateTablet for tablet 75359721445e48d2bc0dd6fd17649bc1 (DEFAULT_TABLE table=default.Table_618200045a4b44908fc6e99de0c2788e [id=554293853df24d7a8c6721d441ef8622]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:44.463460 13459 tablet_service.cc:1515] Processing DeleteTablet for tablet c56e3a30c18640e68c8b0c4ff4251d96 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:43 UTC) from {username='slave'} at 127.0.0.1:37956
I20250830 07:54:44.488772 13742 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7e9d2e9b1ca4ddfb0c6a7bced613c35. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:44.489630 13748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 122bec4220c74dfaa8228f6d153cd50e. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:44.490159 14756 raft_consensus.cc:513] T 533811110191436d96665b3475ab597f P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:44.490542 13591 tablet_service.cc:1515] Processing DeleteTablet for tablet 042fd7ff08fc4695b87bb8f9d225ef12 with delete_type TABLET_DATA_DELETED (replaced by tablet f2ebc809f1074db78720920286d9385b) from {username='slave'} at 127.0.0.1:45306
I20250830 07:54:44.491351 14756 leader_election.cc:290] T 533811110191436d96665b3475ab597f P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:44.491505 13596 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 504) took 1200 ms. Trace:
I20250830 07:54:44.492017 13452 rpcz_store.cc:276] 0830 07:54:43.386446 (+ 0us) service_pool.cc:168] Inserting onto call queue
0830 07:54:44.255764 (+869318us) service_pool.cc:225] Handling call
0830 07:54:44.256178 (+ 414us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0830 07:54:44.256198 (+ 20us) ts_tablet_manager.cc:676] Creating new metadata...
0830 07:54:44.281685 (+ 25487us) tablet_metadata.cc:641] Metadata flushed
0830 07:54:44.410469 (+128784us) tablet_replica.cc:206] Creating consensus instance
0830 07:54:44.410595 (+ 126us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20250830 07:54:44.492444 13755 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 458) took 1339 ms. Trace:
I20250830 07:54:44.492547 13755 rpcz_store.cc:276] 0830 07:54:43.152874 (+ 0us) service_pool.cc:168] Inserting onto call queue
0830 07:54:43.832433 (+679559us) service_pool.cc:225] Handling call
0830 07:54:43.889690 (+ 57257us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0830 07:54:43.889750 (+ 60us) ts_tablet_manager.cc:676] Creating new metadata...
0830 07:54:44.295129 (+405379us) tablet_metadata.cc:641] Metadata flushed
0830 07:54:44.490648 (+195519us) tablet_replica.cc:206] Creating consensus instance
0830 07:54:44.491983 (+ 1335us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20250830 07:54:44.492781 13452 tablet_service.cc:1468] Processing CreateTablet for tablet b678fd915c534a2dac8521c21ab93396 (DEFAULT_TABLE table=default.Table_1c93edc0678341fea10a950688a68c08 [id=b966d9c7fdf5493e9c0d825ac703fb28]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:44.493254 13452 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b678fd915c534a2dac8521c21ab93396. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:44.494686 13609 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 511) took 1203 ms. Trace:
I20250830 07:54:44.495033 13755 tablet_service.cc:1468] Processing CreateTablet for tablet c6355878115a4907ae1f0a45fb2c6492 (DEFAULT_TABLE table=default.Table_844cfa31981f4db594c87b260d390b06 [id=346b4d93dd41412aa8f8a2c74fff72e9]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:44.495033 13454 rpcz_store.cc:276] 0830 07:54:43.385773 (+ 0us) service_pool.cc:168] Inserting onto call queue
0830 07:54:44.189392 (+803619us) service_pool.cc:225] Handling call
0830 07:54:44.200324 (+ 10932us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0830 07:54:44.200350 (+ 26us) ts_tablet_manager.cc:676] Creating new metadata...
0830 07:54:44.289288 (+ 88938us) tablet_metadata.cc:641] Metadata flushed
0830 07:54:44.460560 (+171272us) tablet_replica.cc:206] Creating consensus instance
0830 07:54:44.460671 (+ 111us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20250830 07:54:44.495388 13755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c6355878115a4907ae1f0a45fb2c6492. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:44.495491 13454 tablet_service.cc:1468] Processing CreateTablet for tablet 4df6d481baab40e2b2c1309d1a8c5351 (DEFAULT_TABLE table=default.Table_ed76689fb0754162aa9b23002b8d6013 [id=34800e0b41c14e6db8e310f0d414c59b]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:44.495666 13607 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f5471a94dc24a28bce5f9dcaa10334a. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:44.495945 13454 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4df6d481baab40e2b2c1309d1a8c5351. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:44.491642 13596 rpcz_store.cc:276] 0830 07:54:43.290705 (+ 0us) service_pool.cc:168] Inserting onto call queue
0830 07:54:44.280757 (+990052us) service_pool.cc:225] Handling call
0830 07:54:44.342170 (+ 61413us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0830 07:54:44.342206 (+ 36us) ts_tablet_manager.cc:676] Creating new metadata...
0830 07:54:44.356767 (+ 14561us) tablet_metadata.cc:641] Metadata flushed
0830 07:54:44.465319 (+108552us) tablet_replica.cc:206] Creating consensus instance
0830 07:54:44.491495 (+ 26176us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20250830 07:54:44.494951 13609 rpcz_store.cc:276] 0830 07:54:43.291689 (+ 0us) service_pool.cc:168] Inserting onto call queue
0830 07:54:44.362708 (+1071019us) service_pool.cc:225] Handling call
0830 07:54:44.394038 (+ 31330us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0830 07:54:44.394064 (+ 26us) ts_tablet_manager.cc:676] Creating new metadata...
0830 07:54:44.449023 (+ 54959us) tablet_metadata.cc:641] Metadata flushed
0830 07:54:44.494307 (+ 45284us) tablet_replica.cc:206] Creating consensus instance
0830 07:54:44.494636 (+ 329us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20250830 07:54:44.498736 13596 tablet_service.cc:1515] Processing DeleteTablet for tablet 5dffbacf2fcd4a38a1d61cf5bb9c5eeb with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:43 UTC) from {username='slave'} at 127.0.0.1:45306
I20250830 07:54:44.499958 13468 rpcz_store.cc:276] 0830 07:54:43.386280 (+ 0us) service_pool.cc:168] Inserting onto call queue
0830 07:54:44.227885 (+841605us) service_pool.cc:225] Handling call
0830 07:54:44.229007 (+ 1122us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0830 07:54:44.229028 (+ 21us) ts_tablet_manager.cc:676] Creating new metadata...
0830 07:54:44.368074 (+139046us) tablet_metadata.cc:641] Metadata flushed
0830 07:54:44.408048 (+ 39974us) tablet_replica.cc:206] Creating consensus instance
0830 07:54:44.408160 (+ 112us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20250830 07:54:44.500099 14761 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45460 (request call id 474) took 1334 ms. Trace:
I20250830 07:54:44.500551 13468 tablet_service.cc:1468] Processing CreateTablet for tablet 370441c443be46c2a33132fbc5c41f89 (DEFAULT_TABLE table=default.Table_f21862e4d3614f3599c1f8c6b3a0d624 [id=5a0934cf98934953bdf1cd9b5abf2192]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:44.501091 13468 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 370441c443be46c2a33132fbc5c41f89. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:44.501103 13754 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 468) took 1335 ms. Trace:
I20250830 07:54:44.501715 13754 rpcz_store.cc:276] 0830 07:54:43.163786 (+ 0us) service_pool.cc:168] Inserting onto call queue
0830 07:54:44.188874 (+1025088us) service_pool.cc:225] Handling call
0830 07:54:44.227594 (+ 38720us) spinlock_profiling.cc:243] Waited 6.72 ms on lock 0x61800000d518. stack: 00007fd0bf5707d6 00007fd0bf570590 00007fd0be5633ad 0000000000972d94 0000000000972d5d 000000000097272a 00007fd0bf5590dd 00007fd0bf558cfe 00007fd0d2bd6bdd 00007fd0d2bd6b7c 00007fd0cee07904 00007fd0ceddffcd 00007fd0ced34a62 00007fd0c8f346a6 00007fd0c8f343d5 00007fd0c631e2ce
0830 07:54:44.227621 (+ 27us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0830 07:54:44.227641 (+ 20us) ts_tablet_manager.cc:676] Creating new metadata...
0830 07:54:44.260357 (+ 32716us) tablet_metadata.cc:641] Metadata flushed
0830 07:54:44.499136 (+238779us) tablet_replica.cc:206] Creating consensus instance
0830 07:54:44.499248 (+ 112us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":15465216}
I20250830 07:54:44.502144 13754 tablet_service.cc:1468] Processing CreateTablet for tablet bac72b4ba9ba4ca69f93e799dccb0e93 (DEFAULT_TABLE table=default.Table_6b7fef7c0eba4cd5b26659f55457349d [id=e39f1c24862b4b0b9ac3104df120461b]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:44.502769 13449 rpcz_store.cc:276] 0830 07:54:42.983601 (+ 0us) service_pool.cc:168] Inserting onto call queue
0830 07:54:43.339654 (+356053us) service_pool.cc:225] Handling call
0830 07:54:43.380207 (+ 40553us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0830 07:54:43.380229 (+ 22us) ts_tablet_manager.cc:676] Creating new metadata...
0830 07:54:44.295970 (+915741us) tablet_metadata.cc:641] Metadata flushed
0830 07:54:44.418863 (+122893us) tablet_replica.cc:206] Creating consensus instance
0830 07:54:44.455321 (+ 36458us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20250830 07:54:44.500195 14761 rpcz_store.cc:276] 0830 07:54:43.164353 (+ 0us) service_pool.cc:168] Inserting onto call queue
0830 07:54:44.274073 (+1109720us) service_pool.cc:225] Handling call
0830 07:54:44.472362 (+198289us) ts_tablet_manager.cc:1145] Deleting tablet e4ca3110247640fbae4241448e8d5ef7
0830 07:54:44.472371 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0830 07:54:44.499284 (+ 26913us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":28875}
I20250830 07:54:44.504560 13592 tablet_service.cc:1515] Processing DeleteTablet for tablet 2b4103f07e96490488913059a95af0c3 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:43 UTC) from {username='slave'} at 127.0.0.1:45306
I20250830 07:54:44.505287 13773 raft_consensus.cc:2466] T 7af74bdde363493f8061eba450ecf4b4 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b5e454d98894637b466ea27f1b647f9 in term 1.
I20250830 07:54:44.478607 13458 tablet_service.cc:1515] Processing DeleteTablet for tablet 042fd7ff08fc4695b87bb8f9d225ef12 with delete_type TABLET_DATA_DELETED (replaced by tablet f2ebc809f1074db78720920286d9385b) from {username='slave'} at 127.0.0.1:37956
I20250830 07:54:44.485118 13456 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 490) took 1273 ms. Trace:
I20250830 07:54:44.509614 13460 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 509) took 1039 ms. Trace:
I20250830 07:54:44.504912 13594 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c6355878115a4907ae1f0a45fb2c6492. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:44.509958 13737 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 469) took 1346 ms. Trace:
I20250830 07:54:44.510457 13467 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 514) took 1040 ms. Trace:
I20250830 07:54:44.510437 13737 rpcz_store.cc:276] 0830 07:54:43.163887 (+ 0us) service_pool.cc:168] Inserting onto call queue
0830 07:54:44.189481 (+1025594us) service_pool.cc:225] Handling call
0830 07:54:44.218145 (+ 28664us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0830 07:54:44.218170 (+ 25us) ts_tablet_manager.cc:676] Creating new metadata...
0830 07:54:44.487135 (+268965us) tablet_metadata.cc:641] Metadata flushed
0830 07:54:44.509799 (+ 22664us) tablet_replica.cc:206] Creating consensus instance
0830 07:54:44.509929 (+ 130us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20250830 07:54:44.510793 13737 tablet_service.cc:1468] Processing CreateTablet for tablet f192693039a24e3cb0bec646c8d11056 (DEFAULT_TABLE table=default.Table_98722818dc7c4e3284220440947a4cbf [id=9eba8c5b208640b69c94f332fdc4e56e]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:44.511693 13754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bac72b4ba9ba4ca69f93e799dccb0e93. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:44.512801 13449 tablet_service.cc:1468] Processing CreateTablet for tablet dad2dfa1a19d45778933780b1029d924 (DEFAULT_TABLE table=default.Table_fdf6b173da034defb96d857c29760d5e [id=057b3ca5735944209509cf2d47ae25fa]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:44.513245 13449 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dad2dfa1a19d45778933780b1029d924. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:44.514253 13737 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f192693039a24e3cb0bec646c8d11056. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:44.514341 13450 rpcz_store.cc:276] 0830 07:54:43.385955 (+ 0us) service_pool.cc:168] Inserting onto call queue
0830 07:54:44.216430 (+830475us) service_pool.cc:225] Handling call
0830 07:54:44.221467 (+ 5037us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0830 07:54:44.221486 (+ 19us) ts_tablet_manager.cc:676] Creating new metadata...
0830 07:54:44.364240 (+142754us) tablet_metadata.cc:641] Metadata flushed
0830 07:54:44.444976 (+ 80736us) tablet_replica.cc:206] Creating consensus instance
0830 07:54:44.445128 (+ 152us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20250830 07:54:44.515276 13592 tablet_service.cc:1515] Processing DeleteTablet for tablet d206f6b6e7524a27a9f95787bcd5de77 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:43 UTC) from {username='slave'} at 127.0.0.1:45306
I20250830 07:54:44.514084 13461 rpcz_store.cc:276] 0830 07:54:43.268700 (+ 0us) service_pool.cc:168] Inserting onto call queue
0830 07:54:44.140314 (+871614us) service_pool.cc:225] Handling call
0830 07:54:44.140674 (+ 360us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0830 07:54:44.140708 (+ 34us) ts_tablet_manager.cc:676] Creating new metadata...
0830 07:54:44.243729 (+103021us) tablet_metadata.cc:641] Metadata flushed
0830 07:54:44.455053 (+211324us) tablet_replica.cc:206] Creating consensus instance
0830 07:54:44.457876 (+ 2823us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20250830 07:54:44.516088 13605 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 497) took 1201 ms. Trace:
I20250830 07:54:44.516072 13456 rpcz_store.cc:276] 0830 07:54:43.209464 (+ 0us) service_pool.cc:168] Inserting onto call queue
0830 07:54:44.125097 (+915633us) service_pool.cc:225] Handling call
0830 07:54:44.211619 (+ 86522us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0830 07:54:44.211648 (+ 29us) ts_tablet_manager.cc:676] Creating new metadata...
0830 07:54:44.303740 (+ 92092us) tablet_metadata.cc:641] Metadata flushed
0830 07:54:44.482681 (+178941us) tablet_replica.cc:206] Creating consensus instance
0830 07:54:44.482842 (+ 161us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20250830 07:54:44.516233 13605 rpcz_store.cc:276] 0830 07:54:43.289850 (+ 0us) service_pool.cc:168] Inserting onto call queue
0830 07:54:44.181674 (+891824us) service_pool.cc:225] Handling call
0830 07:54:44.182051 (+ 377us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0830 07:54:44.182074 (+ 23us) ts_tablet_manager.cc:676] Creating new metadata...
0830 07:54:44.340159 (+158085us) tablet_metadata.cc:641] Metadata flushed
0830 07:54:44.473671 (+133512us) tablet_replica.cc:206] Creating consensus instance
0830 07:54:44.491375 (+ 17704us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20250830 07:54:44.517287 13609 tablet_service.cc:1515] Processing DeleteTablet for tablet 283aa82b808e49528ceb19133748ffc8 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:43 UTC) from {username='slave'} at 127.0.0.1:45306
I20250830 07:54:44.517740 13593 tablet_service.cc:1468] Processing CreateTablet for tablet 5dffbacf2fcd4a38a1d61cf5bb9c5eeb (DEFAULT_TABLE table=default.Table_f8d552f66f96486cb2b5984a52b993ce [id=803bcda3ed6641749163c3162af467f2]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:44.518127 13602 tablet_service.cc:1515] Processing DeleteTablet for tablet e6b7646588fe4134b2db62ff84ca4791 with delete_type TABLET_DATA_DELETED (replaced by tablet 6bb062f9c4e342489422c8faabfb1b9b) from {username='slave'} at 127.0.0.1:45306
I20250830 07:54:44.518455 13739 tablet_service.cc:1468] Processing CreateTablet for tablet 8ee98b748d0245bc8bf9eeac727b495e (DEFAULT_TABLE table=default.Table_b59b0e75bbee4971912072e1174aad74 [id=dadcb9b0dfca4aabbdafef5727a1fc3c]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:44.518676 13605 tablet_service.cc:1515] Processing DeleteTablet for tablet 23d2c7013c9c4b4aacf47e6ac7ab5a0b with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:43 UTC) from {username='slave'} at 127.0.0.1:45306
I20250830 07:54:44.520208 13596 tablet_service.cc:1515] Processing DeleteTablet for tablet c56e3a30c18640e68c8b0c4ff4251d96 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:43 UTC) from {username='slave'} at 127.0.0.1:45306
I20250830 07:54:44.520550 13602 tablet_service.cc:1515] Processing DeleteTablet for tablet 0c32e597f17e4e75a0f584b6b7b02c36 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:43 UTC) from {username='slave'} at 127.0.0.1:45306
I20250830 07:54:44.520777 13605 tablet_service.cc:1515] Processing DeleteTablet for tablet f52dd8eeb64a4b8a92babf34387b6c5b with delete_type TABLET_DATA_DELETED (replaced by tablet 40ce920462584c25b19befa4146b340f) from {username='slave'} at 127.0.0.1:45306
I20250830 07:54:44.521549 13739 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ee98b748d0245bc8bf9eeac727b495e. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:44.521732 13603 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 510) took 1230 ms. Trace:
I20250830 07:54:44.521791 13603 rpcz_store.cc:276] 0830 07:54:43.291554 (+ 0us) service_pool.cc:168] Inserting onto call queue
0830 07:54:44.361842 (+1070288us) service_pool.cc:225] Handling call
0830 07:54:44.363011 (+ 1169us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0830 07:54:44.363046 (+ 35us) ts_tablet_manager.cc:676] Creating new metadata...
0830 07:54:44.479722 (+116676us) tablet_metadata.cc:641] Metadata flushed
0830 07:54:44.521621 (+ 41899us) tablet_replica.cc:206] Creating consensus instance
0830 07:54:44.521718 (+ 97us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20250830 07:54:44.522034 13886 tablet_bootstrap.cc:492] T 99f307a8cbb34addaafab82b3ed18241 P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:54:44.522176 13886 ts_tablet_manager.cc:1397] T 99f307a8cbb34addaafab82b3ed18241 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.578s user 0.009s sys 0.004s
I20250830 07:54:44.522912 13701 leader_election.cc:304] T d3f207cee78a43a1b5e030c09752c78c P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:54:44.523898 13745 tablet_service.cc:1515] Processing DeleteTablet for tablet 65f1ee59e6e9498381d686f16a865e23 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:42 UTC) from {username='slave'} at 127.0.0.1:45460
I20250830 07:54:44.524142 13740 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 473) took 1353 ms. Trace:
I20250830 07:54:44.524910 13741 tablet_service.cc:1468] Processing CreateTablet for tablet 7e9d6af1d7fc4d4b961583b44f2f962a (DEFAULT_TABLE table=default.Table_a7d9a21ec2e74f30a2ce61cdcdd33685 [id=957201242ea748618cc610a5002a8684]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:44.525236 13609 tablet_service.cc:1515] Processing DeleteTablet for tablet db7144b25ff34bed8c7b779ba9497ef4 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:43 UTC) from {username='slave'} at 127.0.0.1:45306
I20250830 07:54:44.525578 13590 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4c345013ff04cf991989f456aa2d420. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:44.528476 13464 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 505) took 1120 ms. Trace:
I20250830 07:54:44.528594 13464 rpcz_store.cc:276] 0830 07:54:43.386103 (+ 0us) service_pool.cc:168] Inserting onto call queue
0830 07:54:44.225914 (+839811us) service_pool.cc:225] Handling call
0830 07:54:44.271253 (+ 45339us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0830 07:54:44.271291 (+ 38us) ts_tablet_manager.cc:676] Creating new metadata...
0830 07:54:44.420636 (+149345us) tablet_metadata.cc:641] Metadata flushed
0830 07:54:44.488447 (+ 67811us) tablet_replica.cc:206] Creating consensus instance
0830 07:54:44.506572 (+ 18125us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20250830 07:54:44.531196 13599 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 53766699d42e4f6e9b42d9a98613726c. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:44.532902 13595 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bac72b4ba9ba4ca69f93e799dccb0e93. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:44.533051 13464 tablet_service.cc:1515] Processing DeleteTablet for tablet 5dffbacf2fcd4a38a1d61cf5bb9c5eeb with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:43 UTC) from {username='slave'} at 127.0.0.1:37956
I20250830 07:54:44.533428 13601 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75359721445e48d2bc0dd6fd17649bc1. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:44.533679 13464 tablet_service.cc:1515] Processing DeleteTablet for tablet 2b4103f07e96490488913059a95af0c3 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:43 UTC) from {username='slave'} at 127.0.0.1:37956
I20250830 07:54:44.535986 13461 tablet_service.cc:1468] Processing CreateTablet for tablet 2d91b0ba74034b85812a13719e21dc6c (DEFAULT_TABLE table=default.Table_d978d625ae9f4ac5ad252d8e982685f7 [id=9fd46fc815604123bcb15dc7ecd892a9]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:44.536345 13461 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d91b0ba74034b85812a13719e21dc6c. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:44.537573 13232 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet 838616d8274648fc9ea4f1583bdb97f9
I20250830 07:54:44.538226 13232 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_481f218fb1b94c81b8f0932c67bb5b55" } new_table_name: "default.Table_842d6de7e7c24438af9d52c6f779b657" modify_external_catalogs: true
I20250830 07:54:44.538247 13233 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_dd2ace0925144bbea283b6535233e4a9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:44.538797 13233 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_dd2ace0925144bbea283b6535233e4a9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:44.539021 13741 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e9d6af1d7fc4d4b961583b44f2f962a. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:44.539209 13234 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet 88bbd6b4c795433d9b6ad746353f3aa1
W20250830 07:54:44.540812 13701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.209.1:45325, user_credentials={real_user=slave}} blocked reactor thread for 131765us
I20250830 07:54:44.543871 13753 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 467) took 1388 ms. Trace:
I20250830 07:54:44.544430 13606 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 503) took 1253 ms. Trace:
I20250830 07:54:44.544492 13606 rpcz_store.cc:276] 0830 07:54:43.290591 (+ 0us) service_pool.cc:168] Inserting onto call queue
0830 07:54:44.216279 (+925688us) service_pool.cc:225] Handling call
0830 07:54:44.345536 (+129257us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0830 07:54:44.345560 (+ 24us) ts_tablet_manager.cc:676] Creating new metadata...
0830 07:54:44.381478 (+ 35918us) tablet_metadata.cc:641] Metadata flushed
0830 07:54:44.544300 (+162822us) tablet_replica.cc:206] Creating consensus instance
0830 07:54:44.544415 (+ 115us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":8960}
I20250830 07:54:44.545747 13752 rpcz_store.cc:276] 0830 07:54:43.164016 (+ 0us) service_pool.cc:168] Inserting onto call queue
0830 07:54:44.200016 (+1036000us) service_pool.cc:225] Handling call
0830 07:54:44.200401 (+ 385us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0830 07:54:44.200429 (+ 28us) ts_tablet_manager.cc:676] Creating new metadata...
0830 07:54:44.288555 (+ 88126us) tablet_metadata.cc:641] Metadata flushed
0830 07:54:44.456327 (+167772us) tablet_replica.cc:206] Creating consensus instance
0830 07:54:44.456449 (+ 122us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20250830 07:54:44.546182 13752 tablet_service.cc:1468] Processing CreateTablet for tablet 508d21af038c4801a9680ce275eb504c (DEFAULT_TABLE table=default.Table_87c4d4c8f9434a7887c620edd83eebaf [id=d1d894519e174e219cb1bd20b8b4504c]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:44.547461 13450 tablet_service.cc:1468] Processing CreateTablet for tablet 11042d702d4048c99644f0f06a6212d6 (DEFAULT_TABLE table=default.Table_c2d3c80608cf49c4832bcc433c7533ae [id=40624d7f141348df82e85be3a796c840]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:44.548588 13752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 508d21af038c4801a9680ce275eb504c. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:44.550791 13450 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11042d702d4048c99644f0f06a6212d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:44.551409 13464 tablet_service.cc:1515] Processing DeleteTablet for tablet d206f6b6e7524a27a9f95787bcd5de77 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:43 UTC) from {username='slave'} at 127.0.0.1:37956
I20250830 07:54:44.551769 14567 raft_consensus.cc:491] T 508ce3cc87734e5b8cec40e74522549a P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2065c332f15a4739899af79f3669c3ba)
I20250830 07:54:44.552091 14567 raft_consensus.cc:513] T 508ce3cc87734e5b8cec40e74522549a P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } }
I20250830 07:54:44.552402 13456 tablet_service.cc:1468] Processing CreateTablet for tablet d7afb311a699495aa8376db6ab206d94 (DEFAULT_TABLE table=default.Table_e671b5354b7b4ebe8814ab52385e56fe [id=3abbecb154a042428e6d68d43bf105fb]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:44.552773 13456 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d7afb311a699495aa8376db6ab206d94. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:44.553400 14567 leader_election.cc:290] T 508ce3cc87734e5b8cec40e74522549a P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967)
I20250830 07:54:44.554169 13750 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 457) took 1303 ms. Trace:
I20250830 07:54:44.554303 13750 rpcz_store.cc:276] 0830 07:54:43.141767 (+ 0us) service_pool.cc:168] Inserting onto call queue
0830 07:54:43.612935 (+471168us) service_pool.cc:225] Handling call
0830 07:54:43.646882 (+ 33947us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0830 07:54:43.666122 (+ 19240us) ts_tablet_manager.cc:676] Creating new metadata...
0830 07:54:44.205388 (+539266us) tablet_metadata.cc:641] Metadata flushed
0830 07:54:44.339964 (+134576us) tablet_replica.cc:206] Creating consensus instance
0830 07:54:44.445471 (+105507us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20250830 07:54:44.555688 14757 raft_consensus.cc:2802] T d3f207cee78a43a1b5e030c09752c78c P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:54:44.555774 14757 raft_consensus.cc:491] T d3f207cee78a43a1b5e030c09752c78c P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:54:44.556095 14757 raft_consensus.cc:3058] T d3f207cee78a43a1b5e030c09752c78c P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:44.556685 13460 rpcz_store.cc:276] 0830 07:54:43.469900 (+ 0us) service_pool.cc:168] Inserting onto call queue
0830 07:54:44.265494 (+795594us) service_pool.cc:225] Handling call
0830 07:54:44.265882 (+ 388us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0830 07:54:44.265901 (+ 19us) ts_tablet_manager.cc:676] Creating new metadata...
0830 07:54:44.430692 (+164791us) tablet_metadata.cc:641] Metadata flushed
0830 07:54:44.509472 (+ 78780us) tablet_replica.cc:206] Creating consensus instance
0830 07:54:44.509582 (+ 110us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20250830 07:54:44.557094 13460 tablet_service.cc:1515] Processing DeleteTablet for tablet db7144b25ff34bed8c7b779ba9497ef4 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:43 UTC) from {username='slave'} at 127.0.0.1:37956
I20250830 07:54:44.557245 13598 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d72ef294123b4bcdb8ff63af5de9c621. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:44.557427 13460 tablet_service.cc:1515] Processing DeleteTablet for tablet 0c32e597f17e4e75a0f584b6b7b02c36 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:43 UTC) from {username='slave'} at 127.0.0.1:37956
I20250830 07:54:44.557606 13460 tablet_service.cc:1515] Processing DeleteTablet for tablet f52dd8eeb64a4b8a92babf34387b6c5b with delete_type TABLET_DATA_DELETED (replaced by tablet 40ce920462584c25b19befa4146b340f) from {username='slave'} at 127.0.0.1:37956
I20250830 07:54:44.557785 13460 tablet_service.cc:1515] Processing DeleteTablet for tablet 838616d8274648fc9ea4f1583bdb97f9 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:44 UTC) from {username='slave'} at 127.0.0.1:37956
I20250830 07:54:44.557930 13460 tablet_service.cc:1515] Processing DeleteTablet for tablet 88bbd6b4c795433d9b6ad746353f3aa1 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:44 UTC) from {username='slave'} at 127.0.0.1:37956
I20250830 07:54:44.559413 14757 raft_consensus.cc:513] T d3f207cee78a43a1b5e030c09752c78c P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:44.559681 13459 tablet_service.cc:1468] Processing CreateTablet for tablet 4639d1b6add8447c9ce071af71a99869 (DEFAULT_TABLE table=default.Table_2c46d09a19884723bb6778784b0e3fa0 [id=ee45206ce57f4424bb08794e35e2e66a]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:44.561094 13464 tablet_service.cc:1515] Processing DeleteTablet for tablet 23d2c7013c9c4b4aacf47e6ac7ab5a0b with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:43 UTC) from {username='slave'} at 127.0.0.1:37956
I20250830 07:54:44.563201 13593 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5dffbacf2fcd4a38a1d61cf5bb9c5eeb. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:44.566468 13886 raft_consensus.cc:357] T 99f307a8cbb34addaafab82b3ed18241 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:44.557222 13749 tablet_service.cc:1468] Processing CreateTablet for tablet a3ac09a6d8604297aa8736d1f60484e2 (DEFAULT_TABLE table=default.Table_6113d94cac75499baf2aee4b46a92217 [id=b1c1f115c63b467f879094c549ed8352]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:44.566700 13886 raft_consensus.cc:383] T 99f307a8cbb34addaafab82b3ed18241 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:44.566778 13751 tablet_service.cc:1468] Processing CreateTablet for tablet 76dd9dd481fc427fb20f5091e4a3b738 (DEFAULT_TABLE table=default.Table_d72b020da8b34ec291b8c8dcd8e0d459 [id=1740a0f9c36b44a7ab5b65366950cc95]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:44.567030 13467 rpcz_store.cc:276] 0830 07:54:43.470451 (+ 0us) service_pool.cc:168] Inserting onto call queue
0830 07:54:44.292352 (+821901us) service_pool.cc:225] Handling call
0830 07:54:44.307252 (+ 14900us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0830 07:54:44.307273 (+ 21us) ts_tablet_manager.cc:676] Creating new metadata...
0830 07:54:44.440021 (+132748us) tablet_metadata.cc:641] Metadata flushed
0830 07:54:44.510330 (+ 70309us) tablet_replica.cc:206] Creating consensus instance
0830 07:54:44.510427 (+ 97us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20250830 07:54:44.568493 13600 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 521) took 1062 ms. Trace:
I20250830 07:54:44.568631 13600 rpcz_store.cc:276] 0830 07:54:43.505982 (+ 0us) service_pool.cc:168] Inserting onto call queue
0830 07:54:44.436851 (+930869us) service_pool.cc:225] Handling call
0830 07:54:44.437194 (+ 343us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0830 07:54:44.437213 (+ 19us) ts_tablet_manager.cc:676] Creating new metadata...
0830 07:54:44.480299 (+ 43086us) tablet_metadata.cc:641] Metadata flushed
0830 07:54:44.568312 (+ 88013us) tablet_replica.cc:206] Creating consensus instance
0830 07:54:44.568450 (+ 138us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20250830 07:54:44.569531 13749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a3ac09a6d8604297aa8736d1f60484e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:44.570689 13459 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4639d1b6add8447c9ce071af71a99869. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:44.571043 13463 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 513) took 1100 ms. Trace:
I20250830 07:54:44.571162 13463 rpcz_store.cc:276] 0830 07:54:43.470336 (+ 0us) service_pool.cc:168] Inserting onto call queue
0830 07:54:44.285612 (+815276us) service_pool.cc:225] Handling call
0830 07:54:44.286078 (+ 466us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0830 07:54:44.286104 (+ 26us) ts_tablet_manager.cc:676] Creating new metadata...
0830 07:54:44.458470 (+172366us) tablet_metadata.cc:641] Metadata flushed
0830 07:54:44.570407 (+111937us) tablet_replica.cc:206] Creating consensus instance
0830 07:54:44.570511 (+ 104us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20250830 07:54:44.571952 13736 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 456) took 1392 ms. Trace:
I20250830 07:54:44.573112 13466 tablet_service.cc:1515] Processing DeleteTablet for tablet e6b7646588fe4134b2db62ff84ca4791 with delete_type TABLET_DATA_DELETED (replaced by tablet 6bb062f9c4e342489422c8faabfb1b9b) from {username='slave'} at 127.0.0.1:37956
I20250830 07:54:44.573864 13234 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_bec8b25cbc67460488f70626c8ad7859" } new_table_name: "default.Table_2f359a3ab6854c5589d3c78af9b2e364" modify_external_catalogs: true
I20250830 07:54:44.575150 13751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 76dd9dd481fc427fb20f5091e4a3b738. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:44.575088 13597 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 522) took 1013 ms. Trace:
I20250830 07:54:44.575832 13597 rpcz_store.cc:276] 0830 07:54:43.506108 (+ 0us) service_pool.cc:168] Inserting onto call queue
0830 07:54:44.437973 (+931865us) service_pool.cc:225] Handling call
0830 07:54:44.438327 (+ 354us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0830 07:54:44.438344 (+ 17us) ts_tablet_manager.cc:676] Creating new metadata...
0830 07:54:44.468444 (+ 30100us) tablet_metadata.cc:641] Metadata flushed
0830 07:54:44.470850 (+ 2406us) tablet_replica.cc:206] Creating consensus instance
0830 07:54:44.519737 (+ 48887us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20250830 07:54:44.576102 13886 raft_consensus.cc:738] T 99f307a8cbb34addaafab82b3ed18241 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
W20250830 07:54:44.576579 13561 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.209.1:45325, user_credentials={real_user=slave}} blocked reactor thread for 235484us
I20250830 07:54:44.509744 13607 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 518) took 1004 ms. Trace:
I20250830 07:54:44.577477 13607 rpcz_store.cc:276] 0830 07:54:43.505711 (+ 0us) service_pool.cc:168] Inserting onto call queue
0830 07:54:44.398888 (+893177us) service_pool.cc:225] Handling call
0830 07:54:44.407586 (+ 8698us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0830 07:54:44.407603 (+ 17us) ts_tablet_manager.cc:676] Creating new metadata...
0830 07:54:44.507238 (+ 99635us) tablet_metadata.cc:641] Metadata flushed
0830 07:54:44.509596 (+ 2358us) tablet_replica.cc:206] Creating consensus instance
0830 07:54:44.509712 (+ 116us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20250830 07:54:44.578503 14753 consensus_queue.cc:1035] T 14ed24577c8f49f49c83242a26877614 P 6b5e454d98894637b466ea27f1b647f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:54:44.579312 13745 tablet_service.cc:1468] Processing CreateTablet for tablet 283aa82b808e49528ceb19133748ffc8 (DEFAULT_TABLE table=default.Table_99d5f73171164be2bacb3d06d32875b6 [id=0e9e08a5b9354c8da540f1e0e8cc6733]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:44.580348 13886 consensus_queue.cc:260] T 99f307a8cbb34addaafab82b3ed18241 P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:44.581782 13604 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 509) took 1290 ms. Trace:
I20250830 07:54:44.581858 13604 rpcz_store.cc:276] 0830 07:54:43.291435 (+ 0us) service_pool.cc:168] Inserting onto call queue
0830 07:54:44.360332 (+1068897us) service_pool.cc:225] Handling call
0830 07:54:44.361211 (+ 879us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0830 07:54:44.361231 (+ 20us) ts_tablet_manager.cc:676] Creating new metadata...
0830 07:54:44.476697 (+115466us) tablet_metadata.cc:641] Metadata flushed
0830 07:54:44.579003 (+102306us) tablet_replica.cc:206] Creating consensus instance
0830 07:54:44.581751 (+ 2748us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20250830 07:54:44.586719 13882 raft_consensus.cc:357] T cb3c48982add45379c0e1b117ec40c1a P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:44.586937 13882 raft_consensus.cc:383] T cb3c48982add45379c0e1b117ec40c1a P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:44.585986 14761 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45460 (request call id 475) took 1341 ms. Trace:
I20250830 07:54:44.580497 13738 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 463) took 1417 ms. Trace:
I20250830 07:54:44.588367 14761 rpcz_store.cc:276] 0830 07:54:43.164435 (+ 0us) service_pool.cc:168] Inserting onto call queue
0830 07:54:44.314133 (+1149698us) service_pool.cc:225] Handling call
0830 07:54:44.503645 (+189512us) ts_tablet_manager.cc:1145] Deleting tablet 2c31d119743f49589703c434ac6c7548
0830 07:54:44.503655 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0830 07:54:44.506285 (+ 2630us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":54882}
I20250830 07:54:44.586043 13735 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 472) took 1390 ms. Trace:
I20250830 07:54:44.589160 13455 tablet_service.cc:1515] Processing DeleteTablet for tablet 283aa82b808e49528ceb19133748ffc8 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:43 UTC) from {username='slave'} at 127.0.0.1:37956
I20250830 07:54:44.589576 13745 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 283aa82b808e49528ceb19133748ffc8. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:44.590592 13886 ts_tablet_manager.cc:1428] T 99f307a8cbb34addaafab82b3ed18241 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.064s user 0.000s sys 0.002s
I20250830 07:54:44.590770 13735 rpcz_store.cc:276] 0830 07:54:43.164186 (+ 0us) service_pool.cc:168] Inserting onto call queue
0830 07:54:44.267355 (+1103169us) service_pool.cc:225] Handling call
0830 07:54:44.271591 (+ 4236us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0830 07:54:44.271609 (+ 18us) ts_tablet_manager.cc:676] Creating new metadata...
0830 07:54:44.457523 (+185914us) tablet_metadata.cc:641] Metadata flushed
0830 07:54:44.554982 (+ 97459us) tablet_replica.cc:206] Creating consensus instance
0830 07:54:44.555105 (+ 123us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20250830 07:54:44.591466 13562 consensus_peers.cc:489] T 8dddcfe56522436287aea212e316a729 P 6b5e454d98894637b466ea27f1b647f9 -> Peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Couldn't send request to peer 9b057ade5dce45af9f8bf0bedf8b917f. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20250830 07:54:44.591657 13462 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 510) took 1077 ms. Trace:
I20250830 07:54:44.591699 13753 rpcz_store.cc:276] 0830 07:54:43.155197 (+ 0us) service_pool.cc:168] Inserting onto call queue
0830 07:54:44.188573 (+1033376us) service_pool.cc:225] Handling call
0830 07:54:44.226732 (+ 38159us) spinlock_profiling.cc:243] Waited 8.27 ms on lock 0x61800000d518. stack: 00007fd0bf5707d6 00007fd0bf570590 00007fd0be5633ad 0000000000972d94 0000000000972d5d 000000000097272a 00007fd0bf5590dd 00007fd0bf558cfe 00007fd0d2bd6bdd 00007fd0d2bd6b7c 00007fd0cee07904 00007fd0ceddffcd 00007fd0ced34a62 00007fd0c8f346a6 00007fd0c8f343d5 00007fd0c631e2ce
0830 07:54:44.226759 (+ 27us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0830 07:54:44.226861 (+ 102us) ts_tablet_manager.cc:676] Creating new metadata...
0830 07:54:44.471534 (+244673us) tablet_metadata.cc:641] Metadata flushed
0830 07:54:44.543696 (+ 72162us) tablet_replica.cc:206] Creating consensus instance
0830 07:54:44.543835 (+ 139us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":19018624}
I20250830 07:54:44.592032 13590 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 519) took 1086 ms. Trace:
I20250830 07:54:44.592099 13590 rpcz_store.cc:276] 0830 07:54:43.505800 (+ 0us) service_pool.cc:168] Inserting onto call queue
0830 07:54:44.425540 (+919740us) service_pool.cc:225] Handling call
0830 07:54:44.426653 (+ 1113us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0830 07:54:44.426675 (+ 22us) ts_tablet_manager.cc:676] Creating new metadata...
0830 07:54:44.528528 (+101853us) tablet_metadata.cc:641] Metadata flushed
0830 07:54:44.591893 (+ 63365us) tablet_replica.cc:206] Creating consensus instance
0830 07:54:44.592019 (+ 126us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20250830 07:54:44.586089 13740 rpcz_store.cc:276] 0830 07:54:43.164263 (+ 0us) service_pool.cc:168] Inserting onto call queue
0830 07:54:44.267419 (+1103156us) service_pool.cc:225] Handling call
0830 07:54:44.444839 (+177420us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0830 07:54:44.444881 (+ 42us) ts_tablet_manager.cc:676] Creating new metadata...
0830 07:54:44.468793 (+ 23912us) tablet_metadata.cc:641] Metadata flushed
0830 07:54:44.517329 (+ 48536us) tablet_replica.cc:206] Creating consensus instance
0830 07:54:44.517439 (+ 110us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20250830 07:54:44.592437 13483 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "30c2558c28944ff39d1a4a4ca9ac604e" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:54:44.592684 13483 raft_consensus.cc:2391] T 30c2558c28944ff39d1a4a4ca9ac604e P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b5e454d98894637b466ea27f1b647f9 in current term 1: Already voted for candidate 9b057ade5dce45af9f8bf0bedf8b917f in this term.
I20250830 07:54:44.586135 14757 leader_election.cc:290] T d3f207cee78a43a1b5e030c09752c78c P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Requested vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
I20250830 07:54:44.585938 13746 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 471) took 1313 ms. Trace:
I20250830 07:54:44.595497 14674 consensus_queue.cc:1035] T cf5613278b4c4f3bbe751b1ae6f3c313 P 6b5e454d98894637b466ea27f1b647f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:54:44.595960 13462 rpcz_store.cc:276] 0830 07:54:43.470028 (+ 0us) service_pool.cc:168] Inserting onto call queue
0830 07:54:44.274600 (+804572us) service_pool.cc:225] Handling call
0830 07:54:44.286599 (+ 11999us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0830 07:54:44.286622 (+ 23us) ts_tablet_manager.cc:676] Creating new metadata...
0830 07:54:44.483596 (+196974us) tablet_metadata.cc:641] Metadata flushed
0830 07:54:44.546977 (+ 63381us) tablet_replica.cc:206] Creating consensus instance
0830 07:54:44.547116 (+ 139us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20250830 07:54:44.586987 13882 raft_consensus.cc:738] T cb3c48982add45379c0e1b117ec40c1a P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:54:44.597275 13604 tablet_service.cc:1515] Processing DeleteTablet for tablet 838616d8274648fc9ea4f1583bdb97f9 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:44 UTC) from {username='slave'} at 127.0.0.1:45306
I20250830 07:54:44.586180 13701 leader_election.cc:304] T 853503f3f98a49219b077af980180400 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 2065c332f15a4739899af79f3669c3ba, 6b5e454d98894637b466ea27f1b647f9
I20250830 07:54:44.598162 14757 raft_consensus.cc:2747] T 853503f3f98a49219b077af980180400 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:54:44.598173 13886 tablet_bootstrap.cc:492] T ffc5945a032e47d4bd3397d7c887dc62 P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
W20250830 07:54:44.597080 13562 consensus_peers.cc:489] T cf5613278b4c4f3bbe751b1ae6f3c313 P 6b5e454d98894637b466ea27f1b647f9 -> Peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Couldn't send request to peer 9b057ade5dce45af9f8bf0bedf8b917f. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20250830 07:54:44.607487 13562 leader_election.cc:343] T 2009012fddc24e4fb7ad0fab33a1103b P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Not found: Tablet not found: 2009012fddc24e4fb7ad0fab33a1103b
I20250830 07:54:44.607620 13562 leader_election.cc:304] T 2009012fddc24e4fb7ad0fab33a1103b P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b5e454d98894637b466ea27f1b647f9; no voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:54:44.607869 14480 raft_consensus.cc:2747] T 2009012fddc24e4fb7ad0fab33a1103b P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20250830 07:54:44.607892 13701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.209.1:45325, user_credentials={real_user=slave}} blocked reactor thread for 56558.6us
I20250830 07:54:44.608588 13230 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_dfb8cb02c2eb48d4b9058e5a38c7f47d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:44.609191 13230 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_dfb8cb02c2eb48d4b9058e5a38c7f47d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:44.609614 13589 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.ListTablets from 127.0.0.1:45302 (request call id 137) took 1314 ms. Trace:
I20250830 07:54:44.609704 13750 tablet_service.cc:1468] Processing CreateTablet for tablet b678fd915c534a2dac8521c21ab93396 (DEFAULT_TABLE table=default.Table_1c93edc0678341fea10a950688a68c08 [id=b966d9c7fdf5493e9c0d825ac703fb28]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:44.609740 13589 rpcz_store.cc:276] 0830 07:54:43.295102 (+ 0us) service_pool.cc:168] Inserting onto call queue
0830 07:54:43.308244 (+ 13142us) service_pool.cc:225] Handling call
0830 07:54:44.609593 (+1301349us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20250830 07:54:44.610059 13750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b678fd915c534a2dac8521c21ab93396. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:44.610232 13604 tablet_service.cc:1515] Processing DeleteTablet for tablet 88bbd6b4c795433d9b6ad746353f3aa1 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:44 UTC) from {username='slave'} at 127.0.0.1:45306
I20250830 07:54:44.610635 14761 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45460 (request call id 477) took 1424 ms. Trace:
I20250830 07:54:44.610750 14761 rpcz_store.cc:276] 0830 07:54:43.164584 (+ 0us) service_pool.cc:168] Inserting onto call queue
0830 07:54:44.444005 (+1279421us) service_pool.cc:225] Handling call
0830 07:54:44.588643 (+144638us) ts_tablet_manager.cc:1145] Deleting tablet 2d91b0ba74034b85812a13719e21dc6c
0830 07:54:44.588653 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0830 07:54:44.588753 (+ 100us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":131529}
I20250830 07:54:44.611263 14761 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45460 (request call id 476) took 1446 ms. Trace:
I20250830 07:54:44.611339 14761 rpcz_store.cc:276] 0830 07:54:43.164508 (+ 0us) service_pool.cc:168] Inserting onto call queue
0830 07:54:44.443586 (+1279078us) service_pool.cc:225] Handling call
0830 07:54:44.611079 (+167493us) ts_tablet_manager.cc:1145] Deleting tablet 65f1ee59e6e9498381d686f16a865e23
0830 07:54:44.611092 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0830 07:54:44.611205 (+ 113us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":86788}
I20250830 07:54:44.611585 13738 rpcz_store.cc:276] 0830 07:54:43.154812 (+ 0us) service_pool.cc:168] Inserting onto call queue
0830 07:54:43.960066 (+805254us) service_pool.cc:225] Handling call
0830 07:54:43.961053 (+ 987us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0830 07:54:43.961114 (+ 61us) ts_tablet_manager.cc:676] Creating new metadata...
0830 07:54:44.187123 (+226009us) tablet_metadata.cc:641] Metadata flushed
0830 07:54:44.571813 (+384690us) tablet_replica.cc:206] Creating consensus instance
0830 07:54:44.571930 (+ 117us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20250830 07:54:44.611586 13882 consensus_queue.cc:260] T cb3c48982add45379c0e1b117ec40c1a P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:44.612174 13738 tablet_service.cc:1468] Processing CreateTablet for tablet dad2dfa1a19d45778933780b1029d924 (DEFAULT_TABLE table=default.Table_fdf6b173da034defb96d857c29760d5e [id=057b3ca5735944209509cf2d47ae25fa]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:44.612520 13738 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dad2dfa1a19d45778933780b1029d924. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:44.613384 13735 tablet_service.cc:1468] Processing CreateTablet for tablet 370441c443be46c2a33132fbc5c41f89 (DEFAULT_TABLE table=default.Table_f21862e4d3614f3599c1f8c6b3a0d624 [id=5a0934cf98934953bdf1cd9b5abf2192]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:44.613564 13598 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 520) took 1107 ms. Trace:
I20250830 07:54:44.613682 13735 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 370441c443be46c2a33132fbc5c41f89. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:44.613636 13598 rpcz_store.cc:276] 0830 07:54:43.505879 (+ 0us) service_pool.cc:168] Inserting onto call queue
0830 07:54:44.428421 (+922542us) service_pool.cc:225] Handling call
0830 07:54:44.455989 (+ 27568us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0830 07:54:44.456010 (+ 21us) ts_tablet_manager.cc:676] Creating new metadata...
0830 07:54:44.561919 (+105909us) tablet_metadata.cc:641] Metadata flushed
0830 07:54:44.613440 (+ 51521us) tablet_replica.cc:206] Creating consensus instance
0830 07:54:44.613552 (+ 112us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20250830 07:54:44.614632 13562 leader_election.cc:304] T b38c8d003413428dae9e47f58e197c2c P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 2065c332f15a4739899af79f3669c3ba
I20250830 07:54:44.614797 13747 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 466) took 1443 ms. Trace:
I20250830 07:54:44.614828 14480 raft_consensus.cc:2802] T b38c8d003413428dae9e47f58e197c2c P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20250830 07:54:44.614882 14480 raft_consensus.cc:491] T b38c8d003413428dae9e47f58e197c2c P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:54:44.614990 14480 raft_consensus.cc:3058] T b38c8d003413428dae9e47f58e197c2c P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Advancing to term 2
I20250830 07:54:44.615324 13744 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 484) took 1401 ms. Trace:
I20250830 07:54:44.615393 13562 leader_election.cc:304] T 7af74bdde363493f8061eba450ecf4b4 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 2065c332f15a4739899af79f3669c3ba
I20250830 07:54:44.615656 14674 raft_consensus.cc:2802] T 7af74bdde363493f8061eba450ecf4b4 P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Leader election won for term 1
I20250830 07:54:44.615780 14674 raft_consensus.cc:695] T 7af74bdde363493f8061eba450ecf4b4 P 6b5e454d98894637b466ea27f1b647f9 [term 1 LEADER]: Becoming Leader. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Running, Role: LEADER
I20250830 07:54:44.616077 13561 leader_election.cc:304] T 30c2558c28944ff39d1a4a4ca9ac604e P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b5e454d98894637b466ea27f1b647f9; no voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:54:44.616255 14753 raft_consensus.cc:2747] T 30c2558c28944ff39d1a4a4ca9ac604e P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:54:44.607076 13746 rpcz_store.cc:276] 0830 07:54:43.164110 (+ 0us) service_pool.cc:168] Inserting onto call queue
0830 07:54:44.267108 (+1102998us) service_pool.cc:225] Handling call
0830 07:54:44.270577 (+ 3469us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0830 07:54:44.270600 (+ 23us) ts_tablet_manager.cc:676] Creating new metadata...
0830 07:54:44.474126 (+203526us) tablet_metadata.cc:641] Metadata flushed
0830 07:54:44.477083 (+ 2957us) tablet_replica.cc:206] Creating consensus instance
0830 07:54:44.477224 (+ 141us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20250830 07:54:44.617326 13882 ts_tablet_manager.cc:1428] T cb3c48982add45379c0e1b117ec40c1a P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.218s user 0.000s sys 0.002s
I20250830 07:54:44.617579 13882 tablet_bootstrap.cc:492] T 533811110191436d96665b3475ab597f P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:54:44.615985 14674 consensus_queue.cc:237] T 7af74bdde363493f8061eba450ecf4b4 P 6b5e454d98894637b466ea27f1b647f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:44.621253 14533 consensus_queue.cc:1035] T 6dda55ec2da34c8aba9f39a63e144a7c P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20250830 07:54:44.621971 13736 rpcz_store.cc:276] 0830 07:54:43.135039 (+ 0us) service_pool.cc:168] Inserting onto call queue
0830 07:54:43.488251 (+353212us) service_pool.cc:225] Handling call
0830 07:54:43.642322 (+154071us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0830 07:54:43.643611 (+ 1289us) ts_tablet_manager.cc:676] Creating new metadata...
0830 07:54:44.278128 (+634517us) tablet_metadata.cc:641] Metadata flushed
0830 07:54:44.527282 (+249154us) tablet_replica.cc:206] Creating consensus instance
0830 07:54:44.527405 (+ 123us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20250830 07:54:44.624356 13753 tablet_service.cc:1468] Processing CreateTablet for tablet e24d68b8f5ba4df59a9aeec8ebd6403d (DEFAULT_TABLE table=default.Table_c8928475736a40768e1ad90aed18fa32 [id=390d0083d26c4c39b58622c2cd50365e]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:44.631794 13740 tablet_service.cc:1468] Processing CreateTablet for tablet 4df6d481baab40e2b2c1309d1a8c5351 (DEFAULT_TABLE table=default.Table_ed76689fb0754162aa9b23002b8d6013 [id=34800e0b41c14e6db8e310f0d414c59b]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:44.632295 13736 tablet_service.cc:1468] Processing CreateTablet for tablet 11042d702d4048c99644f0f06a6212d6 (DEFAULT_TABLE table=default.Table_c2d3c80608cf49c4832bcc433c7533ae [id=40624d7f141348df82e85be3a796c840]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:44.633569 13608 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 492) took 1344 ms. Trace:
I20250830 07:54:44.633641 13608 rpcz_store.cc:276] 0830 07:54:43.289083 (+ 0us) service_pool.cc:168] Inserting onto call queue
0830 07:54:44.082012 (+792929us) service_pool.cc:225] Handling call
0830 07:54:44.082372 (+ 360us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0830 07:54:44.082393 (+ 21us) ts_tablet_manager.cc:676] Creating new metadata...
0830 07:54:44.324740 (+242347us) tablet_metadata.cc:641] Metadata flushed
0830 07:54:44.629824 (+305084us) tablet_replica.cc:206] Creating consensus instance
0830 07:54:44.633553 (+ 3729us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20250830 07:54:44.636750 14567 consensus_queue.cc:1035] T 30c2558c28944ff39d1a4a4ca9ac604e P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.019s
I20250830 07:54:44.637393 13746 tablet_service.cc:1468] Processing CreateTablet for tablet 690cf258639a4c1ea5a0ac4f2fd39f88 (DEFAULT_TABLE table=default.Table_523d7bc660f94c9db577f499e22c772f [id=3582c72cab4b4e1084021b098ec30f87]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:44.637742 13773 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "73853894da074ecd8147a94ac28bfab8" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:44.638134 13740 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4df6d481baab40e2b2c1309d1a8c5351. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:44.638895 13746 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 690cf258639a4c1ea5a0ac4f2fd39f88. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:44.639638 13736 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11042d702d4048c99644f0f06a6212d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:44.634084 13747 rpcz_store.cc:276] 0830 07:54:43.155120 (+ 0us) service_pool.cc:168] Inserting onto call queue
0830 07:54:44.188476 (+1033356us) service_pool.cc:225] Handling call
0830 07:54:44.218389 (+ 29913us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0830 07:54:44.218406 (+ 17us) ts_tablet_manager.cc:676] Creating new metadata...
0830 07:54:44.484866 (+266460us) tablet_metadata.cc:641] Metadata flushed
0830 07:54:44.598802 (+113936us) tablet_replica.cc:206] Creating consensus instance
0830 07:54:44.598949 (+ 147us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1376000}
I20250830 07:54:44.643570 13451 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 512) took 1157 ms. Trace:
I20250830 07:54:44.644037 13599 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45306 (request call id 515) took 1142 ms. Trace:
I20250830 07:54:44.644218 13765 raft_consensus.cc:3058] T dbe542c478874482b078296a7a0e9ec9 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:44.644559 13886 tablet_bootstrap.cc:654] T ffc5945a032e47d4bd3397d7c887dc62 P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:44.644995 13599 rpcz_store.cc:276] 0830 07:54:43.501342 (+ 0us) service_pool.cc:168] Inserting onto call queue
0830 07:54:44.375711 (+874369us) service_pool.cc:225] Handling call
0830 07:54:44.427692 (+ 51981us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0830 07:54:44.427711 (+ 19us) ts_tablet_manager.cc:676] Creating new metadata...
0830 07:54:44.619175 (+191464us) tablet_metadata.cc:641] Metadata flushed
0830 07:54:44.643859 (+ 24684us) tablet_replica.cc:206] Creating consensus instance
0830 07:54:44.644002 (+ 143us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20250830 07:54:44.645074 14480 raft_consensus.cc:513] T b38c8d003413428dae9e47f58e197c2c P 6b5e454d98894637b466ea27f1b647f9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:44.645663 14480 leader_election.cc:290] T b38c8d003413428dae9e47f58e197c2c P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 2 election: Requested vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:44.645555 13744 rpcz_store.cc:276] 0830 07:54:43.197695 (+ 0us) service_pool.cc:168] Inserting onto call queue
0830 07:54:44.457126 (+1259431us) service_pool.cc:225] Handling call
0830 07:54:44.463576 (+ 6450us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0830 07:54:44.463595 (+ 19us) ts_tablet_manager.cc:676] Creating new metadata...
0830 07:54:44.483252 (+ 19657us) tablet_metadata.cc:641] Metadata flushed
0830 07:54:44.599448 (+116196us) tablet_replica.cc:206] Creating consensus instance
0830 07:54:44.599570 (+ 122us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20250830 07:54:44.646931 13488 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "b38c8d003413428dae9e47f58e197c2c" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba"
I20250830 07:54:44.647111 13753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e24d68b8f5ba4df59a9aeec8ebd6403d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:44.647313 13451 rpcz_store.cc:276] 0830 07:54:43.470206 (+ 0us) service_pool.cc:168] Inserting onto call queue
0830 07:54:44.285011 (+814805us) service_pool.cc:225] Handling call
0830 07:54:44.297784 (+ 12773us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0830 07:54:44.297805 (+ 21us) ts_tablet_manager.cc:676] Creating new metadata...
0830 07:54:44.504479 (+206674us) tablet_metadata.cc:641] Metadata flushed
0830 07:54:44.627416 (+122937us) tablet_replica.cc:206] Creating consensus instance
0830 07:54:44.627564 (+ 148us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20250830 07:54:44.649181 13882 tablet_bootstrap.cc:654] T 533811110191436d96665b3475ab597f P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:44.651933 13747 tablet_service.cc:1468] Processing CreateTablet for tablet 4639d1b6add8447c9ce071af71a99869 (DEFAULT_TABLE table=default.Table_2c46d09a19884723bb6778784b0e3fa0 [id=ee45206ce57f4424bb08794e35e2e66a]), partition=RANGE (key) PARTITION UNBOUNDED
W20250830 07:54:44.653374 13220 catalog_manager.cc:4908] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet 042fd7ff08fc4695b87bb8f9d225ef12 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 042fd7ff08fc4695b87bb8f9d225ef12 already in progress: creating tablet
W20250830 07:54:44.653645 13220 catalog_manager.cc:4908] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet 5dffbacf2fcd4a38a1d61cf5bb9c5eeb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5dffbacf2fcd4a38a1d61cf5bb9c5eeb already in progress: creating tablet
I20250830 07:54:44.654476 13737 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 487) took 1456 ms. Trace:
W20250830 07:54:44.654778 13220 catalog_manager.cc:4908] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet 2b4103f07e96490488913059a95af0c3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2b4103f07e96490488913059a95af0c3 already in progress: creating tablet
W20250830 07:54:44.655037 13220 catalog_manager.cc:4908] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet d206f6b6e7524a27a9f95787bcd5de77 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d206f6b6e7524a27a9f95787bcd5de77 already in progress: creating tablet
W20250830 07:54:44.655274 13220 catalog_manager.cc:4908] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet 283aa82b808e49528ceb19133748ffc8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 283aa82b808e49528ceb19133748ffc8 already in progress: creating tablet
W20250830 07:54:44.658172 13220 catalog_manager.cc:4908] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet e6b7646588fe4134b2db62ff84ca4791 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e6b7646588fe4134b2db62ff84ca4791 already in progress: creating tablet
W20250830 07:54:44.658522 13220 catalog_manager.cc:4908] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet 23d2c7013c9c4b4aacf47e6ac7ab5a0b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 23d2c7013c9c4b4aacf47e6ac7ab5a0b already in progress: creating tablet
W20250830 07:54:44.658803 13220 catalog_manager.cc:4908] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet c56e3a30c18640e68c8b0c4ff4251d96 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c56e3a30c18640e68c8b0c4ff4251d96 already in progress: creating tablet
W20250830 07:54:44.659075 13220 catalog_manager.cc:4908] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet 0c32e597f17e4e75a0f584b6b7b02c36 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0c32e597f17e4e75a0f584b6b7b02c36 already in progress: creating tablet
W20250830 07:54:44.659318 13220 catalog_manager.cc:4908] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet f52dd8eeb64a4b8a92babf34387b6c5b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f52dd8eeb64a4b8a92babf34387b6c5b already in progress: creating tablet
I20250830 07:54:44.659970 14756 raft_consensus.cc:491] T 69d6daeb7c774fd48ed296f52ed7c6a6 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:44.660107 14756 raft_consensus.cc:513] T 69d6daeb7c774fd48ed296f52ed7c6a6 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:44.660984 14756 leader_election.cc:290] T 69d6daeb7c774fd48ed296f52ed7c6a6 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
W20250830 07:54:44.661554 13220 catalog_manager.cc:4908] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet db7144b25ff34bed8c7b779ba9497ef4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet db7144b25ff34bed8c7b779ba9497ef4 already in progress: creating tablet
W20250830 07:54:44.661815 13220 catalog_manager.cc:4908] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet 838616d8274648fc9ea4f1583bdb97f9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 838616d8274648fc9ea4f1583bdb97f9 already in progress: creating tablet
W20250830 07:54:44.662096 13220 catalog_manager.cc:4908] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet 88bbd6b4c795433d9b6ad746353f3aa1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 88bbd6b4c795433d9b6ad746353f3aa1 already in progress: creating tablet
I20250830 07:54:44.655122 13744 tablet_service.cc:1468] Processing CreateTablet for tablet 7676b4d6a75c4c6aacced1f2a1beb555 (DEFAULT_TABLE table=default.Table_312a5248361141058060b702704a3b35 [id=16c0b33e1e744e61b48b7cb029228977]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:44.658515 13747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4639d1b6add8447c9ce071af71a99869. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:44.658696 13771 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "7af74bdde363493f8061eba450ecf4b4" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:44.669539 13887 tablet_bootstrap.cc:492] T 53a933afa4b74095baf0f54736d99bf0 P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:54:44.676813 13737 rpcz_store.cc:276] 0830 07:54:43.197980 (+ 0us) service_pool.cc:168] Inserting onto call queue
0830 07:54:44.510616 (+1312636us) service_pool.cc:225] Handling call
0830 07:54:44.511424 (+ 808us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0830 07:54:44.511442 (+ 18us) ts_tablet_manager.cc:676] Creating new metadata...
0830 07:54:44.562244 (+ 50802us) tablet_metadata.cc:641] Metadata flushed
0830 07:54:44.654313 (+ 92069us) tablet_replica.cc:206] Creating consensus instance
0830 07:54:44.654444 (+ 131us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20250830 07:54:44.677573 13737 tablet_service.cc:1468] Processing CreateTablet for tablet 838616d8274648fc9ea4f1583bdb97f9 (DEFAULT_TABLE table=default.Table_5b1f6f284dc946afa2daaea18a0164e2 [id=447ff69ae6a14f93b768dd1357195a84]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:44.677160 13744 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7676b4d6a75c4c6aacced1f2a1beb555. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:44.681296 13737 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 838616d8274648fc9ea4f1583bdb97f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:44.682341 13887 ts_tablet_manager.cc:1397] T 53a933afa4b74095baf0f54736d99bf0 P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.316s user 0.009s sys 0.000s
I20250830 07:54:44.684516 13771 raft_consensus.cc:2391] T 7af74bdde363493f8061eba450ecf4b4 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2065c332f15a4739899af79f3669c3ba in current term 1: Already voted for candidate 6b5e454d98894637b466ea27f1b647f9 in this term.
I20250830 07:54:44.685226 13453 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37956 (request call id 521) took 1079 ms. Trace:
I20250830 07:54:44.688005 13887 raft_consensus.cc:357] T 53a933afa4b74095baf0f54736d99bf0 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:44.688287 13887 raft_consensus.cc:383] T 53a933afa4b74095baf0f54736d99bf0 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20250830 07:54:44.685608 13702 connection.cc:537] client connection to 127.12.209.60:43889 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20250830 07:54:44.690791 13887 raft_consensus.cc:738] T 53a933afa4b74095baf0f54736d99bf0 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:54:44.691126 13887 consensus_queue.cc:260] T 53a933afa4b74095baf0f54736d99bf0 P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
W20250830 07:54:44.693818 13219 catalog_manager.cc:4908] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): delete failed for tablet f1fe024f0de048a5a0931ee38752d5a1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f1fe024f0de048a5a0931ee38752d5a1 already in progress: creating tablet
W20250830 07:54:44.694345 13219 catalog_manager.cc:4908] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): delete failed for tablet e4ca3110247640fbae4241448e8d5ef7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e4ca3110247640fbae4241448e8d5ef7 already in progress: creating tablet
W20250830 07:54:44.694873 13219 catalog_manager.cc:4908] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): delete failed for tablet 2c31d119743f49589703c434ac6c7548 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2c31d119743f49589703c434ac6c7548 already in progress: creating tablet
W20250830 07:54:44.695438 13219 catalog_manager.cc:4895] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): delete failed for tablet 2d91b0ba74034b85812a13719e21dc6c because the tablet was not found. No further retry: Not found: Tablet not found: 2d91b0ba74034b85812a13719e21dc6c
W20250830 07:54:44.695693 13219 catalog_manager.cc:4908] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): delete failed for tablet 65f1ee59e6e9498381d686f16a865e23 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 65f1ee59e6e9498381d686f16a865e23 already in progress: creating tablet
I20250830 07:54:44.696692 13739 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 479) took 1493 ms. Trace:
I20250830 07:54:44.699314 13751 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 481) took 1493 ms. Trace:
I20250830 07:54:44.699407 13751 rpcz_store.cc:276] 0830 07:54:43.197439 (+ 0us) service_pool.cc:168] Inserting onto call queue
0830 07:54:44.448783 (+1251344us) service_pool.cc:225] Handling call
0830 07:54:44.566930 (+118147us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0830 07:54:44.566947 (+ 17us) ts_tablet_manager.cc:676] Creating new metadata...
0830 07:54:44.650718 (+ 83771us) tablet_metadata.cc:641] Metadata flushed
0830 07:54:44.690348 (+ 39630us) tablet_replica.cc:206] Creating consensus instance
0830 07:54:44.690443 (+ 95us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20250830 07:54:44.688457 13453 rpcz_store.cc:276] 0830 07:54:43.592298 (+ 0us) service_pool.cc:168] Inserting onto call queue
0830 07:54:44.395411 (+803113us) service_pool.cc:225] Handling call
0830 07:54:44.395785 (+ 374us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0830 07:54:44.395803 (+ 18us) ts_tablet_manager.cc:676] Creating new metadata...
0830 07:54:44.586251 (+190448us) tablet_metadata.cc:641] Metadata flushed
0830 07:54:44.671224 (+ 84973us) tablet_replica.cc:206] Creating consensus instance
0830 07:54:44.671321 (+ 97us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20250830 07:54:44.699239 13739 rpcz_store.cc:276] 0830 07:54:43.197196 (+ 0us) service_pool.cc:168] Inserting onto call queue
0830 07:54:44.447505 (+1250309us) service_pool.cc:225] Handling call
0830 07:54:44.518621 (+ 71116us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0830 07:54:44.518641 (+ 20us) ts_tablet_manager.cc:676] Creating new metadata...
0830 07:54:44.590070 (+ 71429us) tablet_metadata.cc:641] Metadata flushed
0830 07:54:44.690175 (+100105us) tablet_replica.cc:206] Creating consensus instance
0830 07:54:44.690304 (+ 129us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20250830 07:54:44.704756 13882 tablet_bootstrap.cc:492] T 533811110191436d96665b3475ab597f P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:54:44.704883 13882 ts_tablet_manager.cc:1397] T 533811110191436d96665b3475ab597f P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.087s user 0.001s sys 0.009s
I20250830 07:54:44.705644 13882 raft_consensus.cc:357] T 533811110191436d96665b3475ab597f P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:44.705845 13882 raft_consensus.cc:383] T 533811110191436d96665b3475ab597f P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:44.705901 13882 raft_consensus.cc:738] T 533811110191436d96665b3475ab597f P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:54:44.706081 13882 consensus_queue.cc:260] T 533811110191436d96665b3475ab597f P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:44.709647 13751 tablet_service.cc:1468] Processing CreateTablet for tablet 78fe9f6325c243a490f361aa79295c36 (DEFAULT_TABLE table=default.Table_2b82782993784298b5f2664d01b07707 [id=41b94badffbc4d1aad72f5ecc891a07e]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:44.711445 13887 ts_tablet_manager.cc:1428] T 53a933afa4b74095baf0f54736d99bf0 P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.016s user 0.002s sys 0.000s
I20250830 07:54:44.711758 13887 tablet_bootstrap.cc:492] T 04eadf45b82e4c319eb7b316a402d81a P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:54:44.712543 13773 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "7af74bdde363493f8061eba450ecf4b4" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f"
I20250830 07:54:44.712940 13882 ts_tablet_manager.cc:1428] T 533811110191436d96665b3475ab597f P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.008s user 0.001s sys 0.001s
I20250830 07:54:44.713171 13882 tablet_bootstrap.cc:492] T f56cab43580a4ee3a912fc5e58a3bd9d P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:54:44.716408 13882 tablet_bootstrap.cc:654] T f56cab43580a4ee3a912fc5e58a3bd9d P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:44.717123 13587 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.ListTablets from 127.0.0.1:45302 (request call id 139) took 1195 ms. Trace:
I20250830 07:54:44.717206 13587 rpcz_store.cc:276] 0830 07:54:43.521872 (+ 0us) service_pool.cc:168] Inserting onto call queue
0830 07:54:43.521931 (+ 59us) service_pool.cc:225] Handling call
0830 07:54:43.531802 (+ 9871us) spinlock_profiling.cc:243] Waited 2.85 ms on lock 0x6160000f5630. stack: 00007f507b5977d6 00007f507b597590 00007f507a58a3ad 0000000000972d94 0000000000972d5d 000000000097272a 00007f508833b859 00007f508ad87528 00007f50854b8c36 00007f50854b8965 00007f50823452ce 00007f50823441ae 00007f508234a3e5 00007f508234ad0f 00007f508234ab38 0000000000a774dc
0830 07:54:44.621591 (+1089789us) spinlock_profiling.cc:243] Waited 80.5 ms on lock 0x616000250354. stack: 00007f507b5977d6 00007f507b597590 00007f507a58a3ad 0000000000972d94 0000000000972d5d 000000000097272a 00007f5086fed700 00007f508ad8771f 00007f50854b8c36 00007f50854b8965 00007f50823452ce 00007f50823441ae 00007f508234a3e5 00007f508234ad0f 00007f508234ab38 0000000000a774dc
0830 07:54:44.711538 (+ 89947us) spinlock_profiling.cc:243] Waited 63 ms on lock 0x616000260254. stack: 00007f507b5977d6 00007f507b597590 00007f507a58a3ad 0000000000972d94 0000000000972d5d 000000000097272a 00007f5086fed700 00007f508ad8771f 00007f50854b8c36 00007f50854b8965 00007f50823452ce 00007f50823441ae 00007f508234a3e5 00007f508234ad0f 00007f508234ab38 0000000000a774dc
0830 07:54:44.717103 (+ 5565us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":336549504}
I20250830 07:54:44.717216 14785 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37956 (request call id 528) took 1002 ms. Trace:
I20250830 07:54:44.717389 14785 rpcz_store.cc:276] 0830 07:54:43.715990 (+ 0us) service_pool.cc:168] Inserting onto call queue
0830 07:54:44.478499 (+762509us) service_pool.cc:225] Handling call
0830 07:54:44.716785 (+238286us) ts_tablet_manager.cc:1145] Deleting tablet 042fd7ff08fc4695b87bb8f9d225ef12
0830 07:54:44.716792 (+ 7us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0830 07:54:44.717097 (+ 305us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":208368,"threads_started":1}
W20250830 07:54:44.718298 13218 catalog_manager.cc:4908] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): delete failed for tablet 042fd7ff08fc4695b87bb8f9d225ef12 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 042fd7ff08fc4695b87bb8f9d225ef12 already in progress: creating tablet
I20250830 07:54:44.718778 14785 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37956 (request call id 524) took 1108 ms. Trace:
I20250830 07:54:44.718920 14785 rpcz_store.cc:276] 0830 07:54:43.608883 (+ 0us) service_pool.cc:168] Inserting onto call queue
0830 07:54:44.463386 (+854503us) service_pool.cc:225] Handling call
0830 07:54:44.717654 (+254268us) ts_tablet_manager.cc:1145] Deleting tablet c56e3a30c18640e68c8b0c4ff4251d96
0830 07:54:44.717663 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0830 07:54:44.717735 (+ 72us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":202433}
W20250830 07:54:44.720230 13218 catalog_manager.cc:4908] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): delete failed for tablet c56e3a30c18640e68c8b0c4ff4251d96 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c56e3a30c18640e68c8b0c4ff4251d96 already in progress: creating tablet
I20250830 07:54:44.720702 13773 raft_consensus.cc:2391] T 7af74bdde363493f8061eba450ecf4b4 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 2065c332f15a4739899af79f3669c3ba in current term 1: Already voted for candidate 6b5e454d98894637b466ea27f1b647f9 in this term.
W20250830 07:54:44.721247 13218 catalog_manager.cc:4908] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): delete failed for tablet 5dffbacf2fcd4a38a1d61cf5bb9c5eeb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5dffbacf2fcd4a38a1d61cf5bb9c5eeb already in progress: creating tablet
I20250830 07:54:44.719163 13739 tablet_service.cc:1468] Processing CreateTablet for tablet 7dc061ebaa334c109d1e457e2dc860df (DEFAULT_TABLE table=default.Table_406d183190bf4e01a97000963dd33d13 [id=d1b9fcbd33df447984a15bc7504aa31c]), partition=RANGE (key) PARTITION UNBOUNDED
W20250830 07:54:44.722734 13218 catalog_manager.cc:4908] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): delete failed for tablet 2b4103f07e96490488913059a95af0c3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2b4103f07e96490488913059a95af0c3 already in progress: creating tablet
I20250830 07:54:44.722867 13887 tablet_bootstrap.cc:654] T 04eadf45b82e4c319eb7b316a402d81a P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:44.728055 13755 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 485) took 1528 ms. Trace:
I20250830 07:54:44.728211 13755 rpcz_store.cc:276] 0830 07:54:43.197769 (+ 0us) service_pool.cc:168] Inserting onto call queue
0830 07:54:44.492752 (+1294983us) service_pool.cc:225] Handling call
0830 07:54:44.495215 (+ 2463us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0830 07:54:44.495242 (+ 27us) ts_tablet_manager.cc:676] Creating new metadata...
0830 07:54:44.520860 (+ 25618us) tablet_metadata.cc:641] Metadata flushed
0830 07:54:44.698825 (+177965us) tablet_replica.cc:206] Creating consensus instance
0830 07:54:44.726729 (+ 27904us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20250830 07:54:44.728787 13755 tablet_service.cc:1468] Processing CreateTablet for tablet e2ef8300fb994f98b3565ad708f880cf (DEFAULT_TABLE table=default.Table_2c14c2548447473a998f5b39993d1b72 [id=158681f88c0d4c3998a0b9709f1b703d]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:44.729033 13749 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 482) took 1529 ms. Trace:
I20250830 07:54:44.729296 13749 rpcz_store.cc:276] 0830 07:54:43.197527 (+ 0us) service_pool.cc:168] Inserting onto call queue
0830 07:54:44.449152 (+1251625us) service_pool.cc:225] Handling call
0830 07:54:44.566767 (+117615us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0830 07:54:44.566791 (+ 24us) ts_tablet_manager.cc:676] Creating new metadata...
0830 07:54:44.659162 (+ 92371us) tablet_metadata.cc:641] Metadata flushed
0830 07:54:44.702741 (+ 43579us) tablet_replica.cc:206] Creating consensus instance
0830 07:54:44.726809 (+ 24068us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20250830 07:54:44.730049 13218 catalog_manager.cc:4908] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): delete failed for tablet d206f6b6e7524a27a9f95787bcd5de77 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d206f6b6e7524a27a9f95787bcd5de77 already in progress: creating tablet
W20250830 07:54:44.730265 13218 catalog_manager.cc:4908] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): delete failed for tablet db7144b25ff34bed8c7b779ba9497ef4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet db7144b25ff34bed8c7b779ba9497ef4 already in progress: creating tablet
W20250830 07:54:44.730470 13218 catalog_manager.cc:4908] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): delete failed for tablet 0c32e597f17e4e75a0f584b6b7b02c36 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0c32e597f17e4e75a0f584b6b7b02c36 already in progress: creating tablet
W20250830 07:54:44.730650 13218 catalog_manager.cc:4908] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): delete failed for tablet f52dd8eeb64a4b8a92babf34387b6c5b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f52dd8eeb64a4b8a92babf34387b6c5b already in progress: creating tablet
W20250830 07:54:44.730842 13218 catalog_manager.cc:4908] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): delete failed for tablet 838616d8274648fc9ea4f1583bdb97f9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 838616d8274648fc9ea4f1583bdb97f9 already in progress: creating tablet
W20250830 07:54:44.731060 13218 catalog_manager.cc:4908] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): delete failed for tablet 88bbd6b4c795433d9b6ad746353f3aa1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 88bbd6b4c795433d9b6ad746353f3aa1 already in progress: creating tablet
W20250830 07:54:44.731251 13218 catalog_manager.cc:4908] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): delete failed for tablet 23d2c7013c9c4b4aacf47e6ac7ab5a0b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 23d2c7013c9c4b4aacf47e6ac7ab5a0b already in progress: creating tablet
W20250830 07:54:44.731462 13218 catalog_manager.cc:4908] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): delete failed for tablet e6b7646588fe4134b2db62ff84ca4791 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e6b7646588fe4134b2db62ff84ca4791 already in progress: creating tablet
W20250830 07:54:44.731678 13218 catalog_manager.cc:4908] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): delete failed for tablet 283aa82b808e49528ceb19133748ffc8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 283aa82b808e49528ceb19133748ffc8 already in progress: creating tablet
I20250830 07:54:44.732120 13741 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 483) took 1529 ms. Trace:
I20250830 07:54:44.732208 13741 rpcz_store.cc:276] 0830 07:54:43.197609 (+ 0us) service_pool.cc:168] Inserting onto call queue
0830 07:54:44.449196 (+1251587us) service_pool.cc:225] Handling call
0830 07:54:44.525081 (+ 75885us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0830 07:54:44.525103 (+ 22us) ts_tablet_manager.cc:676] Creating new metadata...
0830 07:54:44.593542 (+ 68439us) tablet_metadata.cc:641] Metadata flushed
0830 07:54:44.722022 (+128480us) tablet_replica.cc:206] Creating consensus instance
0830 07:54:44.726869 (+ 4847us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20250830 07:54:44.732570 13741 tablet_service.cc:1468] Processing CreateTablet for tablet b85843ab0e3a40e1b453cfdd71bbae5e (DEFAULT_TABLE table=default.Table_2e6009ad55fd42afb9f5d177f2b8c272 [id=9c9207d3b60e4781b1cc610cff92c8e6]), partition=RANGE (key) PARTITION UNBOUNDED
W20250830 07:54:44.735056 13561 consensus_peers.cc:489] T ff2267fb411942ff826e2a72bcb89cd7 P 6b5e454d98894637b466ea27f1b647f9 -> Peer 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): Couldn't send request to peer 2065c332f15a4739899af79f3669c3ba. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ff2267fb411942ff826e2a72bcb89cd7. This is attempt 6: this message will repeat every 5th retry.
I20250830 07:54:44.736562 13751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78fe9f6325c243a490f361aa79295c36. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:44.736620 13771 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "99f307a8cbb34addaafab82b3ed18241" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:44.736769 13771 raft_consensus.cc:2466] T 99f307a8cbb34addaafab82b3ed18241 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2065c332f15a4739899af79f3669c3ba in term 0.
W20250830 07:54:44.744504 13423 consensus_peers.cc:489] T b4ab964a64a64e00a78ffd2b220aef46 P 2065c332f15a4739899af79f3669c3ba -> Peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Couldn't send request to peer 6b5e454d98894637b466ea27f1b647f9. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b4ab964a64a64e00a78ffd2b220aef46. This is attempt 6: this message will repeat every 5th retry.
I20250830 07:54:44.747131 14645 consensus_queue.cc:1035] T e862fa77e16945bd94e405aa3474f021 P 2065c332f15a4739899af79f3669c3ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:54:44.747764 13749 tablet_service.cc:1468] Processing CreateTablet for tablet 9bc54e40f9eb4271aa3132986c249e51 (DEFAULT_TABLE table=default.Table_034019ccacd345d5873db4d09f70ee1f [id=f27ebd3627c84206b8623634701e7de5]), partition=RANGE (key) PARTITION UNBOUNDED
W20250830 07:54:44.748123 13423 leader_election.cc:343] T cb3c48982add45379c0e1b117ec40c1a P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:44.748500 13739 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7dc061ebaa334c109d1e457e2dc860df. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:44.761044 13773 raft_consensus.cc:3058] T e862fa77e16945bd94e405aa3474f021 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:44.761569 13749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9bc54e40f9eb4271aa3132986c249e51. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:44.765933 13741 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b85843ab0e3a40e1b453cfdd71bbae5e. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:44.771272 13887 tablet_bootstrap.cc:492] T 04eadf45b82e4c319eb7b316a402d81a P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:54:44.771416 13887 ts_tablet_manager.cc:1397] T 04eadf45b82e4c319eb7b316a402d81a P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.060s user 0.008s sys 0.000s
I20250830 07:54:44.772123 13887 raft_consensus.cc:357] T 04eadf45b82e4c319eb7b316a402d81a P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:44.772286 13887 raft_consensus.cc:383] T 04eadf45b82e4c319eb7b316a402d81a P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:44.772343 13887 raft_consensus.cc:738] T 04eadf45b82e4c319eb7b316a402d81a P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:54:44.772531 13887 consensus_queue.cc:260] T 04eadf45b82e4c319eb7b316a402d81a P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:44.774793 13624 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "508ce3cc87734e5b8cec40e74522549a" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:44.777245 13624 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "d3f207cee78a43a1b5e030c09752c78c" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9"
I20250830 07:54:44.779229 13887 ts_tablet_manager.cc:1428] T 04eadf45b82e4c319eb7b316a402d81a P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.008s user 0.002s sys 0.000s
I20250830 07:54:44.781461 13624 raft_consensus.cc:1238] T b38c8d003413428dae9e47f58e197c2c P 6b5e454d98894637b466ea27f1b647f9 [term 2 FOLLOWER]: Rejecting Update request from peer 2065c332f15a4739899af79f3669c3ba for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20250830 07:54:44.782511 13624 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "533811110191436d96665b3475ab597f" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:44.782649 13624 raft_consensus.cc:2466] T 533811110191436d96665b3475ab597f P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2065c332f15a4739899af79f3669c3ba in term 0.
I20250830 07:54:44.783414 13751 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 504) took 1282 ms. Trace:
I20250830 07:54:44.784323 13755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e2ef8300fb994f98b3565ad708f880cf. 1 dirs total, 0 dirs full, 0 dirs failed
W20250830 07:54:44.786933 13221 catalog_manager.cc:4726] Async tablet task AlterTable RPC for tablet ed364f03bdad42b88e181b7d0e1e4011 (table default.Table_d72c9e458203404188b2329054b05d20 [id=41f959f5cad14060ae3f4bf1b0151b9f], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet ed364f03bdad42b88e181b7d0e1e4011 consensus state has no leader
I20250830 07:54:44.787103 13887 tablet_bootstrap.cc:492] T 007435e198b9440db055711a98e3148a P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:54:44.788749 13624 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "69d6daeb7c774fd48ed296f52ed7c6a6" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:44.788910 13624 raft_consensus.cc:2466] T 69d6daeb7c774fd48ed296f52ed7c6a6 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2065c332f15a4739899af79f3669c3ba in term 0.
I20250830 07:54:44.789346 13227 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet d1bf58d367f54ba8bad64887b9a8d9cc
I20250830 07:54:44.790098 13887 tablet_bootstrap.cc:654] T 007435e198b9440db055711a98e3148a P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:44.792769 13227 catalog_manager.cc:5674] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325) does not have the latest schema for tablet 14ed24577c8f49f49c83242a26877614 (table default.Table_4428c29c8358411282f00fd33a6badd4 [id=bcee72f9b1c6407f98435a1494b42407]). Expected version 1 got 0
I20250830 07:54:44.793368 13599 tablet_service.cc:1515] Processing DeleteTablet for tablet d1bf58d367f54ba8bad64887b9a8d9cc with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:44 UTC) from {username='slave'} at 127.0.0.1:45306
I20250830 07:54:44.789317 13231 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet 3bca390f6d4343cba7a9fb07f0d4d72b
I20250830 07:54:44.794169 13231 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_281c6fe95ef0467092591e8fcb80ed46"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250830 07:54:44.794384 13887 tablet_bootstrap.cc:492] T 007435e198b9440db055711a98e3148a P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:54:44.794533 13887 ts_tablet_manager.cc:1397] T 007435e198b9440db055711a98e3148a P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.008s user 0.003s sys 0.000s
W20250830 07:54:44.794847 13231 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_281c6fe95ef0467092591e8fcb80ed46 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:44.795507 13887 raft_consensus.cc:357] T 007435e198b9440db055711a98e3148a P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:44.795710 13887 raft_consensus.cc:383] T 007435e198b9440db055711a98e3148a P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:44.795809 13887 raft_consensus.cc:738] T 007435e198b9440db055711a98e3148a P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
W20250830 07:54:44.796404 13220 catalog_manager.cc:4908] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet d1bf58d367f54ba8bad64887b9a8d9cc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d1bf58d367f54ba8bad64887b9a8d9cc already in progress: creating tablet
I20250830 07:54:44.796599 13599 tablet_service.cc:1515] Processing DeleteTablet for tablet 3bca390f6d4343cba7a9fb07f0d4d72b with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:44 UTC) from {username='slave'} at 127.0.0.1:45306
W20250830 07:54:44.797122 13220 catalog_manager.cc:4908] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet 3bca390f6d4343cba7a9fb07f0d4d72b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3bca390f6d4343cba7a9fb07f0d4d72b already in progress: creating tablet
I20250830 07:54:44.797706 13227 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_9080042e085842df95abc5ce12a86850"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:44.798345 13227 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9080042e085842df95abc5ce12a86850 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:44.802091 13751 rpcz_store.cc:276] 0830 07:54:43.598094 (+ 0us) service_pool.cc:168] Inserting onto call queue
0830 07:54:44.699574 (+1101480us) service_pool.cc:225] Handling call
0830 07:54:44.726792 (+ 27218us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0830 07:54:44.726822 (+ 30us) ts_tablet_manager.cc:676] Creating new metadata...
0830 07:54:44.760799 (+ 33977us) tablet_metadata.cc:641] Metadata flushed
0830 07:54:44.776707 (+ 15908us) tablet_replica.cc:206] Creating consensus instance
0830 07:54:44.776855 (+ 148us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20250830 07:54:44.802434 14783 raft_consensus.cc:491] T f53e7423d1f54566a667195f7cf5e1ce P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2065c332f15a4739899af79f3669c3ba)
I20250830 07:54:44.802639 14783 raft_consensus.cc:513] T f53e7423d1f54566a667195f7cf5e1ce P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:44.803547 14783 leader_election.cc:290] T f53e7423d1f54566a667195f7cf5e1ce P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
I20250830 07:54:44.804901 13468 tablet_service.cc:1515] Processing DeleteTablet for tablet d1bf58d367f54ba8bad64887b9a8d9cc with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:44 UTC) from {username='slave'} at 127.0.0.1:37956
I20250830 07:54:44.805194 13458 tablet_service.cc:1515] Processing DeleteTablet for tablet 3bca390f6d4343cba7a9fb07f0d4d72b with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:44 UTC) from {username='slave'} at 127.0.0.1:37956
I20250830 07:54:44.806123 13886 tablet_bootstrap.cc:492] T ffc5945a032e47d4bd3397d7c887dc62 P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
W20250830 07:54:44.807890 13218 catalog_manager.cc:4908] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): delete failed for tablet d1bf58d367f54ba8bad64887b9a8d9cc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d1bf58d367f54ba8bad64887b9a8d9cc already in progress: creating tablet
W20250830 07:54:44.808221 13218 catalog_manager.cc:4908] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): delete failed for tablet 3bca390f6d4343cba7a9fb07f0d4d72b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3bca390f6d4343cba7a9fb07f0d4d72b already in progress: creating tablet
I20250830 07:54:44.811932 13748 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 478) took 1614 ms. Trace:
I20250830 07:54:44.815074 13745 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 488) took 1611 ms. Trace:
I20250830 07:54:44.815173 13745 rpcz_store.cc:276] 0830 07:54:43.198063 (+ 0us) service_pool.cc:168] Inserting onto call queue
0830 07:54:44.524310 (+1326247us) service_pool.cc:225] Handling call
0830 07:54:44.579556 (+ 55246us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0830 07:54:44.579584 (+ 28us) ts_tablet_manager.cc:676] Creating new metadata...
0830 07:54:44.705956 (+126372us) tablet_metadata.cc:641] Metadata flushed
0830 07:54:44.809886 (+103930us) tablet_replica.cc:206] Creating consensus instance
0830 07:54:44.810027 (+ 141us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20250830 07:54:44.815603 13745 tablet_service.cc:1468] Processing CreateTablet for tablet 0c32e597f17e4e75a0f584b6b7b02c36 (DEFAULT_TABLE table=default.Table_f9f639c72f2a46a0bb1606c0f1e92ee0 [id=71cc7b5209c44469889014ae93315aab]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:44.815940 13745 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0c32e597f17e4e75a0f584b6b7b02c36. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:44.816964 13887 consensus_queue.cc:260] T 007435e198b9440db055711a98e3148a P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:44.817858 13751 tablet_service.cc:1468] Processing CreateTablet for tablet 2d91b0ba74034b85812a13719e21dc6c (DEFAULT_TABLE table=default.Table_d978d625ae9f4ac5ad252d8e982685f7 [id=9fd46fc815604123bcb15dc7ecd892a9]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:44.817881 13748 rpcz_store.cc:276] 0830 07:54:43.197044 (+ 0us) service_pool.cc:168] Inserting onto call queue
0830 07:54:44.445936 (+1248892us) service_pool.cc:225] Handling call
0830 07:54:44.458333 (+ 12397us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0830 07:54:44.458357 (+ 24us) ts_tablet_manager.cc:676] Creating new metadata...
0830 07:54:44.635520 (+177163us) tablet_metadata.cc:641] Metadata flushed
0830 07:54:44.811779 (+176259us) tablet_replica.cc:206] Creating consensus instance
0830 07:54:44.811891 (+ 112us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20250830 07:54:44.818212 13751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d91b0ba74034b85812a13719e21dc6c. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:44.818419 14756 raft_consensus.cc:491] T 53a933afa4b74095baf0f54736d99bf0 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:44.818591 14756 raft_consensus.cc:513] T 53a933afa4b74095baf0f54736d99bf0 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:44.819074 13771 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "cb3c48982add45379c0e1b117ec40c1a" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:44.819365 14645 raft_consensus.cc:491] T 007435e198b9440db055711a98e3148a P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:44.819511 14645 raft_consensus.cc:513] T 007435e198b9440db055711a98e3148a P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:44.819723 14756 leader_election.cc:290] T 53a933afa4b74095baf0f54736d99bf0 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:44.819774 13770 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "533811110191436d96665b3475ab597f" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:44.820102 14645 leader_election.cc:290] T 007435e198b9440db055711a98e3148a P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:44.820237 13770 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "69d6daeb7c774fd48ed296f52ed7c6a6" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:44.820624 13770 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "53a933afa4b74095baf0f54736d99bf0" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:44.821058 13770 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "007435e198b9440db055711a98e3148a" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
W20250830 07:54:44.821750 13422 leader_election.cc:343] T 8f215330505848619ad44569d3167591 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:44.821895 13422 leader_election.cc:304] T 8f215330505848619ad44569d3167591 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba; no voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:54:44.822139 14645 raft_consensus.cc:2747] T 8f215330505848619ad44569d3167591 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:54:44.822885 13748 tablet_service.cc:1468] Processing CreateTablet for tablet 8028ac4c928a48f3a077d61aec24f3bd (DEFAULT_TABLE table=default.Table_3ab80fb58bfa45f0aa3aaeef49d0b416 [id=f8ee1dbbf2df48dea75fa01ffbfdebd9]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:44.822976 13487 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "508ce3cc87734e5b8cec40e74522549a" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:54:44.823247 13748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8028ac4c928a48f3a077d61aec24f3bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:44.823239 13479 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "d3f207cee78a43a1b5e030c09752c78c" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba"
I20250830 07:54:44.823486 13479 raft_consensus.cc:3058] T d3f207cee78a43a1b5e030c09752c78c P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
W20250830 07:54:44.823791 13422 leader_election.cc:343] T 73853894da074ecd8147a94ac28bfab8 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:44.823922 13422 leader_election.cc:304] T 73853894da074ecd8147a94ac28bfab8 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba; no voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:54:44.824898 13483 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "e862fa77e16945bd94e405aa3474f021" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:54:44.826427 14644 raft_consensus.cc:2747] T 73853894da074ecd8147a94ac28bfab8 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:54:44.826527 13479 raft_consensus.cc:2466] T d3f207cee78a43a1b5e030c09752c78c P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 1.
I20250830 07:54:44.826532 14445 raft_consensus.cc:491] T 752727eef0734ff3b7b35b1d5f66aea6 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:44.826673 14445 raft_consensus.cc:513] T 752727eef0734ff3b7b35b1d5f66aea6 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:44.828680 13477 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "752727eef0734ff3b7b35b1d5f66aea6" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:54:44.829119 14445 leader_election.cc:290] T 752727eef0734ff3b7b35b1d5f66aea6 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
W20250830 07:54:44.829353 13561 leader_election.cc:343] T 752727eef0734ff3b7b35b1d5f66aea6 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:44.833178 14756 consensus_queue.cc:1035] T b38c8d003413428dae9e47f58e197c2c P 2065c332f15a4739899af79f3669c3ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:54:44.835255 13422 leader_election.cc:304] T 7af74bdde363493f8061eba450ecf4b4 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba; no voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:54:44.835865 14756 raft_consensus.cc:2747] T 7af74bdde363493f8061eba450ecf4b4 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20250830 07:54:44.837113 13422 leader_election.cc:304] T 99f307a8cbb34addaafab82b3ed18241 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:54:44.837788 14756 raft_consensus.cc:2802] T 99f307a8cbb34addaafab82b3ed18241 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:54:44.837881 14756 raft_consensus.cc:491] T 99f307a8cbb34addaafab82b3ed18241 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:54:44.837998 14756 raft_consensus.cc:3058] T 99f307a8cbb34addaafab82b3ed18241 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
W20250830 07:54:44.840556 13226 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 690cf258639a4c1ea5a0ac4f2fd39f88 consensus state has no leader
I20250830 07:54:44.841512 14756 raft_consensus.cc:513] T 99f307a8cbb34addaafab82b3ed18241 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:44.842253 14756 leader_election.cc:290] T 99f307a8cbb34addaafab82b3ed18241 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 election: Requested vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:44.846119 14645 consensus_queue.cc:1035] T e862fa77e16945bd94e405aa3474f021 P 2065c332f15a4739899af79f3669c3ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20250830 07:54:44.846774 13422 leader_election.cc:343] T cb3c48982add45379c0e1b117ec40c1a P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:44.847052 13886 ts_tablet_manager.cc:1397] T ffc5945a032e47d4bd3397d7c887dc62 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.215s user 0.005s sys 0.014s
I20250830 07:54:44.847199 13422 leader_election.cc:304] T cb3c48982add45379c0e1b117ec40c1a P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba; no voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:54:44.847683 14645 raft_consensus.cc:2747] T cb3c48982add45379c0e1b117ec40c1a P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20250830 07:54:44.848119 13422 leader_election.cc:343] T 533811110191436d96665b3475ab597f P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:44.851332 13742 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 480) took 1652 ms. Trace:
W20250830 07:54:44.851361 13422 leader_election.cc:343] T 69d6daeb7c774fd48ed296f52ed7c6a6 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Illegal state: must be running to vote when last-logged opid is not known
W20250830 07:54:44.851596 13422 leader_election.cc:343] T 53a933afa4b74095baf0f54736d99bf0 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:44.851521 13742 rpcz_store.cc:276] 0830 07:54:43.197339 (+ 0us) service_pool.cc:168] Inserting onto call queue
0830 07:54:44.448341 (+1251002us) service_pool.cc:225] Handling call
0830 07:54:44.464360 (+ 16019us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0830 07:54:44.464393 (+ 33us) ts_tablet_manager.cc:676] Creating new metadata...
0830 07:54:44.700250 (+235857us) tablet_metadata.cc:641] Metadata flushed
0830 07:54:44.850129 (+149879us) tablet_replica.cc:206] Creating consensus instance
0830 07:54:44.850259 (+ 130us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20250830 07:54:44.851761 13422 leader_election.cc:343] T 007435e198b9440db055711a98e3148a P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:44.852185 13742 tablet_service.cc:1468] Processing CreateTablet for tablet 75359721445e48d2bc0dd6fd17649bc1 (DEFAULT_TABLE table=default.Table_618200045a4b44908fc6e99de0c2788e [id=554293853df24d7a8c6721d441ef8622]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:44.852449 13479 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f53e7423d1f54566a667195f7cf5e1ce" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:54:44.852627 13742 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75359721445e48d2bc0dd6fd17649bc1. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:44.860368 13752 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 489) took 1662 ms. Trace:
I20250830 07:54:44.860569 13752 rpcz_store.cc:276] 0830 07:54:43.198135 (+ 0us) service_pool.cc:168] Inserting onto call queue
0830 07:54:44.545962 (+1347827us) service_pool.cc:225] Handling call
0830 07:54:44.546339 (+ 377us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0830 07:54:44.546357 (+ 18us) ts_tablet_manager.cc:676] Creating new metadata...
0830 07:54:44.734189 (+187832us) tablet_metadata.cc:641] Metadata flushed
0830 07:54:44.860156 (+125967us) tablet_replica.cc:206] Creating consensus instance
0830 07:54:44.860310 (+ 154us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20250830 07:54:44.861129 13752 tablet_service.cc:1468] Processing CreateTablet for tablet 53766699d42e4f6e9b42d9a98613726c (DEFAULT_TABLE table=default.Table_a4097958af86408498f5bc26a4fc0871 [id=0ca73c1fbe9f48ad82737dca6997e50e]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:44.861510 13752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 53766699d42e4f6e9b42d9a98613726c. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:44.868322 13735 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 495) took 1584 ms. Trace:
I20250830 07:54:44.868425 13735 rpcz_store.cc:276] 0830 07:54:43.283202 (+ 0us) service_pool.cc:168] Inserting onto call queue
0830 07:54:44.594239 (+1311037us) service_pool.cc:225] Handling call
0830 07:54:44.613537 (+ 19298us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0830 07:54:44.613555 (+ 18us) ts_tablet_manager.cc:676] Creating new metadata...
0830 07:54:44.756418 (+142863us) tablet_metadata.cc:641] Metadata flushed
0830 07:54:44.867563 (+111145us) tablet_replica.cc:206] Creating consensus instance
0830 07:54:44.867674 (+ 111us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20250830 07:54:44.868656 13226 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_c4a636c729fe4982bec27dec6c84bc98"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250830 07:54:44.869273 13887 ts_tablet_manager.cc:1428] T 007435e198b9440db055711a98e3148a P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.075s user 0.003s sys 0.000s
W20250830 07:54:44.869302 13226 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c4a636c729fe4982bec27dec6c84bc98 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:44.869582 13887 tablet_bootstrap.cc:492] T 752727eef0734ff3b7b35b1d5f66aea6 P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
W20250830 07:54:44.871135 13703 leader_election.cc:343] T d3f207cee78a43a1b5e030c09752c78c P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:44.872267 14645 consensus_queue.cc:1046] T b38c8d003413428dae9e47f58e197c2c P 2065c332f15a4739899af79f3669c3ba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:54:44.872488 14645 raft_consensus.cc:3053] T b38c8d003413428dae9e47f58e197c2c P 2065c332f15a4739899af79f3669c3ba [term 1 LEADER]: Stepping down as leader of term 1
I20250830 07:54:44.872571 14645 raft_consensus.cc:738] T b38c8d003413428dae9e47f58e197c2c P 2065c332f15a4739899af79f3669c3ba [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Running, Role: LEADER
I20250830 07:54:44.872812 14645 consensus_queue.cc:260] T b38c8d003413428dae9e47f58e197c2c P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:44.873087 14645 raft_consensus.cc:3058] T b38c8d003413428dae9e47f58e197c2c P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Advancing to term 2
I20250830 07:54:44.875993 13735 tablet_service.cc:1468] Processing CreateTablet for tablet d7afb311a699495aa8376db6ab206d94 (DEFAULT_TABLE table=default.Table_e671b5354b7b4ebe8814ab52385e56fe [id=3abbecb154a042428e6d68d43bf105fb]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:44.876390 13887 tablet_bootstrap.cc:654] T 752727eef0734ff3b7b35b1d5f66aea6 P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:44.877588 13423 leader_election.cc:304] T 533811110191436d96665b3475ab597f P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 6b5e454d98894637b466ea27f1b647f9; no voters: 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:54:44.877986 13423 leader_election.cc:304] T 69d6daeb7c774fd48ed296f52ed7c6a6 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 6b5e454d98894637b466ea27f1b647f9; no voters: 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:54:44.878532 14644 raft_consensus.cc:2802] T 533811110191436d96665b3475ab597f P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:54:44.878597 14644 raft_consensus.cc:491] T 533811110191436d96665b3475ab597f P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:54:44.878654 14644 raft_consensus.cc:3058] T 533811110191436d96665b3475ab597f P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:44.879237 14813 raft_consensus.cc:2802] T 69d6daeb7c774fd48ed296f52ed7c6a6 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:54:44.879303 14813 raft_consensus.cc:491] T 69d6daeb7c774fd48ed296f52ed7c6a6 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:54:44.879355 14813 raft_consensus.cc:3058] T 69d6daeb7c774fd48ed296f52ed7c6a6 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:44.880961 13886 raft_consensus.cc:357] T ffc5945a032e47d4bd3397d7c887dc62 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:44.881338 13735 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d7afb311a699495aa8376db6ab206d94. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:44.881218 14644 raft_consensus.cc:513] T 533811110191436d96665b3475ab597f P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:44.881872 14644 leader_election.cc:290] T 533811110191436d96665b3475ab597f P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 election: Requested vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:44.884655 13754 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 486) took 1682 ms. Trace:
I20250830 07:54:44.885035 13624 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f53e7423d1f54566a667195f7cf5e1ce" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:44.886790 13886 raft_consensus.cc:383] T ffc5945a032e47d4bd3397d7c887dc62 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:44.890100 14813 raft_consensus.cc:513] T 69d6daeb7c774fd48ed296f52ed7c6a6 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:44.892318 13753 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 491) took 1693 ms. Trace:
I20250830 07:54:44.892730 14445 raft_consensus.cc:491] T cb3c48982add45379c0e1b117ec40c1a P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:44.892865 14445 raft_consensus.cc:513] T cb3c48982add45379c0e1b117ec40c1a P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:44.893500 14445 leader_election.cc:290] T cb3c48982add45379c0e1b117ec40c1a P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:44.893772 13478 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "cb3c48982add45379c0e1b117ec40c1a" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:54:44.892149 13887 tablet_bootstrap.cc:492] T 752727eef0734ff3b7b35b1d5f66aea6 P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:54:44.893903 13478 raft_consensus.cc:2466] T cb3c48982add45379c0e1b117ec40c1a P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b5e454d98894637b466ea27f1b647f9 in term 0.
I20250830 07:54:44.894173 13613 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "53a933afa4b74095baf0f54736d99bf0" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:44.894183 13561 leader_election.cc:304] T cb3c48982add45379c0e1b117ec40c1a P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 6b5e454d98894637b466ea27f1b647f9; no voters:
I20250830 07:54:44.894619 14445 raft_consensus.cc:2802] T cb3c48982add45379c0e1b117ec40c1a P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:54:44.894691 14445 raft_consensus.cc:491] T cb3c48982add45379c0e1b117ec40c1a P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:54:44.894737 14445 raft_consensus.cc:3058] T cb3c48982add45379c0e1b117ec40c1a P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:44.896226 13624 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "99f307a8cbb34addaafab82b3ed18241" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9"
I20250830 07:54:44.897750 13617 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "533811110191436d96665b3475ab597f" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9"
I20250830 07:54:44.897922 13617 raft_consensus.cc:3058] T 533811110191436d96665b3475ab597f P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Advancing to term 1
W20250830 07:54:44.897956 13423 leader_election.cc:343] T 53a933afa4b74095baf0f54736d99bf0 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:44.898051 13423 leader_election.cc:304] T 53a933afa4b74095baf0f54736d99bf0 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba; no voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f
W20250830 07:54:44.898476 13423 leader_election.cc:343] T 99f307a8cbb34addaafab82b3ed18241 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:44.898711 14643 raft_consensus.cc:2747] T 53a933afa4b74095baf0f54736d99bf0 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:54:44.900748 13617 raft_consensus.cc:2466] T 533811110191436d96665b3475ab597f P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2065c332f15a4739899af79f3669c3ba in term 1.
I20250830 07:54:44.902387 13613 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "007435e198b9440db055711a98e3148a" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:44.903053 13423 leader_election.cc:304] T 533811110191436d96665b3475ab597f P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 6b5e454d98894637b466ea27f1b647f9; no voters:
W20250830 07:54:44.903327 13423 leader_election.cc:343] T 007435e198b9440db055711a98e3148a P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:44.903399 13423 leader_election.cc:304] T 007435e198b9440db055711a98e3148a P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba; no voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:54:44.903620 14445 raft_consensus.cc:513] T cb3c48982add45379c0e1b117ec40c1a P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:44.903925 14755 raft_consensus.cc:2802] T 533811110191436d96665b3475ab597f P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election won for term 1
I20250830 07:54:44.904062 14755 raft_consensus.cc:695] T 533811110191436d96665b3475ab597f P 2065c332f15a4739899af79f3669c3ba [term 1 LEADER]: Becoming Leader. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Running, Role: LEADER
I20250830 07:54:44.904160 14445 leader_election.cc:290] T cb3c48982add45379c0e1b117ec40c1a P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 election: Requested vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:44.904322 13887 ts_tablet_manager.cc:1397] T 752727eef0734ff3b7b35b1d5f66aea6 P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.035s user 0.000s sys 0.003s
I20250830 07:54:44.904284 14755 consensus_queue.cc:237] T 533811110191436d96665b3475ab597f P 2065c332f15a4739899af79f3669c3ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:44.905014 13887 raft_consensus.cc:357] T 752727eef0734ff3b7b35b1d5f66aea6 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:44.905171 13887 raft_consensus.cc:383] T 752727eef0734ff3b7b35b1d5f66aea6 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:44.905237 13887 raft_consensus.cc:738] T 752727eef0734ff3b7b35b1d5f66aea6 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:54:44.905390 13887 consensus_queue.cc:260] T 752727eef0734ff3b7b35b1d5f66aea6 P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:44.905668 14643 raft_consensus.cc:2747] T 007435e198b9440db055711a98e3148a P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:54:44.905836 13887 ts_tablet_manager.cc:1428] T 752727eef0734ff3b7b35b1d5f66aea6 P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20250830 07:54:44.906067 13887 tablet_bootstrap.cc:492] T 0507245aa8c74aeb9f3eafba0682590d P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:54:44.907356 14813 leader_election.cc:290] T 69d6daeb7c774fd48ed296f52ed7c6a6 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 election: Requested vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:44.908169 13747 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 501) took 1505 ms. Trace:
I20250830 07:54:44.913296 13478 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "cb3c48982add45379c0e1b117ec40c1a" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba"
I20250830 07:54:44.914987 13886 raft_consensus.cc:738] T ffc5945a032e47d4bd3397d7c887dc62 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:54:44.915089 13478 raft_consensus.cc:3058] T cb3c48982add45379c0e1b117ec40c1a P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:44.916935 13773 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "752727eef0734ff3b7b35b1d5f66aea6" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:44.917125 13773 raft_consensus.cc:2466] T 752727eef0734ff3b7b35b1d5f66aea6 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b5e454d98894637b466ea27f1b647f9 in term 0.
I20250830 07:54:44.918546 13478 raft_consensus.cc:2466] T cb3c48982add45379c0e1b117ec40c1a P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b5e454d98894637b466ea27f1b647f9 in term 1.
I20250830 07:54:44.919430 13562 leader_election.cc:304] T 752727eef0734ff3b7b35b1d5f66aea6 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 2065c332f15a4739899af79f3669c3ba
I20250830 07:54:44.919680 14445 raft_consensus.cc:2802] T 752727eef0734ff3b7b35b1d5f66aea6 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:54:44.919786 14445 raft_consensus.cc:491] T 752727eef0734ff3b7b35b1d5f66aea6 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:54:44.919860 14445 raft_consensus.cc:3058] T 752727eef0734ff3b7b35b1d5f66aea6 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:44.921319 13754 rpcz_store.cc:276] 0830 07:54:43.197880 (+ 0us) service_pool.cc:168] Inserting onto call queue
0830 07:54:44.501931 (+1304051us) service_pool.cc:225] Handling call
0830 07:54:44.502312 (+ 381us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0830 07:54:44.502330 (+ 18us) ts_tablet_manager.cc:676] Creating new metadata...
0830 07:54:44.717863 (+215533us) tablet_metadata.cc:641] Metadata flushed
0830 07:54:44.878745 (+160882us) tablet_replica.cc:206] Creating consensus instance
0830 07:54:44.880510 (+ 1765us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20250830 07:54:44.886665 13766 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "b38c8d003413428dae9e47f58e197c2c" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f"
I20250830 07:54:44.923388 14445 raft_consensus.cc:513] T 752727eef0734ff3b7b35b1d5f66aea6 P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:44.924158 14445 leader_election.cc:290] T 752727eef0734ff3b7b35b1d5f66aea6 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 election: Requested vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:44.924546 13486 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "752727eef0734ff3b7b35b1d5f66aea6" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba"
I20250830 07:54:44.928382 13486 raft_consensus.cc:3058] T 752727eef0734ff3b7b35b1d5f66aea6 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:44.931134 13486 raft_consensus.cc:2466] T 752727eef0734ff3b7b35b1d5f66aea6 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b5e454d98894637b466ea27f1b647f9 in term 1.
I20250830 07:54:44.931476 13561 leader_election.cc:304] T 752727eef0734ff3b7b35b1d5f66aea6 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 6b5e454d98894637b466ea27f1b647f9; no voters:
I20250830 07:54:44.925570 13887 tablet_bootstrap.cc:654] T 0507245aa8c74aeb9f3eafba0682590d P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:44.931735 14445 raft_consensus.cc:2802] T 752727eef0734ff3b7b35b1d5f66aea6 P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Leader election won for term 1
I20250830 07:54:44.931790 13561 leader_election.cc:304] T cb3c48982add45379c0e1b117ec40c1a P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 6b5e454d98894637b466ea27f1b647f9; no voters:
I20250830 07:54:44.931972 14445 raft_consensus.cc:695] T 752727eef0734ff3b7b35b1d5f66aea6 P 6b5e454d98894637b466ea27f1b647f9 [term 1 LEADER]: Becoming Leader. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Running, Role: LEADER
I20250830 07:54:44.932113 14753 raft_consensus.cc:2802] T cb3c48982add45379c0e1b117ec40c1a P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Leader election won for term 1
I20250830 07:54:44.932212 14753 raft_consensus.cc:695] T cb3c48982add45379c0e1b117ec40c1a P 6b5e454d98894637b466ea27f1b647f9 [term 1 LEADER]: Becoming Leader. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Running, Role: LEADER
I20250830 07:54:44.932312 14445 consensus_queue.cc:237] T 752727eef0734ff3b7b35b1d5f66aea6 P 6b5e454d98894637b466ea27f1b647f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:44.932431 14753 consensus_queue.cc:237] T cb3c48982add45379c0e1b117ec40c1a P 6b5e454d98894637b466ea27f1b647f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:44.934116 13750 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 490) took 1695 ms. Trace:
I20250830 07:54:44.934235 13750 rpcz_store.cc:276] 0830 07:54:43.198230 (+ 0us) service_pool.cc:168] Inserting onto call queue
0830 07:54:44.554568 (+1356338us) service_pool.cc:225] Handling call
0830 07:54:44.609884 (+ 55316us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0830 07:54:44.609916 (+ 32us) ts_tablet_manager.cc:676] Creating new metadata...
0830 07:54:44.800718 (+190802us) tablet_metadata.cc:641] Metadata flushed
0830 07:54:44.893992 (+ 93274us) tablet_replica.cc:206] Creating consensus instance
0830 07:54:44.894154 (+ 162us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20250830 07:54:44.934867 13750 tablet_service.cc:1468] Processing CreateTablet for tablet 1f5471a94dc24a28bce5f9dcaa10334a (DEFAULT_TABLE table=default.Table_8edbcf7950a04e75982f77c91ac9ff84 [id=c048285db66d4bc09170a2bb1e50fe58]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:44.935326 13750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f5471a94dc24a28bce5f9dcaa10334a. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:44.935885 13753 rpcz_store.cc:276] 0830 07:54:43.198400 (+ 0us) service_pool.cc:168] Inserting onto call queue
0830 07:54:44.591925 (+1393525us) service_pool.cc:225] Handling call
0830 07:54:44.640982 (+ 49057us) spinlock_profiling.cc:243] Waited 3.41 ms on lock 0x61800000d518. stack: 00007fd0bf5707d6 00007fd0bf570590 00007fd0be5633ad 0000000000972d94 0000000000972d5d 000000000097272a 00007fd0bf5590dd 00007fd0bf558cfe 00007fd0d2bd6bdd 00007fd0d2bd6b7c 00007fd0cee07904 00007fd0ceddffcd 00007fd0ced34a62 00007fd0c8f346a6 00007fd0c8f343d5 00007fd0c631e2ce
0830 07:54:44.641027 (+ 45us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0830 07:54:44.641054 (+ 27us) ts_tablet_manager.cc:676] Creating new metadata...
0830 07:54:44.813857 (+172803us) tablet_metadata.cc:641] Metadata flushed
0830 07:54:44.892155 (+ 78298us) tablet_replica.cc:206] Creating consensus instance
0830 07:54:44.892282 (+ 127us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":7840000}
I20250830 07:54:44.936333 13753 tablet_service.cc:1468] Processing CreateTablet for tablet b4c345013ff04cf991989f456aa2d420 (DEFAULT_TABLE table=default.Table_005af599605e4bd090ba828f70a19003 [id=edbafe796f4049feb1d4331956940568]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:44.937064 13753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4c345013ff04cf991989f456aa2d420. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:44.937669 13739 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 505) took 1268 ms. Trace:
I20250830 07:54:44.937769 13739 rpcz_store.cc:276] 0830 07:54:43.630864 (+ 0us) service_pool.cc:168] Inserting onto call queue
0830 07:54:44.701248 (+1070384us) service_pool.cc:225] Handling call
0830 07:54:44.726885 (+ 25637us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0830 07:54:44.726900 (+ 15us) ts_tablet_manager.cc:676] Creating new metadata...
0830 07:54:44.895690 (+168790us) tablet_metadata.cc:641] Metadata flushed
0830 07:54:44.898657 (+ 2967us) tablet_replica.cc:206] Creating consensus instance
0830 07:54:44.898813 (+ 156us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20250830 07:54:44.938238 13739 tablet_service.cc:1468] Processing CreateTablet for tablet d72ef294123b4bcdb8ff63af5de9c621 (DEFAULT_TABLE table=default.Table_83d1032daed546d9ac781ef43a37179b [id=22bbb1ac25e74341b0e5b522388588c7]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:44.938611 13739 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d72ef294123b4bcdb8ff63af5de9c621. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:44.939280 13747 rpcz_store.cc:276] 0830 07:54:43.493511 (+ 0us) service_pool.cc:168] Inserting onto call queue
0830 07:54:44.640880 (+1147369us) service_pool.cc:225] Handling call
0830 07:54:44.652093 (+ 11213us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0830 07:54:44.652110 (+ 17us) ts_tablet_manager.cc:676] Creating new metadata...
0830 07:54:44.876652 (+224542us) tablet_metadata.cc:641] Metadata flushed
0830 07:54:44.907992 (+ 31340us) tablet_replica.cc:206] Creating consensus instance
0830 07:54:44.908131 (+ 139us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20250830 07:54:44.939728 13747 tablet_service.cc:1468] Processing CreateTablet for tablet 559fdab1ef804325978db705431a0ad8 (DEFAULT_TABLE table=default.Table_ceb6b6a4e5014de182da8b467ca360f1 [id=7be8407046b4444e96e2bdee08cc5900]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:44.942593 13613 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "69d6daeb7c774fd48ed296f52ed7c6a6" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9"
I20250830 07:54:44.942734 13613 raft_consensus.cc:3058] T 69d6daeb7c774fd48ed296f52ed7c6a6 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:44.945812 13613 raft_consensus.cc:2466] T 69d6daeb7c774fd48ed296f52ed7c6a6 P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2065c332f15a4739899af79f3669c3ba in term 1.
I20250830 07:54:44.946117 13423 leader_election.cc:304] T 69d6daeb7c774fd48ed296f52ed7c6a6 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 6b5e454d98894637b466ea27f1b647f9; no voters:
I20250830 07:54:44.946790 14644 raft_consensus.cc:2802] T 69d6daeb7c774fd48ed296f52ed7c6a6 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election won for term 1
I20250830 07:54:44.946987 14644 raft_consensus.cc:695] T 69d6daeb7c774fd48ed296f52ed7c6a6 P 2065c332f15a4739899af79f3669c3ba [term 1 LEADER]: Becoming Leader. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Running, Role: LEADER
I20250830 07:54:44.948282 14644 consensus_queue.cc:237] T 69d6daeb7c774fd48ed296f52ed7c6a6 P 2065c332f15a4739899af79f3669c3ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:44.950642 13773 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "cb3c48982add45379c0e1b117ec40c1a" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f"
I20250830 07:54:44.955224 13887 tablet_bootstrap.cc:492] T 0507245aa8c74aeb9f3eafba0682590d P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:54:44.955255 13746 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 499) took 1487 ms. Trace:
I20250830 07:54:44.955374 13887 ts_tablet_manager.cc:1397] T 0507245aa8c74aeb9f3eafba0682590d P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.049s user 0.002s sys 0.002s
I20250830 07:54:44.955498 13746 rpcz_store.cc:276] 0830 07:54:43.402709 (+ 0us) service_pool.cc:168] Inserting onto call queue
0830 07:54:44.616864 (+1214155us) service_pool.cc:225] Handling call
0830 07:54:44.637583 (+ 20719us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0830 07:54:44.637609 (+ 26us) ts_tablet_manager.cc:676] Creating new metadata...
0830 07:54:44.849432 (+211823us) tablet_metadata.cc:641] Metadata flushed
0830 07:54:44.890059 (+ 40627us) tablet_replica.cc:206] Creating consensus instance
0830 07:54:44.890183 (+ 124us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20250830 07:54:44.956133 13887 raft_consensus.cc:357] T 0507245aa8c74aeb9f3eafba0682590d P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:44.956306 13887 raft_consensus.cc:383] T 0507245aa8c74aeb9f3eafba0682590d P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:44.956370 13887 raft_consensus.cc:738] T 0507245aa8c74aeb9f3eafba0682590d P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:54:44.956566 13746 tablet_service.cc:1468] Processing CreateTablet for tablet d075a38c613c46398ec533c1e00a24c6 (DEFAULT_TABLE table=default.Table_85cff6310828487f93c6d44cd1770ecb [id=cf2276b202ea4aca98c0d7f5d23aeb89]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:44.957016 13746 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d075a38c613c46398ec533c1e00a24c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:44.957660 13754 tablet_service.cc:1468] Processing CreateTablet for tablet 91da20bcd25341b5a0f6605b3ec58fb3 (DEFAULT_TABLE table=default.Table_200f184b944748a08e37e88ac1a2d08d [id=c83fcb4f43b54817b7aeb042d5e0ec85]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:44.958348 13766 raft_consensus.cc:3058] T b38c8d003413428dae9e47f58e197c2c P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Advancing to term 2
I20250830 07:54:44.959441 13887 consensus_queue.cc:260] T 0507245aa8c74aeb9f3eafba0682590d P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:44.959957 13887 ts_tablet_manager.cc:1428] T 0507245aa8c74aeb9f3eafba0682590d P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20250830 07:54:44.961625 13740 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 494) took 1688 ms. Trace:
I20250830 07:54:44.961807 13887 tablet_bootstrap.cc:492] T e6491d149c0646848680cfdadb6fc76c P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:54:44.967905 13887 tablet_bootstrap.cc:654] T e6491d149c0646848680cfdadb6fc76c P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:44.968647 13754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 91da20bcd25341b5a0f6605b3ec58fb3. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:44.969297 13769 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "cb3c48982add45379c0e1b117ec40c1a" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:44.969924 13886 consensus_queue.cc:260] T ffc5945a032e47d4bd3397d7c887dc62 P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:44.970980 13886 ts_tablet_manager.cc:1428] T ffc5945a032e47d4bd3397d7c887dc62 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.124s user 0.002s sys 0.000s
I20250830 07:54:44.974371 13747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 559fdab1ef804325978db705431a0ad8. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:44.975677 13886 tablet_bootstrap.cc:492] T 73853894da074ecd8147a94ac28bfab8 P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:54:44.982931 13887 tablet_bootstrap.cc:492] T e6491d149c0646848680cfdadb6fc76c P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:54:44.983050 13887 ts_tablet_manager.cc:1397] T e6491d149c0646848680cfdadb6fc76c P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.022s user 0.002s sys 0.001s
I20250830 07:54:44.983615 13887 raft_consensus.cc:357] T e6491d149c0646848680cfdadb6fc76c P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:54:44.983745 13887 raft_consensus.cc:383] T e6491d149c0646848680cfdadb6fc76c P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:44.983784 13887 raft_consensus.cc:738] T e6491d149c0646848680cfdadb6fc76c P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:54:44.985916 13887 consensus_queue.cc:260] T e6491d149c0646848680cfdadb6fc76c P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:54:44.987609 13887 ts_tablet_manager.cc:1428] T e6491d149c0646848680cfdadb6fc76c P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.005s user 0.001s sys 0.000s
I20250830 07:54:44.987874 13887 tablet_bootstrap.cc:492] T e66e56ecdf14466282daab8c894eb3c6 P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:54:44.995458 13887 tablet_bootstrap.cc:654] T e66e56ecdf14466282daab8c894eb3c6 P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:45.004747 13887 tablet_bootstrap.cc:492] T e66e56ecdf14466282daab8c894eb3c6 P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:54:45.009907 13736 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 500) took 1575 ms. Trace:
I20250830 07:54:45.010083 13887 ts_tablet_manager.cc:1397] T e66e56ecdf14466282daab8c894eb3c6 P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.022s user 0.001s sys 0.002s
I20250830 07:54:45.011407 13887 raft_consensus.cc:357] T e66e56ecdf14466282daab8c894eb3c6 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:45.012291 13887 raft_consensus.cc:383] T e66e56ecdf14466282daab8c894eb3c6 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:45.012473 13887 raft_consensus.cc:738] T e66e56ecdf14466282daab8c894eb3c6 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:54:45.012807 13887 consensus_queue.cc:260] T e66e56ecdf14466282daab8c894eb3c6 P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
W20250830 07:54:45.013726 13703 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.209.2:38967, user_credentials={real_user=slave}} blocked reactor thread for 62233.2us
I20250830 07:54:45.014166 13887 ts_tablet_manager.cc:1428] T e66e56ecdf14466282daab8c894eb3c6 P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.004s user 0.000s sys 0.001s
W20250830 07:54:45.014628 13562 leader_election.cc:343] T cb3c48982add45379c0e1b117ec40c1a P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:45.015130 13887 tablet_bootstrap.cc:492] T e255d3fdee09400ead41ca835d6d103f P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
W20250830 07:54:45.015383 13562 leader_election.cc:343] T cb3c48982add45379c0e1b117ec40c1a P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:44.978363 13740 rpcz_store.cc:276] 0830 07:54:43.273193 (+ 0us) service_pool.cc:168] Inserting onto call queue
0830 07:54:44.592546 (+1319353us) service_pool.cc:225] Handling call
0830 07:54:44.631990 (+ 39444us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0830 07:54:44.632021 (+ 31us) ts_tablet_manager.cc:676] Creating new metadata...
0830 07:54:44.880228 (+248207us) tablet_metadata.cc:641] Metadata flushed
0830 07:54:44.961408 (+ 81180us) tablet_replica.cc:206] Creating consensus instance
0830 07:54:44.961581 (+ 173us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20250830 07:54:45.017707 14803 tablet.cc:1722] T 8dddcfe56522436287aea212e316a729 P 6b5e454d98894637b466ea27f1b647f9: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20250830 07:54:45.031875 13887 tablet_bootstrap.cc:654] T e255d3fdee09400ead41ca835d6d103f P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:45.053762 13887 tablet_bootstrap.cc:492] T e255d3fdee09400ead41ca835d6d103f P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:54:45.053966 13887 ts_tablet_manager.cc:1397] T e255d3fdee09400ead41ca835d6d103f P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.039s user 0.001s sys 0.004s
I20250830 07:54:45.055729 13887 raft_consensus.cc:357] T e255d3fdee09400ead41ca835d6d103f P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:45.058804 13887 raft_consensus.cc:383] T e255d3fdee09400ead41ca835d6d103f P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:45.063153 13887 raft_consensus.cc:738] T e255d3fdee09400ead41ca835d6d103f P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:54:45.063436 13887 consensus_queue.cc:260] T e255d3fdee09400ead41ca835d6d103f P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:45.063951 13887 ts_tablet_manager.cc:1428] T e255d3fdee09400ead41ca835d6d103f P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.009s user 0.000s sys 0.001s
I20250830 07:54:45.065770 13887 tablet_bootstrap.cc:492] T 2b4ce50fbd26484faba3faa2ec5115c0 P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:54:45.067634 13887 tablet_bootstrap.cc:654] T 2b4ce50fbd26484faba3faa2ec5115c0 P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:45.073115 13882 tablet_bootstrap.cc:492] T f56cab43580a4ee3a912fc5e58a3bd9d P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:54:45.073282 13882 ts_tablet_manager.cc:1397] T f56cab43580a4ee3a912fc5e58a3bd9d P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.360s user 0.039s sys 0.105s
I20250830 07:54:45.074141 13882 raft_consensus.cc:357] T f56cab43580a4ee3a912fc5e58a3bd9d P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:45.074383 13882 raft_consensus.cc:383] T f56cab43580a4ee3a912fc5e58a3bd9d P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:45.074455 13882 raft_consensus.cc:738] T f56cab43580a4ee3a912fc5e58a3bd9d P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:54:45.074712 13882 consensus_queue.cc:260] T f56cab43580a4ee3a912fc5e58a3bd9d P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:45.075340 13882 ts_tablet_manager.cc:1428] T f56cab43580a4ee3a912fc5e58a3bd9d P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20250830 07:54:45.075656 13882 tablet_bootstrap.cc:492] T 73853894da074ecd8147a94ac28bfab8 P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:54:45.077481 13882 tablet_bootstrap.cc:654] T 73853894da074ecd8147a94ac28bfab8 P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:45.051872 13773 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "99f307a8cbb34addaafab82b3ed18241" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f"
I20250830 07:54:45.052448 13770 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "752727eef0734ff3b7b35b1d5f66aea6" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f"
I20250830 07:54:45.053241 13740 tablet_service.cc:1515] Processing DeleteTablet for tablet 5dffbacf2fcd4a38a1d61cf5bb9c5eeb with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:43 UTC) from {username='slave'} at 127.0.0.1:45460
I20250830 07:54:45.061614 13751 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 509) took 1236 ms. Trace:
I20250830 07:54:45.099267 13751 rpcz_store.cc:276] 0830 07:54:43.825016 (+ 0us) service_pool.cc:168] Inserting onto call queue
0830 07:54:44.802299 (+977283us) service_pool.cc:225] Handling call
0830 07:54:44.818058 (+ 15759us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0830 07:54:44.818089 (+ 31us) ts_tablet_manager.cc:676] Creating new metadata...
0830 07:54:44.915959 (+ 97870us) tablet_metadata.cc:641] Metadata flushed
0830 07:54:45.060879 (+144920us) tablet_replica.cc:206] Creating consensus instance
0830 07:54:45.061003 (+ 124us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20250830 07:54:45.061703 13738 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 496) took 1766 ms. Trace:
I20250830 07:54:45.058390 13736 rpcz_store.cc:276] 0830 07:54:43.402826 (+ 0us) service_pool.cc:168] Inserting onto call queue
0830 07:54:44.622169 (+1219343us) service_pool.cc:225] Handling call
0830 07:54:44.636021 (+ 13852us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0830 07:54:44.636038 (+ 17us) ts_tablet_manager.cc:676] Creating new metadata...
0830 07:54:44.774453 (+138415us) tablet_metadata.cc:641] Metadata flushed
0830 07:54:44.978018 (+203565us) tablet_replica.cc:206] Creating consensus instance
0830 07:54:44.978168 (+ 150us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20250830 07:54:45.100296 13736 tablet_service.cc:1515] Processing DeleteTablet for tablet 23d2c7013c9c4b4aacf47e6ac7ab5a0b with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:43 UTC) from {username='slave'} at 127.0.0.1:45460
I20250830 07:54:45.062935 13735 tablet_service.cc:1515] Processing DeleteTablet for tablet e6b7646588fe4134b2db62ff84ca4791 with delete_type TABLET_DATA_DELETED (replaced by tablet 6bb062f9c4e342489422c8faabfb1b9b) from {username='slave'} at 127.0.0.1:45460
I20250830 07:54:45.101303 13735 tablet_service.cc:1515] Processing DeleteTablet for tablet 0c32e597f17e4e75a0f584b6b7b02c36 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:43 UTC) from {username='slave'} at 127.0.0.1:45460
I20250830 07:54:45.067111 13742 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 512) took 1189 ms. Trace:
I20250830 07:54:45.102208 13742 rpcz_store.cc:276] 0830 07:54:43.854114 (+ 0us) service_pool.cc:168] Inserting onto call queue
0830 07:54:44.851916 (+997802us) service_pool.cc:225] Handling call
0830 07:54:44.852395 (+ 479us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0830 07:54:44.852417 (+ 22us) ts_tablet_manager.cc:676] Creating new metadata...
0830 07:54:45.010182 (+157765us) tablet_metadata.cc:641] Metadata flushed
0830 07:54:45.042899 (+ 32717us) tablet_replica.cc:206] Creating consensus instance
0830 07:54:45.043102 (+ 203us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20250830 07:54:45.068686 13744 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 502) took 1575 ms. Trace:
I20250830 07:54:45.083580 13741 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 508) took 1404 ms. Trace:
I20250830 07:54:45.103296 13741 rpcz_store.cc:276] 0830 07:54:43.772665 (+ 0us) service_pool.cc:168] Inserting onto call queue
0830 07:54:44.732369 (+959704us) service_pool.cc:225] Handling call
0830 07:54:44.732722 (+ 353us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0830 07:54:44.732745 (+ 23us) ts_tablet_manager.cc:676] Creating new metadata...
0830 07:54:44.876720 (+143975us) tablet_metadata.cc:641] Metadata flushed
0830 07:54:45.057382 (+180662us) tablet_replica.cc:206] Creating consensus instance
0830 07:54:45.057480 (+ 98us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20250830 07:54:45.084787 13767 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "533811110191436d96665b3475ab597f" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f"
I20250830 07:54:45.084616 13748 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 511) took 1227 ms. Trace:
I20250830 07:54:45.057876 13886 tablet_bootstrap.cc:654] T 73853894da074ecd8147a94ac28bfab8 P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:45.096426 13772 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "69d6daeb7c774fd48ed296f52ed7c6a6" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f"
I20250830 07:54:45.086966 13749 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 507) took 1440 ms. Trace:
I20250830 07:54:45.104885 13749 rpcz_store.cc:276] 0830 07:54:43.645997 (+ 0us) service_pool.cc:168] Inserting onto call queue
0830 07:54:44.729505 (+1083508us) service_pool.cc:225] Handling call
0830 07:54:44.747920 (+ 18415us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0830 07:54:44.747938 (+ 18us) ts_tablet_manager.cc:676] Creating new metadata...
0830 07:54:44.952380 (+204442us) tablet_metadata.cc:641] Metadata flushed
0830 07:54:45.086360 (+133980us) tablet_replica.cc:206] Creating consensus instance
0830 07:54:45.086530 (+ 170us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20250830 07:54:45.036171 13752 tablet_service.cc:1515] Processing DeleteTablet for tablet c56e3a30c18640e68c8b0c4ff4251d96 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:43 UTC) from {username='slave'} at 127.0.0.1:45460
I20250830 07:54:45.118564 14815 raft_consensus.cc:491] T e6491d149c0646848680cfdadb6fc76c P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:45.118724 14815 raft_consensus.cc:513] T e6491d149c0646848680cfdadb6fc76c P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:54:45.119488 14815 leader_election.cc:290] T e6491d149c0646848680cfdadb6fc76c P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:45.123838 13613 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "e6491d149c0646848680cfdadb6fc76c" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
W20250830 07:54:45.129956 13423 leader_election.cc:343] T e6491d149c0646848680cfdadb6fc76c P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:45.132200 14815 raft_consensus.cc:491] T e66e56ecdf14466282daab8c894eb3c6 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:45.132362 14815 raft_consensus.cc:513] T e66e56ecdf14466282daab8c894eb3c6 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:45.133015 14815 leader_election.cc:290] T e66e56ecdf14466282daab8c894eb3c6 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:45.133724 13613 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "e66e56ecdf14466282daab8c894eb3c6" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
W20250830 07:54:45.134326 13423 leader_election.cc:343] T e66e56ecdf14466282daab8c894eb3c6 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:45.134833 14805 tablet.cc:1722] T 8dddcfe56522436287aea212e316a729 P 2065c332f15a4739899af79f3669c3ba: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20250830 07:54:45.180394 13766 raft_consensus.cc:2466] T b38c8d003413428dae9e47f58e197c2c P 9b057ade5dce45af9f8bf0bedf8b917f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b5e454d98894637b466ea27f1b647f9 in term 2.
I20250830 07:54:45.180891 13773 raft_consensus.cc:3058] T 99f307a8cbb34addaafab82b3ed18241 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:45.181006 13770 raft_consensus.cc:3058] T 752727eef0734ff3b7b35b1d5f66aea6 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:45.181136 13751 tablet_service.cc:1515] Processing DeleteTablet for tablet 042fd7ff08fc4695b87bb8f9d225ef12 with delete_type TABLET_DATA_DELETED (replaced by tablet f2ebc809f1074db78720920286d9385b) from {username='slave'} at 127.0.0.1:45460
I20250830 07:54:45.186609 13751 tablet_service.cc:1515] Processing DeleteTablet for tablet 2b4103f07e96490488913059a95af0c3 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:43 UTC) from {username='slave'} at 127.0.0.1:45460
I20250830 07:54:45.186843 13751 tablet_service.cc:1515] Processing DeleteTablet for tablet d206f6b6e7524a27a9f95787bcd5de77 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:43 UTC) from {username='slave'} at 127.0.0.1:45460
I20250830 07:54:45.187047 13751 tablet_service.cc:1515] Processing DeleteTablet for tablet f52dd8eeb64a4b8a92babf34387b6c5b with delete_type TABLET_DATA_DELETED (replaced by tablet 40ce920462584c25b19befa4146b340f) from {username='slave'} at 127.0.0.1:45460
I20250830 07:54:45.187565 13751 tablet_service.cc:1515] Processing DeleteTablet for tablet 838616d8274648fc9ea4f1583bdb97f9 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:44 UTC) from {username='slave'} at 127.0.0.1:45460
I20250830 07:54:45.188484 13751 tablet_service.cc:1515] Processing DeleteTablet for tablet 88bbd6b4c795433d9b6ad746353f3aa1 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:44 UTC) from {username='slave'} at 127.0.0.1:45460
I20250830 07:54:45.188699 13751 tablet_service.cc:1515] Processing DeleteTablet for tablet d1bf58d367f54ba8bad64887b9a8d9cc with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:44 UTC) from {username='slave'} at 127.0.0.1:45460
I20250830 07:54:45.188905 13751 tablet_service.cc:1515] Processing DeleteTablet for tablet 3bca390f6d4343cba7a9fb07f0d4d72b with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:44 UTC) from {username='slave'} at 127.0.0.1:45460
I20250830 07:54:45.181272 13738 rpcz_store.cc:276] 0830 07:54:43.295529 (+ 0us) service_pool.cc:168] Inserting onto call queue
0830 07:54:44.611982 (+1316453us) service_pool.cc:225] Handling call
0830 07:54:44.612365 (+ 383us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0830 07:54:44.612382 (+ 17us) ts_tablet_manager.cc:676] Creating new metadata...
0830 07:54:44.871947 (+259565us) tablet_metadata.cc:641] Metadata flushed
0830 07:54:45.056279 (+184332us) tablet_replica.cc:206] Creating consensus instance
0830 07:54:45.061675 (+ 5396us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20250830 07:54:45.181468 13740 tablet_service.cc:1515] Processing DeleteTablet for tablet 283aa82b808e49528ceb19133748ffc8 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:43 UTC) from {username='slave'} at 127.0.0.1:45460
I20250830 07:54:45.181581 13736 tablet_service.cc:1515] Processing DeleteTablet for tablet db7144b25ff34bed8c7b779ba9497ef4 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:43 UTC) from {username='slave'} at 127.0.0.1:45460
I20250830 07:54:45.181703 13735 tablet_service.cc:1468] Processing CreateTablet for tablet 986878a23a0b47ee865e09277b027bb0 (DEFAULT_TABLE table=default.Table_06f5b3c7c1d64d37b8f57cd4c75a3074 [id=e3c7fb8fde774dfe863e3ca5f792b119]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:45.192265 13735 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 986878a23a0b47ee865e09277b027bb0. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:45.192401 14674 raft_consensus.cc:491] T f56cab43580a4ee3a912fc5e58a3bd9d P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:45.192559 14674 raft_consensus.cc:513] T f56cab43580a4ee3a912fc5e58a3bd9d P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:45.193295 14674 leader_election.cc:290] T f56cab43580a4ee3a912fc5e58a3bd9d P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:45.193780 13481 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f56cab43580a4ee3a912fc5e58a3bd9d" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:54:45.194000 13481 raft_consensus.cc:2466] T f56cab43580a4ee3a912fc5e58a3bd9d P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b5e454d98894637b466ea27f1b647f9 in term 0.
I20250830 07:54:45.194350 13561 leader_election.cc:304] T f56cab43580a4ee3a912fc5e58a3bd9d P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 6b5e454d98894637b466ea27f1b647f9; no voters:
I20250830 07:54:45.194578 14674 raft_consensus.cc:2802] T f56cab43580a4ee3a912fc5e58a3bd9d P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:54:45.194667 14674 raft_consensus.cc:491] T f56cab43580a4ee3a912fc5e58a3bd9d P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:54:45.194758 14674 raft_consensus.cc:3058] T f56cab43580a4ee3a912fc5e58a3bd9d P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:45.198072 14674 raft_consensus.cc:513] T f56cab43580a4ee3a912fc5e58a3bd9d P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:45.199115 13481 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f56cab43580a4ee3a912fc5e58a3bd9d" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba"
I20250830 07:54:45.199304 13481 raft_consensus.cc:3058] T f56cab43580a4ee3a912fc5e58a3bd9d P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:45.199340 14674 leader_election.cc:290] T f56cab43580a4ee3a912fc5e58a3bd9d P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 election: Requested vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:45.181906 13742 tablet_service.cc:1468] Processing CreateTablet for tablet 6fb5cd3618584dd3a0ee43a10f7a2660 (DEFAULT_TABLE table=default.Table_7abf2e48a940411181ec19ecfe22ce3f [id=fb22b8356fa341be882cccb6467e2135]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:45.200014 13742 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6fb5cd3618584dd3a0ee43a10f7a2660. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:45.182049 13744 rpcz_store.cc:276] 0830 07:54:43.493702 (+ 0us) service_pool.cc:168] Inserting onto call queue
0830 07:54:44.646432 (+1152730us) service_pool.cc:225] Handling call
0830 07:54:44.665021 (+ 18589us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0830 07:54:44.665047 (+ 26us) ts_tablet_manager.cc:676] Creating new metadata...
0830 07:54:44.754358 (+ 89311us) tablet_metadata.cc:641] Metadata flushed
0830 07:54:45.068500 (+314142us) tablet_replica.cc:206] Creating consensus instance
0830 07:54:45.068640 (+ 140us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20250830 07:54:45.182273 13741 tablet_service.cc:1468] Processing CreateTablet for tablet fac764a2d269411c86b85ceeaec0b014 (DEFAULT_TABLE table=default.Table_d2e35b9bab8b4f559b34fe632e69f973 [id=79ead01cb7c54bba8701da6c74224b2b]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:45.182442 13748 rpcz_store.cc:276] 0830 07:54:43.852191 (+ 0us) service_pool.cc:168] Inserting onto call queue
0830 07:54:44.818119 (+965928us) service_pool.cc:225] Handling call
0830 07:54:44.823070 (+ 4951us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0830 07:54:44.823090 (+ 20us) ts_tablet_manager.cc:676] Creating new metadata...
0830 07:54:44.887274 (+ 64184us) tablet_metadata.cc:641] Metadata flushed
0830 07:54:45.070825 (+183551us) tablet_replica.cc:206] Creating consensus instance
0830 07:54:45.079645 (+ 8820us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20250830 07:54:45.182629 13749 tablet_service.cc:1468] Processing CreateTablet for tablet a5eea1950d1945f1b755fd34597b2fb4 (DEFAULT_TABLE table=default.Table_3fc8320fad174384a19616004d3b6e4e [id=965e15b7139f4b7aa3653373dbbea5e0]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:45.182753 13701 leader_election.cc:304] T 508ce3cc87734e5b8cec40e74522549a P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 2065c332f15a4739899af79f3669c3ba, 6b5e454d98894637b466ea27f1b647f9
I20250830 07:54:45.182952 13752 tablet_service.cc:1468] Processing CreateTablet for tablet 5dffbacf2fcd4a38a1d61cf5bb9c5eeb (DEFAULT_TABLE table=default.Table_f8d552f66f96486cb2b5984a52b993ce [id=803bcda3ed6641749163c3162af467f2]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:45.184752 13745 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 510) took 1087 ms. Trace:
I20250830 07:54:45.202693 13481 raft_consensus.cc:2466] T f56cab43580a4ee3a912fc5e58a3bd9d P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b5e454d98894637b466ea27f1b647f9 in term 1.
I20250830 07:54:45.202992 13561 leader_election.cc:304] T f56cab43580a4ee3a912fc5e58a3bd9d P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 6b5e454d98894637b466ea27f1b647f9; no voters:
I20250830 07:54:45.203215 14674 raft_consensus.cc:2802] T f56cab43580a4ee3a912fc5e58a3bd9d P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Leader election won for term 1
I20250830 07:54:45.203624 14674 raft_consensus.cc:695] T f56cab43580a4ee3a912fc5e58a3bd9d P 6b5e454d98894637b466ea27f1b647f9 [term 1 LEADER]: Becoming Leader. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Running, Role: LEADER
I20250830 07:54:45.203938 14674 consensus_queue.cc:237] T f56cab43580a4ee3a912fc5e58a3bd9d P 6b5e454d98894637b466ea27f1b647f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:45.213742 13562 leader_election.cc:304] T b38c8d003413428dae9e47f58e197c2c P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 2065c332f15a4739899af79f3669c3ba
I20250830 07:54:45.214284 14674 raft_consensus.cc:2802] T b38c8d003413428dae9e47f58e197c2c P 6b5e454d98894637b466ea27f1b647f9 [term 2 FOLLOWER]: Leader election won for term 2
I20250830 07:54:45.216405 14674 raft_consensus.cc:695] T b38c8d003413428dae9e47f58e197c2c P 6b5e454d98894637b466ea27f1b647f9 [term 2 LEADER]: Becoming Leader. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Running, Role: LEADER
I20250830 07:54:45.216773 14674 consensus_queue.cc:237] T b38c8d003413428dae9e47f58e197c2c P 6b5e454d98894637b466ea27f1b647f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:45.201218 14818 raft_consensus.cc:2747] T 508ce3cc87734e5b8cec40e74522549a P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20250830 07:54:45.200695 13741 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fac764a2d269411c86b85ceeaec0b014. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:45.202080 13769 raft_consensus.cc:1238] T b38c8d003413428dae9e47f58e197c2c P 9b057ade5dce45af9f8bf0bedf8b917f [term 2 FOLLOWER]: Rejecting Update request from peer 2065c332f15a4739899af79f3669c3ba for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20250830 07:54:45.204881 13767 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f56cab43580a4ee3a912fc5e58a3bd9d" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f"
W20250830 07:54:45.254410 13562 leader_election.cc:343] T f56cab43580a4ee3a912fc5e58a3bd9d P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Illegal state: must be running to vote when last-logged opid is not known
W20250830 07:54:45.201411 13701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.209.1:45325, user_credentials={real_user=slave}} blocked reactor thread for 104322us
I20250830 07:54:45.194808 13772 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f56cab43580a4ee3a912fc5e58a3bd9d" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
W20250830 07:54:45.258265 13562 leader_election.cc:343] T f56cab43580a4ee3a912fc5e58a3bd9d P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:45.213418 13745 rpcz_store.cc:276] 0830 07:54:43.826358 (+ 0us) service_pool.cc:168] Inserting onto call queue
0830 07:54:44.815384 (+989026us) service_pool.cc:225] Handling call
0830 07:54:44.815767 (+ 383us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0830 07:54:44.815787 (+ 20us) ts_tablet_manager.cc:676] Creating new metadata...
0830 07:54:44.911054 (+ 95267us) tablet_metadata.cc:641] Metadata flushed
0830 07:54:44.914078 (+ 3024us) tablet_replica.cc:206] Creating consensus instance
0830 07:54:44.914222 (+ 144us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20250830 07:54:45.263100 13749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a5eea1950d1945f1b755fd34597b2fb4. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:45.264518 13755 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 506) took 1613 ms. Trace:
I20250830 07:54:45.264760 13886 tablet_bootstrap.cc:492] T 73853894da074ecd8147a94ac28bfab8 P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:54:45.264947 13886 ts_tablet_manager.cc:1397] T 73853894da074ecd8147a94ac28bfab8 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.294s user 0.007s sys 0.003s
I20250830 07:54:45.264405 13701 leader_election.cc:304] T e862fa77e16945bd94e405aa3474f021 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 2065c332f15a4739899af79f3669c3ba, 6b5e454d98894637b466ea27f1b647f9
I20250830 07:54:45.267683 14832 tablet.cc:1722] T dbe542c478874482b078296a7a0e9ec9 P 9b057ade5dce45af9f8bf0bedf8b917f: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20250830 07:54:45.268692 13752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5dffbacf2fcd4a38a1d61cf5bb9c5eeb. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:45.272338 13755 rpcz_store.cc:276] 0830 07:54:43.639429 (+ 0us) service_pool.cc:168] Inserting onto call queue
0830 07:54:44.728494 (+1089065us) service_pool.cc:225] Handling call
0830 07:54:44.731933 (+ 3439us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0830 07:54:44.731956 (+ 23us) ts_tablet_manager.cc:676] Creating new metadata...
0830 07:54:45.011191 (+279235us) tablet_metadata.cc:641] Metadata flushed
0830 07:54:45.252300 (+241109us) tablet_replica.cc:206] Creating consensus instance
0830 07:54:45.252469 (+ 169us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20250830 07:54:45.274803 13886 raft_consensus.cc:357] T 73853894da074ecd8147a94ac28bfab8 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:45.275040 13886 raft_consensus.cc:383] T 73853894da074ecd8147a94ac28bfab8 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:45.276906 14818 raft_consensus.cc:2747] T e862fa77e16945bd94e405aa3474f021 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:54:45.277441 13887 tablet_bootstrap.cc:492] T 2b4ce50fbd26484faba3faa2ec5115c0 P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:54:45.277590 13887 ts_tablet_manager.cc:1397] T 2b4ce50fbd26484faba3faa2ec5115c0 P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.212s user 0.021s sys 0.037s
I20250830 07:54:45.278349 13887 raft_consensus.cc:357] T 2b4ce50fbd26484faba3faa2ec5115c0 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:45.278527 13887 raft_consensus.cc:383] T 2b4ce50fbd26484faba3faa2ec5115c0 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:45.278570 13887 raft_consensus.cc:738] T 2b4ce50fbd26484faba3faa2ec5115c0 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:54:45.278738 13887 consensus_queue.cc:260] T 2b4ce50fbd26484faba3faa2ec5115c0 P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:45.279281 13887 ts_tablet_manager.cc:1428] T 2b4ce50fbd26484faba3faa2ec5115c0 P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20250830 07:54:45.280205 13773 raft_consensus.cc:2466] T 99f307a8cbb34addaafab82b3ed18241 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2065c332f15a4739899af79f3669c3ba in term 1.
I20250830 07:54:45.281525 13887 tablet_bootstrap.cc:492] T c0147310dad84226808332a4c2c6e09d P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:54:45.281993 13886 raft_consensus.cc:738] T 73853894da074ecd8147a94ac28bfab8 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:54:45.282265 13886 consensus_queue.cc:260] T 73853894da074ecd8147a94ac28bfab8 P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:45.282748 13770 raft_consensus.cc:2466] T 752727eef0734ff3b7b35b1d5f66aea6 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b5e454d98894637b466ea27f1b647f9 in term 1.
I20250830 07:54:45.283098 13887 tablet_bootstrap.cc:654] T c0147310dad84226808332a4c2c6e09d P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:45.289248 13886 ts_tablet_manager.cc:1428] T 73853894da074ecd8147a94ac28bfab8 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.018s user 0.002s sys 0.000s
I20250830 07:54:45.289119 13701 leader_election.cc:304] T d3f207cee78a43a1b5e030c09752c78c P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:54:45.293586 14818 raft_consensus.cc:2802] T d3f207cee78a43a1b5e030c09752c78c P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election won for term 1
I20250830 07:54:45.293753 14818 raft_consensus.cc:695] T d3f207cee78a43a1b5e030c09752c78c P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 LEADER]: Becoming Leader. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Running, Role: LEADER
I20250830 07:54:45.297416 13887 tablet_bootstrap.cc:492] T c0147310dad84226808332a4c2c6e09d P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:54:45.297562 13887 ts_tablet_manager.cc:1397] T c0147310dad84226808332a4c2c6e09d P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.016s user 0.003s sys 0.000s
I20250830 07:54:45.298269 13737 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 503) took 1780 ms. Trace:
I20250830 07:54:45.298408 13887 raft_consensus.cc:357] T c0147310dad84226808332a4c2c6e09d P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:45.298585 13887 raft_consensus.cc:383] T c0147310dad84226808332a4c2c6e09d P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:45.298646 13887 raft_consensus.cc:738] T c0147310dad84226808332a4c2c6e09d P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:54:45.298892 13887 consensus_queue.cc:260] T c0147310dad84226808332a4c2c6e09d P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:45.299706 13887 ts_tablet_manager.cc:1428] T c0147310dad84226808332a4c2c6e09d P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20250830 07:54:45.299969 13887 tablet_bootstrap.cc:492] T acca1a8240454b889c63c82d3c75087e P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:54:45.301822 13887 tablet_bootstrap.cc:654] T acca1a8240454b889c63c82d3c75087e P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
W20250830 07:54:45.302790 13229 catalog_manager.cc:5415] Ignoring report from unknown tablet b4ab964a64a64e00a78ffd2b220aef46
W20250830 07:54:45.304962 13225 catalog_manager.cc:5415] Ignoring report from unknown tablet e4c5eedb7f4d4397b19b8a3e0ddf9458
W20250830 07:54:45.305091 13225 catalog_manager.cc:5415] Ignoring report from unknown tablet ff2267fb411942ff826e2a72bcb89cd7
W20250830 07:54:45.305160 13225 catalog_manager.cc:5415] Ignoring report from unknown tablet 752727eef0734ff3b7b35b1d5f66aea6
W20250830 07:54:45.305249 13225 catalog_manager.cc:5415] Ignoring report from unknown tablet 6dda55ec2da34c8aba9f39a63e144a7c
W20250830 07:54:45.305313 13225 catalog_manager.cc:5415] Ignoring report from unknown tablet 30c2558c28944ff39d1a4a4ca9ac604e
W20250830 07:54:45.305389 13225 catalog_manager.cc:5415] Ignoring report from unknown tablet d1ae3812d72b419798736328da64b53c
I20250830 07:54:45.306463 13225 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_d2e35b9bab8b4f559b34fe632e69f973" } new_table_name: "default.Table_d63b9139d2864f4180dc5b7f59a0f5dc" modify_external_catalogs: true
W20250830 07:54:45.302886 13229 catalog_manager.cc:5415] Ignoring report from unknown tablet 04eadf45b82e4c319eb7b316a402d81a
W20250830 07:54:45.307502 13229 catalog_manager.cc:5415] Ignoring report from unknown tablet e4f1ff6026bb45e28e63c27c83399d72
W20250830 07:54:45.307648 13229 catalog_manager.cc:5415] Ignoring report from unknown tablet e862fa77e16945bd94e405aa3474f021
W20250830 07:54:45.307770 13229 catalog_manager.cc:5415] Ignoring report from unknown tablet b38c8d003413428dae9e47f58e197c2c
W20250830 07:54:45.307857 13229 catalog_manager.cc:5415] Ignoring report from unknown tablet 05da843c0fe4482a926e410e06b22461
W20250830 07:54:45.308049 13229 catalog_manager.cc:5415] Ignoring report from unknown tablet cf5613278b4c4f3bbe751b1ae6f3c313
I20250830 07:54:45.308871 13229 catalog_manager.cc:5674] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325) does not have the latest schema for tablet 14ed24577c8f49f49c83242a26877614 (table default.Table_4428c29c8358411282f00fd33a6badd4 [id=bcee72f9b1c6407f98435a1494b42407]). Expected version 1 got 0
I20250830 07:54:45.309298 13229 catalog_manager.cc:5674] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325) does not have the latest schema for tablet 8dddcfe56522436287aea212e316a729 (table default.Table_e0d2400861094b258fca0704d88ed743 [id=c483c08824f24586855e3575a590b294]). Expected version 2 got 0
I20250830 07:54:45.318822 13228 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet 852e353f6ee945628ddebdbdd1bd76fb
I20250830 07:54:45.320797 13458 tablet_service.cc:1515] Processing DeleteTablet for tablet 852e353f6ee945628ddebdbdd1bd76fb with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:44 UTC) from {username='slave'} at 127.0.0.1:37956
I20250830 07:54:45.320982 13599 tablet_service.cc:1515] Processing DeleteTablet for tablet 852e353f6ee945628ddebdbdd1bd76fb with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:44 UTC) from {username='slave'} at 127.0.0.1:45306
W20250830 07:54:45.321310 13232 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 2c4c3c61cddf42668d3a09f4fbc5f641 consensus state has no leader
W20250830 07:54:45.323084 13218 catalog_manager.cc:4908] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): delete failed for tablet 852e353f6ee945628ddebdbdd1bd76fb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 852e353f6ee945628ddebdbdd1bd76fb already in progress: creating tablet
I20250830 07:54:45.323407 13887 tablet_bootstrap.cc:492] T acca1a8240454b889c63c82d3c75087e P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:54:45.323529 13887 ts_tablet_manager.cc:1397] T acca1a8240454b889c63c82d3c75087e P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.024s user 0.005s sys 0.001s
I20250830 07:54:45.324226 13887 raft_consensus.cc:357] T acca1a8240454b889c63c82d3c75087e P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:45.324390 13887 raft_consensus.cc:383] T acca1a8240454b889c63c82d3c75087e P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:45.324460 13887 raft_consensus.cc:738] T acca1a8240454b889c63c82d3c75087e P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:54:45.324666 13887 consensus_queue.cc:260] T acca1a8240454b889c63c82d3c75087e P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:45.325398 13887 ts_tablet_manager.cc:1428] T acca1a8240454b889c63c82d3c75087e P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20250830 07:54:45.325661 13887 tablet_bootstrap.cc:492] T 6a82ea7078e344a497c34f932e139bcd P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:54:45.327208 13887 tablet_bootstrap.cc:654] T 6a82ea7078e344a497c34f932e139bcd P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
W20250830 07:54:45.342990 13219 catalog_manager.cc:4895] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): delete failed for tablet 5dffbacf2fcd4a38a1d61cf5bb9c5eeb because the tablet was not found. No further retry: Not found: Tablet not found: 5dffbacf2fcd4a38a1d61cf5bb9c5eeb
I20250830 07:54:45.296696 14818 consensus_queue.cc:237] T d3f207cee78a43a1b5e030c09752c78c P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:45.351058 13886 tablet_bootstrap.cc:492] T 8dddcfe56522436287aea212e316a729 P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:54:45.352277 13737 rpcz_store.cc:276] 0830 07:54:43.493815 (+ 0us) service_pool.cc:168] Inserting onto call queue
0830 07:54:44.677275 (+1183460us) service_pool.cc:225] Handling call
0830 07:54:44.681119 (+ 3844us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0830 07:54:44.681141 (+ 22us) ts_tablet_manager.cc:676] Creating new metadata...
0830 07:54:44.992081 (+310940us) tablet_metadata.cc:641] Metadata flushed
0830 07:54:45.274438 (+282357us) tablet_replica.cc:206] Creating consensus instance
0830 07:54:45.274591 (+ 153us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20250830 07:54:45.354360 13233 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_215b7f39935142a88ce385ee6fc0a5c6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:45.369365 13233 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_215b7f39935142a88ce385ee6fc0a5c6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:45.355218 13232 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_3cbdf35c754f444abc2be4d675765540"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:45.370251 13232 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3cbdf35c754f444abc2be4d675765540 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250830 07:54:45.356859 13228 catalog_manager.cc:5415] Ignoring report from unknown tablet b38c8d003413428dae9e47f58e197c2c
W20250830 07:54:45.370666 13228 catalog_manager.cc:5415] Ignoring report from unknown tablet 04c9d954106a4417a34ff80bc98e2ce8
W20250830 07:54:45.370857 13228 catalog_manager.cc:5415] Ignoring report from unknown tablet afb132e8a5b14a029e005e375f276348
W20250830 07:54:45.370949 13228 catalog_manager.cc:5415] Ignoring report from unknown tablet e862fa77e16945bd94e405aa3474f021
W20250830 07:54:45.371030 13228 catalog_manager.cc:5415] Ignoring report from unknown tablet cf5613278b4c4f3bbe751b1ae6f3c313
W20250830 07:54:45.371182 13228 catalog_manager.cc:5415] Ignoring report from unknown tablet 533811110191436d96665b3475ab597f
W20250830 07:54:45.371320 13228 catalog_manager.cc:5415] Ignoring report from unknown tablet cb3c48982add45379c0e1b117ec40c1a
W20250830 07:54:45.371413 13228 catalog_manager.cc:5415] Ignoring report from unknown tablet 853503f3f98a49219b077af980180400
W20250830 07:54:45.371491 13228 catalog_manager.cc:5415] Ignoring report from unknown tablet e4c5eedb7f4d4397b19b8a3e0ddf9458
W20250830 07:54:45.372272 13228 catalog_manager.cc:5415] Ignoring report from unknown tablet ff2267fb411942ff826e2a72bcb89cd7
W20250830 07:54:45.372407 13228 catalog_manager.cc:5415] Ignoring report from unknown tablet 752727eef0734ff3b7b35b1d5f66aea6
W20250830 07:54:45.372464 13228 catalog_manager.cc:5415] Ignoring report from unknown tablet 30c2558c28944ff39d1a4a4ca9ac604e
I20250830 07:54:45.373437 13228 catalog_manager.cc:5582] T 7af74bdde363493f8061eba450ecf4b4 P 6b5e454d98894637b466ea27f1b647f9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2). New cstate: current_term: 1 leader_uuid: "6b5e454d98894637b466ea27f1b647f9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } health_report { overall_health: UNKNOWN } } }
I20250830 07:54:45.374214 13228 catalog_manager.cc:5674] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967) does not have the latest schema for tablet 14ed24577c8f49f49c83242a26877614 (table default.Table_4428c29c8358411282f00fd33a6badd4 [id=bcee72f9b1c6407f98435a1494b42407]). Expected version 1 got 0
I20250830 07:54:45.374508 13228 catalog_manager.cc:5582] T f56cab43580a4ee3a912fc5e58a3bd9d P 6b5e454d98894637b466ea27f1b647f9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2). New cstate: current_term: 1 leader_uuid: "6b5e454d98894637b466ea27f1b647f9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } health_report { overall_health: UNKNOWN } } }
I20250830 07:54:45.377599 13228 catalog_manager.cc:5674] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967) does not have the latest schema for tablet f56cab43580a4ee3a912fc5e58a3bd9d (table default.Table_a2e96e9e547e4a07a6ccd9839e3d909c [id=6fc5c53b47c24f8283191be07f6f3cb1]). Expected version 1 got 0
W20250830 07:54:45.379186 13219 catalog_manager.cc:4908] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): delete failed for tablet 23d2c7013c9c4b4aacf47e6ac7ab5a0b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 23d2c7013c9c4b4aacf47e6ac7ab5a0b already in progress: creating tablet
I20250830 07:54:45.395833 13746 tablet_service.cc:1468] Processing CreateTablet for tablet 6f8b6f233e5c49b39b3ef6314508e9d9 (DEFAULT_TABLE table=default.Table_106c5d91b7314b3398e48ac2c97aa95b [id=7f24e7d037584d65b1c480cf52b59fa9]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:45.396308 13753 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 519) took 1147 ms. Trace:
I20250830 07:54:45.404950 13739 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 520) took 1147 ms. Trace:
I20250830 07:54:45.405066 13739 rpcz_store.cc:276] 0830 07:54:44.203097 (+ 0us) service_pool.cc:168] Inserting onto call queue
0830 07:54:44.937964 (+734867us) service_pool.cc:225] Handling call
0830 07:54:44.938436 (+ 472us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0830 07:54:44.938462 (+ 26us) ts_tablet_manager.cc:676] Creating new metadata...
0830 07:54:45.133234 (+194772us) tablet_metadata.cc:641] Metadata flushed
0830 07:54:45.327880 (+194646us) tablet_replica.cc:206] Creating consensus instance
0830 07:54:45.350762 (+ 22882us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20250830 07:54:45.408085 13886 tablet_bootstrap.cc:654] T 8dddcfe56522436287aea212e316a729 P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:45.422564 14674 consensus_queue.cc:1035] T 7af74bdde363493f8061eba450ecf4b4 P 6b5e454d98894637b466ea27f1b647f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:54:45.423666 13750 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 518) took 1219 ms. Trace:
I20250830 07:54:45.425981 13747 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 521) took 1222 ms. Trace:
I20250830 07:54:45.427793 13754 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45460 (request call id 517) took 1224 ms. Trace:
I20250830 07:54:45.404740 13701 leader_election.cc:304] T f53e7423d1f54566a667195f7cf5e1ce P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 2065c332f15a4739899af79f3669c3ba, 6b5e454d98894637b466ea27f1b647f9
W20250830 07:54:45.392076 13234 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 78fe9f6325c243a490f361aa79295c36 consensus state has no leader
W20250830 07:54:45.439111 13219 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.12.209.3:38743, user_credentials={real_user=slave}} blocked reactor thread for 59911.1us
W20250830 07:54:45.439797 13219 catalog_manager.cc:4908] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): delete failed for tablet e6b7646588fe4134b2db62ff84ca4791 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e6b7646588fe4134b2db62ff84ca4791 already in progress: creating tablet
W20250830 07:54:45.440141 13219 catalog_manager.cc:4908] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): delete failed for tablet 0c32e597f17e4e75a0f584b6b7b02c36 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0c32e597f17e4e75a0f584b6b7b02c36 already in progress: creating tablet
W20250830 07:54:45.440671 13219 catalog_manager.cc:4908] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): delete failed for tablet c56e3a30c18640e68c8b0c4ff4251d96 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c56e3a30c18640e68c8b0c4ff4251d96 already in progress: creating tablet
W20250830 07:54:45.441488 13234 catalog_manager.cc:5415] Ignoring report from unknown tablet 6dda55ec2da34c8aba9f39a63e144a7c
W20250830 07:54:45.443580 13234 catalog_manager.cc:5415] Ignoring report from unknown tablet 853503f3f98a49219b077af980180400
W20250830 07:54:45.443709 13234 catalog_manager.cc:5415] Ignoring report from unknown tablet 1fa571e9490e499792225d7b786e8658
W20250830 07:54:45.443784 13234 catalog_manager.cc:5415] Ignoring report from unknown tablet ff0f9cccc8ed43b1a8cd38de0e9d4097
W20250830 07:54:45.443833 13234 catalog_manager.cc:5415] Ignoring report from unknown tablet e862fa77e16945bd94e405aa3474f021
W20250830 07:54:45.443902 13234 catalog_manager.cc:5415] Ignoring report from unknown tablet f398e12cd9f543738d5163354f8a9d9d
W20250830 07:54:45.443960 13234 catalog_manager.cc:5415] Ignoring report from unknown tablet 04c9d954106a4417a34ff80bc98e2ce8
W20250830 07:54:45.443004 13220 catalog_manager.cc:4908] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet 852e353f6ee945628ddebdbdd1bd76fb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 852e353f6ee945628ddebdbdd1bd76fb already in progress: creating tablet
W20250830 07:54:45.444357 13219 catalog_manager.cc:4908] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): delete failed for tablet 042fd7ff08fc4695b87bb8f9d225ef12 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 042fd7ff08fc4695b87bb8f9d225ef12 already in progress: creating tablet
W20250830 07:54:45.444556 13219 catalog_manager.cc:4908] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): delete failed for tablet 2b4103f07e96490488913059a95af0c3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2b4103f07e96490488913059a95af0c3 already in progress: creating tablet
W20250830 07:54:45.444770 13219 catalog_manager.cc:4908] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): delete failed for tablet d206f6b6e7524a27a9f95787bcd5de77 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d206f6b6e7524a27a9f95787bcd5de77 already in progress: creating tablet
W20250830 07:54:45.457927 13219 catalog_manager.cc:4908] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): delete failed for tablet f52dd8eeb64a4b8a92babf34387b6c5b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f52dd8eeb64a4b8a92babf34387b6c5b already in progress: creating tablet
W20250830 07:54:45.458652 13219 catalog_manager.cc:4895] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): delete failed for tablet 838616d8274648fc9ea4f1583bdb97f9 because the tablet was not found. No further retry: Not found: Tablet not found: 838616d8274648fc9ea4f1583bdb97f9
I20250830 07:54:45.461279 13754 rpcz_store.cc:276] 0830 07:54:44.202822 (+ 0us) service_pool.cc:168] Inserting onto call queue
0830 07:54:44.921591 (+718769us) service_pool.cc:225] Handling call
0830 07:54:44.957901 (+ 36310us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0830 07:54:44.957926 (+ 25us) ts_tablet_manager.cc:676] Creating new metadata...
0830 07:54:45.250805 (+292879us) tablet_metadata.cc:641] Metadata flushed
0830 07:54:45.427654 (+176849us) tablet_replica.cc:206] Creating consensus instance
0830 07:54:45.427753 (+ 99us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20250830 07:54:45.461774 13701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.209.1:45325, user_credentials={real_user=slave}} blocked reactor thread for 88071.8us
I20250830 07:54:45.462152 13882 tablet_bootstrap.cc:492] T 73853894da074ecd8147a94ac28bfab8 P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:54:45.462284 13882 ts_tablet_manager.cc:1397] T 73853894da074ecd8147a94ac28bfab8 P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.387s user 0.121s sys 0.206s
I20250830 07:54:45.462949 13882 raft_consensus.cc:357] T 73853894da074ecd8147a94ac28bfab8 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:45.463104 13882 raft_consensus.cc:383] T 73853894da074ecd8147a94ac28bfab8 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:45.463155 13882 raft_consensus.cc:738] T 73853894da074ecd8147a94ac28bfab8 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:54:45.463387 13882 consensus_queue.cc:260] T 73853894da074ecd8147a94ac28bfab8 P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:45.463804 13882 ts_tablet_manager.cc:1428] T 73853894da074ecd8147a94ac28bfab8 P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20250830 07:54:45.464103 13882 tablet_bootstrap.cc:492] T ffc5945a032e47d4bd3397d7c887dc62 P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:54:45.465663 13882 tablet_bootstrap.cc:654] T ffc5945a032e47d4bd3397d7c887dc62 P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
W20250830 07:54:45.469506 13219 catalog_manager.cc:4908] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): delete failed for tablet 88bbd6b4c795433d9b6ad746353f3aa1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 88bbd6b4c795433d9b6ad746353f3aa1 already in progress: creating tablet
W20250830 07:54:45.469843 13219 catalog_manager.cc:4908] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): delete failed for tablet d1bf58d367f54ba8bad64887b9a8d9cc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d1bf58d367f54ba8bad64887b9a8d9cc already in progress: creating tablet
W20250830 07:54:45.470141 13219 catalog_manager.cc:4908] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): delete failed for tablet 3bca390f6d4343cba7a9fb07f0d4d72b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3bca390f6d4343cba7a9fb07f0d4d72b already in progress: creating tablet
W20250830 07:54:45.470499 13219 catalog_manager.cc:4908] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): delete failed for tablet 283aa82b808e49528ceb19133748ffc8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 283aa82b808e49528ceb19133748ffc8 already in progress: creating tablet
W20250830 07:54:45.470782 13219 catalog_manager.cc:4908] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): delete failed for tablet db7144b25ff34bed8c7b779ba9497ef4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet db7144b25ff34bed8c7b779ba9497ef4 already in progress: creating tablet
I20250830 07:54:45.423858 13750 rpcz_store.cc:276] 0830 07:54:44.202926 (+ 0us) service_pool.cc:168] Inserting onto call queue
0830 07:54:44.934529 (+731603us) service_pool.cc:225] Handling call
0830 07:54:44.935103 (+ 574us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0830 07:54:44.935143 (+ 40us) ts_tablet_manager.cc:676] Creating new metadata...
0830 07:54:45.050656 (+115513us) tablet_metadata.cc:641] Metadata flushed
0830 07:54:45.422347 (+371691us) tablet_replica.cc:206] Creating consensus instance
0830 07:54:45.422483 (+ 136us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20250830 07:54:45.476397 13747 rpcz_store.cc:276] 0830 07:54:44.203168 (+ 0us) service_pool.cc:168] Inserting onto call queue
0830 07:54:44.939513 (+736345us) service_pool.cc:225] Handling call
0830 07:54:44.964039 (+ 24526us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0830 07:54:44.964068 (+ 29us) ts_tablet_manager.cc:676] Creating new metadata...
0830 07:54:45.247837 (+283769us) tablet_metadata.cc:641] Metadata flushed
0830 07:54:45.425776 (+177939us) tablet_replica.cc:206] Creating consensus instance
0830 07:54:45.425942 (+ 166us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20250830 07:54:45.477720 14533 raft_consensus.cc:2747] T f53e7423d1f54566a667195f7cf5e1ce P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20250830 07:54:45.479573 13882 tablet_bootstrap.cc:492] T ffc5945a032e47d4bd3397d7c887dc62 P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:54:45.479701 13882 ts_tablet_manager.cc:1397] T ffc5945a032e47d4bd3397d7c887dc62 P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.016s user 0.002s sys 0.000s
W20250830 07:54:45.479741 13703 consensus_peers.cc:489] T f398e12cd9f543738d5163354f8a9d9d P 9b057ade5dce45af9f8bf0bedf8b917f -> Peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Couldn't send request to peer 6b5e454d98894637b466ea27f1b647f9. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f398e12cd9f543738d5163354f8a9d9d. This is attempt 6: this message will repeat every 5th retry.
W20250830 07:54:45.479838 13703 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.209.2:38967, user_credentials={real_user=slave}} blocked reactor thread for 47105.6us
W20250830 07:54:45.480036 13422 leader_election.cc:343] T 533811110191436d96665b3475ab597f P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Illegal state: must be running to vote when last-logged opid is not known
W20250830 07:54:45.480342 13422 leader_election.cc:343] T 69d6daeb7c774fd48ed296f52ed7c6a6 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:45.480758 13882 raft_consensus.cc:357] T ffc5945a032e47d4bd3397d7c887dc62 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:45.481158 13882 raft_consensus.cc:383] T ffc5945a032e47d4bd3397d7c887dc62 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:45.481216 13882 raft_consensus.cc:738] T ffc5945a032e47d4bd3397d7c887dc62 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:54:45.481487 13887 tablet_bootstrap.cc:492] T 6a82ea7078e344a497c34f932e139bcd P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:54:45.481462 13882 consensus_queue.cc:260] T ffc5945a032e47d4bd3397d7c887dc62 P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:45.481614 13887 ts_tablet_manager.cc:1397] T 6a82ea7078e344a497c34f932e139bcd P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.156s user 0.015s sys 0.026s
I20250830 07:54:45.481609 13422 leader_election.cc:304] T 99f307a8cbb34addaafab82b3ed18241 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:54:45.481843 14644 raft_consensus.cc:2802] T 99f307a8cbb34addaafab82b3ed18241 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election won for term 1
I20250830 07:54:45.481953 14644 raft_consensus.cc:695] T 99f307a8cbb34addaafab82b3ed18241 P 2065c332f15a4739899af79f3669c3ba [term 1 LEADER]: Becoming Leader. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Running, Role: LEADER
I20250830 07:54:45.482180 14644 consensus_queue.cc:237] T 99f307a8cbb34addaafab82b3ed18241 P 2065c332f15a4739899af79f3669c3ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:45.482853 13887 raft_consensus.cc:357] T 6a82ea7078e344a497c34f932e139bcd P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:45.483044 13887 raft_consensus.cc:383] T 6a82ea7078e344a497c34f932e139bcd P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:45.483100 13887 raft_consensus.cc:738] T 6a82ea7078e344a497c34f932e139bcd P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:54:45.483286 13887 consensus_queue.cc:260] T 6a82ea7078e344a497c34f932e139bcd P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:45.483748 13887 ts_tablet_manager.cc:1428] T 6a82ea7078e344a497c34f932e139bcd P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20250830 07:54:45.484071 13887 tablet_bootstrap.cc:492] T 4c4a8eea119044b49e2b29f10a703097 P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:54:45.484200 14753 consensus_queue.cc:1035] T 7af74bdde363493f8061eba450ecf4b4 P 6b5e454d98894637b466ea27f1b647f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:54:45.486867 13887 tablet_bootstrap.cc:654] T 4c4a8eea119044b49e2b29f10a703097 P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:45.488478 13882 ts_tablet_manager.cc:1428] T ffc5945a032e47d4bd3397d7c887dc62 P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.009s user 0.002s sys 0.000s
I20250830 07:54:45.488770 13882 tablet_bootstrap.cc:492] T 007435e198b9440db055711a98e3148a P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:54:45.490461 13882 tablet_bootstrap.cc:654] T 007435e198b9440db055711a98e3148a P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:45.490458 13230 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_e671b5354b7b4ebe8814ab52385e56fe" } new_table_name: "default.Table_8a839bdfd86440999548197b16877948" modify_external_catalogs: true
I20250830 07:54:45.495345 13746 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f8b6f233e5c49b39b3ef6314508e9d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:45.501106 13887 tablet_bootstrap.cc:492] T 4c4a8eea119044b49e2b29f10a703097 P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:54:45.501219 13887 ts_tablet_manager.cc:1397] T 4c4a8eea119044b49e2b29f10a703097 P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.017s user 0.001s sys 0.003s
I20250830 07:54:45.501049 13753 rpcz_store.cc:276] 0830 07:54:44.203007 (+ 0us) service_pool.cc:168] Inserting onto call queue
0830 07:54:44.936110 (+733103us) service_pool.cc:225] Handling call
0830 07:54:44.936851 (+ 741us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0830 07:54:44.936876 (+ 25us) ts_tablet_manager.cc:676] Creating new metadata...
0830 07:54:45.168091 (+231215us) tablet_metadata.cc:641] Metadata flushed
0830 07:54:45.340418 (+172327us) tablet_replica.cc:206] Creating consensus instance
0830 07:54:45.350840 (+ 10422us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20250830 07:54:45.501549 13770 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "e6491d149c0646848680cfdadb6fc76c" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:45.501905 13887 raft_consensus.cc:357] T 4c4a8eea119044b49e2b29f10a703097 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:45.502065 13887 raft_consensus.cc:383] T 4c4a8eea119044b49e2b29f10a703097 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:45.502116 13887 raft_consensus.cc:738] T 4c4a8eea119044b49e2b29f10a703097 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:54:45.502318 13887 consensus_queue.cc:260] T 4c4a8eea119044b49e2b29f10a703097 P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:45.502768 13887 ts_tablet_manager.cc:1428] T 4c4a8eea119044b49e2b29f10a703097 P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.001s user 0.001s sys 0.001s
I20250830 07:54:45.503177 13887 tablet_bootstrap.cc:492] T a41c1455404f4ed0a782a0c4ddd4140d P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:54:45.503885 13770 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "e66e56ecdf14466282daab8c894eb3c6" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:45.504416 13886 tablet_bootstrap.cc:492] T 8dddcfe56522436287aea212e316a729 P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:54:45.505026 13887 tablet_bootstrap.cc:654] T a41c1455404f4ed0a782a0c4ddd4140d P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:45.505462 13886 ts_tablet_manager.cc:1397] T 8dddcfe56522436287aea212e316a729 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.154s user 0.005s sys 0.008s
I20250830 07:54:45.508906 13882 tablet_bootstrap.cc:492] T 007435e198b9440db055711a98e3148a P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:54:45.509043 13882 ts_tablet_manager.cc:1397] T 007435e198b9440db055711a98e3148a P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.020s user 0.000s sys 0.004s
I20250830 07:54:45.509737 13882 raft_consensus.cc:357] T 007435e198b9440db055711a98e3148a P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:45.509907 13882 raft_consensus.cc:383] T 007435e198b9440db055711a98e3148a P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:45.509982 13882 raft_consensus.cc:738] T 007435e198b9440db055711a98e3148a P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:54:45.510252 13882 consensus_queue.cc:260] T 007435e198b9440db055711a98e3148a P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:45.510705 13882 ts_tablet_manager.cc:1428] T 007435e198b9440db055711a98e3148a P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20250830 07:54:45.511543 13882 tablet_bootstrap.cc:492] T 04eadf45b82e4c319eb7b316a402d81a P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:54:45.513751 13882 tablet_bootstrap.cc:654] T 04eadf45b82e4c319eb7b316a402d81a P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:45.515830 13231 master_service.cc:948] ReplaceTablet: received request to replace tablet 861809cc50764aa89140e587489e2d88 from {username='slave'} at 127.0.0.1:42126
I20250830 07:54:45.517258 13231 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_eabaaf87b5374194a21b1a2d0f2868c9" } modify_external_catalogs: true
I20250830 07:54:45.517398 14852 raft_consensus.cc:491] T e255d3fdee09400ead41ca835d6d103f P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:45.517459 13231 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_eabaaf87b5374194a21b1a2d0f2868c9" } modify_external_catalogs: true
I20250830 07:54:45.517535 14852 raft_consensus.cc:513] T e255d3fdee09400ead41ca835d6d103f P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:45.518201 14852 leader_election.cc:290] T e255d3fdee09400ead41ca835d6d103f P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:45.519999 13611 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "e255d3fdee09400ead41ca835d6d103f" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
W20250830 07:54:45.520612 13423 leader_election.cc:343] T e255d3fdee09400ead41ca835d6d103f P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:45.532029 13227 master_service.cc:948] ReplaceTablet: received request to replace tablet 23d2c7013c9c4b4aacf47e6ac7ab5a0b from {username='slave'} at 127.0.0.1:42126
I20250830 07:54:45.536448 13886 raft_consensus.cc:357] T 8dddcfe56522436287aea212e316a729 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:45.537758 13887 tablet_bootstrap.cc:492] T a41c1455404f4ed0a782a0c4ddd4140d P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:54:45.537880 13887 ts_tablet_manager.cc:1397] T a41c1455404f4ed0a782a0c4ddd4140d P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.035s user 0.002s sys 0.006s
I20250830 07:54:45.538561 13887 raft_consensus.cc:357] T a41c1455404f4ed0a782a0c4ddd4140d P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:45.538724 13887 raft_consensus.cc:383] T a41c1455404f4ed0a782a0c4ddd4140d P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:45.538770 13887 raft_consensus.cc:738] T a41c1455404f4ed0a782a0c4ddd4140d P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:54:45.538995 13887 consensus_queue.cc:260] T a41c1455404f4ed0a782a0c4ddd4140d P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:45.539276 13886 raft_consensus.cc:383] T 8dddcfe56522436287aea212e316a729 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:45.539415 13886 raft_consensus.cc:738] T 8dddcfe56522436287aea212e316a729 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:54:45.540412 13882 tablet_bootstrap.cc:492] T 04eadf45b82e4c319eb7b316a402d81a P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:54:45.540578 13882 ts_tablet_manager.cc:1397] T 04eadf45b82e4c319eb7b316a402d81a P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.030s user 0.007s sys 0.000s
I20250830 07:54:45.540962 13226 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_f21862e4d3614f3599c1f8c6b3a0d624" } modify_external_catalogs: true
I20250830 07:54:45.541150 13227 master_service.cc:948] ReplaceTablet: received request to replace tablet de3a52a8e08a45808373902a0185e6f0 from {username='slave'} at 127.0.0.1:42126
I20250830 07:54:45.541177 13226 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_f21862e4d3614f3599c1f8c6b3a0d624" } modify_external_catalogs: true
I20250830 07:54:45.541613 13227 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_dabc7588cbb441859f6adbe7728463ce"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:45.542116 13227 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_dabc7588cbb441859f6adbe7728463ce in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:45.544982 13887 ts_tablet_manager.cc:1428] T a41c1455404f4ed0a782a0c4ddd4140d P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.007s user 0.002s sys 0.000s
I20250830 07:54:45.545414 13887 tablet_bootstrap.cc:492] T 44313f1a11b74e6d996cafd3c03d1836 P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:54:45.547456 13886 consensus_queue.cc:260] T 8dddcfe56522436287aea212e316a729 P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:45.547606 14852 raft_consensus.cc:491] T 04eadf45b82e4c319eb7b316a402d81a P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:45.547729 14852 raft_consensus.cc:513] T 04eadf45b82e4c319eb7b316a402d81a P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:45.547669 13882 raft_consensus.cc:357] T 04eadf45b82e4c319eb7b316a402d81a P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:45.548243 14852 leader_election.cc:290] T 04eadf45b82e4c319eb7b316a402d81a P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:45.548031 13882 raft_consensus.cc:383] T 04eadf45b82e4c319eb7b316a402d81a P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:45.548646 13611 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "04eadf45b82e4c319eb7b316a402d81a" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:45.548705 13882 raft_consensus.cc:738] T 04eadf45b82e4c319eb7b316a402d81a P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:54:45.548243 13887 tablet_bootstrap.cc:654] T 44313f1a11b74e6d996cafd3c03d1836 P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:45.549031 13882 consensus_queue.cc:260] T 04eadf45b82e4c319eb7b316a402d81a P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:45.549424 13611 raft_consensus.cc:2466] T 04eadf45b82e4c319eb7b316a402d81a P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2065c332f15a4739899af79f3669c3ba in term 0.
I20250830 07:54:45.550135 13423 leader_election.cc:304] T 04eadf45b82e4c319eb7b316a402d81a P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 6b5e454d98894637b466ea27f1b647f9; no voters:
I20250830 07:54:45.550344 14852 raft_consensus.cc:2802] T 04eadf45b82e4c319eb7b316a402d81a P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:54:45.550424 14852 raft_consensus.cc:491] T 04eadf45b82e4c319eb7b316a402d81a P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:54:45.550506 14852 raft_consensus.cc:3058] T 04eadf45b82e4c319eb7b316a402d81a P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:45.551661 13882 ts_tablet_manager.cc:1428] T 04eadf45b82e4c319eb7b316a402d81a P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20250830 07:54:45.552341 13882 tablet_bootstrap.cc:492] T 53a933afa4b74095baf0f54736d99bf0 P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:54:45.553339 14852 raft_consensus.cc:513] T 04eadf45b82e4c319eb7b316a402d81a P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:45.555222 13611 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "04eadf45b82e4c319eb7b316a402d81a" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9"
I20250830 07:54:45.555409 13611 raft_consensus.cc:3058] T 04eadf45b82e4c319eb7b316a402d81a P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:45.556480 13886 ts_tablet_manager.cc:1428] T 8dddcfe56522436287aea212e316a729 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.051s user 0.001s sys 0.001s
I20250830 07:54:45.558064 13882 tablet_bootstrap.cc:654] T 53a933afa4b74095baf0f54736d99bf0 P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:45.558638 14852 leader_election.cc:290] T 04eadf45b82e4c319eb7b316a402d81a P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 election: Requested vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:45.559070 13886 tablet_bootstrap.cc:492] T 53a933afa4b74095baf0f54736d99bf0 P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:54:45.558524 13611 raft_consensus.cc:2466] T 04eadf45b82e4c319eb7b316a402d81a P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2065c332f15a4739899af79f3669c3ba in term 1.
I20250830 07:54:45.560865 13423 leader_election.cc:304] T 04eadf45b82e4c319eb7b316a402d81a P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 6b5e454d98894637b466ea27f1b647f9; no voters:
I20250830 07:54:45.561077 14852 raft_consensus.cc:2802] T 04eadf45b82e4c319eb7b316a402d81a P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election won for term 1
I20250830 07:54:45.561269 14852 raft_consensus.cc:695] T 04eadf45b82e4c319eb7b316a402d81a P 2065c332f15a4739899af79f3669c3ba [term 1 LEADER]: Becoming Leader. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Running, Role: LEADER
I20250830 07:54:45.561484 14852 consensus_queue.cc:237] T 04eadf45b82e4c319eb7b316a402d81a P 2065c332f15a4739899af79f3669c3ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:45.565415 13769 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "e255d3fdee09400ead41ca835d6d103f" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:45.573663 13886 tablet_bootstrap.cc:654] T 53a933afa4b74095baf0f54736d99bf0 P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:45.583222 13887 tablet_bootstrap.cc:492] T 44313f1a11b74e6d996cafd3c03d1836 P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:54:45.583357 13887 ts_tablet_manager.cc:1397] T 44313f1a11b74e6d996cafd3c03d1836 P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.038s user 0.008s sys 0.003s
I20250830 07:54:45.584151 13887 raft_consensus.cc:357] T 44313f1a11b74e6d996cafd3c03d1836 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:45.584307 13887 raft_consensus.cc:383] T 44313f1a11b74e6d996cafd3c03d1836 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:45.584358 13887 raft_consensus.cc:738] T 44313f1a11b74e6d996cafd3c03d1836 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:54:45.584534 13887 consensus_queue.cc:260] T 44313f1a11b74e6d996cafd3c03d1836 P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:45.584931 13887 ts_tablet_manager.cc:1428] T 44313f1a11b74e6d996cafd3c03d1836 P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20250830 07:54:45.585167 13887 tablet_bootstrap.cc:492] T 66d59910b4b2451a851e9d2728d50f42 P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:54:45.586859 13887 tablet_bootstrap.cc:654] T 66d59910b4b2451a851e9d2728d50f42 P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
W20250830 07:54:45.589047 14745 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
I20250830 07:54:45.591346 13882 tablet_bootstrap.cc:492] T 53a933afa4b74095baf0f54736d99bf0 P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:54:45.591470 13882 ts_tablet_manager.cc:1397] T 53a933afa4b74095baf0f54736d99bf0 P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.039s user 0.009s sys 0.005s
I20250830 07:54:45.592166 13882 raft_consensus.cc:357] T 53a933afa4b74095baf0f54736d99bf0 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:45.592319 13882 raft_consensus.cc:383] T 53a933afa4b74095baf0f54736d99bf0 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:45.592367 13882 raft_consensus.cc:738] T 53a933afa4b74095baf0f54736d99bf0 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
W20250830 07:54:45.592629 14745 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20250830 07:54:45.594125 14745 flags.cc:425] Enabled unsafe flag: --never_fsync=true
I20250830 07:54:45.594362 13882 consensus_queue.cc:260] T 53a933afa4b74095baf0f54736d99bf0 P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:45.601122 13882 ts_tablet_manager.cc:1428] T 53a933afa4b74095baf0f54736d99bf0 P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.010s user 0.002s sys 0.000s
I20250830 07:54:45.602871 13882 tablet_bootstrap.cc:492] T 99f307a8cbb34addaafab82b3ed18241 P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:54:45.604158 13887 tablet_bootstrap.cc:492] T 66d59910b4b2451a851e9d2728d50f42 P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:54:45.604269 13887 ts_tablet_manager.cc:1397] T 66d59910b4b2451a851e9d2728d50f42 P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.019s user 0.003s sys 0.001s
I20250830 07:54:45.604943 13887 raft_consensus.cc:357] T 66d59910b4b2451a851e9d2728d50f42 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:45.605113 13887 raft_consensus.cc:383] T 66d59910b4b2451a851e9d2728d50f42 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:45.605166 13887 raft_consensus.cc:738] T 66d59910b4b2451a851e9d2728d50f42 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:54:45.605324 13887 consensus_queue.cc:260] T 66d59910b4b2451a851e9d2728d50f42 P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:45.605615 13886 tablet_bootstrap.cc:492] T 53a933afa4b74095baf0f54736d99bf0 P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:54:45.605763 13886 ts_tablet_manager.cc:1397] T 53a933afa4b74095baf0f54736d99bf0 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.047s user 0.009s sys 0.005s
I20250830 07:54:45.605932 13887 ts_tablet_manager.cc:1428] T 66d59910b4b2451a851e9d2728d50f42 P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20250830 07:54:45.606190 13887 tablet_bootstrap.cc:492] T 51cee993ce4249c0830b29cb1808fe80 P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:54:45.606520 13886 raft_consensus.cc:357] T 53a933afa4b74095baf0f54736d99bf0 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:45.606690 13886 raft_consensus.cc:383] T 53a933afa4b74095baf0f54736d99bf0 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:45.606794 13886 raft_consensus.cc:738] T 53a933afa4b74095baf0f54736d99bf0 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:54:45.606798 13769 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "04eadf45b82e4c319eb7b316a402d81a" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:45.607421 13769 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "04eadf45b82e4c319eb7b316a402d81a" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f"
W20250830 07:54:45.607965 13422 leader_election.cc:343] T e6491d149c0646848680cfdadb6fc76c P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:45.608067 13422 leader_election.cc:304] T e6491d149c0646848680cfdadb6fc76c P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba; no voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:54:45.608335 14818 raft_consensus.cc:491] T 4d4b00bdadb24ec892d87c9be2ed7dd9 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20250830 07:54:45.608399 13422 leader_election.cc:343] T e66e56ecdf14466282daab8c894eb3c6 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:45.608481 13422 leader_election.cc:304] T e66e56ecdf14466282daab8c894eb3c6 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba; no voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:54:45.608479 14818 raft_consensus.cc:513] T 4d4b00bdadb24ec892d87c9be2ed7dd9 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:45.608888 14644 raft_consensus.cc:2747] T e6491d149c0646848680cfdadb6fc76c P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:54:45.608951 14815 raft_consensus.cc:2747] T e66e56ecdf14466282daab8c894eb3c6 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:54:45.609056 14818 leader_election.cc:290] T 4d4b00bdadb24ec892d87c9be2ed7dd9 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967)
W20250830 07:54:45.610445 13703 leader_election.cc:343] T 4d4b00bdadb24ec892d87c9be2ed7dd9 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Not found: Tablet not found: 4d4b00bdadb24ec892d87c9be2ed7dd9
I20250830 07:54:45.606981 13886 consensus_queue.cc:260] T 53a933afa4b74095baf0f54736d99bf0 P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:45.611400 13887 tablet_bootstrap.cc:654] T 51cee993ce4249c0830b29cb1808fe80 P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
W20250830 07:54:45.616237 13225 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet fac764a2d269411c86b85ceeaec0b014 consensus state has no leader
I20250830 07:54:45.616422 13225 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:42126 (request call id 921) took 1037 ms. Trace:
I20250830 07:54:45.616521 13225 rpcz_store.cc:276] 0830 07:54:44.579116 (+ 0us) service_pool.cc:168] Inserting onto call queue
0830 07:54:45.305877 (+726761us) service_pool.cc:225] Handling call
0830 07:54:45.306767 (+ 890us) catalog_manager.cc:2368] Looking up, locking, and authorizing table
0830 07:54:45.307050 (+ 283us) catalog_manager.cc:3683] Apply alter schema
0830 07:54:45.310269 (+ 3219us) catalog_manager.cc:3715] Acquired catalog manager lock
0830 07:54:45.310334 (+ 65us) catalog_manager.cc:3873] Updating metadata on disk
0830 07:54:45.615982 (+305648us) catalog_manager.cc:3904] Committing alterations to in-memory state
0830 07:54:45.616377 (+ 395us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0830 07:54:45.541842 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0830 07:54:45.541899 (+ 57us) write_op.cc:432] Acquiring schema lock in shared mode
0830 07:54:45.541904 (+ 5us) write_op.cc:435] Acquired schema lock
0830 07:54:45.541906 (+ 2us) tablet.cc:660] Decoding operations
0830 07:54:45.541987 (+ 81us) write_op.cc:620] Acquiring the partition lock for write op
0830 07:54:45.541994 (+ 7us) write_op.cc:641] Partition lock acquired for write op
0830 07:54:45.541997 (+ 3us) tablet.cc:683] Acquiring locks for 1 operations
0830 07:54:45.542034 (+ 37us) tablet.cc:699] Row locks acquired
0830 07:54:45.542036 (+ 2us) write_op.cc:260] PREPARE: finished
0830 07:54:45.542060 (+ 24us) write_op.cc:270] Start()
0830 07:54:45.542080 (+ 20us) write_op.cc:276] Timestamp: P: 1756540485542008 usec, L: 0
0830 07:54:45.542083 (+ 3us) op_driver.cc:348] REPLICATION: starting
0830 07:54:45.542226 (+ 143us) log.cc:844] Serialized 405 byte log entry
0830 07:54:45.613754 (+ 71528us) op_driver.cc:464] REPLICATION: finished
0830 07:54:45.614030 (+ 276us) write_op.cc:301] APPLY: starting
0830 07:54:45.614056 (+ 26us) tablet.cc:1365] starting BulkCheckPresence
0830 07:54:45.614099 (+ 43us) tablet.cc:1368] finished BulkCheckPresence
0830 07:54:45.614119 (+ 20us) tablet.cc:1370] starting ApplyRowOperation cycle
0830 07:54:45.614166 (+ 47us) tablet.cc:1381] finished ApplyRowOperation cycle
0830 07:54:45.614196 (+ 30us) tablet_metrics.cc:563] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0830 07:54:45.614202 (+ 6us) write_op.cc:312] APPLY: finished
0830 07:54:45.614297 (+ 95us) log.cc:844] Serialized 23 byte log entry
0830 07:54:45.614371 (+ 74us) write_op.cc:489] Releasing partition, row and schema locks
0830 07:54:45.614387 (+ 16us) write_op.cc:454] Released schema lock
0830 07:54:45.614416 (+ 29us) write_op.cc:341] FINISH: Updating metrics
0830 07:54:45.614500 (+ 84us) write_op.cc:489] Releasing partition, row and schema locks
0830 07:54:45.614504 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":228,"apply.run_cpu_time_us":460,"apply.run_wall_time_us":460,"num_ops":1,"prepare.queue_time_us":231043,"prepare.run_cpu_time_us":451,"prepare.run_wall_time_us":451,"raft.queue_time_us":3882,"raft.run_cpu_time_us":6,"raft.run_wall_time_us":6,"replication_time_us":71636}]]}
I20250830 07:54:45.617213 13225 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_ed76689fb0754162aa9b23002b8d6013" } modify_external_catalogs: true
I20250830 07:54:45.617388 13225 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_ed76689fb0754162aa9b23002b8d6013" } modify_external_catalogs: true
I20250830 07:54:45.618765 13232 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:42126 (request call id 923) took 1001 ms. Trace:
I20250830 07:54:45.618885 13232 rpcz_store.cc:276] 0830 07:54:44.617503 (+ 0us) service_pool.cc:168] Inserting onto call queue
0830 07:54:45.321594 (+704091us) service_pool.cc:225] Handling call
0830 07:54:45.355126 (+ 33532us) spinlock_profiling.cc:243] Waited 33.2 ms on lock 0x616000040f54. stack: 00007f4985b867d6 00007f4985b86590 00007f4984b793ad 0000000000972d94 0000000000972d5d 00007f499495114d 00007f4994951243 00007f4991610941 00007f499919ba5d 00007f4999324e93 00007f499015c7a6 00007f499015c4d5 00007f498c9342ce 00007f498c9331ae 00007f498c9393e5 00007f498c939d0f
0830 07:54:45.376502 (+ 21376us) catalog_manager.cc:2076] Acquired catalog manager lock
0830 07:54:45.377034 (+ 532us) catalog_manager.cc:2122] Created new table and tablet info
0830 07:54:45.618487 (+241453us) catalog_manager.cc:2182] Wrote table and tablets to system table
0830 07:54:45.618612 (+ 125us) catalog_manager.cc:2216] Inserted table and tablets into CatalogManager maps
0830 07:54:45.618710 (+ 98us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0830 07:54:45.546280 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0830 07:54:45.546368 (+ 88us) write_op.cc:432] Acquiring schema lock in shared mode
0830 07:54:45.546372 (+ 4us) write_op.cc:435] Acquired schema lock
0830 07:54:45.546374 (+ 2us) tablet.cc:660] Decoding operations
0830 07:54:45.546435 (+ 61us) write_op.cc:620] Acquiring the partition lock for write op
0830 07:54:45.546442 (+ 7us) write_op.cc:641] Partition lock acquired for write op
0830 07:54:45.546446 (+ 4us) tablet.cc:683] Acquiring locks for 2 operations
0830 07:54:45.546499 (+ 53us) tablet.cc:699] Row locks acquired
0830 07:54:45.546501 (+ 2us) write_op.cc:260] PREPARE: finished
0830 07:54:45.546526 (+ 25us) write_op.cc:270] Start()
0830 07:54:45.546560 (+ 34us) write_op.cc:276] Timestamp: P: 1756540485546473 usec, L: 0
0830 07:54:45.546563 (+ 3us) op_driver.cc:348] REPLICATION: starting
0830 07:54:45.546677 (+ 114us) log.cc:844] Serialized 433 byte log entry
0830 07:54:45.613860 (+ 67183us) op_driver.cc:464] REPLICATION: finished
0830 07:54:45.614984 (+ 1124us) write_op.cc:301] APPLY: starting
0830 07:54:45.614993 (+ 9us) tablet.cc:1365] starting BulkCheckPresence
0830 07:54:45.615018 (+ 25us) tablet.cc:1368] finished BulkCheckPresence
0830 07:54:45.615037 (+ 19us) tablet.cc:1370] starting ApplyRowOperation cycle
0830 07:54:45.615128 (+ 91us) tablet.cc:1381] finished ApplyRowOperation cycle
0830 07:54:45.615153 (+ 25us) tablet_metrics.cc:563] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0830 07:54:45.615159 (+ 6us) write_op.cc:312] APPLY: finished
0830 07:54:45.615204 (+ 45us) log.cc:844] Serialized 29 byte log entry
0830 07:54:45.615241 (+ 37us) write_op.cc:489] Releasing partition, row and schema locks
0830 07:54:45.615252 (+ 11us) write_op.cc:454] Released schema lock
0830 07:54:45.615257 (+ 5us) write_op.cc:341] FINISH: Updating metrics
0830 07:54:45.615318 (+ 61us) write_op.cc:489] Releasing partition, row and schema locks
0830 07:54:45.615321 (+ 3us) write_op.cc:454] Released schema lock
Metrics: {"spinlock_wait_cycles":76460800,"child_traces":[["op",{"apply.queue_time_us":1088,"apply.run_cpu_time_us":328,"apply.run_wall_time_us":328,"num_ops":2,"prepare.queue_time_us":168779,"prepare.run_cpu_time_us":549,"prepare.run_wall_time_us":67478,"raft.queue_time_us":2598,"raft.run_cpu_time_us":112,"raft.run_wall_time_us":113,"replication_time_us":67285}]]}
I20250830 07:54:45.619952 13232 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_a0ed85ec15944f419c32ba7fd1d9b4c1" } modify_external_catalogs: true
I20250830 07:54:45.620133 13232 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_a0ed85ec15944f419c32ba7fd1d9b4c1" } modify_external_catalogs: true
I20250830 07:54:45.624516 13233 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:42126 (request call id 922) took 1042 ms. Trace:
I20250830 07:54:45.624989 13746 tablet_service.cc:1515] Processing DeleteTablet for tablet 852e353f6ee945628ddebdbdd1bd76fb with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:44 UTC) from {username='slave'} at 127.0.0.1:45460
I20250830 07:54:45.624624 13233 rpcz_store.cc:276] 0830 07:54:44.582131 (+ 0us) service_pool.cc:168] Inserting onto call queue
0830 07:54:45.320204 (+738073us) service_pool.cc:225] Handling call
0830 07:54:45.354275 (+ 34071us) spinlock_profiling.cc:243] Waited 33.7 ms on lock 0x616000040f54. stack: 00007f4985b867d6 00007f4985b86590 00007f4984b793ad 0000000000972d94 0000000000972d5d 00007f499495114d 00007f4994951243 00007f4991610941 00007f499919ba5d 00007f4999324e93 00007f499015c7a6 00007f499015c4d5 00007f498c9342ce 00007f498c9331ae 00007f498c9393e5 00007f498c939d0f
0830 07:54:45.375305 (+ 21030us) catalog_manager.cc:2076] Acquired catalog manager lock
0830 07:54:45.375885 (+ 580us) catalog_manager.cc:2122] Created new table and tablet info
0830 07:54:45.624287 (+248402us) catalog_manager.cc:2182] Wrote table and tablets to system table
0830 07:54:45.624382 (+ 95us) catalog_manager.cc:2216] Inserted table and tablets into CatalogManager maps
0830 07:54:45.624464 (+ 82us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0830 07:54:45.542390 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0830 07:54:45.542462 (+ 72us) write_op.cc:432] Acquiring schema lock in shared mode
0830 07:54:45.542466 (+ 4us) write_op.cc:435] Acquired schema lock
0830 07:54:45.542467 (+ 1us) tablet.cc:660] Decoding operations
0830 07:54:45.542528 (+ 61us) write_op.cc:620] Acquiring the partition lock for write op
0830 07:54:45.542534 (+ 6us) write_op.cc:641] Partition lock acquired for write op
0830 07:54:45.542538 (+ 4us) tablet.cc:683] Acquiring locks for 2 operations
0830 07:54:45.542603 (+ 65us) tablet.cc:699] Row locks acquired
0830 07:54:45.542605 (+ 2us) write_op.cc:260] PREPARE: finished
0830 07:54:45.542628 (+ 23us) write_op.cc:270] Start()
0830 07:54:45.542648 (+ 20us) write_op.cc:276] Timestamp: P: 1756540485542575 usec, L: 0
0830 07:54:45.542651 (+ 3us) op_driver.cc:348] REPLICATION: starting
0830 07:54:45.542756 (+ 105us) log.cc:844] Serialized 433 byte log entry
0830 07:54:45.613822 (+ 71066us) op_driver.cc:464] REPLICATION: finished
0830 07:54:45.614583 (+ 761us) write_op.cc:301] APPLY: starting
0830 07:54:45.614593 (+ 10us) tablet.cc:1365] starting BulkCheckPresence
0830 07:54:45.614624 (+ 31us) tablet.cc:1368] finished BulkCheckPresence
0830 07:54:45.614644 (+ 20us) tablet.cc:1370] starting ApplyRowOperation cycle
0830 07:54:45.614727 (+ 83us) tablet.cc:1381] finished ApplyRowOperation cycle
0830 07:54:45.614754 (+ 27us) tablet_metrics.cc:563] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0830 07:54:45.614762 (+ 8us) write_op.cc:312] APPLY: finished
0830 07:54:45.614819 (+ 57us) log.cc:844] Serialized 29 byte log entry
0830 07:54:45.614881 (+ 62us) write_op.cc:489] Releasing partition, row and schema locks
0830 07:54:45.614892 (+ 11us) write_op.cc:454] Released schema lock
0830 07:54:45.614896 (+ 4us) write_op.cc:341] FINISH: Updating metrics
0830 07:54:45.624196 (+ 9300us) write_op.cc:489] Releasing partition, row and schema locks
0830 07:54:45.624202 (+ 6us) write_op.cc:454] Released schema lock
Metrics: {"spinlock_wait_cycles":77602560,"child_traces":[["op",{"apply.queue_time_us":732,"apply.run_cpu_time_us":412,"apply.run_wall_time_us":9595,"num_ops":2,"prepare.queue_time_us":165892,"prepare.run_cpu_time_us":452,"prepare.run_wall_time_us":3864,"raft.queue_time_us":3412,"raft.run_cpu_time_us":3,"raft.run_wall_time_us":3,"replication_time_us":71155}]]}
I20250830 07:54:45.625365 13233 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_67739ac4113c4648920b4a24633396c5" } new_table_name: "default.Table_5caf352b482f4b9ba4d727ab7fbd00bb" modify_external_catalogs: true
I20250830 07:54:45.626732 13887 tablet_bootstrap.cc:492] T 51cee993ce4249c0830b29cb1808fe80 P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:54:45.626848 13887 ts_tablet_manager.cc:1397] T 51cee993ce4249c0830b29cb1808fe80 P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.021s user 0.001s sys 0.006s
W20250830 07:54:45.627092 13219 catalog_manager.cc:4908] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): delete failed for tablet 852e353f6ee945628ddebdbdd1bd76fb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 852e353f6ee945628ddebdbdd1bd76fb already in progress: creating tablet
I20250830 07:54:45.627707 13887 raft_consensus.cc:357] T 51cee993ce4249c0830b29cb1808fe80 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:45.627862 13887 raft_consensus.cc:383] T 51cee993ce4249c0830b29cb1808fe80 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:45.627923 13887 raft_consensus.cc:738] T 51cee993ce4249c0830b29cb1808fe80 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:54:45.628103 13887 consensus_queue.cc:260] T 51cee993ce4249c0830b29cb1808fe80 P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:45.628862 13887 ts_tablet_manager.cc:1428] T 51cee993ce4249c0830b29cb1808fe80 P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20250830 07:54:45.629210 13887 tablet_bootstrap.cc:492] T ec4a3975961d4f85ad9da94835417574 P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:54:45.631601 13887 tablet_bootstrap.cc:654] T ec4a3975961d4f85ad9da94835417574 P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
W20250830 07:54:45.631968 13230 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d7afb311a699495aa8376db6ab206d94 consensus state has no leader
I20250830 07:54:45.632582 13230 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_719374aba3bf455e9f60e4ad7d0b558b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250830 07:54:45.632788 14753 raft_consensus.cc:491] T ffc5945a032e47d4bd3397d7c887dc62 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20250830 07:54:45.632867 13422 leader_election.cc:343] T e255d3fdee09400ead41ca835d6d103f P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:45.632956 13422 leader_election.cc:304] T e255d3fdee09400ead41ca835d6d103f P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba; no voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:54:45.632925 14753 raft_consensus.cc:513] T ffc5945a032e47d4bd3397d7c887dc62 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
W20250830 07:54:45.633138 13230 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_719374aba3bf455e9f60e4ad7d0b558b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:45.633143 14852 raft_consensus.cc:2747] T e255d3fdee09400ead41ca835d6d103f P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20250830 07:54:45.633452 13422 leader_election.cc:343] T 04eadf45b82e4c319eb7b316a402d81a P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:45.633491 14753 leader_election.cc:290] T ffc5945a032e47d4bd3397d7c887dc62 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
W20250830 07:54:45.633708 13422 leader_election.cc:343] T 04eadf45b82e4c319eb7b316a402d81a P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:45.634145 13234 catalog_manager.cc:5674] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743) does not have the latest schema for tablet 99f307a8cbb34addaafab82b3ed18241 (table default.Table_4e2c5e0840fe4d3398519818e193f4dd [id=2a10f84461764fd5ab5a59499a370034]). Expected version 1 got 0
I20250830 07:54:45.634341 13234 catalog_manager.cc:5674] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743) does not have the latest schema for tablet 14ed24577c8f49f49c83242a26877614 (table default.Table_4428c29c8358411282f00fd33a6badd4 [id=bcee72f9b1c6407f98435a1494b42407]). Expected version 1 got 0
I20250830 07:54:45.634503 13234 catalog_manager.cc:5674] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743) does not have the latest schema for tablet dbe542c478874482b078296a7a0e9ec9 (table default.Table_54bd02c58de341ec93ced1d662a7e671 [id=b80ba51884ef4042818f8def0b0ebf0e]). Expected version 2 got 0
I20250830 07:54:45.635797 13234 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_f440bd2200c547deb37ad7cba486eb5a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:45.636169 13701 leader_election.cc:343] T 4d4b00bdadb24ec892d87c9be2ed7dd9 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): Not found: Tablet not found: 4d4b00bdadb24ec892d87c9be2ed7dd9
W20250830 07:54:45.636265 13234 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f440bd2200c547deb37ad7cba486eb5a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:45.636276 13701 leader_election.cc:304] T 4d4b00bdadb24ec892d87c9be2ed7dd9 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 2065c332f15a4739899af79f3669c3ba, 6b5e454d98894637b466ea27f1b647f9
I20250830 07:54:45.636725 14818 raft_consensus.cc:2747] T 4d4b00bdadb24ec892d87c9be2ed7dd9 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:54:45.639238 13481 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "ffc5945a032e47d4bd3397d7c887dc62" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:54:45.639386 13481 raft_consensus.cc:2466] T ffc5945a032e47d4bd3397d7c887dc62 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b5e454d98894637b466ea27f1b647f9 in term 0.
I20250830 07:54:45.639700 13561 leader_election.cc:304] T ffc5945a032e47d4bd3397d7c887dc62 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 6b5e454d98894637b466ea27f1b647f9; no voters:
I20250830 07:54:45.640239 14480 raft_consensus.cc:2802] T ffc5945a032e47d4bd3397d7c887dc62 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:54:45.640312 14480 raft_consensus.cc:491] T ffc5945a032e47d4bd3397d7c887dc62 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:54:45.640372 14480 raft_consensus.cc:3058] T ffc5945a032e47d4bd3397d7c887dc62 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:45.647842 13768 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "ffc5945a032e47d4bd3397d7c887dc62" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:45.648015 13768 raft_consensus.cc:2466] T ffc5945a032e47d4bd3397d7c887dc62 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b5e454d98894637b466ea27f1b647f9 in term 0.
I20250830 07:54:45.651124 14480 raft_consensus.cc:513] T ffc5945a032e47d4bd3397d7c887dc62 P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:45.651932 13486 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "ffc5945a032e47d4bd3397d7c887dc62" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba"
I20250830 07:54:45.652078 13486 raft_consensus.cc:3058] T ffc5945a032e47d4bd3397d7c887dc62 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
W20250830 07:54:45.653898 14745 flags.cc:425] Enabled experimental flag: --enable_metadata_cleanup_for_deleted_tables_and_tablets=true
I20250830 07:54:45.654424 13486 raft_consensus.cc:2466] T ffc5945a032e47d4bd3397d7c887dc62 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b5e454d98894637b466ea27f1b647f9 in term 1.
I20250830 07:54:45.654688 13561 leader_election.cc:304] T ffc5945a032e47d4bd3397d7c887dc62 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 6b5e454d98894637b466ea27f1b647f9; no voters:
I20250830 07:54:45.654835 13231 catalog_manager.cc:5864] Not sending DeleteTablet requests; no consensus state for tablet baabe2f009b447ab92b761c02dc10063
I20250830 07:54:45.655126 13231 master_service.cc:948] ReplaceTablet: received request to replace tablet 2aea1a69d22544899b0218be7e0f8799 from {username='slave'} at 127.0.0.1:42126
I20250830 07:54:45.655341 14674 raft_consensus.cc:491] T 69f2105c5eeb47e9a848ae7bf8779996 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:45.655455 14674 raft_consensus.cc:513] T 69f2105c5eeb47e9a848ae7bf8779996 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:45.656023 14674 leader_election.cc:290] T 69f2105c5eeb47e9a848ae7bf8779996 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:45.656155 14674 raft_consensus.cc:2802] T ffc5945a032e47d4bd3397d7c887dc62 P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Leader election won for term 1
I20250830 07:54:45.656241 14674 raft_consensus.cc:695] T ffc5945a032e47d4bd3397d7c887dc62 P 6b5e454d98894637b466ea27f1b647f9 [term 1 LEADER]: Becoming Leader. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Running, Role: LEADER
I20250830 07:54:45.656436 14674 consensus_queue.cc:237] T ffc5945a032e47d4bd3397d7c887dc62 P 6b5e454d98894637b466ea27f1b647f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
W20250830 07:54:45.661626 14745 flags.cc:425] Enabled experimental flag: --metadata_for_deleted_table_and_tablet_reserved_secs=0
W20250830 07:54:45.661830 14745 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20250830 07:54:45.661950 14745 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20250830 07:54:45.662087 14745 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20250830 07:54:45.662220 14745 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20250830 07:54:45.669579 13562 leader_election.cc:343] T 69f2105c5eeb47e9a848ae7bf8779996 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Not found: Tablet not found: 69f2105c5eeb47e9a848ae7bf8779996
I20250830 07:54:45.671612 13226 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet 370441c443be46c2a33132fbc5c41f89
I20250830 07:54:45.672923 13599 tablet_service.cc:1515] Processing DeleteTablet for tablet 370441c443be46c2a33132fbc5c41f89 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:45 UTC) from {username='slave'} at 127.0.0.1:45306
I20250830 07:54:45.673120 13227 master_service.cc:948] ReplaceTablet: received request to replace tablet 62bc8168176e4678a77827c5b7cc0f3e from {username='slave'} at 127.0.0.1:42126
I20250830 07:54:45.673331 13225 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet 4df6d481baab40e2b2c1309d1a8c5351
W20250830 07:54:45.673797 13561 leader_election.cc:343] T 69f2105c5eeb47e9a848ae7bf8779996 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): Not found: Tablet not found: 69f2105c5eeb47e9a848ae7bf8779996
I20250830 07:54:45.673887 13561 leader_election.cc:304] T 69f2105c5eeb47e9a848ae7bf8779996 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b5e454d98894637b466ea27f1b647f9; no voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:54:45.674255 14753 raft_consensus.cc:2747] T 69f2105c5eeb47e9a848ae7bf8779996 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20250830 07:54:45.674515 13220 catalog_manager.cc:4908] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet 370441c443be46c2a33132fbc5c41f89 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 370441c443be46c2a33132fbc5c41f89 already in progress: creating tablet
I20250830 07:54:45.674623 13599 tablet_service.cc:1515] Processing DeleteTablet for tablet 4df6d481baab40e2b2c1309d1a8c5351 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:45 UTC) from {username='slave'} at 127.0.0.1:45306
I20250830 07:54:45.675809 13746 tablet_service.cc:1515] Processing DeleteTablet for tablet 370441c443be46c2a33132fbc5c41f89 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:45 UTC) from {username='slave'} at 127.0.0.1:45460
I20250830 07:54:45.675959 13458 tablet_service.cc:1515] Processing DeleteTablet for tablet 370441c443be46c2a33132fbc5c41f89 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:45 UTC) from {username='slave'} at 127.0.0.1:37956
I20250830 07:54:45.676069 13749 tablet_service.cc:1515] Processing DeleteTablet for tablet 4df6d481baab40e2b2c1309d1a8c5351 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:45 UTC) from {username='slave'} at 127.0.0.1:45460
I20250830 07:54:45.676170 13468 tablet_service.cc:1515] Processing DeleteTablet for tablet 4df6d481baab40e2b2c1309d1a8c5351 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:45 UTC) from {username='slave'} at 127.0.0.1:37956
W20250830 07:54:45.676690 13218 catalog_manager.cc:4908] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): delete failed for tablet 370441c443be46c2a33132fbc5c41f89 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 370441c443be46c2a33132fbc5c41f89 already in progress: creating tablet
W20250830 07:54:45.677062 13220 catalog_manager.cc:4908] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet 4df6d481baab40e2b2c1309d1a8c5351 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4df6d481baab40e2b2c1309d1a8c5351 already in progress: creating tablet
W20250830 07:54:45.677160 13218 catalog_manager.cc:4908] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): delete failed for tablet 4df6d481baab40e2b2c1309d1a8c5351 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4df6d481baab40e2b2c1309d1a8c5351 already in progress: creating tablet
W20250830 07:54:45.677567 13219 catalog_manager.cc:4908] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): delete failed for tablet 370441c443be46c2a33132fbc5c41f89 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 370441c443be46c2a33132fbc5c41f89 already in progress: creating tablet
W20250830 07:54:45.677840 13219 catalog_manager.cc:4908] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): delete failed for tablet 4df6d481baab40e2b2c1309d1a8c5351 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4df6d481baab40e2b2c1309d1a8c5351 already in progress: creating tablet
I20250830 07:54:45.678948 14480 leader_election.cc:290] T ffc5945a032e47d4bd3397d7c887dc62 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 election: Requested vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:45.679616 13768 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "ffc5945a032e47d4bd3397d7c887dc62" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f"
I20250830 07:54:45.679829 13768 raft_consensus.cc:3058] T ffc5945a032e47d4bd3397d7c887dc62 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:45.686559 13768 raft_consensus.cc:2466] T ffc5945a032e47d4bd3397d7c887dc62 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b5e454d98894637b466ea27f1b647f9 in term 1.
I20250830 07:54:45.690128 14852 consensus_queue.cc:1035] T 533811110191436d96665b3475ab597f P 2065c332f15a4739899af79f3669c3ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:54:45.691071 13886 ts_tablet_manager.cc:1428] T 53a933afa4b74095baf0f54736d99bf0 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.085s user 0.002s sys 0.000s
I20250830 07:54:45.691828 13886 tablet_bootstrap.cc:492] T e6491d149c0646848680cfdadb6fc76c P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:54:45.694710 13886 tablet_bootstrap.cc:654] T e6491d149c0646848680cfdadb6fc76c P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:45.700490 13882 tablet_bootstrap.cc:654] T 99f307a8cbb34addaafab82b3ed18241 P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:45.708204 14745 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.209.20:33943
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/master-2/wal
--catalog_manager_bg_task_wait_ms=10
--enable_metadata_cleanup_for_deleted_tables_and_tablets=true
--metadata_for_deleted_table_and_tablet_reserved_secs=0
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.12.209.62:39725,127.12.209.61:44241,127.12.209.60:43889
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.209.60:43889
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.12.209.60
--webserver_port=32915
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.19.0-SNAPSHOT
revision 06466b25e294b4d7d455e6c56263318dc34a80ef
build type FASTDEBUG
built by None at 30 Aug 2025 07:43:23 UTC on 24a791456cd2
build id 7812
ASAN enabled
I20250830 07:54:45.709765 13225 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_7ca088845834445cb9cb88eccd1e7e8a" } modify_external_catalogs: true
I20250830 07:54:45.710096 13225 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_7ca088845834445cb9cb88eccd1e7e8a" } modify_external_catalogs: true
W20250830 07:54:45.711052 13226 catalog_manager.cc:5415] Ignoring report from unknown tablet b480f5eb03804baeb61cd0424d70faf5
W20250830 07:54:45.711138 13226 catalog_manager.cc:5415] Ignoring report from unknown tablet c3b35ea656db4741a02e6746e1b049ec
W20250830 07:54:45.711202 13226 catalog_manager.cc:5415] Ignoring report from unknown tablet 1fa571e9490e499792225d7b786e8658
W20250830 07:54:45.711261 13226 catalog_manager.cc:5415] Ignoring report from unknown tablet 91ab8c468c8143b9ae11b839a95a26fd
W20250830 07:54:45.711499 13226 catalog_manager.cc:5415] Ignoring report from unknown tablet 27da527d9fe045ae8c17f193d034f5ac
W20250830 07:54:45.711570 13226 catalog_manager.cc:5415] Ignoring report from unknown tablet 6dda55ec2da34c8aba9f39a63e144a7c
I20250830 07:54:45.711544 14745 env_posix.cc:2264] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
W20250830 07:54:45.711714 13226 catalog_manager.cc:5415] Ignoring report from unknown tablet d3f207cee78a43a1b5e030c09752c78c
W20250830 07:54:45.711796 13226 catalog_manager.cc:5415] Ignoring report from unknown tablet 73853894da074ecd8147a94ac28bfab8
W20250830 07:54:45.711858 13226 catalog_manager.cc:5415] Ignoring report from unknown tablet ffc5945a032e47d4bd3397d7c887dc62
W20250830 07:54:45.711903 13226 catalog_manager.cc:5415] Ignoring report from unknown tablet 30c2558c28944ff39d1a4a4ca9ac604e
W20250830 07:54:45.712003 13226 catalog_manager.cc:5415] Ignoring report from unknown tablet ff0f9cccc8ed43b1a8cd38de0e9d4097
W20250830 07:54:45.712060 13226 catalog_manager.cc:5415] Ignoring report from unknown tablet e862fa77e16945bd94e405aa3474f021
W20250830 07:54:45.712119 13226 catalog_manager.cc:5415] Ignoring report from unknown tablet f398e12cd9f543738d5163354f8a9d9d
I20250830 07:54:45.712388 13232 catalog_manager.cc:5864] Not sending DeleteTablet requests; no consensus state for tablet ed4b18f7e82e4633b05ebec96686320e
I20250830 07:54:45.712749 13232 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_7e6ff9d50e134fdeab2a52fca051aadf" } new_table_name: "default.Table_ceaf585c8f1744e1b9df594f917269d8" modify_external_catalogs: true
I20250830 07:54:45.712815 13226 catalog_manager.cc:5674] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743) does not have the latest schema for tablet 14ed24577c8f49f49c83242a26877614 (table default.Table_4428c29c8358411282f00fd33a6badd4 [id=bcee72f9b1c6407f98435a1494b42407]). Expected version 1 got 0
I20250830 07:54:45.713013 13226 catalog_manager.cc:5674] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743) does not have the latest schema for tablet 8dddcfe56522436287aea212e316a729 (table default.Table_e0d2400861094b258fca0704d88ed743 [id=c483c08824f24586855e3575a590b294]). Expected version 2 got 0
I20250830 07:54:45.713835 14745 file_cache.cc:492] Constructed file cache file cache with capacity 419430
I20250830 07:54:45.715490 13886 tablet_bootstrap.cc:492] T e6491d149c0646848680cfdadb6fc76c P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
W20250830 07:54:45.721191 13233 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 924403105a6a40f28aad60647a2a8987 consensus state has no leader
I20250830 07:54:45.727025 13230 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_fb1775ef38e248bcbde37a9fc64ee5c1" } new_table_name: "default.Table_7f4b0093219d4583a01dc853b65dcd45" modify_external_catalogs: true
I20250830 07:54:45.727175 13233 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_88d35396b3cc42279534b96adf03c731"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250830 07:54:45.727633 13228 catalog_manager.cc:6127] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: default.Table_e0d2400861094b258fca0704d88ed743 [id=c483c08824f24586855e3575a590b294] alter complete (version 2)
W20250830 07:54:45.727857 13233 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_88d35396b3cc42279534b96adf03c731 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:45.729818 13228 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_a8b747811d784f818430f7ecb11b738c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:45.732345 13228 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a8b747811d784f818430f7ecb11b738c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:45.733668 13231 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet 2aea1a69d22544899b0218be7e0f8799
I20250830 07:54:45.734546 13599 tablet_service.cc:1515] Processing DeleteTablet for tablet 2aea1a69d22544899b0218be7e0f8799 with delete_type TABLET_DATA_DELETED (replaced by tablet 1a1a7ff577334cc58e75d7615b793573) from {username='slave'} at 127.0.0.1:45306
I20250830 07:54:45.734689 13231 catalog_manager.cc:6652] ReplaceTablet: tablet 2aea1a69d22544899b0218be7e0f8799 deleted and replaced by tablet 1a1a7ff577334cc58e75d7615b793573
I20250830 07:54:45.734702 13468 tablet_service.cc:1515] Processing DeleteTablet for tablet 2aea1a69d22544899b0218be7e0f8799 with delete_type TABLET_DATA_DELETED (replaced by tablet 1a1a7ff577334cc58e75d7615b793573) from {username='slave'} at 127.0.0.1:37956
I20250830 07:54:45.735280 13749 tablet_service.cc:1515] Processing DeleteTablet for tablet 2aea1a69d22544899b0218be7e0f8799 with delete_type TABLET_DATA_DELETED (replaced by tablet 1a1a7ff577334cc58e75d7615b793573) from {username='slave'} at 127.0.0.1:45460
I20250830 07:54:45.736403 13231 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_38c9c9f1bfb24082854dfb1f7d0b112f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:45.737087 13220 catalog_manager.cc:4908] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet 2aea1a69d22544899b0218be7e0f8799 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2aea1a69d22544899b0218be7e0f8799 already in progress: creating tablet
W20250830 07:54:45.737324 13219 catalog_manager.cc:4908] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): delete failed for tablet 2aea1a69d22544899b0218be7e0f8799 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2aea1a69d22544899b0218be7e0f8799 already in progress: creating tablet
W20250830 07:54:45.738466 13218 catalog_manager.cc:4908] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): delete failed for tablet 2aea1a69d22544899b0218be7e0f8799 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2aea1a69d22544899b0218be7e0f8799 already in progress: creating tablet
W20250830 07:54:45.739208 13231 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_38c9c9f1bfb24082854dfb1f7d0b112f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:45.740262 13234 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_8e66006498aa4e5ebbaf880a1a53c1e7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250830 07:54:45.740559 13227 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet 62bc8168176e4678a77827c5b7cc0f3e
W20250830 07:54:45.740736 13234 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8e66006498aa4e5ebbaf880a1a53c1e7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:45.741039 13227 catalog_manager.cc:6652] ReplaceTablet: tablet 62bc8168176e4678a77827c5b7cc0f3e deleted and replaced by tablet f8fab6e766a847c29da8573ad0b402d5
I20250830 07:54:45.741325 13227 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_e40f799d6135436c83693f971a69ee0d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:45.741705 13227 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e40f799d6135436c83693f971a69ee0d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250830 07:54:45.741928 13232 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 76ab56c469cf4675a4e21acbe0a8085d consensus state has no leader
I20250830 07:54:45.748975 14853 raft_consensus.cc:491] T 5aef6fd239ba43478cd978fa5d29b26e P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:45.749143 14853 raft_consensus.cc:513] T 5aef6fd239ba43478cd978fa5d29b26e P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:45.749733 14853 leader_election.cc:290] T 5aef6fd239ba43478cd978fa5d29b26e P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
W20250830 07:54:45.751034 13701 leader_election.cc:343] T 5aef6fd239ba43478cd978fa5d29b26e P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): Not found: Tablet not found: 5aef6fd239ba43478cd978fa5d29b26e
I20250830 07:54:45.751283 13749 tablet_service.cc:1515] Processing DeleteTablet for tablet 62bc8168176e4678a77827c5b7cc0f3e with delete_type TABLET_DATA_DELETED (replaced by tablet f8fab6e766a847c29da8573ad0b402d5) from {username='slave'} at 127.0.0.1:45460
I20250830 07:54:45.751704 13599 tablet_service.cc:1515] Processing DeleteTablet for tablet 62bc8168176e4678a77827c5b7cc0f3e with delete_type TABLET_DATA_DELETED (replaced by tablet f8fab6e766a847c29da8573ad0b402d5) from {username='slave'} at 127.0.0.1:45306
W20250830 07:54:45.751947 13219 catalog_manager.cc:4908] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): delete failed for tablet 62bc8168176e4678a77827c5b7cc0f3e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 62bc8168176e4678a77827c5b7cc0f3e already in progress: creating tablet
W20250830 07:54:45.753000 13220 catalog_manager.cc:4908] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet 62bc8168176e4678a77827c5b7cc0f3e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 62bc8168176e4678a77827c5b7cc0f3e already in progress: creating tablet
I20250830 07:54:45.753540 13225 catalog_manager.cc:5864] Not sending DeleteTablet requests; no consensus state for tablet fb401ca314e445e5a66feaf25386520a
I20250830 07:54:45.763231 13468 tablet_service.cc:1515] Processing DeleteTablet for tablet 62bc8168176e4678a77827c5b7cc0f3e with delete_type TABLET_DATA_DELETED (replaced by tablet f8fab6e766a847c29da8573ad0b402d5) from {username='slave'} at 127.0.0.1:37956
W20250830 07:54:45.766481 13218 catalog_manager.cc:4908] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): delete failed for tablet 62bc8168176e4678a77827c5b7cc0f3e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 62bc8168176e4678a77827c5b7cc0f3e already in progress: creating tablet
W20250830 07:54:45.766605 13422 consensus_peers.cc:489] T 533811110191436d96665b3475ab597f P 2065c332f15a4739899af79f3669c3ba -> Peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Couldn't send request to peer 9b057ade5dce45af9f8bf0bedf8b917f. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20250830 07:54:45.766534 14880 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20250830 07:54:45.767056 14869 raft_consensus.cc:491] T 0507245aa8c74aeb9f3eafba0682590d P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:45.767205 14869 raft_consensus.cc:513] T 0507245aa8c74aeb9f3eafba0682590d P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:45.767803 14869 leader_election.cc:290] T 0507245aa8c74aeb9f3eafba0682590d P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:45.768536 14745 server_base.cc:1047] running on GCE node
I20250830 07:54:45.771129 13770 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "0507245aa8c74aeb9f3eafba0682590d" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
W20250830 07:54:45.773854 13422 leader_election.cc:343] T 0507245aa8c74aeb9f3eafba0682590d P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Illegal state: must be running to vote when last-logged opid is not known
W20250830 07:54:45.777799 13703 leader_election.cc:343] T 5aef6fd239ba43478cd978fa5d29b26e P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Not found: Tablet not found: 5aef6fd239ba43478cd978fa5d29b26e
I20250830 07:54:45.777962 13703 leader_election.cc:304] T 5aef6fd239ba43478cd978fa5d29b26e P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 2065c332f15a4739899af79f3669c3ba, 6b5e454d98894637b466ea27f1b647f9
W20250830 07:54:45.778558 13230 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 8a6a2a2dc6e0411b8ad8364cbf2cec36 has no consensus state
I20250830 07:54:45.779808 14854 consensus_queue.cc:1035] T 69d6daeb7c774fd48ed296f52ed7c6a6 P 2065c332f15a4739899af79f3669c3ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:54:45.782161 14819 raft_consensus.cc:2747] T 5aef6fd239ba43478cd978fa5d29b26e P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:54:45.782227 13613 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "0507245aa8c74aeb9f3eafba0682590d" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
W20250830 07:54:45.783897 13230 catalog_manager.cc:5415] Ignoring report from unknown tablet 04eadf45b82e4c319eb7b316a402d81a
W20250830 07:54:45.783929 13423 leader_election.cc:343] T 0507245aa8c74aeb9f3eafba0682590d P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:45.784061 13423 leader_election.cc:304] T 0507245aa8c74aeb9f3eafba0682590d P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba; no voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f
W20250830 07:54:45.784411 13230 catalog_manager.cc:5415] Ignoring report from unknown tablet 007435e198b9440db055711a98e3148a
W20250830 07:54:45.784520 13230 catalog_manager.cc:5415] Ignoring report from unknown tablet ffc5945a032e47d4bd3397d7c887dc62
I20250830 07:54:45.784497 14815 raft_consensus.cc:2747] T 0507245aa8c74aeb9f3eafba0682590d P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20250830 07:54:45.784695 13230 catalog_manager.cc:5415] Ignoring report from unknown tablet 73853894da074ecd8147a94ac28bfab8
W20250830 07:54:45.784808 13230 catalog_manager.cc:5415] Ignoring report from unknown tablet d1ae3812d72b419798736328da64b53c
W20250830 07:54:45.785518 13230 catalog_manager.cc:5415] Ignoring report from unknown tablet 533811110191436d96665b3475ab597f
W20250830 07:54:45.785677 13230 catalog_manager.cc:5415] Ignoring report from unknown tablet ff2267fb411942ff826e2a72bcb89cd7
W20250830 07:54:45.793838 13562 consensus_peers.cc:489] T cb3c48982add45379c0e1b117ec40c1a P 6b5e454d98894637b466ea27f1b647f9 -> Peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Couldn't send request to peer 9b057ade5dce45af9f8bf0bedf8b917f. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20250830 07:54:45.799314 13882 tablet_bootstrap.cc:492] T 99f307a8cbb34addaafab82b3ed18241 P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
W20250830 07:54:45.799477 13221 catalog_manager.cc:4726] Async tablet task AlterTable RPC for tablet 924403105a6a40f28aad60647a2a8987 (table default.Table_5caf352b482f4b9ba4d727ab7fbd00bb [id=46ec9117fe9146cb807dd092284616fc], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 924403105a6a40f28aad60647a2a8987 consensus state has no leader
I20250830 07:54:45.802954 13882 ts_tablet_manager.cc:1397] T 99f307a8cbb34addaafab82b3ed18241 P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.200s user 0.003s sys 0.000s
I20250830 07:54:45.799537 13886 ts_tablet_manager.cc:1397] T e6491d149c0646848680cfdadb6fc76c P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.108s user 0.003s sys 0.000s
I20250830 07:54:45.804925 13886 raft_consensus.cc:357] T e6491d149c0646848680cfdadb6fc76c P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:54:45.805724 13886 raft_consensus.cc:383] T e6491d149c0646848680cfdadb6fc76c P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:45.809482 13882 raft_consensus.cc:357] T 99f307a8cbb34addaafab82b3ed18241 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:45.809993 13882 raft_consensus.cc:383] T 99f307a8cbb34addaafab82b3ed18241 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:45.810858 13886 raft_consensus.cc:738] T e6491d149c0646848680cfdadb6fc76c P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:54:45.811007 13882 raft_consensus.cc:738] T 99f307a8cbb34addaafab82b3ed18241 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:54:45.811684 13882 consensus_queue.cc:260] T 99f307a8cbb34addaafab82b3ed18241 P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:45.812106 13886 consensus_queue.cc:260] T e6491d149c0646848680cfdadb6fc76c P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
W20250830 07:54:45.817947 14881 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20250830 07:54:45.819408 14869 raft_consensus.cc:491] T 4c4a8eea119044b49e2b29f10a703097 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:45.819527 14869 raft_consensus.cc:513] T 4c4a8eea119044b49e2b29f10a703097 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:45.820101 14869 leader_election.cc:290] T 4c4a8eea119044b49e2b29f10a703097 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:45.820921 13770 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "4c4a8eea119044b49e2b29f10a703097" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
W20250830 07:54:45.821537 13422 leader_election.cc:343] T 4c4a8eea119044b49e2b29f10a703097 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:45.824337 13227 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_dff4a3b7f30d42b482a11c49e6df4558"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:45.824841 13227 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_dff4a3b7f30d42b482a11c49e6df4558 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:45.825845 13234 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_8a839bdfd86440999548197b16877948" } new_table_name: "default.Table_0c2faf92583f4b649a893b03b88923a0" modify_external_catalogs: true
I20250830 07:54:45.829460 13231 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_0f02ca27d84745debe858483af7ccea7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:45.829952 13231 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0f02ca27d84745debe858483af7ccea7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250830 07:54:45.834429 13234 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d7afb311a699495aa8376db6ab206d94 consensus state has no leader
I20250830 07:54:45.837023 13886 ts_tablet_manager.cc:1428] T e6491d149c0646848680cfdadb6fc76c P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.033s user 0.001s sys 0.000s
I20250830 07:54:45.837877 13882 ts_tablet_manager.cc:1428] T 99f307a8cbb34addaafab82b3ed18241 P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.032s user 0.002s sys 0.000s
I20250830 07:54:45.841421 13617 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "4c4a8eea119044b49e2b29f10a703097" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:45.844507 13231 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_2a3e3a79103b4c378e0cf2beabac7ed2" } new_table_name: "default.Table_8cd7888630c047b89d1237ee4e25dc03" modify_external_catalogs: true
I20250830 07:54:45.850384 13882 tablet_bootstrap.cc:492] T 8f215330505848619ad44569d3167591 P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:54:45.850678 13886 tablet_bootstrap.cc:492] T 69d6daeb7c774fd48ed296f52ed7c6a6 P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:54:45.853009 13882 tablet_bootstrap.cc:654] T 8f215330505848619ad44569d3167591 P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
W20250830 07:54:45.853524 13231 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 208995abd6d44dbea3b5ebbea27d6a39 consensus state has no leader
W20250830 07:54:45.859721 13423 leader_election.cc:343] T 4c4a8eea119044b49e2b29f10a703097 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:45.859838 13423 leader_election.cc:304] T 4c4a8eea119044b49e2b29f10a703097 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba; no voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:54:45.860191 14869 raft_consensus.cc:2747] T 4c4a8eea119044b49e2b29f10a703097 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20250830 07:54:45.860451 13422 consensus_peers.cc:489] T 69d6daeb7c774fd48ed296f52ed7c6a6 P 2065c332f15a4739899af79f3669c3ba -> Peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Couldn't send request to peer 9b057ade5dce45af9f8bf0bedf8b917f. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20250830 07:54:45.869261 13231 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_337ffcdb618e443ab9f21511ef2f615c" } modify_external_catalogs: true
I20250830 07:54:45.869437 13231 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_337ffcdb618e443ab9f21511ef2f615c" } modify_external_catalogs: true
I20250830 07:54:45.870779 13234 master_service.cc:948] ReplaceTablet: received request to replace tablet f192693039a24e3cb0bec646c8d11056 from {username='slave'} at 127.0.0.1:42126
W20250830 07:54:45.874752 14884 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20250830 07:54:45.876545 14745 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20250830 07:54:45.881278 13233 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_fa88ef9c651348d287efdd7af42e9526"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:45.881734 13233 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fa88ef9c651348d287efdd7af42e9526 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:45.883226 13228 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_2c14c2548447473a998f5b39993d1b72" } modify_external_catalogs: true
I20250830 07:54:45.883399 13228 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_2c14c2548447473a998f5b39993d1b72" } modify_external_catalogs: true
I20250830 07:54:45.884631 13227 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_98722818dc7c4e3284220440947a4cbf" } modify_external_catalogs: true
I20250830 07:54:45.884783 13227 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_98722818dc7c4e3284220440947a4cbf" } modify_external_catalogs: true
I20250830 07:54:45.888450 13231 catalog_manager.cc:5864] Not sending DeleteTablet requests; no consensus state for tablet 6bb062f9c4e342489422c8faabfb1b9b
I20250830 07:54:45.889488 14644 raft_consensus.cc:491] T 2b4ce50fbd26484faba3faa2ec5115c0 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:45.889602 14644 raft_consensus.cc:513] T 2b4ce50fbd26484faba3faa2ec5115c0 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:45.890161 14644 leader_election.cc:290] T 2b4ce50fbd26484faba3faa2ec5115c0 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:45.890867 13770 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "2b4ce50fbd26484faba3faa2ec5115c0" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
W20250830 07:54:45.891288 13422 leader_election.cc:343] T 2b4ce50fbd26484faba3faa2ec5115c0 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:45.893590 13234 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet f192693039a24e3cb0bec646c8d11056
I20250830 07:54:45.894080 13234 catalog_manager.cc:6652] ReplaceTablet: tablet f192693039a24e3cb0bec646c8d11056 deleted and replaced by tablet b55148275523426dad5f424311740892
I20250830 07:54:45.894784 13468 tablet_service.cc:1515] Processing DeleteTablet for tablet f192693039a24e3cb0bec646c8d11056 with delete_type TABLET_DATA_DELETED (replaced by tablet b55148275523426dad5f424311740892) from {username='slave'} at 127.0.0.1:37956
I20250830 07:54:45.895448 13228 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet e2ef8300fb994f98b3565ad708f880cf
W20250830 07:54:45.896313 13218 catalog_manager.cc:4908] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): delete failed for tablet f192693039a24e3cb0bec646c8d11056 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f192693039a24e3cb0bec646c8d11056 already in progress: creating tablet
I20250830 07:54:45.896404 13468 tablet_service.cc:1515] Processing DeleteTablet for tablet e2ef8300fb994f98b3565ad708f880cf with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:45 UTC) from {username='slave'} at 127.0.0.1:37956
W20250830 07:54:45.896828 13218 catalog_manager.cc:4908] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): delete failed for tablet e2ef8300fb994f98b3565ad708f880cf because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e2ef8300fb994f98b3565ad708f880cf already in progress: creating tablet
I20250830 07:54:45.900945 13887 tablet_bootstrap.cc:492] T ec4a3975961d4f85ad9da94835417574 P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:54:45.901062 13887 ts_tablet_manager.cc:1397] T ec4a3975961d4f85ad9da94835417574 P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.272s user 0.025s sys 0.058s
I20250830 07:54:45.901876 13887 raft_consensus.cc:357] T ec4a3975961d4f85ad9da94835417574 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:45.902079 13887 raft_consensus.cc:383] T ec4a3975961d4f85ad9da94835417574 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:45.902136 13887 raft_consensus.cc:738] T ec4a3975961d4f85ad9da94835417574 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:54:45.902334 13887 consensus_queue.cc:260] T ec4a3975961d4f85ad9da94835417574 P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:45.902814 13887 ts_tablet_manager.cc:1428] T ec4a3975961d4f85ad9da94835417574 P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20250830 07:54:45.904699 13887 tablet_bootstrap.cc:492] T 29f0695563854e45965a1cc36ac54138 P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:54:45.906075 13887 tablet_bootstrap.cc:654] T 29f0695563854e45965a1cc36ac54138 P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:45.912849 14815 raft_consensus.cc:491] T 44313f1a11b74e6d996cafd3c03d1836 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:45.912959 14815 raft_consensus.cc:513] T 44313f1a11b74e6d996cafd3c03d1836 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:45.913441 14815 leader_election.cc:290] T 44313f1a11b74e6d996cafd3c03d1836 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:45.917603 13770 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "44313f1a11b74e6d996cafd3c03d1836" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
W20250830 07:54:45.918301 13422 leader_election.cc:343] T 44313f1a11b74e6d996cafd3c03d1836 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:45.920658 13227 catalog_manager.cc:5864] Not sending DeleteTablet requests; no consensus state for tablet b55148275523426dad5f424311740892
I20250830 07:54:45.924923 13227 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_2f359a3ab6854c5589d3c78af9b2e364" } modify_external_catalogs: true
I20250830 07:54:45.925081 13227 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_2f359a3ab6854c5589d3c78af9b2e364" } modify_external_catalogs: true
I20250830 07:54:45.926218 13228 master_service.cc:948] ReplaceTablet: received request to replace tablet acca1a8240454b889c63c82d3c75087e from {username='slave'} at 127.0.0.1:42126
I20250830 07:54:45.927439 14753 raft_consensus.cc:491] T 007435e198b9440db055711a98e3148a P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:45.927599 13887 tablet_bootstrap.cc:492] T 29f0695563854e45965a1cc36ac54138 P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:54:45.927556 14753 raft_consensus.cc:513] T 007435e198b9440db055711a98e3148a P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:45.927699 13887 ts_tablet_manager.cc:1397] T 29f0695563854e45965a1cc36ac54138 P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.023s user 0.005s sys 0.001s
I20250830 07:54:45.928104 14753 leader_election.cc:290] T 007435e198b9440db055711a98e3148a P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:45.928308 13887 raft_consensus.cc:357] T 29f0695563854e45965a1cc36ac54138 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:45.928431 13887 raft_consensus.cc:383] T 29f0695563854e45965a1cc36ac54138 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:45.928467 13887 raft_consensus.cc:738] T 29f0695563854e45965a1cc36ac54138 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:54:45.928606 13887 consensus_queue.cc:260] T 29f0695563854e45965a1cc36ac54138 P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:45.930253 13887 ts_tablet_manager.cc:1428] T 29f0695563854e45965a1cc36ac54138 P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20250830 07:54:45.930641 13481 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "007435e198b9440db055711a98e3148a" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:54:45.930804 13481 raft_consensus.cc:2466] T 007435e198b9440db055711a98e3148a P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b5e454d98894637b466ea27f1b647f9 in term 0.
I20250830 07:54:45.931288 13887 tablet_bootstrap.cc:492] T f1fe024f0de048a5a0931ee38752d5a1 P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:54:45.931885 13561 leader_election.cc:304] T 007435e198b9440db055711a98e3148a P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 6b5e454d98894637b466ea27f1b647f9; no voters:
I20250830 07:54:45.932199 14753 raft_consensus.cc:2802] T 007435e198b9440db055711a98e3148a P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:54:45.932273 14753 raft_consensus.cc:491] T 007435e198b9440db055711a98e3148a P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:54:45.932340 14753 raft_consensus.cc:3058] T 007435e198b9440db055711a98e3148a P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:45.838722 14674 consensus_queue.cc:1035] T cb3c48982add45379c0e1b117ec40c1a P 6b5e454d98894637b466ea27f1b647f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.019s
I20250830 07:54:45.932921 13887 tablet_bootstrap.cc:654] T f1fe024f0de048a5a0931ee38752d5a1 P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:45.893749 13611 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "2b4ce50fbd26484faba3faa2ec5115c0" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:45.895155 13599 tablet_service.cc:1515] Processing DeleteTablet for tablet f192693039a24e3cb0bec646c8d11056 with delete_type TABLET_DATA_DELETED (replaced by tablet b55148275523426dad5f424311740892) from {username='slave'} at 127.0.0.1:45306
I20250830 07:54:45.896436 13591 tablet_service.cc:1515] Processing DeleteTablet for tablet e2ef8300fb994f98b3565ad708f880cf with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:45 UTC) from {username='slave'} at 127.0.0.1:45306
I20250830 07:54:45.914079 13617 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "44313f1a11b74e6d996cafd3c03d1836" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:45.918844 14748 consensus_queue.cc:1035] T 752727eef0734ff3b7b35b1d5f66aea6 P 6b5e454d98894637b466ea27f1b647f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20250830 07:54:45.934108 13423 leader_election.cc:343] T 2b4ce50fbd26484faba3faa2ec5115c0 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:45.934192 13423 leader_election.cc:304] T 2b4ce50fbd26484faba3faa2ec5115c0 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba; no voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f
W20250830 07:54:45.934525 13423 leader_election.cc:343] T 44313f1a11b74e6d996cafd3c03d1836 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:45.934607 13423 leader_election.cc:304] T 44313f1a11b74e6d996cafd3c03d1836 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba; no voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:54:45.934813 14869 raft_consensus.cc:2747] T 2b4ce50fbd26484faba3faa2ec5115c0 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:54:45.934962 14869 raft_consensus.cc:2747] T 44313f1a11b74e6d996cafd3c03d1836 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20250830 07:54:45.935240 13220 catalog_manager.cc:4908] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet e2ef8300fb994f98b3565ad708f880cf because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e2ef8300fb994f98b3565ad708f880cf already in progress: creating tablet
I20250830 07:54:45.938571 13768 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "007435e198b9440db055711a98e3148a" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:45.939218 14753 raft_consensus.cc:513] T 007435e198b9440db055711a98e3148a P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:45.939918 14753 leader_election.cc:290] T 007435e198b9440db055711a98e3148a P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 election: Requested vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:45.940294 13486 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "007435e198b9440db055711a98e3148a" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba"
I20250830 07:54:45.940443 13486 raft_consensus.cc:3058] T 007435e198b9440db055711a98e3148a P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:45.941785 13768 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "007435e198b9440db055711a98e3148a" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f"
W20250830 07:54:45.941440 13562 leader_election.cc:343] T 007435e198b9440db055711a98e3148a P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:45.943259 13486 raft_consensus.cc:2466] T 007435e198b9440db055711a98e3148a P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b5e454d98894637b466ea27f1b647f9 in term 1.
W20250830 07:54:45.943271 13562 leader_election.cc:343] T 007435e198b9440db055711a98e3148a P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:45.943590 13561 leader_election.cc:304] T 007435e198b9440db055711a98e3148a P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 6b5e454d98894637b466ea27f1b647f9; no voters: 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:54:45.945199 14753 raft_consensus.cc:2802] T 007435e198b9440db055711a98e3148a P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Leader election won for term 1
I20250830 07:54:45.945837 14753 raft_consensus.cc:695] T 007435e198b9440db055711a98e3148a P 6b5e454d98894637b466ea27f1b647f9 [term 1 LEADER]: Becoming Leader. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Running, Role: LEADER
I20250830 07:54:45.946148 14753 consensus_queue.cc:237] T 007435e198b9440db055711a98e3148a P 6b5e454d98894637b466ea27f1b647f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:45.948912 13228 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_8edbcf7950a04e75982f77c91ac9ff84" } new_table_name: "default.Table_b4907cdb918d416aad947d2c3f14f9bc" modify_external_catalogs: true
I20250830 07:54:45.951301 13234 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_8a9281237b4a4a5fb5e460f64531ea37"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:45.951807 13234 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8a9281237b4a4a5fb5e460f64531ea37 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:45.952536 13233 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_454f67980c3e4ddf989f257b146a9c29"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:45.952972 13233 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_454f67980c3e4ddf989f257b146a9c29 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:45.955647 13231 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_034019ccacd345d5873db4d09f70ee1f" } new_table_name: "default.Table_423718714b4c41f394a8af89b1a82ff3" modify_external_catalogs: true
I20250830 07:54:45.958542 13225 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_ceb6b6a4e5014de182da8b467ca360f1" } modify_external_catalogs: true
I20250830 07:54:45.958720 13225 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_ceb6b6a4e5014de182da8b467ca360f1" } modify_external_catalogs: true
I20250830 07:54:45.966107 13232 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_30a34510203d435ca31d4da546ce305b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:45.966568 13232 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_30a34510203d435ca31d4da546ce305b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:45.975735 13227 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet 78fe9f6325c243a490f361aa79295c36
I20250830 07:54:45.976361 13591 tablet_service.cc:1515] Processing DeleteTablet for tablet 78fe9f6325c243a490f361aa79295c36 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:45 UTC) from {username='slave'} at 127.0.0.1:45306
I20250830 07:54:45.976630 13227 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_5a55d9f1c7a44f4785b34a618728cbae"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:45.977092 13227 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5a55d9f1c7a44f4785b34a618728cbae in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250830 07:54:45.977294 13220 catalog_manager.cc:4908] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet 78fe9f6325c243a490f361aa79295c36 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 78fe9f6325c243a490f361aa79295c36 already in progress: creating tablet
I20250830 07:54:45.977912 13468 tablet_service.cc:1515] Processing DeleteTablet for tablet 78fe9f6325c243a490f361aa79295c36 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:45 UTC) from {username='slave'} at 127.0.0.1:37956
W20250830 07:54:45.978456 13218 catalog_manager.cc:4908] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): delete failed for tablet 78fe9f6325c243a490f361aa79295c36 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 78fe9f6325c243a490f361aa79295c36 already in progress: creating tablet
I20250830 07:54:45.979884 13886 tablet_bootstrap.cc:654] T 69d6daeb7c774fd48ed296f52ed7c6a6 P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:45.985280 14745 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20250830 07:54:45.990548 13234 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_2d468f4cd05e4f9aa354321ddccdc59c" } new_table_name: "default.Table_1e1d43a415824a4788e1de36139d2cfd" modify_external_catalogs: true
I20250830 07:54:45.990666 13233 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_b3bbd69f2357492c8a10ce75ea4c393a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:45.991137 13233 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b3bbd69f2357492c8a10ce75ea4c393a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250830 07:54:45.992794 13219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.209.60:43889, user_credentials={real_user=slave}} blocked reactor thread for 129414us
W20250830 07:54:45.993130 13228 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 1f5471a94dc24a28bce5f9dcaa10334a consensus state has no leader
I20250830 07:54:45.993307 13749 tablet_service.cc:1515] Processing DeleteTablet for tablet f192693039a24e3cb0bec646c8d11056 with delete_type TABLET_DATA_DELETED (replaced by tablet b55148275523426dad5f424311740892) from {username='slave'} at 127.0.0.1:45460
I20250830 07:54:45.993813 13228 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_34baaf5f8c9e4e8f9ac45d692fff219e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250830 07:54:45.993896 13749 tablet_service.cc:1515] Processing DeleteTablet for tablet e2ef8300fb994f98b3565ad708f880cf with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:45 UTC) from {username='slave'} at 127.0.0.1:45460
I20250830 07:54:45.994398 13749 tablet_service.cc:1515] Processing DeleteTablet for tablet 78fe9f6325c243a490f361aa79295c36 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:45 UTC) from {username='slave'} at 127.0.0.1:45460
W20250830 07:54:45.994989 13219 catalog_manager.cc:4908] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): delete failed for tablet e2ef8300fb994f98b3565ad708f880cf because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e2ef8300fb994f98b3565ad708f880cf already in progress: creating tablet
W20250830 07:54:45.995218 13219 catalog_manager.cc:4908] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): delete failed for tablet 78fe9f6325c243a490f361aa79295c36 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 78fe9f6325c243a490f361aa79295c36 already in progress: creating tablet
W20250830 07:54:45.995788 13228 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_34baaf5f8c9e4e8f9ac45d692fff219e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:45.996021 14644 raft_consensus.cc:491] T c0147310dad84226808332a4c2c6e09d P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:45.996183 14644 raft_consensus.cc:513] T c0147310dad84226808332a4c2c6e09d P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:45.996737 14644 leader_election.cc:290] T c0147310dad84226808332a4c2c6e09d P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:45.997478 13768 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "c0147310dad84226808332a4c2c6e09d" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:45.997658 13617 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "c0147310dad84226808332a4c2c6e09d" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
W20250830 07:54:45.998219 13423 leader_election.cc:343] T c0147310dad84226808332a4c2c6e09d P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
W20250830 07:54:45.998548 13422 leader_election.cc:343] T c0147310dad84226808332a4c2c6e09d P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:45.998703 13422 leader_election.cc:304] T c0147310dad84226808332a4c2c6e09d P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba; no voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f
W20250830 07:54:45.999382 13219 consensus_peers.cc:489] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88 -> Peer 3ea183a890b84f408b20b55e9eb7c7ed (127.12.209.60:43889): Couldn't send request to peer 3ea183a890b84f408b20b55e9eb7c7ed. Status: Network error: Client connection negotiation failed: client connection to 127.12.209.60:43889: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20250830 07:54:45.999441 14869 raft_consensus.cc:2747] T c0147310dad84226808332a4c2c6e09d P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:54:46.000514 13887 tablet_bootstrap.cc:492] T f1fe024f0de048a5a0931ee38752d5a1 P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:54:46.000722 13887 ts_tablet_manager.cc:1397] T f1fe024f0de048a5a0931ee38752d5a1 P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.069s user 0.003s sys 0.031s
I20250830 07:54:46.001515 13887 raft_consensus.cc:357] T f1fe024f0de048a5a0931ee38752d5a1 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:46.001757 13887 raft_consensus.cc:383] T f1fe024f0de048a5a0931ee38752d5a1 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:46.001888 13887 raft_consensus.cc:738] T f1fe024f0de048a5a0931ee38752d5a1 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:54:46.002218 13887 consensus_queue.cc:260] T f1fe024f0de048a5a0931ee38752d5a1 P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:46.002890 13887 ts_tablet_manager.cc:1428] T f1fe024f0de048a5a0931ee38752d5a1 P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20250830 07:54:46.002976 14753 raft_consensus.cc:491] T 53a933afa4b74095baf0f54736d99bf0 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:46.003232 13887 tablet_bootstrap.cc:492] T f0144701d459480d96c1ece519951442 P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:54:46.003546 14753 raft_consensus.cc:513] T 53a933afa4b74095baf0f54736d99bf0 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:46.005179 14745 hybrid_clock.cc:648] HybridClock initialized: now 1756540486005121 us; error 145 us; skew 500 ppm
I20250830 07:54:46.005561 13887 tablet_bootstrap.cc:654] T f0144701d459480d96c1ece519951442 P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:46.006237 13486 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "53a933afa4b74095baf0f54736d99bf0" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:54:46.006417 13882 tablet_bootstrap.cc:492] T 8f215330505848619ad44569d3167591 P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:54:46.006435 13486 raft_consensus.cc:2466] T 53a933afa4b74095baf0f54736d99bf0 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b5e454d98894637b466ea27f1b647f9 in term 0.
I20250830 07:54:46.006784 13561 leader_election.cc:304] T 53a933afa4b74095baf0f54736d99bf0 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 6b5e454d98894637b466ea27f1b647f9; no voters:
I20250830 07:54:46.007035 14748 raft_consensus.cc:2802] T 53a933afa4b74095baf0f54736d99bf0 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:54:46.007098 14748 raft_consensus.cc:491] T 53a933afa4b74095baf0f54736d99bf0 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:54:46.007171 14748 raft_consensus.cc:3058] T 53a933afa4b74095baf0f54736d99bf0 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:46.007772 13768 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "53a933afa4b74095baf0f54736d99bf0" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:46.007961 13768 raft_consensus.cc:2466] T 53a933afa4b74095baf0f54736d99bf0 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b5e454d98894637b466ea27f1b647f9 in term 0.
I20250830 07:54:46.008669 14753 leader_election.cc:290] T 53a933afa4b74095baf0f54736d99bf0 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:46.008555 14745 server_base.cc:847] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20250830 07:54:46.009941 14748 raft_consensus.cc:513] T 53a933afa4b74095baf0f54736d99bf0 P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:46.010533 14748 leader_election.cc:290] T 53a933afa4b74095baf0f54736d99bf0 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 election: Requested vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:46.011168 13486 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "53a933afa4b74095baf0f54736d99bf0" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba"
I20250830 07:54:46.011338 13486 raft_consensus.cc:3058] T 53a933afa4b74095baf0f54736d99bf0 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:46.013922 13486 raft_consensus.cc:2466] T 53a933afa4b74095baf0f54736d99bf0 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b5e454d98894637b466ea27f1b647f9 in term 1.
I20250830 07:54:46.015291 13882 ts_tablet_manager.cc:1397] T 8f215330505848619ad44569d3167591 P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.165s user 0.004s sys 0.000s
I20250830 07:54:46.018620 13886 tablet_bootstrap.cc:492] T 69d6daeb7c774fd48ed296f52ed7c6a6 P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:54:46.018774 13886 ts_tablet_manager.cc:1397] T 69d6daeb7c774fd48ed296f52ed7c6a6 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.168s user 0.004s sys 0.000s
I20250830 07:54:46.018903 13561 leader_election.cc:304] T 53a933afa4b74095baf0f54736d99bf0 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 6b5e454d98894637b466ea27f1b647f9; no voters:
I20250830 07:54:46.019174 14748 raft_consensus.cc:2802] T 53a933afa4b74095baf0f54736d99bf0 P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Leader election won for term 1
I20250830 07:54:46.019281 14748 raft_consensus.cc:695] T 53a933afa4b74095baf0f54736d99bf0 P 6b5e454d98894637b466ea27f1b647f9 [term 1 LEADER]: Becoming Leader. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Running, Role: LEADER
I20250830 07:54:46.020426 13768 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "53a933afa4b74095baf0f54736d99bf0" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f"
I20250830 07:54:46.020584 13768 raft_consensus.cc:3058] T 53a933afa4b74095baf0f54736d99bf0 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:46.023036 13886 raft_consensus.cc:357] T 69d6daeb7c774fd48ed296f52ed7c6a6 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:46.023097 14818 raft_consensus.cc:491] T 050e72b96c2d479896b3a54d85e6f6dd P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:46.023195 13886 raft_consensus.cc:383] T 69d6daeb7c774fd48ed296f52ed7c6a6 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:46.023286 13886 raft_consensus.cc:738] T 69d6daeb7c774fd48ed296f52ed7c6a6 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:54:46.023396 14818 raft_consensus.cc:513] T 050e72b96c2d479896b3a54d85e6f6dd P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:46.023470 13886 consensus_queue.cc:260] T 69d6daeb7c774fd48ed296f52ed7c6a6 P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:46.023943 13886 ts_tablet_manager.cc:1428] T 69d6daeb7c774fd48ed296f52ed7c6a6 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.005s user 0.001s sys 0.000s
I20250830 07:54:46.024003 14818 leader_election.cc:290] T 050e72b96c2d479896b3a54d85e6f6dd P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967)
I20250830 07:54:46.024786 13887 tablet_bootstrap.cc:492] T f0144701d459480d96c1ece519951442 P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:54:46.024935 13887 ts_tablet_manager.cc:1397] T f0144701d459480d96c1ece519951442 P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.022s user 0.000s sys 0.003s
I20250830 07:54:46.025894 14748 consensus_queue.cc:237] T 53a933afa4b74095baf0f54736d99bf0 P 6b5e454d98894637b466ea27f1b647f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
W20250830 07:54:46.026823 13701 leader_election.cc:343] T 050e72b96c2d479896b3a54d85e6f6dd P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): Not found: Tablet not found: 050e72b96c2d479896b3a54d85e6f6dd
I20250830 07:54:46.027050 13882 raft_consensus.cc:357] T 8f215330505848619ad44569d3167591 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:46.027174 13882 raft_consensus.cc:383] T 8f215330505848619ad44569d3167591 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:46.027211 13882 raft_consensus.cc:738] T 8f215330505848619ad44569d3167591 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:54:46.027343 13882 consensus_queue.cc:260] T 8f215330505848619ad44569d3167591 P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
W20250830 07:54:46.027503 13703 leader_election.cc:343] T 050e72b96c2d479896b3a54d85e6f6dd P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Not found: Tablet not found: 050e72b96c2d479896b3a54d85e6f6dd
I20250830 07:54:46.027621 13703 leader_election.cc:304] T 050e72b96c2d479896b3a54d85e6f6dd P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 2065c332f15a4739899af79f3669c3ba, 6b5e454d98894637b466ea27f1b647f9
I20250830 07:54:46.028470 13768 raft_consensus.cc:2466] T 53a933afa4b74095baf0f54736d99bf0 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b5e454d98894637b466ea27f1b647f9 in term 1.
I20250830 07:54:46.028502 14818 raft_consensus.cc:2747] T 050e72b96c2d479896b3a54d85e6f6dd P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:54:46.029706 13887 raft_consensus.cc:357] T f0144701d459480d96c1ece519951442 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:46.029879 13887 raft_consensus.cc:383] T f0144701d459480d96c1ece519951442 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:46.031100 13887 raft_consensus.cc:738] T f0144701d459480d96c1ece519951442 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:54:46.031356 13887 consensus_queue.cc:260] T f0144701d459480d96c1ece519951442 P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
W20250830 07:54:46.034637 13231 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 9bc54e40f9eb4271aa3132986c249e51 consensus state has no leader
I20250830 07:54:46.035099 13886 tablet_bootstrap.cc:492] T cf5613278b4c4f3bbe751b1ae6f3c313 P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:54:46.035053 13231 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_cacba29065c242789ac3e0da29384aa3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:46.035574 13231 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_cacba29065c242789ac3e0da29384aa3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:46.036211 13887 ts_tablet_manager.cc:1428] T f0144701d459480d96c1ece519951442 P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.011s user 0.001s sys 0.001s
I20250830 07:54:46.036470 13887 tablet_bootstrap.cc:492] T 4828280e6fec4338b35422917966ac8c P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:54:46.036640 13225 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet 559fdab1ef804325978db705431a0ad8
I20250830 07:54:46.036720 13886 tablet_bootstrap.cc:654] T cf5613278b4c4f3bbe751b1ae6f3c313 P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:46.037740 13468 tablet_service.cc:1515] Processing DeleteTablet for tablet 559fdab1ef804325978db705431a0ad8 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:45 UTC) from {username='slave'} at 127.0.0.1:37956
W20250830 07:54:46.039078 13218 catalog_manager.cc:4908] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): delete failed for tablet 559fdab1ef804325978db705431a0ad8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 559fdab1ef804325978db705431a0ad8 already in progress: creating tablet
I20250830 07:54:46.041426 13749 tablet_service.cc:1515] Processing DeleteTablet for tablet 559fdab1ef804325978db705431a0ad8 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:45 UTC) from {username='slave'} at 127.0.0.1:45460
I20250830 07:54:46.041479 13887 tablet_bootstrap.cc:654] T 4828280e6fec4338b35422917966ac8c P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
W20250830 07:54:46.042014 13219 catalog_manager.cc:4908] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): delete failed for tablet 559fdab1ef804325978db705431a0ad8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 559fdab1ef804325978db705431a0ad8 already in progress: creating tablet
I20250830 07:54:46.057991 13225 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_543efd84df20400db7e11d80065e2720"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:46.058503 13225 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_543efd84df20400db7e11d80065e2720 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:46.059468 14869 raft_consensus.cc:491] T f0144701d459480d96c1ece519951442 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:46.059653 14869 raft_consensus.cc:513] T f0144701d459480d96c1ece519951442 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:46.060395 14869 leader_election.cc:290] T f0144701d459480d96c1ece519951442 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:46.061046 13770 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f0144701d459480d96c1ece519951442" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:46.063517 13232 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_dff4a3b7f30d42b482a11c49e6df4558" } new_table_name: "default.Table_949a40db3db44c7a816e2e49ea5ee5e0" modify_external_catalogs: true
W20250830 07:54:46.064702 13234 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet dcb8b326dbec4d40af26b4f143157468 consensus state has no leader
I20250830 07:54:46.065044 13234 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_a41ba45f1ed84fecae2f9b5e1c9c54c2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250830 07:54:46.065258 13227 master_service.cc:948] ReplaceTablet: received request to replace tablet 4df6d481baab40e2b2c1309d1a8c5351 from {username='slave'} at 127.0.0.1:42126
W20250830 07:54:46.065498 13234 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a41ba45f1ed84fecae2f9b5e1c9c54c2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250830 07:54:46.066866 13422 leader_election.cc:343] T f0144701d459480d96c1ece519951442 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:46.075101 13228 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_049167f2b5e44e98b771e19ddb7ac501" } new_table_name: "default.Table_32d032fe8fba47348e797c68bb7ea866" modify_external_catalogs: true
I20250830 07:54:46.084342 13591 tablet_service.cc:1515] Processing DeleteTablet for tablet 559fdab1ef804325978db705431a0ad8 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:45 UTC) from {username='slave'} at 127.0.0.1:45306
W20250830 07:54:46.085960 13232 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet becf9667a0fc4507bc114407090c055c has no consensus state
I20250830 07:54:46.086310 13886 tablet_bootstrap.cc:492] T cf5613278b4c4f3bbe751b1ae6f3c313 P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:54:46.086465 13886 ts_tablet_manager.cc:1397] T cf5613278b4c4f3bbe751b1ae6f3c313 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.051s user 0.009s sys 0.005s
I20250830 07:54:46.087466 13886 raft_consensus.cc:357] T cf5613278b4c4f3bbe751b1ae6f3c313 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:46.087684 13886 raft_consensus.cc:383] T cf5613278b4c4f3bbe751b1ae6f3c313 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:46.087757 13886 raft_consensus.cc:738] T cf5613278b4c4f3bbe751b1ae6f3c313 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:54:46.087989 13886 consensus_queue.cc:260] T cf5613278b4c4f3bbe751b1ae6f3c313 P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:46.088991 13886 ts_tablet_manager.cc:1428] T cf5613278b4c4f3bbe751b1ae6f3c313 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20250830 07:54:46.089309 13882 ts_tablet_manager.cc:1428] T 8f215330505848619ad44569d3167591 P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.074s user 0.001s sys 0.001s
I20250830 07:54:46.089354 13886 tablet_bootstrap.cc:492] T f56cab43580a4ee3a912fc5e58a3bd9d P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:54:46.090615 13882 tablet_bootstrap.cc:492] T d3f207cee78a43a1b5e030c09752c78c P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:54:46.091859 14644 raft_consensus.cc:491] T a41c1455404f4ed0a782a0c4ddd4140d P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:46.092039 14644 raft_consensus.cc:513] T a41c1455404f4ed0a782a0c4ddd4140d P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:46.092757 14644 leader_election.cc:290] T a41c1455404f4ed0a782a0c4ddd4140d P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:46.093116 13770 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "a41c1455404f4ed0a782a0c4ddd4140d" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
W20250830 07:54:46.093632 13422 leader_election.cc:343] T a41c1455404f4ed0a782a0c4ddd4140d P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:46.094532 14818 raft_consensus.cc:491] T 73853894da074ecd8147a94ac28bfab8 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:46.094733 14818 raft_consensus.cc:513] T 73853894da074ecd8147a94ac28bfab8 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:46.095501 14818 leader_election.cc:290] T 73853894da074ecd8147a94ac28bfab8 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
I20250830 07:54:46.096101 13234 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_7e8dccc6af2d49159b06563cd36240a7" } modify_external_catalogs: true
I20250830 07:54:46.096264 13234 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_7e8dccc6af2d49159b06563cd36240a7" } modify_external_catalogs: true
I20250830 07:54:46.097023 13481 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "73853894da074ecd8147a94ac28bfab8" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:54:46.097198 13481 raft_consensus.cc:2466] T 73853894da074ecd8147a94ac28bfab8 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 0.
I20250830 07:54:46.098579 13232 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_337eac5fc73e489cadc40b6760448942" } modify_external_catalogs: true
I20250830 07:54:46.098735 13232 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_337eac5fc73e489cadc40b6760448942" } modify_external_catalogs: true
W20250830 07:54:46.099471 13228 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 0ceccc5f18294356894695fe08d73e30 consensus state has no leader
I20250830 07:54:46.099928 13231 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_2631f1f3da404c52b362b8093acbf4a9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:46.100414 13231 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2631f1f3da404c52b362b8093acbf4a9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:46.101115 13701 leader_election.cc:304] T 73853894da074ecd8147a94ac28bfab8 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters:
I20250830 07:54:46.101418 14818 raft_consensus.cc:2802] T 73853894da074ecd8147a94ac28bfab8 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:54:46.101502 14818 raft_consensus.cc:491] T 73853894da074ecd8147a94ac28bfab8 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:54:46.101588 14818 raft_consensus.cc:3058] T 73853894da074ecd8147a94ac28bfab8 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:46.106217 13886 tablet_bootstrap.cc:654] T f56cab43580a4ee3a912fc5e58a3bd9d P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:46.106408 14818 raft_consensus.cc:513] T 73853894da074ecd8147a94ac28bfab8 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:46.107440 14818 leader_election.cc:290] T 73853894da074ecd8147a94ac28bfab8 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Requested vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
I20250830 07:54:46.107663 13481 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "73853894da074ecd8147a94ac28bfab8" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba"
I20250830 07:54:46.107858 13481 raft_consensus.cc:3058] T 73853894da074ecd8147a94ac28bfab8 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:46.107928 13234 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet 4b9d9d4b65964fd49d8e25092a14d774
I20250830 07:54:46.111194 13749 tablet_service.cc:1515] Processing DeleteTablet for tablet 4b9d9d4b65964fd49d8e25092a14d774 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:46 UTC) from {username='slave'} at 127.0.0.1:45460
W20250830 07:54:46.111827 13219 catalog_manager.cc:4908] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): delete failed for tablet 4b9d9d4b65964fd49d8e25092a14d774 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4b9d9d4b65964fd49d8e25092a14d774 already in progress: creating tablet
I20250830 07:54:46.111864 13468 tablet_service.cc:1515] Processing DeleteTablet for tablet 4b9d9d4b65964fd49d8e25092a14d774 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:46 UTC) from {username='slave'} at 127.0.0.1:37956
I20250830 07:54:46.111902 13232 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet 846338e46b834ae0b5f4e74c7f1325d2
I20250830 07:54:46.113062 13749 tablet_service.cc:1515] Processing DeleteTablet for tablet 846338e46b834ae0b5f4e74c7f1325d2 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:46 UTC) from {username='slave'} at 127.0.0.1:45460
W20250830 07:54:46.113358 13218 catalog_manager.cc:4908] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): delete failed for tablet 4b9d9d4b65964fd49d8e25092a14d774 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4b9d9d4b65964fd49d8e25092a14d774 already in progress: creating tablet
I20250830 07:54:46.113451 13468 tablet_service.cc:1515] Processing DeleteTablet for tablet 846338e46b834ae0b5f4e74c7f1325d2 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:46 UTC) from {username='slave'} at 127.0.0.1:37956
W20250830 07:54:46.113624 13219 catalog_manager.cc:4908] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): delete failed for tablet 846338e46b834ae0b5f4e74c7f1325d2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 846338e46b834ae0b5f4e74c7f1325d2 already in progress: creating tablet
I20250830 07:54:46.110836 13481 raft_consensus.cc:2466] T 73853894da074ecd8147a94ac28bfab8 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 1.
W20250830 07:54:46.114404 13218 catalog_manager.cc:4908] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): delete failed for tablet 846338e46b834ae0b5f4e74c7f1325d2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 846338e46b834ae0b5f4e74c7f1325d2 already in progress: creating tablet
I20250830 07:54:46.114506 13701 leader_election.cc:304] T 73853894da074ecd8147a94ac28bfab8 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters:
I20250830 07:54:46.114751 14818 raft_consensus.cc:2802] T 73853894da074ecd8147a94ac28bfab8 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election won for term 1
I20250830 07:54:46.115033 14818 raft_consensus.cc:695] T 73853894da074ecd8147a94ac28bfab8 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 LEADER]: Becoming Leader. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Running, Role: LEADER
I20250830 07:54:46.116010 14818 consensus_queue.cc:237] T 73853894da074ecd8147a94ac28bfab8 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:46.127161 13886 tablet_bootstrap.cc:492] T f56cab43580a4ee3a912fc5e58a3bd9d P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:54:46.127542 13231 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_0f02ca27d84745debe858483af7ccea7" } modify_external_catalogs: true
I20250830 07:54:46.127735 13231 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_0f02ca27d84745debe858483af7ccea7" } modify_external_catalogs: true
I20250830 07:54:46.131981 13886 ts_tablet_manager.cc:1397] T f56cab43580a4ee3a912fc5e58a3bd9d P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.038s user 0.005s sys 0.003s
I20250830 07:54:46.132855 13886 raft_consensus.cc:357] T f56cab43580a4ee3a912fc5e58a3bd9d P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:46.133994 13886 raft_consensus.cc:383] T f56cab43580a4ee3a912fc5e58a3bd9d P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:46.134225 13886 raft_consensus.cc:738] T f56cab43580a4ee3a912fc5e58a3bd9d P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:54:46.134608 13886 consensus_queue.cc:260] T f56cab43580a4ee3a912fc5e58a3bd9d P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:46.135502 13886 ts_tablet_manager.cc:1428] T f56cab43580a4ee3a912fc5e58a3bd9d P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.003s user 0.000s sys 0.001s
I20250830 07:54:46.136827 13886 tablet_bootstrap.cc:492] T 04eadf45b82e4c319eb7b316a402d81a P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:54:46.137332 13231 catalog_manager.cc:5864] Not sending DeleteTablet requests; no consensus state for tablet b8b07251f2764b64992045fe61704569
I20250830 07:54:46.139642 13886 tablet_bootstrap.cc:654] T 04eadf45b82e4c319eb7b316a402d81a P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:46.141507 13617 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f0144701d459480d96c1ece519951442" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:46.142352 13882 tablet_bootstrap.cc:654] T d3f207cee78a43a1b5e030c09752c78c P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:46.143299 14644 raft_consensus.cc:491] T 6a82ea7078e344a497c34f932e139bcd P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:46.143455 14644 raft_consensus.cc:513] T 6a82ea7078e344a497c34f932e139bcd P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:46.144170 14644 leader_election.cc:290] T 6a82ea7078e344a497c34f932e139bcd P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:46.144613 13770 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "6a82ea7078e344a497c34f932e139bcd" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
W20250830 07:54:46.145023 13422 leader_election.cc:343] T 6a82ea7078e344a497c34f932e139bcd P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:46.151057 14818 raft_consensus.cc:491] T e6491d149c0646848680cfdadb6fc76c P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:46.151325 14818 raft_consensus.cc:513] T e6491d149c0646848680cfdadb6fc76c P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:54:46.152339 14818 leader_election.cc:290] T e6491d149c0646848680cfdadb6fc76c P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
I20250830 07:54:46.152706 13481 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "e6491d149c0646848680cfdadb6fc76c" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:54:46.152913 13481 raft_consensus.cc:2466] T e6491d149c0646848680cfdadb6fc76c P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 0.
W20250830 07:54:46.153389 13231 catalog_manager.cc:5415] Ignoring report from unknown tablet f0144701d459480d96c1ece519951442
I20250830 07:54:46.153407 13701 leader_election.cc:304] T e6491d149c0646848680cfdadb6fc76c P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters:
I20250830 07:54:46.153630 14818 raft_consensus.cc:2802] T e6491d149c0646848680cfdadb6fc76c P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election won for term 1
W20250830 07:54:46.153699 13231 catalog_manager.cc:5415] Ignoring report from unknown tablet 2b4ce50fbd26484faba3faa2ec5115c0
W20250830 07:54:46.153803 13231 catalog_manager.cc:5415] Ignoring report from unknown tablet cf5613278b4c4f3bbe751b1ae6f3c313
W20250830 07:54:46.153964 13231 catalog_manager.cc:5415] Ignoring report from unknown tablet 6a82ea7078e344a497c34f932e139bcd
W20250830 07:54:46.154168 13231 catalog_manager.cc:5415] Ignoring report from unknown tablet 30c2558c28944ff39d1a4a4ca9ac604e
W20250830 07:54:46.154309 13231 catalog_manager.cc:5415] Ignoring report from unknown tablet 05da843c0fe4482a926e410e06b22461
I20250830 07:54:46.154286 14818 raft_consensus.cc:491] T e6491d149c0646848680cfdadb6fc76c P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20250830 07:54:46.154392 13231 catalog_manager.cc:5415] Ignoring report from unknown tablet cb3c48982add45379c0e1b117ec40c1a
I20250830 07:54:46.154435 14818 raft_consensus.cc:3058] T e6491d149c0646848680cfdadb6fc76c P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
W20250830 07:54:46.154506 13231 catalog_manager.cc:5415] Ignoring report from unknown tablet e6491d149c0646848680cfdadb6fc76c
W20250830 07:54:46.154598 13231 catalog_manager.cc:5415] Ignoring report from unknown tablet e862fa77e16945bd94e405aa3474f021
W20250830 07:54:46.154706 13231 catalog_manager.cc:5415] Ignoring report from unknown tablet e4f1ff6026bb45e28e63c27c83399d72
W20250830 07:54:46.154790 13231 catalog_manager.cc:5415] Ignoring report from unknown tablet b4ab964a64a64e00a78ffd2b220aef46
W20250830 07:54:46.154930 13231 catalog_manager.cc:5415] Ignoring report from unknown tablet 007435e198b9440db055711a98e3148a
W20250830 07:54:46.155041 13231 catalog_manager.cc:5415] Ignoring report from unknown tablet 04eadf45b82e4c319eb7b316a402d81a
W20250830 07:54:46.155165 13231 catalog_manager.cc:5415] Ignoring report from unknown tablet 6dda55ec2da34c8aba9f39a63e144a7c
W20250830 07:54:46.155277 13231 catalog_manager.cc:5415] Ignoring report from unknown tablet 533811110191436d96665b3475ab597f
W20250830 07:54:46.155385 13231 catalog_manager.cc:5415] Ignoring report from unknown tablet b38c8d003413428dae9e47f58e197c2c
W20250830 07:54:46.155478 13231 catalog_manager.cc:5415] Ignoring report from unknown tablet d33a5d107c6849aca6eb48ffdf8a5463
W20250830 07:54:46.155583 13231 catalog_manager.cc:5415] Ignoring report from unknown tablet 752727eef0734ff3b7b35b1d5f66aea6
W20250830 07:54:46.155694 13231 catalog_manager.cc:5415] Ignoring report from unknown tablet ef16b9e2d444489699f4db1ac26d5f6c
W20250830 07:54:46.155805 13231 catalog_manager.cc:5415] Ignoring report from unknown tablet c0147310dad84226808332a4c2c6e09d
W20250830 07:54:46.155989 13231 catalog_manager.cc:5415] Ignoring report from unknown tablet e66e56ecdf14466282daab8c894eb3c6
W20250830 07:54:46.156114 13231 catalog_manager.cc:5415] Ignoring report from unknown tablet ec4a3975961d4f85ad9da94835417574
W20250830 07:54:46.156219 13231 catalog_manager.cc:5415] Ignoring report from unknown tablet e255d3fdee09400ead41ca835d6d103f
W20250830 07:54:46.156351 13231 catalog_manager.cc:5415] Ignoring report from unknown tablet 66d59910b4b2451a851e9d2728d50f42
W20250830 07:54:46.156491 13231 catalog_manager.cc:5415] Ignoring report from unknown tablet acca1a8240454b889c63c82d3c75087e
W20250830 07:54:46.156659 13231 catalog_manager.cc:5415] Ignoring report from unknown tablet 4c4a8eea119044b49e2b29f10a703097
W20250830 07:54:46.156754 13231 catalog_manager.cc:5415] Ignoring report from unknown tablet 0507245aa8c74aeb9f3eafba0682590d
W20250830 07:54:46.156860 13231 catalog_manager.cc:5415] Ignoring report from unknown tablet a41c1455404f4ed0a782a0c4ddd4140d
W20250830 07:54:46.156939 13231 catalog_manager.cc:5415] Ignoring report from unknown tablet 44313f1a11b74e6d996cafd3c03d1836
I20250830 07:54:46.158334 13231 catalog_manager.cc:5582] T 99f307a8cbb34addaafab82b3ed18241 P 2065c332f15a4739899af79f3669c3ba reported cstate change: term changed from 0 to 1, leader changed from <none> to 2065c332f15a4739899af79f3669c3ba (127.12.209.1). New cstate: current_term: 1 leader_uuid: "2065c332f15a4739899af79f3669c3ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } health_report { overall_health: UNKNOWN } } }
I20250830 07:54:46.158787 13231 catalog_manager.cc:5674] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325) does not have the latest schema for tablet 99f307a8cbb34addaafab82b3ed18241 (table default.Table_4e2c5e0840fe4d3398519818e193f4dd [id=2a10f84461764fd5ab5a59499a370034]). Expected version 1 got 0
I20250830 07:54:46.159262 14818 raft_consensus.cc:513] T e6491d149c0646848680cfdadb6fc76c P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:54:46.159317 13231 catalog_manager.cc:5582] T 69d6daeb7c774fd48ed296f52ed7c6a6 P 2065c332f15a4739899af79f3669c3ba reported cstate change: term changed from 0 to 1, leader changed from <none> to 2065c332f15a4739899af79f3669c3ba (127.12.209.1). New cstate: current_term: 1 leader_uuid: "2065c332f15a4739899af79f3669c3ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } health_report { overall_health: UNKNOWN } } }
I20250830 07:54:46.159698 13231 catalog_manager.cc:5674] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325) does not have the latest schema for tablet 69d6daeb7c774fd48ed296f52ed7c6a6 (table default.Table_c8fac6974ea94c7e863c1ded184f9230 [id=761247d93d9f4f788ecceabebf1de486]). Expected version 3 got 0
I20250830 07:54:46.160012 13231 catalog_manager.cc:5674] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325) does not have the latest schema for tablet 29f0695563854e45965a1cc36ac54138 (table default.Table_e40b329adbd0475da2669620084f75f3 [id=7d0a5ef4aaf64241be34eba188f2cbcd]). Expected version 2 got 0
I20250830 07:54:46.160269 14818 leader_election.cc:290] T e6491d149c0646848680cfdadb6fc76c P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Requested vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
I20250830 07:54:46.160351 13231 catalog_manager.cc:5674] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325) does not have the latest schema for tablet 14ed24577c8f49f49c83242a26877614 (table default.Table_4428c29c8358411282f00fd33a6badd4 [id=bcee72f9b1c6407f98435a1494b42407]). Expected version 1 got 0
I20250830 07:54:46.160863 13481 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "e6491d149c0646848680cfdadb6fc76c" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba"
I20250830 07:54:46.161056 13481 raft_consensus.cc:3058] T e6491d149c0646848680cfdadb6fc76c P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:46.164224 13481 raft_consensus.cc:2466] T e6491d149c0646848680cfdadb6fc76c P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 1.
I20250830 07:54:46.164592 13701 leader_election.cc:304] T e6491d149c0646848680cfdadb6fc76c P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters:
I20250830 07:54:46.164847 14819 raft_consensus.cc:491] T 50360492db824755a6de251436cab5c6 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:46.164952 13887 tablet_bootstrap.cc:492] T 4828280e6fec4338b35422917966ac8c P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:54:46.165004 14819 raft_consensus.cc:513] T 50360492db824755a6de251436cab5c6 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:46.165117 13887 ts_tablet_manager.cc:1397] T 4828280e6fec4338b35422917966ac8c P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.129s user 0.024s sys 0.020s
I20250830 07:54:46.165576 14819 leader_election.cc:290] T 50360492db824755a6de251436cab5c6 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
I20250830 07:54:46.165738 14819 raft_consensus.cc:2802] T e6491d149c0646848680cfdadb6fc76c P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election won for term 1
I20250830 07:54:46.165849 14819 raft_consensus.cc:695] T e6491d149c0646848680cfdadb6fc76c P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 LEADER]: Becoming Leader. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Running, Role: LEADER
I20250830 07:54:46.165824 13887 raft_consensus.cc:357] T 4828280e6fec4338b35422917966ac8c P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:46.165964 13886 tablet_bootstrap.cc:492] T 04eadf45b82e4c319eb7b316a402d81a P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:54:46.166028 13887 raft_consensus.cc:383] T 4828280e6fec4338b35422917966ac8c P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:46.166091 13886 ts_tablet_manager.cc:1397] T 04eadf45b82e4c319eb7b316a402d81a P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.030s user 0.003s sys 0.000s
I20250830 07:54:46.166103 13887 raft_consensus.cc:738] T 4828280e6fec4338b35422917966ac8c P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:54:46.166147 14819 consensus_queue.cc:237] T e6491d149c0646848680cfdadb6fc76c P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:54:46.166352 13887 consensus_queue.cc:260] T 4828280e6fec4338b35422917966ac8c P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:46.166934 13887 ts_tablet_manager.cc:1428] T 4828280e6fec4338b35422917966ac8c P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20250830 07:54:46.167238 13887 tablet_bootstrap.cc:492] T 856e644662334f8194ffef6ca1232248 P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:54:46.170032 13887 tablet_bootstrap.cc:654] T 856e644662334f8194ffef6ca1232248 P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:46.174228 13886 raft_consensus.cc:357] T 04eadf45b82e4c319eb7b316a402d81a P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:46.174435 13886 raft_consensus.cc:383] T 04eadf45b82e4c319eb7b316a402d81a P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20250830 07:54:46.174979 13701 leader_election.cc:343] T 50360492db824755a6de251436cab5c6 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): Not found: Tablet not found: 50360492db824755a6de251436cab5c6
I20250830 07:54:46.183192 14745 webserver.cc:480] Webserver started at http://127.12.209.60:32915/ using document root <none> and password file <none>
I20250830 07:54:46.183624 13887 tablet_bootstrap.cc:492] T 856e644662334f8194ffef6ca1232248 P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:54:46.183753 13887 ts_tablet_manager.cc:1397] T 856e644662334f8194ffef6ca1232248 P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.017s user 0.000s sys 0.006s
I20250830 07:54:46.184643 13887 raft_consensus.cc:357] T 856e644662334f8194ffef6ca1232248 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:46.184804 13887 raft_consensus.cc:383] T 856e644662334f8194ffef6ca1232248 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:46.184897 13887 raft_consensus.cc:738] T 856e644662334f8194ffef6ca1232248 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:54:46.185134 13887 consensus_queue.cc:260] T 856e644662334f8194ffef6ca1232248 P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:46.185703 13887 ts_tablet_manager.cc:1428] T 856e644662334f8194ffef6ca1232248 P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20250830 07:54:46.185976 13887 tablet_bootstrap.cc:492] T 8eb010d7955d47a89ff1d01be1b5b01e P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:54:46.187834 13887 tablet_bootstrap.cc:654] T 8eb010d7955d47a89ff1d01be1b5b01e P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:46.188598 13232 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_4f298420002a4cc9b05f343a524ae6d1" } modify_external_catalogs: true
I20250830 07:54:46.188803 13232 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_4f298420002a4cc9b05f343a524ae6d1" } modify_external_catalogs: true
I20250830 07:54:46.193961 14745 fs_manager.cc:362] Metadata directory not provided
I20250830 07:54:46.194887 13234 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_130992e56c244ef48918ebf28377d703"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250830 07:54:46.195322 13228 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_f39d53dc9a38494daede2d9d2fef10e4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:46.195453 13234 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_130992e56c244ef48918ebf28377d703 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250830 07:54:46.195740 13228 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f39d53dc9a38494daede2d9d2fef10e4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:46.197463 13232 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet 8eb010d7955d47a89ff1d01be1b5b01e
I20250830 07:54:46.198717 13749 tablet_service.cc:1515] Processing DeleteTablet for tablet 8eb010d7955d47a89ff1d01be1b5b01e with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:46 UTC) from {username='slave'} at 127.0.0.1:45460
W20250830 07:54:46.200654 13219 catalog_manager.cc:4908] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): delete failed for tablet 8eb010d7955d47a89ff1d01be1b5b01e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8eb010d7955d47a89ff1d01be1b5b01e already in progress: creating tablet
I20250830 07:54:46.202239 13887 tablet_bootstrap.cc:492] T 8eb010d7955d47a89ff1d01be1b5b01e P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:54:46.202399 13887 ts_tablet_manager.cc:1397] T 8eb010d7955d47a89ff1d01be1b5b01e P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.016s user 0.000s sys 0.005s
I20250830 07:54:46.202672 13749 tablet_service.cc:1515] Processing DeleteTablet for tablet 53a933afa4b74095baf0f54736d99bf0 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:42 UTC) from {username='slave'} at 127.0.0.1:45460
I20250830 07:54:46.203006 14761 tablet_replica.cc:331] T 53a933afa4b74095baf0f54736d99bf0 P 9b057ade5dce45af9f8bf0bedf8b917f: stopping tablet replica
I20250830 07:54:46.203199 14761 raft_consensus.cc:2241] T 53a933afa4b74095baf0f54736d99bf0 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Raft consensus shutting down.
I20250830 07:54:46.203178 13887 raft_consensus.cc:357] T 8eb010d7955d47a89ff1d01be1b5b01e P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:46.203358 13887 raft_consensus.cc:383] T 8eb010d7955d47a89ff1d01be1b5b01e P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:46.203366 14761 raft_consensus.cc:2270] T 53a933afa4b74095baf0f54736d99bf0 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Raft consensus is shut down!
I20250830 07:54:46.203430 13887 raft_consensus.cc:738] T 8eb010d7955d47a89ff1d01be1b5b01e P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:54:46.203629 13887 consensus_queue.cc:260] T 8eb010d7955d47a89ff1d01be1b5b01e P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:46.203876 14761 ts_tablet_manager.cc:1905] T 53a933afa4b74095baf0f54736d99bf0 P 9b057ade5dce45af9f8bf0bedf8b917f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250830 07:54:46.204152 13887 ts_tablet_manager.cc:1428] T 8eb010d7955d47a89ff1d01be1b5b01e P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20250830 07:54:46.204422 13887 tablet_bootstrap.cc:492] T e4ca3110247640fbae4241448e8d5ef7 P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:54:46.206068 13887 tablet_bootstrap.cc:654] T e4ca3110247640fbae4241448e8d5ef7 P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:46.207326 13230 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_390f65cc8d874afe83a062923fd229f9" } new_table_name: "default.Table_b53032ff88434d2f9a1fbf5a6fdc546f" modify_external_catalogs: true
W20250830 07:54:46.208922 13229 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.12.209.1:41421 (request call id 100) took 1070 ms (client timeout 1000 ms). Trace:
W20250830 07:54:46.209035 13229 rpcz_store.cc:269] 0830 07:54:45.138278 (+ 0us) service_pool.cc:168] Inserting onto call queue
0830 07:54:45.145217 (+ 6939us) service_pool.cc:225] Handling call
0830 07:54:45.300780 (+155563us) spinlock_profiling.cc:243] Waited 154 ms on lock 0x616000040f54. stack: 00007f4985b867d6 00007f4985b86590 00007f4984b793ad 0000000000972d94 0000000000972d5d 00007f499495114d 00007f4994951243 00007f4991610941 00007f499919ba5d 00007f499931f6d8 00007f4990159c86 00007f49901599b5 00007f498c9342ce 00007f498c9331ae 00007f498c9393e5 00007f498c939d0f
0830 07:54:46.208891 (+908111us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":9625,"reported_tablets":13,"spinlock_wait_cycles":354155776}
W20250830 07:54:46.211777 13226 catalog_manager.cc:5415] Ignoring report from unknown tablet cf5613278b4c4f3bbe751b1ae6f3c313
W20250830 07:54:46.211884 13226 catalog_manager.cc:5415] Ignoring report from unknown tablet 1fa571e9490e499792225d7b786e8658
W20250830 07:54:46.211923 13226 catalog_manager.cc:5415] Ignoring report from unknown tablet 752727eef0734ff3b7b35b1d5f66aea6
I20250830 07:54:46.174516 13886 raft_consensus.cc:738] T 04eadf45b82e4c319eb7b316a402d81a P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
W20250830 07:54:46.211969 13226 catalog_manager.cc:5415] Ignoring report from unknown tablet 6dda55ec2da34c8aba9f39a63e144a7c
W20250830 07:54:46.212013 13226 catalog_manager.cc:5415] Ignoring report from unknown tablet e6491d149c0646848680cfdadb6fc76c
W20250830 07:54:46.212107 13226 catalog_manager.cc:5415] Ignoring report from unknown tablet 73853894da074ecd8147a94ac28bfab8
W20250830 07:54:46.212198 13226 catalog_manager.cc:5415] Ignoring report from unknown tablet f398e12cd9f543738d5163354f8a9d9d
I20250830 07:54:46.212162 13886 consensus_queue.cc:260] T 04eadf45b82e4c319eb7b316a402d81a P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:46.212756 13886 ts_tablet_manager.cc:1428] T 04eadf45b82e4c319eb7b316a402d81a P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.047s user 0.001s sys 0.001s
I20250830 07:54:46.213012 13886 tablet_bootstrap.cc:492] T 8f215330505848619ad44569d3167591 P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:54:46.213429 13226 catalog_manager.cc:5674] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743) does not have the latest schema for tablet 69d6daeb7c774fd48ed296f52ed7c6a6 (table default.Table_c8fac6974ea94c7e863c1ded184f9230 [id=761247d93d9f4f788ecceabebf1de486]). Expected version 3 got 0
I20250830 07:54:46.213747 13226 catalog_manager.cc:5674] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743) does not have the latest schema for tablet f56cab43580a4ee3a912fc5e58a3bd9d (table default.Table_a2e96e9e547e4a07a6ccd9839e3d909c [id=6fc5c53b47c24f8283191be07f6f3cb1]). Expected version 1 got 0
I20250830 07:54:46.215755 13887 tablet_bootstrap.cc:492] T e4ca3110247640fbae4241448e8d5ef7 P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:54:46.215889 13887 ts_tablet_manager.cc:1397] T e4ca3110247640fbae4241448e8d5ef7 P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.012s user 0.000s sys 0.003s
I20250830 07:54:46.216540 13468 tablet_service.cc:1515] Processing DeleteTablet for tablet 8eb010d7955d47a89ff1d01be1b5b01e with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:46 UTC) from {username='slave'} at 127.0.0.1:37956
I20250830 07:54:46.216727 13458 tablet_service.cc:1515] Processing DeleteTablet for tablet 53a933afa4b74095baf0f54736d99bf0 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:42 UTC) from {username='slave'} at 127.0.0.1:37956
I20250830 07:54:46.216928 14841 tablet_replica.cc:331] T 8eb010d7955d47a89ff1d01be1b5b01e P 2065c332f15a4739899af79f3669c3ba: stopping tablet replica
I20250830 07:54:46.217115 14841 raft_consensus.cc:2241] T 8eb010d7955d47a89ff1d01be1b5b01e P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Raft consensus shutting down.
I20250830 07:54:46.217260 14841 raft_consensus.cc:2270] T 8eb010d7955d47a89ff1d01be1b5b01e P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Raft consensus is shut down!
I20250830 07:54:46.217870 14841 ts_tablet_manager.cc:1905] T 8eb010d7955d47a89ff1d01be1b5b01e P 2065c332f15a4739899af79f3669c3ba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250830 07:54:46.220890 13886 tablet_bootstrap.cc:654] T 8f215330505848619ad44569d3167591 P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:46.223634 14841 ts_tablet_manager.cc:1918] T 8eb010d7955d47a89ff1d01be1b5b01e P 2065c332f15a4739899af79f3669c3ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250830 07:54:46.223788 14841 log.cc:1199] T 8eb010d7955d47a89ff1d01be1b5b01e P 2065c332f15a4739899af79f3669c3ba: Deleting WAL directory at /tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/ts-0/wal/wals/8eb010d7955d47a89ff1d01be1b5b01e
I20250830 07:54:46.224236 14841 ts_tablet_manager.cc:1939] T 8eb010d7955d47a89ff1d01be1b5b01e P 2065c332f15a4739899af79f3669c3ba: Deleting consensus metadata
W20250830 07:54:46.225322 13226 catalog_manager.cc:5415] Ignoring report from unknown tablet 04eadf45b82e4c319eb7b316a402d81a
I20250830 07:54:46.225502 13887 raft_consensus.cc:357] T e4ca3110247640fbae4241448e8d5ef7 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:46.225669 13887 raft_consensus.cc:383] T e4ca3110247640fbae4241448e8d5ef7 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:46.225770 13887 raft_consensus.cc:738] T e4ca3110247640fbae4241448e8d5ef7 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:54:46.225993 13887 consensus_queue.cc:260] T e4ca3110247640fbae4241448e8d5ef7 P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:46.226305 13218 catalog_manager.cc:4928] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): tablet 8eb010d7955d47a89ff1d01be1b5b01e (table default.Table_4f298420002a4cc9b05f343a524ae6d1 [id=10cdb0b0b3ca416b8e7164aa1a37c8c9]) successfully deleted
I20250830 07:54:46.226610 14841 tablet_replica.cc:331] T 53a933afa4b74095baf0f54736d99bf0 P 2065c332f15a4739899af79f3669c3ba: stopping tablet replica
I20250830 07:54:46.226807 14841 raft_consensus.cc:2241] T 53a933afa4b74095baf0f54736d99bf0 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Raft consensus shutting down.
I20250830 07:54:46.227005 14841 raft_consensus.cc:2270] T 53a933afa4b74095baf0f54736d99bf0 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20250830 07:54:46.227430 14841 ts_tablet_manager.cc:1905] T 53a933afa4b74095baf0f54736d99bf0 P 2065c332f15a4739899af79f3669c3ba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250830 07:54:46.228112 14761 ts_tablet_manager.cc:1918] T 53a933afa4b74095baf0f54736d99bf0 P 9b057ade5dce45af9f8bf0bedf8b917f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250830 07:54:46.228268 14761 log.cc:1199] T 53a933afa4b74095baf0f54736d99bf0 P 9b057ade5dce45af9f8bf0bedf8b917f: Deleting WAL directory at /tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/ts-2/wal/wals/53a933afa4b74095baf0f54736d99bf0
I20250830 07:54:46.229002 14761 ts_tablet_manager.cc:1939] T 53a933afa4b74095baf0f54736d99bf0 P 9b057ade5dce45af9f8bf0bedf8b917f: Deleting consensus metadata
I20250830 07:54:46.229985 13219 catalog_manager.cc:4928] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): tablet 53a933afa4b74095baf0f54736d99bf0 (table default.Table_d601d7d0f55744e5b227aa7b31516c20 [id=e9e95cc7dbe94eadae3a118c44143363]) successfully deleted
I20250830 07:54:46.231328 13887 ts_tablet_manager.cc:1428] T e4ca3110247640fbae4241448e8d5ef7 P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.015s user 0.000s sys 0.002s
I20250830 07:54:46.231647 13887 tablet_bootstrap.cc:492] T 01771fa171374e92892345e7402c33d1 P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:54:46.233357 13887 tablet_bootstrap.cc:654] T 01771fa171374e92892345e7402c33d1 P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
W20250830 07:54:46.235558 13226 catalog_manager.cc:5415] Ignoring report from unknown tablet ff0f9cccc8ed43b1a8cd38de0e9d4097
I20250830 07:54:46.236436 14841 ts_tablet_manager.cc:1918] T 53a933afa4b74095baf0f54736d99bf0 P 2065c332f15a4739899af79f3669c3ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250830 07:54:46.236567 14841 log.cc:1199] T 53a933afa4b74095baf0f54736d99bf0 P 2065c332f15a4739899af79f3669c3ba: Deleting WAL directory at /tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/ts-0/wal/wals/53a933afa4b74095baf0f54736d99bf0
I20250830 07:54:46.236913 14841 ts_tablet_manager.cc:1939] T 53a933afa4b74095baf0f54736d99bf0 P 2065c332f15a4739899af79f3669c3ba: Deleting consensus metadata
I20250830 07:54:46.237668 13886 tablet_bootstrap.cc:492] T 8f215330505848619ad44569d3167591 P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:54:46.237821 13886 ts_tablet_manager.cc:1397] T 8f215330505848619ad44569d3167591 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.025s user 0.001s sys 0.002s
I20250830 07:54:46.237905 13218 catalog_manager.cc:4928] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): tablet 53a933afa4b74095baf0f54736d99bf0 (table default.Table_d601d7d0f55744e5b227aa7b31516c20 [id=e9e95cc7dbe94eadae3a118c44143363]) successfully deleted
I20250830 07:54:46.240595 13613 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "6a82ea7078e344a497c34f932e139bcd" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:46.240919 13611 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "a41c1455404f4ed0a782a0c4ddd4140d" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:46.242147 14745 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20250830 07:54:46.239427 13886 raft_consensus.cc:357] T 8f215330505848619ad44569d3167591 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:46.244371 13886 raft_consensus.cc:383] T 8f215330505848619ad44569d3167591 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:46.244490 13886 raft_consensus.cc:738] T 8f215330505848619ad44569d3167591 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:54:46.245644 13887 tablet_bootstrap.cc:492] T 01771fa171374e92892345e7402c33d1 P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:54:46.246018 13887 ts_tablet_manager.cc:1397] T 01771fa171374e92892345e7402c33d1 P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.014s user 0.002s sys 0.002s
I20250830 07:54:46.246596 13887 raft_consensus.cc:357] T 01771fa171374e92892345e7402c33d1 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:46.246750 13887 raft_consensus.cc:383] T 01771fa171374e92892345e7402c33d1 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:46.246807 13887 raft_consensus.cc:738] T 01771fa171374e92892345e7402c33d1 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:54:46.246784 13234 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_3af4480a9af740f598919322e7fc5efc" } new_table_name: "default.Table_96df3a05fc564aba9ae2d0e0f1e94abb" modify_external_catalogs: true
I20250830 07:54:46.246812 13886 consensus_queue.cc:260] T 8f215330505848619ad44569d3167591 P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:46.247077 13887 consensus_queue.cc:260] T 01771fa171374e92892345e7402c33d1 P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:46.247522 13887 ts_tablet_manager.cc:1428] T 01771fa171374e92892345e7402c33d1 P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20250830 07:54:46.247756 13887 tablet_bootstrap.cc:492] T d6afa1ad4791429ba96ee81583dcee64 P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:54:46.248121 13886 ts_tablet_manager.cc:1428] T 8f215330505848619ad44569d3167591 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.010s user 0.002s sys 0.001s
I20250830 07:54:46.248358 13886 tablet_bootstrap.cc:492] T 533811110191436d96665b3475ab597f P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:54:46.249145 13887 tablet_bootstrap.cc:654] T d6afa1ad4791429ba96ee81583dcee64 P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:46.257462 13887 tablet_bootstrap.cc:492] T d6afa1ad4791429ba96ee81583dcee64 P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:54:46.257612 13887 ts_tablet_manager.cc:1397] T d6afa1ad4791429ba96ee81583dcee64 P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.010s user 0.001s sys 0.001s
I20250830 07:54:46.258351 13229 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_b0514d974e9d4da1b8599e38ea5657cb" } modify_external_catalogs: true
I20250830 07:54:46.258550 13229 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_b0514d974e9d4da1b8599e38ea5657cb" } modify_external_catalogs: true
I20250830 07:54:46.258625 13887 raft_consensus.cc:357] T d6afa1ad4791429ba96ee81583dcee64 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:46.258834 13887 raft_consensus.cc:383] T d6afa1ad4791429ba96ee81583dcee64 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:46.258962 13887 raft_consensus.cc:738] T d6afa1ad4791429ba96ee81583dcee64 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:54:46.259310 13887 consensus_queue.cc:260] T d6afa1ad4791429ba96ee81583dcee64 P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:46.259778 13887 ts_tablet_manager.cc:1428] T d6afa1ad4791429ba96ee81583dcee64 P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20250830 07:54:46.260277 13886 tablet_bootstrap.cc:654] T 533811110191436d96665b3475ab597f P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:46.262185 13887 tablet_bootstrap.cc:492] T e6b7646588fe4134b2db62ff84ca4791 P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:54:46.264016 13887 tablet_bootstrap.cc:654] T e6b7646588fe4134b2db62ff84ca4791 P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
W20250830 07:54:46.264572 13561 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.209.1:45325, user_credentials={real_user=slave}} blocked reactor thread for 221177us
I20250830 07:54:46.269559 13232 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_c7c5891f1b4b4240ac4fe5bec6316c3c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:46.270206 13232 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c7c5891f1b4b4240ac4fe5bec6316c3c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:46.270605 13225 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_949a40db3db44c7a816e2e49ea5ee5e0" } new_table_name: "default.Table_800922101ede43af952ed138bc5b9e1e" modify_external_catalogs: true
I20250830 07:54:46.272629 13233 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_b78c0409c93441d0a67de3b13dbb4140"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250830 07:54:46.272686 13227 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_bad0d43a8b93475c9b78800b232ecd75"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:46.273065 13233 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b78c0409c93441d0a67de3b13dbb4140 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250830 07:54:46.273142 13227 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bad0d43a8b93475c9b78800b232ecd75 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:46.288472 14644 raft_consensus.cc:491] T ec4a3975961d4f85ad9da94835417574 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:46.288617 14869 consensus_queue.cc:1035] T 99f307a8cbb34addaafab82b3ed18241 P 2065c332f15a4739899af79f3669c3ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:54:46.288648 14644 raft_consensus.cc:513] T ec4a3975961d4f85ad9da94835417574 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:46.289381 14644 leader_election.cc:290] T ec4a3975961d4f85ad9da94835417574 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:46.290802 14644 raft_consensus.cc:491] T acca1a8240454b889c63c82d3c75087e P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:46.290984 14644 raft_consensus.cc:513] T acca1a8240454b889c63c82d3c75087e P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:46.291673 14644 leader_election.cc:290] T acca1a8240454b889c63c82d3c75087e P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:46.298300 13768 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "ec4a3975961d4f85ad9da94835417574" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:46.298393 14644 raft_consensus.cc:491] T 66d59910b4b2451a851e9d2728d50f42 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:46.298413 13769 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "acca1a8240454b889c63c82d3c75087e" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:46.298523 14644 raft_consensus.cc:513] T 66d59910b4b2451a851e9d2728d50f42 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
W20250830 07:54:46.298977 13422 leader_election.cc:343] T ec4a3975961d4f85ad9da94835417574 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:46.299193 14644 leader_election.cc:290] T 66d59910b4b2451a851e9d2728d50f42 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
W20250830 07:54:46.299263 13422 leader_election.cc:343] T acca1a8240454b889c63c82d3c75087e P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:46.299746 13769 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "66d59910b4b2451a851e9d2728d50f42" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
W20250830 07:54:46.301196 13422 leader_election.cc:343] T 66d59910b4b2451a851e9d2728d50f42 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:46.309549 13882 tablet_bootstrap.cc:492] T d3f207cee78a43a1b5e030c09752c78c P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:54:46.309722 13882 ts_tablet_manager.cc:1397] T d3f207cee78a43a1b5e030c09752c78c P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.220s user 0.011s sys 0.000s
I20250830 07:54:46.311012 13882 raft_consensus.cc:357] T d3f207cee78a43a1b5e030c09752c78c P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:46.311165 13882 raft_consensus.cc:383] T d3f207cee78a43a1b5e030c09752c78c P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:46.311208 13882 raft_consensus.cc:738] T d3f207cee78a43a1b5e030c09752c78c P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:54:46.311352 13882 consensus_queue.cc:260] T d3f207cee78a43a1b5e030c09752c78c P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:46.311714 13882 ts_tablet_manager.cc:1428] T d3f207cee78a43a1b5e030c09752c78c P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20250830 07:54:46.311942 13882 tablet_bootstrap.cc:492] T f0144701d459480d96c1ece519951442 P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:54:46.319556 13228 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_1bea3c4b6c2d4a8280397f4141c185b6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:46.320253 13228 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1bea3c4b6c2d4a8280397f4141c185b6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250830 07:54:46.325425 13226 catalog_manager.cc:5415] Ignoring report from unknown tablet 8f215330505848619ad44569d3167591
I20250830 07:54:46.333118 13458 tablet_service.cc:1515] Processing DeleteTablet for tablet f1fe024f0de048a5a0931ee38752d5a1 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:42 UTC) from {username='slave'} at 127.0.0.1:37956
I20250830 07:54:46.333340 14841 tablet_replica.cc:331] T f1fe024f0de048a5a0931ee38752d5a1 P 2065c332f15a4739899af79f3669c3ba: stopping tablet replica
I20250830 07:54:46.333810 14841 raft_consensus.cc:2241] T f1fe024f0de048a5a0931ee38752d5a1 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Raft consensus shutting down.
I20250830 07:54:46.333956 14841 raft_consensus.cc:2270] T f1fe024f0de048a5a0931ee38752d5a1 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Raft consensus is shut down!
I20250830 07:54:46.334762 14841 ts_tablet_manager.cc:1905] T f1fe024f0de048a5a0931ee38752d5a1 P 2065c332f15a4739899af79f3669c3ba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250830 07:54:46.345520 14841 ts_tablet_manager.cc:1918] T f1fe024f0de048a5a0931ee38752d5a1 P 2065c332f15a4739899af79f3669c3ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250830 07:54:46.345705 14841 log.cc:1199] T f1fe024f0de048a5a0931ee38752d5a1 P 2065c332f15a4739899af79f3669c3ba: Deleting WAL directory at /tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/ts-0/wal/wals/f1fe024f0de048a5a0931ee38752d5a1
I20250830 07:54:46.349776 14818 raft_consensus.cc:491] T cf5613278b4c4f3bbe751b1ae6f3c313 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:46.349944 14818 raft_consensus.cc:513] T cf5613278b4c4f3bbe751b1ae6f3c313 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:46.350775 14818 leader_election.cc:290] T cf5613278b4c4f3bbe751b1ae6f3c313 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
I20250830 07:54:46.351794 13481 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "cf5613278b4c4f3bbe751b1ae6f3c313" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
W20250830 07:54:46.355502 13230 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet b294445c38544232b0ff7e730a9fcdce has no consensus state
I20250830 07:54:46.355690 14841 ts_tablet_manager.cc:1939] T f1fe024f0de048a5a0931ee38752d5a1 P 2065c332f15a4739899af79f3669c3ba: Deleting consensus metadata
W20250830 07:54:46.357268 13234 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 52e910677ae34630a919d1d3f21b7e83 consensus state has no leader
I20250830 07:54:46.359586 13226 master_service.cc:948] ReplaceTablet: received request to replace tablet 02be33dc658d428fa55e59784a2342f6 from {username='slave'} at 127.0.0.1:42126
I20250830 07:54:46.360481 13218 catalog_manager.cc:4928] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): tablet f1fe024f0de048a5a0931ee38752d5a1 (table default.Table_7d9f9b1fda5b4fc183fa2b56c3b6642f [id=2e4e80b5de924f18a54c9f0731e19534]) successfully deleted
I20250830 07:54:46.329450 13231 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_b9955166bf7c43c0a8c0a0f84357b6f7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:46.361383 13231 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b9955166bf7c43c0a8c0a0f84357b6f7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:46.367842 14644 raft_consensus.cc:491] T d6afa1ad4791429ba96ee81583dcee64 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:46.367954 14644 raft_consensus.cc:513] T d6afa1ad4791429ba96ee81583dcee64 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:46.368427 14644 leader_election.cc:290] T d6afa1ad4791429ba96ee81583dcee64 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
W20250830 07:54:46.370517 13230 catalog_manager.cc:5415] Ignoring report from unknown tablet 01771fa171374e92892345e7402c33d1
I20250830 07:54:46.370838 13234 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_6001a3ae122a44c08cb923fe3a5e5a0c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:46.371412 13234 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6001a3ae122a44c08cb923fe3a5e5a0c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250830 07:54:46.371690 13230 catalog_manager.cc:5415] Ignoring report from unknown tablet 4828280e6fec4338b35422917966ac8c
I20250830 07:54:46.372817 14853 raft_consensus.cc:491] T 8dddcfe56522436287aea212e316a729 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:46.372925 14853 raft_consensus.cc:513] T 8dddcfe56522436287aea212e316a729 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:46.373566 14853 leader_election.cc:290] T 8dddcfe56522436287aea212e316a729 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
I20250830 07:54:46.375061 13770 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "d6afa1ad4791429ba96ee81583dcee64" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
W20250830 07:54:46.377362 13422 leader_election.cc:343] T d6afa1ad4791429ba96ee81583dcee64 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:46.377811 13481 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "8dddcfe56522436287aea212e316a729" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:54:46.378564 13229 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet a36f38ada7314165a5e9d6ee7bbf69e3
I20250830 07:54:46.380771 13232 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_a0b8d1d1cefc406db62d3d2882feb096" } new_table_name: "default.Table_93ef94dcadb54242892fcefbec3892a4" modify_external_catalogs: true
I20250830 07:54:46.382544 13229 catalog_manager.cc:5674] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743) does not have the latest schema for tablet 99f307a8cbb34addaafab82b3ed18241 (table default.Table_4e2c5e0840fe4d3398519818e193f4dd [id=2a10f84461764fd5ab5a59499a370034]). Expected version 1 got 0
W20250830 07:54:46.386526 13225 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet becf9667a0fc4507bc114407090c055c has no consensus state
I20250830 07:54:46.387650 13225 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_296357f9b1b946b2858b94eb7266630b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:46.388212 13225 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_296357f9b1b946b2858b94eb7266630b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:46.391341 13749 tablet_service.cc:1515] Processing DeleteTablet for tablet a36f38ada7314165a5e9d6ee7bbf69e3 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:46 UTC) from {username='slave'} at 127.0.0.1:45460
I20250830 07:54:46.391886 13229 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_3cbdf35c754f444abc2be4d675765540" } new_table_name: "default.Table_f3e7b6dfb1fc4dc2be4da90c976b21dd" modify_external_catalogs: true
W20250830 07:54:46.395597 13219 catalog_manager.cc:4908] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): delete failed for tablet a36f38ada7314165a5e9d6ee7bbf69e3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a36f38ada7314165a5e9d6ee7bbf69e3 already in progress: creating tablet
I20250830 07:54:46.396733 13458 tablet_service.cc:1515] Processing DeleteTablet for tablet a36f38ada7314165a5e9d6ee7bbf69e3 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:46 UTC) from {username='slave'} at 127.0.0.1:37956
W20250830 07:54:46.411209 13218 catalog_manager.cc:4908] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): delete failed for tablet a36f38ada7314165a5e9d6ee7bbf69e3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a36f38ada7314165a5e9d6ee7bbf69e3 already in progress: creating tablet
I20250830 07:54:46.461040 14921 raft_consensus.cc:491] T 73853894da074ecd8147a94ac28bfab8 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:46.461226 14921 raft_consensus.cc:513] T 73853894da074ecd8147a94ac28bfab8 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:46.462183 14921 leader_election.cc:290] T 73853894da074ecd8147a94ac28bfab8 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:46.462924 13591 tablet_service.cc:1515] Processing DeleteTablet for tablet 4b9d9d4b65964fd49d8e25092a14d774 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:46 UTC) from {username='slave'} at 127.0.0.1:45306
I20250830 07:54:46.463270 13599 tablet_service.cc:1515] Processing DeleteTablet for tablet 846338e46b834ae0b5f4e74c7f1325d2 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:46 UTC) from {username='slave'} at 127.0.0.1:45306
I20250830 07:54:46.464141 13882 tablet_bootstrap.cc:654] T f0144701d459480d96c1ece519951442 P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
W20250830 07:54:46.465214 13562 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.209.3:38743, user_credentials={real_user=slave}} blocked reactor thread for 270339us
I20250830 07:54:46.466842 13886 tablet_bootstrap.cc:492] T 533811110191436d96665b3475ab597f P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:54:46.467018 13886 ts_tablet_manager.cc:1397] T 533811110191436d96665b3475ab597f P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.219s user 0.037s sys 0.087s
I20250830 07:54:46.467294 14644 raft_consensus.cc:491] T 29f0695563854e45965a1cc36ac54138 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:46.467427 14644 raft_consensus.cc:513] T 29f0695563854e45965a1cc36ac54138 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:46.468088 14644 leader_election.cc:290] T 29f0695563854e45965a1cc36ac54138 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:46.469430 13886 raft_consensus.cc:357] T 533811110191436d96665b3475ab597f P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:46.469645 13886 raft_consensus.cc:383] T 533811110191436d96665b3475ab597f P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:46.469697 13886 raft_consensus.cc:738] T 533811110191436d96665b3475ab597f P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:54:46.469926 13886 consensus_queue.cc:260] T 533811110191436d96665b3475ab597f P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:46.470728 13886 ts_tablet_manager.cc:1428] T 533811110191436d96665b3475ab597f P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20250830 07:54:46.471016 13886 tablet_bootstrap.cc:492] T e66e56ecdf14466282daab8c894eb3c6 P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:54:46.472098 13770 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "29f0695563854e45965a1cc36ac54138" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:46.473331 13886 tablet_bootstrap.cc:654] T e66e56ecdf14466282daab8c894eb3c6 P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
W20250830 07:54:46.477855 13422 leader_election.cc:343] T 29f0695563854e45965a1cc36ac54138 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:46.486474 13886 tablet_bootstrap.cc:492] T e66e56ecdf14466282daab8c894eb3c6 P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:54:46.486618 13886 ts_tablet_manager.cc:1397] T e66e56ecdf14466282daab8c894eb3c6 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.016s user 0.008s sys 0.003s
I20250830 07:54:46.487457 13886 raft_consensus.cc:357] T e66e56ecdf14466282daab8c894eb3c6 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:46.487654 13886 raft_consensus.cc:383] T e66e56ecdf14466282daab8c894eb3c6 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:46.487706 13886 raft_consensus.cc:738] T e66e56ecdf14466282daab8c894eb3c6 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:54:46.487910 13886 consensus_queue.cc:260] T e66e56ecdf14466282daab8c894eb3c6 P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:46.488454 13886 ts_tablet_manager.cc:1428] T e66e56ecdf14466282daab8c894eb3c6 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20250830 07:54:46.488977 13886 tablet_bootstrap.cc:492] T 0507245aa8c74aeb9f3eafba0682590d P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:54:46.491057 13886 tablet_bootstrap.cc:654] T 0507245aa8c74aeb9f3eafba0682590d P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:46.499037 13886 tablet_bootstrap.cc:492] T 0507245aa8c74aeb9f3eafba0682590d P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:54:46.499161 13886 ts_tablet_manager.cc:1397] T 0507245aa8c74aeb9f3eafba0682590d P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.010s user 0.002s sys 0.008s
I20250830 07:54:46.500095 13886 raft_consensus.cc:357] T 0507245aa8c74aeb9f3eafba0682590d P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:46.500272 13886 raft_consensus.cc:383] T 0507245aa8c74aeb9f3eafba0682590d P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:46.500324 13886 raft_consensus.cc:738] T 0507245aa8c74aeb9f3eafba0682590d P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:54:46.500613 13886 consensus_queue.cc:260] T 0507245aa8c74aeb9f3eafba0682590d P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:46.501247 13886 ts_tablet_manager.cc:1428] T 0507245aa8c74aeb9f3eafba0682590d P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20250830 07:54:46.501731 13886 tablet_bootstrap.cc:492] T 007435e198b9440db055711a98e3148a P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:54:46.503517 13886 tablet_bootstrap.cc:654] T 007435e198b9440db055711a98e3148a P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:46.511575 13886 tablet_bootstrap.cc:492] T 007435e198b9440db055711a98e3148a P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:54:46.511688 13886 ts_tablet_manager.cc:1397] T 007435e198b9440db055711a98e3148a P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.010s user 0.005s sys 0.004s
I20250830 07:54:46.512457 13886 raft_consensus.cc:357] T 007435e198b9440db055711a98e3148a P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:46.512630 13886 raft_consensus.cc:383] T 007435e198b9440db055711a98e3148a P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:46.512686 13886 raft_consensus.cc:738] T 007435e198b9440db055711a98e3148a P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:54:46.512910 13886 consensus_queue.cc:260] T 007435e198b9440db055711a98e3148a P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:46.513398 13886 ts_tablet_manager.cc:1428] T 007435e198b9440db055711a98e3148a P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20250830 07:54:46.513654 13886 tablet_bootstrap.cc:492] T cb3c48982add45379c0e1b117ec40c1a P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:54:46.516091 13886 tablet_bootstrap.cc:654] T cb3c48982add45379c0e1b117ec40c1a P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:46.524139 13886 tablet_bootstrap.cc:492] T cb3c48982add45379c0e1b117ec40c1a P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:54:46.524255 13886 ts_tablet_manager.cc:1397] T cb3c48982add45379c0e1b117ec40c1a P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.011s user 0.000s sys 0.009s
I20250830 07:54:46.524909 13886 raft_consensus.cc:357] T cb3c48982add45379c0e1b117ec40c1a P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:46.525085 13886 raft_consensus.cc:383] T cb3c48982add45379c0e1b117ec40c1a P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:46.525157 13886 raft_consensus.cc:738] T cb3c48982add45379c0e1b117ec40c1a P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:54:46.525410 13886 consensus_queue.cc:260] T cb3c48982add45379c0e1b117ec40c1a P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:46.525924 13886 ts_tablet_manager.cc:1428] T cb3c48982add45379c0e1b117ec40c1a P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20250830 07:54:46.526197 13886 tablet_bootstrap.cc:492] T f0144701d459480d96c1ece519951442 P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:54:46.528273 13886 tablet_bootstrap.cc:654] T f0144701d459480d96c1ece519951442 P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:46.528972 13887 tablet_bootstrap.cc:492] T e6b7646588fe4134b2db62ff84ca4791 P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:54:46.529173 13887 ts_tablet_manager.cc:1397] T e6b7646588fe4134b2db62ff84ca4791 P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.267s user 0.077s sys 0.118s
I20250830 07:54:46.529953 13887 raft_consensus.cc:357] T e6b7646588fe4134b2db62ff84ca4791 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:46.530190 13887 raft_consensus.cc:383] T e6b7646588fe4134b2db62ff84ca4791 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:46.530287 13887 raft_consensus.cc:738] T e6b7646588fe4134b2db62ff84ca4791 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:54:46.530509 13887 consensus_queue.cc:260] T e6b7646588fe4134b2db62ff84ca4791 P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:46.531208 13887 ts_tablet_manager.cc:1428] T e6b7646588fe4134b2db62ff84ca4791 P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20250830 07:54:46.531653 13887 tablet_bootstrap.cc:492] T f52dd8eeb64a4b8a92babf34387b6c5b P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:54:46.532918 14745 fs_manager.cc:714] Time spent opening directory manager: real 0.202s user 0.003s sys 0.001s
I20250830 07:54:46.534350 13887 tablet_bootstrap.cc:654] T f52dd8eeb64a4b8a92babf34387b6c5b P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:46.546730 14644 raft_consensus.cc:491] T 51cee993ce4249c0830b29cb1808fe80 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:46.546869 14644 raft_consensus.cc:513] T 51cee993ce4249c0830b29cb1808fe80 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:46.547581 14644 leader_election.cc:290] T 51cee993ce4249c0830b29cb1808fe80 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:46.549485 13770 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "51cee993ce4249c0830b29cb1808fe80" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
W20250830 07:54:46.549654 13220 catalog_manager.cc:4908] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet 559fdab1ef804325978db705431a0ad8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 559fdab1ef804325978db705431a0ad8 already in progress: creating tablet
W20250830 07:54:46.549978 13220 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.12.209.2:38967, user_credentials={real_user=slave}} blocked reactor thread for 89941us
W20250830 07:54:46.550557 13422 leader_election.cc:343] T 51cee993ce4249c0830b29cb1808fe80 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:46.550755 13886 tablet_bootstrap.cc:492] T f0144701d459480d96c1ece519951442 P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:54:46.550920 13886 ts_tablet_manager.cc:1397] T f0144701d459480d96c1ece519951442 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.025s user 0.003s sys 0.007s
I20250830 07:54:46.551810 13886 raft_consensus.cc:357] T f0144701d459480d96c1ece519951442 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:46.552052 13886 raft_consensus.cc:383] T f0144701d459480d96c1ece519951442 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:46.552155 13886 raft_consensus.cc:738] T f0144701d459480d96c1ece519951442 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:54:46.552404 13886 consensus_queue.cc:260] T f0144701d459480d96c1ece519951442 P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:46.552963 13886 ts_tablet_manager.cc:1428] T f0144701d459480d96c1ece519951442 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20250830 07:54:46.553313 13886 tablet_bootstrap.cc:492] T c0147310dad84226808332a4c2c6e09d P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:54:46.555085 13887 tablet_bootstrap.cc:492] T f52dd8eeb64a4b8a92babf34387b6c5b P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:54:46.555194 13887 ts_tablet_manager.cc:1397] T f52dd8eeb64a4b8a92babf34387b6c5b P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.024s user 0.007s sys 0.002s
I20250830 07:54:46.555816 13887 raft_consensus.cc:357] T f52dd8eeb64a4b8a92babf34387b6c5b P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:46.555953 13887 raft_consensus.cc:383] T f52dd8eeb64a4b8a92babf34387b6c5b P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:46.556005 13887 raft_consensus.cc:738] T f52dd8eeb64a4b8a92babf34387b6c5b P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:54:46.556064 13233 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_b209e8dbb7be40408440ef087e11bbd4" } modify_external_catalogs: true
I20250830 07:54:46.556175 13887 consensus_queue.cc:260] T f52dd8eeb64a4b8a92babf34387b6c5b P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:46.556227 13233 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_b209e8dbb7be40408440ef087e11bbd4" } modify_external_catalogs: true
I20250830 07:54:46.556739 13887 ts_tablet_manager.cc:1428] T f52dd8eeb64a4b8a92babf34387b6c5b P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250830 07:54:46.556970 13887 tablet_bootstrap.cc:492] T 13df49c2c2cd4e5cae26a540835b74c9 P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:54:46.557035 13227 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_8a9281237b4a4a5fb5e460f64531ea37" } modify_external_catalogs: true
I20250830 07:54:46.557184 13227 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_8a9281237b4a4a5fb5e460f64531ea37" } modify_external_catalogs: true
I20250830 07:54:46.558420 13887 tablet_bootstrap.cc:654] T 13df49c2c2cd4e5cae26a540835b74c9 P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:46.567116 13887 tablet_bootstrap.cc:492] T 13df49c2c2cd4e5cae26a540835b74c9 P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:54:46.567256 13887 ts_tablet_manager.cc:1397] T 13df49c2c2cd4e5cae26a540835b74c9 P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.010s user 0.006s sys 0.003s
I20250830 07:54:46.568604 13887 raft_consensus.cc:357] T 13df49c2c2cd4e5cae26a540835b74c9 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:46.568807 13887 raft_consensus.cc:383] T 13df49c2c2cd4e5cae26a540835b74c9 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:46.568871 13887 raft_consensus.cc:738] T 13df49c2c2cd4e5cae26a540835b74c9 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:54:46.569093 13887 consensus_queue.cc:260] T 13df49c2c2cd4e5cae26a540835b74c9 P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:46.569635 13887 ts_tablet_manager.cc:1428] T 13df49c2c2cd4e5cae26a540835b74c9 P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20250830 07:54:46.569921 13887 tablet_bootstrap.cc:492] T 74891b8103e144c486750f64ba2003f4 P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:54:46.571581 13887 tablet_bootstrap.cc:654] T 74891b8103e144c486750f64ba2003f4 P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:46.572669 13886 tablet_bootstrap.cc:654] T c0147310dad84226808332a4c2c6e09d P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:46.579480 14819 raft_consensus.cc:491] T f56cab43580a4ee3a912fc5e58a3bd9d P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:46.579598 14819 raft_consensus.cc:513] T f56cab43580a4ee3a912fc5e58a3bd9d P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:46.579869 13887 tablet_bootstrap.cc:492] T 74891b8103e144c486750f64ba2003f4 P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:54:46.579967 13887 ts_tablet_manager.cc:1397] T 74891b8103e144c486750f64ba2003f4 P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.010s user 0.002s sys 0.006s
I20250830 07:54:46.580096 13886 tablet_bootstrap.cc:492] T c0147310dad84226808332a4c2c6e09d P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:54:46.580175 14819 leader_election.cc:290] T f56cab43580a4ee3a912fc5e58a3bd9d P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
I20250830 07:54:46.580246 13886 ts_tablet_manager.cc:1397] T c0147310dad84226808332a4c2c6e09d P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.027s user 0.000s sys 0.003s
I20250830 07:54:46.580667 13887 raft_consensus.cc:357] T 74891b8103e144c486750f64ba2003f4 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:46.580802 13887 raft_consensus.cc:383] T 74891b8103e144c486750f64ba2003f4 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:46.580863 13887 raft_consensus.cc:738] T 74891b8103e144c486750f64ba2003f4 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:54:46.580927 13886 raft_consensus.cc:357] T c0147310dad84226808332a4c2c6e09d P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:46.581015 13887 consensus_queue.cc:260] T 74891b8103e144c486750f64ba2003f4 P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:46.581095 13886 raft_consensus.cc:383] T c0147310dad84226808332a4c2c6e09d P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:46.581149 13886 raft_consensus.cc:738] T c0147310dad84226808332a4c2c6e09d P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:54:46.581427 13887 ts_tablet_manager.cc:1428] T 74891b8103e144c486750f64ba2003f4 P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20250830 07:54:46.581334 13886 consensus_queue.cc:260] T c0147310dad84226808332a4c2c6e09d P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:46.581758 13887 tablet_bootstrap.cc:492] T 09586fdda94c4aff9d3fa25d71fe6ac0 P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:54:46.581874 13886 ts_tablet_manager.cc:1428] T c0147310dad84226808332a4c2c6e09d P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20250830 07:54:46.583226 13887 tablet_bootstrap.cc:654] T 09586fdda94c4aff9d3fa25d71fe6ac0 P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:46.583343 13886 tablet_bootstrap.cc:492] T 2b4ce50fbd26484faba3faa2ec5115c0 P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:54:46.583568 14819 consensus_queue.cc:1035] T d3f207cee78a43a1b5e030c09752c78c P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:54:46.584776 13886 tablet_bootstrap.cc:654] T 2b4ce50fbd26484faba3faa2ec5115c0 P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:46.586495 13481 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f56cab43580a4ee3a912fc5e58a3bd9d" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:54:46.586684 13481 raft_consensus.cc:2391] T f56cab43580a4ee3a912fc5e58a3bd9d P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b057ade5dce45af9f8bf0bedf8b917f in current term 1: Already voted for candidate 6b5e454d98894637b466ea27f1b647f9 in this term.
I20250830 07:54:46.588918 13228 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_e622be14e2824ec1939de81fe5d6f1f8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:46.589610 13228 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e622be14e2824ec1939de81fe5d6f1f8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:46.590387 13231 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_605f96f8ddea45cfa2a0862488a409f6" } modify_external_catalogs: true
I20250830 07:54:46.590585 13231 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_605f96f8ddea45cfa2a0862488a409f6" } modify_external_catalogs: true
I20250830 07:54:46.598687 13886 tablet_bootstrap.cc:492] T 2b4ce50fbd26484faba3faa2ec5115c0 P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:54:46.598805 13886 ts_tablet_manager.cc:1397] T 2b4ce50fbd26484faba3faa2ec5115c0 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.016s user 0.000s sys 0.008s
I20250830 07:54:46.599315 13234 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_d07e338c217149ec81b084cb18a19650" } modify_external_catalogs: true
I20250830 07:54:46.599493 13234 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_d07e338c217149ec81b084cb18a19650" } modify_external_catalogs: true
I20250830 07:54:46.599735 13886 raft_consensus.cc:357] T 2b4ce50fbd26484faba3faa2ec5115c0 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:46.599884 13886 raft_consensus.cc:383] T 2b4ce50fbd26484faba3faa2ec5115c0 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:46.599942 13886 raft_consensus.cc:738] T 2b4ce50fbd26484faba3faa2ec5115c0 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:54:46.600167 13886 consensus_queue.cc:260] T 2b4ce50fbd26484faba3faa2ec5115c0 P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:46.600664 13886 ts_tablet_manager.cc:1428] T 2b4ce50fbd26484faba3faa2ec5115c0 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20250830 07:54:46.601578 13887 tablet_bootstrap.cc:492] T 09586fdda94c4aff9d3fa25d71fe6ac0 P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:54:46.601730 13887 ts_tablet_manager.cc:1397] T 09586fdda94c4aff9d3fa25d71fe6ac0 P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.020s user 0.001s sys 0.005s
I20250830 07:54:46.602440 13887 raft_consensus.cc:357] T 09586fdda94c4aff9d3fa25d71fe6ac0 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:46.602630 13887 raft_consensus.cc:383] T 09586fdda94c4aff9d3fa25d71fe6ac0 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:46.603011 13887 raft_consensus.cc:738] T 09586fdda94c4aff9d3fa25d71fe6ac0 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:54:46.603219 13887 consensus_queue.cc:260] T 09586fdda94c4aff9d3fa25d71fe6ac0 P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:46.603718 13887 ts_tablet_manager.cc:1428] T 09586fdda94c4aff9d3fa25d71fe6ac0 P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20250830 07:54:46.603961 13887 tablet_bootstrap.cc:492] T d206f6b6e7524a27a9f95787bcd5de77 P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
W20250830 07:54:46.604466 13232 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ad7a45187569416bad6c71db9f8ab702 consensus state has no leader
I20250830 07:54:46.605396 13887 tablet_bootstrap.cc:654] T d206f6b6e7524a27a9f95787bcd5de77 P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:46.606784 13232 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_9496092ee37348cebec93de7bbe38ee3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:46.607478 13232 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9496092ee37348cebec93de7bbe38ee3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:46.620900 14644 raft_consensus.cc:491] T 01771fa171374e92892345e7402c33d1 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:46.621055 14644 raft_consensus.cc:513] T 01771fa171374e92892345e7402c33d1 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:46.621352 14819 raft_consensus.cc:491] T 0507245aa8c74aeb9f3eafba0682590d P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:46.621721 14644 leader_election.cc:290] T 01771fa171374e92892345e7402c33d1 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:46.623144 14819 raft_consensus.cc:513] T 0507245aa8c74aeb9f3eafba0682590d P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:46.624109 14819 leader_election.cc:290] T 0507245aa8c74aeb9f3eafba0682590d P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967)
I20250830 07:54:46.631742 13478 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "0507245aa8c74aeb9f3eafba0682590d" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:54:46.631894 13478 raft_consensus.cc:2466] T 0507245aa8c74aeb9f3eafba0682590d P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 0.
I20250830 07:54:46.634171 13886 tablet_bootstrap.cc:492] T 01771fa171374e92892345e7402c33d1 P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:54:46.636109 13886 tablet_bootstrap.cc:654] T 01771fa171374e92892345e7402c33d1 P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:46.637370 13770 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "01771fa171374e92892345e7402c33d1" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:46.648383 14819 raft_consensus.cc:491] T f0144701d459480d96c1ece519951442 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:46.648566 14819 raft_consensus.cc:513] T f0144701d459480d96c1ece519951442 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:46.649233 14819 leader_election.cc:290] T f0144701d459480d96c1ece519951442 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
I20250830 07:54:46.653964 13701 leader_election.cc:304] T 0507245aa8c74aeb9f3eafba0682590d P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters:
I20250830 07:54:46.654331 14819 raft_consensus.cc:2802] T 0507245aa8c74aeb9f3eafba0682590d P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:54:46.654412 14819 raft_consensus.cc:491] T 0507245aa8c74aeb9f3eafba0682590d P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:54:46.654479 14819 raft_consensus.cc:3058] T 0507245aa8c74aeb9f3eafba0682590d P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:46.657347 13886 tablet_bootstrap.cc:492] T 01771fa171374e92892345e7402c33d1 P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:54:46.657485 13886 ts_tablet_manager.cc:1397] T 01771fa171374e92892345e7402c33d1 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.023s user 0.006s sys 0.006s
I20250830 07:54:46.658273 14819 raft_consensus.cc:513] T 0507245aa8c74aeb9f3eafba0682590d P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:46.658284 13886 raft_consensus.cc:357] T 01771fa171374e92892345e7402c33d1 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:46.658674 13886 raft_consensus.cc:383] T 01771fa171374e92892345e7402c33d1 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:46.658733 13886 raft_consensus.cc:738] T 01771fa171374e92892345e7402c33d1 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:54:46.658975 13886 consensus_queue.cc:260] T 01771fa171374e92892345e7402c33d1 P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:46.659525 13886 ts_tablet_manager.cc:1428] T 01771fa171374e92892345e7402c33d1 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20250830 07:54:46.659653 14819 leader_election.cc:290] T 0507245aa8c74aeb9f3eafba0682590d P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Requested vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967)
I20250830 07:54:46.659824 13886 tablet_bootstrap.cc:492] T acca1a8240454b889c63c82d3c75087e P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:54:46.661911 13886 tablet_bootstrap.cc:654] T acca1a8240454b889c63c82d3c75087e P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
W20250830 07:54:46.666079 13226 catalog_manager.cc:5415] Ignoring report from unknown tablet f398e12cd9f543738d5163354f8a9d9d
I20250830 07:54:46.668215 13486 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "0507245aa8c74aeb9f3eafba0682590d" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba"
I20250830 07:54:46.668179 13481 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f0144701d459480d96c1ece519951442" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:54:46.668358 13486 raft_consensus.cc:3058] T 0507245aa8c74aeb9f3eafba0682590d P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
W20250830 07:54:46.668383 13422 leader_election.cc:343] T 01771fa171374e92892345e7402c33d1 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:46.668368 13481 raft_consensus.cc:2466] T f0144701d459480d96c1ece519951442 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 0.
I20250830 07:54:46.671006 13886 tablet_bootstrap.cc:492] T acca1a8240454b889c63c82d3c75087e P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:54:46.671123 13886 ts_tablet_manager.cc:1397] T acca1a8240454b889c63c82d3c75087e P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.011s user 0.004s sys 0.003s
I20250830 07:54:46.671408 13486 raft_consensus.cc:2466] T 0507245aa8c74aeb9f3eafba0682590d P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 1.
I20250830 07:54:46.671799 13886 raft_consensus.cc:357] T acca1a8240454b889c63c82d3c75087e P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:46.671929 13886 raft_consensus.cc:383] T acca1a8240454b889c63c82d3c75087e P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:46.671983 13886 raft_consensus.cc:738] T acca1a8240454b889c63c82d3c75087e P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:54:46.672180 14819 raft_consensus.cc:491] T 69d6daeb7c774fd48ed296f52ed7c6a6 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:46.672356 14819 raft_consensus.cc:513] T 69d6daeb7c774fd48ed296f52ed7c6a6 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:46.672909 14819 leader_election.cc:290] T 69d6daeb7c774fd48ed296f52ed7c6a6 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967)
I20250830 07:54:46.673532 13617 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "73853894da074ecd8147a94ac28bfab8" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:46.672147 13886 consensus_queue.cc:260] T acca1a8240454b889c63c82d3c75087e P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:46.674450 13886 ts_tablet_manager.cc:1428] T acca1a8240454b889c63c82d3c75087e P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20250830 07:54:46.674748 13886 tablet_bootstrap.cc:492] T e255d3fdee09400ead41ca835d6d103f P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:54:46.676321 13477 raft_consensus.cc:1273] T b38c8d003413428dae9e47f58e197c2c P 2065c332f15a4739899af79f3669c3ba [term 2 FOLLOWER]: Refusing update from remote peer 6b5e454d98894637b466ea27f1b647f9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 1. (term mismatch)
I20250830 07:54:46.676431 13477 pending_rounds.cc:85] T b38c8d003413428dae9e47f58e197c2c P 2065c332f15a4739899af79f3669c3ba: Aborting all ops after (but not including) 0
I20250830 07:54:46.676488 13477 pending_rounds.cc:107] T b38c8d003413428dae9e47f58e197c2c P 2065c332f15a4739899af79f3669c3ba: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20250830 07:54:46.676563 13886 tablet_bootstrap.cc:654] T e255d3fdee09400ead41ca835d6d103f P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:46.676614 13477 raft_consensus.cc:2887] T b38c8d003413428dae9e47f58e197c2c P 2065c332f15a4739899af79f3669c3ba [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20250830 07:54:46.676985 13482 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "73853894da074ecd8147a94ac28bfab8" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:54:46.677217 13482 raft_consensus.cc:2391] T 73853894da074ecd8147a94ac28bfab8 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b5e454d98894637b466ea27f1b647f9 in current term 1: Already voted for candidate 9b057ade5dce45af9f8bf0bedf8b917f in this term.
I20250830 07:54:46.681870 13599 tablet_service.cc:1515] Processing DeleteTablet for tablet 8eb010d7955d47a89ff1d01be1b5b01e with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:46 UTC) from {username='slave'} at 127.0.0.1:45306
I20250830 07:54:46.682596 14748 consensus_queue.cc:1035] T b38c8d003413428dae9e47f58e197c2c P 6b5e454d98894637b466ea27f1b647f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:54:46.687773 13611 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "73853894da074ecd8147a94ac28bfab8" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9"
I20250830 07:54:46.688086 13613 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "e6491d149c0646848680cfdadb6fc76c" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:46.690198 14819 raft_consensus.cc:491] T cb3c48982add45379c0e1b117ec40c1a P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:46.690349 14819 raft_consensus.cc:513] T cb3c48982add45379c0e1b117ec40c1a P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:46.691218 13613 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "e6491d149c0646848680cfdadb6fc76c" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9"
I20250830 07:54:46.691649 14906 raft_consensus.cc:491] T 99f307a8cbb34addaafab82b3ed18241 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:46.691849 13592 tablet_service.cc:1515] Processing DeleteTablet for tablet a36f38ada7314165a5e9d6ee7bbf69e3 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:46 UTC) from {username='slave'} at 127.0.0.1:45306
I20250830 07:54:46.692021 13882 tablet_bootstrap.cc:492] T f0144701d459480d96c1ece519951442 P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:54:46.691952 14922 consensus_queue.cc:1035] T 752727eef0734ff3b7b35b1d5f66aea6 P 6b5e454d98894637b466ea27f1b647f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.010s
I20250830 07:54:46.692155 13882 ts_tablet_manager.cc:1397] T f0144701d459480d96c1ece519951442 P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.380s user 0.004s sys 0.000s
I20250830 07:54:46.691870 14906 raft_consensus.cc:513] T 99f307a8cbb34addaafab82b3ed18241 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:46.694859 13611 raft_consensus.cc:3058] T d3f207cee78a43a1b5e030c09752c78c P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:46.698132 14819 leader_election.cc:290] T cb3c48982add45379c0e1b117ec40c1a P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
I20250830 07:54:46.699856 13617 raft_consensus.cc:2466] T 73853894da074ecd8147a94ac28bfab8 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 0.
I20250830 07:54:46.703969 13617 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "cf5613278b4c4f3bbe751b1ae6f3c313" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:46.704196 13886 tablet_bootstrap.cc:492] T e255d3fdee09400ead41ca835d6d103f P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:54:46.704324 13886 ts_tablet_manager.cc:1397] T e255d3fdee09400ead41ca835d6d103f P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.030s user 0.010s sys 0.004s
I20250830 07:54:46.704991 13886 raft_consensus.cc:357] T e255d3fdee09400ead41ca835d6d103f P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:46.705165 13886 raft_consensus.cc:383] T e255d3fdee09400ead41ca835d6d103f P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:46.705219 13886 raft_consensus.cc:738] T e255d3fdee09400ead41ca835d6d103f P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:54:46.705408 13886 consensus_queue.cc:260] T e255d3fdee09400ead41ca835d6d103f P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:46.705840 13886 ts_tablet_manager.cc:1428] T e255d3fdee09400ead41ca835d6d103f P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20250830 07:54:46.706091 13886 tablet_bootstrap.cc:492] T 44313f1a11b74e6d996cafd3c03d1836 P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:54:46.707075 14906 leader_election.cc:290] T 99f307a8cbb34addaafab82b3ed18241 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:46.708518 13886 tablet_bootstrap.cc:654] T 44313f1a11b74e6d996cafd3c03d1836 P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:46.712381 13484 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "99f307a8cbb34addaafab82b3ed18241" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:54:46.712826 13882 raft_consensus.cc:357] T f0144701d459480d96c1ece519951442 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:46.713064 13882 raft_consensus.cc:383] T f0144701d459480d96c1ece519951442 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:46.713181 13599 tablet_service.cc:1515] Processing DeleteTablet for tablet 53a933afa4b74095baf0f54736d99bf0 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:42 UTC) from {username='slave'} at 127.0.0.1:45306
I20250830 07:54:46.714191 13882 raft_consensus.cc:738] T f0144701d459480d96c1ece519951442 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:54:46.717733 14869 raft_consensus.cc:491] T 13df49c2c2cd4e5cae26a540835b74c9 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:46.717862 14869 raft_consensus.cc:513] T 13df49c2c2cd4e5cae26a540835b74c9 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:46.718437 14869 leader_election.cc:290] T 13df49c2c2cd4e5cae26a540835b74c9 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
W20250830 07:54:46.718878 13422 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.209.3:38743, user_credentials={real_user=slave}} blocked reactor thread for 50277.9us
W20250830 07:54:46.719255 13701 consensus_peers.cc:489] T f398e12cd9f543738d5163354f8a9d9d P 9b057ade5dce45af9f8bf0bedf8b917f -> Peer 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): Couldn't send request to peer 2065c332f15a4739899af79f3669c3ba. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f398e12cd9f543738d5163354f8a9d9d. This is attempt 6: this message will repeat every 5th retry.
I20250830 07:54:46.720788 13701 leader_election.cc:304] T f0144701d459480d96c1ece519951442 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters:
I20250830 07:54:46.721035 14853 raft_consensus.cc:2802] T f0144701d459480d96c1ece519951442 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:54:46.715020 14922 consensus_queue.cc:1035] T f56cab43580a4ee3a912fc5e58a3bd9d P 6b5e454d98894637b466ea27f1b647f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.020s
I20250830 07:54:46.722165 14644 raft_consensus.cc:491] T 856e644662334f8194ffef6ca1232248 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:46.722301 14644 raft_consensus.cc:513] T 856e644662334f8194ffef6ca1232248 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:46.722990 14644 leader_election.cc:290] T 856e644662334f8194ffef6ca1232248 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:46.729010 14842 tablet_replica.cc:331] T 53a933afa4b74095baf0f54736d99bf0 P 6b5e454d98894637b466ea27f1b647f9: stopping tablet replica
I20250830 07:54:46.729247 14842 raft_consensus.cc:2241] T 53a933afa4b74095baf0f54736d99bf0 P 6b5e454d98894637b466ea27f1b647f9 [term 1 LEADER]: Raft consensus shutting down.
I20250830 07:54:46.721622 13882 consensus_queue.cc:260] T f0144701d459480d96c1ece519951442 P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
W20250830 07:54:46.696938 13220 catalog_manager.cc:4908] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet 4b9d9d4b65964fd49d8e25092a14d774 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4b9d9d4b65964fd49d8e25092a14d774 already in progress: creating tablet
W20250830 07:54:46.734679 13220 catalog_manager.cc:4908] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet 846338e46b834ae0b5f4e74c7f1325d2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 846338e46b834ae0b5f4e74c7f1325d2 already in progress: creating tablet
W20250830 07:54:46.734959 13220 catalog_manager.cc:4908] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet 8eb010d7955d47a89ff1d01be1b5b01e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8eb010d7955d47a89ff1d01be1b5b01e already in progress: creating tablet
W20250830 07:54:46.735265 13220 catalog_manager.cc:4908] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet a36f38ada7314165a5e9d6ee7bbf69e3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a36f38ada7314165a5e9d6ee7bbf69e3 already in progress: creating tablet
I20250830 07:54:46.737337 13225 master_service.cc:948] ReplaceTablet: received request to replace tablet 2afb1e75cfcc4e1abd265fbadb4170fa from {username='slave'} at 127.0.0.1:42126
I20250830 07:54:46.739461 13226 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_54601facf0e047a0b574ba40d13542c1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250830 07:54:46.739543 13225 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_b6dea313c9d743c1aeb4496f06880746" } new_table_name: "default.Table_aa8142e34d1a4709acfb060513a54001" modify_external_catalogs: true
W20250830 07:54:46.741860 13229 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 9f27983af2c84dd6a40e7e0b900a9dc6 has no consensus state
W20250830 07:54:46.742563 13226 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_54601facf0e047a0b574ba40d13542c1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:46.742517 13229 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_a5ac1561c57f4248ad01f99c4739a38a" } new_table_name: "default.Table_a5f97c309511426b8824d523c216bd7d" modify_external_catalogs: true
I20250830 07:54:46.744796 13611 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f56cab43580a4ee3a912fc5e58a3bd9d" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:46.721144 14853 raft_consensus.cc:491] T f0144701d459480d96c1ece519951442 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:54:46.757074 14853 raft_consensus.cc:3058] T f0144701d459480d96c1ece519951442 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:46.722966 13614 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "8dddcfe56522436287aea212e316a729" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:46.757407 13701 leader_election.cc:304] T 0507245aa8c74aeb9f3eafba0682590d P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters:
I20250830 07:54:46.757742 14819 raft_consensus.cc:2802] T 0507245aa8c74aeb9f3eafba0682590d P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election won for term 1
I20250830 07:54:46.757812 14842 pending_rounds.cc:70] T 53a933afa4b74095baf0f54736d99bf0 P 6b5e454d98894637b466ea27f1b647f9: Trying to abort 1 pending ops.
I20250830 07:54:46.757880 14819 raft_consensus.cc:695] T 0507245aa8c74aeb9f3eafba0682590d P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 LEADER]: Becoming Leader. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Running, Role: LEADER
I20250830 07:54:46.757886 14842 pending_rounds.cc:77] T 53a933afa4b74095baf0f54736d99bf0 P 6b5e454d98894637b466ea27f1b647f9: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7194789830764154880 op_type: NO_OP noop_request { }
I20250830 07:54:46.758001 14842 raft_consensus.cc:2887] T 53a933afa4b74095baf0f54736d99bf0 P 6b5e454d98894637b466ea27f1b647f9 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20250830 07:54:46.758100 14842 raft_consensus.cc:2270] T 53a933afa4b74095baf0f54736d99bf0 P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250830 07:54:46.758157 14819 consensus_queue.cc:237] T 0507245aa8c74aeb9f3eafba0682590d P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:46.758858 13882 ts_tablet_manager.cc:1428] T f0144701d459480d96c1ece519951442 P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.067s user 0.001s sys 0.001s
I20250830 07:54:46.759752 14842 ts_tablet_manager.cc:1905] T 53a933afa4b74095baf0f54736d99bf0 P 6b5e454d98894637b466ea27f1b647f9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250830 07:54:46.774470 14853 raft_consensus.cc:513] T f0144701d459480d96c1ece519951442 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:46.774771 14842 ts_tablet_manager.cc:1918] T 53a933afa4b74095baf0f54736d99bf0 P 6b5e454d98894637b466ea27f1b647f9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250830 07:54:46.774961 14842 log.cc:1199] T 53a933afa4b74095baf0f54736d99bf0 P 6b5e454d98894637b466ea27f1b647f9: Deleting WAL directory at /tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/ts-1/wal/wals/53a933afa4b74095baf0f54736d99bf0
I20250830 07:54:46.775360 14842 ts_tablet_manager.cc:1939] T 53a933afa4b74095baf0f54736d99bf0 P 6b5e454d98894637b466ea27f1b647f9: Deleting consensus metadata
I20250830 07:54:46.777012 13611 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "0507245aa8c74aeb9f3eafba0682590d" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:46.780200 13228 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_4184c9e2d90c4ecfb3b3199ce5517ba5" } modify_external_catalogs: true
I20250830 07:54:46.780439 13228 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_4184c9e2d90c4ecfb3b3199ce5517ba5" } modify_external_catalogs: true
I20250830 07:54:46.781309 13232 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_e3f3256f69e3417da28ddd970e1ca7a0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250830 07:54:46.781651 13882 tablet_bootstrap.cc:492] T e255d3fdee09400ead41ca835d6d103f P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
W20250830 07:54:46.781944 13232 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e3f3256f69e3417da28ddd970e1ca7a0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:46.782932 13611 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "0507245aa8c74aeb9f3eafba0682590d" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9"
I20250830 07:54:46.783226 13614 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f0144701d459480d96c1ece519951442" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:46.784961 13614 raft_consensus.cc:2466] T f0144701d459480d96c1ece519951442 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 0.
I20250830 07:54:46.784986 14922 raft_consensus.cc:491] T 8f215330505848619ad44569d3167591 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:46.785128 14922 raft_consensus.cc:513] T 8f215330505848619ad44569d3167591 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:46.785279 13611 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "69d6daeb7c774fd48ed296f52ed7c6a6" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:46.785780 14922 leader_election.cc:290] T 8f215330505848619ad44569d3167591 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:46.786235 13482 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "8f215330505848619ad44569d3167591" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:54:46.786422 13482 raft_consensus.cc:2466] T 8f215330505848619ad44569d3167591 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b5e454d98894637b466ea27f1b647f9 in term 0.
I20250830 07:54:46.787123 13561 leader_election.cc:304] T 8f215330505848619ad44569d3167591 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 6b5e454d98894637b466ea27f1b647f9; no voters:
I20250830 07:54:46.787406 14922 raft_consensus.cc:2802] T 8f215330505848619ad44569d3167591 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20250830 07:54:46.788669 13225 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 8c01157324ba45bda5b3a9a328bf319b consensus state has no leader
I20250830 07:54:46.789969 14922 raft_consensus.cc:491] T 8f215330505848619ad44569d3167591 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:54:46.790266 14922 raft_consensus.cc:3058] T 8f215330505848619ad44569d3167591 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:46.790779 13225 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_454f67980c3e4ddf989f257b146a9c29" } new_table_name: "default.Table_c9cd695063014e7eb11e8aa6f932505c" modify_external_catalogs: true
I20250830 07:54:46.792093 13220 catalog_manager.cc:4928] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): tablet 53a933afa4b74095baf0f54736d99bf0 (table default.Table_d601d7d0f55744e5b227aa7b31516c20 [id=e9e95cc7dbe94eadae3a118c44143363]) successfully deleted
I20250830 07:54:46.793040 13882 tablet_bootstrap.cc:654] T e255d3fdee09400ead41ca835d6d103f P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:46.794450 13611 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "cb3c48982add45379c0e1b117ec40c1a" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:46.795619 13482 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "69d6daeb7c774fd48ed296f52ed7c6a6" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:54:46.800881 13482 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "cb3c48982add45379c0e1b117ec40c1a" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
W20250830 07:54:46.803885 13220 catalog_manager.cc:4726] Async tablet task AlterTable RPC for tablet d7afb311a699495aa8376db6ab206d94 (table default.Table_0c2faf92583f4b649a893b03b88923a0 [id=3abbecb154a042428e6d68d43bf105fb], current schema version=3) failed: Not found: failed to reset TS proxy: No leader found: Tablet d7afb311a699495aa8376db6ab206d94 consensus state has no leader
W20250830 07:54:46.811280 13423 leader_election.cc:343] T f0144701d459480d96c1ece519951442 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:46.811386 13423 leader_election.cc:304] T f0144701d459480d96c1ece519951442 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba; no voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f
W20250830 07:54:46.811502 13229 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 713c12e1efec4e6f9895c65dc8a9c4b9 consensus state has no leader
I20250830 07:54:46.811810 13229 master_service.cc:948] ReplaceTablet: received request to replace tablet 1ca83bbf848744f38206ceb4126271be from {username='slave'} at 127.0.0.1:42126
I20250830 07:54:46.811826 14644 raft_consensus.cc:2747] T f0144701d459480d96c1ece519951442 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20250830 07:54:46.816049 13423 leader_election.cc:343] T 6a82ea7078e344a497c34f932e139bcd P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:46.816193 13423 leader_election.cc:304] T 6a82ea7078e344a497c34f932e139bcd P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba; no voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:54:46.816516 14644 raft_consensus.cc:2747] T 6a82ea7078e344a497c34f932e139bcd P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20250830 07:54:46.816962 13423 leader_election.cc:343] T a41c1455404f4ed0a782a0c4ddd4140d P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:46.817061 13423 leader_election.cc:304] T a41c1455404f4ed0a782a0c4ddd4140d P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba; no voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:54:46.817396 14644 raft_consensus.cc:2747] T a41c1455404f4ed0a782a0c4ddd4140d P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:54:46.817700 14644 raft_consensus.cc:491] T e6b7646588fe4134b2db62ff84ca4791 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:46.817819 14644 raft_consensus.cc:513] T e6b7646588fe4134b2db62ff84ca4791 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:46.818252 14922 raft_consensus.cc:513] T 8f215330505848619ad44569d3167591 P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:46.818444 14644 leader_election.cc:290] T e6b7646588fe4134b2db62ff84ca4791 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:46.818794 14922 leader_election.cc:290] T 8f215330505848619ad44569d3167591 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 election: Requested vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:46.825243 13482 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "8f215330505848619ad44569d3167591" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba"
I20250830 07:54:46.825416 13482 raft_consensus.cc:3058] T 8f215330505848619ad44569d3167591 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:46.829120 13482 raft_consensus.cc:2466] T 8f215330505848619ad44569d3167591 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b5e454d98894637b466ea27f1b647f9 in term 1.
I20250830 07:54:46.829706 14644 raft_consensus.cc:491] T 4828280e6fec4338b35422917966ac8c P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:46.829818 14644 raft_consensus.cc:513] T 4828280e6fec4338b35422917966ac8c P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:46.830045 13561 leader_election.cc:304] T 8f215330505848619ad44569d3167591 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 6b5e454d98894637b466ea27f1b647f9; no voters:
I20250830 07:54:46.830358 14644 leader_election.cc:290] T 4828280e6fec4338b35422917966ac8c P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:46.831396 14906 raft_consensus.cc:2802] T 8f215330505848619ad44569d3167591 P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Leader election won for term 1
I20250830 07:54:46.831560 14906 raft_consensus.cc:695] T 8f215330505848619ad44569d3167591 P 6b5e454d98894637b466ea27f1b647f9 [term 1 LEADER]: Becoming Leader. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Running, Role: LEADER
I20250830 07:54:46.831825 14906 consensus_queue.cc:237] T 8f215330505848619ad44569d3167591 P 6b5e454d98894637b466ea27f1b647f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:46.836680 14748 raft_consensus.cc:491] T 02be33dc658d428fa55e59784a2342f6 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:46.839183 14924 consensus_queue.cc:1035] T ffc5945a032e47d4bd3397d7c887dc62 P 6b5e454d98894637b466ea27f1b647f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:54:46.830302 14946 consensus_queue.cc:1035] T 007435e198b9440db055711a98e3148a P 6b5e454d98894637b466ea27f1b647f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.018s
I20250830 07:54:46.853295 13226 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_d356c6eecb574cf6aa06b4405e9cdf0c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:46.854022 13226 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d356c6eecb574cf6aa06b4405e9cdf0c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:46.867844 14963 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20250830 07:54:46.869927 14748 raft_consensus.cc:513] T 02be33dc658d428fa55e59784a2342f6 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
W20250830 07:54:46.880594 13561 leader_election.cc:343] T 02be33dc658d428fa55e59784a2342f6 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): Not found: Tablet not found: 02be33dc658d428fa55e59784a2342f6
I20250830 07:54:46.884155 13611 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "ec4a3975961d4f85ad9da94835417574" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:46.885573 14748 leader_election.cc:290] T 02be33dc658d428fa55e59784a2342f6 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:46.794414 13770 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "13df49c2c2cd4e5cae26a540835b74c9" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:46.807790 13769 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "856e644662334f8194ffef6ca1232248" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:46.829527 13768 raft_consensus.cc:3058] T f56cab43580a4ee3a912fc5e58a3bd9d P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:46.834107 13765 raft_consensus.cc:3058] T 8dddcfe56522436287aea212e316a729 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:46.835088 13773 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "73853894da074ecd8147a94ac28bfab8" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:46.840651 13767 raft_consensus.cc:3058] T cf5613278b4c4f3bbe751b1ae6f3c313 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:46.840939 13772 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "99f307a8cbb34addaafab82b3ed18241" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:46.841665 13766 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "8f215330505848619ad44569d3167591" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:46.841892 13771 raft_consensus.cc:3058] T 04eadf45b82e4c319eb7b316a402d81a P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
W20250830 07:54:46.842411 13703 leader_election.cc:343] T e6491d149c0646848680cfdadb6fc76c P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:46.901340 13766 raft_consensus.cc:2466] T 8f215330505848619ad44569d3167591 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b5e454d98894637b466ea27f1b647f9 in term 0.
W20250830 07:54:46.901469 13703 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.209.2:38967, user_credentials={real_user=slave}} blocked reactor thread for 59077.2us
W20250830 07:54:46.901654 13703 leader_election.cc:343] T e6491d149c0646848680cfdadb6fc76c P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:46.902125 13703 leader_election.cc:304] T cf5613278b4c4f3bbe751b1ae6f3c313 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 2065c332f15a4739899af79f3669c3ba, 6b5e454d98894637b466ea27f1b647f9
W20250830 07:54:46.902544 13703 leader_election.cc:343] T 50360492db824755a6de251436cab5c6 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Not found: Tablet not found: 50360492db824755a6de251436cab5c6
I20250830 07:54:46.902621 13703 leader_election.cc:304] T 50360492db824755a6de251436cab5c6 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 2065c332f15a4739899af79f3669c3ba, 6b5e454d98894637b466ea27f1b647f9
I20250830 07:54:46.845274 13775 raft_consensus.cc:3058] T 69d6daeb7c774fd48ed296f52ed7c6a6 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:46.905773 14958 raft_consensus.cc:491] T 04eadf45b82e4c319eb7b316a402d81a P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:46.905885 14958 raft_consensus.cc:513] T 04eadf45b82e4c319eb7b316a402d81a P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:46.906543 14958 leader_election.cc:290] T 04eadf45b82e4c319eb7b316a402d81a P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
I20250830 07:54:46.847822 13886 tablet_bootstrap.cc:492] T 44313f1a11b74e6d996cafd3c03d1836 P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:54:46.907131 14958 raft_consensus.cc:2747] T 50360492db824755a6de251436cab5c6 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:54:46.907271 13886 ts_tablet_manager.cc:1397] T 44313f1a11b74e6d996cafd3c03d1836 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.201s user 0.003s sys 0.002s
I20250830 07:54:46.875342 14957 raft_consensus.cc:491] T acca1a8240454b889c63c82d3c75087e P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:46.907678 14957 raft_consensus.cc:513] T acca1a8240454b889c63c82d3c75087e P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:46.908044 13886 raft_consensus.cc:357] T 44313f1a11b74e6d996cafd3c03d1836 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:46.908169 13886 raft_consensus.cc:383] T 44313f1a11b74e6d996cafd3c03d1836 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:46.908213 13886 raft_consensus.cc:738] T 44313f1a11b74e6d996cafd3c03d1836 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:54:46.908236 14957 leader_election.cc:290] T acca1a8240454b889c63c82d3c75087e P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967)
I20250830 07:54:46.908380 13886 consensus_queue.cc:260] T 44313f1a11b74e6d996cafd3c03d1836 P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:46.908990 13886 ts_tablet_manager.cc:1428] T 44313f1a11b74e6d996cafd3c03d1836 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20250830 07:54:46.909301 13886 tablet_bootstrap.cc:492] T 66d59910b4b2451a851e9d2728d50f42 P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:54:46.883827 13774 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "e6b7646588fe4134b2db62ff84ca4791" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:46.885329 13764 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "4828280e6fec4338b35422917966ac8c" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:46.914425 14745 fs_manager.cc:730] Time spent opening block manager: real 0.074s user 0.001s sys 0.000s
I20250830 07:54:46.914685 14745 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/master-2/data,/tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/master-2/wal
uuid: "3ea183a890b84f408b20b55e9eb7c7ed"
format_stamp: "Formatted at 2025-08-30 07:54:28 on dist-test-slave-g8n5"
I20250830 07:54:46.918138 14745 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20250830 07:54:46.930824 14943 consensus_queue.cc:1035] T d3f207cee78a43a1b5e030c09752c78c P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:54:46.932646 13611 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "66d59910b4b2451a851e9d2728d50f42" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:46.933754 13232 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_d33fa1b1af664fa8b8bc70c5ebceecc3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250830 07:54:46.934825 13614 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "acca1a8240454b889c63c82d3c75087e" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:46.936409 13703 leader_election.cc:304] T f56cab43580a4ee3a912fc5e58a3bd9d P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 2065c332f15a4739899af79f3669c3ba, 6b5e454d98894637b466ea27f1b647f9
I20250830 07:54:46.939814 14943 raft_consensus.cc:2747] T f56cab43580a4ee3a912fc5e58a3bd9d P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:54:46.940516 14907 raft_consensus.cc:491] T d3f207cee78a43a1b5e030c09752c78c P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:46.941144 14907 raft_consensus.cc:513] T d3f207cee78a43a1b5e030c09752c78c P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:46.941531 13703 leader_election.cc:304] T 8dddcfe56522436287aea212e316a729 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 2065c332f15a4739899af79f3669c3ba, 6b5e454d98894637b466ea27f1b647f9
W20250830 07:54:46.942828 13703 leader_election.cc:343] T 0507245aa8c74aeb9f3eafba0682590d P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
W20250830 07:54:46.943713 13703 leader_election.cc:343] T 0507245aa8c74aeb9f3eafba0682590d P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:46.944132 13613 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "d6afa1ad4791429ba96ee81583dcee64" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:46.944667 13614 raft_consensus.cc:3058] T 99f307a8cbb34addaafab82b3ed18241 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:46.945353 13703 leader_election.cc:304] T 69d6daeb7c774fd48ed296f52ed7c6a6 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 2065c332f15a4739899af79f3669c3ba, 6b5e454d98894637b466ea27f1b647f9
W20250830 07:54:46.945839 13225 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 930081bb13454b85ae17bbc4b2b59053 has no consensus state
I20250830 07:54:46.948773 13480 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "d3f207cee78a43a1b5e030c09752c78c" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:54:46.951115 14973 raft_consensus.cc:2747] T 69d6daeb7c774fd48ed296f52ed7c6a6 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:54:46.952989 13886 tablet_bootstrap.cc:654] T 66d59910b4b2451a851e9d2728d50f42 P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:46.956095 14907 leader_election.cc:290] T d3f207cee78a43a1b5e030c09752c78c P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:46.956346 13611 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "29f0695563854e45965a1cc36ac54138" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:46.963781 14853 leader_election.cc:290] T f0144701d459480d96c1ece519951442 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Requested vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
I20250830 07:54:46.965234 14815 raft_consensus.cc:491] T e4ca3110247640fbae4241448e8d5ef7 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:46.965379 14815 raft_consensus.cc:513] T e4ca3110247640fbae4241448e8d5ef7 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:46.965850 14815 leader_election.cc:290] T e4ca3110247640fbae4241448e8d5ef7 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
W20250830 07:54:46.967021 13422 leader_election.cc:343] T 13df49c2c2cd4e5cae26a540835b74c9 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Illegal state: must be running to vote when last-logged opid is not known
W20250830 07:54:46.967281 13422 leader_election.cc:343] T 856e644662334f8194ffef6ca1232248 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:46.967594 14815 consensus_queue.cc:1035] T 04eadf45b82e4c319eb7b316a402d81a P 2065c332f15a4739899af79f3669c3ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:54:46.977195 13882 tablet_bootstrap.cc:492] T e255d3fdee09400ead41ca835d6d103f P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:54:46.980154 13887 tablet_bootstrap.cc:492] T d206f6b6e7524a27a9f95787bcd5de77 P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:54:46.980296 13887 ts_tablet_manager.cc:1397] T d206f6b6e7524a27a9f95787bcd5de77 P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.376s user 0.054s sys 0.111s
I20250830 07:54:46.980360 13611 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "51cee993ce4249c0830b29cb1808fe80" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:46.980993 13887 raft_consensus.cc:357] T d206f6b6e7524a27a9f95787bcd5de77 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:46.981163 13887 raft_consensus.cc:383] T d206f6b6e7524a27a9f95787bcd5de77 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:46.981226 13887 raft_consensus.cc:738] T d206f6b6e7524a27a9f95787bcd5de77 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:54:46.981422 13887 consensus_queue.cc:260] T d206f6b6e7524a27a9f95787bcd5de77 P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:46.988214 13225 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_0a54b09130b8425f9f06c093345e6a29"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250830 07:54:46.990942 13887 ts_tablet_manager.cc:1428] T d206f6b6e7524a27a9f95787bcd5de77 P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.011s user 0.001s sys 0.001s
I20250830 07:54:46.991242 13887 tablet_bootstrap.cc:492] T d2b8e6df64ef49e2ba36c093efd3c351 P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:54:46.993484 13887 tablet_bootstrap.cc:654] T d2b8e6df64ef49e2ba36c093efd3c351 P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:46.995509 13882 ts_tablet_manager.cc:1397] T e255d3fdee09400ead41ca835d6d103f P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.196s user 0.002s sys 0.013s
I20250830 07:54:46.996426 13882 raft_consensus.cc:357] T e255d3fdee09400ead41ca835d6d103f P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:46.997328 13886 tablet_bootstrap.cc:492] T 66d59910b4b2451a851e9d2728d50f42 P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:54:46.997447 13886 ts_tablet_manager.cc:1397] T 66d59910b4b2451a851e9d2728d50f42 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.088s user 0.002s sys 0.001s
I20250830 07:54:46.999043 13886 raft_consensus.cc:357] T 66d59910b4b2451a851e9d2728d50f42 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:46.999191 13886 raft_consensus.cc:383] T 66d59910b4b2451a851e9d2728d50f42 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:46.999233 13886 raft_consensus.cc:738] T 66d59910b4b2451a851e9d2728d50f42 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:54:46.999388 13886 consensus_queue.cc:260] T 66d59910b4b2451a851e9d2728d50f42 P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:47.000061 13886 ts_tablet_manager.cc:1428] T 66d59910b4b2451a851e9d2728d50f42 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20250830 07:54:47.000288 13886 tablet_bootstrap.cc:492] T 856e644662334f8194ffef6ca1232248 P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:54:47.001154 13764 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "e4ca3110247640fbae4241448e8d5ef7" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:47.006261 13887 tablet_bootstrap.cc:492] T d2b8e6df64ef49e2ba36c093efd3c351 P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:54:47.006366 13887 ts_tablet_manager.cc:1397] T d2b8e6df64ef49e2ba36c093efd3c351 P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.015s user 0.003s sys 0.000s
I20250830 07:54:47.007025 13887 raft_consensus.cc:357] T d2b8e6df64ef49e2ba36c093efd3c351 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:47.007193 13887 raft_consensus.cc:383] T d2b8e6df64ef49e2ba36c093efd3c351 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:47.007244 13887 raft_consensus.cc:738] T d2b8e6df64ef49e2ba36c093efd3c351 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:54:47.007409 13887 consensus_queue.cc:260] T d2b8e6df64ef49e2ba36c093efd3c351 P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:47.007871 13887 ts_tablet_manager.cc:1428] T d2b8e6df64ef49e2ba36c093efd3c351 P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250830 07:54:47.008397 13613 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "13df49c2c2cd4e5cae26a540835b74c9" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:47.008904 13886 tablet_bootstrap.cc:654] T 856e644662334f8194ffef6ca1232248 P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:47.009008 13611 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "856e644662334f8194ffef6ca1232248" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:47.010589 13614 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "01771fa171374e92892345e7402c33d1" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
W20250830 07:54:47.010627 13423 leader_election.cc:343] T ec4a3975961d4f85ad9da94835417574 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:47.010721 13423 leader_election.cc:304] T ec4a3975961d4f85ad9da94835417574 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba; no voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:54:47.011159 14644 raft_consensus.cc:2747] T ec4a3975961d4f85ad9da94835417574 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20250830 07:54:47.013187 13225 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0a54b09130b8425f9f06c093345e6a29 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:47.014353 13887 tablet_bootstrap.cc:492] T 4b403cadfb7b42f8896b2ee16b50ecb1 P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:54:47.015782 13887 tablet_bootstrap.cc:654] T 4b403cadfb7b42f8896b2ee16b50ecb1 P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
W20250830 07:54:47.016487 13232 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d33fa1b1af664fa8b8bc70c5ebceecc3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250830 07:54:47.017669 13423 leader_election.cc:343] T 66d59910b4b2451a851e9d2728d50f42 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:47.017771 13423 leader_election.cc:304] T 66d59910b4b2451a851e9d2728d50f42 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba; no voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f
W20250830 07:54:47.018162 13423 leader_election.cc:343] T acca1a8240454b889c63c82d3c75087e P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:47.018129 14644 raft_consensus.cc:2747] T 66d59910b4b2451a851e9d2728d50f42 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:54:47.018255 13423 leader_election.cc:304] T acca1a8240454b889c63c82d3c75087e P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba; no voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:54:47.018450 14644 raft_consensus.cc:2747] T acca1a8240454b889c63c82d3c75087e P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:54:47.018879 13775 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "8f215330505848619ad44569d3167591" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f"
I20250830 07:54:47.019474 13775 raft_consensus.cc:3058] T 8f215330505848619ad44569d3167591 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:47.021598 13766 raft_consensus.cc:1273] T b38c8d003413428dae9e47f58e197c2c P 9b057ade5dce45af9f8bf0bedf8b917f [term 2 FOLLOWER]: Refusing update from remote peer 6b5e454d98894637b466ea27f1b647f9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20250830 07:54:47.021900 13775 raft_consensus.cc:2466] T 8f215330505848619ad44569d3167591 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b5e454d98894637b466ea27f1b647f9 in term 1.
I20250830 07:54:47.023319 13617 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "e6b7646588fe4134b2db62ff84ca4791" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:47.023602 13610 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "4828280e6fec4338b35422917966ac8c" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:47.023922 13882 raft_consensus.cc:383] T e255d3fdee09400ead41ca835d6d103f P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:47.024060 13882 raft_consensus.cc:738] T e255d3fdee09400ead41ca835d6d103f P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:54:47.024129 13766 raft_consensus.cc:3058] T 007435e198b9440db055711a98e3148a P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:47.024422 13882 consensus_queue.cc:260] T e255d3fdee09400ead41ca835d6d103f P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:47.027031 14818 raft_consensus.cc:2747] T cf5613278b4c4f3bbe751b1ae6f3c313 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:54:47.028007 13703 leader_election.cc:304] T cb3c48982add45379c0e1b117ec40c1a P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 2065c332f15a4739899af79f3669c3ba, 6b5e454d98894637b466ea27f1b647f9
I20250830 07:54:47.029277 14818 raft_consensus.cc:2747] T cb3c48982add45379c0e1b117ec40c1a P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:54:47.035344 13622 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "e4ca3110247640fbae4241448e8d5ef7" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:47.041854 14815 raft_consensus.cc:491] T 09586fdda94c4aff9d3fa25d71fe6ac0 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:47.041973 14815 raft_consensus.cc:513] T 09586fdda94c4aff9d3fa25d71fe6ac0 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:47.042497 14815 leader_election.cc:290] T 09586fdda94c4aff9d3fa25d71fe6ac0 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
W20250830 07:54:47.042914 13422 leader_election.cc:343] T e6b7646588fe4134b2db62ff84ca4791 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Illegal state: must be running to vote when last-logged opid is not known
W20250830 07:54:47.043520 13422 leader_election.cc:343] T 4828280e6fec4338b35422917966ac8c P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:47.044463 13484 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "04eadf45b82e4c319eb7b316a402d81a" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:54:47.047526 14984 tablet.cc:1722] T 8dddcfe56522436287aea212e316a729 P 9b057ade5dce45af9f8bf0bedf8b917f: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20250830 07:54:47.047799 13886 tablet_bootstrap.cc:492] T 856e644662334f8194ffef6ca1232248 P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:54:47.047914 13886 ts_tablet_manager.cc:1397] T 856e644662334f8194ffef6ca1232248 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.048s user 0.006s sys 0.006s
I20250830 07:54:47.048627 13886 raft_consensus.cc:357] T 856e644662334f8194ffef6ca1232248 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:47.048784 13886 raft_consensus.cc:383] T 856e644662334f8194ffef6ca1232248 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:47.048849 13886 raft_consensus.cc:738] T 856e644662334f8194ffef6ca1232248 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:54:47.049062 13886 consensus_queue.cc:260] T 856e644662334f8194ffef6ca1232248 P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:47.049561 13886 ts_tablet_manager.cc:1428] T 856e644662334f8194ffef6ca1232248 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20250830 07:54:47.049841 13886 tablet_bootstrap.cc:492] T f1fe024f0de048a5a0931ee38752d5a1 P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:54:47.051131 14943 raft_consensus.cc:2747] T 8dddcfe56522436287aea212e316a729 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:54:47.058341 13882 ts_tablet_manager.cc:1428] T e255d3fdee09400ead41ca835d6d103f P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.037s user 0.001s sys 0.001s
I20250830 07:54:47.058696 13882 tablet_bootstrap.cc:492] T 0507245aa8c74aeb9f3eafba0682590d P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
W20250830 07:54:47.060667 13423 leader_election.cc:343] T d6afa1ad4791429ba96ee81583dcee64 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:47.060763 13423 leader_election.cc:304] T d6afa1ad4791429ba96ee81583dcee64 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba; no voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:54:47.061170 14644 raft_consensus.cc:2747] T d6afa1ad4791429ba96ee81583dcee64 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:54:47.061226 13886 tablet_bootstrap.cc:654] T f1fe024f0de048a5a0931ee38752d5a1 P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
W20250830 07:54:47.061357 13423 leader_election.cc:343] T 29f0695563854e45965a1cc36ac54138 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:47.061442 13423 leader_election.cc:304] T 29f0695563854e45965a1cc36ac54138 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba; no voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:54:47.061657 14644 raft_consensus.cc:2747] T 29f0695563854e45965a1cc36ac54138 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:54:47.061858 14644 consensus_queue.cc:1035] T 99f307a8cbb34addaafab82b3ed18241 P 2065c332f15a4739899af79f3669c3ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20250830 07:54:47.062738 13423 leader_election.cc:343] T 51cee993ce4249c0830b29cb1808fe80 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:47.062759 14943 raft_consensus.cc:491] T a04bf79de30a42a98e71f622efc90c22 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:47.062840 13423 leader_election.cc:304] T 51cee993ce4249c0830b29cb1808fe80 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba; no voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:54:47.062870 14943 raft_consensus.cc:513] T a04bf79de30a42a98e71f622efc90c22 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:47.063277 14950 raft_consensus.cc:2747] T 51cee993ce4249c0830b29cb1808fe80 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:54:47.063403 14943 leader_election.cc:290] T a04bf79de30a42a98e71f622efc90c22 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
W20250830 07:54:47.064353 13423 leader_election.cc:343] T 13df49c2c2cd4e5cae26a540835b74c9 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:47.064534 13423 leader_election.cc:304] T 13df49c2c2cd4e5cae26a540835b74c9 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba; no voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:54:47.064776 14950 raft_consensus.cc:2747] T 13df49c2c2cd4e5cae26a540835b74c9 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20250830 07:54:47.065200 13423 leader_election.cc:343] T 856e644662334f8194ffef6ca1232248 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:47.065351 13423 leader_election.cc:304] T 856e644662334f8194ffef6ca1232248 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba; no voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:54:47.065580 14950 raft_consensus.cc:2747] T 856e644662334f8194ffef6ca1232248 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:54:47.065701 13764 raft_consensus.cc:3058] T 533811110191436d96665b3475ab597f P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:47.066763 13886 tablet_bootstrap.cc:492] T f1fe024f0de048a5a0931ee38752d5a1 P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:54:47.066879 13886 ts_tablet_manager.cc:1397] T f1fe024f0de048a5a0931ee38752d5a1 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.017s user 0.002s sys 0.002s
I20250830 07:54:47.067596 13886 raft_consensus.cc:357] T f1fe024f0de048a5a0931ee38752d5a1 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:47.067721 13886 raft_consensus.cc:383] T f1fe024f0de048a5a0931ee38752d5a1 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:47.067797 13886 raft_consensus.cc:738] T f1fe024f0de048a5a0931ee38752d5a1 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:54:47.067981 13886 consensus_queue.cc:260] T f1fe024f0de048a5a0931ee38752d5a1 P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:47.068491 13886 ts_tablet_manager.cc:1428] T f1fe024f0de048a5a0931ee38752d5a1 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20250830 07:54:47.068754 13886 tablet_bootstrap.cc:492] T 6a82ea7078e344a497c34f932e139bcd P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:54:47.070539 13484 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "acca1a8240454b889c63c82d3c75087e" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:54:47.070704 13886 tablet_bootstrap.cc:654] T 6a82ea7078e344a497c34f932e139bcd P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:47.070812 13484 raft_consensus.cc:2466] T acca1a8240454b889c63c82d3c75087e P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 0.
I20250830 07:54:47.073068 13477 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f0144701d459480d96c1ece519951442" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba"
I20250830 07:54:47.073216 13477 raft_consensus.cc:3058] T f0144701d459480d96c1ece519951442 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:47.075781 13477 raft_consensus.cc:2466] T f0144701d459480d96c1ece519951442 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 1.
I20250830 07:54:47.077858 14906 consensus_queue.cc:1035] T f56cab43580a4ee3a912fc5e58a3bd9d P 6b5e454d98894637b466ea27f1b647f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:54:47.078593 13562 leader_election.cc:304] T 73853894da074ecd8147a94ac28bfab8 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b5e454d98894637b466ea27f1b647f9; no voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:54:47.078825 14906 raft_consensus.cc:3058] T 73853894da074ecd8147a94ac28bfab8 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Advancing to term 1
W20250830 07:54:47.080278 13226 catalog_manager.cc:5415] Ignoring report from unknown tablet d3f207cee78a43a1b5e030c09752c78c
W20250830 07:54:47.080367 13226 catalog_manager.cc:5415] Ignoring report from unknown tablet e255d3fdee09400ead41ca835d6d103f
W20250830 07:54:47.080408 13226 catalog_manager.cc:5415] Ignoring report from unknown tablet acca1a8240454b889c63c82d3c75087e
W20250830 07:54:47.080457 13226 catalog_manager.cc:5415] Ignoring report from unknown tablet 01771fa171374e92892345e7402c33d1
W20250830 07:54:47.080492 13226 catalog_manager.cc:5415] Ignoring report from unknown tablet 1fa571e9490e499792225d7b786e8658
W20250830 07:54:47.080541 13226 catalog_manager.cc:5415] Ignoring report from unknown tablet c0147310dad84226808332a4c2c6e09d
W20250830 07:54:47.080578 13226 catalog_manager.cc:5415] Ignoring report from unknown tablet f0144701d459480d96c1ece519951442
W20250830 07:54:47.080636 13226 catalog_manager.cc:5415] Ignoring report from unknown tablet cb3c48982add45379c0e1b117ec40c1a
W20250830 07:54:47.080682 13226 catalog_manager.cc:5415] Ignoring report from unknown tablet 007435e198b9440db055711a98e3148a
W20250830 07:54:47.080729 13226 catalog_manager.cc:5415] Ignoring report from unknown tablet 0507245aa8c74aeb9f3eafba0682590d
W20250830 07:54:47.080772 13226 catalog_manager.cc:5415] Ignoring report from unknown tablet e66e56ecdf14466282daab8c894eb3c6
W20250830 07:54:47.080825 13226 catalog_manager.cc:5415] Ignoring report from unknown tablet 2b4ce50fbd26484faba3faa2ec5115c0
W20250830 07:54:47.080860 13226 catalog_manager.cc:5415] Ignoring report from unknown tablet 533811110191436d96665b3475ab597f
W20250830 07:54:47.080906 13226 catalog_manager.cc:5415] Ignoring report from unknown tablet f398e12cd9f543738d5163354f8a9d9d
I20250830 07:54:47.081609 14906 raft_consensus.cc:2747] T 73853894da074ecd8147a94ac28bfab8 P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:54:47.088375 13562 leader_election.cc:304] T 99f307a8cbb34addaafab82b3ed18241 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b5e454d98894637b466ea27f1b647f9; no voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:54:47.089048 14921 raft_consensus.cc:2747] T 99f307a8cbb34addaafab82b3ed18241 P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:54:47.089280 14921 consensus_queue.cc:1035] T ffc5945a032e47d4bd3397d7c887dc62 P 6b5e454d98894637b466ea27f1b647f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:54:47.090363 14921 consensus_queue.cc:1035] T b38c8d003413428dae9e47f58e197c2c P 6b5e454d98894637b466ea27f1b647f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:54:47.091174 13225 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_cb4f14be94f441bbb2f3e8f3a336f1b7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250830 07:54:47.089048 13882 tablet_bootstrap.cc:654] T 0507245aa8c74aeb9f3eafba0682590d P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
W20250830 07:54:47.093515 13226 catalog_manager.cc:5415] Ignoring report from unknown tablet cb3c48982add45379c0e1b117ec40c1a
W20250830 07:54:47.093667 13226 catalog_manager.cc:5415] Ignoring report from unknown tablet d3f207cee78a43a1b5e030c09752c78c
W20250830 07:54:47.093788 13226 catalog_manager.cc:5415] Ignoring report from unknown tablet 752727eef0734ff3b7b35b1d5f66aea6
W20250830 07:54:47.093961 13226 catalog_manager.cc:5415] Ignoring report from unknown tablet 8f215330505848619ad44569d3167591
W20250830 07:54:47.094185 13226 catalog_manager.cc:5415] Ignoring report from unknown tablet 007435e198b9440db055711a98e3148a
W20250830 07:54:47.094369 13226 catalog_manager.cc:5415] Ignoring report from unknown tablet d1ae3812d72b419798736328da64b53c
W20250830 07:54:47.094506 13226 catalog_manager.cc:5415] Ignoring report from unknown tablet 533811110191436d96665b3475ab597f
W20250830 07:54:47.094678 13226 catalog_manager.cc:5415] Ignoring report from unknown tablet f0144701d459480d96c1ece519951442
W20250830 07:54:47.094844 13226 catalog_manager.cc:5415] Ignoring report from unknown tablet ff2267fb411942ff826e2a72bcb89cd7
I20250830 07:54:47.095855 13226 catalog_manager.cc:5674] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967) does not have the latest schema for tablet 99f307a8cbb34addaafab82b3ed18241 (table default.Table_4e2c5e0840fe4d3398519818e193f4dd [id=2a10f84461764fd5ab5a59499a370034]). Expected version 1 got 0
I20250830 07:54:47.096184 13226 catalog_manager.cc:5674] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967) does not have the latest schema for tablet 69d6daeb7c774fd48ed296f52ed7c6a6 (table default.Table_c8fac6974ea94c7e863c1ded184f9230 [id=761247d93d9f4f788ecceabebf1de486]). Expected version 3 got 0
W20250830 07:54:47.091884 13562 leader_election.cc:343] T 02be33dc658d428fa55e59784a2342f6 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Not found: Tablet not found: 02be33dc658d428fa55e59784a2342f6
I20250830 07:54:47.096680 13562 leader_election.cc:304] T 02be33dc658d428fa55e59784a2342f6 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b5e454d98894637b466ea27f1b647f9; no voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:54:47.097759 14818 raft_consensus.cc:491] T 66d59910b4b2451a851e9d2728d50f42 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:47.097887 14818 raft_consensus.cc:513] T 66d59910b4b2451a851e9d2728d50f42 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:47.098269 13766 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "d3f207cee78a43a1b5e030c09752c78c" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:47.098467 14818 leader_election.cc:290] T 66d59910b4b2451a851e9d2728d50f42 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967)
I20250830 07:54:47.098562 14818 raft_consensus.cc:491] T 01771fa171374e92892345e7402c33d1 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:47.098672 14818 raft_consensus.cc:513] T 01771fa171374e92892345e7402c33d1 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:47.099277 14818 leader_election.cc:290] T 01771fa171374e92892345e7402c33d1 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
I20250830 07:54:47.099452 13232 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_c9bf25d8aabf4253b834cfaf90b0d481"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:47.100210 13232 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c9bf25d8aabf4253b834cfaf90b0d481 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250830 07:54:47.101224 13225 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_cb4f14be94f441bbb2f3e8f3a336f1b7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:47.104130 13226 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_510bdb6808fa48948663ba929c792917" } new_table_name: "default.Table_d4c23a361ea94d88b0fa71c2f7ac15d1" modify_external_catalogs: true
I20250830 07:54:47.109874 14921 raft_consensus.cc:2747] T 02be33dc658d428fa55e59784a2342f6 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:54:47.110409 14921 consensus_queue.cc:1035] T 007435e198b9440db055711a98e3148a P 6b5e454d98894637b466ea27f1b647f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:54:47.112958 13225 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_812995c9d8ac47a89a232b73ff63ed59"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:47.120622 13225 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_812995c9d8ac47a89a232b73ff63ed59 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:47.124207 13887 tablet_bootstrap.cc:492] T 4b403cadfb7b42f8896b2ee16b50ecb1 P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:54:47.124374 13887 ts_tablet_manager.cc:1397] T 4b403cadfb7b42f8896b2ee16b50ecb1 P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.110s user 0.002s sys 0.004s
I20250830 07:54:47.125104 13887 raft_consensus.cc:357] T 4b403cadfb7b42f8896b2ee16b50ecb1 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:47.125303 13887 raft_consensus.cc:383] T 4b403cadfb7b42f8896b2ee16b50ecb1 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:47.125645 13887 raft_consensus.cc:738] T 4b403cadfb7b42f8896b2ee16b50ecb1 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:54:47.126744 13482 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "66d59910b4b2451a851e9d2728d50f42" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:54:47.127063 13482 raft_consensus.cc:2466] T 66d59910b4b2451a851e9d2728d50f42 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 0.
I20250830 07:54:47.127794 13887 consensus_queue.cc:260] T 4b403cadfb7b42f8896b2ee16b50ecb1 P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:47.127945 13886 tablet_bootstrap.cc:492] T 6a82ea7078e344a497c34f932e139bcd P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:54:47.128067 13886 ts_tablet_manager.cc:1397] T 6a82ea7078e344a497c34f932e139bcd P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.059s user 0.002s sys 0.008s
I20250830 07:54:47.128288 13232 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_9da4c3c58ca94b989fa57b37343548b4" } new_table_name: "default.Table_6fe6d8fe98fb48218cef68475a6faeb9" modify_external_catalogs: true
I20250830 07:54:47.128651 13886 raft_consensus.cc:357] T 6a82ea7078e344a497c34f932e139bcd P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:47.128793 13886 raft_consensus.cc:383] T 6a82ea7078e344a497c34f932e139bcd P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:47.128834 13886 raft_consensus.cc:738] T 6a82ea7078e344a497c34f932e139bcd P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:54:47.129005 13886 consensus_queue.cc:260] T 6a82ea7078e344a497c34f932e139bcd P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:47.129467 13886 ts_tablet_manager.cc:1428] T 6a82ea7078e344a497c34f932e139bcd P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20250830 07:54:47.129714 13886 tablet_bootstrap.cc:492] T e6b7646588fe4134b2db62ff84ca4791 P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:54:47.131278 13886 tablet_bootstrap.cc:654] T e6b7646588fe4134b2db62ff84ca4791 P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:47.132742 13562 leader_election.cc:304] T d3f207cee78a43a1b5e030c09752c78c P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b5e454d98894637b466ea27f1b647f9; no voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:54:47.132992 14906 raft_consensus.cc:2747] T d3f207cee78a43a1b5e030c09752c78c P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20250830 07:54:47.134678 13887 ts_tablet_manager.cc:1428] T 4b403cadfb7b42f8896b2ee16b50ecb1 P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.010s user 0.001s sys 0.001s
I20250830 07:54:47.135167 13887 tablet_bootstrap.cc:492] T 74ea2298876a4066b297915c135d4618 P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:54:47.136659 13887 tablet_bootstrap.cc:654] T 74ea2298876a4066b297915c135d4618 P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:47.137548 13614 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "04eadf45b82e4c319eb7b316a402d81a" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:47.137760 13614 raft_consensus.cc:2466] T 04eadf45b82e4c319eb7b316a402d81a P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 1.
I20250830 07:54:47.138985 13226 master_service.cc:948] ReplaceTablet: received request to replace tablet 8cce7e5537794e9484f5a7c82b9e6e1d from {username='slave'} at 127.0.0.1:42126
I20250830 07:54:47.141999 13226 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_34580b9f48b543d4bbdc0dd804e2dfbe"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:47.142725 13226 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_34580b9f48b543d4bbdc0dd804e2dfbe in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:47.144557 13482 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "01771fa171374e92892345e7402c33d1" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:54:47.144723 13482 raft_consensus.cc:2466] T 01771fa171374e92892345e7402c33d1 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 0.
I20250830 07:54:47.147810 13610 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "acca1a8240454b889c63c82d3c75087e" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:47.149058 13610 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f0144701d459480d96c1ece519951442" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9"
I20250830 07:54:47.149262 13610 raft_consensus.cc:3058] T f0144701d459480d96c1ece519951442 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:47.149544 13624 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "66d59910b4b2451a851e9d2728d50f42" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:47.150130 13624 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "01771fa171374e92892345e7402c33d1" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:47.151558 14950 consensus_queue.cc:1035] T 04eadf45b82e4c319eb7b316a402d81a P 2065c332f15a4739899af79f3669c3ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:54:47.151859 14950 raft_consensus.cc:491] T 74891b8103e144c486750f64ba2003f4 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:47.151948 14950 raft_consensus.cc:513] T 74891b8103e144c486750f64ba2003f4 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:47.152424 14950 leader_election.cc:290] T 74891b8103e144c486750f64ba2003f4 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
W20250830 07:54:47.153100 13422 leader_election.cc:343] T e4ca3110247640fbae4241448e8d5ef7 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:47.153870 14974 raft_consensus.cc:491] T 007435e198b9440db055711a98e3148a P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:47.153978 14974 raft_consensus.cc:513] T 007435e198b9440db055711a98e3148a P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:47.154704 14974 leader_election.cc:290] T 007435e198b9440db055711a98e3148a P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
I20250830 07:54:47.155681 13886 tablet_bootstrap.cc:492] T e6b7646588fe4134b2db62ff84ca4791 P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:54:47.155797 13886 ts_tablet_manager.cc:1397] T e6b7646588fe4134b2db62ff84ca4791 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.026s user 0.003s sys 0.000s
I20250830 07:54:47.155928 13703 leader_election.cc:304] T 04eadf45b82e4c319eb7b316a402d81a P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f; no voters:
I20250830 07:54:47.156186 13610 raft_consensus.cc:2466] T f0144701d459480d96c1ece519951442 P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 1.
I20250830 07:54:47.156208 14818 raft_consensus.cc:2802] T 04eadf45b82e4c319eb7b316a402d81a P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20250830 07:54:47.156282 14818 raft_consensus.cc:491] T 04eadf45b82e4c319eb7b316a402d81a P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2065c332f15a4739899af79f3669c3ba)
I20250830 07:54:47.156337 14818 raft_consensus.cc:3058] T 04eadf45b82e4c319eb7b316a402d81a P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Advancing to term 2
I20250830 07:54:47.156626 13886 raft_consensus.cc:357] T e6b7646588fe4134b2db62ff84ca4791 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:47.156774 13886 raft_consensus.cc:383] T e6b7646588fe4134b2db62ff84ca4791 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:47.156831 13886 raft_consensus.cc:738] T e6b7646588fe4134b2db62ff84ca4791 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:54:47.157059 13886 consensus_queue.cc:260] T e6b7646588fe4134b2db62ff84ca4791 P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:47.157472 13886 ts_tablet_manager.cc:1428] T e6b7646588fe4134b2db62ff84ca4791 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20250830 07:54:47.157699 13886 tablet_bootstrap.cc:492] T a41c1455404f4ed0a782a0c4ddd4140d P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:54:47.159194 14985 tablet.cc:1722] T 14ed24577c8f49f49c83242a26877614 P 6b5e454d98894637b466ea27f1b647f9: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250830 07:54:47.159401 14818 raft_consensus.cc:513] T 04eadf45b82e4c319eb7b316a402d81a P 9b057ade5dce45af9f8bf0bedf8b917f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:47.159878 14818 leader_election.cc:290] T 04eadf45b82e4c319eb7b316a402d81a P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 2 election: Requested vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
W20250830 07:54:47.161024 13703 leader_election.cc:343] T acca1a8240454b889c63c82d3c75087e P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:47.167202 14974 raft_consensus.cc:491] T c0147310dad84226808332a4c2c6e09d P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:47.167400 14974 raft_consensus.cc:513] T c0147310dad84226808332a4c2c6e09d P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:47.168032 14974 leader_election.cc:290] T c0147310dad84226808332a4c2c6e09d P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
I20250830 07:54:47.173787 13701 leader_election.cc:304] T acca1a8240454b889c63c82d3c75087e P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:54:47.177026 14943 raft_consensus.cc:2802] T acca1a8240454b889c63c82d3c75087e P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:54:47.177115 14943 raft_consensus.cc:491] T acca1a8240454b889c63c82d3c75087e P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:54:47.177196 14943 raft_consensus.cc:3058] T acca1a8240454b889c63c82d3c75087e P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:47.180405 14943 raft_consensus.cc:513] T acca1a8240454b889c63c82d3c75087e P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:47.180965 14943 leader_election.cc:290] T acca1a8240454b889c63c82d3c75087e P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Requested vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967)
I20250830 07:54:47.181880 13701 leader_election.cc:304] T f0144701d459480d96c1ece519951442 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters:
I20250830 07:54:47.183171 14974 raft_consensus.cc:2802] T f0144701d459480d96c1ece519951442 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election won for term 1
I20250830 07:54:47.183362 14974 raft_consensus.cc:695] T f0144701d459480d96c1ece519951442 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 LEADER]: Becoming Leader. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Running, Role: LEADER
I20250830 07:54:47.183676 14974 consensus_queue.cc:237] T f0144701d459480d96c1ece519951442 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:47.185575 13882 tablet_bootstrap.cc:492] T 0507245aa8c74aeb9f3eafba0682590d P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:54:47.185688 13882 ts_tablet_manager.cc:1397] T 0507245aa8c74aeb9f3eafba0682590d P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.127s user 0.010s sys 0.004s
W20250830 07:54:47.188194 13701 leader_election.cc:343] T a04bf79de30a42a98e71f622efc90c22 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): Not found: Tablet not found: a04bf79de30a42a98e71f622efc90c22
I20250830 07:54:47.189276 13701 leader_election.cc:304] T 66d59910b4b2451a851e9d2728d50f42 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters:
I20250830 07:54:47.189602 14943 raft_consensus.cc:2802] T 66d59910b4b2451a851e9d2728d50f42 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:54:47.189728 14943 raft_consensus.cc:491] T 66d59910b4b2451a851e9d2728d50f42 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:54:47.189860 14943 raft_consensus.cc:3058] T 66d59910b4b2451a851e9d2728d50f42 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:47.193313 14943 raft_consensus.cc:513] T 66d59910b4b2451a851e9d2728d50f42 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:47.194429 14943 leader_election.cc:290] T 66d59910b4b2451a851e9d2728d50f42 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Requested vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967)
I20250830 07:54:47.199824 13882 raft_consensus.cc:357] T 0507245aa8c74aeb9f3eafba0682590d P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:47.200042 13882 raft_consensus.cc:383] T 0507245aa8c74aeb9f3eafba0682590d P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:47.200124 13882 raft_consensus.cc:738] T 0507245aa8c74aeb9f3eafba0682590d P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:54:47.201233 13886 tablet_bootstrap.cc:654] T a41c1455404f4ed0a782a0c4ddd4140d P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:47.216835 13882 consensus_queue.cc:260] T 0507245aa8c74aeb9f3eafba0682590d P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:47.217275 13882 ts_tablet_manager.cc:1428] T 0507245aa8c74aeb9f3eafba0682590d P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.032s user 0.001s sys 0.001s
I20250830 07:54:47.217510 13882 tablet_bootstrap.cc:492] T c0147310dad84226808332a4c2c6e09d P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:54:47.218868 13882 tablet_bootstrap.cc:654] T c0147310dad84226808332a4c2c6e09d P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:47.220152 13701 leader_election.cc:304] T 01771fa171374e92892345e7402c33d1 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters:
I20250830 07:54:47.220657 14818 raft_consensus.cc:2802] T 01771fa171374e92892345e7402c33d1 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:54:47.220956 14818 raft_consensus.cc:491] T 01771fa171374e92892345e7402c33d1 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:54:47.221082 14818 raft_consensus.cc:3058] T 01771fa171374e92892345e7402c33d1 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:47.224242 14818 raft_consensus.cc:513] T 01771fa171374e92892345e7402c33d1 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:47.225394 14818 leader_election.cc:290] T 01771fa171374e92892345e7402c33d1 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Requested vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
W20250830 07:54:47.226809 13703 leader_election.cc:343] T a04bf79de30a42a98e71f622efc90c22 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Not found: Tablet not found: a04bf79de30a42a98e71f622efc90c22
I20250830 07:54:47.226972 13703 leader_election.cc:304] T a04bf79de30a42a98e71f622efc90c22 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 2065c332f15a4739899af79f3669c3ba, 6b5e454d98894637b466ea27f1b647f9
I20250830 07:54:47.227412 14972 raft_consensus.cc:2747] T a04bf79de30a42a98e71f622efc90c22 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20250830 07:54:47.227999 13703 leader_election.cc:343] T 66d59910b4b2451a851e9d2728d50f42 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
W20250830 07:54:47.228576 13703 leader_election.cc:343] T 01771fa171374e92892345e7402c33d1 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:47.231885 13767 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "09586fdda94c4aff9d3fa25d71fe6ac0" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
W20250830 07:54:47.233116 13423 leader_election.cc:343] T 01771fa171374e92892345e7402c33d1 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:47.233243 13423 leader_election.cc:304] T 01771fa171374e92892345e7402c33d1 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba; no voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:54:47.234081 14644 raft_consensus.cc:2747] T 01771fa171374e92892345e7402c33d1 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:54:47.234145 14869 raft_consensus.cc:491] T f52dd8eeb64a4b8a92babf34387b6c5b P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:47.235015 14869 raft_consensus.cc:513] T f52dd8eeb64a4b8a92babf34387b6c5b P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:47.235539 14869 leader_election.cc:290] T f52dd8eeb64a4b8a92babf34387b6c5b P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:47.242661 13617 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "09586fdda94c4aff9d3fa25d71fe6ac0" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:47.250387 13887 tablet_bootstrap.cc:492] T 74ea2298876a4066b297915c135d4618 P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:54:47.250519 13887 ts_tablet_manager.cc:1397] T 74ea2298876a4066b297915c135d4618 P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.116s user 0.016s sys 0.049s
I20250830 07:54:47.251139 13887 raft_consensus.cc:357] T 74ea2298876a4066b297915c135d4618 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:47.251279 13887 raft_consensus.cc:383] T 74ea2298876a4066b297915c135d4618 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:47.251329 13887 raft_consensus.cc:738] T 74ea2298876a4066b297915c135d4618 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:54:47.251470 13887 consensus_queue.cc:260] T 74ea2298876a4066b297915c135d4618 P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:47.255609 14943 raft_consensus.cc:491] T e6b7646588fe4134b2db62ff84ca4791 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:47.255764 14943 raft_consensus.cc:513] T e6b7646588fe4134b2db62ff84ca4791 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:47.256270 14943 leader_election.cc:290] T e6b7646588fe4134b2db62ff84ca4791 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
I20250830 07:54:47.256649 13887 ts_tablet_manager.cc:1428] T 74ea2298876a4066b297915c135d4618 P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
I20250830 07:54:47.256965 13887 tablet_bootstrap.cc:492] T aee84a97524e4568acdc4ae1c74fb492 P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
W20250830 07:54:47.259775 13423 leader_election.cc:343] T e6b7646588fe4134b2db62ff84ca4791 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:47.260000 13423 leader_election.cc:304] T e6b7646588fe4134b2db62ff84ca4791 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba; no voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f
W20250830 07:54:47.260507 13423 leader_election.cc:343] T 4828280e6fec4338b35422917966ac8c P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:47.260627 13423 leader_election.cc:304] T 4828280e6fec4338b35422917966ac8c P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba; no voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:54:47.260828 14869 raft_consensus.cc:2747] T e6b7646588fe4134b2db62ff84ca4791 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:54:47.260957 14869 raft_consensus.cc:2747] T 4828280e6fec4338b35422917966ac8c P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20250830 07:54:47.261003 13423 leader_election.cc:343] T e4ca3110247640fbae4241448e8d5ef7 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:47.261171 13886 tablet_bootstrap.cc:492] T a41c1455404f4ed0a782a0c4ddd4140d P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:54:47.261210 13423 leader_election.cc:304] T e4ca3110247640fbae4241448e8d5ef7 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba; no voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:54:47.261364 13886 ts_tablet_manager.cc:1397] T a41c1455404f4ed0a782a0c4ddd4140d P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.104s user 0.001s sys 0.001s
I20250830 07:54:47.261535 14869 raft_consensus.cc:2747] T e4ca3110247640fbae4241448e8d5ef7 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:54:47.262301 13886 raft_consensus.cc:357] T a41c1455404f4ed0a782a0c4ddd4140d P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:47.262506 13886 raft_consensus.cc:383] T a41c1455404f4ed0a782a0c4ddd4140d P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:47.262617 13886 raft_consensus.cc:738] T a41c1455404f4ed0a782a0c4ddd4140d P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:54:47.262881 13886 consensus_queue.cc:260] T a41c1455404f4ed0a782a0c4ddd4140d P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:47.263466 13886 ts_tablet_manager.cc:1428] T a41c1455404f4ed0a782a0c4ddd4140d P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20250830 07:54:47.263770 13886 tablet_bootstrap.cc:492] T 29f0695563854e45965a1cc36ac54138 P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:54:47.265674 13886 tablet_bootstrap.cc:654] T 29f0695563854e45965a1cc36ac54138 P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:47.267055 14974 raft_consensus.cc:491] T 856e644662334f8194ffef6ca1232248 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:47.267172 13887 tablet_bootstrap.cc:654] T aee84a97524e4568acdc4ae1c74fb492 P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:47.267325 14974 raft_consensus.cc:513] T 856e644662334f8194ffef6ca1232248 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:47.267958 14974 leader_election.cc:290] T 856e644662334f8194ffef6ca1232248 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
I20250830 07:54:47.270700 13610 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "74891b8103e144c486750f64ba2003f4" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:47.270727 13482 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "007435e198b9440db055711a98e3148a" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:54:47.271351 13887 tablet_bootstrap.cc:492] T aee84a97524e4568acdc4ae1c74fb492 P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:54:47.271793 13887 ts_tablet_manager.cc:1397] T aee84a97524e4568acdc4ae1c74fb492 P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.015s user 0.001s sys 0.003s
I20250830 07:54:47.272612 13887 raft_consensus.cc:357] T aee84a97524e4568acdc4ae1c74fb492 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:47.273653 13887 raft_consensus.cc:383] T aee84a97524e4568acdc4ae1c74fb492 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:47.273841 13887 raft_consensus.cc:738] T aee84a97524e4568acdc4ae1c74fb492 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:54:47.275682 13624 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f52dd8eeb64a4b8a92babf34387b6c5b" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:47.275620 13887 consensus_queue.cc:260] T aee84a97524e4568acdc4ae1c74fb492 P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:47.276238 13887 ts_tablet_manager.cc:1428] T aee84a97524e4568acdc4ae1c74fb492 P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.004s user 0.000s sys 0.001s
I20250830 07:54:47.276531 13887 tablet_bootstrap.cc:492] T 65f1ee59e6e9498381d686f16a865e23 P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:54:47.282050 13887 tablet_bootstrap.cc:654] T 65f1ee59e6e9498381d686f16a865e23 P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:47.286458 13886 tablet_bootstrap.cc:492] T 29f0695563854e45965a1cc36ac54138 P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:54:47.286646 13886 ts_tablet_manager.cc:1397] T 29f0695563854e45965a1cc36ac54138 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.023s user 0.002s sys 0.001s
I20250830 07:54:47.287463 13886 raft_consensus.cc:357] T 29f0695563854e45965a1cc36ac54138 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:47.288254 13886 raft_consensus.cc:383] T 29f0695563854e45965a1cc36ac54138 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:47.288344 13886 raft_consensus.cc:738] T 29f0695563854e45965a1cc36ac54138 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:54:47.288533 13886 consensus_queue.cc:260] T 29f0695563854e45965a1cc36ac54138 P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:47.288996 13886 ts_tablet_manager.cc:1428] T 29f0695563854e45965a1cc36ac54138 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20250830 07:54:47.289332 13886 tablet_bootstrap.cc:492] T 4c4a8eea119044b49e2b29f10a703097 P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:54:47.291006 13886 tablet_bootstrap.cc:654] T 4c4a8eea119044b49e2b29f10a703097 P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:47.292415 13617 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "04eadf45b82e4c319eb7b316a402d81a" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9"
I20250830 07:54:47.293794 13617 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "acca1a8240454b889c63c82d3c75087e" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9"
I20250830 07:54:47.292117 13624 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "007435e198b9440db055711a98e3148a" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:47.294679 13622 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "66d59910b4b2451a851e9d2728d50f42" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9"
I20250830 07:54:47.294727 14922 raft_consensus.cc:491] T 0507245aa8c74aeb9f3eafba0682590d P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:47.294999 13624 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "01771fa171374e92892345e7402c33d1" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9"
W20250830 07:54:47.295445 13423 leader_election.cc:343] T 09586fdda94c4aff9d3fa25d71fe6ac0 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
W20250830 07:54:47.297230 13423 leader_election.cc:343] T 74891b8103e144c486750f64ba2003f4 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
W20250830 07:54:47.300324 13423 leader_election.cc:343] T f52dd8eeb64a4b8a92babf34387b6c5b P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:47.295284 13610 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "c0147310dad84226808332a4c2c6e09d" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:47.300449 14922 raft_consensus.cc:513] T 0507245aa8c74aeb9f3eafba0682590d P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:47.301218 14922 leader_election.cc:290] T 0507245aa8c74aeb9f3eafba0682590d P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:47.301805 13614 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "e6b7646588fe4134b2db62ff84ca4791" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:47.301888 13624 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "856e644662334f8194ffef6ca1232248" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:47.303306 14984 tablet.cc:1722] T 14ed24577c8f49f49c83242a26877614 P 9b057ade5dce45af9f8bf0bedf8b917f: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250830 07:54:47.303705 13767 raft_consensus.cc:3058] T cb3c48982add45379c0e1b117ec40c1a P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
W20250830 07:54:47.310732 13703 leader_election.cc:343] T 66d59910b4b2451a851e9d2728d50f42 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
W20250830 07:54:47.311822 13703 leader_election.cc:343] T acca1a8240454b889c63c82d3c75087e P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
W20250830 07:54:47.312337 13703 leader_election.cc:343] T 01771fa171374e92892345e7402c33d1 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:47.312104 13775 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "0507245aa8c74aeb9f3eafba0682590d" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:47.312834 14943 consensus_queue.cc:1035] T 73853894da074ecd8147a94ac28bfab8 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20250830 07:54:47.313515 13703 leader_election.cc:343] T c0147310dad84226808332a4c2c6e09d P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:47.313750 14943 raft_consensus.cc:491] T e66e56ecdf14466282daab8c894eb3c6 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20250830 07:54:47.313788 13703 leader_election.cc:343] T e6b7646588fe4134b2db62ff84ca4791 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:47.313925 14943 raft_consensus.cc:513] T e66e56ecdf14466282daab8c894eb3c6 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
W20250830 07:54:47.314173 13703 leader_election.cc:343] T 856e644662334f8194ffef6ca1232248 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:47.314599 14943 leader_election.cc:290] T e66e56ecdf14466282daab8c894eb3c6 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
I20250830 07:54:47.316587 14943 raft_consensus.cc:491] T 6a82ea7078e344a497c34f932e139bcd P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:47.316752 14943 raft_consensus.cc:513] T 6a82ea7078e344a497c34f932e139bcd P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:47.317312 14943 leader_election.cc:290] T 6a82ea7078e344a497c34f932e139bcd P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
I20250830 07:54:47.317399 14985 tablet.cc:1722] T 7af74bdde363493f8061eba450ecf4b4 P 6b5e454d98894637b466ea27f1b647f9: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250830 07:54:47.318403 13477 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "04eadf45b82e4c319eb7b316a402d81a" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba"
I20250830 07:54:47.323835 14985 tablet.cc:1722] T f56cab43580a4ee3a912fc5e58a3bd9d P 6b5e454d98894637b466ea27f1b647f9: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250830 07:54:47.326745 13477 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "c0147310dad84226808332a4c2c6e09d" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:54:47.326956 13477 raft_consensus.cc:2466] T c0147310dad84226808332a4c2c6e09d P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 0.
I20250830 07:54:47.336982 14984 tablet.cc:1722] T 7af74bdde363493f8061eba450ecf4b4 P 9b057ade5dce45af9f8bf0bedf8b917f: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
W20250830 07:54:47.337736 13225 catalog_manager.cc:5415] Ignoring report from unknown tablet ff0f9cccc8ed43b1a8cd38de0e9d4097
W20250830 07:54:47.337872 13225 catalog_manager.cc:5415] Ignoring report from unknown tablet 04eadf45b82e4c319eb7b316a402d81a
W20250830 07:54:47.337924 13225 catalog_manager.cc:5415] Ignoring report from unknown tablet 44313f1a11b74e6d996cafd3c03d1836
W20250830 07:54:47.337997 13225 catalog_manager.cc:5415] Ignoring report from unknown tablet cf5613278b4c4f3bbe751b1ae6f3c313
W20250830 07:54:47.338069 13225 catalog_manager.cc:5415] Ignoring report from unknown tablet 66d59910b4b2451a851e9d2728d50f42
W20250830 07:54:47.338130 13225 catalog_manager.cc:5415] Ignoring report from unknown tablet 0507245aa8c74aeb9f3eafba0682590d
W20250830 07:54:47.338174 13225 catalog_manager.cc:5415] Ignoring report from unknown tablet 533811110191436d96665b3475ab597f
W20250830 07:54:47.341428 13232 catalog_manager.cc:5415] Ignoring report from unknown tablet 0507245aa8c74aeb9f3eafba0682590d
W20250830 07:54:47.341537 13232 catalog_manager.cc:5415] Ignoring report from unknown tablet ffc5945a032e47d4bd3397d7c887dc62
I20250830 07:54:47.342229 13226 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_cd8fedaf779b42a3982c1638c4147bae"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:47.342955 13226 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_cd8fedaf779b42a3982c1638c4147bae in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250830 07:54:47.343084 13232 catalog_manager.cc:5415] Ignoring report from unknown tablet b38c8d003413428dae9e47f58e197c2c
W20250830 07:54:47.343164 13232 catalog_manager.cc:5415] Ignoring report from unknown tablet d3f207cee78a43a1b5e030c09752c78c
W20250830 07:54:47.343232 13232 catalog_manager.cc:5415] Ignoring report from unknown tablet 007435e198b9440db055711a98e3148a
W20250830 07:54:47.343290 13232 catalog_manager.cc:5415] Ignoring report from unknown tablet e255d3fdee09400ead41ca835d6d103f
I20250830 07:54:47.343899 13232 catalog_manager.cc:5674] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967) does not have the latest schema for tablet f56cab43580a4ee3a912fc5e58a3bd9d (table default.Table_a2e96e9e547e4a07a6ccd9839e3d909c [id=6fc5c53b47c24f8283191be07f6f3cb1]). Expected version 1 got 0
I20250830 07:54:47.346088 13766 raft_consensus.cc:1238] T 04eadf45b82e4c319eb7b316a402d81a P 9b057ade5dce45af9f8bf0bedf8b917f [term 2 FOLLOWER]: Rejecting Update request from peer 2065c332f15a4739899af79f3669c3ba for earlier term 1. Current term is 2. Ops: []
I20250830 07:54:47.346433 13775 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "74891b8103e144c486750f64ba2003f4" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:47.346957 14943 raft_consensus.cc:491] T 2b4ce50fbd26484faba3faa2ec5115c0 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:47.347091 14943 raft_consensus.cc:513] T 2b4ce50fbd26484faba3faa2ec5115c0 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:47.347601 14943 leader_election.cc:290] T 2b4ce50fbd26484faba3faa2ec5115c0 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967)
I20250830 07:54:47.347760 14984 tablet.cc:1722] T f56cab43580a4ee3a912fc5e58a3bd9d P 9b057ade5dce45af9f8bf0bedf8b917f: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250830 07:54:47.348286 14943 raft_consensus.cc:491] T 44313f1a11b74e6d996cafd3c03d1836 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:47.348451 14943 raft_consensus.cc:513] T 44313f1a11b74e6d996cafd3c03d1836 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:47.348904 14943 leader_election.cc:290] T 44313f1a11b74e6d996cafd3c03d1836 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
I20250830 07:54:47.349472 13477 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "acca1a8240454b889c63c82d3c75087e" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba"
I20250830 07:54:47.349639 13477 raft_consensus.cc:3058] T acca1a8240454b889c63c82d3c75087e P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:47.352174 13477 raft_consensus.cc:2466] T acca1a8240454b889c63c82d3c75087e P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 1.
I20250830 07:54:47.354017 13477 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "66d59910b4b2451a851e9d2728d50f42" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba"
I20250830 07:54:47.354146 13477 raft_consensus.cc:3058] T 66d59910b4b2451a851e9d2728d50f42 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:47.356240 13624 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "e66e56ecdf14466282daab8c894eb3c6" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:47.356375 13477 raft_consensus.cc:2466] T 66d59910b4b2451a851e9d2728d50f42 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 1.
I20250830 07:54:47.356642 13610 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "6a82ea7078e344a497c34f932e139bcd" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:47.358319 13624 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "2b4ce50fbd26484faba3faa2ec5115c0" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:47.358835 13624 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "44313f1a11b74e6d996cafd3c03d1836" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
W20250830 07:54:47.372715 13703 leader_election.cc:343] T e66e56ecdf14466282daab8c894eb3c6 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
W20250830 07:54:47.376152 13703 leader_election.cc:343] T 6a82ea7078e344a497c34f932e139bcd P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
W20250830 07:54:47.376792 13703 leader_election.cc:343] T 2b4ce50fbd26484faba3faa2ec5115c0 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
W20250830 07:54:47.377039 13703 leader_election.cc:343] T 44313f1a11b74e6d996cafd3c03d1836 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:47.384707 13480 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "0507245aa8c74aeb9f3eafba0682590d" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:54:47.384887 13480 raft_consensus.cc:2391] T 0507245aa8c74aeb9f3eafba0682590d P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b5e454d98894637b466ea27f1b647f9 in current term 1: Already voted for candidate 9b057ade5dce45af9f8bf0bedf8b917f in this term.
I20250830 07:54:47.389552 13561 leader_election.cc:304] T 0507245aa8c74aeb9f3eafba0682590d P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b5e454d98894637b466ea27f1b647f9; no voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:54:47.400110 14924 raft_consensus.cc:3058] T 0507245aa8c74aeb9f3eafba0682590d P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:47.401979 14985 tablet.cc:1722] T 62ee2d0fbd774d38a4a4c4a033584ef9 P 6b5e454d98894637b466ea27f1b647f9: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250830 07:54:47.402472 14924 raft_consensus.cc:2747] T 0507245aa8c74aeb9f3eafba0682590d P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:54:47.403156 15012 tablet.cc:1722] T 14ed24577c8f49f49c83242a26877614 P 2065c332f15a4739899af79f3669c3ba: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250830 07:54:47.405059 14984 tablet.cc:1722] T 62ee2d0fbd774d38a4a4c4a033584ef9 P 9b057ade5dce45af9f8bf0bedf8b917f: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250830 07:54:47.405457 13486 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "e6b7646588fe4134b2db62ff84ca4791" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:54:47.405617 13486 raft_consensus.cc:2466] T e6b7646588fe4134b2db62ff84ca4791 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 0.
I20250830 07:54:47.405654 13484 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "01771fa171374e92892345e7402c33d1" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba"
I20250830 07:54:47.405757 13484 raft_consensus.cc:3058] T 01771fa171374e92892345e7402c33d1 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:47.405840 13480 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "856e644662334f8194ffef6ca1232248" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:54:47.405946 13480 raft_consensus.cc:2466] T 856e644662334f8194ffef6ca1232248 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 0.
I20250830 07:54:47.408754 13484 raft_consensus.cc:2466] T 01771fa171374e92892345e7402c33d1 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 1.
I20250830 07:54:47.410678 13764 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f52dd8eeb64a4b8a92babf34387b6c5b" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:47.424470 13882 tablet_bootstrap.cc:492] T c0147310dad84226808332a4c2c6e09d P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:54:47.424643 13882 ts_tablet_manager.cc:1397] T c0147310dad84226808332a4c2c6e09d P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.207s user 0.004s sys 0.013s
I20250830 07:54:47.425585 13882 raft_consensus.cc:357] T c0147310dad84226808332a4c2c6e09d P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:47.425784 13882 raft_consensus.cc:383] T c0147310dad84226808332a4c2c6e09d P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:47.425851 13882 raft_consensus.cc:738] T c0147310dad84226808332a4c2c6e09d P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:54:47.426066 13882 consensus_queue.cc:260] T c0147310dad84226808332a4c2c6e09d P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
W20250830 07:54:47.426868 13703 consensus_peers.cc:489] T e6491d149c0646848680cfdadb6fc76c P 9b057ade5dce45af9f8bf0bedf8b917f -> Peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Couldn't send request to peer 6b5e454d98894637b466ea27f1b647f9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20250830 07:54:47.428081 13882 ts_tablet_manager.cc:1428] T c0147310dad84226808332a4c2c6e09d P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20250830 07:54:47.431813 13882 tablet_bootstrap.cc:492] T e66e56ecdf14466282daab8c894eb3c6 P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:54:47.417361 13478 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "e66e56ecdf14466282daab8c894eb3c6" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:54:47.433349 13478 raft_consensus.cc:2466] T e66e56ecdf14466282daab8c894eb3c6 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 0.
I20250830 07:54:47.418396 13480 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "6a82ea7078e344a497c34f932e139bcd" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:54:47.433558 13480 raft_consensus.cc:2466] T 6a82ea7078e344a497c34f932e139bcd P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 0.
I20250830 07:54:47.424544 13481 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "2b4ce50fbd26484faba3faa2ec5115c0" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:54:47.433748 13481 raft_consensus.cc:2466] T 2b4ce50fbd26484faba3faa2ec5115c0 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 0.
I20250830 07:54:47.424721 15026 tablet.cc:1722] T f56cab43580a4ee3a912fc5e58a3bd9d P 2065c332f15a4739899af79f3669c3ba: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250830 07:54:47.425374 13482 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "44313f1a11b74e6d996cafd3c03d1836" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:54:47.426031 13887 tablet_bootstrap.cc:492] T 65f1ee59e6e9498381d686f16a865e23 P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:54:47.434468 13482 raft_consensus.cc:2466] T 44313f1a11b74e6d996cafd3c03d1836 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 0.
I20250830 07:54:47.434527 13886 tablet_bootstrap.cc:492] T 4c4a8eea119044b49e2b29f10a703097 P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:54:47.434659 13886 ts_tablet_manager.cc:1397] T 4c4a8eea119044b49e2b29f10a703097 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.145s user 0.024s sys 0.060s
I20250830 07:54:47.429939 15029 tablet.cc:1722] T 62ee2d0fbd774d38a4a4c4a033584ef9 P 2065c332f15a4739899af79f3669c3ba: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250830 07:54:47.434576 13887 ts_tablet_manager.cc:1397] T 65f1ee59e6e9498381d686f16a865e23 P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.158s user 0.011s sys 0.022s
I20250830 07:54:47.436064 13886 raft_consensus.cc:357] T 4c4a8eea119044b49e2b29f10a703097 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:47.436120 13887 raft_consensus.cc:357] T 65f1ee59e6e9498381d686f16a865e23 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:47.436271 13887 raft_consensus.cc:383] T 65f1ee59e6e9498381d686f16a865e23 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:47.436329 13887 raft_consensus.cc:738] T 65f1ee59e6e9498381d686f16a865e23 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:54:47.436419 13886 raft_consensus.cc:383] T 4c4a8eea119044b49e2b29f10a703097 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:47.436558 13886 raft_consensus.cc:738] T 4c4a8eea119044b49e2b29f10a703097 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:54:47.436525 13887 consensus_queue.cc:260] T 65f1ee59e6e9498381d686f16a865e23 P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:47.436935 13887 ts_tablet_manager.cc:1428] T 65f1ee59e6e9498381d686f16a865e23 P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20250830 07:54:47.436849 13886 consensus_queue.cc:260] T 4c4a8eea119044b49e2b29f10a703097 P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:47.437515 13886 ts_tablet_manager.cc:1428] T 4c4a8eea119044b49e2b29f10a703097 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20250830 07:54:47.437844 13886 tablet_bootstrap.cc:492] T 51cee993ce4249c0830b29cb1808fe80 P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:54:47.440199 13886 tablet_bootstrap.cc:654] T 51cee993ce4249c0830b29cb1808fe80 P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:47.440560 13887 tablet_bootstrap.cc:492] T 1e48641532cd439e9b4074712033c737 P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:54:47.441985 13887 tablet_bootstrap.cc:654] T 1e48641532cd439e9b4074712033c737 P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:47.447933 13886 tablet_bootstrap.cc:492] T 51cee993ce4249c0830b29cb1808fe80 P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:54:47.448115 13886 ts_tablet_manager.cc:1397] T 51cee993ce4249c0830b29cb1808fe80 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.010s user 0.004s sys 0.006s
I20250830 07:54:47.448750 13886 raft_consensus.cc:357] T 51cee993ce4249c0830b29cb1808fe80 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:47.448894 14818 raft_consensus.cc:491] T f1fe024f0de048a5a0931ee38752d5a1 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:47.448975 13886 raft_consensus.cc:383] T 51cee993ce4249c0830b29cb1808fe80 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:47.449079 13886 raft_consensus.cc:738] T 51cee993ce4249c0830b29cb1808fe80 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:54:47.449082 14818 raft_consensus.cc:513] T f1fe024f0de048a5a0931ee38752d5a1 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:47.449332 13886 consensus_queue.cc:260] T 51cee993ce4249c0830b29cb1808fe80 P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:47.449745 14818 leader_election.cc:290] T f1fe024f0de048a5a0931ee38752d5a1 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
I20250830 07:54:47.449863 13886 ts_tablet_manager.cc:1428] T 51cee993ce4249c0830b29cb1808fe80 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20250830 07:54:47.450130 13886 tablet_bootstrap.cc:492] T ec4a3975961d4f85ad9da94835417574 P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:54:47.450302 13624 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f1fe024f0de048a5a0931ee38752d5a1" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
W20250830 07:54:47.450737 13703 leader_election.cc:343] T f1fe024f0de048a5a0931ee38752d5a1 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:47.451704 13886 tablet_bootstrap.cc:654] T ec4a3975961d4f85ad9da94835417574 P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
W20250830 07:54:47.429399 13422 leader_election.cc:343] T 09586fdda94c4aff9d3fa25d71fe6ac0 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:47.453610 13422 leader_election.cc:304] T 09586fdda94c4aff9d3fa25d71fe6ac0 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba; no voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f
W20250830 07:54:47.454671 13422 leader_election.cc:343] T 74891b8103e144c486750f64ba2003f4 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:47.454764 13422 leader_election.cc:304] T 74891b8103e144c486750f64ba2003f4 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba; no voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:54:47.456777 13230 catalog_manager.cc:5674] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325) does not have the latest schema for tablet 99f307a8cbb34addaafab82b3ed18241 (table default.Table_4e2c5e0840fe4d3398519818e193f4dd [id=2a10f84461764fd5ab5a59499a370034]). Expected version 1 got 0
I20250830 07:54:47.457057 13230 catalog_manager.cc:5674] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325) does not have the latest schema for tablet 856e644662334f8194ffef6ca1232248 (table default.Table_5a48429e0b894a6ea2c01b3ce40de1e9 [id=fe3e5972240046eaa659a06b4eea8648]). Expected version 1 got 0
W20250830 07:54:47.458990 13230 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.12.209.1:41421 (request call id 102) took 1125 ms (client timeout 1000 ms). Trace:
I20250830 07:54:47.459055 14852 raft_consensus.cc:2747] T 09586fdda94c4aff9d3fa25d71fe6ac0 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20250830 07:54:47.459122 13230 rpcz_store.cc:269] 0830 07:54:46.333280 (+ 0us) service_pool.cc:168] Inserting onto call queue
0830 07:54:46.355775 (+ 22495us) service_pool.cc:225] Handling call
0830 07:54:46.368197 (+ 12422us) spinlock_profiling.cc:243] Waited 11 ms on lock 0x616000040f54. stack: 00007f4985b867d6 00007f4985b86590 00007f4984b793ad 0000000000972d94 0000000000972d5d 00007f499495114d 00007f4994951243 00007f4991610941 00007f499919ba5d 00007f499931f6d8 00007f4990159c86 00007f49901599b5 00007f498c9342ce 00007f498c9331ae 00007f498c9393e5 00007f498c939d0f
0830 07:54:47.458895 (+1090698us) inbound_call.cc:173] Queueing success response
Metrics: {"reported_tablets":6,"spinlock_wait_cycles":25393024}
I20250830 07:54:47.459199 14852 consensus_queue.cc:1046] T 04eadf45b82e4c319eb7b316a402d81a P 2065c332f15a4739899af79f3669c3ba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:54:47.459164 13599 tablet_service.cc:1468] Processing CreateTablet for tablet 7f749e9eb58b44408d70a5461f10a3ef (DEFAULT_TABLE table=default.Table_2631f1f3da404c52b362b8093acbf4a9 [id=828a0f6bc6d64100aeb31e83bf6d16ee]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:47.459437 14852 raft_consensus.cc:2747] T 74891b8103e144c486750f64ba2003f4 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:54:47.459550 14852 raft_consensus.cc:3053] T 04eadf45b82e4c319eb7b316a402d81a P 2065c332f15a4739899af79f3669c3ba [term 1 LEADER]: Stepping down as leader of term 1
I20250830 07:54:47.459604 13599 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f749e9eb58b44408d70a5461f10a3ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:47.459597 14852 raft_consensus.cc:738] T 04eadf45b82e4c319eb7b316a402d81a P 2065c332f15a4739899af79f3669c3ba [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Running, Role: LEADER
I20250830 07:54:47.459807 14852 consensus_queue.cc:260] T 04eadf45b82e4c319eb7b316a402d81a P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:47.460170 14852 raft_consensus.cc:3058] T 04eadf45b82e4c319eb7b316a402d81a P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Advancing to term 2
I20250830 07:54:47.460474 13225 catalog_manager.cc:5674] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743) does not have the latest schema for tablet 69d6daeb7c774fd48ed296f52ed7c6a6 (table default.Table_c8fac6974ea94c7e863c1ded184f9230 [id=761247d93d9f4f788ecceabebf1de486]). Expected version 3 got 0
I20250830 07:54:47.460692 13225 catalog_manager.cc:5674] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743) does not have the latest schema for tablet 856e644662334f8194ffef6ca1232248 (table default.Table_5a48429e0b894a6ea2c01b3ce40de1e9 [id=fe3e5972240046eaa659a06b4eea8648]). Expected version 1 got 0
I20250830 07:54:47.460947 13886 tablet_bootstrap.cc:492] T ec4a3975961d4f85ad9da94835417574 P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:54:47.461076 13886 ts_tablet_manager.cc:1397] T ec4a3975961d4f85ad9da94835417574 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.011s user 0.004s sys 0.004s
I20250830 07:54:47.462186 13886 raft_consensus.cc:357] T ec4a3975961d4f85ad9da94835417574 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:47.462338 13886 raft_consensus.cc:383] T ec4a3975961d4f85ad9da94835417574 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:47.462493 13886 raft_consensus.cc:738] T ec4a3975961d4f85ad9da94835417574 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:54:47.462683 13886 consensus_queue.cc:260] T ec4a3975961d4f85ad9da94835417574 P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:47.463109 13886 ts_tablet_manager.cc:1428] T ec4a3975961d4f85ad9da94835417574 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
W20250830 07:54:47.463114 13422 leader_election.cc:343] T f52dd8eeb64a4b8a92babf34387b6c5b P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:47.463199 13422 leader_election.cc:304] T f52dd8eeb64a4b8a92babf34387b6c5b P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba; no voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:54:47.463385 14869 raft_consensus.cc:2747] T f52dd8eeb64a4b8a92babf34387b6c5b P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:54:47.463389 13749 tablet_service.cc:1468] Processing CreateTablet for tablet 7f749e9eb58b44408d70a5461f10a3ef (DEFAULT_TABLE table=default.Table_2631f1f3da404c52b362b8093acbf4a9 [id=828a0f6bc6d64100aeb31e83bf6d16ee]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:47.463446 13591 tablet_service.cc:1468] Processing CreateTablet for tablet 669e649b53984db3bad8c6121f39fb73 (DEFAULT_TABLE table=default.Table_cacba29065c242789ac3e0da29384aa3 [id=5efb3235048e43e7bd068bfd1b7fc8fa]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:47.463732 13591 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 669e649b53984db3bad8c6121f39fb73. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:47.463768 13701 leader_election.cc:304] T 007435e198b9440db055711a98e3148a P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 2065c332f15a4739899af79f3669c3ba, 6b5e454d98894637b466ea27f1b647f9
I20250830 07:54:47.464047 14818 raft_consensus.cc:2747] T 007435e198b9440db055711a98e3148a P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20250830 07:54:47.465400 13701 leader_election.cc:304] T 04eadf45b82e4c319eb7b316a402d81a P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 2065c332f15a4739899af79f3669c3ba, 6b5e454d98894637b466ea27f1b647f9
I20250830 07:54:47.465600 14818 raft_consensus.cc:2747] T 04eadf45b82e4c319eb7b316a402d81a P 9b057ade5dce45af9f8bf0bedf8b917f [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20250830 07:54:47.465890 13701 leader_election.cc:304] T c0147310dad84226808332a4c2c6e09d P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:54:47.466728 13746 tablet_service.cc:1468] Processing CreateTablet for tablet 669e649b53984db3bad8c6121f39fb73 (DEFAULT_TABLE table=default.Table_cacba29065c242789ac3e0da29384aa3 [id=5efb3235048e43e7bd068bfd1b7fc8fa]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:47.467183 13592 tablet_service.cc:1468] Processing CreateTablet for tablet cf75d4190d30460f811ce563b16e334b (DEFAULT_TABLE table=default.Table_543efd84df20400db7e11d80065e2720 [id=202c8414ffd94effa5bc293358cb3119]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:47.467454 13592 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf75d4190d30460f811ce563b16e334b. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:47.468456 14818 raft_consensus.cc:2802] T c0147310dad84226808332a4c2c6e09d P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:54:47.468559 14818 raft_consensus.cc:491] T c0147310dad84226808332a4c2c6e09d P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:54:47.468657 14818 raft_consensus.cc:3058] T c0147310dad84226808332a4c2c6e09d P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:47.469626 13458 tablet_service.cc:1468] Processing CreateTablet for tablet 7f749e9eb58b44408d70a5461f10a3ef (DEFAULT_TABLE table=default.Table_2631f1f3da404c52b362b8093acbf4a9 [id=828a0f6bc6d64100aeb31e83bf6d16ee]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:47.470224 13608 tablet_service.cc:1468] Processing CreateTablet for tablet 581ae087d60d45e291d899fa03fb89e2 (DEFAULT_TABLE table=default.Table_b3bbd69f2357492c8a10ce75ea4c393a [id=33f23cf0e39d4d8989a07f506101442d]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:47.470449 13608 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 581ae087d60d45e291d899fa03fb89e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:47.470875 14745 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20250830 07:54:47.471498 14818 raft_consensus.cc:513] T c0147310dad84226808332a4c2c6e09d P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:47.471897 14745 env_posix.cc:2264] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20250830 07:54:47.472023 14818 leader_election.cc:290] T c0147310dad84226808332a4c2c6e09d P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Requested vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
I20250830 07:54:47.472209 14745 kserver.cc:163] Server-wide thread pool size limit: 3276
I20250830 07:54:47.472369 13701 leader_election.cc:304] T acca1a8240454b889c63c82d3c75087e P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:54:47.472700 13742 tablet_service.cc:1468] Processing CreateTablet for tablet cf75d4190d30460f811ce563b16e334b (DEFAULT_TABLE table=default.Table_543efd84df20400db7e11d80065e2720 [id=202c8414ffd94effa5bc293358cb3119]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:47.473050 13752 tablet_service.cc:1468] Processing CreateTablet for tablet 581ae087d60d45e291d899fa03fb89e2 (DEFAULT_TABLE table=default.Table_b3bbd69f2357492c8a10ce75ea4c393a [id=33f23cf0e39d4d8989a07f506101442d]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:47.473155 13742 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf75d4190d30460f811ce563b16e334b. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:47.473371 13752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 581ae087d60d45e291d899fa03fb89e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:47.473444 13468 tablet_service.cc:1468] Processing CreateTablet for tablet 669e649b53984db3bad8c6121f39fb73 (DEFAULT_TABLE table=default.Table_cacba29065c242789ac3e0da29384aa3 [id=5efb3235048e43e7bd068bfd1b7fc8fa]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:47.474054 13886 tablet_bootstrap.cc:492] T d6afa1ad4791429ba96ee81583dcee64 P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:54:47.474213 13459 tablet_service.cc:1468] Processing CreateTablet for tablet cf75d4190d30460f811ce563b16e334b (DEFAULT_TABLE table=default.Table_543efd84df20400db7e11d80065e2720 [id=202c8414ffd94effa5bc293358cb3119]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:47.474759 13456 tablet_service.cc:1515] Processing DeleteTablet for tablet e4ca3110247640fbae4241448e8d5ef7 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:42 UTC) from {username='slave'} at 127.0.0.1:37956
I20250830 07:54:47.475793 13886 tablet_bootstrap.cc:654] T d6afa1ad4791429ba96ee81583dcee64 P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:47.479154 13741 tablet_service.cc:1515] Processing DeleteTablet for tablet f1fe024f0de048a5a0931ee38752d5a1 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:42 UTC) from {username='slave'} at 127.0.0.1:45460
I20250830 07:54:47.480463 13746 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 669e649b53984db3bad8c6121f39fb73. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:47.480728 13749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f749e9eb58b44408d70a5461f10a3ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:47.486542 15034 tablet_replica.cc:331] T e4ca3110247640fbae4241448e8d5ef7 P 2065c332f15a4739899af79f3669c3ba: stopping tablet replica
I20250830 07:54:47.486718 15034 raft_consensus.cc:2241] T e4ca3110247640fbae4241448e8d5ef7 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Raft consensus shutting down.
I20250830 07:54:47.486882 15034 raft_consensus.cc:2270] T e4ca3110247640fbae4241448e8d5ef7 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Raft consensus is shut down!
I20250830 07:54:47.487365 15034 ts_tablet_manager.cc:1905] T e4ca3110247640fbae4241448e8d5ef7 P 2065c332f15a4739899af79f3669c3ba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250830 07:54:47.490900 13230 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_ecc415dc4d894e3c851f48708e0c22c3" } new_table_name: "default.Table_be6d695eba4f47e19d74094c4f16ee02" modify_external_catalogs: true
I20250830 07:54:47.492133 13886 tablet_bootstrap.cc:492] T d6afa1ad4791429ba96ee81583dcee64 P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:54:47.492269 13886 ts_tablet_manager.cc:1397] T d6afa1ad4791429ba96ee81583dcee64 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.018s user 0.005s sys 0.005s
I20250830 07:54:47.492307 13225 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_fe33866fc1ed45899e8aaa719eab9640" } new_table_name: "default.Table_525d900516e748b1ad533d8a38492d5a" modify_external_catalogs: true
I20250830 07:54:47.496243 13624 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "c0147310dad84226808332a4c2c6e09d" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9"
I20250830 07:54:47.496394 13624 raft_consensus.cc:3058] T c0147310dad84226808332a4c2c6e09d P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:47.497525 13456 tablet_service.cc:1468] Processing CreateTablet for tablet 581ae087d60d45e291d899fa03fb89e2 (DEFAULT_TABLE table=default.Table_b3bbd69f2357492c8a10ce75ea4c393a [id=33f23cf0e39d4d8989a07f506101442d]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:47.498114 13453 tablet_service.cc:1468] Processing CreateTablet for tablet 930081bb13454b85ae17bbc4b2b59053 (DEFAULT_TABLE table=default.Table_c9cd695063014e7eb11e8aa6f932505c [id=a0c22ad6e1e743479543af70237a9df8]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:47.498574 13624 raft_consensus.cc:2466] T c0147310dad84226808332a4c2c6e09d P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 1.
I20250830 07:54:47.498950 13601 tablet_service.cc:1468] Processing CreateTablet for tablet 473fcf65d49b42dabe9b787cee681f76 (DEFAULT_TABLE table=default.Table_fa88ef9c651348d287efdd7af42e9526 [id=7cba2a8f1e6344daaf748a4c36fa7c85]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:47.499284 13601 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 473fcf65d49b42dabe9b787cee681f76. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:47.498663 13454 tablet_service.cc:1468] Processing CreateTablet for tablet 78a8df3642224d99a86637c1a3a9de5c (DEFAULT_TABLE table=default.Table_8a9281237b4a4a5fb5e460f64531ea37 [id=cb6379aed9f94346a9d15ec3b7563766]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:47.499890 13450 tablet_service.cc:1468] Processing CreateTablet for tablet 473fcf65d49b42dabe9b787cee681f76 (DEFAULT_TABLE table=default.Table_fa88ef9c651348d287efdd7af42e9526 [id=7cba2a8f1e6344daaf748a4c36fa7c85]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:47.500483 13461 tablet_service.cc:1468] Processing CreateTablet for tablet becf9667a0fc4507bc114407090c055c (DEFAULT_TABLE table=default.Table_800922101ede43af952ed138bc5b9e1e [id=09050cc21e474d8cbe0d47f657651b54]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:47.501207 13452 tablet_service.cc:1468] Processing CreateTablet for tablet f0b5a16ef15e466d908a623e64391a0f (DEFAULT_TABLE table=default.Table_38c9c9f1bfb24082854dfb1f7d0b112f [id=db215153a41943e1abcfe63a8a41763b]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:47.501746 13451 tablet_service.cc:1468] Processing CreateTablet for tablet 529e743ea8ba4dcb879dad1d28087486 (DEFAULT_TABLE table=default.Table_e40f799d6135436c83693f971a69ee0d [id=a009e77538bf4240a7cb6f1e575454b3]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:47.503119 13593 tablet_service.cc:1468] Processing CreateTablet for tablet becf9667a0fc4507bc114407090c055c (DEFAULT_TABLE table=default.Table_800922101ede43af952ed138bc5b9e1e [id=09050cc21e474d8cbe0d47f657651b54]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:47.503389 13593 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet becf9667a0fc4507bc114407090c055c. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:47.504995 13449 tablet_service.cc:1468] Processing CreateTablet for tablet 7efdf13fd50d419da921c28e21c25757 (DEFAULT_TABLE table=default.Table_f440bd2200c547deb37ad7cba486eb5a [id=0caf828cfe2548c5b4e058b766c0aea3]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:47.505618 13882 tablet_bootstrap.cc:654] T e66e56ecdf14466282daab8c894eb3c6 P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:47.505584 13462 tablet_service.cc:1468] Processing CreateTablet for tablet 9b9631c8038a4c6eb9fd0530511777ac (DEFAULT_TABLE table=default.Table_215b7f39935142a88ce385ee6fc0a5c6 [id=64650700a5eb4daeaa2a38be73a56bf9]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:47.505697 13592 tablet_service.cc:1468] Processing CreateTablet for tablet 9f27983af2c84dd6a40e7e0b900a9dc6 (DEFAULT_TABLE table=default.Table_f3e7b6dfb1fc4dc2be4da90c976b21dd [id=0e1d9a24febe4035ae03aa19db5f69dc]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:47.505963 13592 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f27983af2c84dd6a40e7e0b900a9dc6. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:47.506160 13455 tablet_service.cc:1468] Processing CreateTablet for tablet 9f27983af2c84dd6a40e7e0b900a9dc6 (DEFAULT_TABLE table=default.Table_f3e7b6dfb1fc4dc2be4da90c976b21dd [id=0e1d9a24febe4035ae03aa19db5f69dc]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:47.507112 13598 tablet_service.cc:1468] Processing CreateTablet for tablet f0b5a16ef15e466d908a623e64391a0f (DEFAULT_TABLE table=default.Table_38c9c9f1bfb24082854dfb1f7d0b112f [id=db215153a41943e1abcfe63a8a41763b]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:47.507359 13598 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0b5a16ef15e466d908a623e64391a0f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:47.507473 13232 catalog_manager.cc:6127] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: default.Table_4428c29c8358411282f00fd33a6badd4 [id=bcee72f9b1c6407f98435a1494b42407] alter complete (version 1)
I20250830 07:54:47.509645 14818 raft_consensus.cc:2802] T acca1a8240454b889c63c82d3c75087e P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election won for term 1
I20250830 07:54:47.509840 14818 raft_consensus.cc:695] T acca1a8240454b889c63c82d3c75087e P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 LEADER]: Becoming Leader. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Running, Role: LEADER
I20250830 07:54:47.510066 14818 consensus_queue.cc:237] T acca1a8240454b889c63c82d3c75087e P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:47.511123 13595 tablet_service.cc:1468] Processing CreateTablet for tablet 529e743ea8ba4dcb879dad1d28087486 (DEFAULT_TABLE table=default.Table_e40f799d6135436c83693f971a69ee0d [id=a009e77538bf4240a7cb6f1e575454b3]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:47.511404 13595 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 529e743ea8ba4dcb879dad1d28087486. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:47.511797 13591 tablet_service.cc:1468] Processing CreateTablet for tablet 9b9631c8038a4c6eb9fd0530511777ac (DEFAULT_TABLE table=default.Table_215b7f39935142a88ce385ee6fc0a5c6 [id=64650700a5eb4daeaa2a38be73a56bf9]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:47.512051 13591 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b9631c8038a4c6eb9fd0530511777ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:47.515149 13604 tablet_service.cc:1468] Processing CreateTablet for tablet 7efdf13fd50d419da921c28e21c25757 (DEFAULT_TABLE table=default.Table_f440bd2200c547deb37ad7cba486eb5a [id=0caf828cfe2548c5b4e058b766c0aea3]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:47.515306 13886 raft_consensus.cc:357] T d6afa1ad4791429ba96ee81583dcee64 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:47.515408 13604 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7efdf13fd50d419da921c28e21c25757. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:47.515486 13886 raft_consensus.cc:383] T d6afa1ad4791429ba96ee81583dcee64 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:47.515554 13886 raft_consensus.cc:738] T d6afa1ad4791429ba96ee81583dcee64 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:54:47.515655 13701 leader_election.cc:304] T 66d59910b4b2451a851e9d2728d50f42 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:54:47.515982 14975 raft_consensus.cc:2802] T 66d59910b4b2451a851e9d2728d50f42 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election won for term 1
I20250830 07:54:47.516083 14975 raft_consensus.cc:695] T 66d59910b4b2451a851e9d2728d50f42 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 LEADER]: Becoming Leader. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Running, Role: LEADER
I20250830 07:54:47.516300 14975 consensus_queue.cc:237] T 66d59910b4b2451a851e9d2728d50f42 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:47.516330 14943 consensus_queue.cc:1035] T 73853894da074ecd8147a94ac28bfab8 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:54:47.516975 13701 leader_election.cc:304] T e6b7646588fe4134b2db62ff84ca4791 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:54:47.517216 14943 raft_consensus.cc:2802] T e6b7646588fe4134b2db62ff84ca4791 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:54:47.517330 14943 raft_consensus.cc:491] T e6b7646588fe4134b2db62ff84ca4791 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:54:47.517421 14943 raft_consensus.cc:3058] T e6b7646588fe4134b2db62ff84ca4791 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:47.519318 13590 tablet_service.cc:1468] Processing CreateTablet for tablet 8921c85fefac415f9a4e5bb7dc38a134 (DEFAULT_TABLE table=default.Table_2a1215c34df8484ca99228faa7e3747b [id=1d912dffe17c43738af7f48d8a8cc1a2]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:47.519718 13590 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8921c85fefac415f9a4e5bb7dc38a134. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:47.520152 14943 raft_consensus.cc:513] T e6b7646588fe4134b2db62ff84ca4791 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:47.515866 13886 consensus_queue.cc:260] T d6afa1ad4791429ba96ee81583dcee64 P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:47.520970 14943 leader_election.cc:290] T e6b7646588fe4134b2db62ff84ca4791 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Requested vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
I20250830 07:54:47.521340 13886 ts_tablet_manager.cc:1428] T d6afa1ad4791429ba96ee81583dcee64 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.029s user 0.001s sys 0.001s
I20250830 07:54:47.521597 13886 tablet_bootstrap.cc:492] T 4828280e6fec4338b35422917966ac8c P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:54:47.523177 13886 tablet_bootstrap.cc:654] T 4828280e6fec4338b35422917966ac8c P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:47.526023 13752 tablet_service.cc:1468] Processing CreateTablet for tablet 930081bb13454b85ae17bbc4b2b59053 (DEFAULT_TABLE table=default.Table_c9cd695063014e7eb11e8aa6f932505c [id=a0c22ad6e1e743479543af70237a9df8]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:47.526319 13752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 930081bb13454b85ae17bbc4b2b59053. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:47.534142 13608 tablet_service.cc:1468] Processing CreateTablet for tablet 78a8df3642224d99a86637c1a3a9de5c (DEFAULT_TABLE table=default.Table_8a9281237b4a4a5fb5e460f64531ea37 [id=cb6379aed9f94346a9d15ec3b7563766]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:47.534657 13703 leader_election.cc:304] T c0147310dad84226808332a4c2c6e09d P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f; no voters:
I20250830 07:54:47.535246 14943 raft_consensus.cc:2802] T c0147310dad84226808332a4c2c6e09d P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election won for term 1
I20250830 07:54:47.535440 14943 raft_consensus.cc:695] T c0147310dad84226808332a4c2c6e09d P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 LEADER]: Becoming Leader. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Running, Role: LEADER
I20250830 07:54:47.535679 14943 consensus_queue.cc:237] T c0147310dad84226808332a4c2c6e09d P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:47.536280 15026 tablet.cc:1722] T 7af74bdde363493f8061eba450ecf4b4 P 2065c332f15a4739899af79f3669c3ba: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250830 07:54:47.537257 13608 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78a8df3642224d99a86637c1a3a9de5c. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:47.540426 13458 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f749e9eb58b44408d70a5461f10a3ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:47.540885 13468 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 669e649b53984db3bad8c6121f39fb73. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:47.541293 13459 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf75d4190d30460f811ce563b16e334b. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:47.541651 13456 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 581ae087d60d45e291d899fa03fb89e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:47.542045 13453 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 930081bb13454b85ae17bbc4b2b59053. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:47.542390 13454 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78a8df3642224d99a86637c1a3a9de5c. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:47.542768 13450 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 473fcf65d49b42dabe9b787cee681f76. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:47.542732 13624 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "e6b7646588fe4134b2db62ff84ca4791" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9"
I20250830 07:54:47.543141 13461 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet becf9667a0fc4507bc114407090c055c. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:47.543187 13601 tablet_service.cc:1468] Processing CreateTablet for tablet aab8d9a009d34166920905ad06ed153b (DEFAULT_TABLE table=default.Table_b209e8dbb7be40408440ef087e11bbd4 [id=c80ac1ec788b4318989aecb0b5032526]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:47.543437 13601 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aab8d9a009d34166920905ad06ed153b. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:47.543526 13452 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0b5a16ef15e466d908a623e64391a0f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:47.543897 13451 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 529e743ea8ba4dcb879dad1d28087486. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:47.544329 13449 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7efdf13fd50d419da921c28e21c25757. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:47.544674 13462 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b9631c8038a4c6eb9fd0530511777ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:47.545112 13455 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f27983af2c84dd6a40e7e0b900a9dc6. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:47.545312 15036 tablet_replica.cc:331] T f1fe024f0de048a5a0931ee38752d5a1 P 9b057ade5dce45af9f8bf0bedf8b917f: stopping tablet replica
I20250830 07:54:47.545480 15036 raft_consensus.cc:2241] T f1fe024f0de048a5a0931ee38752d5a1 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Raft consensus shutting down.
I20250830 07:54:47.545604 15036 raft_consensus.cc:2270] T f1fe024f0de048a5a0931ee38752d5a1 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Raft consensus is shut down!
I20250830 07:54:47.547070 13599 tablet_service.cc:1468] Processing CreateTablet for tablet 930081bb13454b85ae17bbc4b2b59053 (DEFAULT_TABLE table=default.Table_c9cd695063014e7eb11e8aa6f932505c [id=a0c22ad6e1e743479543af70237a9df8]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:47.547338 13599 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 930081bb13454b85ae17bbc4b2b59053. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:47.548910 13741 tablet_service.cc:1468] Processing CreateTablet for tablet 78a8df3642224d99a86637c1a3a9de5c (DEFAULT_TABLE table=default.Table_8a9281237b4a4a5fb5e460f64531ea37 [id=cb6379aed9f94346a9d15ec3b7563766]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:47.549295 13741 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78a8df3642224d99a86637c1a3a9de5c. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:47.551584 13598 tablet_service.cc:1468] Processing CreateTablet for tablet 736de5dbaf7f4f449f6fc323ab6a72d8 (DEFAULT_TABLE table=default.Table_3c2f79a13fe642769065e2bc5fb22872 [id=177b8299ef08486ca4d9788f309e5c11]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:47.551862 13598 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 736de5dbaf7f4f449f6fc323ab6a72d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:47.552184 15036 ts_tablet_manager.cc:1905] T f1fe024f0de048a5a0931ee38752d5a1 P 9b057ade5dce45af9f8bf0bedf8b917f: Deleting tablet data with delete state TABLET_DATA_DELETED
W20250830 07:54:47.555593 13703 leader_election.cc:343] T e6b7646588fe4134b2db62ff84ca4791 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:47.556568 13882 tablet_bootstrap.cc:492] T e66e56ecdf14466282daab8c894eb3c6 P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:54:47.556667 13882 ts_tablet_manager.cc:1397] T e66e56ecdf14466282daab8c894eb3c6 P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.125s user 0.001s sys 0.001s
I20250830 07:54:47.557212 13604 tablet_service.cc:1468] Processing CreateTablet for tablet 51aecb7681034f7ca67039ca86a0a618 (DEFAULT_TABLE table=default.Table_ecc415dc4d894e3c851f48708e0c22c3 [id=439a6d953d5645e7827b6103f9b65e56]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:47.557327 13882 raft_consensus.cc:357] T e66e56ecdf14466282daab8c894eb3c6 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:47.557457 13882 raft_consensus.cc:383] T e66e56ecdf14466282daab8c894eb3c6 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:47.557495 13882 raft_consensus.cc:738] T e66e56ecdf14466282daab8c894eb3c6 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:54:47.557509 13604 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 51aecb7681034f7ca67039ca86a0a618. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:47.557786 13882 consensus_queue.cc:260] T e66e56ecdf14466282daab8c894eb3c6 P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:47.558956 13882 ts_tablet_manager.cc:1428] T e66e56ecdf14466282daab8c894eb3c6 P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20250830 07:54:47.559084 13591 tablet_service.cc:1468] Processing CreateTablet for tablet 533f17f5a9104a6582d9682287c9f1f7 (DEFAULT_TABLE table=default.Table_3fbed79aa89e46a380f08c35b61be998 [id=f50f57edefaa444b9fb30986bb25db44]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:47.559307 13882 tablet_bootstrap.cc:492] T e6491d149c0646848680cfdadb6fc76c P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:54:47.559372 13591 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 533f17f5a9104a6582d9682287c9f1f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:47.559868 13701 leader_election.cc:304] T 856e644662334f8194ffef6ca1232248 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:54:47.560201 14974 raft_consensus.cc:2802] T 856e644662334f8194ffef6ca1232248 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:54:47.560307 14974 raft_consensus.cc:491] T 856e644662334f8194ffef6ca1232248 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:54:47.560408 14974 raft_consensus.cc:3058] T 856e644662334f8194ffef6ca1232248 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:47.563585 14974 raft_consensus.cc:513] T 856e644662334f8194ffef6ca1232248 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:47.564489 14974 leader_election.cc:290] T 856e644662334f8194ffef6ca1232248 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Requested vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
I20250830 07:54:47.566111 13595 tablet_service.cc:1468] Processing CreateTablet for tablet ef409101e58e46ef9e7d430a32ddbc06 (DEFAULT_TABLE table=default.Table_853367df8be040c2ac006a7215f9792e [id=c150350f33d74d08bf68f9d028f86501]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:47.566395 13595 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef409101e58e46ef9e7d430a32ddbc06. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:47.566354 13610 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "856e644662334f8194ffef6ca1232248" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9"
I20250830 07:54:47.566694 14852 raft_consensus.cc:491] T 74ea2298876a4066b297915c135d4618 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:47.566821 14852 raft_consensus.cc:513] T 74ea2298876a4066b297915c135d4618 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:47.567027 13742 tablet_service.cc:1468] Processing CreateTablet for tablet becf9667a0fc4507bc114407090c055c (DEFAULT_TABLE table=default.Table_800922101ede43af952ed138bc5b9e1e [id=09050cc21e474d8cbe0d47f657651b54]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:47.567356 13742 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet becf9667a0fc4507bc114407090c055c. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:47.567348 14852 leader_election.cc:290] T 74ea2298876a4066b297915c135d4618 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:47.567947 13465 tablet_service.cc:1468] Processing CreateTablet for tablet 8921c85fefac415f9a4e5bb7dc38a134 (DEFAULT_TABLE table=default.Table_2a1215c34df8484ca99228faa7e3747b [id=1d912dffe17c43738af7f48d8a8cc1a2]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:47.568471 13457 tablet_service.cc:1468] Processing CreateTablet for tablet aab8d9a009d34166920905ad06ed153b (DEFAULT_TABLE table=default.Table_b209e8dbb7be40408440ef087e11bbd4 [id=c80ac1ec788b4318989aecb0b5032526]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:47.568928 13466 tablet_service.cc:1468] Processing CreateTablet for tablet 0b574113fee342f98c5574703440ba3a (DEFAULT_TABLE table=default.Table_d07e338c217149ec81b084cb18a19650 [id=88bbd3e0547947f4b67daf43f3cc7f86]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:47.569449 13463 tablet_service.cc:1468] Processing CreateTablet for tablet 736de5dbaf7f4f449f6fc323ab6a72d8 (DEFAULT_TABLE table=default.Table_3c2f79a13fe642769065e2bc5fb22872 [id=177b8299ef08486ca4d9788f309e5c11]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:47.570187 13467 tablet_service.cc:1468] Processing CreateTablet for tablet 51aecb7681034f7ca67039ca86a0a618 (DEFAULT_TABLE table=default.Table_ecc415dc4d894e3c851f48708e0c22c3 [id=439a6d953d5645e7827b6103f9b65e56]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:47.570667 13464 tablet_service.cc:1468] Processing CreateTablet for tablet 533f17f5a9104a6582d9682287c9f1f7 (DEFAULT_TABLE table=default.Table_3fbed79aa89e46a380f08c35b61be998 [id=f50f57edefaa444b9fb30986bb25db44]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:47.571199 13593 tablet_service.cc:1468] Processing CreateTablet for tablet 835bb0ae1a49413a9d510fd1b518ae01 (DEFAULT_TABLE table=default.Table_98a00559f592459ba64aaa784044fc41 [id=ba09dea9af634352986a4aa64537ae21]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:47.571204 13460 tablet_service.cc:1468] Processing CreateTablet for tablet 4b692717d4d34919af71cabb1a82bfd8 (DEFAULT_TABLE table=default.Table_20a3756852a8404a9000ae7e154cfc5f [id=daafbf7b5cb04668a43588cf761d2cbc]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:47.571488 13593 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 835bb0ae1a49413a9d510fd1b518ae01. 1 dirs total, 0 dirs full, 0 dirs failed
W20250830 07:54:47.571496 13703 leader_election.cc:343] T 856e644662334f8194ffef6ca1232248 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:47.572312 13610 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "74ea2298876a4066b297915c135d4618" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
W20250830 07:54:47.572971 13423 leader_election.cc:343] T 74ea2298876a4066b297915c135d4618 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:47.574225 13590 tablet_service.cc:1468] Processing CreateTablet for tablet 4b692717d4d34919af71cabb1a82bfd8 (DEFAULT_TABLE table=default.Table_20a3756852a8404a9000ae7e154cfc5f [id=daafbf7b5cb04668a43588cf761d2cbc]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:47.574549 13590 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b692717d4d34919af71cabb1a82bfd8. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:47.579360 13463 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 736de5dbaf7f4f449f6fc323ab6a72d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:47.580191 13741 tablet_service.cc:1468] Processing CreateTablet for tablet 473fcf65d49b42dabe9b787cee681f76 (DEFAULT_TABLE table=default.Table_fa88ef9c651348d287efdd7af42e9526 [id=7cba2a8f1e6344daaf748a4c36fa7c85]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:47.580631 13741 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 473fcf65d49b42dabe9b787cee681f76. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:47.582835 13464 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 533f17f5a9104a6582d9682287c9f1f7. 1 dirs total, 0 dirs full, 0 dirs failed
W20250830 07:54:47.587746 13226 catalog_manager.cc:5415] Ignoring report from unknown tablet 4c4a8eea119044b49e2b29f10a703097
W20250830 07:54:47.587852 13226 catalog_manager.cc:5415] Ignoring report from unknown tablet 73853894da074ecd8147a94ac28bfab8
W20250830 07:54:47.587913 13226 catalog_manager.cc:5415] Ignoring report from unknown tablet cb3c48982add45379c0e1b117ec40c1a
W20250830 07:54:47.587991 13226 catalog_manager.cc:5415] Ignoring report from unknown tablet f0144701d459480d96c1ece519951442
W20250830 07:54:47.588047 13226 catalog_manager.cc:5415] Ignoring report from unknown tablet 007435e198b9440db055711a98e3148a
W20250830 07:54:47.588090 13226 catalog_manager.cc:5415] Ignoring report from unknown tablet b38c8d003413428dae9e47f58e197c2c
W20250830 07:54:47.588140 13226 catalog_manager.cc:5415] Ignoring report from unknown tablet ffc5945a032e47d4bd3397d7c887dc62
W20250830 07:54:47.588214 13226 catalog_manager.cc:5415] Ignoring report from unknown tablet a41c1455404f4ed0a782a0c4ddd4140d
W20250830 07:54:47.588287 13226 catalog_manager.cc:5415] Ignoring report from unknown tablet ec4a3975961d4f85ad9da94835417574
W20250830 07:54:47.588330 13226 catalog_manager.cc:5415] Ignoring report from unknown tablet 6a82ea7078e344a497c34f932e139bcd
I20250830 07:54:47.588930 13457 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aab8d9a009d34166920905ad06ed153b. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:47.591198 13607 tablet_service.cc:1468] Processing CreateTablet for tablet 957bd8a761cf484cad4fa68b50dcac10 (DEFAULT_TABLE table=default.Table_26823b419608403ea304b5f2135fe73d [id=c89b60cbf52742afbdcee06f6cf9c3c3]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:47.591531 13607 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 957bd8a761cf484cad4fa68b50dcac10. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:47.594745 13457 tablet_service.cc:1468] Processing CreateTablet for tablet ef409101e58e46ef9e7d430a32ddbc06 (DEFAULT_TABLE table=default.Table_853367df8be040c2ac006a7215f9792e [id=c150350f33d74d08bf68f9d028f86501]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:47.595386 13594 tablet_service.cc:1468] Processing CreateTablet for tablet 6f261efe27ec49caa422f23bdb2ec13e (DEFAULT_TABLE table=default.Table_c74208cd42834eccbc9ff4f256fb93ef [id=87b43838ede848c19535066447b9c991]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:47.595742 13594 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f261efe27ec49caa422f23bdb2ec13e. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:47.596428 13464 tablet_service.cc:1468] Processing CreateTablet for tablet 835bb0ae1a49413a9d510fd1b518ae01 (DEFAULT_TABLE table=default.Table_98a00559f592459ba64aaa784044fc41 [id=ba09dea9af634352986a4aa64537ae21]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:47.599309 13597 tablet_service.cc:1468] Processing CreateTablet for tablet d1a99857f707440d9edd0b30d918b2ff (DEFAULT_TABLE table=default.Table_c08e2c34885940b5aec6ab02c4f3edf6 [id=ad04e76547bb47a6bcda52b433309d1a]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:47.599625 13597 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1a99857f707440d9edd0b30d918b2ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:47.603310 13600 tablet_service.cc:1468] Processing CreateTablet for tablet bbe66fc62de74dfe823e0a66ad297142 (DEFAULT_TABLE table=default.Table_b755f70318f4435689e640c0b4283116 [id=bd738a9e8fa447d5b710bb153bcc487c]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:47.603613 13600 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bbe66fc62de74dfe823e0a66ad297142. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:47.603842 13886 tablet_bootstrap.cc:492] T 4828280e6fec4338b35422917966ac8c P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:54:47.604019 13886 ts_tablet_manager.cc:1397] T 4828280e6fec4338b35422917966ac8c P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.082s user 0.006s sys 0.003s
I20250830 07:54:47.604806 13886 raft_consensus.cc:357] T 4828280e6fec4338b35422917966ac8c P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:47.604995 13886 raft_consensus.cc:383] T 4828280e6fec4338b35422917966ac8c P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:47.605088 13886 raft_consensus.cc:738] T 4828280e6fec4338b35422917966ac8c P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:54:47.605297 13749 tablet_service.cc:1468] Processing CreateTablet for tablet f0b5a16ef15e466d908a623e64391a0f (DEFAULT_TABLE table=default.Table_38c9c9f1bfb24082854dfb1f7d0b112f [id=db215153a41943e1abcfe63a8a41763b]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:47.605852 13749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0b5a16ef15e466d908a623e64391a0f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:47.606269 13455 tablet_service.cc:1468] Processing CreateTablet for tablet 964fa8581b7f48a9a264072241a37d64 (DEFAULT_TABLE table=default.Table_e326fff272534f8ba6bbb330b4be2815 [id=206701cd4ae5404da0b02b08af12b71a]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:47.607101 15036 ts_tablet_manager.cc:1918] T f1fe024f0de048a5a0931ee38752d5a1 P 9b057ade5dce45af9f8bf0bedf8b917f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250830 07:54:47.609673 13457 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef409101e58e46ef9e7d430a32ddbc06. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:47.612473 13606 tablet_service.cc:1468] Processing CreateTablet for tablet af3f79e46d6149aa921a4c0ce19c7172 (DEFAULT_TABLE table=default.Table_fdd5806cae9b42f88d2c947a8241f783 [id=fce977e0d52e4ddf9015a07b10aa071d]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:47.612721 15036 log.cc:1199] T f1fe024f0de048a5a0931ee38752d5a1 P 9b057ade5dce45af9f8bf0bedf8b917f: Deleting WAL directory at /tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/ts-2/wal/wals/f1fe024f0de048a5a0931ee38752d5a1
I20250830 07:54:47.612808 13606 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af3f79e46d6149aa921a4c0ce19c7172. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:47.613723 15036 ts_tablet_manager.cc:1939] T f1fe024f0de048a5a0931ee38752d5a1 P 9b057ade5dce45af9f8bf0bedf8b917f: Deleting consensus metadata
I20250830 07:54:47.615098 13746 tablet_service.cc:1468] Processing CreateTablet for tablet 529e743ea8ba4dcb879dad1d28087486 (DEFAULT_TABLE table=default.Table_e40f799d6135436c83693f971a69ee0d [id=a009e77538bf4240a7cb6f1e575454b3]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:47.613054 13886 consensus_queue.cc:260] T 4828280e6fec4338b35422917966ac8c P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:47.615479 13746 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 529e743ea8ba4dcb879dad1d28087486. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:47.615779 13886 ts_tablet_manager.cc:1428] T 4828280e6fec4338b35422917966ac8c P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.012s user 0.001s sys 0.001s
I20250830 07:54:47.616098 13886 tablet_bootstrap.cc:492] T 8eb010d7955d47a89ff1d01be1b5b01e P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:54:47.617704 13886 tablet_bootstrap.cc:654] T 8eb010d7955d47a89ff1d01be1b5b01e P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:47.618140 13466 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0b574113fee342f98c5574703440ba3a. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:47.623109 13465 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8921c85fefac415f9a4e5bb7dc38a134. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:47.624747 13606 tablet_service.cc:1468] Processing CreateTablet for tablet e5c8a6e8e5854274bd0548c6ece9bf2d (DEFAULT_TABLE table=default.Table_e8e9b4f20799486282c3998dac420480 [id=8423c869430848bf85e010e5786deea8]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:47.625108 13606 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e5c8a6e8e5854274bd0548c6ece9bf2d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:47.627110 13467 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 51aecb7681034f7ca67039ca86a0a618. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:47.627148 13607 tablet_service.cc:1468] Processing CreateTablet for tablet 20a532a8db53426faa7b4231cfb393b8 (DEFAULT_TABLE table=default.Table_fe33866fc1ed45899e8aaa719eab9640 [id=ebd8f41849634ab1a9ea27bcf055ddfe]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:47.627456 13607 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 20a532a8db53426faa7b4231cfb393b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:47.630090 14924 raft_consensus.cc:491] T e66e56ecdf14466282daab8c894eb3c6 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:47.630219 14924 raft_consensus.cc:513] T e66e56ecdf14466282daab8c894eb3c6 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:47.630784 14924 leader_election.cc:290] T e66e56ecdf14466282daab8c894eb3c6 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:47.631135 13600 tablet_service.cc:1468] Processing CreateTablet for tablet 99c52db41f6747d1a8a1e59157aa4bfd (DEFAULT_TABLE table=default.Table_34baaf5f8c9e4e8f9ac45d692fff219e [id=44de082ec39c47dd88a7180d71abec80]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:47.631459 13600 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 99c52db41f6747d1a8a1e59157aa4bfd. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:47.631675 13480 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "e66e56ecdf14466282daab8c894eb3c6" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:54:47.631852 13480 raft_consensus.cc:2466] T e66e56ecdf14466282daab8c894eb3c6 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b5e454d98894637b466ea27f1b647f9 in term 0.
I20250830 07:54:47.632304 13561 leader_election.cc:304] T e66e56ecdf14466282daab8c894eb3c6 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 6b5e454d98894637b466ea27f1b647f9; no voters:
I20250830 07:54:47.632612 14924 raft_consensus.cc:2802] T e66e56ecdf14466282daab8c894eb3c6 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:54:47.632683 14924 raft_consensus.cc:491] T e66e56ecdf14466282daab8c894eb3c6 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:54:47.632764 14924 raft_consensus.cc:3058] T e66e56ecdf14466282daab8c894eb3c6 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:47.632987 13460 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b692717d4d34919af71cabb1a82bfd8. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:47.635600 14924 raft_consensus.cc:513] T e66e56ecdf14466282daab8c894eb3c6 P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:47.636205 14924 leader_election.cc:290] T e66e56ecdf14466282daab8c894eb3c6 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 election: Requested vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:47.636675 13480 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "e66e56ecdf14466282daab8c894eb3c6" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba"
I20250830 07:54:47.636818 13480 raft_consensus.cc:3058] T e66e56ecdf14466282daab8c894eb3c6 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:47.639493 13480 raft_consensus.cc:2466] T e66e56ecdf14466282daab8c894eb3c6 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b5e454d98894637b466ea27f1b647f9 in term 1.
I20250830 07:54:47.639899 13561 leader_election.cc:304] T e66e56ecdf14466282daab8c894eb3c6 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 6b5e454d98894637b466ea27f1b647f9; no voters:
I20250830 07:54:47.640308 13766 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "e66e56ecdf14466282daab8c894eb3c6" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:47.640635 13766 raft_consensus.cc:2466] T e66e56ecdf14466282daab8c894eb3c6 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b5e454d98894637b466ea27f1b647f9 in term 0.
I20250830 07:54:47.641404 14924 raft_consensus.cc:2802] T e66e56ecdf14466282daab8c894eb3c6 P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Leader election won for term 1
I20250830 07:54:47.641444 13465 tablet_service.cc:1468] Processing CreateTablet for tablet 6f261efe27ec49caa422f23bdb2ec13e (DEFAULT_TABLE table=default.Table_c74208cd42834eccbc9ff4f256fb93ef [id=87b43838ede848c19535066447b9c991]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:47.641703 14924 raft_consensus.cc:695] T e66e56ecdf14466282daab8c894eb3c6 P 6b5e454d98894637b466ea27f1b647f9 [term 1 LEADER]: Becoming Leader. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Running, Role: LEADER
I20250830 07:54:47.641757 13465 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f261efe27ec49caa422f23bdb2ec13e. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:47.642079 14924 consensus_queue.cc:237] T e66e56ecdf14466282daab8c894eb3c6 P 6b5e454d98894637b466ea27f1b647f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:47.643946 13597 tablet_service.cc:1468] Processing CreateTablet for tablet 8d685e1a2d474463b9f98282fd4d2090 (DEFAULT_TABLE table=default.Table_ad790949dd984cfda29f3c9a85e62db6 [id=4dfbd986a0e64280b56f15f6fd31a450]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:47.644276 13597 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d685e1a2d474463b9f98282fd4d2090. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:47.644963 13766 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "e66e56ecdf14466282daab8c894eb3c6" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f"
I20250830 07:54:47.645190 13766 raft_consensus.cc:3058] T e66e56ecdf14466282daab8c894eb3c6 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:47.647729 13766 raft_consensus.cc:2466] T e66e56ecdf14466282daab8c894eb3c6 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b5e454d98894637b466ea27f1b647f9 in term 1.
I20250830 07:54:47.649564 13463 tablet_service.cc:1468] Processing CreateTablet for tablet d1a99857f707440d9edd0b30d918b2ff (DEFAULT_TABLE table=default.Table_c08e2c34885940b5aec6ab02c4f3edf6 [id=ad04e76547bb47a6bcda52b433309d1a]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:47.649922 13463 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1a99857f707440d9edd0b30d918b2ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:47.650483 13608 tablet_service.cc:1468] Processing CreateTablet for tablet cd48d5c2d81a4b26aa1128b4f1cd01f3 (DEFAULT_TABLE table=default.Table_10cf790ce076449ba68094fc91ebade3 [id=4e1e2c9e2ba94bc0b52b12a896a4f202]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:47.652575 13746 tablet_service.cc:1468] Processing CreateTablet for tablet 7efdf13fd50d419da921c28e21c25757 (DEFAULT_TABLE table=default.Table_f440bd2200c547deb37ad7cba486eb5a [id=0caf828cfe2548c5b4e058b766c0aea3]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:47.652901 13746 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7efdf13fd50d419da921c28e21c25757. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:47.653889 13608 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd48d5c2d81a4b26aa1128b4f1cd01f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:47.654866 13455 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 964fa8581b7f48a9a264072241a37d64. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:47.659160 13460 tablet_service.cc:1468] Processing CreateTablet for tablet 957bd8a761cf484cad4fa68b50dcac10 (DEFAULT_TABLE table=default.Table_26823b419608403ea304b5f2135fe73d [id=c89b60cbf52742afbdcee06f6cf9c3c3]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:47.659561 13460 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 957bd8a761cf484cad4fa68b50dcac10. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:47.660640 13753 tablet_service.cc:1468] Processing CreateTablet for tablet 9b9631c8038a4c6eb9fd0530511777ac (DEFAULT_TABLE table=default.Table_215b7f39935142a88ce385ee6fc0a5c6 [id=64650700a5eb4daeaa2a38be73a56bf9]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:47.660981 13753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b9631c8038a4c6eb9fd0530511777ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:47.663187 13464 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 835bb0ae1a49413a9d510fd1b518ae01. 1 dirs total, 0 dirs full, 0 dirs failed
W20250830 07:54:47.668083 13226 catalog_manager.cc:5415] Ignoring report from unknown tablet 533811110191436d96665b3475ab597f
W20250830 07:54:47.668483 13226 catalog_manager.cc:5415] Ignoring report from unknown tablet f398e12cd9f543738d5163354f8a9d9d
I20250830 07:54:47.668956 13228 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet 0afcda169b6d406590129c0fd70936b9
I20250830 07:54:47.669917 13592 tablet_service.cc:1468] Processing CreateTablet for tablet 0b574113fee342f98c5574703440ba3a (DEFAULT_TABLE table=default.Table_d07e338c217149ec81b084cb18a19650 [id=88bbd3e0547947f4b67daf43f3cc7f86]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:47.670352 13228 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:42126 (request call id 1004) took 1084 ms. Trace:
I20250830 07:54:47.670490 13591 tablet_service.cc:1468] Processing CreateTablet for tablet 964fa8581b7f48a9a264072241a37d64 (DEFAULT_TABLE table=default.Table_e326fff272534f8ba6bbb330b4be2815 [id=206701cd4ae5404da0b02b08af12b71a]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:47.670771 13592 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0b574113fee342f98c5574703440ba3a. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:47.670974 13591 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 964fa8581b7f48a9a264072241a37d64. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:47.672214 13590 tablet_service.cc:1468] Processing CreateTablet for tablet 55d6b2e221c34d159ff5e71606be86f0 (DEFAULT_TABLE table=default.Table_e6e8ed8d3fb245729dfbc091e5e237a3 [id=416d2b28c197494b966fc1412f36cca7]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:47.672919 13590 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 55d6b2e221c34d159ff5e71606be86f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:47.678217 13597 tablet_service.cc:1468] Processing CreateTablet for tablet ec7e9d198aab4ecabbc5a4f2cb3c6854 (DEFAULT_TABLE table=default.Table_c442bb1874724c3d9b586558e26bc632 [id=0d207a219a8c470b88c42060f8536bf9]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:47.679090 13597 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec7e9d198aab4ecabbc5a4f2cb3c6854. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:47.678643 13600 tablet_service.cc:1468] Processing CreateTablet for tablet 0d2c9f8b6ce745bab1aa07beeb9ddbff (DEFAULT_TABLE table=default.Table_6041884eb99a4da5b48436b99054e999 [id=ddb55370d40b43e780cac1057babd33a]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:47.670490 13228 rpcz_store.cc:276] 0830 07:54:46.584646 (+ 0us) service_pool.cc:168] Inserting onto call queue
0830 07:54:46.779995 (+195349us) service_pool.cc:225] Handling call
0830 07:54:46.780563 (+ 568us) catalog_manager.cc:2368] Looking up, locking, and authorizing table
0830 07:54:46.780727 (+ 164us) catalog_manager.cc:2790] Modifying in-memory table state
0830 07:54:46.780793 (+ 66us) catalog_manager.cc:2799] Locking tablets
0830 07:54:47.453561 (+672768us) catalog_manager.cc:2813] Removing table and tablets from system table
0830 07:54:47.599419 (+145858us) catalog_manager.cc:2831] Removing table from by-name map
0830 07:54:47.668883 (+ 69464us) catalog_manager.cc:2847] Committing in-memory state
0830 07:54:47.668915 (+ 32us) catalog_manager.cc:2851] Aborting table tasks
0830 07:54:47.669500 (+ 585us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0830 07:54:47.542131 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0830 07:54:47.542215 (+ 84us) write_op.cc:432] Acquiring schema lock in shared mode
0830 07:54:47.542219 (+ 4us) write_op.cc:435] Acquired schema lock
0830 07:54:47.542221 (+ 2us) tablet.cc:660] Decoding operations
0830 07:54:47.542327 (+ 106us) write_op.cc:620] Acquiring the partition lock for write op
0830 07:54:47.542338 (+ 11us) write_op.cc:641] Partition lock acquired for write op
0830 07:54:47.542342 (+ 4us) tablet.cc:683] Acquiring locks for 2 operations
0830 07:54:47.542722 (+ 380us) tablet.cc:699] Row locks acquired
0830 07:54:47.542725 (+ 3us) write_op.cc:260] PREPARE: finished
0830 07:54:47.542754 (+ 29us) write_op.cc:270] Start()
0830 07:54:47.542779 (+ 25us) write_op.cc:276] Timestamp: P: 1756540487542705 usec, L: 0
0830 07:54:47.542783 (+ 4us) op_driver.cc:348] REPLICATION: starting
0830 07:54:47.583725 (+ 40942us) spinlock_profiling.cc:243] Waited 40.8 ms on lock 0x616000041eb8. stack: 00007f4985b867d6 00007f4985b86590 00007f4984b793ad 0000000000972d94 0000000000972d5d 000000000097272a 00007f499153e675 00007f499160833b 00007f49915e3358 00007f49915e2c05 00007f499298b2d5 00007f4992989df9 00007f4992992220 00007f499299202d 0000000000a774dc 00007f4985bccb5f
0830 07:54:47.583896 (+ 171us) log.cc:844] Serialized 728 byte log entry
0830 07:54:47.597583 (+ 13687us) op_driver.cc:464] REPLICATION: finished
0830 07:54:47.598721 (+ 1138us) write_op.cc:301] APPLY: starting
0830 07:54:47.598737 (+ 16us) tablet.cc:1365] starting BulkCheckPresence
0830 07:54:47.598790 (+ 53us) tablet.cc:1368] finished BulkCheckPresence
0830 07:54:47.598795 (+ 5us) tablet.cc:1370] starting ApplyRowOperation cycle
0830 07:54:47.598866 (+ 71us) tablet.cc:1381] finished ApplyRowOperation cycle
0830 07:54:47.598928 (+ 62us) tablet_metrics.cc:563] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0830 07:54:47.598935 (+ 7us) write_op.cc:312] APPLY: finished
0830 07:54:47.599001 (+ 66us) log.cc:844] Serialized 29 byte log entry
0830 07:54:47.599291 (+ 290us) write_op.cc:489] Releasing partition, row and schema locks
0830 07:54:47.599314 (+ 23us) write_op.cc:454] Released schema lock
0830 07:54:47.599323 (+ 9us) write_op.cc:341] FINISH: Updating metrics
0830 07:54:47.651187 (+ 51864us) write_op.cc:489] Releasing partition, row and schema locks
0830 07:54:47.651196 (+ 9us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":1079,"apply.run_cpu_time_us":472,"apply.run_wall_time_us":751,"num_ops":2,"prepare.queue_time_us":87940,"prepare.run_cpu_time_us":971,"prepare.run_wall_time_us":108953,"raft.queue_time_us":48,"raft.run_cpu_time_us":189,"raft.run_wall_time_us":519,"replication_time_us":54772,"spinlock_wait_cycles":93736320}]]}
I20250830 07:54:47.682693 13606 tablet_service.cc:1468] Processing CreateTablet for tablet 31244b74c01a4c0d816867286a39cd4d (DEFAULT_TABLE table=default.Table_632fd974aa4a410b8b2c30d251ba9ad7 [id=19196ba07f914699b5f62503d02925e0]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:47.683468 13604 tablet_service.cc:1468] Processing CreateTablet for tablet 94e28f0788664448b53edb5240a4a4b6 (DEFAULT_TABLE table=default.Table_dc6cbe0df3e54f26a96f0b91dcec8d56 [id=ce7f98cb7cb948b2aa9d5b309cc101a6]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:47.684135 13599 tablet_service.cc:1468] Processing CreateTablet for tablet 20779fb169cb4a218df515d68bbe64b8 (DEFAULT_TABLE table=default.Table_5aa473e5c4f245cdaba8e696d6775c87 [id=63bfed9f630243098a072aa565cd5561]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:47.684832 13595 tablet_service.cc:1468] Processing CreateTablet for tablet e498b17956514a9d93807598f8dfb351 (DEFAULT_TABLE table=default.Table_9ea8aaa6727d4d4c9a728c1deb363c95 [id=ffbe89803ccf4bd5a46e022eb310b1b6]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:47.685181 13594 tablet_service.cc:1468] Processing CreateTablet for tablet 19f5b18cbe0b4f97889a089beff3b585 (DEFAULT_TABLE table=default.Table_2383bf6f9b124a47aad389ba74ef460a [id=867c64d352a4400e8c398547f9d7aaa1]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:47.685384 13609 tablet_service.cc:1515] Processing DeleteTablet for tablet 0afcda169b6d406590129c0fd70936b9 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:46 UTC) from {username='slave'} at 127.0.0.1:45306
I20250830 07:54:47.685384 13593 tablet_service.cc:1468] Processing CreateTablet for tablet e845134de44f4cf4b0075d207df30d21 (DEFAULT_TABLE table=default.Table_0ad54505afd34d1792f97395a95b26bb [id=8f41d25177eb44c8b4555831176adeef]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:47.686229 13601 tablet_service.cc:1468] Processing CreateTablet for tablet e97facd563eb42b6b5b72e7c56386ef5 (DEFAULT_TABLE table=default.Table_e2b0521d564549e69deaff73c4506d20 [id=fa39d2dd20894e78b0dcbd2ec7b979cb]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:47.686612 13605 tablet_service.cc:1468] Processing CreateTablet for tablet fd614a8565e74f488905a27d57fd42e1 (DEFAULT_TABLE table=default.Table_85b01c51682445e4a4f1672b286b0c56 [id=8ca45ce8b3e549c0949784cb59d2b2d5]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:47.686978 13598 tablet_service.cc:1468] Processing CreateTablet for tablet ddd8e87e811e41c582c91342b9ff2755 (DEFAULT_TABLE table=default.Table_3bb6252818564f6c898bfd231839d740 [id=d9bb26da7fc54e0fba3a888e0d2746f6]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:47.689450 13753 tablet_service.cc:1468] Processing CreateTablet for tablet 8921c85fefac415f9a4e5bb7dc38a134 (DEFAULT_TABLE table=default.Table_2a1215c34df8484ca99228faa7e3747b [id=1d912dffe17c43738af7f48d8a8cc1a2]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:47.691601 13753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8921c85fefac415f9a4e5bb7dc38a134. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:47.698153 13606 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 31244b74c01a4c0d816867286a39cd4d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:47.698845 13747 tablet_service.cc:1468] Processing CreateTablet for tablet 0b574113fee342f98c5574703440ba3a (DEFAULT_TABLE table=default.Table_d07e338c217149ec81b084cb18a19650 [id=88bbd3e0547947f4b67daf43f3cc7f86]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:47.699564 13747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0b574113fee342f98c5574703440ba3a. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:47.702411 13604 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 94e28f0788664448b53edb5240a4a4b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:47.703585 13595 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e498b17956514a9d93807598f8dfb351. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:47.703845 13750 tablet_service.cc:1468] Processing CreateTablet for tablet 736de5dbaf7f4f449f6fc323ab6a72d8 (DEFAULT_TABLE table=default.Table_3c2f79a13fe642769065e2bc5fb22872 [id=177b8299ef08486ca4d9788f309e5c11]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:47.704106 13594 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 19f5b18cbe0b4f97889a089beff3b585. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:47.704185 13750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 736de5dbaf7f4f449f6fc323ab6a72d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:47.704389 13593 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e845134de44f4cf4b0075d207df30d21. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:47.704826 13598 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ddd8e87e811e41c582c91342b9ff2755. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:47.705538 13600 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d2c9f8b6ce745bab1aa07beeb9ddbff. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:47.711400 13605 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd614a8565e74f488905a27d57fd42e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:47.712476 13599 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 20779fb169cb4a218df515d68bbe64b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:47.713551 13601 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e97facd563eb42b6b5b72e7c56386ef5. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:47.715122 13754 tablet_service.cc:1468] Processing CreateTablet for tablet 533f17f5a9104a6582d9682287c9f1f7 (DEFAULT_TABLE table=default.Table_3fbed79aa89e46a380f08c35b61be998 [id=f50f57edefaa444b9fb30986bb25db44]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:47.716691 13747 tablet_service.cc:1468] Processing CreateTablet for tablet 4b692717d4d34919af71cabb1a82bfd8 (DEFAULT_TABLE table=default.Table_20a3756852a8404a9000ae7e154cfc5f [id=daafbf7b5cb04668a43588cf761d2cbc]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:47.718372 13737 tablet_service.cc:1468] Processing CreateTablet for tablet 964fa8581b7f48a9a264072241a37d64 (DEFAULT_TABLE table=default.Table_e326fff272534f8ba6bbb330b4be2815 [id=206701cd4ae5404da0b02b08af12b71a]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:47.720101 13748 tablet_service.cc:1468] Processing CreateTablet for tablet d1a99857f707440d9edd0b30d918b2ff (DEFAULT_TABLE table=default.Table_c08e2c34885940b5aec6ab02c4f3edf6 [id=ad04e76547bb47a6bcda52b433309d1a]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:47.721688 13735 tablet_service.cc:1468] Processing CreateTablet for tablet 51aecb7681034f7ca67039ca86a0a618 (DEFAULT_TABLE table=default.Table_ecc415dc4d894e3c851f48708e0c22c3 [id=439a6d953d5645e7827b6103f9b65e56]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:47.722010 13754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 533f17f5a9104a6582d9682287c9f1f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:47.727062 13735 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 51aecb7681034f7ca67039ca86a0a618. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:47.731632 13748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1a99857f707440d9edd0b30d918b2ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:47.734571 13737 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 964fa8581b7f48a9a264072241a37d64. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:47.749565 13739 tablet_service.cc:1468] Processing CreateTablet for tablet ef409101e58e46ef9e7d430a32ddbc06 (DEFAULT_TABLE table=default.Table_853367df8be040c2ac006a7215f9792e [id=c150350f33d74d08bf68f9d028f86501]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:47.749965 13739 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef409101e58e46ef9e7d430a32ddbc06. 1 dirs total, 0 dirs full, 0 dirs failed
W20250830 07:54:47.754174 13701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.209.1:45325, user_credentials={real_user=slave}} blocked reactor thread for 194338us
I20250830 07:54:47.754655 13701 leader_election.cc:304] T 01771fa171374e92892345e7402c33d1 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:54:47.754618 14818 consensus_queue.cc:1035] T e6491d149c0646848680cfdadb6fc76c P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:54:47.754949 14975 raft_consensus.cc:2802] T 01771fa171374e92892345e7402c33d1 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election won for term 1
I20250830 07:54:47.755124 14975 raft_consensus.cc:695] T 01771fa171374e92892345e7402c33d1 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 LEADER]: Becoming Leader. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Running, Role: LEADER
I20250830 07:54:47.755050 13755 tablet_service.cc:1468] Processing CreateTablet for tablet 957bd8a761cf484cad4fa68b50dcac10 (DEFAULT_TABLE table=default.Table_26823b419608403ea304b5f2135fe73d [id=c89b60cbf52742afbdcee06f6cf9c3c3]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:47.755463 13755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 957bd8a761cf484cad4fa68b50dcac10. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:47.755362 14975 consensus_queue.cc:237] T 01771fa171374e92892345e7402c33d1 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:47.757038 15034 ts_tablet_manager.cc:1918] T e4ca3110247640fbae4241448e8d5ef7 P 2065c332f15a4739899af79f3669c3ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250830 07:54:47.757144 15034 log.cc:1199] T e4ca3110247640fbae4241448e8d5ef7 P 2065c332f15a4739899af79f3669c3ba: Deleting WAL directory at /tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/ts-0/wal/wals/e4ca3110247640fbae4241448e8d5ef7
I20250830 07:54:47.757472 15034 ts_tablet_manager.cc:1939] T e4ca3110247640fbae4241448e8d5ef7 P 2065c332f15a4739899af79f3669c3ba: Deleting consensus metadata
I20250830 07:54:47.758864 13745 tablet_service.cc:1468] Processing CreateTablet for tablet 6f261efe27ec49caa422f23bdb2ec13e (DEFAULT_TABLE table=default.Table_c74208cd42834eccbc9ff4f256fb93ef [id=87b43838ede848c19535066447b9c991]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:47.759238 13745 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f261efe27ec49caa422f23bdb2ec13e. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:47.764835 13467 tablet_service.cc:1468] Processing CreateTablet for tablet bbe66fc62de74dfe823e0a66ad297142 (DEFAULT_TABLE table=default.Table_b755f70318f4435689e640c0b4283116 [id=bd738a9e8fa447d5b710bb153bcc487c]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:47.765209 13467 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bbe66fc62de74dfe823e0a66ad297142. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:47.769753 13750 tablet_service.cc:1468] Processing CreateTablet for tablet 835bb0ae1a49413a9d510fd1b518ae01 (DEFAULT_TABLE table=default.Table_98a00559f592459ba64aaa784044fc41 [id=ba09dea9af634352986a4aa64537ae21]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:47.770149 13750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 835bb0ae1a49413a9d510fd1b518ae01. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:47.771054 13747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b692717d4d34919af71cabb1a82bfd8. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:47.771142 13466 tablet_service.cc:1468] Processing CreateTablet for tablet af3f79e46d6149aa921a4c0ce19c7172 (DEFAULT_TABLE table=default.Table_fdd5806cae9b42f88d2c947a8241f783 [id=fce977e0d52e4ddf9015a07b10aa071d]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:47.771440 13466 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af3f79e46d6149aa921a4c0ce19c7172. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:47.773751 13887 tablet_bootstrap.cc:492] T 1e48641532cd439e9b4074712033c737 P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:54:47.773921 13887 ts_tablet_manager.cc:1397] T 1e48641532cd439e9b4074712033c737 P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.333s user 0.001s sys 0.015s
I20250830 07:54:47.774787 13887 raft_consensus.cc:357] T 1e48641532cd439e9b4074712033c737 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:47.775141 13887 raft_consensus.cc:383] T 1e48641532cd439e9b4074712033c737 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:47.775326 13887 raft_consensus.cc:738] T 1e48641532cd439e9b4074712033c737 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:54:47.775619 13887 consensus_queue.cc:260] T 1e48641532cd439e9b4074712033c737 P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:47.784881 13887 ts_tablet_manager.cc:1428] T 1e48641532cd439e9b4074712033c737 P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.011s user 0.000s sys 0.001s
I20250830 07:54:47.755059 13701 leader_election.cc:304] T e66e56ecdf14466282daab8c894eb3c6 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:54:47.787876 14975 raft_consensus.cc:2762] T e66e56ecdf14466282daab8c894eb3c6 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20250830 07:54:47.792542 13701 leader_election.cc:304] T 6a82ea7078e344a497c34f932e139bcd P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:54:47.792856 14975 raft_consensus.cc:2802] T 6a82ea7078e344a497c34f932e139bcd P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:54:47.793059 14975 raft_consensus.cc:491] T 6a82ea7078e344a497c34f932e139bcd P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:54:47.793172 14975 raft_consensus.cc:3058] T 6a82ea7078e344a497c34f932e139bcd P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:47.795133 13234 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet 0b574113fee342f98c5574703440ba3a
I20250830 07:54:47.796988 13466 tablet_service.cc:1468] Processing CreateTablet for tablet 20a532a8db53426faa7b4231cfb393b8 (DEFAULT_TABLE table=default.Table_fe33866fc1ed45899e8aaa719eab9640 [id=ebd8f41849634ab1a9ea27bcf055ddfe]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:47.797413 14975 raft_consensus.cc:513] T 6a82ea7078e344a497c34f932e139bcd P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:47.797610 13454 tablet_service.cc:1468] Processing CreateTablet for tablet 99c52db41f6747d1a8a1e59157aa4bfd (DEFAULT_TABLE table=default.Table_34baaf5f8c9e4e8f9ac45d692fff219e [id=44de082ec39c47dd88a7180d71abec80]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:47.797937 13454 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 99c52db41f6747d1a8a1e59157aa4bfd. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:47.798799 14975 leader_election.cc:290] T 6a82ea7078e344a497c34f932e139bcd P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Requested vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
W20250830 07:54:47.799158 13228 catalog_manager.cc:5415] Ignoring report from unknown tablet ff2267fb411942ff826e2a72bcb89cd7
I20250830 07:54:47.799146 13701 leader_election.cc:304] T 2b4ce50fbd26484faba3faa2ec5115c0 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
W20250830 07:54:47.799331 13228 catalog_manager.cc:5415] Ignoring report from unknown tablet c0147310dad84226808332a4c2c6e09d
W20250830 07:54:47.799695 13228 catalog_manager.cc:5415] Ignoring report from unknown tablet 73853894da074ecd8147a94ac28bfab8
I20250830 07:54:47.799804 14975 raft_consensus.cc:2802] T 2b4ce50fbd26484faba3faa2ec5115c0 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election won for term 1
W20250830 07:54:47.799925 13228 catalog_manager.cc:5415] Ignoring report from unknown tablet 04eadf45b82e4c319eb7b316a402d81a
I20250830 07:54:47.800001 14975 raft_consensus.cc:491] T 2b4ce50fbd26484faba3faa2ec5115c0 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:54:47.800302 14975 raft_consensus.cc:3058] T 2b4ce50fbd26484faba3faa2ec5115c0 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
W20250830 07:54:47.800377 13228 catalog_manager.cc:5415] Ignoring report from unknown tablet d1ae3812d72b419798736328da64b53c
I20250830 07:54:47.801760 14818 raft_consensus.cc:491] T a41c1455404f4ed0a782a0c4ddd4140d P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:47.801921 14818 raft_consensus.cc:513] T a41c1455404f4ed0a782a0c4ddd4140d P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:47.802462 14818 leader_election.cc:290] T a41c1455404f4ed0a782a0c4ddd4140d P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
I20250830 07:54:47.801669 13228 catalog_manager.cc:5674] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967) does not have the latest schema for tablet 99f307a8cbb34addaafab82b3ed18241 (table default.Table_4e2c5e0840fe4d3398519818e193f4dd [id=2a10f84461764fd5ab5a59499a370034]). Expected version 1 got 0
I20250830 07:54:47.803290 13449 tablet_service.cc:1468] Processing CreateTablet for tablet e5c8a6e8e5854274bd0548c6ece9bf2d (DEFAULT_TABLE table=default.Table_e8e9b4f20799486282c3998dac420480 [id=8423c869430848bf85e010e5786deea8]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:47.803614 13449 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e5c8a6e8e5854274bd0548c6ece9bf2d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:47.804395 13453 tablet_service.cc:1468] Processing CreateTablet for tablet 8d685e1a2d474463b9f98282fd4d2090 (DEFAULT_TABLE table=default.Table_ad790949dd984cfda29f3c9a85e62db6 [id=4dfbd986a0e64280b56f15f6fd31a450]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:47.805109 13458 tablet_service.cc:1468] Processing CreateTablet for tablet cd48d5c2d81a4b26aa1128b4f1cd01f3 (DEFAULT_TABLE table=default.Table_10cf790ce076449ba68094fc91ebade3 [id=4e1e2c9e2ba94bc0b52b12a896a4f202]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:47.805655 13450 tablet_service.cc:1468] Processing CreateTablet for tablet 0d2c9f8b6ce745bab1aa07beeb9ddbff (DEFAULT_TABLE table=default.Table_6041884eb99a4da5b48436b99054e999 [id=ddb55370d40b43e780cac1057babd33a]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:47.805684 13226 catalog_manager.cc:5674] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743) does not have the latest schema for tablet 29f0695563854e45965a1cc36ac54138 (table default.Table_e40b329adbd0475da2669620084f75f3 [id=7d0a5ef4aaf64241be34eba188f2cbcd]). Expected version 2 got 0
I20250830 07:54:47.806221 13456 tablet_service.cc:1468] Processing CreateTablet for tablet ec7e9d198aab4ecabbc5a4f2cb3c6854 (DEFAULT_TABLE table=default.Table_c442bb1874724c3d9b586558e26bc632 [id=0d207a219a8c470b88c42060f8536bf9]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:47.806752 13451 tablet_service.cc:1468] Processing CreateTablet for tablet 55d6b2e221c34d159ff5e71606be86f0 (DEFAULT_TABLE table=default.Table_e6e8ed8d3fb245729dfbc091e5e237a3 [id=416d2b28c197494b966fc1412f36cca7]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:47.807286 13607 tablet_service.cc:1468] Processing CreateTablet for tablet 8e4de738b30a45fb98c083c425cfa7b4 (DEFAULT_TABLE table=default.Table_9eae6b032d184bee81196ba47638cdb3 [id=8da53c4ff6d94949b2fd2f89d0f0d20e]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:47.807498 13451 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 55d6b2e221c34d159ff5e71606be86f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:47.807653 13607 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e4de738b30a45fb98c083c425cfa7b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:47.808179 13234 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:42126 (request call id 998) took 1407 ms. Trace:
I20250830 07:54:47.808336 13459 tablet_service.cc:1468] Processing CreateTablet for tablet 31244b74c01a4c0d816867286a39cd4d (DEFAULT_TABLE table=default.Table_632fd974aa4a410b8b2c30d251ba9ad7 [id=19196ba07f914699b5f62503d02925e0]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:47.808334 13234 rpcz_store.cc:276] 0830 07:54:46.401158 (+ 0us) service_pool.cc:168] Inserting onto call queue
0830 07:54:46.598191 (+197033us) service_pool.cc:225] Handling call
0830 07:54:46.599262 (+ 1071us) spinlock_profiling.cc:243] Waited 879 us on lock 0x616000040f54. stack: 00007f4985b867d6 00007f4985b86590 00007f4984b793ad 0000000000972d94 0000000000972d5d 00007f499495114d 00007f4994951243 00007f4991610941 00007f499919ba5d 00007f4999325e86 00007f499015e466 00007f499015e195 00007f498c9342ce 00007f498c9331ae 00007f498c9393e5 00007f498c939d0f
0830 07:54:46.599592 (+ 330us) catalog_manager.cc:2368] Looking up, locking, and authorizing table
0830 07:54:46.599715 (+ 123us) catalog_manager.cc:2790] Modifying in-memory table state
0830 07:54:46.599763 (+ 48us) catalog_manager.cc:2799] Locking tablets
0830 07:54:47.454352 (+854589us) catalog_manager.cc:2813] Removing table and tablets from system table
0830 07:54:47.794578 (+340226us) catalog_manager.cc:2831] Removing table from by-name map
0830 07:54:47.794667 (+ 89us) catalog_manager.cc:2847] Committing in-memory state
0830 07:54:47.794711 (+ 44us) catalog_manager.cc:2851] Aborting table tasks
0830 07:54:47.808116 (+ 13405us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0830 07:54:47.651476 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0830 07:54:47.652225 (+ 749us) write_op.cc:432] Acquiring schema lock in shared mode
0830 07:54:47.659503 (+ 7278us) write_op.cc:435] Acquired schema lock
0830 07:54:47.659506 (+ 3us) tablet.cc:660] Decoding operations
0830 07:54:47.666878 (+ 7372us) write_op.cc:620] Acquiring the partition lock for write op
0830 07:54:47.666944 (+ 66us) write_op.cc:641] Partition lock acquired for write op
0830 07:54:47.666953 (+ 9us) tablet.cc:683] Acquiring locks for 2 operations
0830 07:54:47.667636 (+ 683us) tablet.cc:699] Row locks acquired
0830 07:54:47.667641 (+ 5us) write_op.cc:260] PREPARE: finished
0830 07:54:47.667792 (+ 151us) write_op.cc:270] Start()
0830 07:54:47.668023 (+ 231us) write_op.cc:276] Timestamp: P: 1756540487667616 usec, L: 0
0830 07:54:47.668028 (+ 5us) op_driver.cc:348] REPLICATION: starting
0830 07:54:47.669863 (+ 1835us) log.cc:844] Serialized 728 byte log entry
0830 07:54:47.793336 (+123473us) op_driver.cc:464] REPLICATION: finished
0830 07:54:47.793693 (+ 357us) write_op.cc:301] APPLY: starting
0830 07:54:47.793712 (+ 19us) tablet.cc:1365] starting BulkCheckPresence
0830 07:54:47.793762 (+ 50us) tablet.cc:1368] finished BulkCheckPresence
0830 07:54:47.793970 (+ 208us) tablet.cc:1370] starting ApplyRowOperation cycle
0830 07:54:47.794043 (+ 73us) tablet.cc:1381] finished ApplyRowOperation cycle
0830 07:54:47.794085 (+ 42us) tablet_metrics.cc:563] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0830 07:54:47.794095 (+ 10us) write_op.cc:312] APPLY: finished
0830 07:54:47.794184 (+ 89us) log.cc:844] Serialized 29 byte log entry
0830 07:54:47.794469 (+ 285us) write_op.cc:489] Releasing partition, row and schema locks
0830 07:54:47.794489 (+ 20us) write_op.cc:454] Released schema lock
0830 07:54:47.794495 (+ 6us) write_op.cc:341] FINISH: Updating metrics
0830 07:54:47.794803 (+ 308us) write_op.cc:489] Releasing partition, row and schema locks
0830 07:54:47.794809 (+ 6us) write_op.cc:454] Released schema lock
Metrics: {"spinlock_wait_cycles":2022272,"child_traces":[["op",{"apply.queue_time_us":294,"apply.run_cpu_time_us":505,"apply.run_wall_time_us":1097,"num_ops":2,"prepare.queue_time_us":196484,"prepare.run_cpu_time_us":1150,"prepare.run_wall_time_us":21050,"raft.queue_time_us":122,"raft.run_cpu_time_us":253,"raft.run_wall_time_us":9506,"replication_time_us":125254}]]}
I20250830 07:54:47.808900 13452 tablet_service.cc:1468] Processing CreateTablet for tablet 20779fb169cb4a218df515d68bbe64b8 (DEFAULT_TABLE table=default.Table_5aa473e5c4f245cdaba8e696d6775c87 [id=63bfed9f630243098a072aa565cd5561]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:47.809717 13468 tablet_service.cc:1468] Processing CreateTablet for tablet 94e28f0788664448b53edb5240a4a4b6 (DEFAULT_TABLE table=default.Table_dc6cbe0df3e54f26a96f0b91dcec8d56 [id=ce7f98cb7cb948b2aa9d5b309cc101a6]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:47.810099 13450 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d2c9f8b6ce745bab1aa07beeb9ddbff. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:47.810067 13461 tablet_service.cc:1468] Processing CreateTablet for tablet e498b17956514a9d93807598f8dfb351 (DEFAULT_TABLE table=default.Table_9ea8aaa6727d4d4c9a728c1deb363c95 [id=ffbe89803ccf4bd5a46e022eb310b1b6]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:47.810463 13462 tablet_service.cc:1468] Processing CreateTablet for tablet e845134de44f4cf4b0075d207df30d21 (DEFAULT_TABLE table=default.Table_0ad54505afd34d1792f97395a95b26bb [id=8f41d25177eb44c8b4555831176adeef]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:47.810600 13456 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec7e9d198aab4ecabbc5a4f2cb3c6854. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:47.811092 13453 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d685e1a2d474463b9f98282fd4d2090. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:47.811285 13463 tablet_service.cc:1468] Processing CreateTablet for tablet e97facd563eb42b6b5b72e7c56386ef5 (DEFAULT_TABLE table=default.Table_e2b0521d564549e69deaff73c4506d20 [id=fa39d2dd20894e78b0dcbd2ec7b979cb]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:47.811532 13458 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd48d5c2d81a4b26aa1128b4f1cd01f3. 1 dirs total, 0 dirs full, 0 dirs failed
W20250830 07:54:47.812072 13232 catalog_manager.cc:5415] Ignoring report from unknown tablet 04eadf45b82e4c319eb7b316a402d81a
W20250830 07:54:47.812410 13232 catalog_manager.cc:5415] Ignoring report from unknown tablet 4b403cadfb7b42f8896b2ee16b50ecb1
W20250830 07:54:47.812798 13232 catalog_manager.cc:5415] Ignoring report from unknown tablet d2b8e6df64ef49e2ba36c093efd3c351
W20250830 07:54:47.813036 13232 catalog_manager.cc:5415] Ignoring report from unknown tablet 007435e198b9440db055711a98e3148a
W20250830 07:54:47.813251 13232 catalog_manager.cc:5415] Ignoring report from unknown tablet ef16b9e2d444489699f4db1ac26d5f6c
W20250830 07:54:47.813452 13232 catalog_manager.cc:5415] Ignoring report from unknown tablet b4ab964a64a64e00a78ffd2b220aef46
W20250830 07:54:47.813856 13232 catalog_manager.cc:5415] Ignoring report from unknown tablet d33a5d107c6849aca6eb48ffdf8a5463
W20250830 07:54:47.814098 13232 catalog_manager.cc:5415] Ignoring report from unknown tablet b38c8d003413428dae9e47f58e197c2c
W20250830 07:54:47.814721 13232 catalog_manager.cc:5415] Ignoring report from unknown tablet d3f207cee78a43a1b5e030c09752c78c
I20250830 07:54:47.816720 13461 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e498b17956514a9d93807598f8dfb351. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:47.817217 13462 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e845134de44f4cf4b0075d207df30d21. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:47.817131 14975 raft_consensus.cc:513] T 2b4ce50fbd26484faba3faa2ec5115c0 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:47.817724 14975 leader_election.cc:290] T 2b4ce50fbd26484faba3faa2ec5115c0 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Requested vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967)
I20250830 07:54:47.817749 13468 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 94e28f0788664448b53edb5240a4a4b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:47.818176 13452 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 20779fb169cb4a218df515d68bbe64b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:47.818603 13459 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 31244b74c01a4c0d816867286a39cd4d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:47.821442 13458 tablet_service.cc:1468] Processing CreateTablet for tablet ddd8e87e811e41c582c91342b9ff2755 (DEFAULT_TABLE table=default.Table_3bb6252818564f6c898bfd231839d740 [id=d9bb26da7fc54e0fba3a888e0d2746f6]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:47.821738 13458 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ddd8e87e811e41c582c91342b9ff2755. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:47.826566 13742 tablet_service.cc:1468] Processing CreateTablet for tablet aab8d9a009d34166920905ad06ed153b (DEFAULT_TABLE table=default.Table_b209e8dbb7be40408440ef087e11bbd4 [id=c80ac1ec788b4318989aecb0b5032526]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:47.826917 13742 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aab8d9a009d34166920905ad06ed153b. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:47.828121 13454 tablet_service.cc:1468] Processing CreateTablet for tablet 19f5b18cbe0b4f97889a089beff3b585 (DEFAULT_TABLE table=default.Table_2383bf6f9b124a47aad389ba74ef460a [id=867c64d352a4400e8c398547f9d7aaa1]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:47.828426 13454 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 19f5b18cbe0b4f97889a089beff3b585. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:47.833972 13451 tablet_service.cc:1515] Processing DeleteTablet for tablet 0afcda169b6d406590129c0fd70936b9 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:46 UTC) from {username='slave'} at 127.0.0.1:37956
I20250830 07:54:47.834774 13234 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_7db597e6145e4826a32a5ed5ba6f2397"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250830 07:54:47.805078 13701 leader_election.cc:304] T 44313f1a11b74e6d996cafd3c03d1836 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
W20250830 07:54:47.835367 13234 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7db597e6145e4826a32a5ed5ba6f2397 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:47.836082 14818 raft_consensus.cc:2802] T 44313f1a11b74e6d996cafd3c03d1836 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:54:47.836171 14818 raft_consensus.cc:491] T 44313f1a11b74e6d996cafd3c03d1836 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:54:47.836278 14818 raft_consensus.cc:3058] T 44313f1a11b74e6d996cafd3c03d1836 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:47.838752 14818 raft_consensus.cc:513] T 44313f1a11b74e6d996cafd3c03d1836 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:47.839565 14818 leader_election.cc:290] T 44313f1a11b74e6d996cafd3c03d1836 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Requested vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
W20250830 07:54:47.841722 13220 catalog_manager.cc:4726] Async tablet task AlterTable RPC for tablet d7afb311a699495aa8376db6ab206d94 (table default.Table_0c2faf92583f4b649a893b03b88923a0 [id=3abbecb154a042428e6d68d43bf105fb], current schema version=3) failed: Not found: failed to reset TS proxy: No leader found: Tablet d7afb311a699495aa8376db6ab206d94 consensus state has no leader
I20250830 07:54:47.845503 13745 tablet_service.cc:1468] Processing CreateTablet for tablet 99c52db41f6747d1a8a1e59157aa4bfd (DEFAULT_TABLE table=default.Table_34baaf5f8c9e4e8f9ac45d692fff219e [id=44de082ec39c47dd88a7180d71abec80]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:47.845836 13745 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 99c52db41f6747d1a8a1e59157aa4bfd. 1 dirs total, 0 dirs full, 0 dirs failed
W20250830 07:54:47.847337 13701 leader_election.cc:343] T f1fe024f0de048a5a0931ee38752d5a1 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): Not found: Tablet not found: f1fe024f0de048a5a0931ee38752d5a1
I20250830 07:54:47.848191 13701 leader_election.cc:304] T f1fe024f0de048a5a0931ee38752d5a1 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 2065c332f15a4739899af79f3669c3ba, 6b5e454d98894637b466ea27f1b647f9
W20250830 07:54:47.848668 13701 raft_consensus.cc:2684] T f1fe024f0de048a5a0931ee38752d5a1 P 9b057ade5dce45af9f8bf0bedf8b917f: unable to run election callback: Service unavailable: Thread pool token was shut down
I20250830 07:54:47.853003 14748 consensus_queue.cc:1035] T 8f215330505848619ad44569d3167591 P 6b5e454d98894637b466ea27f1b647f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:54:47.853461 13602 tablet_service.cc:1468] Processing CreateTablet for tablet 1034799ae047460b839edd59e4c2ae72 (DEFAULT_TABLE table=default.Table_5a55d9f1c7a44f4785b34a618728cbae [id=26cb070ad4f84af6a7be55fc16cac701]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:47.853822 13602 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1034799ae047460b839edd59e4c2ae72. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:47.853852 13604 tablet_service.cc:1468] Processing CreateTablet for tablet 8a6a2a2dc6e0411b8ad8364cbf2cec36 (DEFAULT_TABLE table=default.Table_7f4b0093219d4583a01dc853b65dcd45 [id=78a71e4ff2394a3195828ee5988c36f0]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:47.854377 13590 tablet_service.cc:1468] Processing CreateTablet for tablet b294445c38544232b0ff7e730a9fcdce (DEFAULT_TABLE table=default.Table_b53032ff88434d2f9a1fbf5a6fdc546f [id=58c4cfc99086408b9c208b84a73cc4d5]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:47.854897 13752 tablet_service.cc:1468] Processing CreateTablet for tablet 20a532a8db53426faa7b4231cfb393b8 (DEFAULT_TABLE table=default.Table_fe33866fc1ed45899e8aaa719eab9640 [id=ebd8f41849634ab1a9ea27bcf055ddfe]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:47.855382 13752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 20a532a8db53426faa7b4231cfb393b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:47.856106 13750 tablet_service.cc:1468] Processing CreateTablet for tablet af3f79e46d6149aa921a4c0ce19c7172 (DEFAULT_TABLE table=default.Table_fdd5806cae9b42f88d2c947a8241f783 [id=fce977e0d52e4ddf9015a07b10aa071d]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:47.857702 13750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af3f79e46d6149aa921a4c0ce19c7172. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:47.857915 14972 raft_consensus.cc:491] T e255d3fdee09400ead41ca835d6d103f P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:47.858016 14972 raft_consensus.cc:513] T e255d3fdee09400ead41ca835d6d103f P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:47.858597 14972 leader_election.cc:290] T e255d3fdee09400ead41ca835d6d103f P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967)
I20250830 07:54:47.861709 13624 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "6a82ea7078e344a497c34f932e139bcd" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9"
I20250830 07:54:47.857394 13747 tablet_service.cc:1468] Processing CreateTablet for tablet bbe66fc62de74dfe823e0a66ad297142 (DEFAULT_TABLE table=default.Table_b755f70318f4435689e640c0b4283116 [id=bd738a9e8fa447d5b710bb153bcc487c]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:47.863288 13747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bbe66fc62de74dfe823e0a66ad297142. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:47.863276 13596 tablet_service.cc:1468] Processing CreateTablet for tablet d0d8a3d95b4b4529a3c95be4c2d7a409 (DEFAULT_TABLE table=default.Table_be854d521db44926811d0dee9cb0fa54 [id=8a38230b74c8432c86f6c1528abc072b]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:47.863605 13596 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0d8a3d95b4b4529a3c95be4c2d7a409. 1 dirs total, 0 dirs full, 0 dirs failed
W20250830 07:54:47.864486 13703 leader_election.cc:343] T 6a82ea7078e344a497c34f932e139bcd P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:47.864713 13604 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a6a2a2dc6e0411b8ad8364cbf2cec36. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:47.865100 13608 tablet_service.cc:1468] Processing CreateTablet for tablet bb8afaec26154052b4ebf758ef286bed (DEFAULT_TABLE table=default.Table_3d2bb182df644a38ac75060c11bb7ac8 [id=9f40b3f7d2584cfcaa0b9b12aa52c7c7]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:47.865633 13624 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "a41c1455404f4ed0a782a0c4ddd4140d" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:47.866139 13598 tablet_service.cc:1515] Processing DeleteTablet for tablet 0b574113fee342f98c5574703440ba3a with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:46 UTC) from {username='slave'} at 127.0.0.1:45306
I20250830 07:54:47.867183 13590 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b294445c38544232b0ff7e730a9fcdce. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:47.868257 13593 tablet_service.cc:1468] Processing CreateTablet for tablet 381b57c8b76a4b1bb9acab08c0544588 (DEFAULT_TABLE table=default.Table_dfb8cb02c2eb48d4b9058e5a38c7f47d [id=6126e4761efe4889a919aa84a56398bb]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:47.851140 13462 tablet_service.cc:1468] Processing CreateTablet for tablet fd614a8565e74f488905a27d57fd42e1 (DEFAULT_TABLE table=default.Table_85b01c51682445e4a4f1672b286b0c56 [id=8ca45ce8b3e549c0949784cb59d2b2d5]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:47.851380 13463 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e97facd563eb42b6b5b72e7c56386ef5. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:47.869199 13451 tablet_service.cc:1468] Processing CreateTablet for tablet 381b57c8b76a4b1bb9acab08c0544588 (DEFAULT_TABLE table=default.Table_dfb8cb02c2eb48d4b9058e5a38c7f47d [id=6126e4761efe4889a919aa84a56398bb]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:47.869576 13451 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 381b57c8b76a4b1bb9acab08c0544588. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:47.870204 13595 tablet_service.cc:1468] Processing CreateTablet for tablet e7ac2e088ad94f64aa52cd9c5038a0c2 (DEFAULT_TABLE table=default.Table_a41ba45f1ed84fecae2f9b5e1c9c54c2 [id=aa7887df8c0f4850a7b30c56145c4a6e]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:47.870781 13595 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7ac2e088ad94f64aa52cd9c5038a0c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:47.874032 13465 tablet_service.cc:1468] Processing CreateTablet for tablet bb8afaec26154052b4ebf758ef286bed (DEFAULT_TABLE table=default.Table_3d2bb182df644a38ac75060c11bb7ac8 [id=9f40b3f7d2584cfcaa0b9b12aa52c7c7]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:47.874221 13462 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd614a8565e74f488905a27d57fd42e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:47.874467 13465 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb8afaec26154052b4ebf758ef286bed. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:47.875293 13766 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "74ea2298876a4066b297915c135d4618" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
W20250830 07:54:47.878780 13232 catalog_manager.cc:5415] Ignoring report from unknown tablet 752727eef0734ff3b7b35b1d5f66aea6
W20250830 07:54:47.878927 13232 catalog_manager.cc:5415] Ignoring report from unknown tablet 01771fa171374e92892345e7402c33d1
W20250830 07:54:47.878996 13232 catalog_manager.cc:5415] Ignoring report from unknown tablet ffc5945a032e47d4bd3397d7c887dc62
W20250830 07:54:47.879102 13232 catalog_manager.cc:5415] Ignoring report from unknown tablet 4828280e6fec4338b35422917966ac8c
I20250830 07:54:47.880657 13229 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet 1ca83bbf848744f38206ceb4126271be
I20250830 07:54:47.880838 13232 catalog_manager.cc:5674] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325) does not have the latest schema for tablet 856e644662334f8194ffef6ca1232248 (table default.Table_5a48429e0b894a6ea2c01b3ce40de1e9 [id=fe3e5972240046eaa659a06b4eea8648]). Expected version 1 got 0
I20250830 07:54:47.880843 13462 tablet_service.cc:1468] Processing CreateTablet for tablet f58dd526b5be4896a42984f88f9b5db0 (DEFAULT_TABLE table=default.Table_dfe393a221e54d719df225ec7723bdf1 [id=b3a8b069ca52462883194b127ef4acfa]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:47.881115 13229 catalog_manager.cc:6652] ReplaceTablet: tablet 1ca83bbf848744f38206ceb4126271be deleted and replaced by tablet 91aded8c81e5440bbed129f3d1638f79
I20250830 07:54:47.881145 13462 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f58dd526b5be4896a42984f88f9b5db0. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:47.881253 13229 rpcz_store.cc:275] Call kudu.master.MasterService.ReplaceTablet from 127.0.0.1:42126 (request call id 1007) took 1159 ms. Trace:
I20250830 07:54:47.881338 13229 rpcz_store.cc:276] 0830 07:54:46.721552 (+ 0us) service_pool.cc:168] Inserting onto call queue
0830 07:54:46.811753 (+ 90201us) service_pool.cc:225] Handling call
0830 07:54:46.815565 (+ 3812us) spinlock_profiling.cc:243] Waited 3.49 ms on lock 0x616000040f54. stack: 00007f4985b867d6 00007f4985b86590 00007f4984b793ad 0000000000972d94 0000000000972d5d 00007f499495114d 00007f4994951243 00007f4991610941 00007f499919ba5d 00007f4999331bdb 00007f49901690e7 00007f4990168e15 00007f498c9342ce 00007f498c9331ae 00007f498c9393e5 00007f498c939d0f
0830 07:54:47.881203 (+1065638us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0830 07:54:47.843815 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0830 07:54:47.844123 (+ 308us) write_op.cc:432] Acquiring schema lock in shared mode
0830 07:54:47.860105 (+ 15982us) write_op.cc:435] Acquired schema lock
0830 07:54:47.860108 (+ 3us) tablet.cc:660] Decoding operations
0830 07:54:47.860367 (+ 259us) write_op.cc:620] Acquiring the partition lock for write op
0830 07:54:47.860381 (+ 14us) write_op.cc:641] Partition lock acquired for write op
0830 07:54:47.860387 (+ 6us) tablet.cc:683] Acquiring locks for 2 operations
0830 07:54:47.860671 (+ 284us) tablet.cc:699] Row locks acquired
0830 07:54:47.860674 (+ 3us) write_op.cc:260] PREPARE: finished
0830 07:54:47.860743 (+ 69us) write_op.cc:270] Start()
0830 07:54:47.860810 (+ 67us) write_op.cc:276] Timestamp: P: 1756540487860715 usec, L: 0
0830 07:54:47.860815 (+ 5us) op_driver.cc:348] REPLICATION: starting
0830 07:54:47.861328 (+ 513us) log.cc:844] Serialized 625 byte log entry
0830 07:54:47.875345 (+ 14017us) op_driver.cc:464] REPLICATION: finished
0830 07:54:47.877373 (+ 2028us) write_op.cc:301] APPLY: starting
0830 07:54:47.877387 (+ 14us) tablet.cc:1365] starting BulkCheckPresence
0830 07:54:47.877456 (+ 69us) tablet.cc:1368] finished BulkCheckPresence
0830 07:54:47.877523 (+ 67us) tablet.cc:1370] starting ApplyRowOperation cycle
0830 07:54:47.877715 (+ 192us) tablet.cc:1381] finished ApplyRowOperation cycle
0830 07:54:47.877837 (+ 122us) tablet_metrics.cc:563] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0830 07:54:47.877845 (+ 8us) write_op.cc:312] APPLY: finished
0830 07:54:47.877968 (+ 123us) log.cc:844] Serialized 29 byte log entry
0830 07:54:47.878233 (+ 265us) write_op.cc:489] Releasing partition, row and schema locks
0830 07:54:47.878251 (+ 18us) write_op.cc:454] Released schema lock
0830 07:54:47.878257 (+ 6us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"spinlock_wait_cycles":8026368,"child_traces":[["op",{"apply.queue_time_us":1946,"apply.run_cpu_time_us":636,"apply.run_wall_time_us":1109,"num_ops":2,"prepare.queue_time_us":388120,"raft.queue_time_us":85,"raft.run_cpu_time_us":281,"raft.run_wall_time_us":615,"replication_time_us":14500}]]}
I20250830 07:54:47.882067 13229 master_service.cc:948] ReplaceTablet: received request to replace tablet a8660a6ff9254d4f9f0ef047b8682ed1 from {username='slave'} at 127.0.0.1:42126
I20250830 07:54:47.882723 13464 tablet_service.cc:1468] Processing CreateTablet for tablet 51c4aed949bd40d6b9088d807a6b0dc3 (DEFAULT_TABLE table=default.Table_980396fb4a82408bbe55bf0260c7431f [id=01a0bcafa91b4254b959a58eac7ee643]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:47.884904 13233 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet aab8d9a009d34166920905ad06ed153b
I20250830 07:54:47.885366 13233 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:42126 (request call id 994) took 1575 ms. Trace:
I20250830 07:54:47.885545 13233 rpcz_store.cc:276] 0830 07:54:46.310373 (+ 0us) service_pool.cc:168] Inserting onto call queue
0830 07:54:46.555875 (+245502us) service_pool.cc:225] Handling call
0830 07:54:46.556342 (+ 467us) catalog_manager.cc:2368] Looking up, locking, and authorizing table
0830 07:54:46.556475 (+ 133us) catalog_manager.cc:2790] Modifying in-memory table state
0830 07:54:46.556528 (+ 53us) catalog_manager.cc:2799] Locking tablets
0830 07:54:47.455113 (+898585us) catalog_manager.cc:2813] Removing table and tablets from system table
0830 07:54:47.842806 (+387693us) catalog_manager.cc:2831] Removing table from by-name map
0830 07:54:47.884806 (+ 42000us) catalog_manager.cc:2847] Committing in-memory state
0830 07:54:47.884838 (+ 32us) catalog_manager.cc:2851] Aborting table tasks
0830 07:54:47.885333 (+ 495us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0830 07:54:47.672555 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0830 07:54:47.672644 (+ 89us) write_op.cc:432] Acquiring schema lock in shared mode
0830 07:54:47.672649 (+ 5us) write_op.cc:435] Acquired schema lock
0830 07:54:47.672651 (+ 2us) tablet.cc:660] Decoding operations
0830 07:54:47.690846 (+ 18195us) write_op.cc:620] Acquiring the partition lock for write op
0830 07:54:47.690857 (+ 11us) write_op.cc:641] Partition lock acquired for write op
0830 07:54:47.690864 (+ 7us) tablet.cc:683] Acquiring locks for 2 operations
0830 07:54:47.690985 (+ 121us) tablet.cc:699] Row locks acquired
0830 07:54:47.690989 (+ 4us) write_op.cc:260] PREPARE: finished
0830 07:54:47.691025 (+ 36us) write_op.cc:270] Start()
0830 07:54:47.691061 (+ 36us) write_op.cc:276] Timestamp: P: 1756540487690958 usec, L: 0
0830 07:54:47.691066 (+ 5us) op_driver.cc:348] REPLICATION: starting
0830 07:54:47.834025 (+142959us) log.cc:844] Serialized 728 byte log entry
0830 07:54:47.835794 (+ 1769us) spinlock_profiling.cc:243] Waited 115 ms on lock 0x616000040f54. stack: 00007f4985b867d6 00007f4985b86590 00007f4984b793ad 0000000000972d94 0000000000972d5d 000000000097272a 00007f49915e2d62 00007f499298b2d5 00007f4992989df9 00007f4992992220 00007f499299202d 0000000000a774dc 00007f4985bccb5f 00007f4985bcfe2b 00007f4985bcfca8 0000000000a774dc
0830 07:54:47.841247 (+ 5453us) op_driver.cc:464] REPLICATION: finished
0830 07:54:47.842068 (+ 821us) write_op.cc:301] APPLY: starting
0830 07:54:47.842084 (+ 16us) tablet.cc:1365] starting BulkCheckPresence
0830 07:54:47.842144 (+ 60us) tablet.cc:1368] finished BulkCheckPresence
0830 07:54:47.842147 (+ 3us) tablet.cc:1370] starting ApplyRowOperation cycle
0830 07:54:47.842244 (+ 97us) tablet.cc:1381] finished ApplyRowOperation cycle
0830 07:54:47.842273 (+ 29us) tablet_metrics.cc:563] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0830 07:54:47.842307 (+ 34us) write_op.cc:312] APPLY: finished
0830 07:54:47.842411 (+ 104us) log.cc:844] Serialized 29 byte log entry
0830 07:54:47.842654 (+ 243us) write_op.cc:489] Releasing partition, row and schema locks
0830 07:54:47.842696 (+ 42us) write_op.cc:454] Released schema lock
0830 07:54:47.842702 (+ 6us) write_op.cc:341] FINISH: Updating metrics
0830 07:54:47.843624 (+ 922us) write_op.cc:489] Releasing partition, row and schema locks
0830 07:54:47.843630 (+ 6us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":743,"apply.run_cpu_time_us":464,"apply.run_wall_time_us":795,"num_ops":2,"prepare.queue_time_us":216946,"prepare.run_cpu_time_us":1529,"prepare.run_wall_time_us":171028,"raft.queue_time_us":77,"raft.run_cpu_time_us":281,"raft.run_wall_time_us":616,"replication_time_us":150152,"spinlock_wait_cycles":264923008}]]}
I20250830 07:54:47.852021 13468 tablet_service.cc:1515] Processing DeleteTablet for tablet 0b574113fee342f98c5574703440ba3a with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:46 UTC) from {username='slave'} at 127.0.0.1:37956
I20250830 07:54:47.852459 13456 tablet_service.cc:1468] Processing CreateTablet for tablet 8e4de738b30a45fb98c083c425cfa7b4 (DEFAULT_TABLE table=default.Table_9eae6b032d184bee81196ba47638cdb3 [id=8da53c4ff6d94949b2fd2f89d0f0d20e]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:47.867192 13887 tablet_bootstrap.cc:492] T b83dfc54383d4e7b96523568aea5c9f3 P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:54:47.867260 15010 raft_consensus.cc:491] T d2b8e6df64ef49e2ba36c093efd3c351 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:47.868084 13455 tablet_service.cc:1468] Processing CreateTablet for tablet 8a6a2a2dc6e0411b8ad8364cbf2cec36 (DEFAULT_TABLE table=default.Table_7f4b0093219d4583a01dc853b65dcd45 [id=78a71e4ff2394a3195828ee5988c36f0]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:47.888149 15010 raft_consensus.cc:513] T d2b8e6df64ef49e2ba36c093efd3c351 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:47.888648 13599 tablet_service.cc:1468] Processing CreateTablet for tablet f58dd526b5be4896a42984f88f9b5db0 (DEFAULT_TABLE table=default.Table_dfe393a221e54d719df225ec7723bdf1 [id=b3a8b069ca52462883194b127ef4acfa]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:47.888844 15010 leader_election.cc:290] T d2b8e6df64ef49e2ba36c093efd3c351 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:47.888648 13603 tablet_service.cc:1468] Processing CreateTablet for tablet b731285205a942c8b41ca06df5274636 (DEFAULT_TABLE table=default.Table_7c5efa2ac47f4d1583ab3a89270e94f9 [id=97f7e71b5e3043b7a2e6c2eae33f18a2]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:47.890507 13593 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 381b57c8b76a4b1bb9acab08c0544588. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:47.890633 13887 tablet_bootstrap.cc:654] T b83dfc54383d4e7b96523568aea5c9f3 P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:47.890868 13608 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb8afaec26154052b4ebf758ef286bed. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:47.891198 13599 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f58dd526b5be4896a42984f88f9b5db0. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:47.891466 13468 tablet_service.cc:1468] Processing CreateTablet for tablet b294445c38544232b0ff7e730a9fcdce (DEFAULT_TABLE table=default.Table_b53032ff88434d2f9a1fbf5a6fdc546f [id=58c4cfc99086408b9c208b84a73cc4d5]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:47.891815 13624 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "2b4ce50fbd26484faba3faa2ec5115c0" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9"
I20250830 07:54:47.892104 13603 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b731285205a942c8b41ca06df5274636. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:47.892944 13605 tablet_service.cc:1468] Processing CreateTablet for tablet d88108b406f941079f8ecacf6b5b44f1 (DEFAULT_TABLE table=default.Table_a8b747811d784f818430f7ecb11b738c [id=abb6c2bae0d6437a811195625eb563c3]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:47.893393 13605 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d88108b406f941079f8ecacf6b5b44f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:47.893537 13464 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 51c4aed949bd40d6b9088d807a6b0dc3. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:47.891275 13598 tablet_service.cc:1468] Processing CreateTablet for tablet e094de127d784eb885c2f31de1202cca (DEFAULT_TABLE table=default.Table_09c158a41a074beaabc02c2079b0d5c8 [id=6afecc1998274c3083bc28ac48533073]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:47.894497 13598 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e094de127d784eb885c2f31de1202cca. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:47.897071 13752 tablet_service.cc:1468] Processing CreateTablet for tablet cd48d5c2d81a4b26aa1128b4f1cd01f3 (DEFAULT_TABLE table=default.Table_10cf790ce076449ba68094fc91ebade3 [id=4e1e2c9e2ba94bc0b52b12a896a4f202]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:47.897084 13233 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_5d0efdc1863d4e95bbe8f050f69fb4c7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250830 07:54:47.897617 13606 tablet_service.cc:1468] Processing CreateTablet for tablet 40f5260a18a7454788078458f49a3ffa (DEFAULT_TABLE table=default.Table_34028d46b5fa400a959628ad3dded830 [id=a475e86558cc4290ae4354fb519c43f7]), partition=RANGE (key) PARTITION UNBOUNDED
W20250830 07:54:47.897706 13233 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5d0efdc1863d4e95bbe8f050f69fb4c7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:47.897850 13752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd48d5c2d81a4b26aa1128b4f1cd01f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:47.898219 13606 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40f5260a18a7454788078458f49a3ffa. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:47.899546 13229 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_2e6009ad55fd42afb9f5d177f2b8c272" } new_table_name: "default.Table_34ab4571d5784a7dbeb8066f8940f9ce" modify_external_catalogs: true
I20250830 07:54:47.900238 13887 tablet_bootstrap.cc:492] T b83dfc54383d4e7b96523568aea5c9f3 P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:54:47.900401 13887 ts_tablet_manager.cc:1397] T b83dfc54383d4e7b96523568aea5c9f3 P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.033s user 0.004s sys 0.000s
I20250830 07:54:47.901037 13887 raft_consensus.cc:357] T b83dfc54383d4e7b96523568aea5c9f3 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:47.901328 13887 raft_consensus.cc:383] T b83dfc54383d4e7b96523568aea5c9f3 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:47.901432 13887 raft_consensus.cc:738] T b83dfc54383d4e7b96523568aea5c9f3 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:54:47.901726 13887 consensus_queue.cc:260] T b83dfc54383d4e7b96523568aea5c9f3 P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:47.902434 13887 ts_tablet_manager.cc:1428] T b83dfc54383d4e7b96523568aea5c9f3 P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20250830 07:54:47.898170 13750 tablet_service.cc:1468] Processing CreateTablet for tablet e5c8a6e8e5854274bd0548c6ece9bf2d (DEFAULT_TABLE table=default.Table_e8e9b4f20799486282c3998dac420480 [id=8423c869430848bf85e010e5786deea8]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:47.902977 13750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e5c8a6e8e5854274bd0548c6ece9bf2d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:47.903039 13601 tablet_service.cc:1468] Processing CreateTablet for tablet 51c4aed949bd40d6b9088d807a6b0dc3 (DEFAULT_TABLE table=default.Table_980396fb4a82408bbe55bf0260c7431f [id=01a0bcafa91b4254b959a58eac7ee643]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:47.903362 13601 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 51c4aed949bd40d6b9088d807a6b0dc3. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:47.903726 13755 tablet_service.cc:1468] Processing CreateTablet for tablet 55d6b2e221c34d159ff5e71606be86f0 (DEFAULT_TABLE table=default.Table_e6e8ed8d3fb245729dfbc091e5e237a3 [id=416d2b28c197494b966fc1412f36cca7]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:47.904062 13755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 55d6b2e221c34d159ff5e71606be86f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:47.903039 13749 tablet_service.cc:1468] Processing CreateTablet for tablet ec7e9d198aab4ecabbc5a4f2cb3c6854 (DEFAULT_TABLE table=default.Table_c442bb1874724c3d9b586558e26bc632 [id=0d207a219a8c470b88c42060f8536bf9]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:47.906014 13749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec7e9d198aab4ecabbc5a4f2cb3c6854. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:47.903337 13747 tablet_service.cc:1468] Processing CreateTablet for tablet 8d685e1a2d474463b9f98282fd4d2090 (DEFAULT_TABLE table=default.Table_ad790949dd984cfda29f3c9a85e62db6 [id=4dfbd986a0e64280b56f15f6fd31a450]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:47.907274 13747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d685e1a2d474463b9f98282fd4d2090. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:47.909313 13591 tablet_service.cc:1468] Processing CreateTablet for tablet 2da9d7bfbe5f40fb839dff1070779256 (DEFAULT_TABLE table=default.Table_56e73ea16ebe4add985e2b7b30163924 [id=52391d002e2d4bd5a42a5f6d707ec8b1]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:47.910279 13755 tablet_service.cc:1468] Processing CreateTablet for tablet 31244b74c01a4c0d816867286a39cd4d (DEFAULT_TABLE table=default.Table_632fd974aa4a410b8b2c30d251ba9ad7 [id=19196ba07f914699b5f62503d02925e0]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:47.910599 13755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 31244b74c01a4c0d816867286a39cd4d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:47.911160 13594 tablet_service.cc:1468] Processing CreateTablet for tablet 6a5ee0edb69b4a03beaff15ef48cdd50 (DEFAULT_TABLE table=default.Table_25b24b8e1e304d03b728de795c0f63a8 [id=427b984e7e3b4587b597eab3b3d29731]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:47.911563 13594 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a5ee0edb69b4a03beaff15ef48cdd50. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:47.911675 13745 tablet_service.cc:1468] Processing CreateTablet for tablet 20779fb169cb4a218df515d68bbe64b8 (DEFAULT_TABLE table=default.Table_5aa473e5c4f245cdaba8e696d6775c87 [id=63bfed9f630243098a072aa565cd5561]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:47.912014 13745 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 20779fb169cb4a218df515d68bbe64b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:47.915196 13591 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2da9d7bfbe5f40fb839dff1070779256. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:47.921654 13591 tablet_service.cc:1468] Processing CreateTablet for tablet 843370e8d324489caeb51077cbdc6aa1 (DEFAULT_TABLE table=default.Table_c4a636c729fe4982bec27dec6c84bc98 [id=789011413bc6477ab138db094ba7a0c4]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:47.936713 13450 tablet_service.cc:1468] Processing CreateTablet for tablet e7ac2e088ad94f64aa52cd9c5038a0c2 (DEFAULT_TABLE table=default.Table_a41ba45f1ed84fecae2f9b5e1c9c54c2 [id=aa7887df8c0f4850a7b30c56145c4a6e]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:47.937100 13450 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7ac2e088ad94f64aa52cd9c5038a0c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:47.938575 13227 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet 78a8df3642224d99a86637c1a3a9de5c
I20250830 07:54:47.939162 13227 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:42126 (request call id 995) took 1623 ms. Trace:
I20250830 07:54:47.939256 13456 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e4de738b30a45fb98c083c425cfa7b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:47.939301 13227 rpcz_store.cc:276] 0830 07:54:46.316074 (+ 0us) service_pool.cc:168] Inserting onto call queue
0830 07:54:46.556843 (+240769us) service_pool.cc:225] Handling call
0830 07:54:46.557261 (+ 418us) catalog_manager.cc:2368] Looking up, locking, and authorizing table
0830 07:54:46.557402 (+ 141us) catalog_manager.cc:2790] Modifying in-memory table state
0830 07:54:46.557442 (+ 40us) catalog_manager.cc:2799] Locking tablets
0830 07:54:47.454566 (+897124us) catalog_manager.cc:2813] Removing table and tablets from system table
0830 07:54:47.938407 (+483841us) catalog_manager.cc:2831] Removing table from by-name map
0830 07:54:47.938477 (+ 70us) catalog_manager.cc:2847] Committing in-memory state
0830 07:54:47.938510 (+ 33us) catalog_manager.cc:2851] Aborting table tasks
0830 07:54:47.939118 (+ 608us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0830 07:54:47.901287 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0830 07:54:47.901403 (+ 116us) write_op.cc:432] Acquiring schema lock in shared mode
0830 07:54:47.901408 (+ 5us) write_op.cc:435] Acquired schema lock
0830 07:54:47.901411 (+ 3us) tablet.cc:660] Decoding operations
0830 07:54:47.901544 (+ 133us) write_op.cc:620] Acquiring the partition lock for write op
0830 07:54:47.901557 (+ 13us) write_op.cc:641] Partition lock acquired for write op
0830 07:54:47.901562 (+ 5us) tablet.cc:683] Acquiring locks for 2 operations
0830 07:54:47.901661 (+ 99us) tablet.cc:699] Row locks acquired
0830 07:54:47.901664 (+ 3us) write_op.cc:260] PREPARE: finished
0830 07:54:47.901695 (+ 31us) write_op.cc:270] Start()
0830 07:54:47.901724 (+ 29us) write_op.cc:276] Timestamp: P: 1756540487901665 usec, L: 0
0830 07:54:47.901728 (+ 4us) op_driver.cc:348] REPLICATION: starting
0830 07:54:47.901903 (+ 175us) log.cc:844] Serialized 728 byte log entry
0830 07:54:47.918165 (+ 16262us) op_driver.cc:464] REPLICATION: finished
0830 07:54:47.937748 (+ 19583us) write_op.cc:301] APPLY: starting
0830 07:54:47.937766 (+ 18us) tablet.cc:1365] starting BulkCheckPresence
0830 07:54:47.937831 (+ 65us) tablet.cc:1368] finished BulkCheckPresence
0830 07:54:47.937862 (+ 31us) tablet.cc:1370] starting ApplyRowOperation cycle
0830 07:54:47.937931 (+ 69us) tablet.cc:1381] finished ApplyRowOperation cycle
0830 07:54:47.937966 (+ 35us) tablet_metrics.cc:563] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0830 07:54:47.937973 (+ 7us) write_op.cc:312] APPLY: finished
0830 07:54:47.938067 (+ 94us) log.cc:844] Serialized 29 byte log entry
0830 07:54:47.938302 (+ 235us) write_op.cc:489] Releasing partition, row and schema locks
0830 07:54:47.938325 (+ 23us) write_op.cc:454] Released schema lock
0830 07:54:47.938331 (+ 6us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":19513,"num_ops":2,"prepare.queue_time_us":445403,"raft.queue_time_us":2289,"raft.run_cpu_time_us":279,"raft.run_wall_time_us":279,"replication_time_us":16404}]]}
I20250830 07:54:47.939980 13227 master_service.cc:948] ReplaceTablet: received request to replace tablet 1ca83bbf848744f38206ceb4126271be from {username='slave'} at 127.0.0.1:42126
I20250830 07:54:47.946107 13450 tablet_service.cc:1468] Processing CreateTablet for tablet 1034799ae047460b839edd59e4c2ae72 (DEFAULT_TABLE table=default.Table_5a55d9f1c7a44f4785b34a618728cbae [id=26cb070ad4f84af6a7be55fc16cac701]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:47.946509 13450 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1034799ae047460b839edd59e4c2ae72. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:47.952709 13449 tablet_service.cc:1468] Processing CreateTablet for tablet d0d8a3d95b4b4529a3c95be4c2d7a409 (DEFAULT_TABLE table=default.Table_be854d521db44926811d0dee9cb0fa54 [id=8a38230b74c8432c86f6c1528abc072b]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:47.953024 13449 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0d8a3d95b4b4529a3c95be4c2d7a409. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:47.955253 13461 tablet_service.cc:1468] Processing CreateTablet for tablet b731285205a942c8b41ca06df5274636 (DEFAULT_TABLE table=default.Table_7c5efa2ac47f4d1583ab3a89270e94f9 [id=97f7e71b5e3043b7a2e6c2eae33f18a2]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:47.955541 13461 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b731285205a942c8b41ca06df5274636. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:47.958847 13231 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet 3f70097c1b3a48dfbc1ad129fa7a3730
I20250830 07:54:47.959635 13231 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:42126 (request call id 997) took 1617 ms. Trace:
I20250830 07:54:47.959745 13231 rpcz_store.cc:276] 0830 07:54:46.342456 (+ 0us) service_pool.cc:168] Inserting onto call queue
0830 07:54:46.590173 (+247717us) service_pool.cc:225] Handling call
0830 07:54:46.590688 (+ 515us) catalog_manager.cc:2368] Looking up, locking, and authorizing table
0830 07:54:46.590850 (+ 162us) catalog_manager.cc:2790] Modifying in-memory table state
0830 07:54:46.590940 (+ 90us) catalog_manager.cc:2799] Locking tablets
0830 07:54:47.455795 (+864855us) catalog_manager.cc:2813] Removing table and tablets from system table
0830 07:54:47.958629 (+502834us) catalog_manager.cc:2831] Removing table from by-name map
0830 07:54:47.958728 (+ 99us) catalog_manager.cc:2847] Committing in-memory state
0830 07:54:47.958790 (+ 62us) catalog_manager.cc:2851] Aborting table tasks
0830 07:54:47.959601 (+ 811us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0830 07:54:47.948118 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0830 07:54:47.948221 (+ 103us) write_op.cc:432] Acquiring schema lock in shared mode
0830 07:54:47.948225 (+ 4us) write_op.cc:435] Acquired schema lock
0830 07:54:47.948227 (+ 2us) tablet.cc:660] Decoding operations
0830 07:54:47.948359 (+ 132us) write_op.cc:620] Acquiring the partition lock for write op
0830 07:54:47.948374 (+ 15us) write_op.cc:641] Partition lock acquired for write op
0830 07:54:47.948381 (+ 7us) tablet.cc:683] Acquiring locks for 2 operations
0830 07:54:47.948485 (+ 104us) tablet.cc:699] Row locks acquired
0830 07:54:47.948487 (+ 2us) write_op.cc:260] PREPARE: finished
0830 07:54:47.948522 (+ 35us) write_op.cc:270] Start()
0830 07:54:47.948552 (+ 30us) write_op.cc:276] Timestamp: P: 1756540487948488 usec, L: 0
0830 07:54:47.948556 (+ 4us) op_driver.cc:348] REPLICATION: starting
0830 07:54:47.948730 (+ 174us) log.cc:844] Serialized 728 byte log entry
0830 07:54:47.952002 (+ 3272us) op_driver.cc:464] REPLICATION: finished
0830 07:54:47.957680 (+ 5678us) write_op.cc:301] APPLY: starting
0830 07:54:47.957695 (+ 15us) tablet.cc:1365] starting BulkCheckPresence
0830 07:54:47.957734 (+ 39us) tablet.cc:1368] finished BulkCheckPresence
0830 07:54:47.957759 (+ 25us) tablet.cc:1370] starting ApplyRowOperation cycle
0830 07:54:47.957817 (+ 58us) tablet.cc:1381] finished ApplyRowOperation cycle
0830 07:54:47.957848 (+ 31us) tablet_metrics.cc:563] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0830 07:54:47.957855 (+ 7us) write_op.cc:312] APPLY: finished
0830 07:54:47.958319 (+ 464us) log.cc:844] Serialized 29 byte log entry
0830 07:54:47.958533 (+ 214us) write_op.cc:489] Releasing partition, row and schema locks
0830 07:54:47.958551 (+ 18us) write_op.cc:454] Released schema lock
0830 07:54:47.958558 (+ 7us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":5617,"num_ops":2,"prepare.queue_time_us":491884,"raft.queue_time_us":56,"raft.run_cpu_time_us":273,"raft.run_wall_time_us":598,"replication_time_us":3418}]]}
I20250830 07:54:47.962491 13452 tablet_service.cc:1468] Processing CreateTablet for tablet e094de127d784eb885c2f31de1202cca (DEFAULT_TABLE table=default.Table_09c158a41a074beaabc02c2079b0d5c8 [id=6afecc1998274c3083bc28ac48533073]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:47.962827 13452 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e094de127d784eb885c2f31de1202cca. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:47.914060 13739 tablet_service.cc:1468] Processing CreateTablet for tablet 94e28f0788664448b53edb5240a4a4b6 (DEFAULT_TABLE table=default.Table_dc6cbe0df3e54f26a96f0b91dcec8d56 [id=ce7f98cb7cb948b2aa9d5b309cc101a6]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:47.963361 13739 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 94e28f0788664448b53edb5240a4a4b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:47.963676 15010 raft_consensus.cc:491] T 65f1ee59e6e9498381d686f16a865e23 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:47.963773 15010 raft_consensus.cc:513] T 65f1ee59e6e9498381d686f16a865e23 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:47.964349 15010 leader_election.cc:290] T 65f1ee59e6e9498381d686f16a865e23 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:47.964551 13461 tablet_service.cc:1468] Processing CreateTablet for tablet d88108b406f941079f8ecacf6b5b44f1 (DEFAULT_TABLE table=default.Table_a8b747811d784f818430f7ecb11b738c [id=abb6c2bae0d6437a811195625eb563c3]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:47.964830 13461 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d88108b406f941079f8ecacf6b5b44f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:47.967846 13449 tablet_service.cc:1468] Processing CreateTablet for tablet 85921239e8a24bd8b2c90e879984f115 (DEFAULT_TABLE table=default.Table_3c833cc95d704af1bb3a4d77ab6b804a [id=1d6b0c07f20f46bd893bc61db3990f3d]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:47.968201 13449 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 85921239e8a24bd8b2c90e879984f115. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:47.969314 13452 tablet_service.cc:1468] Processing CreateTablet for tablet 40f5260a18a7454788078458f49a3ffa (DEFAULT_TABLE table=default.Table_34028d46b5fa400a959628ad3dded830 [id=a475e86558cc4290ae4354fb519c43f7]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:47.969600 13452 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40f5260a18a7454788078458f49a3ffa. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:47.971182 13455 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a6a2a2dc6e0411b8ad8364cbf2cec36. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:47.971271 13463 tablet_service.cc:1468] Processing CreateTablet for tablet 2da9d7bfbe5f40fb839dff1070779256 (DEFAULT_TABLE table=default.Table_56e73ea16ebe4add985e2b7b30163924 [id=52391d002e2d4bd5a42a5f6d707ec8b1]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:47.971534 13463 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2da9d7bfbe5f40fb839dff1070779256. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:47.971661 13754 tablet_service.cc:1468] Processing CreateTablet for tablet e845134de44f4cf4b0075d207df30d21 (DEFAULT_TABLE table=default.Table_0ad54505afd34d1792f97395a95b26bb [id=8f41d25177eb44c8b4555831176adeef]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:47.972074 13754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e845134de44f4cf4b0075d207df30d21. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:47.976657 13463 tablet_service.cc:1468] Processing CreateTablet for tablet 6a5ee0edb69b4a03beaff15ef48cdd50 (DEFAULT_TABLE table=default.Table_25b24b8e1e304d03b728de795c0f63a8 [id=427b984e7e3b4587b597eab3b3d29731]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:47.976971 13463 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a5ee0edb69b4a03beaff15ef48cdd50. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:47.979388 13456 tablet_service.cc:1468] Processing CreateTablet for tablet 843370e8d324489caeb51077cbdc6aa1 (DEFAULT_TABLE table=default.Table_c4a636c729fe4982bec27dec6c84bc98 [id=789011413bc6477ab138db094ba7a0c4]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:47.979674 13456 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 843370e8d324489caeb51077cbdc6aa1. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:47.979696 13749 tablet_service.cc:1468] Processing CreateTablet for tablet e97facd563eb42b6b5b72e7c56386ef5 (DEFAULT_TABLE table=default.Table_e2b0521d564549e69deaff73c4506d20 [id=fa39d2dd20894e78b0dcbd2ec7b979cb]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:47.980006 13749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e97facd563eb42b6b5b72e7c56386ef5. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:47.982498 13460 tablet_service.cc:1468] Processing CreateTablet for tablet 1a1a7ff577334cc58e75d7615b793573 (DEFAULT_TABLE table=default.Table_df0e35c42b3d47589ce170267c3c7b76 [id=eab69737d0014874b68b8c9af5763f09]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:47.985477 13460 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a1a7ff577334cc58e75d7615b793573. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:47.990895 13739 tablet_service.cc:1468] Processing CreateTablet for tablet e498b17956514a9d93807598f8dfb351 (DEFAULT_TABLE table=default.Table_9ea8aaa6727d4d4c9a728c1deb363c95 [id=ffbe89803ccf4bd5a46e022eb310b1b6]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:47.991287 13739 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e498b17956514a9d93807598f8dfb351. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:47.993610 13750 tablet_service.cc:1515] Processing DeleteTablet for tablet 0afcda169b6d406590129c0fd70936b9 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:46 UTC) from {username='slave'} at 127.0.0.1:45460
I20250830 07:54:47.993772 13449 tablet_service.cc:1468] Processing CreateTablet for tablet 2ca20b78cc0445cdb08e4e6f245acf53 (DEFAULT_TABLE table=default.Table_9ce68aedbeda402e84a735a411e55042 [id=dcd33db0bd7c4a2baf4ba4adcfafca6f]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:47.994096 13449 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ca20b78cc0445cdb08e4e6f245acf53. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:47.994251 13741 tablet_service.cc:1468] Processing CreateTablet for tablet 0d2c9f8b6ce745bab1aa07beeb9ddbff (DEFAULT_TABLE table=default.Table_6041884eb99a4da5b48436b99054e999 [id=ddb55370d40b43e780cac1057babd33a]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:47.994588 13741 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d2c9f8b6ce745bab1aa07beeb9ddbff. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:47.983762 13457 tablet_service.cc:1468] Processing CreateTablet for tablet 7cf69490c7944a0a9c0558d425cea37c (DEFAULT_TABLE table=default.Table_b12f5a566e884916a19242caa716466a [id=0abfd2c6bd8b4b969d280883faccae48]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:47.994956 13887 tablet_bootstrap.cc:492] T 3525652a73b8413b8ccbcb5824cc5880 P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:54:47.995638 13754 tablet_service.cc:1468] Processing CreateTablet for tablet ddd8e87e811e41c582c91342b9ff2755 (DEFAULT_TABLE table=default.Table_3bb6252818564f6c898bfd231839d740 [id=d9bb26da7fc54e0fba3a888e0d2746f6]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:47.996330 13754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ddd8e87e811e41c582c91342b9ff2755. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:47.994510 13749 tablet_service.cc:1468] Processing CreateTablet for tablet 19f5b18cbe0b4f97889a089beff3b585 (DEFAULT_TABLE table=default.Table_2383bf6f9b124a47aad389ba74ef460a [id=867c64d352a4400e8c398547f9d7aaa1]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:47.996686 13749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 19f5b18cbe0b4f97889a089beff3b585. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:47.881111 13232 catalog_manager.cc:5674] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325) does not have the latest schema for tablet 99f307a8cbb34addaafab82b3ed18241 (table default.Table_4e2c5e0840fe4d3398519818e193f4dd [id=2a10f84461764fd5ab5a59499a370034]). Expected version 1 got 0
I20250830 07:54:47.997507 13232 catalog_manager.cc:5674] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325) does not have the latest schema for tablet 13df49c2c2cd4e5cae26a540835b74c9 (table default.Table_cbbde0aa8e5b47e69f1a0db288d36cdf [id=f366e4f894174aeb837a8749180c3a34]). Expected version 1 got 0
I20250830 07:54:47.997849 13232 catalog_manager.cc:5674] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325) does not have the latest schema for tablet 74891b8103e144c486750f64ba2003f4 (table default.Table_f898ce75325a436ca3a63a3c9e46fb68 [id=63f62da0ba61488791fcce76368d92a8]). Expected version 1 got 0
I20250830 07:54:47.998220 13232 catalog_manager.cc:5674] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325) does not have the latest schema for tablet aee84a97524e4568acdc4ae1c74fb492 (table default.Table_65ab52329c314c13817e7261f5108188 [id=18b2c25896e546748465c4807b839cbf]). Expected version 2 got 0
I20250830 07:54:47.999557 13468 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b294445c38544232b0ff7e730a9fcdce. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:48.001204 13887 tablet_bootstrap.cc:654] T 3525652a73b8413b8ccbcb5824cc5880 P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:48.001463 13886 tablet_bootstrap.cc:492] T 8eb010d7955d47a89ff1d01be1b5b01e P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:54:48.001579 13886 ts_tablet_manager.cc:1397] T 8eb010d7955d47a89ff1d01be1b5b01e P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.386s user 0.023s sys 0.121s
I20250830 07:54:48.002432 13886 raft_consensus.cc:357] T 8eb010d7955d47a89ff1d01be1b5b01e P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:48.002638 13886 raft_consensus.cc:383] T 8eb010d7955d47a89ff1d01be1b5b01e P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:48.002694 13886 raft_consensus.cc:738] T 8eb010d7955d47a89ff1d01be1b5b01e P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:54:48.003028 13886 consensus_queue.cc:260] T 8eb010d7955d47a89ff1d01be1b5b01e P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:48.003782 13886 ts_tablet_manager.cc:1428] T 8eb010d7955d47a89ff1d01be1b5b01e P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20250830 07:54:48.004082 13886 tablet_bootstrap.cc:492] T e4ca3110247640fbae4241448e8d5ef7 P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:54:48.005138 13457 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7cf69490c7944a0a9c0558d425cea37c. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:48.005681 13466 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 20a532a8db53426faa7b4231cfb393b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:48.006426 13886 tablet_bootstrap.cc:654] T e4ca3110247640fbae4241448e8d5ef7 P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:48.007513 13231 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_161629d931be48b2bcb841aef0b06a96"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:48.008239 13231 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_161629d931be48b2bcb841aef0b06a96 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:48.013999 15010 raft_consensus.cc:491] T aee84a97524e4568acdc4ae1c74fb492 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:48.014119 15010 raft_consensus.cc:513] T aee84a97524e4568acdc4ae1c74fb492 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:48.014710 15010 leader_election.cc:290] T aee84a97524e4568acdc4ae1c74fb492 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:48.013995 13460 tablet_service.cc:1468] Processing CreateTablet for tablet 4b3362e8f5f74cf69348cebed47082ee (DEFAULT_TABLE table=default.Table_83d0da7d392c4cf7837921ac75c21714 [id=96db6fa119934046839553bd0e353bb8]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:48.015349 13750 tablet_service.cc:1468] Processing CreateTablet for tablet fd614a8565e74f488905a27d57fd42e1 (DEFAULT_TABLE table=default.Table_85b01c51682445e4a4f1672b286b0c56 [id=8ca45ce8b3e549c0949784cb59d2b2d5]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:48.015484 13460 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b3362e8f5f74cf69348cebed47082ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:48.015753 13750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd614a8565e74f488905a27d57fd42e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:48.021561 14818 raft_consensus.cc:491] T ec4a3975961d4f85ad9da94835417574 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:48.021678 14818 raft_consensus.cc:513] T ec4a3975961d4f85ad9da94835417574 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:48.022223 14818 leader_election.cc:290] T ec4a3975961d4f85ad9da94835417574 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
I20250830 07:54:48.023447 13886 tablet_bootstrap.cc:492] T e4ca3110247640fbae4241448e8d5ef7 P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:54:48.023573 13886 ts_tablet_manager.cc:1397] T e4ca3110247640fbae4241448e8d5ef7 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.020s user 0.004s sys 0.002s
I20250830 07:54:48.023778 13750 tablet_service.cc:1515] Processing DeleteTablet for tablet 0b574113fee342f98c5574703440ba3a with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:46 UTC) from {username='slave'} at 127.0.0.1:45460
I20250830 07:54:48.024417 13886 raft_consensus.cc:357] T e4ca3110247640fbae4241448e8d5ef7 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:48.024571 13886 raft_consensus.cc:383] T e4ca3110247640fbae4241448e8d5ef7 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:48.024619 13886 raft_consensus.cc:738] T e4ca3110247640fbae4241448e8d5ef7 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:54:48.024801 13886 consensus_queue.cc:260] T e4ca3110247640fbae4241448e8d5ef7 P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:48.025331 13886 ts_tablet_manager.cc:1428] T e4ca3110247640fbae4241448e8d5ef7 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20250830 07:54:48.025591 13886 tablet_bootstrap.cc:492] T 13df49c2c2cd4e5cae26a540835b74c9 P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:54:48.026942 13886 tablet_bootstrap.cc:654] T 13df49c2c2cd4e5cae26a540835b74c9 P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:48.027648 14818 raft_consensus.cc:491] T 8eb010d7955d47a89ff1d01be1b5b01e P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:48.027753 14818 raft_consensus.cc:513] T 8eb010d7955d47a89ff1d01be1b5b01e P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:48.028249 14818 leader_election.cc:290] T 8eb010d7955d47a89ff1d01be1b5b01e P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
I20250830 07:54:48.029232 13766 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "d2b8e6df64ef49e2ba36c093efd3c351" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:48.029850 13775 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "65f1ee59e6e9498381d686f16a865e23" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:48.030130 14852 raft_consensus.cc:491] T d206f6b6e7524a27a9f95787bcd5de77 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:48.030108 13752 tablet_service.cc:1468] Processing CreateTablet for tablet 8a6a2a2dc6e0411b8ad8364cbf2cec36 (DEFAULT_TABLE table=default.Table_7f4b0093219d4583a01dc853b65dcd45 [id=78a71e4ff2394a3195828ee5988c36f0]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:48.030161 13767 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "aee84a97524e4568acdc4ae1c74fb492" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:48.030251 14852 raft_consensus.cc:513] T d206f6b6e7524a27a9f95787bcd5de77 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:48.030431 13752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a6a2a2dc6e0411b8ad8364cbf2cec36. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:48.030735 14852 leader_election.cc:290] T d206f6b6e7524a27a9f95787bcd5de77 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:48.031986 13449 tablet_service.cc:1468] Processing CreateTablet for tablet 910a9f086e384602a8b8661cd6da7585 (DEFAULT_TABLE table=default.Table_8e66006498aa4e5ebbaf880a1a53c1e7 [id=de0be72abdf345dc849cf30a254c5ef7]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:48.032296 13449 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 910a9f086e384602a8b8661cd6da7585. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:48.033241 13218 catalog_manager.cc:4928] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): tablet e4ca3110247640fbae4241448e8d5ef7 (table default.Table_3a3bd36d028a41e39d051f15093ea71d [id=fa763e770a13439084bb86dd227be4cf]) successfully deleted
W20250830 07:54:48.033926 13218 catalog_manager.cc:4895] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): delete failed for tablet 0afcda169b6d406590129c0fd70936b9 because the tablet was not found. No further retry: Not found: Tablet not found: 0afcda169b6d406590129c0fd70936b9
W20250830 07:54:48.034225 13218 catalog_manager.cc:4908] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): delete failed for tablet 0b574113fee342f98c5574703440ba3a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0b574113fee342f98c5574703440ba3a already in progress: creating tablet
I20250830 07:54:48.035307 13457 tablet_service.cc:1468] Processing CreateTablet for tablet 9f8aa6e4a34647629979ea9bb54f1d57 (DEFAULT_TABLE table=default.Table_30a34510203d435ca31d4da546ce305b [id=4862bdf1d65b4376ba6516f78b291d57]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:48.035660 13457 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f8aa6e4a34647629979ea9bb54f1d57. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:48.038604 13752 tablet_service.cc:1468] Processing CreateTablet for tablet 381b57c8b76a4b1bb9acab08c0544588 (DEFAULT_TABLE table=default.Table_dfb8cb02c2eb48d4b9058e5a38c7f47d [id=6126e4761efe4889a919aa84a56398bb]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:48.038973 13752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 381b57c8b76a4b1bb9acab08c0544588. 1 dirs total, 0 dirs full, 0 dirs failed
W20250830 07:54:48.040813 13220 catalog_manager.cc:4895] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet 0afcda169b6d406590129c0fd70936b9 because the tablet was not found. No further retry: Not found: Tablet not found: 0afcda169b6d406590129c0fd70936b9
W20250830 07:54:48.041056 13220 catalog_manager.cc:4908] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet 0b574113fee342f98c5574703440ba3a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0b574113fee342f98c5574703440ba3a already in progress: creating tablet
I20250830 07:54:48.041536 13460 tablet_service.cc:1468] Processing CreateTablet for tablet 7f452a38bf584637b7708a42b2a5a35f (DEFAULT_TABLE table=default.Table_3abc6459ae534133b6d4f903931c1389 [id=78072ab162e6443b83fa3ac6be6caef6]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:48.041821 13460 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f452a38bf584637b7708a42b2a5a35f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:48.045616 13750 tablet_service.cc:1468] Processing CreateTablet for tablet f58dd526b5be4896a42984f88f9b5db0 (DEFAULT_TABLE table=default.Table_dfe393a221e54d719df225ec7723bdf1 [id=b3a8b069ca52462883194b127ef4acfa]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:48.045835 13886 tablet_bootstrap.cc:492] T 13df49c2c2cd4e5cae26a540835b74c9 P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:54:48.045917 13750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f58dd526b5be4896a42984f88f9b5db0. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:48.045954 13886 ts_tablet_manager.cc:1397] T 13df49c2c2cd4e5cae26a540835b74c9 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.020s user 0.006s sys 0.001s
I20250830 07:54:48.046658 13886 raft_consensus.cc:357] T 13df49c2c2cd4e5cae26a540835b74c9 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:48.046805 13886 raft_consensus.cc:383] T 13df49c2c2cd4e5cae26a540835b74c9 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:48.046855 13886 raft_consensus.cc:738] T 13df49c2c2cd4e5cae26a540835b74c9 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:54:48.047075 13886 consensus_queue.cc:260] T 13df49c2c2cd4e5cae26a540835b74c9 P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:48.047145 13746 tablet_service.cc:1468] Processing CreateTablet for tablet 9f27983af2c84dd6a40e7e0b900a9dc6 (DEFAULT_TABLE table=default.Table_f3e7b6dfb1fc4dc2be4da90c976b21dd [id=0e1d9a24febe4035ae03aa19db5f69dc]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:48.047442 13746 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f27983af2c84dd6a40e7e0b900a9dc6. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:48.047549 13886 ts_tablet_manager.cc:1428] T 13df49c2c2cd4e5cae26a540835b74c9 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20250830 07:54:48.047785 13886 tablet_bootstrap.cc:492] T 74891b8103e144c486750f64ba2003f4 P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:54:48.049386 13886 tablet_bootstrap.cc:654] T 74891b8103e144c486750f64ba2003f4 P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:48.051251 13747 tablet_service.cc:1468] Processing CreateTablet for tablet 51c4aed949bd40d6b9088d807a6b0dc3 (DEFAULT_TABLE table=default.Table_980396fb4a82408bbe55bf0260c7431f [id=01a0bcafa91b4254b959a58eac7ee643]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:48.051599 13747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 51c4aed949bd40d6b9088d807a6b0dc3. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:48.058818 13747 tablet_service.cc:1468] Processing CreateTablet for tablet b294445c38544232b0ff7e730a9fcdce (DEFAULT_TABLE table=default.Table_b53032ff88434d2f9a1fbf5a6fdc546f [id=58c4cfc99086408b9c208b84a73cc4d5]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:48.059252 13747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b294445c38544232b0ff7e730a9fcdce. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:48.061642 13886 tablet_bootstrap.cc:492] T 74891b8103e144c486750f64ba2003f4 P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:54:48.061748 13886 ts_tablet_manager.cc:1397] T 74891b8103e144c486750f64ba2003f4 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.014s user 0.003s sys 0.002s
I20250830 07:54:48.062651 13886 raft_consensus.cc:357] T 74891b8103e144c486750f64ba2003f4 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:48.062772 13886 raft_consensus.cc:383] T 74891b8103e144c486750f64ba2003f4 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:48.062813 13886 raft_consensus.cc:738] T 74891b8103e144c486750f64ba2003f4 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:54:48.062985 13886 consensus_queue.cc:260] T 74891b8103e144c486750f64ba2003f4 P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:48.063516 13886 ts_tablet_manager.cc:1428] T 74891b8103e144c486750f64ba2003f4 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20250830 07:54:48.063724 13886 tablet_bootstrap.cc:492] T 09586fdda94c4aff9d3fa25d71fe6ac0 P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:54:47.927903 13601 tablet_service.cc:1468] Processing CreateTablet for tablet 1a1a7ff577334cc58e75d7615b793573 (DEFAULT_TABLE table=default.Table_df0e35c42b3d47589ce170267c3c7b76 [id=eab69737d0014874b68b8c9af5763f09]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:48.065665 13601 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a1a7ff577334cc58e75d7615b793573. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:48.067768 13887 tablet_bootstrap.cc:492] T 3525652a73b8413b8ccbcb5824cc5880 P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:54:48.067881 13887 ts_tablet_manager.cc:1397] T 3525652a73b8413b8ccbcb5824cc5880 P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.073s user 0.004s sys 0.004s
I20250830 07:54:48.068554 13887 raft_consensus.cc:357] T 3525652a73b8413b8ccbcb5824cc5880 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:48.068730 13887 raft_consensus.cc:383] T 3525652a73b8413b8ccbcb5824cc5880 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:48.068768 13886 tablet_bootstrap.cc:654] T 09586fdda94c4aff9d3fa25d71fe6ac0 P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:48.068783 13887 raft_consensus.cc:738] T 3525652a73b8413b8ccbcb5824cc5880 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:54:48.068944 13887 consensus_queue.cc:260] T 3525652a73b8413b8ccbcb5824cc5880 P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:48.069466 13887 ts_tablet_manager.cc:1428] T 3525652a73b8413b8ccbcb5824cc5880 P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20250830 07:54:47.929350 13594 tablet_service.cc:1468] Processing CreateTablet for tablet 7cf69490c7944a0a9c0558d425cea37c (DEFAULT_TABLE table=default.Table_b12f5a566e884916a19242caa716466a [id=0abfd2c6bd8b4b969d280883faccae48]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:47.892364 13624 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "44313f1a11b74e6d996cafd3c03d1836" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9"
I20250830 07:54:48.071187 13594 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7cf69490c7944a0a9c0558d425cea37c. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:47.952090 13592 tablet_service.cc:1468] Processing CreateTablet for tablet 85921239e8a24bd8b2c90e879984f115 (DEFAULT_TABLE table=default.Table_3c833cc95d704af1bb3a4d77ab6b804a [id=1d6b0c07f20f46bd893bc61db3990f3d]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:48.071420 13592 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 85921239e8a24bd8b2c90e879984f115. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:48.075402 13887 tablet_bootstrap.cc:492] T 0ceccc5f18294356894695fe08d73e30 P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:54:48.076918 13887 tablet_bootstrap.cc:654] T 0ceccc5f18294356894695fe08d73e30 P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:48.076934 13594 tablet_service.cc:1468] Processing CreateTablet for tablet 910a9f086e384602a8b8661cd6da7585 (DEFAULT_TABLE table=default.Table_8e66006498aa4e5ebbaf880a1a53c1e7 [id=de0be72abdf345dc849cf30a254c5ef7]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:48.077241 13594 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 910a9f086e384602a8b8661cd6da7585. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:48.078037 13596 tablet_service.cc:1468] Processing CreateTablet for tablet 9f8aa6e4a34647629979ea9bb54f1d57 (DEFAULT_TABLE table=default.Table_30a34510203d435ca31d4da546ce305b [id=4862bdf1d65b4376ba6516f78b291d57]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:48.078339 13596 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f8aa6e4a34647629979ea9bb54f1d57. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:48.079960 13737 tablet_service.cc:1468] Processing CreateTablet for tablet b731285205a942c8b41ca06df5274636 (DEFAULT_TABLE table=default.Table_7c5efa2ac47f4d1583ab3a89270e94f9 [id=97f7e71b5e3043b7a2e6c2eae33f18a2]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:48.080300 13737 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b731285205a942c8b41ca06df5274636. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:48.080396 13744 tablet_service.cc:1468] Processing CreateTablet for tablet 85921239e8a24bd8b2c90e879984f115 (DEFAULT_TABLE table=default.Table_3c833cc95d704af1bb3a4d77ab6b804a [id=1d6b0c07f20f46bd893bc61db3990f3d]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:48.080482 13601 tablet_service.cc:1468] Processing CreateTablet for tablet 0afcda169b6d406590129c0fd70936b9 (DEFAULT_TABLE table=default.Table_4184c9e2d90c4ecfb3b3199ce5517ba5 [id=f96888dead984c5c8f4dd9b1d8be9d5d]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:48.080760 13601 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0afcda169b6d406590129c0fd70936b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:48.080783 13744 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 85921239e8a24bd8b2c90e879984f115. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:48.083142 13735 tablet_service.cc:1468] Processing CreateTablet for tablet e094de127d784eb885c2f31de1202cca (DEFAULT_TABLE table=default.Table_09c158a41a074beaabc02c2079b0d5c8 [id=6afecc1998274c3083bc28ac48533073]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:48.083461 13735 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e094de127d784eb885c2f31de1202cca. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:48.087184 13748 tablet_service.cc:1468] Processing CreateTablet for tablet d88108b406f941079f8ecacf6b5b44f1 (DEFAULT_TABLE table=default.Table_a8b747811d784f818430f7ecb11b738c [id=abb6c2bae0d6437a811195625eb563c3]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:48.087450 13748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d88108b406f941079f8ecacf6b5b44f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:48.091534 13601 tablet_service.cc:1468] Processing CreateTablet for tablet 0621f6e91e464fd2a556d43e2dc88506 (DEFAULT_TABLE table=default.Table_ba631e9ef6834bae8385a9ecb17e8f1e [id=14e5b80fd799477e95e442a35923bc97]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:48.097936 13749 tablet_service.cc:1468] Processing CreateTablet for tablet 8e4de738b30a45fb98c083c425cfa7b4 (DEFAULT_TABLE table=default.Table_9eae6b032d184bee81196ba47638cdb3 [id=8da53c4ff6d94949b2fd2f89d0f0d20e]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:48.098395 13749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e4de738b30a45fb98c083c425cfa7b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:48.108950 13742 tablet_service.cc:1468] Processing CreateTablet for tablet 1034799ae047460b839edd59e4c2ae72 (DEFAULT_TABLE table=default.Table_5a55d9f1c7a44f4785b34a618728cbae [id=26cb070ad4f84af6a7be55fc16cac701]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:48.109467 13742 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1034799ae047460b839edd59e4c2ae72. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:48.113405 15010 raft_consensus.cc:491] T 4b403cadfb7b42f8896b2ee16b50ecb1 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:48.113520 15010 raft_consensus.cc:513] T 4b403cadfb7b42f8896b2ee16b50ecb1 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:48.113946 13737 tablet_service.cc:1468] Processing CreateTablet for tablet 2da9d7bfbe5f40fb839dff1070779256 (DEFAULT_TABLE table=default.Table_56e73ea16ebe4add985e2b7b30163924 [id=52391d002e2d4bd5a42a5f6d707ec8b1]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:48.114077 15010 leader_election.cc:290] T 4b403cadfb7b42f8896b2ee16b50ecb1 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:48.114293 13737 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2da9d7bfbe5f40fb839dff1070779256. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:48.120060 13455 tablet_service.cc:1468] Processing CreateTablet for tablet f2ebc809f1074db78720920286d9385b (DEFAULT_TABLE table=default.Table_457b48606bd94a959a7675a3cded52ba [id=478c49ffdf644b35aefc85cae7c744f9]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:48.120415 13455 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2ebc809f1074db78720920286d9385b. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:48.121183 13747 tablet_service.cc:1468] Processing CreateTablet for tablet e7ac2e088ad94f64aa52cd9c5038a0c2 (DEFAULT_TABLE table=default.Table_a41ba45f1ed84fecae2f9b5e1c9c54c2 [id=aa7887df8c0f4850a7b30c56145c4a6e]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:48.121555 13747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7ac2e088ad94f64aa52cd9c5038a0c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:48.125914 13455 tablet_service.cc:1468] Processing CreateTablet for tablet 7d78e67e74f84c3197e944a21de49407 (DEFAULT_TABLE table=default.Table_22efde9aeb06437dbc97066b9c9cbddf [id=39193d8bf3954c8f95d59aa3797d873d]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:48.126259 13455 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d78e67e74f84c3197e944a21de49407. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:48.127411 13748 tablet_service.cc:1468] Processing CreateTablet for tablet 6a5ee0edb69b4a03beaff15ef48cdd50 (DEFAULT_TABLE table=default.Table_25b24b8e1e304d03b728de795c0f63a8 [id=427b984e7e3b4587b597eab3b3d29731]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:48.127769 13748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a5ee0edb69b4a03beaff15ef48cdd50. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:48.131850 13457 tablet_service.cc:1468] Processing CreateTablet for tablet 8975e47083d442f898ea08f2afbfab69 (DEFAULT_TABLE table=default.Table_b19e6f39256d44a697ead8d4386d6899 [id=40674c4976664992b2d5ce55d4db6afe]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:48.132176 13457 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8975e47083d442f898ea08f2afbfab69. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:48.132244 13744 tablet_service.cc:1468] Processing CreateTablet for tablet 4b3362e8f5f74cf69348cebed47082ee (DEFAULT_TABLE table=default.Table_83d0da7d392c4cf7837921ac75c21714 [id=96db6fa119934046839553bd0e353bb8]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:48.132609 13744 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b3362e8f5f74cf69348cebed47082ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:48.135012 13450 tablet_service.cc:1515] Processing DeleteTablet for tablet 1ca83bbf848744f38206ceb4126271be with delete_type TABLET_DATA_DELETED (replaced by tablet 91aded8c81e5440bbed129f3d1638f79) from {username='slave'} at 127.0.0.1:37956
I20250830 07:54:48.135574 13887 tablet_bootstrap.cc:492] T 0ceccc5f18294356894695fe08d73e30 P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:54:48.135699 13887 ts_tablet_manager.cc:1397] T 0ceccc5f18294356894695fe08d73e30 P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.066s user 0.001s sys 0.001s
I20250830 07:54:48.136273 13887 raft_consensus.cc:357] T 0ceccc5f18294356894695fe08d73e30 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:48.136422 13887 raft_consensus.cc:383] T 0ceccc5f18294356894695fe08d73e30 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:48.136472 13887 raft_consensus.cc:738] T 0ceccc5f18294356894695fe08d73e30 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:54:48.136616 13887 consensus_queue.cc:260] T 0ceccc5f18294356894695fe08d73e30 P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:48.137030 13887 ts_tablet_manager.cc:1428] T 0ceccc5f18294356894695fe08d73e30 P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20250830 07:54:48.137260 13887 tablet_bootstrap.cc:492] T ff72a0fd9a0e46a6bd54a15e4ad783b4 P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:54:48.138446 13887 tablet_bootstrap.cc:654] T ff72a0fd9a0e46a6bd54a15e4ad783b4 P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:47.959970 13609 tablet_service.cc:1468] Processing CreateTablet for tablet 2ca20b78cc0445cdb08e4e6f245acf53 (DEFAULT_TABLE table=default.Table_9ce68aedbeda402e84a735a411e55042 [id=dcd33db0bd7c4a2baf4ba4adcfafca6f]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:48.042326 14748 raft_consensus.cc:491] T e255d3fdee09400ead41ca835d6d103f P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:48.141017 13750 tablet_service.cc:1468] Processing CreateTablet for tablet 843370e8d324489caeb51077cbdc6aa1 (DEFAULT_TABLE table=default.Table_c4a636c729fe4982bec27dec6c84bc98 [id=789011413bc6477ab138db094ba7a0c4]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:48.140947 14748 raft_consensus.cc:513] T e255d3fdee09400ead41ca835d6d103f P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:48.141306 13750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 843370e8d324489caeb51077cbdc6aa1. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:48.141502 14748 leader_election.cc:290] T e255d3fdee09400ead41ca835d6d103f P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:48.142577 13479 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "e255d3fdee09400ead41ca835d6d103f" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:54:48.142827 13479 raft_consensus.cc:2466] T e255d3fdee09400ead41ca835d6d103f P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b5e454d98894637b466ea27f1b647f9 in term 0.
I20250830 07:54:48.143263 13746 tablet_service.cc:1468] Processing CreateTablet for tablet d0d8a3d95b4b4529a3c95be4c2d7a409 (DEFAULT_TABLE table=default.Table_be854d521db44926811d0dee9cb0fa54 [id=8a38230b74c8432c86f6c1528abc072b]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:48.143369 13561 leader_election.cc:304] T e255d3fdee09400ead41ca835d6d103f P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 6b5e454d98894637b466ea27f1b647f9; no voters:
I20250830 07:54:48.143659 14748 raft_consensus.cc:2802] T e255d3fdee09400ead41ca835d6d103f P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:54:48.143748 14748 raft_consensus.cc:491] T e255d3fdee09400ead41ca835d6d103f P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:54:48.143817 14748 raft_consensus.cc:3058] T e255d3fdee09400ead41ca835d6d103f P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:48.144282 13736 tablet_service.cc:1468] Processing CreateTablet for tablet 0afcda169b6d406590129c0fd70936b9 (DEFAULT_TABLE table=default.Table_4184c9e2d90c4ecfb3b3199ce5517ba5 [id=f96888dead984c5c8f4dd9b1d8be9d5d]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:48.144397 13746 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0d8a3d95b4b4529a3c95be4c2d7a409. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:48.144541 13736 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0afcda169b6d406590129c0fd70936b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:48.143678 13739 tablet_service.cc:1468] Processing CreateTablet for tablet 2ca20b78cc0445cdb08e4e6f245acf53 (DEFAULT_TABLE table=default.Table_9ce68aedbeda402e84a735a411e55042 [id=dcd33db0bd7c4a2baf4ba4adcfafca6f]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:48.144804 13739 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ca20b78cc0445cdb08e4e6f245acf53. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:48.146772 14748 raft_consensus.cc:513] T e255d3fdee09400ead41ca835d6d103f P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:48.147359 14748 leader_election.cc:290] T e255d3fdee09400ead41ca835d6d103f P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 election: Requested vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:48.147612 13468 tablet_service.cc:1468] Processing CreateTablet for tablet eecfd102b52d4a2192e0adf3a27e90fa (DEFAULT_TABLE table=default.Table_719374aba3bf455e9f60e4ad7d0b558b [id=afb6085b5b6c45cf9e3b834b80d60e63]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:48.147892 13468 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eecfd102b52d4a2192e0adf3a27e90fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:48.149346 13479 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "e255d3fdee09400ead41ca835d6d103f" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba"
I20250830 07:54:48.149489 13479 raft_consensus.cc:3058] T e255d3fdee09400ead41ca835d6d103f P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:48.151183 13735 tablet_service.cc:1468] Processing CreateTablet for tablet 9f8aa6e4a34647629979ea9bb54f1d57 (DEFAULT_TABLE table=default.Table_30a34510203d435ca31d4da546ce305b [id=4862bdf1d65b4376ba6516f78b291d57]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:48.151490 13735 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f8aa6e4a34647629979ea9bb54f1d57. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:48.151957 13479 raft_consensus.cc:2466] T e255d3fdee09400ead41ca835d6d103f P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b5e454d98894637b466ea27f1b647f9 in term 1.
I20250830 07:54:48.152366 13561 leader_election.cc:304] T e255d3fdee09400ead41ca835d6d103f P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 6b5e454d98894637b466ea27f1b647f9; no voters:
I20250830 07:54:48.152386 13755 tablet_service.cc:1468] Processing CreateTablet for tablet 40f5260a18a7454788078458f49a3ffa (DEFAULT_TABLE table=default.Table_34028d46b5fa400a959628ad3dded830 [id=a475e86558cc4290ae4354fb519c43f7]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:48.152756 13755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40f5260a18a7454788078458f49a3ffa. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:48.153563 13450 tablet_service.cc:1468] Processing CreateTablet for tablet 0eddd1d33f9647358e650d4395e30ac8 (DEFAULT_TABLE table=default.Table_dabc7588cbb441859f6adbe7728463ce [id=88ba9b8a2efe47de8ff45c0768cf56e1]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:48.153884 13450 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0eddd1d33f9647358e650d4395e30ac8. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:48.154418 14748 raft_consensus.cc:2802] T e255d3fdee09400ead41ca835d6d103f P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Leader election won for term 1
I20250830 07:54:48.154567 14748 raft_consensus.cc:695] T e255d3fdee09400ead41ca835d6d103f P 6b5e454d98894637b466ea27f1b647f9 [term 1 LEADER]: Becoming Leader. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Running, Role: LEADER
I20250830 07:54:48.154801 14748 consensus_queue.cc:237] T e255d3fdee09400ead41ca835d6d103f P 6b5e454d98894637b466ea27f1b647f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:48.158455 13752 tablet_service.cc:1468] Processing CreateTablet for tablet 7cf69490c7944a0a9c0558d425cea37c (DEFAULT_TABLE table=default.Table_b12f5a566e884916a19242caa716466a [id=0abfd2c6bd8b4b969d280883faccae48]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:48.158893 13752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7cf69490c7944a0a9c0558d425cea37c. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:48.159471 13449 tablet_service.cc:1468] Processing CreateTablet for tablet f8fab6e766a847c29da8573ad0b402d5 (DEFAULT_TABLE table=default.Table_58c5a4814ca14dfc8b2dc02bc9c03c1b [id=e950f4141a48492297f5e6c7f7731d68]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:48.159768 13449 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8fab6e766a847c29da8573ad0b402d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:48.163079 13468 tablet_service.cc:1468] Processing CreateTablet for tablet 9707bdbb96b24518b0d6742f56c79ad5 (DEFAULT_TABLE table=default.Table_51365a3c8c03499fb338a0498ee0ed07 [id=da58245c67bf47d792b6cc3908d899c4]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:48.163719 13468 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9707bdbb96b24518b0d6742f56c79ad5. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:48.159282 13753 tablet_service.cc:1468] Processing CreateTablet for tablet bb8afaec26154052b4ebf758ef286bed (DEFAULT_TABLE table=default.Table_3d2bb182df644a38ac75060c11bb7ac8 [id=9f40b3f7d2584cfcaa0b9b12aa52c7c7]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:48.164922 13736 tablet_service.cc:1515] Processing DeleteTablet for tablet aab8d9a009d34166920905ad06ed153b with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:46 UTC) from {username='slave'} at 127.0.0.1:45460
I20250830 07:54:48.165323 13740 tablet_service.cc:1468] Processing CreateTablet for tablet 8975e47083d442f898ea08f2afbfab69 (DEFAULT_TABLE table=default.Table_b19e6f39256d44a697ead8d4386d6899 [id=40674c4976664992b2d5ce55d4db6afe]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:48.164829 13739 tablet_service.cc:1515] Processing DeleteTablet for tablet 1ca83bbf848744f38206ceb4126271be with delete_type TABLET_DATA_DELETED (replaced by tablet 91aded8c81e5440bbed129f3d1638f79) from {username='slave'} at 127.0.0.1:45460
I20250830 07:54:48.165650 13740 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8975e47083d442f898ea08f2afbfab69. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:48.166513 13753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb8afaec26154052b4ebf758ef286bed. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:48.171340 13463 tablet_service.cc:1468] Processing CreateTablet for tablet 4fa6907089bd4c8ba92c7b54a3eb8dbe (DEFAULT_TABLE table=default.Table_281c6fe95ef0467092591e8fcb80ed46 [id=7cb7fa3530674a5ab87564605d39c1ab]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:48.171629 13463 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4fa6907089bd4c8ba92c7b54a3eb8dbe. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:48.053954 13608 tablet_service.cc:1468] Processing CreateTablet for tablet 27d1e6493bfb43de86e93e106e346753 (DEFAULT_TABLE table=default.Table_dd2ace0925144bbea283b6535233e4a9 [id=7a1e4cc1513a4cc0b00ffb13d1cf24fc]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:48.171921 13740 tablet_service.cc:1468] Processing CreateTablet for tablet f2ebc809f1074db78720920286d9385b (DEFAULT_TABLE table=default.Table_457b48606bd94a959a7675a3cded52ba [id=478c49ffdf644b35aefc85cae7c744f9]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:48.054891 13882 tablet_bootstrap.cc:654] T e6491d149c0646848680cfdadb6fc76c P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:48.172183 13740 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2ebc809f1074db78720920286d9385b. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:48.059463 13590 tablet_service.cc:1468] Processing CreateTablet for tablet 4b3362e8f5f74cf69348cebed47082ee (DEFAULT_TABLE table=default.Table_83d0da7d392c4cf7837921ac75c21714 [id=96db6fa119934046839553bd0e353bb8]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:48.177258 13463 tablet_service.cc:1468] Processing CreateTablet for tablet a06e0b53a11d46e2b1496216bab61356 (DEFAULT_TABLE table=default.Table_a86aa67f6fd64b1c9306f26e900a021c [id=7dafabbe49e94c85a8066e3ceee04649]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:48.177574 13463 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a06e0b53a11d46e2b1496216bab61356. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:48.035565 13606 tablet_service.cc:1468] Processing CreateTablet for tablet 7f452a38bf584637b7708a42b2a5a35f (DEFAULT_TABLE table=default.Table_3abc6459ae534133b6d4f903931c1389 [id=78072ab162e6443b83fa3ac6be6caef6]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:48.179275 13461 tablet_service.cc:1468] Processing CreateTablet for tablet 73692fe73235422dbbb342caabfb0927 (DEFAULT_TABLE table=default.Table_88d35396b3cc42279534b96adf03c731 [id=2ac75c76049046e9aba3b509c465a27a]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:48.179759 13467 tablet_service.cc:1468] Processing CreateTablet for tablet 40ce920462584c25b19befa4146b340f (DEFAULT_TABLE table=default.Table_b40dad149c2d4efe8abbd16dacb9092f [id=7b095f26f6eb46d09f56121b9ced62e7]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:48.180248 13462 tablet_service.cc:1468] Processing CreateTablet for tablet 82111604312e4240a66df81ba20bc046 (DEFAULT_TABLE table=default.Table_d298f39e826645b180dcd8eba4030ebb [id=d3b5e2dbe26e4d62b2f48dcb05b69fb2]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:48.180706 13453 tablet_service.cc:1468] Processing CreateTablet for tablet dbae44ffd7494075abb2c46eb6fe115b (DEFAULT_TABLE table=default.Table_a3d67b6062f44266afff85d510239f6e [id=90642aa04dc44d6f896563f282caa9e7]), partition=RANGE (key) PARTITION UNBOUNDED
W20250830 07:54:48.184451 13230 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 51aecb7681034f7ca67039ca86a0a618 consensus state has no leader
I20250830 07:54:48.184645 13230 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:42126 (request call id 1019) took 1194 ms. Trace:
I20250830 07:54:48.184732 13230 rpcz_store.cc:276] 0830 07:54:46.990295 (+ 0us) service_pool.cc:168] Inserting onto call queue
0830 07:54:47.459406 (+469111us) service_pool.cc:225] Handling call
0830 07:54:47.490833 (+ 31427us) spinlock_profiling.cc:243] Waited 31.2 ms on lock 0x616000040f54. stack: 00007f4985b867d6 00007f4985b86590 00007f4984b793ad 0000000000972d94 0000000000972d5d 00007f499495114d 00007f4994951243 00007f4991610941 00007f499919ba5d 00007f4999327126 00007f4990160126 00007f499015fe55 00007f498c9342ce 00007f498c9331ae 00007f498c9393e5 00007f498c939d0f
0830 07:54:47.491162 (+ 329us) catalog_manager.cc:2368] Looking up, locking, and authorizing table
0830 07:54:47.491377 (+ 215us) catalog_manager.cc:3683] Apply alter schema
0830 07:54:47.491601 (+ 224us) catalog_manager.cc:3715] Acquired catalog manager lock
0830 07:54:47.491679 (+ 78us) catalog_manager.cc:3873] Updating metadata on disk
0830 07:54:48.184188 (+692509us) catalog_manager.cc:3904] Committing alterations to in-memory state
0830 07:54:48.184592 (+ 404us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0830 07:54:48.010747 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0830 07:54:48.010843 (+ 96us) write_op.cc:432] Acquiring schema lock in shared mode
0830 07:54:48.010848 (+ 5us) write_op.cc:435] Acquired schema lock
0830 07:54:48.010851 (+ 3us) tablet.cc:660] Decoding operations
0830 07:54:48.010966 (+ 115us) write_op.cc:620] Acquiring the partition lock for write op
0830 07:54:48.010980 (+ 14us) write_op.cc:641] Partition lock acquired for write op
0830 07:54:48.010985 (+ 5us) tablet.cc:683] Acquiring locks for 1 operations
0830 07:54:48.011043 (+ 58us) tablet.cc:699] Row locks acquired
0830 07:54:48.011046 (+ 3us) write_op.cc:260] PREPARE: finished
0830 07:54:48.011084 (+ 38us) write_op.cc:270] Start()
0830 07:54:48.011127 (+ 43us) write_op.cc:276] Timestamp: P: 1756540488011040 usec, L: 0
0830 07:54:48.011133 (+ 6us) op_driver.cc:348] REPLICATION: starting
0830 07:54:48.011364 (+ 231us) log.cc:844] Serialized 405 byte log entry
0830 07:54:48.182859 (+171495us) op_driver.cc:464] REPLICATION: finished
0830 07:54:48.183631 (+ 772us) write_op.cc:301] APPLY: starting
0830 07:54:48.183654 (+ 23us) tablet.cc:1365] starting BulkCheckPresence
0830 07:54:48.183706 (+ 52us) tablet.cc:1368] finished BulkCheckPresence
0830 07:54:48.183745 (+ 39us) tablet.cc:1370] starting ApplyRowOperation cycle
0830 07:54:48.183808 (+ 63us) tablet.cc:1381] finished ApplyRowOperation cycle
0830 07:54:48.183851 (+ 43us) tablet_metrics.cc:563] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0830 07:54:48.183861 (+ 10us) write_op.cc:312] APPLY: finished
0830 07:54:48.183949 (+ 88us) log.cc:844] Serialized 23 byte log entry
0830 07:54:48.184052 (+ 103us) write_op.cc:489] Releasing partition, row and schema locks
0830 07:54:48.184074 (+ 22us) write_op.cc:454] Released schema lock
0830 07:54:48.184083 (+ 9us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"spinlock_wait_cycles":71695232,"child_traces":[["op",{"apply.queue_time_us":698,"num_ops":1,"prepare.queue_time_us":518646,"prepare.run_cpu_time_us":777,"prepare.run_wall_time_us":33478,"raft.queue_time_us":32112,"raft.run_cpu_time_us":319,"raft.run_wall_time_us":488,"replication_time_us":171688}]]}
I20250830 07:54:48.186843 13454 tablet_service.cc:1468] Processing CreateTablet for tablet a4a4fc69f68643c1acf6471cee80b581 (DEFAULT_TABLE table=default.Table_29b9901c90514282855f50d19ebedb4c [id=a77b832f2f59474ba96546dca07abb4d]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:48.187203 13451 tablet_service.cc:1468] Processing CreateTablet for tablet 0621f6e91e464fd2a556d43e2dc88506 (DEFAULT_TABLE table=default.Table_ba631e9ef6834bae8385a9ecb17e8f1e [id=14e5b80fd799477e95e442a35923bc97]), partition=RANGE (key) PARTITION UNBOUNDED
W20250830 07:54:48.190037 13703 leader_election.cc:343] T a41c1455404f4ed0a782a0c4ddd4140d P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
W20250830 07:54:48.191424 13703 leader_election.cc:343] T 2b4ce50fbd26484faba3faa2ec5115c0 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:48.191838 13464 tablet_service.cc:1515] Processing DeleteTablet for tablet 78a8df3642224d99a86637c1a3a9de5c with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:46 UTC) from {username='slave'} at 127.0.0.1:37956
I20250830 07:54:48.192047 13464 tablet_service.cc:1515] Processing DeleteTablet for tablet 3f70097c1b3a48dfbc1ad129fa7a3730 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:46 UTC) from {username='slave'} at 127.0.0.1:37956
I20250830 07:54:48.192145 13465 tablet_service.cc:1468] Processing CreateTablet for tablet 0afcda169b6d406590129c0fd70936b9 (DEFAULT_TABLE table=default.Table_4184c9e2d90c4ecfb3b3199ce5517ba5 [id=f96888dead984c5c8f4dd9b1d8be9d5d]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:48.192585 13466 tablet_service.cc:1468] Processing CreateTablet for tablet 05b403cedce64513b858b760d15a0e8f (DEFAULT_TABLE table=default.Table_9080042e085842df95abc5ce12a86850 [id=7e0fa284819842e0975766a38c214431]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:48.193017 13741 tablet_service.cc:1468] Processing CreateTablet for tablet 1a1a7ff577334cc58e75d7615b793573 (DEFAULT_TABLE table=default.Table_df0e35c42b3d47589ce170267c3c7b76 [id=eab69737d0014874b68b8c9af5763f09]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:48.193409 13741 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a1a7ff577334cc58e75d7615b793573. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:48.198094 13455 tablet_service.cc:1468] Processing CreateTablet for tablet b414e951ead842a4994679ba9f192098 (DEFAULT_TABLE table=default.Table_d10c794df1544c4caa5eecb2190cbaec [id=eace9d4452034ae3a3e5abf92c00fa4f]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:48.201915 13458 tablet_service.cc:1468] Processing CreateTablet for tablet 27d1e6493bfb43de86e93e106e346753 (DEFAULT_TABLE table=default.Table_dd2ace0925144bbea283b6535233e4a9 [id=7a1e4cc1513a4cc0b00ffb13d1cf24fc]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:48.202230 13230 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_02180913fadd47db99ed7b4524d67263"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:48.202879 13230 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_02180913fadd47db99ed7b4524d67263 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:48.203012 13460 tablet_service.cc:1515] Processing DeleteTablet for tablet aab8d9a009d34166920905ad06ed153b with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:46 UTC) from {username='slave'} at 127.0.0.1:37956
W20250830 07:54:48.203574 13422 leader_election.cc:343] T 74ea2298876a4066b297915c135d4618 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:48.203661 13422 leader_election.cc:304] T 74ea2298876a4066b297915c135d4618 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba; no voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:54:48.203963 15009 raft_consensus.cc:2747] T 74ea2298876a4066b297915c135d4618 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20250830 07:54:48.205543 13703 leader_election.cc:343] T 44313f1a11b74e6d996cafd3c03d1836 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
W20250830 07:54:48.206307 13422 leader_election.cc:343] T d2b8e6df64ef49e2ba36c093efd3c351 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Illegal state: must be running to vote when last-logged opid is not known
W20250830 07:54:48.206732 13422 leader_election.cc:343] T 65f1ee59e6e9498381d686f16a865e23 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Illegal state: must be running to vote when last-logged opid is not known
W20250830 07:54:48.206876 13422 leader_election.cc:343] T aee84a97524e4568acdc4ae1c74fb492 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:48.206872 13767 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "e255d3fdee09400ead41ca835d6d103f" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:48.207033 13767 raft_consensus.cc:2466] T e255d3fdee09400ead41ca835d6d103f P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b5e454d98894637b466ea27f1b647f9 in term 0.
I20250830 07:54:48.207432 13480 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "856e644662334f8194ffef6ca1232248" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba"
I20250830 07:54:48.207582 13480 raft_consensus.cc:3058] T 856e644662334f8194ffef6ca1232248 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:48.209962 13480 raft_consensus.cc:2466] T 856e644662334f8194ffef6ca1232248 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 1.
I20250830 07:54:48.210896 13482 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "e6b7646588fe4134b2db62ff84ca4791" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba"
I20250830 07:54:48.211097 13482 raft_consensus.cc:3058] T e6b7646588fe4134b2db62ff84ca4791 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:48.212993 13739 tablet_service.cc:1468] Processing CreateTablet for tablet b414e951ead842a4994679ba9f192098 (DEFAULT_TABLE table=default.Table_d10c794df1544c4caa5eecb2190cbaec [id=eace9d4452034ae3a3e5abf92c00fa4f]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:48.213407 13739 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b414e951ead842a4994679ba9f192098. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:48.213418 13482 raft_consensus.cc:2466] T e6b7646588fe4134b2db62ff84ca4791 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 1.
I20250830 07:54:48.213706 13481 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "c0147310dad84226808332a4c2c6e09d" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba"
I20250830 07:54:48.213853 13481 raft_consensus.cc:3058] T c0147310dad84226808332a4c2c6e09d P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:48.214263 13744 tablet_service.cc:1468] Processing CreateTablet for tablet 910a9f086e384602a8b8661cd6da7585 (DEFAULT_TABLE table=default.Table_8e66006498aa4e5ebbaf880a1a53c1e7 [id=de0be72abdf345dc849cf30a254c5ef7]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:48.214532 13744 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 910a9f086e384602a8b8661cd6da7585. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:48.216238 13481 raft_consensus.cc:2466] T c0147310dad84226808332a4c2c6e09d P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 1.
I20250830 07:54:48.216547 13745 tablet_service.cc:1468] Processing CreateTablet for tablet 0621f6e91e464fd2a556d43e2dc88506 (DEFAULT_TABLE table=default.Table_ba631e9ef6834bae8385a9ecb17e8f1e [id=14e5b80fd799477e95e442a35923bc97]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:48.216820 13745 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0621f6e91e464fd2a556d43e2dc88506. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:48.217487 13736 tablet_service.cc:1468] Processing CreateTablet for tablet eecfd102b52d4a2192e0adf3a27e90fa (DEFAULT_TABLE table=default.Table_719374aba3bf455e9f60e4ad7d0b558b [id=afb6085b5b6c45cf9e3b834b80d60e63]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:48.217773 13736 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eecfd102b52d4a2192e0adf3a27e90fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:48.218598 13748 tablet_service.cc:1468] Processing CreateTablet for tablet 27d1e6493bfb43de86e93e106e346753 (DEFAULT_TABLE table=default.Table_dd2ace0925144bbea283b6535233e4a9 [id=7a1e4cc1513a4cc0b00ffb13d1cf24fc]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:48.218863 13748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 27d1e6493bfb43de86e93e106e346753. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:48.224130 13754 tablet_service.cc:1468] Processing CreateTablet for tablet 7f452a38bf584637b7708a42b2a5a35f (DEFAULT_TABLE table=default.Table_3abc6459ae534133b6d4f903931c1389 [id=78072ab162e6443b83fa3ac6be6caef6]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:48.224454 13754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f452a38bf584637b7708a42b2a5a35f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:48.224890 13767 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "e255d3fdee09400ead41ca835d6d103f" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f"
I20250830 07:54:48.225064 13767 raft_consensus.cc:3058] T e255d3fdee09400ead41ca835d6d103f P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:48.226760 13738 tablet_service.cc:1468] Processing CreateTablet for tablet 9707bdbb96b24518b0d6742f56c79ad5 (DEFAULT_TABLE table=default.Table_51365a3c8c03499fb338a0498ee0ed07 [id=da58245c67bf47d792b6cc3908d899c4]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:48.227036 13738 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9707bdbb96b24518b0d6742f56c79ad5. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:48.227582 13767 raft_consensus.cc:2466] T e255d3fdee09400ead41ca835d6d103f P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b5e454d98894637b466ea27f1b647f9 in term 1.
I20250830 07:54:48.233906 13738 tablet_service.cc:1468] Processing CreateTablet for tablet 4fa6907089bd4c8ba92c7b54a3eb8dbe (DEFAULT_TABLE table=default.Table_281c6fe95ef0467092591e8fcb80ed46 [id=7cb7fa3530674a5ab87564605d39c1ab]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:48.234234 13738 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4fa6907089bd4c8ba92c7b54a3eb8dbe. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:48.236568 14924 consensus_queue.cc:1035] T 8f215330505848619ad44569d3167591 P 6b5e454d98894637b466ea27f1b647f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:54:48.242894 13461 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73692fe73235422dbbb342caabfb0927. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:48.243343 13614 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "e255d3fdee09400ead41ca835d6d103f" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:48.244102 13615 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "ec4a3975961d4f85ad9da94835417574" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:48.244318 13616 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "8eb010d7955d47a89ff1d01be1b5b01e" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:48.245190 13234 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:42126 (request call id 1021) took 1222 ms. Trace:
I20250830 07:54:48.245281 13234 rpcz_store.cc:276] 0830 07:54:47.022861 (+ 0us) service_pool.cc:168] Inserting onto call queue
0830 07:54:47.809082 (+786221us) service_pool.cc:225] Handling call
0830 07:54:47.834688 (+ 25606us) spinlock_profiling.cc:243] Waited 25.3 ms on lock 0x616000040f54. stack: 00007f4985b867d6 00007f4985b86590 00007f4984b793ad 0000000000972d94 0000000000972d5d 00007f499495114d 00007f4994951243 00007f4991610941 00007f499919ba5d 00007f4999324e93 00007f499015c7a6 00007f499015c4d5 00007f498c9342ce 00007f498c9331ae 00007f498c9393e5 00007f498c939d0f
0830 07:54:47.880378 (+ 45690us) catalog_manager.cc:2076] Acquired catalog manager lock
0830 07:54:47.884281 (+ 3903us) catalog_manager.cc:2122] Created new table and tablet info
0830 07:54:48.244906 (+360625us) catalog_manager.cc:2182] Wrote table and tablets to system table
0830 07:54:48.245042 (+ 136us) catalog_manager.cc:2216] Inserted table and tablets into CatalogManager maps
0830 07:54:48.245125 (+ 83us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0830 07:54:48.091203 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0830 07:54:48.091334 (+ 131us) write_op.cc:432] Acquiring schema lock in shared mode
0830 07:54:48.091343 (+ 9us) write_op.cc:435] Acquired schema lock
0830 07:54:48.091347 (+ 4us) tablet.cc:660] Decoding operations
0830 07:54:48.091463 (+ 116us) write_op.cc:620] Acquiring the partition lock for write op
0830 07:54:48.091478 (+ 15us) write_op.cc:641] Partition lock acquired for write op
0830 07:54:48.091485 (+ 7us) tablet.cc:683] Acquiring locks for 2 operations
0830 07:54:48.091583 (+ 98us) tablet.cc:699] Row locks acquired
0830 07:54:48.091587 (+ 4us) write_op.cc:260] PREPARE: finished
0830 07:54:48.091625 (+ 38us) write_op.cc:270] Start()
0830 07:54:48.091666 (+ 41us) write_op.cc:276] Timestamp: P: 1756540488091575 usec, L: 0
0830 07:54:48.091671 (+ 5us) op_driver.cc:348] REPLICATION: starting
0830 07:54:48.091890 (+ 219us) log.cc:844] Serialized 433 byte log entry
0830 07:54:48.241884 (+149994us) op_driver.cc:464] REPLICATION: finished
0830 07:54:48.243452 (+ 1568us) write_op.cc:301] APPLY: starting
0830 07:54:48.243466 (+ 14us) tablet.cc:1365] starting BulkCheckPresence
0830 07:54:48.243512 (+ 46us) tablet.cc:1368] finished BulkCheckPresence
0830 07:54:48.243543 (+ 31us) tablet.cc:1370] starting ApplyRowOperation cycle
0830 07:54:48.243672 (+ 129us) tablet.cc:1381] finished ApplyRowOperation cycle
0830 07:54:48.243723 (+ 51us) tablet_metrics.cc:563] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0830 07:54:48.243733 (+ 10us) write_op.cc:312] APPLY: finished
0830 07:54:48.243800 (+ 67us) log.cc:844] Serialized 29 byte log entry
0830 07:54:48.244055 (+ 255us) write_op.cc:489] Releasing partition, row and schema locks
0830 07:54:48.244070 (+ 15us) write_op.cc:454] Released schema lock
0830 07:54:48.244075 (+ 5us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"spinlock_wait_cycles":58268416,"child_traces":[["op",{"apply.queue_time_us":1528,"apply.run_cpu_time_us":524,"apply.run_wall_time_us":680,"num_ops":2,"prepare.queue_time_us":206468,"prepare.run_cpu_time_us":807,"prepare.run_wall_time_us":889,"raft.queue_time_us":43,"raft.run_cpu_time_us":5,"raft.run_wall_time_us":5,"replication_time_us":150192,"threads_started":1}]]}
W20250830 07:54:48.246322 13225 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 20a532a8db53426faa7b4231cfb393b8 consensus state has no leader
I20250830 07:54:48.246474 13225 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:42126 (request call id 1020) took 1233 ms. Trace:
I20250830 07:54:48.246547 13225 rpcz_store.cc:276] 0830 07:54:47.013168 (+ 0us) service_pool.cc:168] Inserting onto call queue
0830 07:54:47.462048 (+448880us) service_pool.cc:225] Handling call
0830 07:54:47.492234 (+ 30186us) spinlock_profiling.cc:243] Waited 30 ms on lock 0x616000040f54. stack: 00007f4985b867d6 00007f4985b86590 00007f4984b793ad 0000000000972d94 0000000000972d5d 00007f499495114d 00007f4994951243 00007f4991610941 00007f499919ba5d 00007f4999327126 00007f4990160126 00007f499015fe55 00007f498c9342ce 00007f498c9331ae 00007f498c9393e5 00007f498c939d0f
0830 07:54:47.492444 (+ 210us) catalog_manager.cc:2368] Looking up, locking, and authorizing table
0830 07:54:47.492610 (+ 166us) catalog_manager.cc:3683] Apply alter schema
0830 07:54:47.492741 (+ 131us) catalog_manager.cc:3715] Acquired catalog manager lock
0830 07:54:47.492800 (+ 59us) catalog_manager.cc:3873] Updating metadata on disk
0830 07:54:48.244847 (+752047us) catalog_manager.cc:3904] Committing alterations to in-memory state
0830 07:54:48.246426 (+ 1579us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0830 07:54:48.044288 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0830 07:54:48.044415 (+ 127us) write_op.cc:432] Acquiring schema lock in shared mode
0830 07:54:48.044424 (+ 9us) write_op.cc:435] Acquired schema lock
0830 07:54:48.044428 (+ 4us) tablet.cc:660] Decoding operations
0830 07:54:48.044548 (+ 120us) write_op.cc:620] Acquiring the partition lock for write op
0830 07:54:48.044562 (+ 14us) write_op.cc:641] Partition lock acquired for write op
0830 07:54:48.044569 (+ 7us) tablet.cc:683] Acquiring locks for 1 operations
0830 07:54:48.044653 (+ 84us) tablet.cc:699] Row locks acquired
0830 07:54:48.044656 (+ 3us) write_op.cc:260] PREPARE: finished
0830 07:54:48.044691 (+ 35us) write_op.cc:270] Start()
0830 07:54:48.044727 (+ 36us) write_op.cc:276] Timestamp: P: 1756540488044647 usec, L: 0
0830 07:54:48.044732 (+ 5us) op_driver.cc:348] REPLICATION: starting
0830 07:54:48.044931 (+ 199us) log.cc:844] Serialized 405 byte log entry
0830 07:54:48.241812 (+196881us) op_driver.cc:464] REPLICATION: finished
0830 07:54:48.242490 (+ 678us) write_op.cc:301] APPLY: starting
0830 07:54:48.242510 (+ 20us) tablet.cc:1365] starting BulkCheckPresence
0830 07:54:48.242562 (+ 52us) tablet.cc:1368] finished BulkCheckPresence
0830 07:54:48.242602 (+ 40us) tablet.cc:1370] starting ApplyRowOperation cycle
0830 07:54:48.242664 (+ 62us) tablet.cc:1381] finished ApplyRowOperation cycle
0830 07:54:48.242709 (+ 45us) tablet_metrics.cc:563] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0830 07:54:48.242721 (+ 12us) write_op.cc:312] APPLY: finished
0830 07:54:48.242811 (+ 90us) log.cc:844] Serialized 23 byte log entry
0830 07:54:48.243228 (+ 417us) write_op.cc:489] Releasing partition, row and schema locks
0830 07:54:48.243248 (+ 20us) write_op.cc:454] Released schema lock
0830 07:54:48.243257 (+ 9us) write_op.cc:341] FINISH: Updating metrics
0830 07:54:48.243350 (+ 93us) write_op.cc:489] Releasing partition, row and schema locks
0830 07:54:48.243357 (+ 7us) write_op.cc:454] Released schema lock
Metrics: {"spinlock_wait_cycles":68984064,"child_traces":[["op",{"apply.queue_time_us":588,"apply.run_cpu_time_us":552,"apply.run_wall_time_us":872,"num_ops":1,"prepare.queue_time_us":550919,"prepare.run_cpu_time_us":778,"prepare.run_wall_time_us":46878,"raft.queue_time_us":46075,"raft.run_cpu_time_us":10,"raft.run_wall_time_us":11,"replication_time_us":197044}]]}
I20250830 07:54:48.247198 13225 master_service.cc:948] ReplaceTablet: received request to replace tablet 1db4109dc43b489d89c5de9eeb64a771 from {username='slave'} at 127.0.0.1:42126
I20250830 07:54:48.253422 13739 tablet_service.cc:1468] Processing CreateTablet for tablet 73692fe73235422dbbb342caabfb0927 (DEFAULT_TABLE table=default.Table_88d35396b3cc42279534b96adf03c731 [id=2ac75c76049046e9aba3b509c465a27a]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:48.253712 13739 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73692fe73235422dbbb342caabfb0927. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:48.254271 13462 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82111604312e4240a66df81ba20bc046. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:48.255134 13453 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dbae44ffd7494075abb2c46eb6fe115b. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:48.256309 13737 tablet_service.cc:1468] Processing CreateTablet for tablet 7d78e67e74f84c3197e944a21de49407 (DEFAULT_TABLE table=default.Table_22efde9aeb06437dbc97066b9c9cbddf [id=39193d8bf3954c8f95d59aa3797d873d]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:48.256603 13737 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d78e67e74f84c3197e944a21de49407. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:48.257287 14975 raft_consensus.cc:491] T 29f0695563854e45965a1cc36ac54138 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:48.257386 14975 raft_consensus.cc:513] T 29f0695563854e45965a1cc36ac54138 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:48.257901 14975 leader_election.cc:290] T 29f0695563854e45965a1cc36ac54138 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
I20250830 07:54:48.261510 13590 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b3362e8f5f74cf69348cebed47082ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:48.261902 13735 tablet_service.cc:1468] Processing CreateTablet for tablet 0eddd1d33f9647358e650d4395e30ac8 (DEFAULT_TABLE table=default.Table_dabc7588cbb441859f6adbe7728463ce [id=88ba9b8a2efe47de8ff45c0768cf56e1]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:48.262253 13735 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0eddd1d33f9647358e650d4395e30ac8. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:48.261651 13597 tablet_service.cc:1468] Processing CreateTablet for tablet a4a4fc69f68643c1acf6471cee80b581 (DEFAULT_TABLE table=default.Table_29b9901c90514282855f50d19ebedb4c [id=a77b832f2f59474ba96546dca07abb4d]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:48.262583 13597 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4a4fc69f68643c1acf6471cee80b581. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:48.263079 13467 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40ce920462584c25b19befa4146b340f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:48.266021 14975 raft_consensus.cc:491] T 51cee993ce4249c0830b29cb1808fe80 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:48.266139 14975 raft_consensus.cc:513] T 51cee993ce4249c0830b29cb1808fe80 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:48.266721 14975 leader_election.cc:290] T 51cee993ce4249c0830b29cb1808fe80 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
I20250830 07:54:48.267462 13607 tablet_service.cc:1468] Processing CreateTablet for tablet f8fab6e766a847c29da8573ad0b402d5 (DEFAULT_TABLE table=default.Table_58c5a4814ca14dfc8b2dc02bc9c03c1b [id=e950f4141a48492297f5e6c7f7731d68]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:48.267763 13607 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8fab6e766a847c29da8573ad0b402d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:48.268963 13753 tablet_service.cc:1468] Processing CreateTablet for tablet a06e0b53a11d46e2b1496216bab61356 (DEFAULT_TABLE table=default.Table_a86aa67f6fd64b1c9306f26e900a021c [id=7dafabbe49e94c85a8066e3ceee04649]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:48.270253 13739 tablet_service.cc:1468] Processing CreateTablet for tablet dbae44ffd7494075abb2c46eb6fe115b (DEFAULT_TABLE table=default.Table_a3d67b6062f44266afff85d510239f6e [id=90642aa04dc44d6f896563f282caa9e7]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:48.270479 13736 tablet_service.cc:1515] Processing DeleteTablet for tablet 3f70097c1b3a48dfbc1ad129fa7a3730 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:46 UTC) from {username='slave'} at 127.0.0.1:45460
I20250830 07:54:48.271909 13465 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0afcda169b6d406590129c0fd70936b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:48.272352 13602 tablet_service.cc:1468] Processing CreateTablet for tablet 8975e47083d442f898ea08f2afbfab69 (DEFAULT_TABLE table=default.Table_b19e6f39256d44a697ead8d4386d6899 [id=40674c4976664992b2d5ce55d4db6afe]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:48.272630 13602 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8975e47083d442f898ea08f2afbfab69. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:48.277424 13466 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 05b403cedce64513b858b760d15a0e8f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:48.277714 13599 tablet_service.cc:1515] Processing DeleteTablet for tablet 1ca83bbf848744f38206ceb4126271be with delete_type TABLET_DATA_DELETED (replaced by tablet 91aded8c81e5440bbed129f3d1638f79) from {username='slave'} at 127.0.0.1:45306
I20250830 07:54:48.277899 13599 tablet_service.cc:1515] Processing DeleteTablet for tablet aab8d9a009d34166920905ad06ed153b with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:46 UTC) from {username='slave'} at 127.0.0.1:45306
I20250830 07:54:48.278141 13599 tablet_service.cc:1468] Processing CreateTablet for tablet f2ebc809f1074db78720920286d9385b (DEFAULT_TABLE table=default.Table_457b48606bd94a959a7675a3cded52ba [id=478c49ffdf644b35aefc85cae7c744f9]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:48.278411 13599 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2ebc809f1074db78720920286d9385b. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:48.279099 13451 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0621f6e91e464fd2a556d43e2dc88506. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:48.280069 13746 tablet_service.cc:1468] Processing CreateTablet for tablet f8fab6e766a847c29da8573ad0b402d5 (DEFAULT_TABLE table=default.Table_58c5a4814ca14dfc8b2dc02bc9c03c1b [id=e950f4141a48492297f5e6c7f7731d68]), partition=RANGE (key) PARTITION UNBOUNDED
W20250830 07:54:48.280447 13219 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.12.209.60:43889: connect: Connection refused (error 111) [suppressed 40 similar messages]
W20250830 07:54:48.282698 13220 catalog_manager.cc:4908] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet 1ca83bbf848744f38206ceb4126271be because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1ca83bbf848744f38206ceb4126271be already in progress: creating tablet
I20250830 07:54:48.282809 13454 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4a4fc69f68643c1acf6471cee80b581. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:48.282816 13753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a06e0b53a11d46e2b1496216bab61356. 1 dirs total, 0 dirs full, 0 dirs failed
W20250830 07:54:48.283010 13220 catalog_manager.cc:4908] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet aab8d9a009d34166920905ad06ed153b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet aab8d9a009d34166920905ad06ed153b already in progress: creating tablet
I20250830 07:54:48.285315 13740 tablet_service.cc:1468] Processing CreateTablet for tablet 05b403cedce64513b858b760d15a0e8f (DEFAULT_TABLE table=default.Table_9080042e085842df95abc5ce12a86850 [id=7e0fa284819842e0975766a38c214431]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:48.285305 13592 tablet_service.cc:1468] Processing CreateTablet for tablet 7d78e67e74f84c3197e944a21de49407 (DEFAULT_TABLE table=default.Table_22efde9aeb06437dbc97066b9c9cbddf [id=39193d8bf3954c8f95d59aa3797d873d]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:48.285586 13592 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d78e67e74f84c3197e944a21de49407. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:48.285877 13746 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8fab6e766a847c29da8573ad0b402d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:48.288009 13600 tablet_service.cc:1468] Processing CreateTablet for tablet 05b403cedce64513b858b760d15a0e8f (DEFAULT_TABLE table=default.Table_9080042e085842df95abc5ce12a86850 [id=7e0fa284819842e0975766a38c214431]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:48.288357 13600 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 05b403cedce64513b858b760d15a0e8f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:48.288872 13749 tablet_service.cc:1468] Processing CreateTablet for tablet 40ce920462584c25b19befa4146b340f (DEFAULT_TABLE table=default.Table_b40dad149c2d4efe8abbd16dacb9092f [id=7b095f26f6eb46d09f56121b9ced62e7]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:48.289160 13749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40ce920462584c25b19befa4146b340f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:48.291064 13455 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b414e951ead842a4994679ba9f192098. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:48.291476 13458 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 27d1e6493bfb43de86e93e106e346753. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:48.298714 13233 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:42126 (request call id 1023) took 1228 ms. Trace:
I20250830 07:54:48.298851 13233 rpcz_store.cc:276] 0830 07:54:47.069932 (+ 0us) service_pool.cc:168] Inserting onto call queue
0830 07:54:47.887252 (+817320us) service_pool.cc:225] Handling call
0830 07:54:47.897020 (+ 9768us) spinlock_profiling.cc:243] Waited 9.51 ms on lock 0x616000040f54. stack: 00007f4985b867d6 00007f4985b86590 00007f4984b793ad 0000000000972d94 0000000000972d5d 00007f499495114d 00007f4994951243 00007f4991610941 00007f499919ba5d 00007f4999324e93 00007f499015c7a6 00007f499015c4d5 00007f498c9342ce 00007f498c9331ae 00007f498c9393e5 00007f498c939d0f
0830 07:54:47.897803 (+ 783us) catalog_manager.cc:2076] Acquired catalog manager lock
0830 07:54:47.898232 (+ 429us) catalog_manager.cc:2122] Created new table and tablet info
0830 07:54:48.298450 (+400218us) catalog_manager.cc:2182] Wrote table and tablets to system table
0830 07:54:48.298571 (+ 121us) catalog_manager.cc:2216] Inserted table and tablets into CatalogManager maps
0830 07:54:48.298672 (+ 101us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0830 07:54:48.092131 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0830 07:54:48.092264 (+ 133us) write_op.cc:432] Acquiring schema lock in shared mode
0830 07:54:48.092271 (+ 7us) write_op.cc:435] Acquired schema lock
0830 07:54:48.092274 (+ 3us) tablet.cc:660] Decoding operations
0830 07:54:48.092367 (+ 93us) write_op.cc:620] Acquiring the partition lock for write op
0830 07:54:48.092378 (+ 11us) write_op.cc:641] Partition lock acquired for write op
0830 07:54:48.092384 (+ 6us) tablet.cc:683] Acquiring locks for 2 operations
0830 07:54:48.092462 (+ 78us) tablet.cc:699] Row locks acquired
0830 07:54:48.092466 (+ 4us) write_op.cc:260] PREPARE: finished
0830 07:54:48.092498 (+ 32us) write_op.cc:270] Start()
0830 07:54:48.092529 (+ 31us) write_op.cc:276] Timestamp: P: 1756540488092448 usec, L: 0
0830 07:54:48.092534 (+ 5us) op_driver.cc:348] REPLICATION: starting
0830 07:54:48.092685 (+ 151us) log.cc:844] Serialized 433 byte log entry
0830 07:54:48.297485 (+204800us) op_driver.cc:464] REPLICATION: finished
0830 07:54:48.297649 (+ 164us) write_op.cc:301] APPLY: starting
0830 07:54:48.297666 (+ 17us) tablet.cc:1365] starting BulkCheckPresence
0830 07:54:48.297720 (+ 54us) tablet.cc:1368] finished BulkCheckPresence
0830 07:54:48.297755 (+ 35us) tablet.cc:1370] starting ApplyRowOperation cycle
0830 07:54:48.297916 (+ 161us) tablet.cc:1381] finished ApplyRowOperation cycle
0830 07:54:48.297961 (+ 45us) tablet_metrics.cc:563] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0830 07:54:48.297971 (+ 10us) write_op.cc:312] APPLY: finished
0830 07:54:48.298072 (+ 101us) log.cc:844] Serialized 29 byte log entry
0830 07:54:48.298327 (+ 255us) write_op.cc:489] Releasing partition, row and schema locks
0830 07:54:48.298349 (+ 22us) write_op.cc:454] Released schema lock
0830 07:54:48.298358 (+ 9us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"spinlock_wait_cycles":21862144,"child_traces":[["op",{"apply.queue_time_us":108,"num_ops":2,"prepare.queue_time_us":193446,"prepare.run_cpu_time_us":636,"prepare.run_wall_time_us":694,"raft.queue_time_us":39,"raft.run_cpu_time_us":4,"raft.run_wall_time_us":5,"replication_time_us":204915}]]}
I20250830 07:54:48.299573 13598 tablet_service.cc:1468] Processing CreateTablet for tablet 0eddd1d33f9647358e650d4395e30ac8 (DEFAULT_TABLE table=default.Table_dabc7588cbb441859f6adbe7728463ce [id=88ba9b8a2efe47de8ff45c0768cf56e1]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:48.299868 13598 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0eddd1d33f9647358e650d4395e30ac8. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:48.301048 13603 tablet_service.cc:1468] Processing CreateTablet for tablet b414e951ead842a4994679ba9f192098 (DEFAULT_TABLE table=default.Table_d10c794df1544c4caa5eecb2190cbaec [id=eace9d4452034ae3a3e5abf92c00fa4f]), partition=RANGE (key) PARTITION UNBOUNDED
W20250830 07:54:48.301609 13229 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet b85843ab0e3a40e1b453cfdd71bbae5e consensus state has no leader
I20250830 07:54:48.301755 13229 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:42126 (request call id 1024) took 1149 ms. Trace:
I20250830 07:54:48.302145 13231 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:42126 (request call id 1026) took 1018 ms. Trace:
I20250830 07:54:48.301846 13229 rpcz_store.cc:276] 0830 07:54:47.152568 (+ 0us) service_pool.cc:168] Inserting onto call queue
0830 07:54:47.899096 (+746528us) service_pool.cc:225] Handling call
0830 07:54:47.899727 (+ 631us) catalog_manager.cc:2368] Looking up, locking, and authorizing table
0830 07:54:47.899962 (+ 235us) catalog_manager.cc:3683] Apply alter schema
0830 07:54:47.900133 (+ 171us) catalog_manager.cc:3715] Acquired catalog manager lock
0830 07:54:47.900193 (+ 60us) catalog_manager.cc:3873] Updating metadata on disk
0830 07:54:48.301370 (+401177us) catalog_manager.cc:3904] Committing alterations to in-memory state
0830 07:54:48.301721 (+ 351us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0830 07:54:48.092849 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0830 07:54:48.092948 (+ 99us) write_op.cc:432] Acquiring schema lock in shared mode
0830 07:54:48.092954 (+ 6us) write_op.cc:435] Acquired schema lock
0830 07:54:48.092958 (+ 4us) tablet.cc:660] Decoding operations
0830 07:54:48.093143 (+ 185us) write_op.cc:620] Acquiring the partition lock for write op
0830 07:54:48.093152 (+ 9us) write_op.cc:641] Partition lock acquired for write op
0830 07:54:48.093159 (+ 7us) tablet.cc:683] Acquiring locks for 1 operations
0830 07:54:48.093205 (+ 46us) tablet.cc:699] Row locks acquired
0830 07:54:48.093207 (+ 2us) write_op.cc:260] PREPARE: finished
0830 07:54:48.093231 (+ 24us) write_op.cc:270] Start()
0830 07:54:48.093251 (+ 20us) write_op.cc:276] Timestamp: P: 1756540488093185 usec, L: 0
0830 07:54:48.093254 (+ 3us) op_driver.cc:348] REPLICATION: starting
0830 07:54:48.093361 (+ 107us) log.cc:844] Serialized 405 byte log entry
0830 07:54:48.297573 (+204212us) op_driver.cc:464] REPLICATION: finished
0830 07:54:48.300777 (+ 3204us) write_op.cc:301] APPLY: starting
0830 07:54:48.300789 (+ 12us) tablet.cc:1365] starting BulkCheckPresence
0830 07:54:48.300819 (+ 30us) tablet.cc:1368] finished BulkCheckPresence
0830 07:54:48.300846 (+ 27us) tablet.cc:1370] starting ApplyRowOperation cycle
0830 07:54:48.300896 (+ 50us) tablet.cc:1381] finished ApplyRowOperation cycle
0830 07:54:48.300924 (+ 28us) tablet_metrics.cc:563] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0830 07:54:48.300931 (+ 7us) write_op.cc:312] APPLY: finished
0830 07:54:48.301006 (+ 75us) log.cc:844] Serialized 23 byte log entry
0830 07:54:48.301269 (+ 263us) write_op.cc:489] Releasing partition, row and schema locks
0830 07:54:48.301283 (+ 14us) write_op.cc:454] Released schema lock
0830 07:54:48.301294 (+ 11us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":3167,"apply.run_cpu_time_us":369,"apply.run_wall_time_us":575,"num_ops":1,"prepare.queue_time_us":192272,"prepare.run_cpu_time_us":532,"prepare.run_wall_time_us":651,"raft.queue_time_us":40,"raft.run_cpu_time_us":4,"raft.run_wall_time_us":5,"replication_time_us":204300}]]}
I20250830 07:54:48.302241 13231 rpcz_store.cc:276] 0830 07:54:47.283694 (+ 0us) service_pool.cc:168] Inserting onto call queue
0830 07:54:47.960349 (+676655us) service_pool.cc:225] Handling call
0830 07:54:48.007448 (+ 47099us) spinlock_profiling.cc:243] Waited 46.8 ms on lock 0x616000040f54. stack: 00007f4985b867d6 00007f4985b86590 00007f4984b793ad 0000000000972d94 0000000000972d5d 00007f499495114d 00007f4994951243 00007f4991610941 00007f499919ba5d 00007f4999324e93 00007f499015c7a6 00007f499015c4d5 00007f498c9342ce 00007f498c9331ae 00007f498c9393e5 00007f498c939d0f
0830 07:54:48.008351 (+ 903us) catalog_manager.cc:2076] Acquired catalog manager lock
0830 07:54:48.008836 (+ 485us) catalog_manager.cc:2122] Created new table and tablet info
0830 07:54:48.301956 (+293120us) catalog_manager.cc:2182] Wrote table and tablets to system table
0830 07:54:48.302039 (+ 83us) catalog_manager.cc:2216] Inserted table and tablets into CatalogManager maps
0830 07:54:48.302103 (+ 64us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0830 07:54:48.093534 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0830 07:54:48.093640 (+ 106us) write_op.cc:432] Acquiring schema lock in shared mode
0830 07:54:48.093646 (+ 6us) write_op.cc:435] Acquired schema lock
0830 07:54:48.093649 (+ 3us) tablet.cc:660] Decoding operations
0830 07:54:48.093752 (+ 103us) write_op.cc:620] Acquiring the partition lock for write op
0830 07:54:48.093762 (+ 10us) write_op.cc:641] Partition lock acquired for write op
0830 07:54:48.093769 (+ 7us) tablet.cc:683] Acquiring locks for 2 operations
0830 07:54:48.093855 (+ 86us) tablet.cc:699] Row locks acquired
0830 07:54:48.093860 (+ 5us) write_op.cc:260] PREPARE: finished
0830 07:54:48.093887 (+ 27us) write_op.cc:270] Start()
0830 07:54:48.093915 (+ 28us) write_op.cc:276] Timestamp: P: 1756540488093840 usec, L: 0
0830 07:54:48.093920 (+ 5us) op_driver.cc:348] REPLICATION: starting
0830 07:54:48.094095 (+ 175us) log.cc:844] Serialized 433 byte log entry
0830 07:54:48.301430 (+207335us) op_driver.cc:464] REPLICATION: finished
0830 07:54:48.301493 (+ 63us) write_op.cc:301] APPLY: starting
0830 07:54:48.301501 (+ 8us) tablet.cc:1365] starting BulkCheckPresence
0830 07:54:48.301536 (+ 35us) tablet.cc:1368] finished BulkCheckPresence
0830 07:54:48.301557 (+ 21us) tablet.cc:1370] starting ApplyRowOperation cycle
0830 07:54:48.301648 (+ 91us) tablet.cc:1381] finished ApplyRowOperation cycle
0830 07:54:48.301669 (+ 21us) tablet_metrics.cc:563] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0830 07:54:48.301675 (+ 6us) write_op.cc:312] APPLY: finished
0830 07:54:48.301716 (+ 41us) log.cc:844] Serialized 29 byte log entry
0830 07:54:48.301888 (+ 172us) write_op.cc:489] Releasing partition, row and schema locks
0830 07:54:48.301899 (+ 11us) write_op.cc:454] Released schema lock
0830 07:54:48.301904 (+ 5us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"spinlock_wait_cycles":107669376,"child_traces":[["op",{"apply.queue_time_us":30,"num_ops":2,"prepare.queue_time_us":83864,"prepare.run_cpu_time_us":643,"prepare.run_wall_time_us":706,"raft.queue_time_us":40,"raft.run_cpu_time_us":4,"raft.run_wall_time_us":4,"replication_time_us":207493}]]}
I20250830 07:54:48.302980 13603 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b414e951ead842a4994679ba9f192098. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:48.304255 13228 catalog_manager.cc:6127] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: default.Table_a2e96e9e547e4a07a6ccd9839e3d909c [id=6fc5c53b47c24f8283191be07f6f3cb1] alter complete (version 1)
I20250830 07:54:48.306967 13484 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "6a82ea7078e344a497c34f932e139bcd" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba"
W20250830 07:54:48.306981 13232 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.12.209.1:41421 (request call id 103) took 819 ms (client timeout 1000 ms). Trace:
W20250830 07:54:48.307088 13232 rpcz_store.cc:269] 0830 07:54:47.487565 (+ 0us) service_pool.cc:168] Inserting onto call queue
0830 07:54:47.508376 (+ 20811us) service_pool.cc:225] Handling call
0830 07:54:47.627596 (+119220us) spinlock_profiling.cc:243] Waited 118 ms on lock 0x616000040f54. stack: 00007f4985b867d6 00007f4985b86590 00007f4984b793ad 0000000000972d94 0000000000972d5d 00007f499495114d 00007f4994951243 00007f4991610941 00007f499919ba5d 00007f499931f6d8 00007f4990159c86 00007f49901599b5 00007f498c9342ce 00007f498c9331ae 00007f498c9393e5 00007f498c939d0f
0830 07:54:48.306933 (+679337us) inbound_call.cc:173] Queueing success response
Metrics: {"reported_tablets":27,"spinlock_wait_cycles":270412672}
I20250830 07:54:48.307183 13484 raft_consensus.cc:3058] T 6a82ea7078e344a497c34f932e139bcd P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:48.308166 13232 master_service.cc:948] ReplaceTablet: received request to replace tablet 0d16bc64dd6e43f7ba313b77c2bbb728 from {username='slave'} at 127.0.0.1:42126
I20250830 07:54:48.308239 13234 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_d6f7850567b6452a80b03a8d4c7236a6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:48.308750 13234 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d6f7850567b6452a80b03a8d4c7236a6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:48.309715 13484 raft_consensus.cc:2466] T 6a82ea7078e344a497c34f932e139bcd P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 1.
I20250830 07:54:48.307853 13229 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_b40b20ca6c404878b58a4eb8c849aa67"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:48.310309 13229 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b40b20ca6c404878b58a4eb8c849aa67 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:48.310262 13233 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_439642f4ff764ffb9bec5b62836ea3c9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:48.310817 13233 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_439642f4ff764ffb9bec5b62836ea3c9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:48.312096 13231 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_d356c6eecb574cf6aa06b4405e9cdf0c" } new_table_name: "default.Table_32b08636825a4a92b041dc105c12c98c" modify_external_catalogs: true
I20250830 07:54:48.313314 13486 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "e255d3fdee09400ead41ca835d6d103f" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:54:48.313555 13486 raft_consensus.cc:2391] T e255d3fdee09400ead41ca835d6d103f P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b057ade5dce45af9f8bf0bedf8b917f in current term 1: Already voted for candidate 6b5e454d98894637b466ea27f1b647f9 in this term.
I20250830 07:54:48.314867 13486 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "ec4a3975961d4f85ad9da94835417574" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:54:48.315047 13486 raft_consensus.cc:2466] T ec4a3975961d4f85ad9da94835417574 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 0.
I20250830 07:54:48.316447 13604 tablet_service.cc:1468] Processing CreateTablet for tablet eecfd102b52d4a2192e0adf3a27e90fa (DEFAULT_TABLE table=default.Table_719374aba3bf455e9f60e4ad7d0b558b [id=afb6085b5b6c45cf9e3b834b80d60e63]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:48.316577 13486 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "29f0695563854e45965a1cc36ac54138" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:54:48.316699 13486 raft_consensus.cc:2466] T 29f0695563854e45965a1cc36ac54138 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 0.
I20250830 07:54:48.316742 13604 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eecfd102b52d4a2192e0adf3a27e90fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:48.317085 13486 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "51cee993ce4249c0830b29cb1808fe80" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:54:48.317219 13486 raft_consensus.cc:2466] T 51cee993ce4249c0830b29cb1808fe80 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 0.
I20250830 07:54:48.317270 13479 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "2b4ce50fbd26484faba3faa2ec5115c0" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba"
I20250830 07:54:48.317397 13479 raft_consensus.cc:3058] T 2b4ce50fbd26484faba3faa2ec5115c0 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:48.317677 13484 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "a41c1455404f4ed0a782a0c4ddd4140d" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:54:48.317847 13484 raft_consensus.cc:2466] T a41c1455404f4ed0a782a0c4ddd4140d P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 0.
I20250830 07:54:48.320973 13479 raft_consensus.cc:2466] T 2b4ce50fbd26484faba3faa2ec5115c0 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 1.
I20250830 07:54:48.325475 13596 tablet_service.cc:1468] Processing CreateTablet for tablet 9707bdbb96b24518b0d6742f56c79ad5 (DEFAULT_TABLE table=default.Table_51365a3c8c03499fb338a0498ee0ed07 [id=da58245c67bf47d792b6cc3908d899c4]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:48.325801 13596 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9707bdbb96b24518b0d6742f56c79ad5. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:48.327540 14943 raft_consensus.cc:491] T 4c4a8eea119044b49e2b29f10a703097 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:48.327688 14943 raft_consensus.cc:513] T 4c4a8eea119044b49e2b29f10a703097 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:48.328253 14943 leader_election.cc:290] T 4c4a8eea119044b49e2b29f10a703097 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
I20250830 07:54:48.332316 13606 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f452a38bf584637b7708a42b2a5a35f. 1 dirs total, 0 dirs full, 0 dirs failed
W20250830 07:54:48.340512 13218 catalog_manager.cc:4908] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): delete failed for tablet 1ca83bbf848744f38206ceb4126271be because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1ca83bbf848744f38206ceb4126271be already in progress: creating tablet
W20250830 07:54:48.341519 13218 catalog_manager.cc:4908] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): delete failed for tablet 78a8df3642224d99a86637c1a3a9de5c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 78a8df3642224d99a86637c1a3a9de5c already in progress: creating tablet
W20250830 07:54:48.341703 13218 catalog_manager.cc:4908] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): delete failed for tablet 3f70097c1b3a48dfbc1ad129fa7a3730 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3f70097c1b3a48dfbc1ad129fa7a3730 already in progress: creating tablet
W20250830 07:54:48.341914 13218 catalog_manager.cc:4908] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): delete failed for tablet aab8d9a009d34166920905ad06ed153b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet aab8d9a009d34166920905ad06ed153b already in progress: creating tablet
I20250830 07:54:48.345527 13600 tablet_service.cc:1468] Processing CreateTablet for tablet 4fa6907089bd4c8ba92c7b54a3eb8dbe (DEFAULT_TABLE table=default.Table_281c6fe95ef0467092591e8fcb80ed46 [id=7cb7fa3530674a5ab87564605d39c1ab]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:48.345899 13600 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4fa6907089bd4c8ba92c7b54a3eb8dbe. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:48.332028 13482 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "44313f1a11b74e6d996cafd3c03d1836" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba"
I20250830 07:54:48.338090 13486 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "4c4a8eea119044b49e2b29f10a703097" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:54:48.346601 13482 raft_consensus.cc:3058] T 44313f1a11b74e6d996cafd3c03d1836 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:48.346632 13486 raft_consensus.cc:2466] T 4c4a8eea119044b49e2b29f10a703097 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 0.
I20250830 07:54:48.347728 13597 tablet_service.cc:1468] Processing CreateTablet for tablet a06e0b53a11d46e2b1496216bab61356 (DEFAULT_TABLE table=default.Table_a86aa67f6fd64b1c9306f26e900a021c [id=7dafabbe49e94c85a8066e3ceee04649]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:48.348049 13597 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a06e0b53a11d46e2b1496216bab61356. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:48.351644 13607 tablet_service.cc:1468] Processing CreateTablet for tablet 73692fe73235422dbbb342caabfb0927 (DEFAULT_TABLE table=default.Table_88d35396b3cc42279534b96adf03c731 [id=2ac75c76049046e9aba3b509c465a27a]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:48.351969 13607 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73692fe73235422dbbb342caabfb0927. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:48.353133 14943 raft_consensus.cc:491] T 4828280e6fec4338b35422917966ac8c P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:48.353246 14943 raft_consensus.cc:513] T 4828280e6fec4338b35422917966ac8c P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:48.353721 14943 leader_election.cc:290] T 4828280e6fec4338b35422917966ac8c P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
I20250830 07:54:48.355619 13482 raft_consensus.cc:2466] T 44313f1a11b74e6d996cafd3c03d1836 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 1.
I20250830 07:54:48.357537 13593 tablet_service.cc:1468] Processing CreateTablet for tablet 40ce920462584c25b19befa4146b340f (DEFAULT_TABLE table=default.Table_b40dad149c2d4efe8abbd16dacb9092f [id=7b095f26f6eb46d09f56121b9ced62e7]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:48.357882 13593 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40ce920462584c25b19befa4146b340f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:48.359359 13605 tablet_service.cc:1468] Processing CreateTablet for tablet 82111604312e4240a66df81ba20bc046 (DEFAULT_TABLE table=default.Table_d298f39e826645b180dcd8eba4030ebb [id=d3b5e2dbe26e4d62b2f48dcb05b69fb2]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:48.360330 13591 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 843370e8d324489caeb51077cbdc6aa1. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:48.363919 13609 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ca20b78cc0445cdb08e4e6f245acf53. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:48.365582 13701 leader_election.cc:304] T 856e644662334f8194ffef6ca1232248 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:54:48.366034 13701 leader_election.cc:304] T e6b7646588fe4134b2db62ff84ca4791 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:54:48.366259 14818 raft_consensus.cc:2802] T 856e644662334f8194ffef6ca1232248 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election won for term 1
I20250830 07:54:48.366385 14818 raft_consensus.cc:695] T 856e644662334f8194ffef6ca1232248 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 LEADER]: Becoming Leader. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Running, Role: LEADER
I20250830 07:54:48.366626 14975 raft_consensus.cc:2802] T e6b7646588fe4134b2db62ff84ca4791 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election won for term 1
I20250830 07:54:48.366586 14818 consensus_queue.cc:237] T 856e644662334f8194ffef6ca1232248 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:48.367215 13608 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 27d1e6493bfb43de86e93e106e346753. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:48.367465 13755 tablet_service.cc:1468] Processing CreateTablet for tablet a4a4fc69f68643c1acf6471cee80b581 (DEFAULT_TABLE table=default.Table_29b9901c90514282855f50d19ebedb4c [id=a77b832f2f59474ba96546dca07abb4d]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:48.368395 13605 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82111604312e4240a66df81ba20bc046. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:48.374042 13739 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dbae44ffd7494075abb2c46eb6fe115b. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:48.374506 13740 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 05b403cedce64513b858b760d15a0e8f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:48.378350 13745 tablet_service.cc:1468] Processing CreateTablet for tablet 82111604312e4240a66df81ba20bc046 (DEFAULT_TABLE table=default.Table_d298f39e826645b180dcd8eba4030ebb [id=d3b5e2dbe26e4d62b2f48dcb05b69fb2]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:48.378772 13745 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82111604312e4240a66df81ba20bc046. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:48.382053 13602 tablet_service.cc:1468] Processing CreateTablet for tablet dbae44ffd7494075abb2c46eb6fe115b (DEFAULT_TABLE table=default.Table_a3d67b6062f44266afff85d510239f6e [id=90642aa04dc44d6f896563f282caa9e7]), partition=RANGE (key) PARTITION UNBOUNDED
I20250830 07:54:48.383320 13742 tablet_service.cc:1515] Processing DeleteTablet for tablet 78a8df3642224d99a86637c1a3a9de5c with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:46 UTC) from {username='slave'} at 127.0.0.1:45460
I20250830 07:54:48.384384 13595 tablet_service.cc:1515] Processing DeleteTablet for tablet 78a8df3642224d99a86637c1a3a9de5c with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:46 UTC) from {username='slave'} at 127.0.0.1:45306
I20250830 07:54:48.384615 13595 tablet_service.cc:1515] Processing DeleteTablet for tablet 3f70097c1b3a48dfbc1ad129fa7a3730 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:46 UTC) from {username='slave'} at 127.0.0.1:45306
W20250830 07:54:48.385215 13220 catalog_manager.cc:4908] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet 78a8df3642224d99a86637c1a3a9de5c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 78a8df3642224d99a86637c1a3a9de5c already in progress: creating tablet
W20250830 07:54:48.385577 13220 catalog_manager.cc:4908] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet 3f70097c1b3a48dfbc1ad129fa7a3730 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3f70097c1b3a48dfbc1ad129fa7a3730 already in progress: creating tablet
I20250830 07:54:48.396070 13755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4a4fc69f68643c1acf6471cee80b581. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:48.396410 13882 tablet_bootstrap.cc:492] T e6491d149c0646848680cfdadb6fc76c P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:54:48.396540 13882 ts_tablet_manager.cc:1397] T e6491d149c0646848680cfdadb6fc76c P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.837s user 0.005s sys 0.001s
I20250830 07:54:48.397240 13882 raft_consensus.cc:357] T e6491d149c0646848680cfdadb6fc76c P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:54:48.397418 13882 raft_consensus.cc:383] T e6491d149c0646848680cfdadb6fc76c P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:48.397469 13882 raft_consensus.cc:738] T e6491d149c0646848680cfdadb6fc76c P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:54:48.398924 13602 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dbae44ffd7494075abb2c46eb6fe115b. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:48.405936 14943 raft_consensus.cc:491] T d6afa1ad4791429ba96ee81583dcee64 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:48.406071 14943 raft_consensus.cc:513] T d6afa1ad4791429ba96ee81583dcee64 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:48.406329 13882 consensus_queue.cc:260] T e6491d149c0646848680cfdadb6fc76c P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:54:48.406701 14975 raft_consensus.cc:695] T e6b7646588fe4134b2db62ff84ca4791 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 LEADER]: Becoming Leader. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Running, Role: LEADER
I20250830 07:54:48.407388 14943 leader_election.cc:290] T d6afa1ad4791429ba96ee81583dcee64 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
I20250830 07:54:48.408923 13882 ts_tablet_manager.cc:1428] T e6491d149c0646848680cfdadb6fc76c P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.012s user 0.001s sys 0.001s
I20250830 07:54:48.409782 13882 tablet_bootstrap.cc:492] T 6a82ea7078e344a497c34f932e139bcd P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:54:48.411458 13882 tablet_bootstrap.cc:654] T 6a82ea7078e344a497c34f932e139bcd P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
W20250830 07:54:48.421113 13701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.209.1:45325, user_credentials={real_user=slave}} blocked reactor thread for 54415.9us
I20250830 07:54:48.421276 13701 leader_election.cc:304] T 6a82ea7078e344a497c34f932e139bcd P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
W20250830 07:54:48.424962 13562 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.209.3:38743, user_credentials={real_user=slave}} blocked reactor thread for 188431us
I20250830 07:54:48.427167 13613 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "d2b8e6df64ef49e2ba36c093efd3c351" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:48.428364 13613 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "65f1ee59e6e9498381d686f16a865e23" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:48.429320 13613 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "aee84a97524e4568acdc4ae1c74fb492" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:48.429970 14974 raft_consensus.cc:2802] T 6a82ea7078e344a497c34f932e139bcd P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election won for term 1
I20250830 07:54:48.430121 14974 raft_consensus.cc:695] T 6a82ea7078e344a497c34f932e139bcd P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 LEADER]: Becoming Leader. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Running, Role: LEADER
I20250830 07:54:48.430351 14974 consensus_queue.cc:237] T 6a82ea7078e344a497c34f932e139bcd P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:48.432924 13701 leader_election.cc:304] T ec4a3975961d4f85ad9da94835417574 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters:
I20250830 07:54:48.433162 14818 raft_consensus.cc:2802] T ec4a3975961d4f85ad9da94835417574 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:54:48.433220 14818 raft_consensus.cc:491] T ec4a3975961d4f85ad9da94835417574 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:54:48.433279 14818 raft_consensus.cc:3058] T ec4a3975961d4f85ad9da94835417574 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:48.435194 13601 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0621f6e91e464fd2a556d43e2dc88506. 1 dirs total, 0 dirs full, 0 dirs failed
I20250830 07:54:48.438416 14818 raft_consensus.cc:513] T ec4a3975961d4f85ad9da94835417574 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:48.439337 14818 leader_election.cc:290] T ec4a3975961d4f85ad9da94835417574 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Requested vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
W20250830 07:54:48.439818 13701 leader_election.cc:343] T 8eb010d7955d47a89ff1d01be1b5b01e P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): Not found: Tablet not found: 8eb010d7955d47a89ff1d01be1b5b01e
I20250830 07:54:48.441021 15074 consensus_queue.cc:1035] T f0144701d459480d96c1ece519951442 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:54:48.441848 13701 leader_election.cc:304] T 29f0695563854e45965a1cc36ac54138 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters:
I20250830 07:54:48.442483 15074 raft_consensus.cc:2802] T 29f0695563854e45965a1cc36ac54138 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:54:48.442592 15074 raft_consensus.cc:491] T 29f0695563854e45965a1cc36ac54138 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:54:48.442706 15074 raft_consensus.cc:3058] T 29f0695563854e45965a1cc36ac54138 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:48.443325 14907 raft_consensus.cc:491] T e6491d149c0646848680cfdadb6fc76c P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:48.443430 14907 raft_consensus.cc:513] T e6491d149c0646848680cfdadb6fc76c P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:54:48.443914 14907 leader_election.cc:290] T e6491d149c0646848680cfdadb6fc76c P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
I20250830 07:54:48.444530 13481 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "e6491d149c0646848680cfdadb6fc76c" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:54:48.445621 15074 raft_consensus.cc:513] T 29f0695563854e45965a1cc36ac54138 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:48.445963 13701 leader_election.cc:304] T 51cee993ce4249c0830b29cb1808fe80 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters:
I20250830 07:54:48.447081 14818 raft_consensus.cc:2802] T 51cee993ce4249c0830b29cb1808fe80 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:54:48.447217 14818 raft_consensus.cc:491] T 51cee993ce4249c0830b29cb1808fe80 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:54:48.447350 14818 raft_consensus.cc:3058] T 51cee993ce4249c0830b29cb1808fe80 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:48.448719 13458 tablet_service.cc:1515] Processing DeleteTablet for tablet e6b7646588fe4134b2db62ff84ca4791 with delete_type TABLET_DATA_DELETED (replaced by tablet 6bb062f9c4e342489422c8faabfb1b9b) from {username='slave'} at 127.0.0.1:37956
I20250830 07:54:48.448941 15034 tablet_replica.cc:331] T e6b7646588fe4134b2db62ff84ca4791 P 2065c332f15a4739899af79f3669c3ba: stopping tablet replica
I20250830 07:54:48.449105 15034 raft_consensus.cc:2241] T e6b7646588fe4134b2db62ff84ca4791 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Raft consensus shutting down.
I20250830 07:54:48.449259 15034 raft_consensus.cc:2270] T e6b7646588fe4134b2db62ff84ca4791 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20250830 07:54:48.449713 15034 ts_tablet_manager.cc:1905] T e6b7646588fe4134b2db62ff84ca4791 P 2065c332f15a4739899af79f3669c3ba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250830 07:54:48.449996 15074 leader_election.cc:290] T 29f0695563854e45965a1cc36ac54138 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Requested vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
I20250830 07:54:48.450405 13701 leader_election.cc:304] T a41c1455404f4ed0a782a0c4ddd4140d P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:54:48.451509 13887 tablet_bootstrap.cc:492] T ff72a0fd9a0e46a6bd54a15e4ad783b4 P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:54:48.451642 13887 ts_tablet_manager.cc:1397] T ff72a0fd9a0e46a6bd54a15e4ad783b4 P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.314s user 0.035s sys 0.051s
I20250830 07:54:48.451805 15071 raft_consensus.cc:2802] T a41c1455404f4ed0a782a0c4ddd4140d P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:54:48.452248 15071 raft_consensus.cc:491] T a41c1455404f4ed0a782a0c4ddd4140d P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:54:48.452366 15071 raft_consensus.cc:3058] T a41c1455404f4ed0a782a0c4ddd4140d P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:48.452587 13887 raft_consensus.cc:357] T ff72a0fd9a0e46a6bd54a15e4ad783b4 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:48.452750 13887 raft_consensus.cc:383] T ff72a0fd9a0e46a6bd54a15e4ad783b4 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:48.452805 13887 raft_consensus.cc:738] T ff72a0fd9a0e46a6bd54a15e4ad783b4 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:54:48.452972 13887 consensus_queue.cc:260] T ff72a0fd9a0e46a6bd54a15e4ad783b4 P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:48.453485 13887 ts_tablet_manager.cc:1428] T ff72a0fd9a0e46a6bd54a15e4ad783b4 P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20250830 07:54:48.453717 13887 tablet_bootstrap.cc:492] T 7c5e50cb605c4a40b47984f328eedd93 P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:54:48.454778 15071 raft_consensus.cc:513] T a41c1455404f4ed0a782a0c4ddd4140d P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:48.455549 15071 leader_election.cc:290] T a41c1455404f4ed0a782a0c4ddd4140d P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Requested vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
I20250830 07:54:48.456364 13775 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "d206f6b6e7524a27a9f95787bcd5de77" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:48.457114 14818 raft_consensus.cc:513] T 51cee993ce4249c0830b29cb1808fe80 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:48.458631 13764 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "4b403cadfb7b42f8896b2ee16b50ecb1" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:48.459667 13458 tablet_service.cc:1515] Processing DeleteTablet for tablet f52dd8eeb64a4b8a92babf34387b6c5b with delete_type TABLET_DATA_DELETED (replaced by tablet 40ce920462584c25b19befa4146b340f) from {username='slave'} at 127.0.0.1:37956
I20250830 07:54:48.455554 15034 ts_tablet_manager.cc:1918] T e6b7646588fe4134b2db62ff84ca4791 P 2065c332f15a4739899af79f3669c3ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250830 07:54:48.459872 13465 tablet_service.cc:1515] Processing DeleteTablet for tablet 65f1ee59e6e9498381d686f16a865e23 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:42 UTC) from {username='slave'} at 127.0.0.1:37956
I20250830 07:54:48.454900 13887 tablet_bootstrap.cc:654] T 7c5e50cb605c4a40b47984f328eedd93 P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:48.460244 13465 tablet_service.cc:1515] Processing DeleteTablet for tablet 74ea2298876a4066b297915c135d4618 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:42 UTC) from {username='slave'} at 127.0.0.1:37956
I20250830 07:54:48.459924 15034 log.cc:1199] T e6b7646588fe4134b2db62ff84ca4791 P 2065c332f15a4739899af79f3669c3ba: Deleting WAL directory at /tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/ts-0/wal/wals/e6b7646588fe4134b2db62ff84ca4791
I20250830 07:54:48.460853 15034 ts_tablet_manager.cc:1939] T e6b7646588fe4134b2db62ff84ca4791 P 2065c332f15a4739899af79f3669c3ba: Deleting consensus metadata
I20250830 07:54:48.461621 15034 tablet_replica.cc:331] T f52dd8eeb64a4b8a92babf34387b6c5b P 2065c332f15a4739899af79f3669c3ba: stopping tablet replica
I20250830 07:54:48.461803 15034 raft_consensus.cc:2241] T f52dd8eeb64a4b8a92babf34387b6c5b P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Raft consensus shutting down.
I20250830 07:54:48.461930 15034 raft_consensus.cc:2270] T f52dd8eeb64a4b8a92babf34387b6c5b P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Raft consensus is shut down!
I20250830 07:54:48.462354 15034 ts_tablet_manager.cc:1905] T f52dd8eeb64a4b8a92babf34387b6c5b P 2065c332f15a4739899af79f3669c3ba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250830 07:54:48.462991 13465 tablet_service.cc:1515] Processing DeleteTablet for tablet d206f6b6e7524a27a9f95787bcd5de77 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:43 UTC) from {username='slave'} at 127.0.0.1:37956
I20250830 07:54:48.463287 13465 tablet_service.cc:1515] Processing DeleteTablet for tablet e4ca3110247640fbae4241448e8d5ef7 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:42 UTC) from {username='slave'} at 127.0.0.1:37956
I20250830 07:54:48.465194 13486 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "d6afa1ad4791429ba96ee81583dcee64" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:54:48.465356 13486 raft_consensus.cc:2466] T d6afa1ad4791429ba96ee81583dcee64 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 0.
I20250830 07:54:48.467717 13479 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "4828280e6fec4338b35422917966ac8c" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:54:48.467866 13479 raft_consensus.cc:2466] T 4828280e6fec4338b35422917966ac8c P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 0.
I20250830 07:54:48.468138 13218 catalog_manager.cc:4928] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): tablet e6b7646588fe4134b2db62ff84ca4791 (table default.Table_337ffcdb618e443ab9f21511ef2f615c [id=e38a27157b504bac9c3ba85277b6b1ae]) successfully deleted
I20250830 07:54:48.470723 15034 ts_tablet_manager.cc:1918] T f52dd8eeb64a4b8a92babf34387b6c5b P 2065c332f15a4739899af79f3669c3ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250830 07:54:48.470809 15034 log.cc:1199] T f52dd8eeb64a4b8a92babf34387b6c5b P 2065c332f15a4739899af79f3669c3ba: Deleting WAL directory at /tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/ts-0/wal/wals/f52dd8eeb64a4b8a92babf34387b6c5b
I20250830 07:54:48.475880 14818 leader_election.cc:290] T 51cee993ce4249c0830b29cb1808fe80 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Requested vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
W20250830 07:54:48.479583 13219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.209.60:43889, user_credentials={real_user=slave}} blocked reactor thread for 199104us
I20250830 07:54:48.480334 13886 tablet_bootstrap.cc:492] T 09586fdda94c4aff9d3fa25d71fe6ac0 P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:54:48.480456 13886 ts_tablet_manager.cc:1397] T 09586fdda94c4aff9d3fa25d71fe6ac0 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.417s user 0.042s sys 0.088s
I20250830 07:54:48.481175 13886 raft_consensus.cc:357] T 09586fdda94c4aff9d3fa25d71fe6ac0 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:48.481344 13886 raft_consensus.cc:383] T 09586fdda94c4aff9d3fa25d71fe6ac0 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:48.481398 13886 raft_consensus.cc:738] T 09586fdda94c4aff9d3fa25d71fe6ac0 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:54:48.481588 13886 consensus_queue.cc:260] T 09586fdda94c4aff9d3fa25d71fe6ac0 P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:48.479091 13701 leader_election.cc:304] T 4c4a8eea119044b49e2b29f10a703097 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters:
I20250830 07:54:48.482091 13886 ts_tablet_manager.cc:1428] T 09586fdda94c4aff9d3fa25d71fe6ac0 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20250830 07:54:48.482236 14818 raft_consensus.cc:2802] T 4c4a8eea119044b49e2b29f10a703097 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:54:48.482339 14818 raft_consensus.cc:491] T 4c4a8eea119044b49e2b29f10a703097 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:54:48.482421 13886 tablet_bootstrap.cc:492] T f52dd8eeb64a4b8a92babf34387b6c5b P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:54:48.482438 14818 raft_consensus.cc:3058] T 4c4a8eea119044b49e2b29f10a703097 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:48.483778 13886 tablet_bootstrap.cc:654] T f52dd8eeb64a4b8a92babf34387b6c5b P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:48.484102 13701 leader_election.cc:304] T 44313f1a11b74e6d996cafd3c03d1836 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:54:48.485378 15074 raft_consensus.cc:2802] T 44313f1a11b74e6d996cafd3c03d1836 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election won for term 1
I20250830 07:54:48.485514 13701 leader_election.cc:304] T 2b4ce50fbd26484faba3faa2ec5115c0 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:54:48.485525 15074 raft_consensus.cc:695] T 44313f1a11b74e6d996cafd3c03d1836 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 LEADER]: Becoming Leader. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Running, Role: LEADER
I20250830 07:54:48.485764 15071 raft_consensus.cc:2802] T 2b4ce50fbd26484faba3faa2ec5115c0 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election won for term 1
W20250830 07:54:48.485860 13422 leader_election.cc:343] T d206f6b6e7524a27a9f95787bcd5de77 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:48.486095 15071 raft_consensus.cc:695] T 2b4ce50fbd26484faba3faa2ec5115c0 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 LEADER]: Becoming Leader. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Running, Role: LEADER
W20250830 07:54:48.486070 13422 consensus_peers.cc:489] T ef16b9e2d444489699f4db1ac26d5f6c P 2065c332f15a4739899af79f3669c3ba -> Peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Couldn't send request to peer 9b057ade5dce45af9f8bf0bedf8b917f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ef16b9e2d444489699f4db1ac26d5f6c. This is attempt 6: this message will repeat every 5th retry.
I20250830 07:54:48.486408 15071 consensus_queue.cc:237] T 2b4ce50fbd26484faba3faa2ec5115c0 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:48.487228 13228 catalog_manager.cc:6127] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: default.Table_6fe6d8fe98fb48218cef68475a6faeb9 [id=b6be55a64bca43c0bbab359694f0bcf6] alter complete (version 1)
I20250830 07:54:48.487476 15074 consensus_queue.cc:237] T 44313f1a11b74e6d996cafd3c03d1836 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
W20250830 07:54:48.487553 13422 leader_election.cc:343] T 4b403cadfb7b42f8896b2ee16b50ecb1 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:48.487648 13227 rpcz_store.cc:275] Call kudu.master.MasterService.ReplaceTablet from 127.0.0.1:42126 (request call id 1025) took 1235 ms. Trace:
I20250830 07:54:48.487723 13227 rpcz_store.cc:276] 0830 07:54:47.252640 (+ 0us) service_pool.cc:168] Inserting onto call queue
0830 07:54:47.939916 (+687276us) service_pool.cc:225] Handling call
0830 07:54:47.947913 (+ 7997us) spinlock_profiling.cc:243] Waited 7.71 ms on lock 0x616000040f54. stack: 00007f4985b867d6 00007f4985b86590 00007f4984b793ad 0000000000972d94 0000000000972d5d 00007f499495114d 00007f4994951243 00007f4991610941 00007f499919ba5d 00007f4999331bdb 00007f49901690e7 00007f4990168e15 00007f498c9342ce 00007f498c9331ae 00007f498c9393e5 00007f498c939d0f
0830 07:54:48.487594 (+539681us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":17729280}
I20250830 07:54:48.488456 13701 leader_election.cc:304] T d6afa1ad4791429ba96ee81583dcee64 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters:
I20250830 07:54:48.488575 13486 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "29f0695563854e45965a1cc36ac54138" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba"
I20250830 07:54:48.488677 13484 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "a41c1455404f4ed0a782a0c4ddd4140d" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba"
I20250830 07:54:48.488816 13484 raft_consensus.cc:3058] T a41c1455404f4ed0a782a0c4ddd4140d P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:48.489199 14943 raft_consensus.cc:2802] T d6afa1ad4791429ba96ee81583dcee64 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:54:48.489286 14943 raft_consensus.cc:491] T d6afa1ad4791429ba96ee81583dcee64 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:54:48.489356 14943 raft_consensus.cc:3058] T d6afa1ad4791429ba96ee81583dcee64 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:48.489733 14818 raft_consensus.cc:513] T 4c4a8eea119044b49e2b29f10a703097 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:48.490152 14818 leader_election.cc:290] T 4c4a8eea119044b49e2b29f10a703097 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Requested vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
I20250830 07:54:48.488710 13486 raft_consensus.cc:3058] T 29f0695563854e45965a1cc36ac54138 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:48.491952 14943 raft_consensus.cc:513] T d6afa1ad4791429ba96ee81583dcee64 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:48.492512 14943 leader_election.cc:290] T d6afa1ad4791429ba96ee81583dcee64 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Requested vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
I20250830 07:54:48.493022 13230 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:42126 (request call id 1027) took 1199 ms. Trace:
I20250830 07:54:48.493271 13486 raft_consensus.cc:2466] T 29f0695563854e45965a1cc36ac54138 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 1.
I20250830 07:54:48.493124 13230 rpcz_store.cc:276] 0830 07:54:47.293229 (+ 0us) service_pool.cc:168] Inserting onto call queue
0830 07:54:48.185597 (+892368us) service_pool.cc:225] Handling call
0830 07:54:48.202133 (+ 16536us) spinlock_profiling.cc:243] Waited 16.2 ms on lock 0x616000040f54. stack: 00007f4985b867d6 00007f4985b86590 00007f4984b793ad 0000000000972d94 0000000000972d5d 00007f499495114d 00007f4994951243 00007f4991610941 00007f499919ba5d 00007f4999324e93 00007f499015c7a6 00007f499015c4d5 00007f498c9342ce 00007f498c9331ae 00007f498c9393e5 00007f498c939d0f
0830 07:54:48.203010 (+ 877us) catalog_manager.cc:2076] Acquired catalog manager lock
0830 07:54:48.203531 (+ 521us) catalog_manager.cc:2122] Created new table and tablet info
0830 07:54:48.492695 (+289164us) catalog_manager.cc:2182] Wrote table and tablets to system table
0830 07:54:48.492821 (+ 126us) catalog_manager.cc:2216] Inserted table and tablets into CatalogManager maps
0830 07:54:48.492924 (+ 103us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0830 07:54:48.313509 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0830 07:54:48.313625 (+ 116us) write_op.cc:432] Acquiring schema lock in shared mode
0830 07:54:48.313632 (+ 7us) write_op.cc:435] Acquired schema lock
0830 07:54:48.313636 (+ 4us) tablet.cc:660] Decoding operations
0830 07:54:48.313829 (+ 193us) write_op.cc:620] Acquiring the partition lock for write op
0830 07:54:48.313842 (+ 13us) write_op.cc:641] Partition lock acquired for write op
0830 07:54:48.313849 (+ 7us) tablet.cc:683] Acquiring locks for 2 operations
0830 07:54:48.313941 (+ 92us) tablet.cc:699] Row locks acquired
0830 07:54:48.313945 (+ 4us) write_op.cc:260] PREPARE: finished
0830 07:54:48.313981 (+ 36us) write_op.cc:270] Start()
0830 07:54:48.314033 (+ 52us) write_op.cc:276] Timestamp: P: 1756540488313956 usec, L: 0
0830 07:54:48.314039 (+ 6us) op_driver.cc:348] REPLICATION: starting
0830 07:54:48.314221 (+ 182us) log.cc:844] Serialized 433 byte log entry
0830 07:54:48.480466 (+166245us) op_driver.cc:464] REPLICATION: finished
0830 07:54:48.482890 (+ 2424us) write_op.cc:301] APPLY: starting
0830 07:54:48.482900 (+ 10us) tablet.cc:1365] starting BulkCheckPresence
0830 07:54:48.490450 (+ 7550us) tablet.cc:1368] finished BulkCheckPresence
0830 07:54:48.490471 (+ 21us) tablet.cc:1370] starting ApplyRowOperation cycle
0830 07:54:48.490554 (+ 83us) tablet.cc:1381] finished ApplyRowOperation cycle
0830 07:54:48.490582 (+ 28us) tablet_metrics.cc:563] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0830 07:54:48.490589 (+ 7us) write_op.cc:312] APPLY: finished
0830 07:54:48.490643 (+ 54us) log.cc:844] Serialized 29 byte log entry
0830 07:54:48.490693 (+ 50us) write_op.cc:489] Releasing partition, row and schema locks
0830 07:54:48.490706 (+ 13us) write_op.cc:454] Released schema lock
0830 07:54:48.490728 (+ 22us) write_op.cc:341] FINISH: Updating metrics
0830 07:54:48.490785 (+ 57us) write_op.cc:489] Releasing partition, row and schema locks
0830 07:54:48.490789 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"spinlock_wait_cycles":37346048,"child_traces":[["op",{"apply.queue_time_us":2386,"apply.run_cpu_time_us":401,"apply.run_wall_time_us":7891,"num_ops":2,"prepare.queue_time_us":109509,"prepare.run_cpu_time_us":709,"prepare.run_wall_time_us":1129,"replication_time_us":166409}]]}
I20250830 07:54:48.493731 13484 raft_consensus.cc:2466] T a41c1455404f4ed0a782a0c4ddd4140d P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 1.
I20250830 07:54:48.495620 13887 tablet_bootstrap.cc:492] T 7c5e50cb605c4a40b47984f328eedd93 P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:54:48.495740 13887 ts_tablet_manager.cc:1397] T 7c5e50cb605c4a40b47984f328eedd93 P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.042s user 0.002s sys 0.000s
I20250830 07:54:48.502013 13887 raft_consensus.cc:357] T 7c5e50cb605c4a40b47984f328eedd93 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:48.503289 13887 raft_consensus.cc:383] T 7c5e50cb605c4a40b47984f328eedd93 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:48.503618 13887 raft_consensus.cc:738] T 7c5e50cb605c4a40b47984f328eedd93 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:54:48.505507 13887 consensus_queue.cc:260] T 7c5e50cb605c4a40b47984f328eedd93 P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:48.506657 13481 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "ec4a3975961d4f85ad9da94835417574" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba"
I20250830 07:54:48.507596 13481 raft_consensus.cc:3058] T ec4a3975961d4f85ad9da94835417574 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:48.510835 13887 ts_tablet_manager.cc:1428] T 7c5e50cb605c4a40b47984f328eedd93 P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.015s user 0.003s sys 0.000s
I20250830 07:54:48.511482 13613 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "d206f6b6e7524a27a9f95787bcd5de77" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:48.513275 13613 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "4b403cadfb7b42f8896b2ee16b50ecb1" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:48.513298 13887 tablet_bootstrap.cc:492] T ca959e42c8764eeba0faee96caf8b39f P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:54:48.521225 13703 leader_election.cc:304] T e255d3fdee09400ead41ca835d6d103f P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 2065c332f15a4739899af79f3669c3ba, 6b5e454d98894637b466ea27f1b647f9
W20250830 07:54:48.521518 13423 leader_election.cc:343] T d2b8e6df64ef49e2ba36c093efd3c351 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:48.521610 13423 leader_election.cc:304] T d2b8e6df64ef49e2ba36c093efd3c351 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba; no voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:54:48.521773 14852 raft_consensus.cc:2747] T d2b8e6df64ef49e2ba36c093efd3c351 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:54:48.521917 15073 consensus_queue.cc:1035] T f0144701d459480d96c1ece519951442 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20250830 07:54:48.522204 13423 leader_election.cc:343] T 65f1ee59e6e9498381d686f16a865e23 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:48.522287 13423 leader_election.cc:304] T 65f1ee59e6e9498381d686f16a865e23 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba; no voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:54:48.522442 14852 raft_consensus.cc:2747] T 65f1ee59e6e9498381d686f16a865e23 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:54:48.522475 15073 consensus_queue.cc:1035] T 0507245aa8c74aeb9f3eafba0682590d P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:54:48.522763 15073 raft_consensus.cc:2747] T e255d3fdee09400ead41ca835d6d103f P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20250830 07:54:48.522848 13423 leader_election.cc:343] T aee84a97524e4568acdc4ae1c74fb492 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:48.522984 13423 leader_election.cc:304] T aee84a97524e4568acdc4ae1c74fb492 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba; no voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:54:48.523243 14852 raft_consensus.cc:2747] T aee84a97524e4568acdc4ae1c74fb492 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20250830 07:54:48.523851 13423 leader_election.cc:343] T d206f6b6e7524a27a9f95787bcd5de77 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:48.523963 13423 leader_election.cc:304] T d206f6b6e7524a27a9f95787bcd5de77 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba; no voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:54:48.524173 14852 raft_consensus.cc:2747] T d206f6b6e7524a27a9f95787bcd5de77 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20250830 07:54:48.525803 13423 leader_election.cc:343] T 4b403cadfb7b42f8896b2ee16b50ecb1 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:48.525884 13423 leader_election.cc:304] T 4b403cadfb7b42f8896b2ee16b50ecb1 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba; no voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:54:48.526044 14852 raft_consensus.cc:2747] T 4b403cadfb7b42f8896b2ee16b50ecb1 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:54:48.526518 13887 tablet_bootstrap.cc:654] T ca959e42c8764eeba0faee96caf8b39f P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:48.529623 15034 ts_tablet_manager.cc:1939] T f52dd8eeb64a4b8a92babf34387b6c5b P 2065c332f15a4739899af79f3669c3ba: Deleting consensus metadata
I20250830 07:54:48.530603 15034 tablet_replica.cc:331] T 65f1ee59e6e9498381d686f16a865e23 P 2065c332f15a4739899af79f3669c3ba: stopping tablet replica
I20250830 07:54:48.530836 15034 raft_consensus.cc:2241] T 65f1ee59e6e9498381d686f16a865e23 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Raft consensus shutting down.
I20250830 07:54:48.531023 15034 raft_consensus.cc:2270] T 65f1ee59e6e9498381d686f16a865e23 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Raft consensus is shut down!
I20250830 07:54:48.531543 15034 ts_tablet_manager.cc:1905] T 65f1ee59e6e9498381d686f16a865e23 P 2065c332f15a4739899af79f3669c3ba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250830 07:54:48.535359 13482 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "51cee993ce4249c0830b29cb1808fe80" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba"
I20250830 07:54:48.535624 13482 raft_consensus.cc:3058] T 51cee993ce4249c0830b29cb1808fe80 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:48.536787 13218 catalog_manager.cc:4928] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): tablet f52dd8eeb64a4b8a92babf34387b6c5b (table default.Table_b40dad149c2d4efe8abbd16dacb9092f [id=7b095f26f6eb46d09f56121b9ced62e7]) successfully deleted
W20250830 07:54:48.537735 13701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.209.1:45325, user_credentials={real_user=slave}} blocked reactor thread for 49083.1us
I20250830 07:54:48.538514 13701 leader_election.cc:304] T 4828280e6fec4338b35422917966ac8c P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters:
I20250830 07:54:48.538831 14818 raft_consensus.cc:2802] T 4828280e6fec4338b35422917966ac8c P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:54:48.538899 14818 raft_consensus.cc:491] T 4828280e6fec4338b35422917966ac8c P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:54:48.538981 14818 raft_consensus.cc:3058] T 4828280e6fec4338b35422917966ac8c P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:48.541923 14818 raft_consensus.cc:513] T 4828280e6fec4338b35422917966ac8c P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:48.542415 13886 tablet_bootstrap.cc:492] T f52dd8eeb64a4b8a92babf34387b6c5b P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:54:48.542462 14818 leader_election.cc:290] T 4828280e6fec4338b35422917966ac8c P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Requested vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
I20250830 07:54:48.542543 13886 ts_tablet_manager.cc:1397] T f52dd8eeb64a4b8a92babf34387b6c5b P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.060s user 0.003s sys 0.000s
I20250830 07:54:48.543318 13886 raft_consensus.cc:357] T f52dd8eeb64a4b8a92babf34387b6c5b P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:48.543357 13701 leader_election.cc:304] T 29f0695563854e45965a1cc36ac54138 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters:
I20250830 07:54:48.543478 13886 raft_consensus.cc:383] T f52dd8eeb64a4b8a92babf34387b6c5b P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:48.543529 13886 raft_consensus.cc:738] T f52dd8eeb64a4b8a92babf34387b6c5b P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:54:48.543623 14818 raft_consensus.cc:2802] T 29f0695563854e45965a1cc36ac54138 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election won for term 1
I20250830 07:54:48.543735 14818 raft_consensus.cc:695] T 29f0695563854e45965a1cc36ac54138 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 LEADER]: Becoming Leader. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Running, Role: LEADER
I20250830 07:54:48.543689 13886 consensus_queue.cc:260] T f52dd8eeb64a4b8a92babf34387b6c5b P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:48.544241 13886 ts_tablet_manager.cc:1428] T f52dd8eeb64a4b8a92babf34387b6c5b P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20250830 07:54:48.544500 13886 tablet_bootstrap.cc:492] T d2b8e6df64ef49e2ba36c093efd3c351 P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:54:48.543958 14818 consensus_queue.cc:237] T 29f0695563854e45965a1cc36ac54138 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:48.545852 13886 tablet_bootstrap.cc:654] T d2b8e6df64ef49e2ba36c093efd3c351 P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:48.510041 13481 raft_consensus.cc:2466] T ec4a3975961d4f85ad9da94835417574 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 1.
I20250830 07:54:48.548378 13882 tablet_bootstrap.cc:492] T 6a82ea7078e344a497c34f932e139bcd P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:54:48.548493 13882 ts_tablet_manager.cc:1397] T 6a82ea7078e344a497c34f932e139bcd P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.139s user 0.004s sys 0.000s
W20250830 07:54:48.548589 13703 leader_election.cc:343] T ec4a3975961d4f85ad9da94835417574 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
W20250830 07:54:48.549077 13703 leader_election.cc:343] T 8eb010d7955d47a89ff1d01be1b5b01e P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:48.549144 13882 raft_consensus.cc:357] T 6a82ea7078e344a497c34f932e139bcd P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:48.549240 13703 leader_election.cc:304] T 8eb010d7955d47a89ff1d01be1b5b01e P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 2065c332f15a4739899af79f3669c3ba, 6b5e454d98894637b466ea27f1b647f9
I20250830 07:54:48.549363 13882 raft_consensus.cc:383] T 6a82ea7078e344a497c34f932e139bcd P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:48.549461 13882 raft_consensus.cc:738] T 6a82ea7078e344a497c34f932e139bcd P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:54:48.549757 15086 raft_consensus.cc:2747] T 8eb010d7955d47a89ff1d01be1b5b01e P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:54:48.549954 15034 ts_tablet_manager.cc:1918] T 65f1ee59e6e9498381d686f16a865e23 P 2065c332f15a4739899af79f3669c3ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250830 07:54:48.549893 13882 consensus_queue.cc:260] T 6a82ea7078e344a497c34f932e139bcd P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
W20250830 07:54:48.550104 13703 consensus_peers.cc:489] T ff0f9cccc8ed43b1a8cd38de0e9d4097 P 9b057ade5dce45af9f8bf0bedf8b917f -> Peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Couldn't send request to peer 6b5e454d98894637b466ea27f1b647f9. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ff0f9cccc8ed43b1a8cd38de0e9d4097. This is attempt 6: this message will repeat every 5th retry.
I20250830 07:54:48.550551 13882 ts_tablet_manager.cc:1428] T 6a82ea7078e344a497c34f932e139bcd P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20250830 07:54:48.550446 13701 leader_election.cc:304] T a41c1455404f4ed0a782a0c4ddd4140d P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters:
I20250830 07:54:48.550894 13882 tablet_bootstrap.cc:492] T 29f0695563854e45965a1cc36ac54138 P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:54:48.551309 15086 raft_consensus.cc:2802] T a41c1455404f4ed0a782a0c4ddd4140d P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election won for term 1
I20250830 07:54:48.551421 15086 raft_consensus.cc:695] T a41c1455404f4ed0a782a0c4ddd4140d P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 LEADER]: Becoming Leader. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Running, Role: LEADER
I20250830 07:54:48.551621 15086 consensus_queue.cc:237] T a41c1455404f4ed0a782a0c4ddd4140d P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:48.552430 13882 tablet_bootstrap.cc:654] T 29f0695563854e45965a1cc36ac54138 P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:48.561138 13226 catalog_manager.cc:6127] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: default.Table_d4c23a361ea94d88b0fa71c2f7ac15d1 [id=dfa51a12131743428fa066bbe3b6982e] alter complete (version 1)
W20250830 07:54:48.561949 13228 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.12.209.2:34503 (request call id 98) took 1005 ms (client timeout 1000 ms). Trace:
I20250830 07:54:48.562582 13234 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:42126 (request call id 1028) took 1264 ms. Trace:
W20250830 07:54:48.562067 13228 rpcz_store.cc:269] 0830 07:54:47.556112 (+ 0us) service_pool.cc:168] Inserting onto call queue
0830 07:54:47.682752 (+126640us) service_pool.cc:225] Handling call
0830 07:54:48.561880 (+879128us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0830 07:54:48.094265 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0830 07:54:48.094370 (+ 105us) write_op.cc:432] Acquiring schema lock in shared mode
0830 07:54:48.094376 (+ 6us) write_op.cc:435] Acquired schema lock
0830 07:54:48.094380 (+ 4us) tablet.cc:660] Decoding operations
0830 07:54:48.094465 (+ 85us) write_op.cc:620] Acquiring the partition lock for write op
0830 07:54:48.094475 (+ 10us) write_op.cc:641] Partition lock acquired for write op
0830 07:54:48.094482 (+ 7us) tablet.cc:683] Acquiring locks for 1 operations
0830 07:54:48.094535 (+ 53us) tablet.cc:699] Row locks acquired
0830 07:54:48.094539 (+ 4us) write_op.cc:260] PREPARE: finished
0830 07:54:48.094566 (+ 27us) write_op.cc:270] Start()
0830 07:54:48.094592 (+ 26us) write_op.cc:276] Timestamp: P: 1756540488094518 usec, L: 0
0830 07:54:48.094597 (+ 5us) op_driver.cc:348] REPLICATION: starting
0830 07:54:48.094741 (+ 144us) log.cc:844] Serialized 356 byte log entry
0830 07:54:48.303616 (+208875us) op_driver.cc:464] REPLICATION: finished
0830 07:54:48.303715 (+ 99us) write_op.cc:301] APPLY: starting
0830 07:54:48.303724 (+ 9us) tablet.cc:1365] starting BulkCheckPresence
0830 07:54:48.303747 (+ 23us) tablet.cc:1368] finished BulkCheckPresence
0830 07:54:48.303771 (+ 24us) tablet.cc:1370] starting ApplyRowOperation cycle
0830 07:54:48.303801 (+ 30us) tablet.cc:1381] finished ApplyRowOperation cycle
0830 07:54:48.303821 (+ 20us) tablet_metrics.cc:563] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0830 07:54:48.303827 (+ 6us) write_op.cc:312] APPLY: finished
0830 07:54:48.303877 (+ 50us) log.cc:844] Serialized 23 byte log entry
0830 07:54:48.304091 (+ 214us) write_op.cc:489] Releasing partition, row and schema locks
0830 07:54:48.304101 (+ 10us) write_op.cc:454] Released schema lock
0830 07:54:48.304106 (+ 5us) write_op.cc:341] FINISH: Updating metrics
0830 07:54:48.305805 (+ 1699us) write_op.cc:489] Releasing partition, row and schema locks
0830 07:54:48.305811 (+ 6us) write_op.cc:454] Released schema lock
Related trace 'op':
0830 07:54:48.314672 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0830 07:54:48.314798 (+ 126us) write_op.cc:432] Acquiring schema lock in shared mode
0830 07:54:48.314804 (+ 6us) write_op.cc:435] Acquired schema lock
0830 07:54:48.314808 (+ 4us) tablet.cc:660] Decoding operations
0830 07:54:48.314925 (+ 117us) write_op.cc:620] Acquiring the partition lock for write op
0830 07:54:48.314936 (+ 11us) write_op.cc:641] Partition lock acquired for write op
0830 07:54:48.314942 (+ 6us) tablet.cc:683] Acquiring locks for 1 operations
0830 07:54:48.315007 (+ 65us) tablet.cc:699] Row locks acquired
0830 07:54:48.315011 (+ 4us) write_op.cc:260] PREPARE: finished
0830 07:54:48.315039 (+ 28us) write_op.cc:270] Start()
0830 07:54:48.315062 (+ 23us) write_op.cc:276] Timestamp: P: 1756540488315016 usec, L: 0
0830 07:54:48.315065 (+ 3us) op_driver.cc:348] REPLICATION: starting
0830 07:54:48.315205 (+ 140us) log.cc:844] Serialized 356 byte log entry
0830 07:54:48.480519 (+165314us) op_driver.cc:464] REPLICATION: finished
0830 07:54:48.482947 (+ 2428us) write_op.cc:301] APPLY: starting
0830 07:54:48.482954 (+ 7us) tablet.cc:1365] starting BulkCheckPresence
0830 07:54:48.482993 (+ 39us) tablet.cc:1368] finished BulkCheckPresence
0830 07:54:48.483015 (+ 22us) tablet.cc:1370] starting ApplyRowOperation cycle
0830 07:54:48.483051 (+ 36us) tablet.cc:1381] finished ApplyRowOperation cycle
0830 07:54:48.483078 (+ 27us) tablet_metrics.cc:563] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0830 07:54:48.483086 (+ 8us) write_op.cc:312] APPLY: finished
0830 07:54:48.483150 (+ 64us) log.cc:844] Serialized 23 byte log entry
0830 07:54:48.483189 (+ 39us) write_op.cc:489] Releasing partition, row and schema locks
0830 07:54:48.483201 (+ 12us) write_op.cc:454] Released schema lock
0830 07:54:48.483207 (+ 6us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"reported_tablets":9,"child_traces":[["op",{"apply.queue_time_us":61,"apply.run_cpu_time_us":271,"apply.run_wall_time_us":2069,"num_ops":1,"prepare.queue_time_us":35043,"prepare.run_cpu_time_us":587,"prepare.run_wall_time_us":110026,"raft.queue_time_us":87075,"raft.run_cpu_time_us":9,"raft.run_wall_time_us":10,"replication_time_us":208999}],["op",{"apply.queue_time_us":2399,"apply.run_cpu_time_us":309,"apply.run_wall_time_us":309,"num_ops":1,"prepare.queue_time_us":9631,"prepare.run_cpu_time_us":597,"prepare.run_wall_time_us":863,"replication_time_us":165438,"thread_start_us":79879,"threads_started":1}]]}
I20250830 07:54:48.562669 13234 rpcz_store.cc:276] 0830 07:54:47.298362 (+ 0us) service_pool.cc:168] Inserting onto call queue
0830 07:54:48.245920 (+947558us) service_pool.cc:225] Handling call
0830 07:54:48.308175 (+ 62255us) spinlock_profiling.cc:243] Waited 62 ms on lock 0x616000040f54. stack: 00007f4985b867d6 00007f4985b86590 00007f4984b793ad 0000000000972d94 0000000000972d5d 00007f499495114d 00007f4994951243 00007f4991610941 00007f499919ba5d 00007f4999324e93 00007f499015c7a6 00007f499015c4d5 00007f498c9342ce 00007f498c9331ae 00007f498c9393e5 00007f498c939d0f
0830 07:54:48.308842 (+ 667us) catalog_manager.cc:2076] Acquired catalog manager lock
0830 07:54:48.309277 (+ 435us) catalog_manager.cc:2122] Created new table and tablet info
0830 07:54:48.562211 (+252934us) catalog_manager.cc:2182] Wrote table and tablets to system table
0830 07:54:48.562307 (+ 96us) catalog_manager.cc:2216] Inserted table and tablets into CatalogManager maps
0830 07:54:48.562524 (+ 217us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0830 07:54:48.343644 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0830 07:54:48.343753 (+ 109us) write_op.cc:432] Acquiring schema lock in shared mode
0830 07:54:48.343760 (+ 7us) write_op.cc:435] Acquired schema lock
0830 07:54:48.343764 (+ 4us) tablet.cc:660] Decoding operations
0830 07:54:48.343851 (+ 87us) write_op.cc:620] Acquiring the partition lock for write op
0830 07:54:48.343862 (+ 11us) write_op.cc:641] Partition lock acquired for write op
0830 07:54:48.343868 (+ 6us) tablet.cc:683] Acquiring locks for 2 operations
0830 07:54:48.343941 (+ 73us) tablet.cc:699] Row locks acquired
0830 07:54:48.343945 (+ 4us) write_op.cc:260] PREPARE: finished
0830 07:54:48.344000 (+ 55us) write_op.cc:270] Start()
0830 07:54:48.344030 (+ 30us) write_op.cc:276] Timestamp: P: 1756540488343949 usec, L: 0
0830 07:54:48.344034 (+ 4us) op_driver.cc:348] REPLICATION: starting
0830 07:54:48.344204 (+ 170us) log.cc:844] Serialized 433 byte log entry
0830 07:54:48.561768 (+217564us) op_driver.cc:464] REPLICATION: finished
0830 07:54:48.561832 (+ 64us) write_op.cc:301] APPLY: starting
0830 07:54:48.561840 (+ 8us) tablet.cc:1365] starting BulkCheckPresence
0830 07:54:48.561865 (+ 25us) tablet.cc:1368] finished BulkCheckPresence
0830 07:54:48.561888 (+ 23us) tablet.cc:1370] starting ApplyRowOperation cycle
0830 07:54:48.561967 (+ 79us) tablet.cc:1381] finished ApplyRowOperation cycle
0830 07:54:48.562002 (+ 35us) tablet_metrics.cc:563] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0830 07:54:48.562008 (+ 6us) write_op.cc:312] APPLY: finished
0830 07:54:48.562057 (+ 49us) log.cc:844] Serialized 29 byte log entry
0830 07:54:48.562102 (+ 45us) write_op.cc:489] Releasing partition, row and schema locks
0830 07:54:48.562114 (+ 12us) write_op.cc:454] Released schema lock
0830 07:54:48.562118 (+ 4us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"spinlock_wait_cycles":142532992,"child_traces":[["op",{"apply.queue_time_us":30,"apply.run_cpu_time_us":327,"apply.run_wall_time_us":326,"num_ops":2,"prepare.queue_time_us":33931,"prepare.run_cpu_time_us":621,"prepare.run_wall_time_us":1145,"replication_time_us":217710}]]}
I20250830 07:54:48.563285 13232 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet 0d16bc64dd6e43f7ba313b77c2bbb728
I20250830 07:54:48.563725 13232 catalog_manager.cc:6652] ReplaceTablet: tablet 0d16bc64dd6e43f7ba313b77c2bbb728 deleted and replaced by tablet 9b1b9831ce394c728aea04c0883da961
I20250830 07:54:48.563834 13232 rpcz_store.cc:275] Call kudu.master.MasterService.ReplaceTablet from 127.0.0.1:42126 (request call id 1033) took 1170 ms. Trace:
I20250830 07:54:48.563920 13232 rpcz_store.cc:276] 0830 07:54:47.393786 (+ 0us) service_pool.cc:168] Inserting onto call queue
0830 07:54:48.308067 (+914281us) service_pool.cc:225] Handling call
0830 07:54:48.563800 (+255733us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0830 07:54:48.316400 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0830 07:54:48.316529 (+ 129us) write_op.cc:432] Acquiring schema lock in shared mode
0830 07:54:48.316535 (+ 6us) write_op.cc:435] Acquired schema lock
0830 07:54:48.316539 (+ 4us) tablet.cc:660] Decoding operations
0830 07:54:48.316639 (+ 100us) write_op.cc:620] Acquiring the partition lock for write op
0830 07:54:48.316649 (+ 10us) write_op.cc:641] Partition lock acquired for write op
0830 07:54:48.316656 (+ 7us) tablet.cc:683] Acquiring locks for 2 operations
0830 07:54:48.316727 (+ 71us) tablet.cc:699] Row locks acquired
0830 07:54:48.316731 (+ 4us) write_op.cc:260] PREPARE: finished
0830 07:54:48.316756 (+ 25us) write_op.cc:270] Start()
0830 07:54:48.316782 (+ 26us) write_op.cc:276] Timestamp: P: 1756540488316734 usec, L: 0
0830 07:54:48.316786 (+ 4us) op_driver.cc:348] REPLICATION: starting
0830 07:54:48.316922 (+ 136us) log.cc:844] Serialized 625 byte log entry
0830 07:54:48.560609 (+243687us) op_driver.cc:464] REPLICATION: finished
0830 07:54:48.561073 (+ 464us) write_op.cc:301] APPLY: starting
0830 07:54:48.561082 (+ 9us) tablet.cc:1365] starting BulkCheckPresence
0830 07:54:48.561110 (+ 28us) tablet.cc:1368] finished BulkCheckPresence
0830 07:54:48.561133 (+ 23us) tablet.cc:1370] starting ApplyRowOperation cycle
0830 07:54:48.561208 (+ 75us) tablet.cc:1381] finished ApplyRowOperation cycle
0830 07:54:48.561263 (+ 55us) tablet_metrics.cc:563] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0830 07:54:48.561269 (+ 6us) write_op.cc:312] APPLY: finished
0830 07:54:48.561334 (+ 65us) log.cc:844] Serialized 29 byte log entry
0830 07:54:48.561372 (+ 38us) write_op.cc:489] Releasing partition, row and schema locks
0830 07:54:48.561384 (+ 12us) write_op.cc:454] Released schema lock
0830 07:54:48.561389 (+ 5us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":437,"apply.run_cpu_time_us":364,"apply.run_wall_time_us":364,"num_ops":2,"prepare.queue_time_us":7191,"prepare.run_cpu_time_us":600,"prepare.run_wall_time_us":27195,"replication_time_us":243809}]]}
I20250830 07:54:48.564929 13229 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:42126 (request call id 1031) took 1239 ms. Trace:
I20250830 07:54:48.565043 13229 rpcz_store.cc:276] 0830 07:54:47.325228 (+ 0us) service_pool.cc:168] Inserting onto call queue
0830 07:54:48.302359 (+977131us) service_pool.cc:225] Handling call
0830 07:54:48.307804 (+ 5445us) spinlock_profiling.cc:243] Waited 5.15 ms on lock 0x616000040f54. stack: 00007f4985b867d6 00007f4985b86590 00007f4984b793ad 0000000000972d94 0000000000972d5d 00007f499495114d 00007f4994951243 00007f4991610941 00007f499919ba5d 00007f4999324e93 00007f499015c7a6 00007f499015c4d5 00007f498c9342ce 00007f498c9331ae 00007f498c9393e5 00007f498c939d0f
0830 07:54:48.310404 (+ 2600us) catalog_manager.cc:2076] Acquired catalog manager lock
0830 07:54:48.310768 (+ 364us) catalog_manager.cc:2122] Created new table and tablet info
0830 07:54:48.564733 (+253965us) catalog_manager.cc:2182] Wrote table and tablets to system table
0830 07:54:48.564802 (+ 69us) catalog_manager.cc:2216] Inserted table and tablets into CatalogManager maps
0830 07:54:48.564886 (+ 84us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0830 07:54:48.344811 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0830 07:54:48.344885 (+ 74us) write_op.cc:432] Acquiring schema lock in shared mode
0830 07:54:48.344889 (+ 4us) write_op.cc:435] Acquired schema lock
0830 07:54:48.344891 (+ 2us) tablet.cc:660] Decoding operations
0830 07:54:48.344948 (+ 57us) write_op.cc:620] Acquiring the partition lock for write op
0830 07:54:48.344955 (+ 7us) write_op.cc:641] Partition lock acquired for write op
0830 07:54:48.344959 (+ 4us) tablet.cc:683] Acquiring locks for 2 operations
0830 07:54:48.345048 (+ 89us) tablet.cc:699] Row locks acquired
0830 07:54:48.345050 (+ 2us) write_op.cc:260] PREPARE: finished
0830 07:54:48.345071 (+ 21us) write_op.cc:270] Start()
0830 07:54:48.345090 (+ 19us) write_op.cc:276] Timestamp: P: 1756540488345048 usec, L: 0
0830 07:54:48.345093 (+ 3us) op_driver.cc:348] REPLICATION: starting
0830 07:54:48.345198 (+ 105us) log.cc:844] Serialized 433 byte log entry
0830 07:54:48.564364 (+219166us) op_driver.cc:464] REPLICATION: finished
0830 07:54:48.564424 (+ 60us) write_op.cc:301] APPLY: starting
0830 07:54:48.564432 (+ 8us) tablet.cc:1365] starting BulkCheckPresence
0830 07:54:48.564456 (+ 24us) tablet.cc:1368] finished BulkCheckPresence
0830 07:54:48.564474 (+ 18us) tablet.cc:1370] starting ApplyRowOperation cycle
0830 07:54:48.564539 (+ 65us) tablet.cc:1381] finished ApplyRowOperation cycle
0830 07:54:48.564560 (+ 21us) tablet_metrics.cc:563] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0830 07:54:48.564566 (+ 6us) write_op.cc:312] APPLY: finished
0830 07:54:48.564607 (+ 41us) log.cc:844] Serialized 29 byte log entry
0830 07:54:48.564641 (+ 34us) write_op.cc:489] Releasing partition, row and schema locks
0830 07:54:48.564652 (+ 11us) write_op.cc:454] Released schema lock
0830 07:54:48.564656 (+ 4us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"spinlock_wait_cycles":11839360,"child_traces":[["op",{"apply.queue_time_us":31,"apply.run_cpu_time_us":267,"apply.run_wall_time_us":267,"num_ops":2,"prepare.queue_time_us":33539,"prepare.run_cpu_time_us":451,"prepare.run_wall_time_us":14508,"replication_time_us":219251}]]}
I20250830 07:54:48.567991 15034 log.cc:1199] T 65f1ee59e6e9498381d686f16a865e23 P 2065c332f15a4739899af79f3669c3ba: Deleting WAL directory at /tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/ts-0/wal/wals/65f1ee59e6e9498381d686f16a865e23
I20250830 07:54:48.568848 15034 ts_tablet_manager.cc:1939] T 65f1ee59e6e9498381d686f16a865e23 P 2065c332f15a4739899af79f3669c3ba: Deleting consensus metadata
I20250830 07:54:48.568989 13233 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:42126 (request call id 1030) took 1256 ms. Trace:
I20250830 07:54:48.569092 13233 rpcz_store.cc:276] 0830 07:54:47.312138 (+ 0us) service_pool.cc:168] Inserting onto call queue
0830 07:54:48.299726 (+987588us) service_pool.cc:225] Handling call
0830 07:54:48.310188 (+ 10462us) spinlock_profiling.cc:243] Waited 10.2 ms on lock 0x616000040f54. stack: 00007f4985b867d6 00007f4985b86590 00007f4984b793ad 0000000000972d94 0000000000972d5d 00007f499495114d 00007f4994951243 00007f4991610941 00007f499919ba5d 00007f4999324e93 00007f499015c7a6 00007f499015c4d5 00007f498c9342ce 00007f498c9331ae 00007f498c9393e5 00007f498c939d0f
0830 07:54:48.310933 (+ 745us) catalog_manager.cc:2076] Acquired catalog manager lock
0830 07:54:48.311394 (+ 461us) catalog_manager.cc:2122] Created new table and tablet info
0830 07:54:48.568793 (+257399us) catalog_manager.cc:2182] Wrote table and tablets to system table
0830 07:54:48.568872 (+ 79us) catalog_manager.cc:2216] Inserted table and tablets into CatalogManager maps
0830 07:54:48.568944 (+ 72us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0830 07:54:48.359360 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0830 07:54:48.359445 (+ 85us) write_op.cc:432] Acquiring schema lock in shared mode
0830 07:54:48.359450 (+ 5us) write_op.cc:435] Acquired schema lock
0830 07:54:48.359453 (+ 3us) tablet.cc:660] Decoding operations
0830 07:54:48.359578 (+ 125us) write_op.cc:620] Acquiring the partition lock for write op
0830 07:54:48.359589 (+ 11us) write_op.cc:641] Partition lock acquired for write op
0830 07:54:48.359597 (+ 8us) tablet.cc:683] Acquiring locks for 2 operations
0830 07:54:48.359680 (+ 83us) tablet.cc:699] Row locks acquired
0830 07:54:48.359685 (+ 5us) write_op.cc:260] PREPARE: finished
0830 07:54:48.359719 (+ 34us) write_op.cc:270] Start()
0830 07:54:48.359751 (+ 32us) write_op.cc:276] Timestamp: P: 1756540488359690 usec, L: 0
0830 07:54:48.359756 (+ 5us) op_driver.cc:348] REPLICATION: starting
0830 07:54:48.359925 (+ 169us) log.cc:844] Serialized 433 byte log entry
0830 07:54:48.568306 (+208381us) op_driver.cc:464] REPLICATION: finished
0830 07:54:48.568371 (+ 65us) write_op.cc:301] APPLY: starting
0830 07:54:48.568382 (+ 11us) tablet.cc:1365] starting BulkCheckPresence
0830 07:54:48.568409 (+ 27us) tablet.cc:1368] finished BulkCheckPresence
0830 07:54:48.568437 (+ 28us) tablet.cc:1370] starting ApplyRowOperation cycle
0830 07:54:48.568522 (+ 85us) tablet.cc:1381] finished ApplyRowOperation cycle
0830 07:54:48.568547 (+ 25us) tablet_metrics.cc:563] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0830 07:54:48.568553 (+ 6us) write_op.cc:312] APPLY: finished
0830 07:54:48.568606 (+ 53us) log.cc:844] Serialized 29 byte log entry
0830 07:54:48.568657 (+ 51us) write_op.cc:489] Releasing partition, row and schema locks
0830 07:54:48.568673 (+ 16us) write_op.cc:454] Released schema lock
0830 07:54:48.568679 (+ 6us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"spinlock_wait_cycles":23365888,"child_traces":[["op",{"apply.queue_time_us":29,"apply.run_cpu_time_us":356,"apply.run_wall_time_us":356,"num_ops":2,"prepare.queue_time_us":47502,"prepare.run_cpu_time_us":631,"prepare.run_wall_time_us":4103,"replication_time_us":208522}]]}
I20250830 07:54:48.569646 13766 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "e6491d149c0646848680cfdadb6fc76c" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:48.570063 13218 catalog_manager.cc:4928] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): tablet 65f1ee59e6e9498381d686f16a865e23 (table default.Table_df1448b0d1b44810b3ce8ad508249df6 [id=3cf0d12aa7644ef4abfcf50bdba92a79]) successfully deleted
I20250830 07:54:48.571070 13225 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet 1db4109dc43b489d89c5de9eeb64a771
I20250830 07:54:48.571413 13225 catalog_manager.cc:6652] ReplaceTablet: tablet 1db4109dc43b489d89c5de9eeb64a771 deleted and replaced by tablet 35f0eff139be404392084877df54d564
I20250830 07:54:48.571487 13225 rpcz_store.cc:275] Call kudu.master.MasterService.ReplaceTablet from 127.0.0.1:42126 (request call id 1029) took 1271 ms. Trace:
I20250830 07:54:48.571573 13225 rpcz_store.cc:276] 0830 07:54:47.299854 (+ 0us) service_pool.cc:168] Inserting onto call queue
0830 07:54:48.247117 (+947263us) service_pool.cc:225] Handling call
0830 07:54:48.312353 (+ 65236us) spinlock_profiling.cc:243] Waited 64.9 ms on lock 0x616000040f54. stack: 00007f4985b867d6 00007f4985b86590 00007f4984b793ad 0000000000972d94 0000000000972d5d 00007f499495114d 00007f4994951243 00007f4991610941 00007f499919ba5d 00007f4999331bdb 00007f49901690e7 00007f4990168e15 00007f498c9342ce 00007f498c9331ae 00007f498c9393e5 00007f498c939d0f
0830 07:54:48.571466 (+259113us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0830 07:54:48.363490 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0830 07:54:48.363569 (+ 79us) write_op.cc:432] Acquiring schema lock in shared mode
0830 07:54:48.363573 (+ 4us) write_op.cc:435] Acquired schema lock
0830 07:54:48.363575 (+ 2us) tablet.cc:660] Decoding operations
0830 07:54:48.363646 (+ 71us) write_op.cc:620] Acquiring the partition lock for write op
0830 07:54:48.363653 (+ 7us) write_op.cc:641] Partition lock acquired for write op
0830 07:54:48.363657 (+ 4us) tablet.cc:683] Acquiring locks for 2 operations
0830 07:54:48.363704 (+ 47us) tablet.cc:699] Row locks acquired
0830 07:54:48.363706 (+ 2us) write_op.cc:260] PREPARE: finished
0830 07:54:48.363726 (+ 20us) write_op.cc:270] Start()
0830 07:54:48.363744 (+ 18us) write_op.cc:276] Timestamp: P: 1756540488363701 usec, L: 0
0830 07:54:48.363746 (+ 2us) op_driver.cc:348] REPLICATION: starting
0830 07:54:48.363856 (+ 110us) log.cc:844] Serialized 625 byte log entry
0830 07:54:48.570542 (+206686us) op_driver.cc:464] REPLICATION: finished
0830 07:54:48.570600 (+ 58us) write_op.cc:301] APPLY: starting
0830 07:54:48.570609 (+ 9us) tablet.cc:1365] starting BulkCheckPresence
0830 07:54:48.570634 (+ 25us) tablet.cc:1368] finished BulkCheckPresence
0830 07:54:48.570657 (+ 23us) tablet.cc:1370] starting ApplyRowOperation cycle
0830 07:54:48.570719 (+ 62us) tablet.cc:1381] finished ApplyRowOperation cycle
0830 07:54:48.570753 (+ 34us) tablet_metrics.cc:563] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0830 07:54:48.570760 (+ 7us) write_op.cc:312] APPLY: finished
0830 07:54:48.570800 (+ 40us) log.cc:844] Serialized 29 byte log entry
0830 07:54:48.570835 (+ 35us) write_op.cc:489] Releasing partition, row and schema locks
0830 07:54:48.570846 (+ 11us) write_op.cc:454] Released schema lock
0830 07:54:48.570850 (+ 4us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"spinlock_wait_cycles":149317888,"child_traces":[["op",{"apply.queue_time_us":29,"apply.run_cpu_time_us":285,"apply.run_wall_time_us":285,"num_ops":2,"prepare.queue_time_us":50311,"prepare.run_cpu_time_us":432,"prepare.run_wall_time_us":18230,"replication_time_us":206776}]]}
I20250830 07:54:48.572434 13458 tablet_service.cc:1515] Processing DeleteTablet for tablet 1db4109dc43b489d89c5de9eeb64a771 with delete_type TABLET_DATA_DELETED (replaced by tablet 35f0eff139be404392084877df54d564) from {username='slave'} at 127.0.0.1:37956
I20250830 07:54:48.572741 14974 consensus_queue.cc:1035] T 66d59910b4b2451a851e9d2728d50f42 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:54:48.573007 15034 tablet_replica.cc:331] T 74ea2298876a4066b297915c135d4618 P 2065c332f15a4739899af79f3669c3ba: stopping tablet replica
I20250830 07:54:48.573112 14943 consensus_queue.cc:1035] T 0507245aa8c74aeb9f3eafba0682590d P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:54:48.573191 15034 raft_consensus.cc:2241] T 74ea2298876a4066b297915c135d4618 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Raft consensus shutting down.
I20250830 07:54:48.573338 15034 raft_consensus.cc:2270] T 74ea2298876a4066b297915c135d4618 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Raft consensus is shut down!
I20250830 07:54:48.574074 13886 tablet_bootstrap.cc:492] T d2b8e6df64ef49e2ba36c093efd3c351 P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:54:48.574216 13886 ts_tablet_manager.cc:1397] T d2b8e6df64ef49e2ba36c093efd3c351 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.030s user 0.003s sys 0.000s
I20250830 07:54:48.574844 13886 raft_consensus.cc:357] T d2b8e6df64ef49e2ba36c093efd3c351 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:48.575039 13886 raft_consensus.cc:383] T d2b8e6df64ef49e2ba36c093efd3c351 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:48.575111 13886 raft_consensus.cc:738] T d2b8e6df64ef49e2ba36c093efd3c351 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:54:48.575316 13886 consensus_queue.cc:260] T d2b8e6df64ef49e2ba36c093efd3c351 P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:48.575747 13886 ts_tablet_manager.cc:1428] T d2b8e6df64ef49e2ba36c093efd3c351 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250830 07:54:48.575990 13886 tablet_bootstrap.cc:492] T aee84a97524e4568acdc4ae1c74fb492 P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:54:48.577276 13886 tablet_bootstrap.cc:654] T aee84a97524e4568acdc4ae1c74fb492 P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:48.565068 13465 tablet_service.cc:1515] Processing DeleteTablet for tablet 0d16bc64dd6e43f7ba313b77c2bbb728 with delete_type TABLET_DATA_DELETED (replaced by tablet 9b1b9831ce394c728aea04c0883da961) from {username='slave'} at 127.0.0.1:37956
I20250830 07:54:48.577847 15034 ts_tablet_manager.cc:1905] T 74ea2298876a4066b297915c135d4618 P 2065c332f15a4739899af79f3669c3ba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250830 07:54:48.560626 13482 raft_consensus.cc:2466] T 51cee993ce4249c0830b29cb1808fe80 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 1.
I20250830 07:54:48.574928 13701 leader_election.cc:304] T ec4a3975961d4f85ad9da94835417574 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters:
I20250830 07:54:48.581202 15077 raft_consensus.cc:2802] T ec4a3975961d4f85ad9da94835417574 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election won for term 1
I20250830 07:54:48.581359 15077 raft_consensus.cc:695] T ec4a3975961d4f85ad9da94835417574 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 LEADER]: Becoming Leader. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Running, Role: LEADER
I20250830 07:54:48.581611 15077 consensus_queue.cc:237] T ec4a3975961d4f85ad9da94835417574 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:48.583235 14852 raft_consensus.cc:491] T 7c5e50cb605c4a40b47984f328eedd93 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:48.583357 14852 raft_consensus.cc:513] T 7c5e50cb605c4a40b47984f328eedd93 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:48.583858 14852 leader_election.cc:290] T 7c5e50cb605c4a40b47984f328eedd93 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:48.584460 13482 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "4c4a8eea119044b49e2b29f10a703097" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba"
I20250830 07:54:48.584674 13482 raft_consensus.cc:3058] T 4c4a8eea119044b49e2b29f10a703097 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
W20250830 07:54:48.587551 13227 catalog_manager.cc:5415] Ignoring report from unknown tablet e6491d149c0646848680cfdadb6fc76c
W20250830 07:54:48.587620 13227 catalog_manager.cc:5415] Ignoring report from unknown tablet b83dfc54383d4e7b96523568aea5c9f3
W20250830 07:54:48.587668 13227 catalog_manager.cc:5415] Ignoring report from unknown tablet 8f215330505848619ad44569d3167591
W20250830 07:54:48.587774 13227 catalog_manager.cc:5415] Ignoring report from unknown tablet ef16b9e2d444489699f4db1ac26d5f6c
W20250830 07:54:48.587844 13227 catalog_manager.cc:5415] Ignoring report from unknown tablet b4ab964a64a64e00a78ffd2b220aef46
W20250830 07:54:48.587908 13227 catalog_manager.cc:5415] Ignoring report from unknown tablet 533811110191436d96665b3475ab597f
W20250830 07:54:48.587956 13227 catalog_manager.cc:5415] Ignoring report from unknown tablet d33a5d107c6849aca6eb48ffdf8a5463
W20250830 07:54:48.588025 13227 catalog_manager.cc:5415] Ignoring report from unknown tablet 73853894da074ecd8147a94ac28bfab8
I20250830 07:54:48.589210 13227 catalog_manager.cc:5674] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325) does not have the latest schema for tablet 99f307a8cbb34addaafab82b3ed18241 (table default.Table_4e2c5e0840fe4d3398519818e193f4dd [id=2a10f84461764fd5ab5a59499a370034]). Expected version 1 got 0
I20250830 07:54:48.589483 13227 catalog_manager.cc:5674] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325) does not have the latest schema for tablet 69d6daeb7c774fd48ed296f52ed7c6a6 (table default.Table_c8fac6974ea94c7e863c1ded184f9230 [id=761247d93d9f4f788ecceabebf1de486]). Expected version 3 got 0
I20250830 07:54:48.589654 13227 catalog_manager.cc:5674] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325) does not have the latest schema for tablet 0ceccc5f18294356894695fe08d73e30 (table default.Table_32d032fe8fba47348e797c68bb7ea866 [id=0e99ba575a7a4f8dae74a98627249018]). Expected version 1 got 0
I20250830 07:54:48.589772 13227 catalog_manager.cc:5674] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325) does not have the latest schema for tablet 1e48641532cd439e9b4074712033c737 (table default.Table_da41ab7e69f34ff880f61dd2168a0ea6 [id=4e107bdebbc749af933e7cd0ee557f9f]). Expected version 1 got 0
I20250830 07:54:48.590447 13233 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_4e2c5e0840fe4d3398519818e193f4dd" } modify_external_catalogs: true
I20250830 07:54:48.590608 13233 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_4e2c5e0840fe4d3398519818e193f4dd" } modify_external_catalogs: true
I20250830 07:54:48.591199 13225 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_ba631e9ef6834bae8385a9ecb17e8f1e" } modify_external_catalogs: true
I20250830 07:54:48.591378 13225 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_ba631e9ef6834bae8385a9ecb17e8f1e" } modify_external_catalogs: true
I20250830 07:54:48.592665 13229 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_5231dd03c13a46d699125d43090db9f1" } modify_external_catalogs: true
I20250830 07:54:48.592825 13229 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_5231dd03c13a46d699125d43090db9f1" } modify_external_catalogs: true
I20250830 07:54:48.593869 13228 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_153646ff157d493ba4c4f4ec4368cc52" } new_table_name: "default.Table_16a1c8f31f864806aa36794b911f0757" modify_external_catalogs: true
I20250830 07:54:48.594132 13232 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_f5c54fd926d448d7be37ee5a95f99b09"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250830 07:54:48.594492 13766 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "7c5e50cb605c4a40b47984f328eedd93" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
W20250830 07:54:48.594789 13232 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f5c54fd926d448d7be37ee5a95f99b09 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:48.594837 13701 leader_election.cc:304] T 51cee993ce4249c0830b29cb1808fe80 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters:
I20250830 07:54:48.595096 13230 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_3f04b91e6a2942ebaaa5ce385e4c0c5f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250830 07:54:48.595189 14818 raft_consensus.cc:2802] T 51cee993ce4249c0830b29cb1808fe80 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election won for term 1
I20250830 07:54:48.595345 14818 raft_consensus.cc:695] T 51cee993ce4249c0830b29cb1808fe80 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 LEADER]: Becoming Leader. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Running, Role: LEADER
W20250830 07:54:48.595528 13230 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3f04b91e6a2942ebaaa5ce385e4c0c5f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:48.595752 14818 consensus_queue.cc:237] T 51cee993ce4249c0830b29cb1808fe80 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:48.597306 13887 tablet_bootstrap.cc:492] T ca959e42c8764eeba0faee96caf8b39f P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:54:48.597447 13887 ts_tablet_manager.cc:1397] T ca959e42c8764eeba0faee96caf8b39f P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.085s user 0.004s sys 0.005s
I20250830 07:54:48.599893 13234 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_ed5d4615fae445629ebd6be55862b4bf"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:48.600468 13234 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ed5d4615fae445629ebd6be55862b4bf in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:48.602711 13482 raft_consensus.cc:2466] T 4c4a8eea119044b49e2b29f10a703097 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 1.
W20250830 07:54:48.605695 13231 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 3ad0df6bf5c745379316bea8db4ca4dc has no consensus state
I20250830 07:54:48.605865 13231 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:42126 (request call id 1032) took 1266 ms. Trace:
I20250830 07:54:48.605971 13231 rpcz_store.cc:276] 0830 07:54:47.339548 (+ 0us) service_pool.cc:168] Inserting onto call queue
0830 07:54:48.302701 (+963153us) service_pool.cc:225] Handling call
0830 07:54:48.312039 (+ 9338us) spinlock_profiling.cc:243] Waited 9.08 ms on lock 0x616000040f54. stack: 00007f4985b867d6 00007f4985b86590 00007f4984b793ad 0000000000972d94 0000000000972d5d 00007f499495114d 00007f4994951243 00007f4991610941 00007f499919ba5d 00007f4999327126 00007f4990160126 00007f499015fe55 00007f498c9342ce 00007f498c9331ae 00007f498c9393e5 00007f498c939d0f
0830 07:54:48.312282 (+ 243us) catalog_manager.cc:2368] Looking up, locking, and authorizing table
0830 07:54:48.312504 (+ 222us) catalog_manager.cc:3683] Apply alter schema
0830 07:54:48.312669 (+ 165us) catalog_manager.cc:3715] Acquired catalog manager lock
0830 07:54:48.312772 (+ 103us) catalog_manager.cc:3873] Updating metadata on disk
0830 07:54:48.605431 (+292659us) catalog_manager.cc:3904] Committing alterations to in-memory state
0830 07:54:48.605826 (+ 395us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0830 07:54:48.381767 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0830 07:54:48.381873 (+ 106us) write_op.cc:432] Acquiring schema lock in shared mode
0830 07:54:48.381879 (+ 6us) write_op.cc:435] Acquired schema lock
0830 07:54:48.381881 (+ 2us) tablet.cc:660] Decoding operations
0830 07:54:48.381959 (+ 78us) write_op.cc:620] Acquiring the partition lock for write op
0830 07:54:48.381968 (+ 9us) write_op.cc:641] Partition lock acquired for write op
0830 07:54:48.381972 (+ 4us) tablet.cc:683] Acquiring locks for 1 operations
0830 07:54:48.382045 (+ 73us) tablet.cc:699] Row locks acquired
0830 07:54:48.382048 (+ 3us) write_op.cc:260] PREPARE: finished
0830 07:54:48.382076 (+ 28us) write_op.cc:270] Start()
0830 07:54:48.382103 (+ 27us) write_op.cc:276] Timestamp: P: 1756540488382047 usec, L: 0
0830 07:54:48.382107 (+ 4us) op_driver.cc:348] REPLICATION: starting
0830 07:54:48.382263 (+ 156us) log.cc:844] Serialized 405 byte log entry
0830 07:54:48.584881 (+202618us) op_driver.cc:464] REPLICATION: finished
0830 07:54:48.604682 (+ 19801us) write_op.cc:301] APPLY: starting
0830 07:54:48.604700 (+ 18us) tablet.cc:1365] starting BulkCheckPresence
0830 07:54:48.604745 (+ 45us) tablet.cc:1368] finished BulkCheckPresence
0830 07:54:48.604781 (+ 36us) tablet.cc:1370] starting ApplyRowOperation cycle
0830 07:54:48.604836 (+ 55us) tablet.cc:1381] finished ApplyRowOperation cycle
0830 07:54:48.604878 (+ 42us) tablet_metrics.cc:563] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0830 07:54:48.604889 (+ 11us) write_op.cc:312] APPLY: finished
0830 07:54:48.605073 (+ 184us) log.cc:844] Serialized 23 byte log entry
0830 07:54:48.605314 (+ 241us) write_op.cc:489] Releasing partition, row and schema locks
0830 07:54:48.605332 (+ 18us) write_op.cc:454] Released schema lock
0830 07:54:48.605341 (+ 9us) write_op.cc:341] FINISH: Updating metrics
0830 07:54:48.605421 (+ 80us) write_op.cc:489] Releasing partition, row and schema locks
0830 07:54:48.605427 (+ 6us) write_op.cc:454] Released schema lock
Metrics: {"spinlock_wait_cycles":20893568,"child_traces":[["op",{"apply.queue_time_us":19710,"apply.run_cpu_time_us":580,"apply.run_wall_time_us":735,"num_ops":1,"prepare.queue_time_us":68532,"prepare.run_cpu_time_us":573,"prepare.run_wall_time_us":4099,"replication_time_us":202746}]]}
I20250830 07:54:48.606814 13231 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_3c375881f4bd48f78131bbf90d56ca6d" } modify_external_catalogs: true
I20250830 07:54:48.607018 13231 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_3c375881f4bd48f78131bbf90d56ca6d" } modify_external_catalogs: true
I20250830 07:54:48.600958 13484 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "4828280e6fec4338b35422917966ac8c" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba"
I20250830 07:54:48.603700 13887 raft_consensus.cc:357] T ca959e42c8764eeba0faee96caf8b39f P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:48.615938 13887 raft_consensus.cc:383] T ca959e42c8764eeba0faee96caf8b39f P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:48.615973 13484 raft_consensus.cc:3058] T 4828280e6fec4338b35422917966ac8c P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:48.615998 13887 raft_consensus.cc:738] T ca959e42c8764eeba0faee96caf8b39f P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:54:48.616215 13887 consensus_queue.cc:260] T ca959e42c8764eeba0faee96caf8b39f P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:48.616689 13887 ts_tablet_manager.cc:1428] T ca959e42c8764eeba0faee96caf8b39f P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.019s user 0.001s sys 0.000s
I20250830 07:54:48.616923 13887 tablet_bootstrap.cc:492] T 95b6f084eb5240ea94c125eaa154ac9f P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:54:48.618448 13887 tablet_bootstrap.cc:654] T 95b6f084eb5240ea94c125eaa154ac9f P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:48.604494 13481 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "d6afa1ad4791429ba96ee81583dcee64" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba"
I20250830 07:54:48.618665 13481 raft_consensus.cc:3058] T d6afa1ad4791429ba96ee81583dcee64 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:48.612828 15034 ts_tablet_manager.cc:1918] T 74ea2298876a4066b297915c135d4618 P 2065c332f15a4739899af79f3669c3ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250830 07:54:48.618997 15034 log.cc:1199] T 74ea2298876a4066b297915c135d4618 P 2065c332f15a4739899af79f3669c3ba: Deleting WAL directory at /tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/ts-0/wal/wals/74ea2298876a4066b297915c135d4618
I20250830 07:54:48.619308 15034 ts_tablet_manager.cc:1939] T 74ea2298876a4066b297915c135d4618 P 2065c332f15a4739899af79f3669c3ba: Deleting consensus metadata
I20250830 07:54:48.619751 13484 raft_consensus.cc:2466] T 4828280e6fec4338b35422917966ac8c P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 1.
I20250830 07:54:48.620136 15034 tablet_replica.cc:331] T d206f6b6e7524a27a9f95787bcd5de77 P 2065c332f15a4739899af79f3669c3ba: stopping tablet replica
I20250830 07:54:48.624527 13481 raft_consensus.cc:2466] T d6afa1ad4791429ba96ee81583dcee64 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 1.
I20250830 07:54:48.625175 15071 raft_consensus.cc:491] T 13df49c2c2cd4e5cae26a540835b74c9 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:48.625453 15071 raft_consensus.cc:513] T 13df49c2c2cd4e5cae26a540835b74c9 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:48.626644 15071 leader_election.cc:290] T 13df49c2c2cd4e5cae26a540835b74c9 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967)
I20250830 07:54:48.627419 15034 raft_consensus.cc:2241] T d206f6b6e7524a27a9f95787bcd5de77 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Raft consensus shutting down.
I20250830 07:54:48.627585 15034 raft_consensus.cc:2270] T d206f6b6e7524a27a9f95787bcd5de77 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Raft consensus is shut down!
I20250830 07:54:48.628082 15034 ts_tablet_manager.cc:1905] T d206f6b6e7524a27a9f95787bcd5de77 P 2065c332f15a4739899af79f3669c3ba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250830 07:54:48.639603 13887 tablet_bootstrap.cc:492] T 95b6f084eb5240ea94c125eaa154ac9f P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:54:48.639720 13887 ts_tablet_manager.cc:1397] T 95b6f084eb5240ea94c125eaa154ac9f P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.023s user 0.002s sys 0.005s
I20250830 07:54:48.640394 13887 raft_consensus.cc:357] T 95b6f084eb5240ea94c125eaa154ac9f P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:48.640550 13887 raft_consensus.cc:383] T 95b6f084eb5240ea94c125eaa154ac9f P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:48.640599 13887 raft_consensus.cc:738] T 95b6f084eb5240ea94c125eaa154ac9f P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:54:48.640753 13887 consensus_queue.cc:260] T 95b6f084eb5240ea94c125eaa154ac9f P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:48.642735 15034 ts_tablet_manager.cc:1918] T d206f6b6e7524a27a9f95787bcd5de77 P 2065c332f15a4739899af79f3669c3ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250830 07:54:48.642870 15034 log.cc:1199] T d206f6b6e7524a27a9f95787bcd5de77 P 2065c332f15a4739899af79f3669c3ba: Deleting WAL directory at /tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/ts-0/wal/wals/d206f6b6e7524a27a9f95787bcd5de77
I20250830 07:54:48.643260 15034 ts_tablet_manager.cc:1939] T d206f6b6e7524a27a9f95787bcd5de77 P 2065c332f15a4739899af79f3669c3ba: Deleting consensus metadata
I20250830 07:54:48.645011 13887 ts_tablet_manager.cc:1428] T 95b6f084eb5240ea94c125eaa154ac9f P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20250830 07:54:48.645264 13887 tablet_bootstrap.cc:492] T 8ae468b43b4c450ca7591b543c2539d9 P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:54:48.646484 13887 tablet_bootstrap.cc:654] T 8ae468b43b4c450ca7591b543c2539d9 P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:48.646931 15010 raft_consensus.cc:491] T 3525652a73b8413b8ccbcb5824cc5880 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:48.647073 15010 raft_consensus.cc:513] T 3525652a73b8413b8ccbcb5824cc5880 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:48.647729 15010 leader_election.cc:290] T 3525652a73b8413b8ccbcb5824cc5880 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:48.648824 15010 raft_consensus.cc:491] T 1e48641532cd439e9b4074712033c737 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:48.648962 15010 raft_consensus.cc:513] T 1e48641532cd439e9b4074712033c737 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:48.649561 15010 leader_election.cc:290] T 1e48641532cd439e9b4074712033c737 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:48.664280 13225 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet 0621f6e91e464fd2a556d43e2dc88506
I20250830 07:54:48.664614 13229 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet a7dc529c40544bafbc9e7f0ab34086bd
W20250830 07:54:48.665524 13228 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 0f34ed0fe6e9400fae5c0edebb615ebd consensus state has no leader
I20250830 07:54:48.665699 13228 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:42126 (request call id 1035) took 1181 ms. Trace:
W20250830 07:54:48.666118 13422 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.209.3:38743, user_credentials={real_user=slave}} blocked reactor thread for 64746.4us
I20250830 07:54:48.665779 13228 rpcz_store.cc:276] 0830 07:54:47.484281 (+ 0us) service_pool.cc:168] Inserting onto call queue
0830 07:54:48.562958 (+1078677us) service_pool.cc:225] Handling call
0830 07:54:48.593802 (+ 30844us) spinlock_profiling.cc:243] Waited 30.6 ms on lock 0x616000040f54. stack: 00007f4985b867d6 00007f4985b86590 00007f4984b793ad 0000000000972d94 0000000000972d5d 00007f499495114d 00007f4994951243 00007f4991610941 00007f499919ba5d 00007f4999327126 00007f4990160126 00007f499015fe55 00007f498c9342ce 00007f498c9331ae 00007f498c9393e5 00007f498c939d0f
0830 07:54:48.594043 (+ 241us) catalog_manager.cc:2368] Looking up, locking, and authorizing table
0830 07:54:48.594267 (+ 224us) catalog_manager.cc:3683] Apply alter schema
0830 07:54:48.594425 (+ 158us) catalog_manager.cc:3715] Acquired catalog manager lock
0830 07:54:48.594492 (+ 67us) catalog_manager.cc:3873] Updating metadata on disk
0830 07:54:48.665355 (+ 70863us) catalog_manager.cc:3904] Committing alterations to in-memory state
0830 07:54:48.665642 (+ 287us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0830 07:54:48.597332 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0830 07:54:48.597402 (+ 70us) write_op.cc:432] Acquiring schema lock in shared mode
0830 07:54:48.597406 (+ 4us) write_op.cc:435] Acquired schema lock
0830 07:54:48.597407 (+ 1us) tablet.cc:660] Decoding operations
0830 07:54:48.597488 (+ 81us) write_op.cc:620] Acquiring the partition lock for write op
0830 07:54:48.597497 (+ 9us) write_op.cc:641] Partition lock acquired for write op
0830 07:54:48.597502 (+ 5us) tablet.cc:683] Acquiring locks for 1 operations
0830 07:54:48.597543 (+ 41us) tablet.cc:699] Row locks acquired
0830 07:54:48.597545 (+ 2us) write_op.cc:260] PREPARE: finished
0830 07:54:48.597568 (+ 23us) write_op.cc:270] Start()
0830 07:54:48.597590 (+ 22us) write_op.cc:276] Timestamp: P: 1756540488597519 usec, L: 0
0830 07:54:48.597593 (+ 3us) op_driver.cc:348] REPLICATION: starting
0830 07:54:48.597717 (+ 124us) log.cc:844] Serialized 405 byte log entry
0830 07:54:48.662010 (+ 64293us) op_driver.cc:464] REPLICATION: finished
0830 07:54:48.663282 (+ 1272us) write_op.cc:301] APPLY: starting
0830 07:54:48.663294 (+ 12us) tablet.cc:1365] starting BulkCheckPresence
0830 07:54:48.663318 (+ 24us) tablet.cc:1368] finished BulkCheckPresence
0830 07:54:48.663338 (+ 20us) tablet.cc:1370] starting ApplyRowOperation cycle
0830 07:54:48.663372 (+ 34us) tablet.cc:1381] finished ApplyRowOperation cycle
0830 07:54:48.663396 (+ 24us) tablet_metrics.cc:563] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0830 07:54:48.663402 (+ 6us) write_op.cc:312] APPLY: finished
0830 07:54:48.663453 (+ 51us) log.cc:844] Serialized 23 byte log entry
0830 07:54:48.663490 (+ 37us) write_op.cc:489] Releasing partition, row and schema locks
0830 07:54:48.663501 (+ 11us) write_op.cc:454] Released schema lock
0830 07:54:48.663506 (+ 5us) write_op.cc:341] FINISH: Updating metrics
0830 07:54:48.663562 (+ 56us) write_op.cc:489] Releasing partition, row and schema locks
0830 07:54:48.663565 (+ 3us) write_op.cc:454] Released schema lock
Metrics: {"spinlock_wait_cycles":70388480,"child_traces":[["op",{"apply.queue_time_us":1240,"apply.run_cpu_time_us":275,"apply.run_wall_time_us":276,"num_ops":1,"prepare.queue_time_us":2505,"prepare.run_cpu_time_us":426,"prepare.run_wall_time_us":426,"replication_time_us":64385}]]}
W20250830 07:54:48.666306 13422 leader_election.cc:343] T 7c5e50cb605c4a40b47984f328eedd93 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:48.667621 13480 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "13df49c2c2cd4e5cae26a540835b74c9" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:54:48.667802 13480 raft_consensus.cc:2466] T 13df49c2c2cd4e5cae26a540835b74c9 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 0.
I20250830 07:54:48.669445 13218 catalog_manager.cc:4928] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): tablet 74ea2298876a4066b297915c135d4618 (table default.Table_abfc383542944209880ab0ae6b4c3f29 [id=c61cd884076e445791d32f8c83d1229f]) successfully deleted
I20250830 07:54:48.673205 13701 leader_election.cc:304] T 4828280e6fec4338b35422917966ac8c P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters:
I20250830 07:54:48.673442 13701 leader_election.cc:304] T d6afa1ad4791429ba96ee81583dcee64 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters:
I20250830 07:54:48.673631 13701 leader_election.cc:304] T 4c4a8eea119044b49e2b29f10a703097 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters:
I20250830 07:54:48.674983 14943 raft_consensus.cc:2802] T 4828280e6fec4338b35422917966ac8c P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election won for term 1
I20250830 07:54:48.675117 14943 raft_consensus.cc:695] T 4828280e6fec4338b35422917966ac8c P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 LEADER]: Becoming Leader. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Running, Role: LEADER
I20250830 07:54:48.675359 14943 consensus_queue.cc:237] T 4828280e6fec4338b35422917966ac8c P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:48.676331 14974 raft_consensus.cc:2802] T d6afa1ad4791429ba96ee81583dcee64 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election won for term 1
I20250830 07:54:48.676456 14974 raft_consensus.cc:695] T d6afa1ad4791429ba96ee81583dcee64 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 LEADER]: Becoming Leader. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Running, Role: LEADER
I20250830 07:54:48.676512 15074 raft_consensus.cc:2802] T 4c4a8eea119044b49e2b29f10a703097 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election won for term 1
I20250830 07:54:48.676592 15074 raft_consensus.cc:695] T 4c4a8eea119044b49e2b29f10a703097 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 LEADER]: Becoming Leader. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Running, Role: LEADER
I20250830 07:54:48.676648 14974 consensus_queue.cc:237] T d6afa1ad4791429ba96ee81583dcee64 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:48.676719 13465 tablet_service.cc:1515] Processing DeleteTablet for tablet 0621f6e91e464fd2a556d43e2dc88506 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:48 UTC) from {username='slave'} at 127.0.0.1:37956
I20250830 07:54:48.676744 15074 consensus_queue.cc:237] T 4c4a8eea119044b49e2b29f10a703097 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:48.677407 13465 tablet_service.cc:1515] Processing DeleteTablet for tablet a7dc529c40544bafbc9e7f0ab34086bd with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:48 UTC) from {username='slave'} at 127.0.0.1:37956
I20250830 07:54:48.677559 15071 consensus_queue.cc:1035] T c0147310dad84226808332a4c2c6e09d P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:54:48.677707 13771 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "1e48641532cd439e9b4074712033c737" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:48.677853 15071 consensus_queue.cc:1035] T acca1a8240454b889c63c82d3c75087e P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:54:48.678171 14852 raft_consensus.cc:491] T b83dfc54383d4e7b96523568aea5c9f3 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:48.678289 14852 raft_consensus.cc:513] T b83dfc54383d4e7b96523568aea5c9f3 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:48.678639 15009 raft_consensus.cc:491] T ff72a0fd9a0e46a6bd54a15e4ad783b4 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:48.678753 15009 raft_consensus.cc:513] T ff72a0fd9a0e46a6bd54a15e4ad783b4 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:48.679314 15009 leader_election.cc:290] T ff72a0fd9a0e46a6bd54a15e4ad783b4 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:48.683032 13766 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "3525652a73b8413b8ccbcb5824cc5880" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:48.678783 14852 leader_election.cc:290] T b83dfc54383d4e7b96523568aea5c9f3 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:48.687587 13701 leader_election.cc:304] T 13df49c2c2cd4e5cae26a540835b74c9 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters:
I20250830 07:54:48.687909 15091 raft_consensus.cc:2802] T 13df49c2c2cd4e5cae26a540835b74c9 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:54:48.687978 15091 raft_consensus.cc:491] T 13df49c2c2cd4e5cae26a540835b74c9 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:54:48.688040 15091 raft_consensus.cc:3058] T 13df49c2c2cd4e5cae26a540835b74c9 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:48.692919 15091 raft_consensus.cc:513] T 13df49c2c2cd4e5cae26a540835b74c9 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:48.693627 15091 leader_election.cc:290] T 13df49c2c2cd4e5cae26a540835b74c9 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Requested vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967)
I20250830 07:54:48.702881 15074 raft_consensus.cc:491] T e4ca3110247640fbae4241448e8d5ef7 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:48.703312 15074 raft_consensus.cc:513] T e4ca3110247640fbae4241448e8d5ef7 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:48.704744 15074 leader_election.cc:290] T e4ca3110247640fbae4241448e8d5ef7 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
I20250830 07:54:48.708192 13886 tablet_bootstrap.cc:492] T aee84a97524e4568acdc4ae1c74fb492 P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:54:48.708325 13886 ts_tablet_manager.cc:1397] T aee84a97524e4568acdc4ae1c74fb492 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.132s user 0.014s sys 0.008s
I20250830 07:54:48.708906 13886 raft_consensus.cc:357] T aee84a97524e4568acdc4ae1c74fb492 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:48.709038 13886 raft_consensus.cc:383] T aee84a97524e4568acdc4ae1c74fb492 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:48.709085 13886 raft_consensus.cc:738] T aee84a97524e4568acdc4ae1c74fb492 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:54:48.709324 13234 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:42126 (request call id 1036) took 1206 ms. Trace:
I20250830 07:54:48.709306 13886 consensus_queue.cc:260] T aee84a97524e4568acdc4ae1c74fb492 P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:48.709664 13886 ts_tablet_manager.cc:1428] T aee84a97524e4568acdc4ae1c74fb492 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.001s user 0.001s sys 0.001s
I20250830 07:54:48.709455 13234 rpcz_store.cc:276] 0830 07:54:47.502555 (+ 0us) service_pool.cc:168] Inserting onto call queue
0830 07:54:48.563250 (+1060695us) service_pool.cc:225] Handling call
0830 07:54:48.599824 (+ 36574us) spinlock_profiling.cc:243] Waited 36.2 ms on lock 0x616000040f54. stack: 00007f4985b867d6 00007f4985b86590 00007f4984b793ad 0000000000972d94 0000000000972d5d 00007f499495114d 00007f4994951243 00007f4991610941 00007f499919ba5d 00007f4999324e93 00007f499015c7a6 00007f499015c4d5 00007f498c9342ce 00007f498c9331ae 00007f498c9393e5 00007f498c939d0f
0830 07:54:48.600541 (+ 717us) catalog_manager.cc:2076] Acquired catalog manager lock
0830 07:54:48.600875 (+ 334us) catalog_manager.cc:2122] Created new table and tablet info
0830 07:54:48.708987 (+108112us) catalog_manager.cc:2182] Wrote table and tablets to system table
0830 07:54:48.709135 (+ 148us) catalog_manager.cc:2216] Inserted table and tablets into CatalogManager maps
0830 07:54:48.709253 (+ 118us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0830 07:54:48.602574 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0830 07:54:48.602659 (+ 85us) write_op.cc:432] Acquiring schema lock in shared mode
0830 07:54:48.602663 (+ 4us) write_op.cc:435] Acquired schema lock
0830 07:54:48.602665 (+ 2us) tablet.cc:660] Decoding operations
0830 07:54:48.602721 (+ 56us) write_op.cc:620] Acquiring the partition lock for write op
0830 07:54:48.602730 (+ 9us) write_op.cc:641] Partition lock acquired for write op
0830 07:54:48.602734 (+ 4us) tablet.cc:683] Acquiring locks for 2 operations
0830 07:54:48.602816 (+ 82us) tablet.cc:699] Row locks acquired
0830 07:54:48.602818 (+ 2us) write_op.cc:260] PREPARE: finished
0830 07:54:48.602872 (+ 54us) write_op.cc:270] Start()
0830 07:54:48.602899 (+ 27us) write_op.cc:276] Timestamp: P: 1756540488602800 usec, L: 0
0830 07:54:48.602903 (+ 4us) op_driver.cc:348] REPLICATION: starting
0830 07:54:48.603063 (+ 160us) log.cc:844] Serialized 433 byte log entry
0830 07:54:48.707791 (+104728us) op_driver.cc:464] REPLICATION: finished
0830 07:54:48.708509 (+ 718us) write_op.cc:301] APPLY: starting
0830 07:54:48.708523 (+ 14us) tablet.cc:1365] starting BulkCheckPresence
0830 07:54:48.708551 (+ 28us) tablet.cc:1368] finished BulkCheckPresence
0830 07:54:48.708581 (+ 30us) tablet.cc:1370] starting ApplyRowOperation cycle
0830 07:54:48.708683 (+ 102us) tablet.cc:1381] finished ApplyRowOperation cycle
0830 07:54:48.708715 (+ 32us) tablet_metrics.cc:563] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0830 07:54:48.708722 (+ 7us) write_op.cc:312] APPLY: finished
0830 07:54:48.708795 (+ 73us) log.cc:844] Serialized 29 byte log entry
0830 07:54:48.708848 (+ 53us) write_op.cc:489] Releasing partition, row and schema locks
0830 07:54:48.708864 (+ 16us) write_op.cc:454] Released schema lock
0830 07:54:48.708870 (+ 6us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"spinlock_wait_cycles":83373440,"child_traces":[["op",{"apply.queue_time_us":649,"apply.run_cpu_time_us":446,"apply.run_wall_time_us":445,"num_ops":2,"prepare.queue_time_us":1318,"prepare.run_cpu_time_us":553,"prepare.run_wall_time_us":553,"replication_time_us":104488}]]}
I20250830 07:54:48.710393 13886 tablet_bootstrap.cc:492] T 65f1ee59e6e9498381d686f16a865e23 P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:54:48.711591 13886 tablet_bootstrap.cc:654] T 65f1ee59e6e9498381d686f16a865e23 P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:48.711647 13233 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet 99f307a8cbb34addaafab82b3ed18241
I20250830 07:54:48.714643 13231 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet 09586fdda94c4aff9d3fa25d71fe6ac0
I20250830 07:54:48.715142 13231 master_service.cc:948] ReplaceTablet: received request to replace tablet 6251a06d1efe44e38d35d962c468f8b2 from {username='slave'} at 127.0.0.1:42126
I20250830 07:54:48.407030 14975 consensus_queue.cc:237] T e6b7646588fe4134b2db62ff84ca4791 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
W20250830 07:54:48.716449 13424 outbound_call.cc:321] RPC callback for RPC call kudu.master.MasterService.TSHeartbeat -> {remote=127.12.209.62:39725, user_credentials={real_user=slave}} blocked reactor thread for 50331.3us
I20250830 07:54:48.573356 13601 tablet_service.cc:1515] Processing DeleteTablet for tablet 1db4109dc43b489d89c5de9eeb64a771 with delete_type TABLET_DATA_DELETED (replaced by tablet 35f0eff139be404392084877df54d564) from {username='slave'} at 127.0.0.1:45306
I20250830 07:54:48.573747 13605 tablet_service.cc:1515] Processing DeleteTablet for tablet 0d16bc64dd6e43f7ba313b77c2bbb728 with delete_type TABLET_DATA_DELETED (replaced by tablet 9b1b9831ce394c728aea04c0883da961) from {username='slave'} at 127.0.0.1:45306
I20250830 07:54:48.614691 13613 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "29f0695563854e45965a1cc36ac54138" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:48.615052 13616 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "51cee993ce4249c0830b29cb1808fe80" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:48.615463 13615 raft_consensus.cc:3058] T e6491d149c0646848680cfdadb6fc76c P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:48.718955 13232 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_a7d9a21ec2e74f30a2ce61cdcdd33685" } new_table_name: "default.Table_af843268c3fe41b696d143a2e807bdda" modify_external_catalogs: true
W20250830 07:54:48.721014 13703 consensus_peers.cc:489] T 66d59910b4b2451a851e9d2728d50f42 P 9b057ade5dce45af9f8bf0bedf8b917f -> Peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Couldn't send request to peer 6b5e454d98894637b466ea27f1b647f9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20250830 07:54:48.618005 13620 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "4c4a8eea119044b49e2b29f10a703097" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:48.638252 13610 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "d6afa1ad4791429ba96ee81583dcee64" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:48.638741 13611 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "ec4a3975961d4f85ad9da94835417574" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9"
I20250830 07:54:48.639078 13617 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "29f0695563854e45965a1cc36ac54138" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9"
I20250830 07:54:48.639588 13619 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "51cee993ce4249c0830b29cb1808fe80" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9"
I20250830 07:54:48.640331 13625 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "4c4a8eea119044b49e2b29f10a703097" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9"
I20250830 07:54:48.640604 13614 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "4828280e6fec4338b35422917966ac8c" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:48.641204 13612 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "a41c1455404f4ed0a782a0c4ddd4140d" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9"
I20250830 07:54:48.723345 13562 leader_election.cc:304] T e6491d149c0646848680cfdadb6fc76c P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b5e454d98894637b466ea27f1b647f9; no voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:54:48.723913 13230 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:42126 (request call id 1034) took 1239 ms. Trace:
I20250830 07:54:48.724048 13230 rpcz_store.cc:276] 0830 07:54:47.484133 (+ 0us) service_pool.cc:168] Inserting onto call queue
0830 07:54:48.493820 (+1009687us) service_pool.cc:225] Handling call
0830 07:54:48.595025 (+101205us) spinlock_profiling.cc:243] Waited 101 ms on lock 0x616000040f54. stack: 00007f4985b867d6 00007f4985b86590 00007f4984b793ad 0000000000972d94 0000000000972d5d 00007f499495114d 00007f4994951243 00007f4991610941 00007f499919ba5d 00007f4999324e93 00007f499015c7a6 00007f499015c4d5 00007f498c9342ce 00007f498c9331ae 00007f498c9393e5 00007f498c939d0f
0830 07:54:48.595605 (+ 580us) catalog_manager.cc:2076] Acquired catalog manager lock
0830 07:54:48.596003 (+ 398us) catalog_manager.cc:2122] Created new table and tablet info
0830 07:54:48.723681 (+127678us) catalog_manager.cc:2182] Wrote table and tablets to system table
0830 07:54:48.723777 (+ 96us) catalog_manager.cc:2216] Inserted table and tablets into CatalogManager maps
0830 07:54:48.723868 (+ 91us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0830 07:54:48.598361 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0830 07:54:48.598456 (+ 95us) write_op.cc:432] Acquiring schema lock in shared mode
0830 07:54:48.598460 (+ 4us) write_op.cc:435] Acquired schema lock
0830 07:54:48.598462 (+ 2us) tablet.cc:660] Decoding operations
0830 07:54:48.598522 (+ 60us) write_op.cc:620] Acquiring the partition lock for write op
0830 07:54:48.598529 (+ 7us) write_op.cc:641] Partition lock acquired for write op
0830 07:54:48.598532 (+ 3us) tablet.cc:683] Acquiring locks for 2 operations
0830 07:54:48.598584 (+ 52us) tablet.cc:699] Row locks acquired
0830 07:54:48.598586 (+ 2us) write_op.cc:260] PREPARE: finished
0830 07:54:48.598611 (+ 25us) write_op.cc:270] Start()
0830 07:54:48.598631 (+ 20us) write_op.cc:276] Timestamp: P: 1756540488598561 usec, L: 0
0830 07:54:48.598634 (+ 3us) op_driver.cc:348] REPLICATION: starting
0830 07:54:48.598761 (+ 127us) log.cc:844] Serialized 433 byte log entry
0830 07:54:48.706575 (+107814us) op_driver.cc:464] REPLICATION: finished
0830 07:54:48.707267 (+ 692us) write_op.cc:301] APPLY: starting
0830 07:54:48.707283 (+ 16us) tablet.cc:1365] starting BulkCheckPresence
0830 07:54:48.707685 (+ 402us) tablet.cc:1368] finished BulkCheckPresence
0830 07:54:48.709678 (+ 1993us) tablet.cc:1370] starting ApplyRowOperation cycle
0830 07:54:48.722326 (+ 12648us) tablet.cc:1381] finished ApplyRowOperation cycle
0830 07:54:48.722575 (+ 249us) tablet_metrics.cc:563] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0830 07:54:48.722582 (+ 7us) write_op.cc:312] APPLY: finished
0830 07:54:48.723011 (+ 429us) log.cc:844] Serialized 29 byte log entry
0830 07:54:48.723388 (+ 377us) write_op.cc:489] Releasing partition, row and schema locks
0830 07:54:48.723401 (+ 13us) write_op.cc:454] Released schema lock
0830 07:54:48.723406 (+ 5us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"spinlock_wait_cycles":232077056,"child_traces":[["op",{"apply.queue_time_us":59,"num_ops":2,"prepare.queue_time_us":1999,"prepare.run_cpu_time_us":445,"prepare.run_wall_time_us":444,"replication_time_us":107552}]]}
I20250830 07:54:48.724776 13230 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_77fe8a5674324b1aa673f84197d25aa5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250830 07:54:48.642653 13622 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "d6afa1ad4791429ba96ee81583dcee64" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9"
W20250830 07:54:48.725275 13230 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_77fe8a5674324b1aa673f84197d25aa5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:48.644398 13629 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "4828280e6fec4338b35422917966ac8c" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9"
I20250830 07:54:48.644584 13624 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "13df49c2c2cd4e5cae26a540835b74c9" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
W20250830 07:54:48.661711 13561 consensus_peers.cc:489] T d1ae3812d72b419798736328da64b53c P 6b5e454d98894637b466ea27f1b647f9 -> Peer 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): Couldn't send request to peer 2065c332f15a4739899af79f3669c3ba. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d1ae3812d72b419798736328da64b53c. This is attempt 6: this message will repeat every 5th retry.
W20250830 07:54:48.725684 13561 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.209.1:45325, user_credentials={real_user=slave}} blocked reactor thread for 64000.5us
I20250830 07:54:48.666024 13597 tablet_service.cc:1515] Processing DeleteTablet for tablet 0621f6e91e464fd2a556d43e2dc88506 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:48 UTC) from {username='slave'} at 127.0.0.1:45306
I20250830 07:54:48.666150 13607 tablet_service.cc:1515] Processing DeleteTablet for tablet a7dc529c40544bafbc9e7f0ab34086bd with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:48 UTC) from {username='slave'} at 127.0.0.1:45306
I20250830 07:54:48.726193 14906 consensus_queue.cc:1035] T e66e56ecdf14466282daab8c894eb3c6 P 6b5e454d98894637b466ea27f1b647f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:54:48.714221 13593 tablet_service.cc:1515] Processing DeleteTablet for tablet 99f307a8cbb34addaafab82b3ed18241 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:48 UTC) from {username='slave'} at 127.0.0.1:45306
I20250830 07:54:48.715935 13602 tablet_service.cc:1515] Processing DeleteTablet for tablet 09586fdda94c4aff9d3fa25d71fe6ac0 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:48 UTC) from {username='slave'} at 127.0.0.1:45306
I20250830 07:54:48.726610 13233 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_d4c23a361ea94d88b0fa71c2f7ac15d1" } new_table_name: "default.Table_56e6d3dc00b343a386af2994a3d5d904" modify_external_catalogs: true
I20250830 07:54:48.728374 13225 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_d64f4859d76f4310a74cddb0fded0771" } modify_external_catalogs: true
I20250830 07:54:48.728453 13228 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_9bdcf0c2f2aa4dc18f78900c21e4cbf7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250830 07:54:48.728590 13225 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_d64f4859d76f4310a74cddb0fded0771" } modify_external_catalogs: true
W20250830 07:54:48.728945 13228 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9bdcf0c2f2aa4dc18f78900c21e4cbf7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:48.730582 15047 tablet_replica.cc:331] T 99f307a8cbb34addaafab82b3ed18241 P 6b5e454d98894637b466ea27f1b647f9: stopping tablet replica
I20250830 07:54:48.730813 15047 raft_consensus.cc:2241] T 99f307a8cbb34addaafab82b3ed18241 P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250830 07:54:48.730983 13229 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_c9bf25d8aabf4253b834cfaf90b0d481" } new_table_name: "default.Table_f5eb564710b04449baf4886a4dbfeb8a" modify_external_catalogs: true
I20250830 07:54:48.731025 15047 raft_consensus.cc:2270] T 99f307a8cbb34addaafab82b3ed18241 P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250830 07:54:48.731679 15047 ts_tablet_manager.cc:1905] T 99f307a8cbb34addaafab82b3ed18241 P 6b5e454d98894637b466ea27f1b647f9: Deleting tablet data with delete state TABLET_DATA_DELETED
W20250830 07:54:48.736364 13220 catalog_manager.cc:4908] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet 1db4109dc43b489d89c5de9eeb64a771 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1db4109dc43b489d89c5de9eeb64a771 already in progress: creating tablet
W20250830 07:54:48.736644 13220 catalog_manager.cc:4908] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet 0d16bc64dd6e43f7ba313b77c2bbb728 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0d16bc64dd6e43f7ba313b77c2bbb728 already in progress: creating tablet
W20250830 07:54:48.736860 13220 catalog_manager.cc:4908] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet 0621f6e91e464fd2a556d43e2dc88506 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0621f6e91e464fd2a556d43e2dc88506 already in progress: creating tablet
W20250830 07:54:48.737080 13220 catalog_manager.cc:4908] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet a7dc529c40544bafbc9e7f0ab34086bd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a7dc529c40544bafbc9e7f0ab34086bd already in progress: creating tablet
I20250830 07:54:48.741779 13234 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_977c3bb9ffa841dc945293231255711d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:48.742352 13234 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_977c3bb9ffa841dc945293231255711d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:48.743837 13227 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_3effc9778ea54e47bd37d4c85c00dd99"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:48.744400 13227 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3effc9778ea54e47bd37d4c85c00dd99 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:48.752749 13882 tablet_bootstrap.cc:492] T 29f0695563854e45965a1cc36ac54138 P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:54:48.752919 13882 ts_tablet_manager.cc:1397] T 29f0695563854e45965a1cc36ac54138 P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.202s user 0.000s sys 0.003s
I20250830 07:54:48.753647 13882 raft_consensus.cc:357] T 29f0695563854e45965a1cc36ac54138 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:48.753865 13882 raft_consensus.cc:383] T 29f0695563854e45965a1cc36ac54138 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:48.753960 13882 raft_consensus.cc:738] T 29f0695563854e45965a1cc36ac54138 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:54:48.754215 13882 consensus_queue.cc:260] T 29f0695563854e45965a1cc36ac54138 P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
W20250830 07:54:48.762403 13422 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.209.3:38743, user_credentials={real_user=slave}} blocked reactor thread for 83161.5us
I20250830 07:54:48.776012 13624 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "7c5e50cb605c4a40b47984f328eedd93" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:48.777392 13624 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "3525652a73b8413b8ccbcb5824cc5880" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:48.777900 13624 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "1e48641532cd439e9b4074712033c737" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:48.781821 13882 ts_tablet_manager.cc:1428] T 29f0695563854e45965a1cc36ac54138 P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.029s user 0.000s sys 0.001s
I20250830 07:54:48.783762 13882 tablet_bootstrap.cc:492] T 2b4ce50fbd26484faba3faa2ec5115c0 P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:54:48.786290 13624 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "b83dfc54383d4e7b96523568aea5c9f3" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:48.796187 13225 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet 3c9dd258e6be47f68e039e4cdcd899b2
I20250830 07:54:48.796965 13225 master_service.cc:948] ReplaceTablet: received request to replace tablet 04eadf45b82e4c319eb7b316a402d81a from {username='slave'} at 127.0.0.1:42126
W20250830 07:54:48.798334 13232 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 7e9d6af1d7fc4d4b961583b44f2f962a consensus state has no leader
I20250830 07:54:48.798699 13230 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_73e8585b02314403984ee9385f37f7dc"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250830 07:54:48.798879 13232 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_1eb04793dbd7403bb844b59f901d9c94"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:48.799350 13230 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_73e8585b02314403984ee9385f37f7dc in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250830 07:54:48.799574 13232 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1eb04793dbd7403bb844b59f901d9c94 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:48.801195 13225 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_ff27126ca2cd426da646c882661f3da9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250830 07:54:48.802172 13602 tablet_service.cc:1515] Processing DeleteTablet for tablet 3c9dd258e6be47f68e039e4cdcd899b2 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:48 UTC) from {username='slave'} at 127.0.0.1:45306
I20250830 07:54:48.801517 13231 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet 6251a06d1efe44e38d35d962c468f8b2
I20250830 07:54:48.803417 13231 catalog_manager.cc:6652] ReplaceTablet: tablet 6251a06d1efe44e38d35d962c468f8b2 deleted and replaced by tablet 6bd5f6b3e0a0420c8c4e6e2987d97db3
W20250830 07:54:48.801785 13229 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 569d4ba62c044ac297ad12ddd9b44dd1 has no consensus state
I20250830 07:54:48.808394 13602 tablet_service.cc:1515] Processing DeleteTablet for tablet 6251a06d1efe44e38d35d962c468f8b2 with delete_type TABLET_DATA_DELETED (replaced by tablet 6bd5f6b3e0a0420c8c4e6e2987d97db3) from {username='slave'} at 127.0.0.1:45306
W20250830 07:54:48.809026 13225 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ff27126ca2cd426da646c882661f3da9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:48.811822 13229 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_b40dad149c2d4efe8abbd16dacb9092f" } new_table_name: "default.Table_c7cb5b003eff4489bc9f763787a7f7d5" modify_external_catalogs: true
I20250830 07:54:48.814829 14943 raft_consensus.cc:491] T 74891b8103e144c486750f64ba2003f4 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:48.814967 14943 raft_consensus.cc:513] T 74891b8103e144c486750f64ba2003f4 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:48.815527 14943 leader_election.cc:290] T 74891b8103e144c486750f64ba2003f4 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967)
I20250830 07:54:48.817942 13624 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "ff72a0fd9a0e46a6bd54a15e4ad783b4" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:48.819766 15102 raft_consensus.cc:491] T ca959e42c8764eeba0faee96caf8b39f P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:48.823076 15102 raft_consensus.cc:513] T ca959e42c8764eeba0faee96caf8b39f P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
W20250830 07:54:48.828269 13229 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 40ce920462584c25b19befa4146b340f consensus state has no leader
W20250830 07:54:48.770740 13422 leader_election.cc:343] T 1e48641532cd439e9b4074712033c737 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Illegal state: must be running to vote when last-logged opid is not known
W20250830 07:54:48.836553 13422 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.209.3:38743, user_credentials={real_user=slave}} blocked reactor thread for 62495.3us
W20250830 07:54:48.839437 13422 leader_election.cc:343] T 3525652a73b8413b8ccbcb5824cc5880 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:48.841737 15102 leader_election.cc:290] T ca959e42c8764eeba0faee96caf8b39f P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:48.850705 13887 tablet_bootstrap.cc:492] T 8ae468b43b4c450ca7591b543c2539d9 P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:54:48.850823 13887 ts_tablet_manager.cc:1397] T 8ae468b43b4c450ca7591b543c2539d9 P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.206s user 0.044s sys 0.088s
I20250830 07:54:48.851518 13887 raft_consensus.cc:357] T 8ae468b43b4c450ca7591b543c2539d9 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:48.851862 13887 raft_consensus.cc:383] T 8ae468b43b4c450ca7591b543c2539d9 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:48.851929 13887 raft_consensus.cc:738] T 8ae468b43b4c450ca7591b543c2539d9 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:54:48.852090 13887 consensus_queue.cc:260] T 8ae468b43b4c450ca7591b543c2539d9 P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:48.852519 13887 ts_tablet_manager.cc:1428] T 8ae468b43b4c450ca7591b543c2539d9 P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20250830 07:54:48.852759 13887 tablet_bootstrap.cc:492] T 43e93d3038f7496ebb18319420ab67e0 P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:54:48.854264 14907 raft_consensus.cc:2747] T e6491d149c0646848680cfdadb6fc76c P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20250830 07:54:48.855077 13221 catalog_manager.cc:4726] Async tablet task AlterTable RPC for tablet 0d16bc64dd6e43f7ba313b77c2bbb728 (table default.Table_6fe8dfbe1873453d8f1a683a12a6288a [id=93a678d18ca94d9f9c1f763808c070d6], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 0d16bc64dd6e43f7ba313b77c2bbb728 consensus state has no leader
I20250830 07:54:48.855813 13764 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "b83dfc54383d4e7b96523568aea5c9f3" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:48.856689 13764 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "ff72a0fd9a0e46a6bd54a15e4ad783b4" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:48.858716 13887 tablet_bootstrap.cc:654] T 43e93d3038f7496ebb18319420ab67e0 P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
W20250830 07:54:48.859385 13703 leader_election.cc:343] T 29f0695563854e45965a1cc36ac54138 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
W20250830 07:54:48.860255 13703 leader_election.cc:343] T 51cee993ce4249c0830b29cb1808fe80 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
W20250830 07:54:48.861127 13703 leader_election.cc:343] T 4c4a8eea119044b49e2b29f10a703097 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
W20250830 07:54:48.861856 13703 leader_election.cc:343] T d6afa1ad4791429ba96ee81583dcee64 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
W20250830 07:54:48.862694 13703 leader_election.cc:343] T ec4a3975961d4f85ad9da94835417574 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
W20250830 07:54:48.863477 13703 leader_election.cc:343] T 29f0695563854e45965a1cc36ac54138 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:48.863793 13882 tablet_bootstrap.cc:654] T 2b4ce50fbd26484faba3faa2ec5115c0 P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
W20250830 07:54:48.864205 13703 leader_election.cc:343] T 51cee993ce4249c0830b29cb1808fe80 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
W20250830 07:54:48.865180 13703 leader_election.cc:343] T 4c4a8eea119044b49e2b29f10a703097 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:48.866575 15047 ts_tablet_manager.cc:1918] T 99f307a8cbb34addaafab82b3ed18241 P 6b5e454d98894637b466ea27f1b647f9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250830 07:54:48.869199 13886 tablet_bootstrap.cc:492] T 65f1ee59e6e9498381d686f16a865e23 P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:54:48.869369 13886 ts_tablet_manager.cc:1397] T 65f1ee59e6e9498381d686f16a865e23 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.159s user 0.003s sys 0.014s
I20250830 07:54:48.870062 13886 raft_consensus.cc:357] T 65f1ee59e6e9498381d686f16a865e23 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:48.870275 13886 raft_consensus.cc:383] T 65f1ee59e6e9498381d686f16a865e23 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:48.870383 13886 raft_consensus.cc:738] T 65f1ee59e6e9498381d686f16a865e23 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:54:48.870635 13886 consensus_queue.cc:260] T 65f1ee59e6e9498381d686f16a865e23 P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:48.871157 13886 ts_tablet_manager.cc:1428] T 65f1ee59e6e9498381d686f16a865e23 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20250830 07:54:48.871443 13886 tablet_bootstrap.cc:492] T 3525652a73b8413b8ccbcb5824cc5880 P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:54:48.871757 13229 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_b78c0409c93441d0a67de3b13dbb4140" } modify_external_catalogs: true
I20250830 07:54:48.871922 13229 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_b78c0409c93441d0a67de3b13dbb4140" } modify_external_catalogs: true
I20250830 07:54:48.872859 13886 tablet_bootstrap.cc:654] T 3525652a73b8413b8ccbcb5824cc5880 P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:48.873064 13230 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_5d0efdc1863d4e95bbe8f050f69fb4c7" } new_table_name: "default.Table_ab4bcb27ad764f5c8b7a0e6ab7fa343c" modify_external_catalogs: true
I20250830 07:54:48.874490 15047 log.cc:1199] T 99f307a8cbb34addaafab82b3ed18241 P 6b5e454d98894637b466ea27f1b647f9: Deleting WAL directory at /tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/ts-1/wal/wals/99f307a8cbb34addaafab82b3ed18241
I20250830 07:54:48.876225 13764 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "ca959e42c8764eeba0faee96caf8b39f" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:48.879963 13232 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_9fd86b145c4a4e1dbbf6a088b47de21b" } modify_external_catalogs: true
I20250830 07:54:48.880136 13232 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_9fd86b145c4a4e1dbbf6a088b47de21b" } modify_external_catalogs: true
W20250830 07:54:48.885229 13227 catalog_manager.cc:5415] Ignoring report from unknown tablet 8f215330505848619ad44569d3167591
W20250830 07:54:48.885566 13227 catalog_manager.cc:5415] Ignoring report from unknown tablet f52dd8eeb64a4b8a92babf34387b6c5b
W20250830 07:54:48.885874 13227 catalog_manager.cc:5415] Ignoring report from unknown tablet 2b4ce50fbd26484faba3faa2ec5115c0
W20250830 07:54:48.886080 13227 catalog_manager.cc:5415] Ignoring report from unknown tablet ec4a3975961d4f85ad9da94835417574
W20250830 07:54:48.886317 13227 catalog_manager.cc:5415] Ignoring report from unknown tablet a41c1455404f4ed0a782a0c4ddd4140d
W20250830 07:54:48.886477 13227 catalog_manager.cc:5415] Ignoring report from unknown tablet 44313f1a11b74e6d996cafd3c03d1836
W20250830 07:54:48.886761 13227 catalog_manager.cc:5415] Ignoring report from unknown tablet e6b7646588fe4134b2db62ff84ca4791
W20250830 07:54:48.886888 13227 catalog_manager.cc:5415] Ignoring report from unknown tablet ff0f9cccc8ed43b1a8cd38de0e9d4097
W20250830 07:54:48.887091 13227 catalog_manager.cc:5415] Ignoring report from unknown tablet e4ca3110247640fbae4241448e8d5ef7
W20250830 07:54:48.887251 13227 catalog_manager.cc:5415] Ignoring report from unknown tablet ffc5945a032e47d4bd3397d7c887dc62
W20250830 07:54:48.887419 13227 catalog_manager.cc:5415] Ignoring report from unknown tablet f0144701d459480d96c1ece519951442
W20250830 07:54:48.887832 13227 catalog_manager.cc:5415] Ignoring report from unknown tablet e6491d149c0646848680cfdadb6fc76c
I20250830 07:54:48.889768 13225 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_990e59015a9844b9b7d257d83b0700a0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250830 07:54:48.890092 13481 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "13df49c2c2cd4e5cae26a540835b74c9" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba"
I20250830 07:54:48.890249 13481 raft_consensus.cc:3058] T 13df49c2c2cd4e5cae26a540835b74c9 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
W20250830 07:54:48.890796 13225 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_990e59015a9844b9b7d257d83b0700a0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250830 07:54:48.890986 13227 catalog_manager.cc:5415] Ignoring report from unknown tablet cb3c48982add45379c0e1b117ec40c1a
W20250830 07:54:48.891346 13227 catalog_manager.cc:5415] Ignoring report from unknown tablet 007435e198b9440db055711a98e3148a
W20250830 07:54:48.891753 13227 catalog_manager.cc:5415] Ignoring report from unknown tablet 4c4a8eea119044b49e2b29f10a703097
W20250830 07:54:48.892038 13227 catalog_manager.cc:5415] Ignoring report from unknown tablet 73853894da074ecd8147a94ac28bfab8
W20250830 07:54:48.892351 13227 catalog_manager.cc:5415] Ignoring report from unknown tablet acca1a8240454b889c63c82d3c75087e
W20250830 07:54:48.892526 13227 catalog_manager.cc:5415] Ignoring report from unknown tablet 533811110191436d96665b3475ab597f
W20250830 07:54:48.892832 13227 catalog_manager.cc:5415] Ignoring report from unknown tablet b38c8d003413428dae9e47f58e197c2c
I20250830 07:54:48.892807 13481 raft_consensus.cc:2466] T 13df49c2c2cd4e5cae26a540835b74c9 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 1.
W20250830 07:54:48.893154 13227 catalog_manager.cc:5415] Ignoring report from unknown tablet 66d59910b4b2451a851e9d2728d50f42
I20250830 07:54:48.898874 13481 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "74891b8103e144c486750f64ba2003f4" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:54:48.899151 13481 raft_consensus.cc:2466] T 74891b8103e144c486750f64ba2003f4 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 0.
W20250830 07:54:48.900089 13227 catalog_manager.cc:5415] Ignoring report from unknown tablet d3f207cee78a43a1b5e030c09752c78c
W20250830 07:54:48.900413 13227 catalog_manager.cc:5415] Ignoring report from unknown tablet c0147310dad84226808332a4c2c6e09d
W20250830 07:54:48.900759 13227 catalog_manager.cc:5415] Ignoring report from unknown tablet 4828280e6fec4338b35422917966ac8c
W20250830 07:54:48.901067 13227 catalog_manager.cc:5415] Ignoring report from unknown tablet 1fa571e9490e499792225d7b786e8658
W20250830 07:54:48.901398 13227 catalog_manager.cc:5415] Ignoring report from unknown tablet 01771fa171374e92892345e7402c33d1
W20250830 07:54:48.901705 13227 catalog_manager.cc:5415] Ignoring report from unknown tablet 6a82ea7078e344a497c34f932e139bcd
W20250830 07:54:48.902050 13227 catalog_manager.cc:5415] Ignoring report from unknown tablet 8eb010d7955d47a89ff1d01be1b5b01e
W20250830 07:54:48.902331 13227 catalog_manager.cc:5415] Ignoring report from unknown tablet f398e12cd9f543738d5163354f8a9d9d
I20250830 07:54:48.903594 13886 tablet_bootstrap.cc:492] T 3525652a73b8413b8ccbcb5824cc5880 P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:54:48.907128 13229 catalog_manager.cc:5864] Not sending DeleteTablet requests; no consensus state for tablet db76df91423344308e20efd194370629
I20250830 07:54:48.909011 13701 leader_election.cc:304] T 13df49c2c2cd4e5cae26a540835b74c9 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters:
I20250830 07:54:48.909286 14975 raft_consensus.cc:2802] T 13df49c2c2cd4e5cae26a540835b74c9 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election won for term 1
I20250830 07:54:48.909407 14975 raft_consensus.cc:695] T 13df49c2c2cd4e5cae26a540835b74c9 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 LEADER]: Becoming Leader. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Running, Role: LEADER
I20250830 07:54:48.909618 14975 consensus_queue.cc:237] T 13df49c2c2cd4e5cae26a540835b74c9 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
W20250830 07:54:48.909888 13701 leader_election.cc:343] T e4ca3110247640fbae4241448e8d5ef7 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): Not found: Tablet not found: e4ca3110247640fbae4241448e8d5ef7
W20250830 07:54:48.910899 13703 leader_election.cc:343] T 4828280e6fec4338b35422917966ac8c P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:48.910463 13886 ts_tablet_manager.cc:1397] T 3525652a73b8413b8ccbcb5824cc5880 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.039s user 0.004s sys 0.000s
W20250830 07:54:48.912473 13703 leader_election.cc:343] T a41c1455404f4ed0a782a0c4ddd4140d P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
W20250830 07:54:48.913417 13703 leader_election.cc:343] T d6afa1ad4791429ba96ee81583dcee64 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:48.913457 14974 consensus_queue.cc:1035] T 01771fa171374e92892345e7402c33d1 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:54:48.914846 15047 ts_tablet_manager.cc:1939] T 99f307a8cbb34addaafab82b3ed18241 P 6b5e454d98894637b466ea27f1b647f9: Deleting consensus metadata
W20250830 07:54:48.914810 13703 leader_election.cc:343] T 4828280e6fec4338b35422917966ac8c P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:48.915100 13701 leader_election.cc:304] T 74891b8103e144c486750f64ba2003f4 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters:
I20250830 07:54:48.915376 14974 raft_consensus.cc:2802] T 74891b8103e144c486750f64ba2003f4 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:54:48.915448 14974 raft_consensus.cc:491] T 74891b8103e144c486750f64ba2003f4 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:54:48.915506 14974 raft_consensus.cc:3058] T 74891b8103e144c486750f64ba2003f4 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:48.915755 13229 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_735b64466af64805b228abbbcd984f26"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:48.916355 13229 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_735b64466af64805b228abbbcd984f26 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:48.918052 13234 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_e40f799d6135436c83693f971a69ee0d" } modify_external_catalogs: true
I20250830 07:54:48.918212 13234 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_e40f799d6135436c83693f971a69ee0d" } modify_external_catalogs: true
I20250830 07:54:48.918501 13231 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_8e96034c87ae45fd8aa588594762fa85" } modify_external_catalogs: true
I20250830 07:54:48.918661 13231 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_8e96034c87ae45fd8aa588594762fa85" } modify_external_catalogs: true
W20250830 07:54:48.919193 13703 leader_election.cc:343] T 13df49c2c2cd4e5cae26a540835b74c9 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:48.921962 14974 raft_consensus.cc:513] T 74891b8103e144c486750f64ba2003f4 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:48.923019 14974 leader_election.cc:290] T 74891b8103e144c486750f64ba2003f4 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Requested vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967)
W20250830 07:54:48.930415 13230 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 4eb1af594b3449b8b8e2f6d5d4f7933f has no consensus state
W20250830 07:54:48.933671 13423 leader_election.cc:343] T 7c5e50cb605c4a40b47984f328eedd93 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:48.933782 13423 leader_election.cc:304] T 7c5e50cb605c4a40b47984f328eedd93 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba; no voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:54:48.933993 15115 raft_consensus.cc:2747] T 7c5e50cb605c4a40b47984f328eedd93 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20250830 07:54:48.936120 13423 leader_election.cc:343] T 3525652a73b8413b8ccbcb5824cc5880 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:48.936220 13423 leader_election.cc:304] T 3525652a73b8413b8ccbcb5824cc5880 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba; no voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:54:48.936561 15115 raft_consensus.cc:2747] T 3525652a73b8413b8ccbcb5824cc5880 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20250830 07:54:48.937117 13422 leader_election.cc:343] T b83dfc54383d4e7b96523568aea5c9f3 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:48.937136 13230 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_972de0510dc041f89dcdac3bd6b9d192"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:48.937636 13230 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_972de0510dc041f89dcdac3bd6b9d192 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:48.940450 13886 raft_consensus.cc:357] T 3525652a73b8413b8ccbcb5824cc5880 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
W20250830 07:54:48.938783 13423 leader_election.cc:343] T 1e48641532cd439e9b4074712033c737 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:48.940858 13423 leader_election.cc:304] T 1e48641532cd439e9b4074712033c737 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba; no voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f
W20250830 07:54:48.940882 13422 leader_election.cc:343] T ff72a0fd9a0e46a6bd54a15e4ad783b4 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:48.941052 15115 raft_consensus.cc:2747] T 1e48641532cd439e9b4074712033c737 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:54:48.942610 13886 raft_consensus.cc:383] T 3525652a73b8413b8ccbcb5824cc5880 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20250830 07:54:48.942780 13423 leader_election.cc:343] T b83dfc54383d4e7b96523568aea5c9f3 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:48.942879 13423 leader_election.cc:304] T b83dfc54383d4e7b96523568aea5c9f3 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba; no voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:54:48.943099 13220 catalog_manager.cc:4928] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): tablet 99f307a8cbb34addaafab82b3ed18241 (table default.Table_4e2c5e0840fe4d3398519818e193f4dd [id=2a10f84461764fd5ab5a59499a370034]) successfully deleted
I20250830 07:54:48.939365 13227 catalog_manager.cc:5582] T 856e644662334f8194ffef6ca1232248 P 9b057ade5dce45af9f8bf0bedf8b917f reported cstate change: term changed from 0 to 1, leader changed from <none> to 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3). New cstate: current_term: 1 leader_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } health_report { overall_health: HEALTHY } } }
W20250830 07:54:48.943588 13220 catalog_manager.cc:4908] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet 09586fdda94c4aff9d3fa25d71fe6ac0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 09586fdda94c4aff9d3fa25d71fe6ac0 already in progress: creating tablet
W20250830 07:54:48.943794 13220 catalog_manager.cc:4908] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet 3c9dd258e6be47f68e039e4cdcd899b2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3c9dd258e6be47f68e039e4cdcd899b2 already in progress: creating tablet
W20250830 07:54:48.944025 13220 catalog_manager.cc:4908] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet 6251a06d1efe44e38d35d962c468f8b2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6251a06d1efe44e38d35d962c468f8b2 already in progress: creating tablet
I20250830 07:54:48.942812 13886 raft_consensus.cc:738] T 3525652a73b8413b8ccbcb5824cc5880 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:54:48.945081 13886 consensus_queue.cc:260] T 3525652a73b8413b8ccbcb5824cc5880 P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:48.945668 15115 raft_consensus.cc:2747] T b83dfc54383d4e7b96523568aea5c9f3 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20250830 07:54:48.946695 13422 leader_election.cc:343] T ca959e42c8764eeba0faee96caf8b39f P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:48.947992 13232 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet e74a3e4b3b234c41aca30f772525652e
I20250830 07:54:48.949054 13593 tablet_service.cc:1515] Processing DeleteTablet for tablet e74a3e4b3b234c41aca30f772525652e with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:48 UTC) from {username='slave'} at 127.0.0.1:45306
W20250830 07:54:48.951609 13220 catalog_manager.cc:4908] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet e74a3e4b3b234c41aca30f772525652e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e74a3e4b3b234c41aca30f772525652e already in progress: creating tablet
I20250830 07:54:48.952816 13886 ts_tablet_manager.cc:1428] T 3525652a73b8413b8ccbcb5824cc5880 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.040s user 0.002s sys 0.000s
W20250830 07:54:48.953099 13423 leader_election.cc:343] T ff72a0fd9a0e46a6bd54a15e4ad783b4 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:48.953186 13423 leader_election.cc:304] T ff72a0fd9a0e46a6bd54a15e4ad783b4 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba; no voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:54:48.953418 15102 raft_consensus.cc:2747] T ff72a0fd9a0e46a6bd54a15e4ad783b4 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:54:48.954202 13232 master_service.cc:948] ReplaceTablet: received request to replace tablet 752727eef0734ff3b7b35b1d5f66aea6 from {username='slave'} at 127.0.0.1:42126
I20250830 07:54:48.955018 13227 catalog_manager.cc:5674] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743) does not have the latest schema for tablet 856e644662334f8194ffef6ca1232248 (table default.Table_5a48429e0b894a6ea2c01b3ce40de1e9 [id=fe3e5972240046eaa659a06b4eea8648]). Expected version 1 got 0
I20250830 07:54:48.957665 13227 catalog_manager.cc:5674] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743) does not have the latest schema for tablet 13df49c2c2cd4e5cae26a540835b74c9 (table default.Table_cbbde0aa8e5b47e69f1a0db288d36cdf [id=f366e4f894174aeb837a8749180c3a34]). Expected version 1 got 0
I20250830 07:54:48.963857 13882 tablet_bootstrap.cc:492] T 2b4ce50fbd26484faba3faa2ec5115c0 P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:54:48.964100 13882 ts_tablet_manager.cc:1397] T 2b4ce50fbd26484faba3faa2ec5115c0 P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.180s user 0.001s sys 0.003s
I20250830 07:54:48.971132 13479 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "74891b8103e144c486750f64ba2003f4" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba"
I20250830 07:54:48.971294 13479 raft_consensus.cc:3058] T 74891b8103e144c486750f64ba2003f4 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:48.974305 13479 raft_consensus.cc:2466] T 74891b8103e144c486750f64ba2003f4 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 1.
I20250830 07:54:48.960129 13227 catalog_manager.cc:5582] T d6afa1ad4791429ba96ee81583dcee64 P 9b057ade5dce45af9f8bf0bedf8b917f reported cstate change: term changed from 0 to 1, leader changed from <none> to 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3). New cstate: current_term: 1 leader_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } health_report { overall_health: HEALTHY } } }
I20250830 07:54:48.977186 13227 catalog_manager.cc:5674] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743) does not have the latest schema for tablet 7af74bdde363493f8061eba450ecf4b4 (table default.Table_56e6d3dc00b343a386af2994a3d5d904 [id=dfa51a12131743428fa066bbe3b6982e]). Expected version 2 got 1
I20250830 07:54:48.977522 13227 catalog_manager.cc:5582] T 51cee993ce4249c0830b29cb1808fe80 P 9b057ade5dce45af9f8bf0bedf8b917f reported cstate change: term changed from 0 to 1, leader changed from <none> to 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3). New cstate: current_term: 1 leader_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } health_report { overall_health: HEALTHY } } }
I20250830 07:54:48.978269 13227 catalog_manager.cc:5582] T 29f0695563854e45965a1cc36ac54138 P 9b057ade5dce45af9f8bf0bedf8b917f reported cstate change: term changed from 0 to 1, leader changed from <none> to 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3). New cstate: current_term: 1 leader_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } health_report { overall_health: HEALTHY } } }
I20250830 07:54:48.978783 13227 catalog_manager.cc:5674] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743) does not have the latest schema for tablet 29f0695563854e45965a1cc36ac54138 (table default.Table_e40b329adbd0475da2669620084f75f3 [id=7d0a5ef4aaf64241be34eba188f2cbcd]). Expected version 2 got 0
I20250830 07:54:48.979087 13227 catalog_manager.cc:5674] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743) does not have the latest schema for tablet 74891b8103e144c486750f64ba2003f4 (table default.Table_f898ce75325a436ca3a63a3c9e46fb68 [id=63f62da0ba61488791fcce76368d92a8]). Expected version 1 got 0
I20250830 07:54:48.982410 13232 master_service.cc:948] ReplaceTablet: received request to replace tablet 5ce773ce68f649b1bf51f0dd901cb04f from {username='slave'} at 127.0.0.1:42126
I20250830 07:54:48.982431 14975 raft_consensus.cc:491] T aee84a97524e4568acdc4ae1c74fb492 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:48.982592 14975 raft_consensus.cc:513] T aee84a97524e4568acdc4ae1c74fb492 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:48.982988 13887 tablet_bootstrap.cc:492] T 43e93d3038f7496ebb18319420ab67e0 P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:54:48.983366 14975 leader_election.cc:290] T aee84a97524e4568acdc4ae1c74fb492 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967)
I20250830 07:54:48.984838 13886 tablet_bootstrap.cc:492] T d1bf58d367f54ba8bad64887b9a8d9cc P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:54:48.989800 13615 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "13df49c2c2cd4e5cae26a540835b74c9" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9"
I20250830 07:54:48.990069 13887 ts_tablet_manager.cc:1397] T 43e93d3038f7496ebb18319420ab67e0 P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.137s user 0.010s sys 0.023s
I20250830 07:54:48.990438 13624 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "e4ca3110247640fbae4241448e8d5ef7" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:48.990854 13887 raft_consensus.cc:357] T 43e93d3038f7496ebb18319420ab67e0 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:48.991449 13887 raft_consensus.cc:383] T 43e93d3038f7496ebb18319420ab67e0 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:48.991555 13887 raft_consensus.cc:738] T 43e93d3038f7496ebb18319420ab67e0 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:54:48.991815 13887 consensus_queue.cc:260] T 43e93d3038f7496ebb18319420ab67e0 P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:48.992138 13624 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "74891b8103e144c486750f64ba2003f4" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:48.992484 13887 ts_tablet_manager.cc:1428] T 43e93d3038f7496ebb18319420ab67e0 P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20250830 07:54:48.992818 13887 tablet_bootstrap.cc:492] T 519b3e58b63b402d84e234f5e180b98c P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:54:48.994761 13887 tablet_bootstrap.cc:654] T 519b3e58b63b402d84e234f5e180b98c P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:48.994783 15074 raft_consensus.cc:491] T d2b8e6df64ef49e2ba36c093efd3c351 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:48.994959 15074 raft_consensus.cc:513] T d2b8e6df64ef49e2ba36c093efd3c351 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:48.995843 15074 leader_election.cc:290] T d2b8e6df64ef49e2ba36c093efd3c351 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967)
I20250830 07:54:48.998064 13701 leader_election.cc:304] T 74891b8103e144c486750f64ba2003f4 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters:
I20250830 07:54:48.998323 15074 raft_consensus.cc:2802] T 74891b8103e144c486750f64ba2003f4 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election won for term 1
I20250830 07:54:48.998448 15074 raft_consensus.cc:695] T 74891b8103e144c486750f64ba2003f4 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 LEADER]: Becoming Leader. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Running, Role: LEADER
I20250830 07:54:48.998663 15074 consensus_queue.cc:237] T 74891b8103e144c486750f64ba2003f4 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:49.005753 13232 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_94c915c548f5408c9bc1d9786a13861c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:49.006249 13232 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_94c915c548f5408c9bc1d9786a13861c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:49.007652 13228 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_26823b419608403ea304b5f2135fe73d" } new_table_name: "default.Table_c48044602a894fec8bebf440c735a2c6" modify_external_catalogs: true
I20250830 07:54:49.008275 13882 raft_consensus.cc:357] T 2b4ce50fbd26484faba3faa2ec5115c0 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:49.008466 13882 raft_consensus.cc:383] T 2b4ce50fbd26484faba3faa2ec5115c0 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:49.008522 13882 raft_consensus.cc:738] T 2b4ce50fbd26484faba3faa2ec5115c0 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:54:49.008713 13882 consensus_queue.cc:260] T 2b4ce50fbd26484faba3faa2ec5115c0 P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:49.009104 13225 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_ebc7e2e80254427c933db947a11b2ef3" } modify_external_catalogs: true
I20250830 07:54:49.009296 13225 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_ebc7e2e80254427c933db947a11b2ef3" } modify_external_catalogs: true
I20250830 07:54:49.009364 13882 ts_tablet_manager.cc:1428] T 2b4ce50fbd26484faba3faa2ec5115c0 P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.045s user 0.000s sys 0.002s
I20250830 07:54:49.009760 13886 tablet_bootstrap.cc:654] T d1bf58d367f54ba8bad64887b9a8d9cc P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:49.010425 13233 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_ff27126ca2cd426da646c882661f3da9" } new_table_name: "default.Table_ff25925f1f064f088911049c80b77237" modify_external_catalogs: true
I20250830 07:54:49.015990 13484 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "aee84a97524e4568acdc4ae1c74fb492" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:54:49.016137 13484 raft_consensus.cc:2466] T aee84a97524e4568acdc4ae1c74fb492 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 0.
I20250830 07:54:49.017082 13701 leader_election.cc:304] T aee84a97524e4568acdc4ae1c74fb492 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters:
I20250830 07:54:49.017724 14975 raft_consensus.cc:2802] T aee84a97524e4568acdc4ae1c74fb492 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:54:49.017833 14975 raft_consensus.cc:491] T aee84a97524e4568acdc4ae1c74fb492 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:54:49.017932 14975 raft_consensus.cc:3058] T aee84a97524e4568acdc4ae1c74fb492 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:49.018061 13479 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "d2b8e6df64ef49e2ba36c093efd3c351" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:54:49.018214 13479 raft_consensus.cc:2466] T d2b8e6df64ef49e2ba36c093efd3c351 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 0.
I20250830 07:54:49.019276 13887 tablet_bootstrap.cc:492] T 519b3e58b63b402d84e234f5e180b98c P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:54:49.019443 13887 ts_tablet_manager.cc:1397] T 519b3e58b63b402d84e234f5e180b98c P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.027s user 0.006s sys 0.000s
I20250830 07:54:49.020283 13887 raft_consensus.cc:357] T 519b3e58b63b402d84e234f5e180b98c P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:49.020542 13887 raft_consensus.cc:383] T 519b3e58b63b402d84e234f5e180b98c P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:49.020656 13887 raft_consensus.cc:738] T 519b3e58b63b402d84e234f5e180b98c P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:54:49.020995 13887 consensus_queue.cc:260] T 519b3e58b63b402d84e234f5e180b98c P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:49.021389 13229 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_a06255e12ba34102829a4d538de92121"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:49.021829 13229 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a06255e12ba34102829a4d538de92121 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:49.021991 13887 ts_tablet_manager.cc:1428] T 519b3e58b63b402d84e234f5e180b98c P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20250830 07:54:49.022245 13887 tablet_bootstrap.cc:492] T 087bb1e80d2d44bf8619b0341ff99527 P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:54:49.022739 14975 raft_consensus.cc:513] T aee84a97524e4568acdc4ae1c74fb492 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:49.023636 13887 tablet_bootstrap.cc:654] T 087bb1e80d2d44bf8619b0341ff99527 P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:49.023784 13624 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "74891b8103e144c486750f64ba2003f4" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9"
I20250830 07:54:49.024256 13882 tablet_bootstrap.cc:492] T 44313f1a11b74e6d996cafd3c03d1836 P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:54:49.023536 14975 leader_election.cc:290] T aee84a97524e4568acdc4ae1c74fb492 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Requested vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967)
I20250830 07:54:49.026481 13882 tablet_bootstrap.cc:654] T 44313f1a11b74e6d996cafd3c03d1836 P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:49.027908 13234 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet 529e743ea8ba4dcb879dad1d28087486
I20250830 07:54:49.028843 13593 tablet_service.cc:1515] Processing DeleteTablet for tablet 529e743ea8ba4dcb879dad1d28087486 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:48 UTC) from {username='slave'} at 127.0.0.1:45306
W20250830 07:54:49.029901 13220 catalog_manager.cc:4908] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet 529e743ea8ba4dcb879dad1d28087486 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 529e743ea8ba4dcb879dad1d28087486 already in progress: creating tablet
I20250830 07:54:49.033619 14924 raft_consensus.cc:491] T 2009012fddc24e4fb7ad0fab33a1103b P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:49.033722 14924 raft_consensus.cc:513] T 2009012fddc24e4fb7ad0fab33a1103b P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:54:49.034174 14924 leader_election.cc:290] T 2009012fddc24e4fb7ad0fab33a1103b P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
W20250830 07:54:49.034888 13561 leader_election.cc:343] T 2009012fddc24e4fb7ad0fab33a1103b P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): Not found: Tablet not found: 2009012fddc24e4fb7ad0fab33a1103b
I20250830 07:54:49.036002 13701 leader_election.cc:304] T d2b8e6df64ef49e2ba36c093efd3c351 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters:
I20250830 07:54:49.036507 15091 raft_consensus.cc:2802] T d2b8e6df64ef49e2ba36c093efd3c351 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:54:49.036585 15091 raft_consensus.cc:491] T d2b8e6df64ef49e2ba36c093efd3c351 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:54:49.036653 15091 raft_consensus.cc:3058] T d2b8e6df64ef49e2ba36c093efd3c351 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:49.039283 15091 raft_consensus.cc:513] T d2b8e6df64ef49e2ba36c093efd3c351 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:49.039912 15091 leader_election.cc:290] T d2b8e6df64ef49e2ba36c093efd3c351 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Requested vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967)
I20250830 07:54:49.041589 13615 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "aee84a97524e4568acdc4ae1c74fb492" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:49.041811 13624 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "d2b8e6df64ef49e2ba36c093efd3c351" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:49.043002 13624 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "aee84a97524e4568acdc4ae1c74fb492" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9"
I20250830 07:54:49.043447 13624 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "d2b8e6df64ef49e2ba36c093efd3c351" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9"
I20250830 07:54:49.058478 13234 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_58c5a4814ca14dfc8b2dc02bc9c03c1b" } new_table_name: "default.Table_709433919e284efd85a8a10a052723bf" modify_external_catalogs: true
I20250830 07:54:49.054658 13480 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "aee84a97524e4568acdc4ae1c74fb492" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba"
I20250830 07:54:49.062187 13480 raft_consensus.cc:3058] T aee84a97524e4568acdc4ae1c74fb492 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:49.071374 13231 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet 2e63eac2579844ef83bf43f1e6d58634
I20250830 07:54:49.073787 13593 tablet_service.cc:1515] Processing DeleteTablet for tablet 2e63eac2579844ef83bf43f1e6d58634 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:48 UTC) from {username='slave'} at 127.0.0.1:45306
W20250830 07:54:49.074484 13220 catalog_manager.cc:4908] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet 2e63eac2579844ef83bf43f1e6d58634 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2e63eac2579844ef83bf43f1e6d58634 already in progress: creating tablet
I20250830 07:54:49.054898 13481 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "d2b8e6df64ef49e2ba36c093efd3c351" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba"
I20250830 07:54:49.075026 13481 raft_consensus.cc:3058] T d2b8e6df64ef49e2ba36c093efd3c351 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:49.077807 13481 raft_consensus.cc:2466] T d2b8e6df64ef49e2ba36c093efd3c351 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 1.
W20250830 07:54:49.080009 13231 catalog_manager.cc:5415] Ignoring report from unknown tablet 8ae468b43b4c450ca7591b543c2539d9
W20250830 07:54:49.080092 13231 catalog_manager.cc:5415] Ignoring report from unknown tablet e66e56ecdf14466282daab8c894eb3c6
W20250830 07:54:49.080159 13231 catalog_manager.cc:5415] Ignoring report from unknown tablet 0507245aa8c74aeb9f3eafba0682590d
W20250830 07:54:49.080214 13231 catalog_manager.cc:5415] Ignoring report from unknown tablet 66d59910b4b2451a851e9d2728d50f42
W20250830 07:54:49.080276 13231 catalog_manager.cc:5415] Ignoring report from unknown tablet 7c5e50cb605c4a40b47984f328eedd93
W20250830 07:54:49.080329 13231 catalog_manager.cc:5415] Ignoring report from unknown tablet f0144701d459480d96c1ece519951442
W20250830 07:54:49.080446 13231 catalog_manager.cc:5415] Ignoring report from unknown tablet e6491d149c0646848680cfdadb6fc76c
W20250830 07:54:49.080488 13231 catalog_manager.cc:5415] Ignoring report from unknown tablet ca959e42c8764eeba0faee96caf8b39f
W20250830 07:54:49.080569 13231 catalog_manager.cc:5415] Ignoring report from unknown tablet b4ab964a64a64e00a78ffd2b220aef46
W20250830 07:54:49.080667 13231 catalog_manager.cc:5415] Ignoring report from unknown tablet 95b6f084eb5240ea94c125eaa154ac9f
I20250830 07:54:49.080935 13231 catalog_manager.cc:5674] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325) does not have the latest schema for tablet ff72a0fd9a0e46a6bd54a15e4ad783b4 (table default.Table_85e7f0b13c094fd7841dcabce61fd911 [id=de7b214458f247ef831f43727543afc5]). Expected version 1 got 0
I20250830 07:54:49.082490 13231 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_c6ab1627ea6e446eb1345ca8898a905d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:49.083302 13231 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c6ab1627ea6e446eb1345ca8898a905d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:49.083448 15153 tablet.cc:1722] T 7af74bdde363493f8061eba450ecf4b4 P 6b5e454d98894637b466ea27f1b647f9: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20250830 07:54:49.084869 13882 tablet_bootstrap.cc:492] T 44313f1a11b74e6d996cafd3c03d1836 P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:54:49.086252 13882 ts_tablet_manager.cc:1397] T 44313f1a11b74e6d996cafd3c03d1836 P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.062s user 0.004s sys 0.000s
W20250830 07:54:49.086654 13703 leader_election.cc:343] T 13df49c2c2cd4e5cae26a540835b74c9 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
W20250830 07:54:49.087528 13703 consensus_peers.cc:489] T acca1a8240454b889c63c82d3c75087e P 9b057ade5dce45af9f8bf0bedf8b917f -> Peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Couldn't send request to peer 6b5e454d98894637b466ea27f1b647f9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20250830 07:54:49.088907 13882 raft_consensus.cc:357] T 44313f1a11b74e6d996cafd3c03d1836 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
W20250830 07:54:49.090538 13703 leader_election.cc:343] T e4ca3110247640fbae4241448e8d5ef7 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:49.090689 13703 leader_election.cc:304] T e4ca3110247640fbae4241448e8d5ef7 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 2065c332f15a4739899af79f3669c3ba, 6b5e454d98894637b466ea27f1b647f9
I20250830 07:54:49.091161 14974 raft_consensus.cc:2747] T e4ca3110247640fbae4241448e8d5ef7 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:54:49.091481 13882 raft_consensus.cc:383] T 44313f1a11b74e6d996cafd3c03d1836 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:49.091553 13882 raft_consensus.cc:738] T 44313f1a11b74e6d996cafd3c03d1836 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:54:49.091737 13882 consensus_queue.cc:260] T 44313f1a11b74e6d996cafd3c03d1836 P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:49.092242 13882 ts_tablet_manager.cc:1428] T 44313f1a11b74e6d996cafd3c03d1836 P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.004s user 0.000s sys 0.000s
I20250830 07:54:49.092491 13882 tablet_bootstrap.cc:492] T a41c1455404f4ed0a782a0c4ddd4140d P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:54:49.093891 13886 tablet_bootstrap.cc:492] T d1bf58d367f54ba8bad64887b9a8d9cc P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:54:49.094030 13886 ts_tablet_manager.cc:1397] T d1bf58d367f54ba8bad64887b9a8d9cc P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.123s user 0.003s sys 0.000s
I20250830 07:54:49.094718 13886 raft_consensus.cc:357] T d1bf58d367f54ba8bad64887b9a8d9cc P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:49.094977 13886 raft_consensus.cc:383] T d1bf58d367f54ba8bad64887b9a8d9cc P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20250830 07:54:49.095005 13703 leader_election.cc:343] T 74891b8103e144c486750f64ba2003f4 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
W20250830 07:54:49.095800 13703 leader_election.cc:343] T 74891b8103e144c486750f64ba2003f4 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:49.096056 13882 tablet_bootstrap.cc:654] T a41c1455404f4ed0a782a0c4ddd4140d P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
W20250830 07:54:49.096175 13703 leader_election.cc:343] T aee84a97524e4568acdc4ae1c74fb492 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
W20250830 07:54:49.096508 13703 leader_election.cc:343] T d2b8e6df64ef49e2ba36c093efd3c351 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
W20250830 07:54:49.096865 13703 consensus_peers.cc:489] T 01771fa171374e92892345e7402c33d1 P 9b057ade5dce45af9f8bf0bedf8b917f -> Peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Couldn't send request to peer 6b5e454d98894637b466ea27f1b647f9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20250830 07:54:49.096827 14972 consensus_queue.cc:1035] T c0147310dad84226808332a4c2c6e09d P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20250830 07:54:49.096968 13703 leader_election.cc:343] T aee84a97524e4568acdc4ae1c74fb492 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
W20250830 07:54:49.097138 13703 leader_election.cc:343] T d2b8e6df64ef49e2ba36c093efd3c351 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:49.098176 13886 raft_consensus.cc:738] T d1bf58d367f54ba8bad64887b9a8d9cc P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:54:49.098606 13886 consensus_queue.cc:260] T d1bf58d367f54ba8bad64887b9a8d9cc P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:49.105872 13230 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_fedd2d63b6fa4c13900a9d1ec5bf5fa1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:49.106401 13230 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fedd2d63b6fa4c13900a9d1ec5bf5fa1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:49.084125 15156 tablet.cc:1722] T 7af74bdde363493f8061eba450ecf4b4 P 2065c332f15a4739899af79f3669c3ba: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20250830 07:54:49.118023 14924 consensus_queue.cc:1035] T e255d3fdee09400ead41ca835d6d103f P 6b5e454d98894637b466ea27f1b647f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:54:49.120694 13886 ts_tablet_manager.cc:1428] T d1bf58d367f54ba8bad64887b9a8d9cc P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.027s user 0.003s sys 0.000s
I20250830 07:54:49.121450 13232 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_ed0f95c774b3416ba6880f17a3b6a826"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:49.121923 13232 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ed0f95c774b3416ba6880f17a3b6a826 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250830 07:54:49.123056 13228 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 957bd8a761cf484cad4fa68b50dcac10 consensus state has no leader
I20250830 07:54:49.123395 13228 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_34956728c70b428f8d3533023793e73d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:49.123788 13228 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_34956728c70b428f8d3533023793e73d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:49.124395 13886 tablet_bootstrap.cc:492] T b83dfc54383d4e7b96523568aea5c9f3 P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:54:49.124835 13225 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet 509e08290f3842cfbde8b74ff9f4f70f
I20250830 07:54:49.125422 13225 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_48f49e02c7cb42e0ba582c50a2136801"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:49.125792 13225 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_48f49e02c7cb42e0ba582c50a2136801 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250830 07:54:49.126784 13233 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 55feb267e3e5496da10ba707e2a93f4c has no consensus state
I20250830 07:54:49.127079 13233 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_03d5ae4a6e604180be10c3a025359f5b" } new_table_name: "default.Table_ae9e802339b345f5ad2cfd671b29e3b5" modify_external_catalogs: true
I20250830 07:54:49.128548 13593 tablet_service.cc:1515] Processing DeleteTablet for tablet 509e08290f3842cfbde8b74ff9f4f70f with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:49 UTC) from {username='slave'} at 127.0.0.1:45306
W20250830 07:54:49.129415 13220 catalog_manager.cc:4908] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet 509e08290f3842cfbde8b74ff9f4f70f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 509e08290f3842cfbde8b74ff9f4f70f already in progress: creating tablet
I20250830 07:54:49.086812 13480 raft_consensus.cc:2466] T aee84a97524e4568acdc4ae1c74fb492 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 1.
I20250830 07:54:49.109282 13887 tablet_bootstrap.cc:492] T 087bb1e80d2d44bf8619b0341ff99527 P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:54:49.131201 13887 ts_tablet_manager.cc:1397] T 087bb1e80d2d44bf8619b0341ff99527 P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.109s user 0.001s sys 0.002s
I20250830 07:54:49.134140 13887 raft_consensus.cc:357] T 087bb1e80d2d44bf8619b0341ff99527 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:49.134479 13887 raft_consensus.cc:383] T 087bb1e80d2d44bf8619b0341ff99527 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:49.134586 13887 raft_consensus.cc:738] T 087bb1e80d2d44bf8619b0341ff99527 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:54:49.134860 13887 consensus_queue.cc:260] T 087bb1e80d2d44bf8619b0341ff99527 P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:49.135574 13887 ts_tablet_manager.cc:1428] T 087bb1e80d2d44bf8619b0341ff99527 P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20250830 07:54:49.136020 13887 tablet_bootstrap.cc:492] T e6060a3dc6444483b8fb2944b8090cb6 P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:54:49.141077 15010 raft_consensus.cc:491] T 087bb1e80d2d44bf8619b0341ff99527 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:49.141191 15010 raft_consensus.cc:513] T 087bb1e80d2d44bf8619b0341ff99527 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:49.141726 15010 leader_election.cc:290] T 087bb1e80d2d44bf8619b0341ff99527 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:49.144559 13886 tablet_bootstrap.cc:654] T b83dfc54383d4e7b96523568aea5c9f3 P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:49.144672 13887 tablet_bootstrap.cc:654] T e6060a3dc6444483b8fb2944b8090cb6 P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
W20250830 07:54:49.145416 13562 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.209.3:38743, user_credentials={real_user=slave}} blocked reactor thread for 44653.3us
I20250830 07:54:49.146287 15123 consensus_queue.cc:1035] T e66e56ecdf14466282daab8c894eb3c6 P 6b5e454d98894637b466ea27f1b647f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:54:49.154835 13887 tablet_bootstrap.cc:492] T e6060a3dc6444483b8fb2944b8090cb6 P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:54:49.155792 13887 ts_tablet_manager.cc:1397] T e6060a3dc6444483b8fb2944b8090cb6 P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.020s user 0.003s sys 0.002s
I20250830 07:54:49.161348 13887 raft_consensus.cc:357] T e6060a3dc6444483b8fb2944b8090cb6 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:49.162739 13887 raft_consensus.cc:383] T e6060a3dc6444483b8fb2944b8090cb6 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:49.163235 13887 raft_consensus.cc:738] T e6060a3dc6444483b8fb2944b8090cb6 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
W20250830 07:54:49.164868 13229 catalog_manager.cc:5415] Ignoring report from unknown tablet d33a5d107c6849aca6eb48ffdf8a5463
I20250830 07:54:49.164237 13887 consensus_queue.cc:260] T e6060a3dc6444483b8fb2944b8090cb6 P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
W20250830 07:54:49.165079 13229 catalog_manager.cc:5415] Ignoring report from unknown tablet 43e93d3038f7496ebb18319420ab67e0
W20250830 07:54:49.165189 13229 catalog_manager.cc:5415] Ignoring report from unknown tablet 01771fa171374e92892345e7402c33d1
W20250830 07:54:49.165280 13229 catalog_manager.cc:5415] Ignoring report from unknown tablet ef16b9e2d444489699f4db1ac26d5f6c
W20250830 07:54:49.165360 13229 catalog_manager.cc:5415] Ignoring report from unknown tablet c0147310dad84226808332a4c2c6e09d
W20250830 07:54:49.165446 13229 catalog_manager.cc:5415] Ignoring report from unknown tablet e66e56ecdf14466282daab8c894eb3c6
W20250830 07:54:49.165526 13229 catalog_manager.cc:5415] Ignoring report from unknown tablet 0507245aa8c74aeb9f3eafba0682590d
W20250830 07:54:49.165616 13229 catalog_manager.cc:5415] Ignoring report from unknown tablet 66d59910b4b2451a851e9d2728d50f42
W20250830 07:54:49.165699 13229 catalog_manager.cc:5415] Ignoring report from unknown tablet acca1a8240454b889c63c82d3c75087e
I20250830 07:54:49.167528 13229 master_service.cc:948] ReplaceTablet: received request to replace tablet 4c2c85732d454cd98efc2646af9450ed from {username='slave'} at 127.0.0.1:42126
I20250830 07:54:49.167971 13229 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_bad0d43a8b93475c9b78800b232ecd75" } modify_external_catalogs: true
I20250830 07:54:49.168249 13229 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_bad0d43a8b93475c9b78800b232ecd75" } modify_external_catalogs: true
I20250830 07:54:49.169759 15123 raft_consensus.cc:491] T 29f0695563854e45965a1cc36ac54138 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:49.169879 15123 raft_consensus.cc:513] T 29f0695563854e45965a1cc36ac54138 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:49.170454 15123 leader_election.cc:290] T 29f0695563854e45965a1cc36ac54138 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:49.170372 13887 ts_tablet_manager.cc:1428] T e6060a3dc6444483b8fb2944b8090cb6 P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.014s user 0.003s sys 0.000s
I20250830 07:54:49.170953 13482 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "29f0695563854e45965a1cc36ac54138" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:54:49.171144 13482 raft_consensus.cc:2391] T 29f0695563854e45965a1cc36ac54138 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b5e454d98894637b466ea27f1b647f9 in current term 1: Already voted for candidate 9b057ade5dce45af9f8bf0bedf8b917f in this term.
I20250830 07:54:49.172032 13887 tablet_bootstrap.cc:492] T de3a52a8e08a45808373902a0185e6f0 P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
W20250830 07:54:49.173735 13562 leader_election.cc:343] T 2009012fddc24e4fb7ad0fab33a1103b P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Not found: Tablet not found: 2009012fddc24e4fb7ad0fab33a1103b
I20250830 07:54:49.174435 13562 leader_election.cc:304] T 2009012fddc24e4fb7ad0fab33a1103b P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b5e454d98894637b466ea27f1b647f9; no voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:54:49.175033 15010 raft_consensus.cc:491] T 8ae468b43b4c450ca7591b543c2539d9 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:49.175169 15010 raft_consensus.cc:513] T 8ae468b43b4c450ca7591b543c2539d9 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:49.175424 15123 raft_consensus.cc:2747] T 2009012fddc24e4fb7ad0fab33a1103b P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:54:49.175695 15010 leader_election.cc:290] T 8ae468b43b4c450ca7591b543c2539d9 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:49.185034 13624 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "ca959e42c8764eeba0faee96caf8b39f" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
W20250830 07:54:49.187000 13234 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f8fab6e766a847c29da8573ad0b402d5 consensus state has no leader
I20250830 07:54:49.187310 13234 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_6fdd8b95556645e3aca8b103373a8dac" } new_table_name: "default.Table_57e5674478754ca0b44cec01ba4e73e8" modify_external_catalogs: true
I20250830 07:54:49.189500 15123 raft_consensus.cc:491] T 6a82ea7078e344a497c34f932e139bcd P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:49.189620 15123 raft_consensus.cc:513] T 6a82ea7078e344a497c34f932e139bcd P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:49.190490 13482 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "6a82ea7078e344a497c34f932e139bcd" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:54:49.190661 13482 raft_consensus.cc:2391] T 6a82ea7078e344a497c34f932e139bcd P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b5e454d98894637b466ea27f1b647f9 in current term 1: Already voted for candidate 9b057ade5dce45af9f8bf0bedf8b917f in this term.
I20250830 07:54:49.190927 13701 leader_election.cc:304] T d2b8e6df64ef49e2ba36c093efd3c351 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:54:49.191323 15123 leader_election.cc:290] T 6a82ea7078e344a497c34f932e139bcd P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:49.191381 14975 raft_consensus.cc:2802] T d2b8e6df64ef49e2ba36c093efd3c351 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election won for term 1
I20250830 07:54:49.191491 14975 raft_consensus.cc:695] T d2b8e6df64ef49e2ba36c093efd3c351 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 LEADER]: Becoming Leader. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Running, Role: LEADER
I20250830 07:54:49.191721 14975 consensus_queue.cc:237] T d2b8e6df64ef49e2ba36c093efd3c351 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
W20250830 07:54:49.191218 13701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.209.1:45325, user_credentials={real_user=slave}} blocked reactor thread for 43892us
I20250830 07:54:49.196103 13764 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "087bb1e80d2d44bf8619b0341ff99527" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:49.196857 13701 leader_election.cc:304] T aee84a97524e4568acdc4ae1c74fb492 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:54:49.196835 13766 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "8ae468b43b4c450ca7591b543c2539d9" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:49.197506 14972 raft_consensus.cc:2802] T aee84a97524e4568acdc4ae1c74fb492 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election won for term 1
I20250830 07:54:49.197613 14972 raft_consensus.cc:695] T aee84a97524e4568acdc4ae1c74fb492 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 LEADER]: Becoming Leader. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Running, Role: LEADER
I20250830 07:54:49.197799 14972 consensus_queue.cc:237] T aee84a97524e4568acdc4ae1c74fb492 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
W20250830 07:54:49.200014 13422 leader_election.cc:343] T 087bb1e80d2d44bf8619b0341ff99527 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Illegal state: must be running to vote when last-logged opid is not known
W20250830 07:54:49.210777 13422 leader_election.cc:343] T 8ae468b43b4c450ca7591b543c2539d9 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:49.190763 13887 tablet_bootstrap.cc:654] T de3a52a8e08a45808373902a0185e6f0 P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:49.212349 14975 consensus_queue.cc:1035] T 856e644662334f8194ffef6ca1232248 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:54:49.226485 15010 raft_consensus.cc:491] T e6060a3dc6444483b8fb2944b8090cb6 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:49.226634 15010 raft_consensus.cc:513] T e6060a3dc6444483b8fb2944b8090cb6 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:49.227442 15010 leader_election.cc:290] T e6060a3dc6444483b8fb2944b8090cb6 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:49.228214 13764 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "e6060a3dc6444483b8fb2944b8090cb6" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
W20250830 07:54:49.229501 13422 leader_election.cc:343] T e6060a3dc6444483b8fb2944b8090cb6 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Illegal state: must be running to vote when last-logged opid is not known
W20250830 07:54:49.235209 13227 catalog_manager.cc:5415] Ignoring report from unknown tablet e6060a3dc6444483b8fb2944b8090cb6
W20250830 07:54:49.235464 13227 catalog_manager.cc:5415] Ignoring report from unknown tablet e255d3fdee09400ead41ca835d6d103f
I20250830 07:54:49.236304 13227 catalog_manager.cc:5674] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325) does not have the latest schema for tablet 087bb1e80d2d44bf8619b0341ff99527 (table default.Table_89e31bbe0cde4122a2d98a13059c5b87 [id=bbfbc80659fd4a558cd48597a7456667]). Expected version 4 got 0
I20250830 07:54:49.241139 13624 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "087bb1e80d2d44bf8619b0341ff99527" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:49.243607 13624 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "8ae468b43b4c450ca7591b543c2539d9" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:49.248867 13887 tablet_bootstrap.cc:492] T de3a52a8e08a45808373902a0185e6f0 P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:54:49.249799 13887 ts_tablet_manager.cc:1397] T de3a52a8e08a45808373902a0185e6f0 P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.078s user 0.007s sys 0.001s
I20250830 07:54:49.254050 13231 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_e0d2400861094b258fca0704d88ed743" } modify_external_catalogs: true
I20250830 07:54:49.254256 13231 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_e0d2400861094b258fca0704d88ed743" } modify_external_catalogs: true
I20250830 07:54:49.255832 13624 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "e6060a3dc6444483b8fb2944b8090cb6" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:49.258379 13887 raft_consensus.cc:357] T de3a52a8e08a45808373902a0185e6f0 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:49.259927 13887 raft_consensus.cc:383] T de3a52a8e08a45808373902a0185e6f0 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:49.260742 13887 raft_consensus.cc:738] T de3a52a8e08a45808373902a0185e6f0 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:54:49.262580 13887 consensus_queue.cc:260] T de3a52a8e08a45808373902a0185e6f0 P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
W20250830 07:54:49.266719 13423 leader_election.cc:343] T ca959e42c8764eeba0faee96caf8b39f P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:49.266839 13423 leader_election.cc:304] T ca959e42c8764eeba0faee96caf8b39f P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba; no voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:54:49.267315 15010 raft_consensus.cc:2747] T ca959e42c8764eeba0faee96caf8b39f P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:54:49.269165 13887 ts_tablet_manager.cc:1428] T de3a52a8e08a45808373902a0185e6f0 P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.019s user 0.001s sys 0.001s
I20250830 07:54:49.270119 13230 master_service.cc:948] ReplaceTablet: received request to replace tablet 508d21af038c4801a9680ce275eb504c from {username='slave'} at 127.0.0.1:42126
I20250830 07:54:49.270500 13771 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "29f0695563854e45965a1cc36ac54138" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:49.270848 13775 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "6a82ea7078e344a497c34f932e139bcd" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:49.272089 13887 tablet_bootstrap.cc:492] T d64f20df166a46249c08444f44422fc3 P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:54:49.274147 15009 raft_consensus.cc:491] T 0ceccc5f18294356894695fe08d73e30 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:49.274250 15009 raft_consensus.cc:513] T 0ceccc5f18294356894695fe08d73e30 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:49.274688 15009 leader_election.cc:290] T 0ceccc5f18294356894695fe08d73e30 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
W20250830 07:54:49.278769 13423 consensus_peers.cc:489] T d33a5d107c6849aca6eb48ffdf8a5463 P 2065c332f15a4739899af79f3669c3ba -> Peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Couldn't send request to peer 6b5e454d98894637b466ea27f1b647f9. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d33a5d107c6849aca6eb48ffdf8a5463. This is attempt 6: this message will repeat every 5th retry.
W20250830 07:54:49.279095 13423 leader_election.cc:343] T 087bb1e80d2d44bf8619b0341ff99527 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:49.279608 13775 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "0ceccc5f18294356894695fe08d73e30" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
W20250830 07:54:49.280053 13422 leader_election.cc:343] T 0ceccc5f18294356894695fe08d73e30 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:49.279233 13423 leader_election.cc:304] T 087bb1e80d2d44bf8619b0341ff99527 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba; no voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:54:49.280818 15009 raft_consensus.cc:2747] T 087bb1e80d2d44bf8619b0341ff99527 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:54:49.281306 13882 tablet_bootstrap.cc:492] T a41c1455404f4ed0a782a0c4ddd4140d P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:54:49.281466 13882 ts_tablet_manager.cc:1397] T a41c1455404f4ed0a782a0c4ddd4140d P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.189s user 0.015s sys 0.045s
I20250830 07:54:49.282120 13882 raft_consensus.cc:357] T a41c1455404f4ed0a782a0c4ddd4140d P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:49.282325 13882 raft_consensus.cc:383] T a41c1455404f4ed0a782a0c4ddd4140d P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:49.282407 13882 raft_consensus.cc:738] T a41c1455404f4ed0a782a0c4ddd4140d P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:54:49.282665 13882 consensus_queue.cc:260] T a41c1455404f4ed0a782a0c4ddd4140d P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:49.283260 13882 ts_tablet_manager.cc:1428] T a41c1455404f4ed0a782a0c4ddd4140d P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20250830 07:54:49.283537 13882 tablet_bootstrap.cc:492] T 01771fa171374e92892345e7402c33d1 P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:54:49.284989 13882 tablet_bootstrap.cc:654] T 01771fa171374e92892345e7402c33d1 P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
W20250830 07:54:49.288739 13129 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerService.ListTablets -> {remote=127.12.209.2:38967, user_credentials={real_user=slave}} blocked reactor thread for 53629.2us
W20250830 07:54:49.292515 13423 leader_election.cc:343] T 8ae468b43b4c450ca7591b543c2539d9 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:49.292610 13423 leader_election.cc:304] T 8ae468b43b4c450ca7591b543c2539d9 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba; no voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:54:49.292883 15009 raft_consensus.cc:2747] T 8ae468b43b4c450ca7591b543c2539d9 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20250830 07:54:49.293927 13423 leader_election.cc:343] T e6060a3dc6444483b8fb2944b8090cb6 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:49.294019 13423 leader_election.cc:304] T e6060a3dc6444483b8fb2944b8090cb6 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba; no voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:54:49.294360 15009 raft_consensus.cc:2747] T e6060a3dc6444483b8fb2944b8090cb6 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:54:49.294328 14975 consensus_queue.cc:1035] T 6a82ea7078e344a497c34f932e139bcd P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:54:49.295671 13887 tablet_bootstrap.cc:654] T d64f20df166a46249c08444f44422fc3 P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:49.297161 13886 tablet_bootstrap.cc:492] T b83dfc54383d4e7b96523568aea5c9f3 P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:54:49.297284 13886 ts_tablet_manager.cc:1397] T b83dfc54383d4e7b96523568aea5c9f3 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.174s user 0.007s sys 0.004s
I20250830 07:54:49.298619 13886 raft_consensus.cc:357] T b83dfc54383d4e7b96523568aea5c9f3 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:49.298771 13886 raft_consensus.cc:383] T b83dfc54383d4e7b96523568aea5c9f3 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:49.298840 13886 raft_consensus.cc:738] T b83dfc54383d4e7b96523568aea5c9f3 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:54:49.304188 15123 raft_consensus.cc:491] T 69f2105c5eeb47e9a848ae7bf8779996 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:49.304322 15123 raft_consensus.cc:513] T 69f2105c5eeb47e9a848ae7bf8779996 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:49.304913 15123 leader_election.cc:290] T 69f2105c5eeb47e9a848ae7bf8779996 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
W20250830 07:54:49.305790 13561 leader_election.cc:343] T 69f2105c5eeb47e9a848ae7bf8779996 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): Not found: Tablet not found: 69f2105c5eeb47e9a848ae7bf8779996
I20250830 07:54:49.306975 13886 consensus_queue.cc:260] T b83dfc54383d4e7b96523568aea5c9f3 P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:49.308789 14975 raft_consensus.cc:491] T 09586fdda94c4aff9d3fa25d71fe6ac0 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:49.308943 14975 raft_consensus.cc:513] T 09586fdda94c4aff9d3fa25d71fe6ac0 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:49.309509 14975 leader_election.cc:290] T 09586fdda94c4aff9d3fa25d71fe6ac0 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967)
I20250830 07:54:49.311093 13482 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "09586fdda94c4aff9d3fa25d71fe6ac0" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:54:49.311285 13482 raft_consensus.cc:2466] T 09586fdda94c4aff9d3fa25d71fe6ac0 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 0.
I20250830 07:54:49.312103 13882 tablet_bootstrap.cc:492] T 01771fa171374e92892345e7402c33d1 P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:54:49.312278 13882 ts_tablet_manager.cc:1397] T 01771fa171374e92892345e7402c33d1 P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.029s user 0.002s sys 0.002s
I20250830 07:54:49.312923 13882 raft_consensus.cc:357] T 01771fa171374e92892345e7402c33d1 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:49.313117 13882 raft_consensus.cc:383] T 01771fa171374e92892345e7402c33d1 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:49.313195 13882 raft_consensus.cc:738] T 01771fa171374e92892345e7402c33d1 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:54:49.313400 13882 consensus_queue.cc:260] T 01771fa171374e92892345e7402c33d1 P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:49.313822 13882 ts_tablet_manager.cc:1428] T 01771fa171374e92892345e7402c33d1 P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20250830 07:54:49.314083 13882 tablet_bootstrap.cc:492] T 8eb010d7955d47a89ff1d01be1b5b01e P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
W20250830 07:54:49.314823 13232 catalog_manager.cc:5415] Ignoring report from unknown tablet d1bf58d367f54ba8bad64887b9a8d9cc
I20250830 07:54:49.315809 13882 tablet_bootstrap.cc:654] T 8eb010d7955d47a89ff1d01be1b5b01e P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
W20250830 07:54:49.315893 13232 catalog_manager.cc:5415] Ignoring report from unknown tablet 8f215330505848619ad44569d3167591
W20250830 07:54:49.316071 13232 catalog_manager.cc:5415] Ignoring report from unknown tablet ec4a3975961d4f85ad9da94835417574
I20250830 07:54:49.316046 13887 tablet_bootstrap.cc:492] T d64f20df166a46249c08444f44422fc3 P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
W20250830 07:54:49.316280 13232 catalog_manager.cc:5415] Ignoring report from unknown tablet 0507245aa8c74aeb9f3eafba0682590d
I20250830 07:54:49.316370 13887 ts_tablet_manager.cc:1397] T d64f20df166a46249c08444f44422fc3 P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.045s user 0.002s sys 0.003s
W20250830 07:54:49.316512 13232 catalog_manager.cc:5415] Ignoring report from unknown tablet f0144701d459480d96c1ece519951442
I20250830 07:54:49.311965 13701 leader_election.cc:304] T 09586fdda94c4aff9d3fa25d71fe6ac0 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters:
W20250830 07:54:49.316686 13232 catalog_manager.cc:5415] Ignoring report from unknown tablet 65f1ee59e6e9498381d686f16a865e23
W20250830 07:54:49.316803 13232 catalog_manager.cc:5415] Ignoring report from unknown tablet e6491d149c0646848680cfdadb6fc76c
W20250830 07:54:49.316900 13232 catalog_manager.cc:5415] Ignoring report from unknown tablet d2b8e6df64ef49e2ba36c093efd3c351
I20250830 07:54:49.316939 14975 raft_consensus.cc:2802] T 09586fdda94c4aff9d3fa25d71fe6ac0 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:54:49.317027 14975 raft_consensus.cc:491] T 09586fdda94c4aff9d3fa25d71fe6ac0 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20250830 07:54:49.317057 13232 catalog_manager.cc:5415] Ignoring report from unknown tablet 4c4a8eea119044b49e2b29f10a703097
I20250830 07:54:49.317106 14975 raft_consensus.cc:3058] T 09586fdda94c4aff9d3fa25d71fe6ac0 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
W20250830 07:54:49.317211 13232 catalog_manager.cc:5415] Ignoring report from unknown tablet acca1a8240454b889c63c82d3c75087e
W20250830 07:54:49.317329 13232 catalog_manager.cc:5415] Ignoring report from unknown tablet 66d59910b4b2451a851e9d2728d50f42
W20250830 07:54:49.317548 13232 catalog_manager.cc:5415] Ignoring report from unknown tablet c0147310dad84226808332a4c2c6e09d
W20250830 07:54:49.317664 13232 catalog_manager.cc:5415] Ignoring report from unknown tablet 4828280e6fec4338b35422917966ac8c
W20250830 07:54:49.317747 13232 catalog_manager.cc:5415] Ignoring report from unknown tablet 1fa571e9490e499792225d7b786e8658
W20250830 07:54:49.317836 13232 catalog_manager.cc:5415] Ignoring report from unknown tablet 01771fa171374e92892345e7402c33d1
I20250830 07:54:49.318631 15197 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.12.209.60:43889 every 8 connection(s)
I20250830 07:54:49.318876 13232 catalog_manager.cc:5582] T 13df49c2c2cd4e5cae26a540835b74c9 P 9b057ade5dce45af9f8bf0bedf8b917f reported cstate change: term changed from 0 to 1, leader changed from <none> to 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3). New cstate: current_term: 1 leader_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } health_report { overall_health: HEALTHY } } }
I20250830 07:54:49.319465 13232 catalog_manager.cc:5674] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743) does not have the latest schema for tablet 13df49c2c2cd4e5cae26a540835b74c9 (table default.Table_cbbde0aa8e5b47e69f1a0db288d36cdf [id=f366e4f894174aeb837a8749180c3a34]). Expected version 1 got 0
I20250830 07:54:49.319840 14975 raft_consensus.cc:513] T 09586fdda94c4aff9d3fa25d71fe6ac0 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:49.320116 14745 rpc_server.cc:307] RPC server started. Bound to: 127.12.209.60:43889
I20250830 07:54:49.319916 13232 catalog_manager.cc:5582] T 74891b8103e144c486750f64ba2003f4 P 9b057ade5dce45af9f8bf0bedf8b917f reported cstate change: term changed from 0 to 1, leader changed from <none> to 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3). New cstate: current_term: 1 leader_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } health_report { overall_health: HEALTHY } } }
I20250830 07:54:49.320533 13232 catalog_manager.cc:5674] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743) does not have the latest schema for tablet 74891b8103e144c486750f64ba2003f4 (table default.Table_f898ce75325a436ca3a63a3c9e46fb68 [id=63f62da0ba61488791fcce76368d92a8]). Expected version 1 got 0
I20250830 07:54:49.320626 14975 leader_election.cc:290] T 09586fdda94c4aff9d3fa25d71fe6ac0 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Requested vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967)
I20250830 07:54:49.321143 13232 catalog_manager.cc:5582] T aee84a97524e4568acdc4ae1c74fb492 P 9b057ade5dce45af9f8bf0bedf8b917f reported cstate change: term changed from 0 to 1, leader changed from <none> to 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3). New cstate: current_term: 1 leader_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } health_report { overall_health: HEALTHY } } }
I20250830 07:54:49.321851 13232 catalog_manager.cc:5674] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743) does not have the latest schema for tablet aee84a97524e4568acdc4ae1c74fb492 (table default.Table_65ab52329c314c13817e7261f5108188 [id=18b2c25896e546748465c4807b839cbf]). Expected version 2 got 0
I20250830 07:54:49.311395 13886 ts_tablet_manager.cc:1428] T b83dfc54383d4e7b96523568aea5c9f3 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.013s user 0.001s sys 0.000s
I20250830 07:54:49.323042 14745 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/master-2/data/info.pb
I20250830 07:54:49.323141 13886 tablet_bootstrap.cc:492] T 4b403cadfb7b42f8896b2ee16b50ecb1 P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:54:49.324077 13480 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "09586fdda94c4aff9d3fa25d71fe6ac0" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba"
I20250830 07:54:49.324342 13480 raft_consensus.cc:3058] T 09586fdda94c4aff9d3fa25d71fe6ac0 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:49.326679 13887 raft_consensus.cc:357] T d64f20df166a46249c08444f44422fc3 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:49.328490 13624 raft_consensus.cc:3058] T 6a82ea7078e344a497c34f932e139bcd P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:49.328330 13887 raft_consensus.cc:383] T d64f20df166a46249c08444f44422fc3 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:49.328733 13887 raft_consensus.cc:738] T d64f20df166a46249c08444f44422fc3 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:54:49.316005 15182 tablet.cc:1722] T 7af74bdde363493f8061eba450ecf4b4 P 9b057ade5dce45af9f8bf0bedf8b917f: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20250830 07:54:49.329613 14975 consensus_queue.cc:1035] T a41c1455404f4ed0a782a0c4ddd4140d P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:54:49.329752 13887 consensus_queue.cc:260] T d64f20df166a46249c08444f44422fc3 P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:49.332509 13882 tablet_bootstrap.cc:492] T 8eb010d7955d47a89ff1d01be1b5b01e P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:54:49.332597 13124 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskbivBUj/build/asan/bin/kudu as pid 14745
I20250830 07:54:49.332652 13882 ts_tablet_manager.cc:1397] T 8eb010d7955d47a89ff1d01be1b5b01e P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.019s user 0.003s sys 0.001s
I20250830 07:54:49.333209 13882 raft_consensus.cc:357] T 8eb010d7955d47a89ff1d01be1b5b01e P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:49.333452 13882 raft_consensus.cc:383] T 8eb010d7955d47a89ff1d01be1b5b01e P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:49.333555 13882 raft_consensus.cc:738] T 8eb010d7955d47a89ff1d01be1b5b01e P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:54:49.333775 13882 consensus_queue.cc:260] T 8eb010d7955d47a89ff1d01be1b5b01e P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:49.334326 13882 ts_tablet_manager.cc:1428] T 8eb010d7955d47a89ff1d01be1b5b01e P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20250830 07:54:49.334601 13882 tablet_bootstrap.cc:492] T 4c4a8eea119044b49e2b29f10a703097 P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:54:49.336196 13887 ts_tablet_manager.cc:1428] T d64f20df166a46249c08444f44422fc3 P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.020s user 0.002s sys 0.000s
I20250830 07:54:49.336495 13887 tablet_bootstrap.cc:492] T 410b1e2d520c470eb4b9ab60104e0cd4 P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:54:49.336872 13882 tablet_bootstrap.cc:654] T 4c4a8eea119044b49e2b29f10a703097 P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:49.342104 13886 tablet_bootstrap.cc:654] T 4b403cadfb7b42f8896b2ee16b50ecb1 P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:49.343679 13614 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "09586fdda94c4aff9d3fa25d71fe6ac0" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9"
I20250830 07:54:49.344689 13629 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "09586fdda94c4aff9d3fa25d71fe6ac0" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:49.352388 13480 raft_consensus.cc:2466] T 09586fdda94c4aff9d3fa25d71fe6ac0 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 1.
I20250830 07:54:49.352694 13701 leader_election.cc:304] T 09586fdda94c4aff9d3fa25d71fe6ac0 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters:
I20250830 07:54:49.353070 14975 raft_consensus.cc:2802] T 09586fdda94c4aff9d3fa25d71fe6ac0 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election won for term 1
I20250830 07:54:49.353178 14975 raft_consensus.cc:695] T 09586fdda94c4aff9d3fa25d71fe6ac0 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 LEADER]: Becoming Leader. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Running, Role: LEADER
I20250830 07:54:49.353379 14975 consensus_queue.cc:237] T 09586fdda94c4aff9d3fa25d71fe6ac0 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:49.353873 13887 tablet_bootstrap.cc:654] T 410b1e2d520c470eb4b9ab60104e0cd4 P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:49.357133 13228 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_18c9e57c50cc476596ff71d5eb3b6968"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:49.357762 13228 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_18c9e57c50cc476596ff71d5eb3b6968 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:49.360217 13882 tablet_bootstrap.cc:492] T 4c4a8eea119044b49e2b29f10a703097 P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:54:49.360422 13882 ts_tablet_manager.cc:1397] T 4c4a8eea119044b49e2b29f10a703097 P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.026s user 0.002s sys 0.003s
I20250830 07:54:49.361168 13882 raft_consensus.cc:357] T 4c4a8eea119044b49e2b29f10a703097 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:49.361387 13882 raft_consensus.cc:383] T 4c4a8eea119044b49e2b29f10a703097 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:49.361485 13882 raft_consensus.cc:738] T 4c4a8eea119044b49e2b29f10a703097 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:54:49.361729 13882 consensus_queue.cc:260] T 4c4a8eea119044b49e2b29f10a703097 P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:49.362282 13882 ts_tablet_manager.cc:1428] T 4c4a8eea119044b49e2b29f10a703097 P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20250830 07:54:49.362565 13882 tablet_bootstrap.cc:492] T 4828280e6fec4338b35422917966ac8c P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:54:49.364471 13882 tablet_bootstrap.cc:654] T 4828280e6fec4338b35422917966ac8c P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:49.368557 13225 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_a135889224c7430a8456340fd646571f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:49.369083 13225 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a135889224c7430a8456340fd646571f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:49.385386 14943 raft_consensus.cc:491] T f52dd8eeb64a4b8a92babf34387b6c5b P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:49.385520 14943 raft_consensus.cc:513] T f52dd8eeb64a4b8a92babf34387b6c5b P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:49.386049 14943 leader_election.cc:290] T f52dd8eeb64a4b8a92babf34387b6c5b P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967)
I20250830 07:54:49.388577 14943 consensus_queue.cc:1035] T 6a82ea7078e344a497c34f932e139bcd P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20250830 07:54:49.389057 13701 leader_election.cc:343] T f52dd8eeb64a4b8a92babf34387b6c5b P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): Not found: Tablet not found: f52dd8eeb64a4b8a92babf34387b6c5b
W20250830 07:54:49.390812 13703 consensus_peers.cc:489] T 856e644662334f8194ffef6ca1232248 P 9b057ade5dce45af9f8bf0bedf8b917f -> Peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Couldn't send request to peer 6b5e454d98894637b466ea27f1b647f9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20250830 07:54:49.393880 13624 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "0ceccc5f18294356894695fe08d73e30" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:49.395067 14906 consensus_queue.cc:1035] T e255d3fdee09400ead41ca835d6d103f P 6b5e454d98894637b466ea27f1b647f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:54:49.395095 13562 leader_election.cc:304] T 29f0695563854e45965a1cc36ac54138 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b5e454d98894637b466ea27f1b647f9; no voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:54:49.395560 14748 raft_consensus.cc:3058] T 29f0695563854e45965a1cc36ac54138 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:49.395815 13562 leader_election.cc:304] T 6a82ea7078e344a497c34f932e139bcd P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b5e454d98894637b466ea27f1b647f9; no voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:54:49.396975 15123 raft_consensus.cc:2747] T 6a82ea7078e344a497c34f932e139bcd P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:54:49.398370 14748 raft_consensus.cc:2747] T 29f0695563854e45965a1cc36ac54138 P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:54:49.399821 13882 tablet_bootstrap.cc:492] T 4828280e6fec4338b35422917966ac8c P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:54:49.399948 13882 ts_tablet_manager.cc:1397] T 4828280e6fec4338b35422917966ac8c P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.037s user 0.009s sys 0.005s
I20250830 07:54:49.401078 13882 raft_consensus.cc:357] T 4828280e6fec4338b35422917966ac8c P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:49.408879 13882 raft_consensus.cc:383] T 4828280e6fec4338b35422917966ac8c P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:49.409029 13882 raft_consensus.cc:738] T 4828280e6fec4338b35422917966ac8c P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:54:49.409394 13882 consensus_queue.cc:260] T 4828280e6fec4338b35422917966ac8c P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:49.410416 13882 ts_tablet_manager.cc:1428] T 4828280e6fec4338b35422917966ac8c P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.010s user 0.001s sys 0.002s
I20250830 07:54:49.410844 13882 tablet_bootstrap.cc:492] T d6afa1ad4791429ba96ee81583dcee64 P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
W20250830 07:54:49.413942 13233 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet fbb1cc8f8eea4a0795f6f8e213b8180f consensus state has no leader
I20250830 07:54:49.414304 13233 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_2631f1f3da404c52b362b8093acbf4a9" } modify_external_catalogs: true
I20250830 07:54:49.414471 13233 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_2631f1f3da404c52b362b8093acbf4a9" } modify_external_catalogs: true
I20250830 07:54:49.415633 13229 catalog_manager.cc:5864] Not sending DeleteTablet requests; no consensus state for tablet d38f2ba1ef2643499a086291c5eaa1a4
I20250830 07:54:49.415817 13229 master_service.cc:948] ReplaceTablet: received request to replace tablet 3f70097c1b3a48dfbc1ad129fa7a3730 from {username='slave'} at 127.0.0.1:42126
I20250830 07:54:49.416271 13229 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_65886201d1784503987a2258f7c62a85" } modify_external_catalogs: true
I20250830 07:54:49.416409 13229 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_65886201d1784503987a2258f7c62a85" } modify_external_catalogs: true
I20250830 07:54:49.417285 15009 raft_consensus.cc:491] T 43e93d3038f7496ebb18319420ab67e0 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:49.417397 15009 raft_consensus.cc:513] T 43e93d3038f7496ebb18319420ab67e0 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
W20250830 07:54:49.417464 13234 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f5baa35307a1425c8d52666d130d6d8a consensus state has no leader
I20250830 07:54:49.417793 13234 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_e79515802e1547b482585de9a1742c33"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250830 07:54:49.417969 15009 leader_election.cc:290] T 43e93d3038f7496ebb18319420ab67e0 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
W20250830 07:54:49.418332 13234 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e79515802e1547b482585de9a1742c33 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:49.418372 13764 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "43e93d3038f7496ebb18319420ab67e0" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
W20250830 07:54:49.418820 13422 leader_election.cc:343] T 43e93d3038f7496ebb18319420ab67e0 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:49.419472 13231 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet 8dddcfe56522436287aea212e316a729
I20250830 07:54:49.420111 13231 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_1eb04793dbd7403bb844b59f901d9c94" } new_table_name: "default.Table_41ce7b564e1c4e19a5f705c818bb7d9f" modify_external_catalogs: true
I20250830 07:54:49.421751 13593 tablet_service.cc:1515] Processing DeleteTablet for tablet 8dddcfe56522436287aea212e316a729 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:49 UTC) from {username='slave'} at 127.0.0.1:45306
I20250830 07:54:49.421955 15047 tablet_replica.cc:331] T 8dddcfe56522436287aea212e316a729 P 6b5e454d98894637b466ea27f1b647f9: stopping tablet replica
I20250830 07:54:49.422119 15047 raft_consensus.cc:2241] T 8dddcfe56522436287aea212e316a729 P 6b5e454d98894637b466ea27f1b647f9 [term 1 LEADER]: Raft consensus shutting down.
I20250830 07:54:49.422385 15047 raft_consensus.cc:2270] T 8dddcfe56522436287aea212e316a729 P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250830 07:54:49.422837 15047 ts_tablet_manager.cc:1905] T 8dddcfe56522436287aea212e316a729 P 6b5e454d98894637b466ea27f1b647f9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250830 07:54:49.400729 13887 tablet_bootstrap.cc:492] T 410b1e2d520c470eb4b9ab60104e0cd4 P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:54:49.423808 13887 ts_tablet_manager.cc:1397] T 410b1e2d520c470eb4b9ab60104e0cd4 P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.087s user 0.003s sys 0.002s
I20250830 07:54:49.424057 13227 catalog_manager.cc:6127] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: default.Table_56e6d3dc00b343a386af2994a3d5d904 [id=dfa51a12131743428fa066bbe3b6982e] alter complete (version 2)
I20250830 07:54:49.424656 13227 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_f5eb564710b04449baf4886a4dbfeb8a" } modify_external_catalogs: true
I20250830 07:54:49.424824 13227 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_f5eb564710b04449baf4886a4dbfeb8a" } modify_external_catalogs: true
I20250830 07:54:49.425001 13887 raft_consensus.cc:357] T 410b1e2d520c470eb4b9ab60104e0cd4 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:49.425138 13887 raft_consensus.cc:383] T 410b1e2d520c470eb4b9ab60104e0cd4 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:49.425177 13887 raft_consensus.cc:738] T 410b1e2d520c470eb4b9ab60104e0cd4 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:54:49.427376 14943 consensus_queue.cc:1035] T 2b4ce50fbd26484faba3faa2ec5115c0 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:54:49.428578 13886 tablet_bootstrap.cc:492] T 4b403cadfb7b42f8896b2ee16b50ecb1 P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:54:49.428758 13886 ts_tablet_manager.cc:1397] T 4b403cadfb7b42f8896b2ee16b50ecb1 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.106s user 0.004s sys 0.003s
I20250830 07:54:49.429458 13886 raft_consensus.cc:357] T 4b403cadfb7b42f8896b2ee16b50ecb1 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:49.430102 13886 raft_consensus.cc:383] T 4b403cadfb7b42f8896b2ee16b50ecb1 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:49.430210 13886 raft_consensus.cc:738] T 4b403cadfb7b42f8896b2ee16b50ecb1 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:54:49.430496 13886 consensus_queue.cc:260] T 4b403cadfb7b42f8896b2ee16b50ecb1 P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:49.430985 13886 ts_tablet_manager.cc:1428] T 4b403cadfb7b42f8896b2ee16b50ecb1 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20250830 07:54:49.431288 13886 tablet_bootstrap.cc:492] T 74ea2298876a4066b297915c135d4618 P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:54:49.431429 15047 ts_tablet_manager.cc:1918] T 8dddcfe56522436287aea212e316a729 P 6b5e454d98894637b466ea27f1b647f9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250830 07:54:49.431536 15047 log.cc:1199] T 8dddcfe56522436287aea212e316a729 P 6b5e454d98894637b466ea27f1b647f9: Deleting WAL directory at /tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/ts-1/wal/wals/8dddcfe56522436287aea212e316a729
I20250830 07:54:49.431844 15047 ts_tablet_manager.cc:1939] T 8dddcfe56522436287aea212e316a729 P 6b5e454d98894637b466ea27f1b647f9: Deleting consensus metadata
I20250830 07:54:49.432301 13220 catalog_manager.cc:4928] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): tablet 8dddcfe56522436287aea212e316a729 (table default.Table_e0d2400861094b258fca0704d88ed743 [id=c483c08824f24586855e3575a590b294]) successfully deleted
I20250830 07:54:49.433813 13886 tablet_bootstrap.cc:654] T 74ea2298876a4066b297915c135d4618 P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
W20250830 07:54:49.436053 13562 leader_election.cc:343] T 69f2105c5eeb47e9a848ae7bf8779996 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Not found: Tablet not found: 69f2105c5eeb47e9a848ae7bf8779996
I20250830 07:54:49.436892 13562 leader_election.cc:304] T 69f2105c5eeb47e9a848ae7bf8779996 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b5e454d98894637b466ea27f1b647f9; no voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:54:49.437726 14748 raft_consensus.cc:2747] T 69f2105c5eeb47e9a848ae7bf8779996 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20250830 07:54:49.439581 13703 leader_election.cc:343] T 09586fdda94c4aff9d3fa25d71fe6ac0 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:49.443233 13230 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet 508d21af038c4801a9680ce275eb504c
I20250830 07:54:49.443646 13230 catalog_manager.cc:6652] ReplaceTablet: tablet 508d21af038c4801a9680ce275eb504c deleted and replaced by tablet d8dcdd2bd68e4f7f8d40fe9b6d9c2df2
W20250830 07:54:49.446573 13230 catalog_manager.cc:5415] Ignoring report from unknown tablet a41c1455404f4ed0a782a0c4ddd4140d
W20250830 07:54:49.446650 13230 catalog_manager.cc:5415] Ignoring report from unknown tablet b4ab964a64a64e00a78ffd2b220aef46
W20250830 07:54:49.446692 13230 catalog_manager.cc:5415] Ignoring report from unknown tablet 6a82ea7078e344a497c34f932e139bcd
W20250830 07:54:49.446743 13230 catalog_manager.cc:5415] Ignoring report from unknown tablet de3a52a8e08a45808373902a0185e6f0
I20250830 07:54:49.447336 13593 tablet_service.cc:1515] Processing DeleteTablet for tablet 508d21af038c4801a9680ce275eb504c with delete_type TABLET_DATA_DELETED (replaced by tablet d8dcdd2bd68e4f7f8d40fe9b6d9c2df2) from {username='slave'} at 127.0.0.1:45306
I20250830 07:54:49.450860 13230 catalog_manager.cc:5674] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325) does not have the latest schema for tablet 856e644662334f8194ffef6ca1232248 (table default.Table_5a48429e0b894a6ea2c01b3ce40de1e9 [id=fe3e5972240046eaa659a06b4eea8648]). Expected version 1 got 0
I20250830 07:54:49.451143 13230 catalog_manager.cc:5674] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325) does not have the latest schema for tablet d64f20df166a46249c08444f44422fc3 (table default.Table_bff4eb83b12a4825993387659d6b3428 [id=26a7abb1aee44e438ca996ebb2ab37b2]). Expected version 2 got 0
I20250830 07:54:49.452275 13230 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_9080042e085842df95abc5ce12a86850" } new_table_name: "default.Table_a89f904be3a4431bb8637b028cf258c9" modify_external_catalogs: true
W20250830 07:54:49.453843 13220 catalog_manager.cc:4908] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet 508d21af038c4801a9680ce275eb504c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 508d21af038c4801a9680ce275eb504c already in progress: creating tablet
W20250830 07:54:49.455214 13703 leader_election.cc:343] T 09586fdda94c4aff9d3fa25d71fe6ac0 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:49.457113 13882 tablet_bootstrap.cc:654] T d6afa1ad4791429ba96ee81583dcee64 P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
W20250830 07:54:49.458657 13423 leader_election.cc:343] T 0ceccc5f18294356894695fe08d73e30 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:49.458781 13423 leader_election.cc:304] T 0ceccc5f18294356894695fe08d73e30 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba; no voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f
W20250830 07:54:49.459362 13423 consensus_peers.cc:489] T 99f307a8cbb34addaafab82b3ed18241 P 2065c332f15a4739899af79f3669c3ba -> Peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Couldn't send request to peer 6b5e454d98894637b466ea27f1b647f9. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 99f307a8cbb34addaafab82b3ed18241. This is attempt 1: this message will repeat every 5th retry.
I20250830 07:54:49.459518 15115 raft_consensus.cc:2747] T 0ceccc5f18294356894695fe08d73e30 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:54:49.462081 13536 heartbeater.cc:344] Connected to a master server at 127.12.209.60:43889
I20250830 07:54:49.467012 15009 raft_consensus.cc:491] T 95b6f084eb5240ea94c125eaa154ac9f P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:49.467140 15009 raft_consensus.cc:513] T 95b6f084eb5240ea94c125eaa154ac9f P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:49.467491 13886 tablet_bootstrap.cc:492] T 74ea2298876a4066b297915c135d4618 P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:54:49.467756 15009 leader_election.cc:290] T 95b6f084eb5240ea94c125eaa154ac9f P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:49.468223 13766 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "95b6f084eb5240ea94c125eaa154ac9f" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
W20250830 07:54:49.469024 13422 leader_election.cc:343] T 95b6f084eb5240ea94c125eaa154ac9f P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:49.467708 13886 ts_tablet_manager.cc:1397] T 74ea2298876a4066b297915c135d4618 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.036s user 0.003s sys 0.003s
I20250830 07:54:49.469434 13820 heartbeater.cc:344] Connected to a master server at 127.12.209.60:43889
I20250830 07:54:49.470274 13886 raft_consensus.cc:357] T 74ea2298876a4066b297915c135d4618 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:49.470502 13886 raft_consensus.cc:383] T 74ea2298876a4066b297915c135d4618 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:49.470588 13886 raft_consensus.cc:738] T 74ea2298876a4066b297915c135d4618 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:54:49.470803 13886 consensus_queue.cc:260] T 74ea2298876a4066b297915c135d4618 P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:49.471329 13886 ts_tablet_manager.cc:1428] T 74ea2298876a4066b297915c135d4618 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20250830 07:54:49.471621 13886 tablet_bootstrap.cc:492] T 0ceccc5f18294356894695fe08d73e30 P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:54:49.471767 13887 consensus_queue.cc:260] T 410b1e2d520c470eb4b9ab60104e0cd4 P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:49.472501 13887 ts_tablet_manager.cc:1428] T 410b1e2d520c470eb4b9ab60104e0cd4 P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.049s user 0.001s sys 0.001s
I20250830 07:54:49.472951 13887 tablet_bootstrap.cc:492] T 713c12e1efec4e6f9895c65dc8a9c4b9 P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:54:49.473196 13886 tablet_bootstrap.cc:654] T 0ceccc5f18294356894695fe08d73e30 P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:49.478991 15009 raft_consensus.cc:491] T 519b3e58b63b402d84e234f5e180b98c P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:49.479125 15009 raft_consensus.cc:513] T 519b3e58b63b402d84e234f5e180b98c P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:49.479713 15009 leader_election.cc:290] T 519b3e58b63b402d84e234f5e180b98c P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:49.480144 13764 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "519b3e58b63b402d84e234f5e180b98c" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
W20250830 07:54:49.480602 13422 leader_election.cc:343] T 519b3e58b63b402d84e234f5e180b98c P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:49.493055 13624 raft_consensus.cc:3058] T a41c1455404f4ed0a782a0c4ddd4140d P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:49.494027 13615 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f52dd8eeb64a4b8a92babf34387b6c5b" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
W20250830 07:54:49.502554 13232 catalog_manager.cc:5415] Ignoring report from unknown tablet 2b4ce50fbd26484faba3faa2ec5115c0
I20250830 07:54:49.504988 13232 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_4cf8a9545bf849008cfb13c060b591ab"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:49.505501 13232 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4cf8a9545bf849008cfb13c060b591ab in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:49.508244 13886 tablet_bootstrap.cc:492] T 0ceccc5f18294356894695fe08d73e30 P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:54:49.509372 13887 tablet_bootstrap.cc:654] T 713c12e1efec4e6f9895c65dc8a9c4b9 P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:49.511407 13886 ts_tablet_manager.cc:1397] T 0ceccc5f18294356894695fe08d73e30 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.040s user 0.002s sys 0.001s
I20250830 07:54:49.512591 13886 raft_consensus.cc:357] T 0ceccc5f18294356894695fe08d73e30 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:49.512820 13886 raft_consensus.cc:383] T 0ceccc5f18294356894695fe08d73e30 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:49.512990 13886 raft_consensus.cc:738] T 0ceccc5f18294356894695fe08d73e30 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:54:49.513289 13886 consensus_queue.cc:260] T 0ceccc5f18294356894695fe08d73e30 P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:49.513831 13886 ts_tablet_manager.cc:1428] T 0ceccc5f18294356894695fe08d73e30 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20250830 07:54:49.514242 13886 tablet_bootstrap.cc:492] T 8ae468b43b4c450ca7591b543c2539d9 P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:54:49.515328 15199 sys_catalog.cc:263] Verifying existing consensus state
I20250830 07:54:49.516124 13886 tablet_bootstrap.cc:654] T 8ae468b43b4c450ca7591b543c2539d9 P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:49.520443 13624 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "95b6f084eb5240ea94c125eaa154ac9f" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:49.519984 13622 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "43e93d3038f7496ebb18319420ab67e0" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:49.522691 13614 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "519b3e58b63b402d84e234f5e180b98c" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:49.522931 13615 raft_consensus.cc:3058] T 2b4ce50fbd26484faba3faa2ec5115c0 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Advancing to term 1
W20250830 07:54:49.523099 13703 consensus_peers.cc:489] T 51cee993ce4249c0830b29cb1808fe80 P 9b057ade5dce45af9f8bf0bedf8b917f -> Peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Couldn't send request to peer 6b5e454d98894637b466ea27f1b647f9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20250830 07:54:49.523422 13703 leader_election.cc:343] T f52dd8eeb64a4b8a92babf34387b6c5b P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:49.523511 13703 leader_election.cc:304] T f52dd8eeb64a4b8a92babf34387b6c5b P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 2065c332f15a4739899af79f3669c3ba, 6b5e454d98894637b466ea27f1b647f9
I20250830 07:54:49.523687 14943 raft_consensus.cc:2747] T f52dd8eeb64a4b8a92babf34387b6c5b P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:54:49.524667 14943 consensus_queue.cc:1035] T a41c1455404f4ed0a782a0c4ddd4140d P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20250830 07:54:49.528800 13423 leader_election.cc:343] T 95b6f084eb5240ea94c125eaa154ac9f P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:49.528906 13423 leader_election.cc:304] T 95b6f084eb5240ea94c125eaa154ac9f P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba; no voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:54:49.529271 15009 raft_consensus.cc:2747] T 95b6f084eb5240ea94c125eaa154ac9f P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20250830 07:54:49.530234 13423 leader_election.cc:343] T 43e93d3038f7496ebb18319420ab67e0 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:49.530356 13423 leader_election.cc:304] T 43e93d3038f7496ebb18319420ab67e0 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba; no voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f
W20250830 07:54:49.530682 13423 leader_election.cc:343] T 519b3e58b63b402d84e234f5e180b98c P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:49.530758 13423 leader_election.cc:304] T 519b3e58b63b402d84e234f5e180b98c P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba; no voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:54:49.531045 15115 raft_consensus.cc:2747] T 43e93d3038f7496ebb18319420ab67e0 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:54:49.531164 15115 raft_consensus.cc:2747] T 519b3e58b63b402d84e234f5e180b98c P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:54:49.531567 13882 tablet_bootstrap.cc:492] T d6afa1ad4791429ba96ee81583dcee64 P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:54:49.531778 13882 ts_tablet_manager.cc:1397] T d6afa1ad4791429ba96ee81583dcee64 P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.121s user 0.002s sys 0.002s
I20250830 07:54:49.532764 13882 raft_consensus.cc:357] T d6afa1ad4791429ba96ee81583dcee64 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:49.533005 13882 raft_consensus.cc:383] T d6afa1ad4791429ba96ee81583dcee64 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:49.533128 13882 raft_consensus.cc:738] T d6afa1ad4791429ba96ee81583dcee64 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:54:49.533428 13882 consensus_queue.cc:260] T d6afa1ad4791429ba96ee81583dcee64 P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:49.536185 13882 ts_tablet_manager.cc:1428] T d6afa1ad4791429ba96ee81583dcee64 P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20250830 07:54:49.542197 14748 raft_consensus.cc:491] T 4c4a8eea119044b49e2b29f10a703097 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:49.541940 13882 tablet_bootstrap.cc:492] T 66d59910b4b2451a851e9d2728d50f42 P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:54:49.542308 14748 raft_consensus.cc:513] T 4c4a8eea119044b49e2b29f10a703097 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:49.542842 14748 leader_election.cc:290] T 4c4a8eea119044b49e2b29f10a703097 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:49.543201 13480 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "4c4a8eea119044b49e2b29f10a703097" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:54:49.543602 13480 raft_consensus.cc:2391] T 4c4a8eea119044b49e2b29f10a703097 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b5e454d98894637b466ea27f1b647f9 in current term 1: Already voted for candidate 9b057ade5dce45af9f8bf0bedf8b917f in this term.
I20250830 07:54:49.547434 14943 consensus_queue.cc:1035] T 2b4ce50fbd26484faba3faa2ec5115c0 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:54:49.549638 13764 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "4c4a8eea119044b49e2b29f10a703097" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:49.555253 13622 raft_consensus.cc:3058] T 44313f1a11b74e6d996cafd3c03d1836 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:49.556480 14943 consensus_queue.cc:1035] T 29f0695563854e45965a1cc36ac54138 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:54:49.557878 14943 consensus_queue.cc:1035] T d6afa1ad4791429ba96ee81583dcee64 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:54:49.558648 13882 tablet_bootstrap.cc:654] T 66d59910b4b2451a851e9d2728d50f42 P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:49.558797 13562 leader_election.cc:304] T 4c4a8eea119044b49e2b29f10a703097 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b5e454d98894637b466ea27f1b647f9; no voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:54:49.560233 15123 raft_consensus.cc:3058] T 4c4a8eea119044b49e2b29f10a703097 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:49.564558 13674 heartbeater.cc:344] Connected to a master server at 127.12.209.60:43889
I20250830 07:54:49.571302 15123 raft_consensus.cc:2747] T 4c4a8eea119044b49e2b29f10a703097 P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:54:49.572088 15091 consensus_queue.cc:1035] T 44313f1a11b74e6d996cafd3c03d1836 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:54:49.586473 15123 raft_consensus.cc:491] T 8eb010d7955d47a89ff1d01be1b5b01e P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:49.586616 14943 consensus_queue.cc:1035] T 4c4a8eea119044b49e2b29f10a703097 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:54:49.586643 15123 raft_consensus.cc:513] T 8eb010d7955d47a89ff1d01be1b5b01e P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
W20250830 07:54:49.588378 13228 catalog_manager.cc:5415] Ignoring report from unknown tablet 2b4ce50fbd26484faba3faa2ec5115c0
W20250830 07:54:49.588505 13228 catalog_manager.cc:5415] Ignoring report from unknown tablet 74ea2298876a4066b297915c135d4618
I20250830 07:54:49.589285 15123 leader_election.cc:290] T 8eb010d7955d47a89ff1d01be1b5b01e P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
W20250830 07:54:49.591562 13228 catalog_manager.cc:5415] Ignoring report from unknown tablet 6a82ea7078e344a497c34f932e139bcd
W20250830 07:54:49.591677 13228 catalog_manager.cc:5415] Ignoring report from unknown tablet ff0f9cccc8ed43b1a8cd38de0e9d4097
W20250830 07:54:49.597519 13561 leader_election.cc:343] T 8eb010d7955d47a89ff1d01be1b5b01e P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): Not found: Tablet not found: 8eb010d7955d47a89ff1d01be1b5b01e
W20250830 07:54:49.599581 13228 catalog_manager.cc:5415] Ignoring report from unknown tablet e66e56ecdf14466282daab8c894eb3c6
W20250830 07:54:49.599756 13228 catalog_manager.cc:5415] Ignoring report from unknown tablet e255d3fdee09400ead41ca835d6d103f
W20250830 07:54:49.599843 13228 catalog_manager.cc:5415] Ignoring report from unknown tablet 4b403cadfb7b42f8896b2ee16b50ecb1
W20250830 07:54:49.599911 13228 catalog_manager.cc:5415] Ignoring report from unknown tablet a41c1455404f4ed0a782a0c4ddd4140d
W20250830 07:54:49.599987 13228 catalog_manager.cc:5415] Ignoring report from unknown tablet b83dfc54383d4e7b96523568aea5c9f3
W20250830 07:54:49.600051 13228 catalog_manager.cc:5415] Ignoring report from unknown tablet f398e12cd9f543738d5163354f8a9d9d
I20250830 07:54:49.600731 13228 catalog_manager.cc:5674] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743) does not have the latest schema for tablet 856e644662334f8194ffef6ca1232248 (table default.Table_5a48429e0b894a6ea2c01b3ce40de1e9 [id=fe3e5972240046eaa659a06b4eea8648]). Expected version 1 got 0
I20250830 07:54:49.602257 13229 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet 439fc51afa6b435e81bc38b9e88d4041
I20250830 07:54:49.603668 13233 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet 7f749e9eb58b44408d70a5461f10a3ef
I20250830 07:54:49.604861 13225 master_service.cc:948] ReplaceTablet: received request to replace tablet 3f70097c1b3a48dfbc1ad129fa7a3730 from {username='slave'} at 127.0.0.1:42126
I20250830 07:54:49.605808 13593 tablet_service.cc:1515] Processing DeleteTablet for tablet 439fc51afa6b435e81bc38b9e88d4041 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:49 UTC) from {username='slave'} at 127.0.0.1:45306
I20250830 07:54:49.606005 13602 tablet_service.cc:1515] Processing DeleteTablet for tablet 7f749e9eb58b44408d70a5461f10a3ef with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:49 UTC) from {username='slave'} at 127.0.0.1:45306
W20250830 07:54:49.607750 13220 catalog_manager.cc:4908] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet 439fc51afa6b435e81bc38b9e88d4041 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 439fc51afa6b435e81bc38b9e88d4041 already in progress: creating tablet
W20250830 07:54:49.608026 13220 catalog_manager.cc:4908] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet 7f749e9eb58b44408d70a5461f10a3ef because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7f749e9eb58b44408d70a5461f10a3ef already in progress: creating tablet
I20250830 07:54:49.611521 13233 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_711aaf9b9ba04df6b8a5fc206b66808e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:49.612161 13233 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_711aaf9b9ba04df6b8a5fc206b66808e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:49.613937 13225 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_19d3d6b48111403bae7cccc4680b9333"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:49.614439 13225 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_19d3d6b48111403bae7cccc4680b9333 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:49.614583 13234 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_842d6de7e7c24438af9d52c6f779b657" } new_table_name: "default.Table_0130f2afc22a48e39d534d4fd584b1c2" modify_external_catalogs: true
I20250830 07:54:49.615108 13886 tablet_bootstrap.cc:492] T 8ae468b43b4c450ca7591b543c2539d9 P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:54:49.615242 13886 ts_tablet_manager.cc:1397] T 8ae468b43b4c450ca7591b543c2539d9 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.101s user 0.036s sys 0.041s
I20250830 07:54:49.616068 13886 raft_consensus.cc:357] T 8ae468b43b4c450ca7591b543c2539d9 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:49.616259 13886 raft_consensus.cc:383] T 8ae468b43b4c450ca7591b543c2539d9 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:49.616312 13886 raft_consensus.cc:738] T 8ae468b43b4c450ca7591b543c2539d9 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:54:49.616494 13886 consensus_queue.cc:260] T 8ae468b43b4c450ca7591b543c2539d9 P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:49.616984 13886 ts_tablet_manager.cc:1428] T 8ae468b43b4c450ca7591b543c2539d9 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
W20250830 07:54:49.617967 13229 catalog_manager.cc:5415] Ignoring report from unknown tablet 2b4ce50fbd26484faba3faa2ec5115c0
I20250830 07:54:49.618304 13229 catalog_manager.cc:5674] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325) does not have the latest schema for tablet 410b1e2d520c470eb4b9ab60104e0cd4 (table default.Table_98c8314f6ad34324b9f857226d762d7d [id=6a8f7192d53441c383824fb67bed40df]). Expected version 1 got 0
W20250830 07:54:49.619426 13231 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 931331f570474f87a6d8d14d3a41a4a7 has no consensus state
I20250830 07:54:49.619725 13231 master_service.cc:948] ReplaceTablet: received request to replace tablet 94e28f0788664448b53edb5240a4a4b6 from {username='slave'} at 127.0.0.1:42126
I20250830 07:54:49.621737 13887 tablet_bootstrap.cc:492] T 713c12e1efec4e6f9895c65dc8a9c4b9 P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:54:49.622289 15091 consensus_queue.cc:1035] T 4828280e6fec4338b35422917966ac8c P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:54:49.622546 13887 ts_tablet_manager.cc:1397] T 713c12e1efec4e6f9895c65dc8a9c4b9 P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.150s user 0.001s sys 0.009s
I20250830 07:54:49.626175 14943 consensus_queue.cc:1035] T 44313f1a11b74e6d996cafd3c03d1836 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:54:49.628291 13229 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_a9255cc2802f4a0db6639529a552e6e3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:49.630820 13229 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a9255cc2802f4a0db6639529a552e6e3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250830 07:54:49.630497 13228 catalog_manager.cc:5415] Ignoring report from unknown tablet 1fa571e9490e499792225d7b786e8658
I20250830 07:54:49.631305 13228 catalog_manager.cc:5674] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743) does not have the latest schema for tablet 0ceccc5f18294356894695fe08d73e30 (table default.Table_32d032fe8fba47348e797c68bb7ea866 [id=0e99ba575a7a4f8dae74a98627249018]). Expected version 1 got 0
I20250830 07:54:49.632943 13228 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_150ed68c3f1649b0b86fa3be5d799676"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:49.633505 13228 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_150ed68c3f1649b0b86fa3be5d799676 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:49.637207 15199 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3ea183a890b84f408b20b55e9eb7c7ed: Bootstrap starting.
I20250830 07:54:49.639017 13629 raft_consensus.cc:3058] T d6afa1ad4791429ba96ee81583dcee64 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:49.641943 14943 consensus_queue.cc:1035] T d6afa1ad4791429ba96ee81583dcee64 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20250830 07:54:49.646957 13230 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 05b403cedce64513b858b760d15a0e8f consensus state has no leader
I20250830 07:54:49.647207 13230 master_service.cc:948] ReplaceTablet: received request to replace tablet 796e01f6a36241fc94e335253929d6ab from {username='slave'} at 127.0.0.1:42126
I20250830 07:54:49.648602 13227 catalog_manager.cc:5864] Not sending DeleteTablet requests; no consensus state for tablet 569d4ba62c044ac297ad12ddd9b44dd1
I20250830 07:54:49.651561 13887 raft_consensus.cc:357] T 713c12e1efec4e6f9895c65dc8a9c4b9 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:49.651722 13887 raft_consensus.cc:383] T 713c12e1efec4e6f9895c65dc8a9c4b9 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:49.651767 13887 raft_consensus.cc:738] T 713c12e1efec4e6f9895c65dc8a9c4b9 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:54:49.651942 13887 consensus_queue.cc:260] T 713c12e1efec4e6f9895c65dc8a9c4b9 P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:49.652455 13887 ts_tablet_manager.cc:1428] T 713c12e1efec4e6f9895c65dc8a9c4b9 P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.030s user 0.001s sys 0.000s
I20250830 07:54:49.652889 13886 tablet_bootstrap.cc:492] T d206f6b6e7524a27a9f95787bcd5de77 P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:54:49.654698 13886 tablet_bootstrap.cc:654] T d206f6b6e7524a27a9f95787bcd5de77 P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:49.655575 13766 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "8eb010d7955d47a89ff1d01be1b5b01e" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:49.655732 13766 raft_consensus.cc:2466] T 8eb010d7955d47a89ff1d01be1b5b01e P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b5e454d98894637b466ea27f1b647f9 in term 0.
W20250830 07:54:49.665160 13234 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 2c4c3c61cddf42668d3a09f4fbc5f641 consensus state has no leader
I20250830 07:54:49.670212 13887 tablet_bootstrap.cc:492] T 9ffa3c1d128c49c8b8e2566c6a64304a P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:54:49.672197 13887 tablet_bootstrap.cc:654] T 9ffa3c1d128c49c8b8e2566c6a64304a P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:49.674494 13882 tablet_bootstrap.cc:492] T 66d59910b4b2451a851e9d2728d50f42 P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:54:49.675925 13882 ts_tablet_manager.cc:1397] T 66d59910b4b2451a851e9d2728d50f42 P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.135s user 0.005s sys 0.005s
I20250830 07:54:49.675958 14975 consensus_queue.cc:1035] T 29f0695563854e45965a1cc36ac54138 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:54:49.676949 13882 raft_consensus.cc:357] T 66d59910b4b2451a851e9d2728d50f42 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:49.677285 13231 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet 94e28f0788664448b53edb5240a4a4b6
I20250830 07:54:49.677801 13231 catalog_manager.cc:6652] ReplaceTablet: tablet 94e28f0788664448b53edb5240a4a4b6 deleted and replaced by tablet a1a275aa324f43cc9e362843d087e303
I20250830 07:54:49.677925 13602 tablet_service.cc:1515] Processing DeleteTablet for tablet 94e28f0788664448b53edb5240a4a4b6 with delete_type TABLET_DATA_DELETED (replaced by tablet a1a275aa324f43cc9e362843d087e303) from {username='slave'} at 127.0.0.1:45306
I20250830 07:54:49.678650 13882 raft_consensus.cc:383] T 66d59910b4b2451a851e9d2728d50f42 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:49.678709 13882 raft_consensus.cc:738] T 66d59910b4b2451a851e9d2728d50f42 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
W20250830 07:54:49.679144 13220 catalog_manager.cc:4908] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet 94e28f0788664448b53edb5240a4a4b6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 94e28f0788664448b53edb5240a4a4b6 already in progress: creating tablet
I20250830 07:54:49.679253 13882 consensus_queue.cc:260] T 66d59910b4b2451a851e9d2728d50f42 P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:49.681841 13882 ts_tablet_manager.cc:1428] T 66d59910b4b2451a851e9d2728d50f42 P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.005s user 0.000s sys 0.001s
I20250830 07:54:49.682117 13882 tablet_bootstrap.cc:492] T e4ca3110247640fbae4241448e8d5ef7 P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:54:49.685117 15091 raft_consensus.cc:491] T 65f1ee59e6e9498381d686f16a865e23 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:49.685288 15091 raft_consensus.cc:513] T 65f1ee59e6e9498381d686f16a865e23 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:49.685882 15091 leader_election.cc:290] T 65f1ee59e6e9498381d686f16a865e23 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967)
W20250830 07:54:49.687834 13701 leader_election.cc:343] T 65f1ee59e6e9498381d686f16a865e23 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): Not found: Tablet not found: 65f1ee59e6e9498381d686f16a865e23
I20250830 07:54:49.694415 13234 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_3f04b91e6a2942ebaaa5ce385e4c0c5f" } new_table_name: "default.Table_14f77b00de274b208bc290bf03dc0254" modify_external_catalogs: true
I20250830 07:54:49.696131 13227 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_9c669dbd103142f5811e5b8dd54acae8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250830 07:54:49.696305 13232 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_f9c7bbd999bd4bfbb0ce5579b195c8db"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250830 07:54:49.696679 13233 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_a06255e12ba34102829a4d538de92121" } new_table_name: "default.Table_206820706e8d4e7da43cd57807233344" modify_external_catalogs: true
I20250830 07:54:49.697876 13225 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_d72b020da8b34ec291b8c8dcd8e0d459" } modify_external_catalogs: true
I20250830 07:54:49.698028 13225 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_d72b020da8b34ec291b8c8dcd8e0d459" } modify_external_catalogs: true
W20250830 07:54:49.698943 13231 catalog_manager.cc:5415] Ignoring report from unknown tablet 4c4a8eea119044b49e2b29f10a703097
I20250830 07:54:49.700184 13231 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_6fe6d8fe98fb48218cef68475a6faeb9" } modify_external_catalogs: true
W20250830 07:54:49.700418 13227 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9c669dbd103142f5811e5b8dd54acae8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250830 07:54:49.700465 13232 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f9c7bbd999bd4bfbb0ce5579b195c8db in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:49.702929 13231 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_6fe6d8fe98fb48218cef68475a6faeb9" } modify_external_catalogs: true
I20250830 07:54:49.704527 13887 tablet_bootstrap.cc:492] T 9ffa3c1d128c49c8b8e2566c6a64304a P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:54:49.704946 13887 ts_tablet_manager.cc:1397] T 9ffa3c1d128c49c8b8e2566c6a64304a P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.035s user 0.004s sys 0.000s
W20250830 07:54:49.708596 13229 catalog_manager.cc:5415] Ignoring report from unknown tablet 44313f1a11b74e6d996cafd3c03d1836
W20250830 07:54:49.708781 13229 catalog_manager.cc:5415] Ignoring report from unknown tablet 8ae468b43b4c450ca7591b543c2539d9
I20250830 07:54:49.712627 13887 raft_consensus.cc:357] T 9ffa3c1d128c49c8b8e2566c6a64304a P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:49.722744 13887 raft_consensus.cc:383] T 9ffa3c1d128c49c8b8e2566c6a64304a P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:49.722950 13887 raft_consensus.cc:738] T 9ffa3c1d128c49c8b8e2566c6a64304a P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:54:49.723757 13887 consensus_queue.cc:260] T 9ffa3c1d128c49c8b8e2566c6a64304a P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:49.724820 13887 ts_tablet_manager.cc:1428] T 9ffa3c1d128c49c8b8e2566c6a64304a P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.017s user 0.002s sys 0.000s
I20250830 07:54:49.727226 13887 tablet_bootstrap.cc:492] T 042fd7ff08fc4695b87bb8f9d225ef12 P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:54:49.727649 13886 tablet_bootstrap.cc:492] T d206f6b6e7524a27a9f95787bcd5de77 P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:54:49.728582 13886 ts_tablet_manager.cc:1397] T d206f6b6e7524a27a9f95787bcd5de77 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.076s user 0.004s sys 0.003s
W20250830 07:54:49.734289 13229 catalog_manager.cc:5415] Ignoring report from unknown tablet f398e12cd9f543738d5163354f8a9d9d
W20250830 07:54:49.734366 13229 catalog_manager.cc:5415] Ignoring report from unknown tablet 4c4a8eea119044b49e2b29f10a703097
W20250830 07:54:49.734452 13229 catalog_manager.cc:5415] Ignoring report from unknown tablet 8ae468b43b4c450ca7591b543c2539d9
I20250830 07:54:49.735143 13886 raft_consensus.cc:357] T d206f6b6e7524a27a9f95787bcd5de77 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:49.740172 13887 tablet_bootstrap.cc:654] T 042fd7ff08fc4695b87bb8f9d225ef12 P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:49.745167 13228 catalog_manager.cc:5674] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743) does not have the latest schema for tablet 29f0695563854e45965a1cc36ac54138 (table default.Table_e40b329adbd0475da2669620084f75f3 [id=7d0a5ef4aaf64241be34eba188f2cbcd]). Expected version 2 got 0
I20250830 07:54:49.743767 15091 raft_consensus.cc:491] T 4b403cadfb7b42f8896b2ee16b50ecb1 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:49.746762 15091 raft_consensus.cc:513] T 4b403cadfb7b42f8896b2ee16b50ecb1 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:49.747324 15091 leader_election.cc:290] T 4b403cadfb7b42f8896b2ee16b50ecb1 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967)
I20250830 07:54:49.751262 13625 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "4b403cadfb7b42f8896b2ee16b50ecb1" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:49.751616 13562 leader_election.cc:304] T 8eb010d7955d47a89ff1d01be1b5b01e P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 2065c332f15a4739899af79f3669c3ba
I20250830 07:54:49.751947 15123 raft_consensus.cc:2802] T 8eb010d7955d47a89ff1d01be1b5b01e P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:54:49.752023 15123 raft_consensus.cc:491] T 8eb010d7955d47a89ff1d01be1b5b01e P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:54:49.752087 15123 raft_consensus.cc:3058] T 8eb010d7955d47a89ff1d01be1b5b01e P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:49.753193 13624 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "65f1ee59e6e9498381d686f16a865e23" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
W20250830 07:54:49.754113 13221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.209.62:39725, user_credentials={real_user=slave}} blocked reactor thread for 96478.1us
I20250830 07:54:49.757421 14943 consensus_queue.cc:1035] T ec4a3975961d4f85ad9da94835417574 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:54:49.762598 13882 tablet_bootstrap.cc:654] T e4ca3110247640fbae4241448e8d5ef7 P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:49.762842 13228 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_23a80551e20d428a8445437be69cffb5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:49.763383 13228 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_23a80551e20d428a8445437be69cffb5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:49.764406 15123 raft_consensus.cc:513] T 8eb010d7955d47a89ff1d01be1b5b01e P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:49.764468 13486 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "4b403cadfb7b42f8896b2ee16b50ecb1" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:54:49.764617 13486 raft_consensus.cc:2466] T 4b403cadfb7b42f8896b2ee16b50ecb1 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 0.
I20250830 07:54:49.764914 15123 leader_election.cc:290] T 8eb010d7955d47a89ff1d01be1b5b01e P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 election: Requested vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:49.764987 13701 leader_election.cc:304] T 4b403cadfb7b42f8896b2ee16b50ecb1 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters:
I20250830 07:54:49.765441 14972 raft_consensus.cc:2802] T 4b403cadfb7b42f8896b2ee16b50ecb1 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:54:49.765525 14972 raft_consensus.cc:491] T 4b403cadfb7b42f8896b2ee16b50ecb1 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:54:49.765583 14972 raft_consensus.cc:3058] T 4b403cadfb7b42f8896b2ee16b50ecb1 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
W20250830 07:54:49.765617 13561 leader_election.cc:343] T 8eb010d7955d47a89ff1d01be1b5b01e P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): Not found: Tablet not found: 8eb010d7955d47a89ff1d01be1b5b01e
I20250830 07:54:49.767952 14972 raft_consensus.cc:513] T 4b403cadfb7b42f8896b2ee16b50ecb1 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:49.768627 14972 leader_election.cc:290] T 4b403cadfb7b42f8896b2ee16b50ecb1 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Requested vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967)
I20250830 07:54:49.770503 13486 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "4b403cadfb7b42f8896b2ee16b50ecb1" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba"
I20250830 07:54:49.770635 13486 raft_consensus.cc:3058] T 4b403cadfb7b42f8896b2ee16b50ecb1 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:49.770612 14975 consensus_queue.cc:1035] T 13df49c2c2cd4e5cae26a540835b74c9 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20250830 07:54:49.774539 13234 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 6d2670e19bc042e7b62d9670df38525e has no consensus state
W20250830 07:54:49.775398 13233 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 67dacf9f69ee45eda614cac0bf22beeb has no consensus state
I20250830 07:54:49.775720 13225 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet 76dd9dd481fc427fb20f5091e4a3b738
I20250830 07:54:49.775997 13230 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet 796e01f6a36241fc94e335253929d6ab
I20250830 07:54:49.776744 13602 tablet_service.cc:1515] Processing DeleteTablet for tablet 796e01f6a36241fc94e335253929d6ab with delete_type TABLET_DATA_DELETED (replaced by tablet f68df2bd098542a6a60028194cc2283e) from {username='slave'} at 127.0.0.1:45306
I20250830 07:54:49.777118 13486 raft_consensus.cc:2466] T 4b403cadfb7b42f8896b2ee16b50ecb1 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 1.
I20250830 07:54:49.777354 15123 raft_consensus.cc:491] T 66d59910b4b2451a851e9d2728d50f42 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:49.777490 13701 leader_election.cc:304] T 4b403cadfb7b42f8896b2ee16b50ecb1 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters:
I20250830 07:54:49.777493 15123 raft_consensus.cc:513] T 66d59910b4b2451a851e9d2728d50f42 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:49.777740 14975 raft_consensus.cc:2802] T 4b403cadfb7b42f8896b2ee16b50ecb1 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election won for term 1
I20250830 07:54:49.777855 14975 raft_consensus.cc:695] T 4b403cadfb7b42f8896b2ee16b50ecb1 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 LEADER]: Becoming Leader. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Running, Role: LEADER
I20250830 07:54:49.778110 15123 leader_election.cc:290] T 66d59910b4b2451a851e9d2728d50f42 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:49.778079 14975 consensus_queue.cc:237] T 4b403cadfb7b42f8896b2ee16b50ecb1 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:49.778576 13230 catalog_manager.cc:6652] ReplaceTablet: tablet 796e01f6a36241fc94e335253929d6ab deleted and replaced by tablet f68df2bd098542a6a60028194cc2283e
W20250830 07:54:49.778978 13220 catalog_manager.cc:4908] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet 796e01f6a36241fc94e335253929d6ab because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 796e01f6a36241fc94e335253929d6ab already in progress: creating tablet
I20250830 07:54:49.779501 13486 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "66d59910b4b2451a851e9d2728d50f42" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:54:49.779547 13602 tablet_service.cc:1515] Processing DeleteTablet for tablet 76dd9dd481fc427fb20f5091e4a3b738 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:49 UTC) from {username='slave'} at 127.0.0.1:45306
W20250830 07:54:49.780975 13220 catalog_manager.cc:4908] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet 76dd9dd481fc427fb20f5091e4a3b738 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 76dd9dd481fc427fb20f5091e4a3b738 already in progress: creating tablet
I20250830 07:54:49.785552 13231 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet 62ee2d0fbd774d38a4a4c4a033584ef9
I20250830 07:54:49.786391 13602 tablet_service.cc:1515] Processing DeleteTablet for tablet 62ee2d0fbd774d38a4a4c4a033584ef9 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:49 UTC) from {username='slave'} at 127.0.0.1:45306
I20250830 07:54:49.786585 15047 tablet_replica.cc:331] T 62ee2d0fbd774d38a4a4c4a033584ef9 P 6b5e454d98894637b466ea27f1b647f9: stopping tablet replica
I20250830 07:54:49.786767 15047 raft_consensus.cc:2241] T 62ee2d0fbd774d38a4a4c4a033584ef9 P 6b5e454d98894637b466ea27f1b647f9 [term 1 LEADER]: Raft consensus shutting down.
I20250830 07:54:49.787072 15047 raft_consensus.cc:2270] T 62ee2d0fbd774d38a4a4c4a033584ef9 P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250830 07:54:49.787583 15047 ts_tablet_manager.cc:1905] T 62ee2d0fbd774d38a4a4c4a033584ef9 P 6b5e454d98894637b466ea27f1b647f9: Deleting tablet data with delete state TABLET_DATA_DELETED
W20250830 07:54:49.789906 13229 catalog_manager.cc:5415] Ignoring report from unknown tablet 533811110191436d96665b3475ab597f
W20250830 07:54:49.792383 13229 catalog_manager.cc:5415] Ignoring report from unknown tablet e862fa77e16945bd94e405aa3474f021
W20250830 07:54:49.794011 13229 catalog_manager.cc:5415] Ignoring report from unknown tablet 44313f1a11b74e6d996cafd3c03d1836
I20250830 07:54:49.794314 15047 ts_tablet_manager.cc:1918] T 62ee2d0fbd774d38a4a4c4a033584ef9 P 6b5e454d98894637b466ea27f1b647f9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250830 07:54:49.794399 15047 log.cc:1199] T 62ee2d0fbd774d38a4a4c4a033584ef9 P 6b5e454d98894637b466ea27f1b647f9: Deleting WAL directory at /tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/ts-1/wal/wals/62ee2d0fbd774d38a4a4c4a033584ef9
I20250830 07:54:49.794838 15047 ts_tablet_manager.cc:1939] T 62ee2d0fbd774d38a4a4c4a033584ef9 P 6b5e454d98894637b466ea27f1b647f9: Deleting consensus metadata
I20250830 07:54:49.795415 13220 catalog_manager.cc:4928] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): tablet 62ee2d0fbd774d38a4a4c4a033584ef9 (table default.Table_6fe6d8fe98fb48218cef68475a6faeb9 [id=b6be55a64bca43c0bbab359694f0bcf6]) successfully deleted
W20250830 07:54:49.795235 13229 catalog_manager.cc:5415] Ignoring report from unknown tablet 4828280e6fec4338b35422917966ac8c
W20250830 07:54:49.796118 13229 catalog_manager.cc:5415] Ignoring report from unknown tablet 4c4a8eea119044b49e2b29f10a703097
W20250830 07:54:49.799067 13562 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.209.3:38743, user_credentials={real_user=slave}} blocked reactor thread for 45207.4us
I20250830 07:54:49.735980 13886 raft_consensus.cc:383] T d206f6b6e7524a27a9f95787bcd5de77 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:49.803890 13229 catalog_manager.cc:5674] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325) does not have the latest schema for tablet 713c12e1efec4e6f9895c65dc8a9c4b9 (table default.Table_a5f97c309511426b8824d523c216bd7d [id=5f77c407feff41a7ab7089ab43413032]). Expected version 3 got 0
I20250830 07:54:49.806659 14748 raft_consensus.cc:491] T 4828280e6fec4338b35422917966ac8c P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:49.806766 14748 raft_consensus.cc:513] T 4828280e6fec4338b35422917966ac8c P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:49.805333 13229 catalog_manager.cc:5674] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325) does not have the latest schema for tablet 29f0695563854e45965a1cc36ac54138 (table default.Table_e40b329adbd0475da2669620084f75f3 [id=7d0a5ef4aaf64241be34eba188f2cbcd]). Expected version 2 got 0
I20250830 07:54:49.807381 13887 tablet_bootstrap.cc:492] T 042fd7ff08fc4695b87bb8f9d225ef12 P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:54:49.807367 14748 leader_election.cc:290] T 4828280e6fec4338b35422917966ac8c P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:49.807556 13887 ts_tablet_manager.cc:1397] T 042fd7ff08fc4695b87bb8f9d225ef12 P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.080s user 0.006s sys 0.000s
I20250830 07:54:49.809079 13887 raft_consensus.cc:357] T 042fd7ff08fc4695b87bb8f9d225ef12 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:49.809312 13887 raft_consensus.cc:383] T 042fd7ff08fc4695b87bb8f9d225ef12 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:49.809407 13887 raft_consensus.cc:738] T 042fd7ff08fc4695b87bb8f9d225ef12 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:54:49.809654 13887 consensus_queue.cc:260] T 042fd7ff08fc4695b87bb8f9d225ef12 P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:49.810209 13887 ts_tablet_manager.cc:1428] T 042fd7ff08fc4695b87bb8f9d225ef12 P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20250830 07:54:49.809851 13229 catalog_manager.cc:5674] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325) does not have the latest schema for tablet 69d6daeb7c774fd48ed296f52ed7c6a6 (table default.Table_c8fac6974ea94c7e863c1ded184f9230 [id=761247d93d9f4f788ecceabebf1de486]). Expected version 3 got 0
I20250830 07:54:49.810830 14943 consensus_queue.cc:1035] T 51cee993ce4249c0830b29cb1808fe80 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:54:49.803591 13886 raft_consensus.cc:738] T d206f6b6e7524a27a9f95787bcd5de77 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
W20250830 07:54:49.812049 13703 consensus_peers.cc:489] T e6b7646588fe4134b2db62ff84ca4791 P 9b057ade5dce45af9f8bf0bedf8b917f -> Peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Couldn't send request to peer 6b5e454d98894637b466ea27f1b647f9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20250830 07:54:49.812301 13703 leader_election.cc:343] T 4b403cadfb7b42f8896b2ee16b50ecb1 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:49.812201 13775 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "66d59910b4b2451a851e9d2728d50f42" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:49.812536 13482 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "4828280e6fec4338b35422917966ac8c" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
W20250830 07:54:49.812682 13703 leader_election.cc:343] T 65f1ee59e6e9498381d686f16a865e23 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:49.812781 13703 leader_election.cc:304] T 65f1ee59e6e9498381d686f16a865e23 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 2065c332f15a4739899af79f3669c3ba, 6b5e454d98894637b466ea27f1b647f9
I20250830 07:54:49.813668 13771 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "8eb010d7955d47a89ff1d01be1b5b01e" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f"
I20250830 07:54:49.813824 13771 raft_consensus.cc:3058] T 8eb010d7955d47a89ff1d01be1b5b01e P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:49.813055 13886 consensus_queue.cc:260] T d206f6b6e7524a27a9f95787bcd5de77 P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:49.816457 13771 raft_consensus.cc:2466] T 8eb010d7955d47a89ff1d01be1b5b01e P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b5e454d98894637b466ea27f1b647f9 in term 1.
I20250830 07:54:49.817570 14974 consensus_queue.cc:1035] T 4c4a8eea119044b49e2b29f10a703097 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:54:49.817891 14974 raft_consensus.cc:2747] T 65f1ee59e6e9498381d686f16a865e23 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:54:49.823119 13612 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "4b403cadfb7b42f8896b2ee16b50ecb1" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9"
I20250830 07:54:49.810531 13887 tablet_bootstrap.cc:492] T 28c2f7a3a6dd444585f0f5d337b985e9 P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:54:49.843470 13887 tablet_bootstrap.cc:654] T 28c2f7a3a6dd444585f0f5d337b985e9 P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:49.844194 15248 raft_consensus.cc:491] T d64f20df166a46249c08444f44422fc3 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:49.845018 15248 raft_consensus.cc:513] T d64f20df166a46249c08444f44422fc3 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:49.850665 13612 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "d64f20df166a46249c08444f44422fc3" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:49.850147 15248 leader_election.cc:290] T d64f20df166a46249c08444f44422fc3 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
W20250830 07:54:49.851033 13423 leader_election.cc:343] T d64f20df166a46249c08444f44422fc3 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:49.851708 13882 tablet_bootstrap.cc:492] T e4ca3110247640fbae4241448e8d5ef7 P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:54:49.851861 13882 ts_tablet_manager.cc:1397] T e4ca3110247640fbae4241448e8d5ef7 P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.170s user 0.007s sys 0.003s
I20250830 07:54:49.852514 13882 raft_consensus.cc:357] T e4ca3110247640fbae4241448e8d5ef7 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:49.852722 13882 raft_consensus.cc:383] T e4ca3110247640fbae4241448e8d5ef7 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:49.852805 13882 raft_consensus.cc:738] T e4ca3110247640fbae4241448e8d5ef7 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:54:49.853410 13882 consensus_queue.cc:260] T e4ca3110247640fbae4241448e8d5ef7 P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:49.854907 13771 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "d64f20df166a46249c08444f44422fc3" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
W20250830 07:54:49.855711 13422 leader_election.cc:343] T d64f20df166a46249c08444f44422fc3 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:49.855820 13422 leader_election.cc:304] T d64f20df166a46249c08444f44422fc3 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba; no voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:54:49.856253 15115 raft_consensus.cc:2747] T d64f20df166a46249c08444f44422fc3 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:54:49.856488 15115 raft_consensus.cc:491] T 9ffa3c1d128c49c8b8e2566c6a64304a P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:49.856577 15115 raft_consensus.cc:513] T 9ffa3c1d128c49c8b8e2566c6a64304a P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:49.857087 15115 leader_election.cc:290] T 9ffa3c1d128c49c8b8e2566c6a64304a P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:49.858109 13771 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "9ffa3c1d128c49c8b8e2566c6a64304a" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
W20250830 07:54:49.858628 13422 leader_election.cc:343] T 9ffa3c1d128c49c8b8e2566c6a64304a P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Illegal state: must be running to vote when last-logged opid is not known
W20250830 07:54:49.860723 13703 consensus_peers.cc:489] T ec4a3975961d4f85ad9da94835417574 P 9b057ade5dce45af9f8bf0bedf8b917f -> Peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Couldn't send request to peer 6b5e454d98894637b466ea27f1b647f9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20250830 07:54:49.861261 13703 leader_election.cc:343] T 4b403cadfb7b42f8896b2ee16b50ecb1 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:49.814241 13228 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_3e4b0ec8a89347c39ca293dd697bb734" } modify_external_catalogs: true
I20250830 07:54:49.815459 13231 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_b59b0e75bbee4971912072e1174aad74" } modify_external_catalogs: true
I20250830 07:54:49.816623 13227 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_2186ac7d5cd94641967f9459854c7fb0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:49.862320 13227 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2186ac7d5cd94641967f9459854c7fb0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:49.817498 13230 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_212693ef5d43495f976d99b2bc0ecbe1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:49.862727 13230 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_212693ef5d43495f976d99b2bc0ecbe1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:49.821267 13225 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_dbadc01ffe94447080e199d005d9e87c" } new_table_name: "default.Table_6ab42a2c7c944a0097217325de9c9c56" modify_external_catalogs: true
W20250830 07:54:49.850601 13233 catalog_manager.cc:5415] Ignoring report from unknown tablet 4b403cadfb7b42f8896b2ee16b50ecb1
I20250830 07:54:49.865235 13231 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_b59b0e75bbee4971912072e1174aad74" } modify_external_catalogs: true
I20250830 07:54:49.866691 13882 ts_tablet_manager.cc:1428] T e4ca3110247640fbae4241448e8d5ef7 P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.015s user 0.000s sys 0.001s
I20250830 07:54:49.866952 13882 tablet_bootstrap.cc:492] T acca1a8240454b889c63c82d3c75087e P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:54:49.867933 13228 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_3e4b0ec8a89347c39ca293dd697bb734" } modify_external_catalogs: true
I20250830 07:54:49.871518 14748 raft_consensus.cc:491] T e4ca3110247640fbae4241448e8d5ef7 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:49.871690 14748 raft_consensus.cc:513] T e4ca3110247640fbae4241448e8d5ef7 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:49.872884 14748 leader_election.cc:290] T e4ca3110247640fbae4241448e8d5ef7 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
W20250830 07:54:49.873481 13561 leader_election.cc:343] T e4ca3110247640fbae4241448e8d5ef7 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): Not found: Tablet not found: e4ca3110247640fbae4241448e8d5ef7
I20250830 07:54:49.874712 13612 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "9ffa3c1d128c49c8b8e2566c6a64304a" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:49.874886 13882 tablet_bootstrap.cc:654] T acca1a8240454b889c63c82d3c75087e P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
W20250830 07:54:49.874960 13221 catalog_manager.cc:4726] Async tablet task AlterTable RPC for tablet fac764a2d269411c86b85ceeaec0b014 (table default.Table_d63b9139d2864f4180dc5b7f59a0f5dc [id=79ead01cb7c54bba8701da6c74224b2b], current schema version=2) failed: Not found: failed to reset TS proxy: No leader found: Tablet fac764a2d269411c86b85ceeaec0b014 consensus state has no leader
W20250830 07:54:49.876835 13703 consensus_peers.cc:489] T 13df49c2c2cd4e5cae26a540835b74c9 P 9b057ade5dce45af9f8bf0bedf8b917f -> Peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Couldn't send request to peer 6b5e454d98894637b466ea27f1b647f9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20250830 07:54:49.876853 13423 leader_election.cc:343] T 9ffa3c1d128c49c8b8e2566c6a64304a P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:49.877058 13423 leader_election.cc:304] T 9ffa3c1d128c49c8b8e2566c6a64304a P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba; no voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:54:49.877295 15115 raft_consensus.cc:2747] T 9ffa3c1d128c49c8b8e2566c6a64304a P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:54:49.877480 13233 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_be8b189bfdc7429499032a5cb02b19cd"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250830 07:54:49.877758 13234 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_94c915c548f5408c9bc1d9786a13861c" } modify_external_catalogs: true
I20250830 07:54:49.877887 13234 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_94c915c548f5408c9bc1d9786a13861c" } modify_external_catalogs: true
W20250830 07:54:49.878319 13701 consensus_peers.cc:489] T e6b7646588fe4134b2db62ff84ca4791 P 9b057ade5dce45af9f8bf0bedf8b917f -> Peer 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): Couldn't send request to peer 2065c332f15a4739899af79f3669c3ba. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e6b7646588fe4134b2db62ff84ca4791. This is attempt 1: this message will repeat every 5th retry.
I20250830 07:54:49.878793 15091 raft_consensus.cc:491] T 3525652a73b8413b8ccbcb5824cc5880 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:49.878909 15091 raft_consensus.cc:513] T 3525652a73b8413b8ccbcb5824cc5880 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:49.879503 15091 leader_election.cc:290] T 3525652a73b8413b8ccbcb5824cc5880 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967)
I20250830 07:54:49.880321 13764 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "4828280e6fec4338b35422917966ac8c" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
W20250830 07:54:49.877923 13233 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_be8b189bfdc7429499032a5cb02b19cd in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:49.884555 13886 ts_tablet_manager.cc:1428] T d206f6b6e7524a27a9f95787bcd5de77 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.156s user 0.004s sys 0.000s
I20250830 07:54:49.886935 13771 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "e4ca3110247640fbae4241448e8d5ef7" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:49.887122 13771 raft_consensus.cc:2466] T e4ca3110247640fbae4241448e8d5ef7 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b5e454d98894637b466ea27f1b647f9 in term 0.
I20250830 07:54:49.889683 13486 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "3525652a73b8413b8ccbcb5824cc5880" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:54:49.889858 13486 raft_consensus.cc:2466] T 3525652a73b8413b8ccbcb5824cc5880 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 0.
W20250830 07:54:49.891222 13225 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet cd9903bdfaef4139a1a582c54689da4a consensus state has no leader
I20250830 07:54:49.893460 13701 leader_election.cc:304] T 3525652a73b8413b8ccbcb5824cc5880 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters:
I20250830 07:54:49.893747 14974 raft_consensus.cc:2802] T 3525652a73b8413b8ccbcb5824cc5880 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:54:49.893810 14974 raft_consensus.cc:491] T 3525652a73b8413b8ccbcb5824cc5880 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:54:49.893864 14974 raft_consensus.cc:3058] T 3525652a73b8413b8ccbcb5824cc5880 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
W20250830 07:54:49.894114 13225 catalog_manager.cc:5415] Ignoring report from unknown tablet 042fd7ff08fc4695b87bb8f9d225ef12
W20250830 07:54:49.894253 13225 catalog_manager.cc:5415] Ignoring report from unknown tablet ec4a3975961d4f85ad9da94835417574
I20250830 07:54:49.894510 13615 raft_consensus.cc:3058] T 01771fa171374e92892345e7402c33d1 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:49.894578 13225 catalog_manager.cc:5674] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325) does not have the latest schema for tablet 13df49c2c2cd4e5cae26a540835b74c9 (table default.Table_cbbde0aa8e5b47e69f1a0db288d36cdf [id=f366e4f894174aeb837a8749180c3a34]). Expected version 1 got 0
I20250830 07:54:49.894768 13882 tablet_bootstrap.cc:492] T acca1a8240454b889c63c82d3c75087e P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:54:49.894872 13882 ts_tablet_manager.cc:1397] T acca1a8240454b889c63c82d3c75087e P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.028s user 0.003s sys 0.000s
I20250830 07:54:49.895486 13882 raft_consensus.cc:357] T acca1a8240454b889c63c82d3c75087e P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:49.895624 13882 raft_consensus.cc:383] T acca1a8240454b889c63c82d3c75087e P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:49.895665 13882 raft_consensus.cc:738] T acca1a8240454b889c63c82d3c75087e P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:54:49.895825 13882 consensus_queue.cc:260] T acca1a8240454b889c63c82d3c75087e P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:49.897004 14974 raft_consensus.cc:513] T 3525652a73b8413b8ccbcb5824cc5880 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:49.897567 14974 leader_election.cc:290] T 3525652a73b8413b8ccbcb5824cc5880 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Requested vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967)
I20250830 07:54:49.898355 13231 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet 8ee98b748d0245bc8bf9eeac727b495e
I20250830 07:54:49.898428 13229 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_18c9e57c50cc476596ff71d5eb3b6968" } new_table_name: "default.Table_eace0187f8ea486e94d4ff049b2752dd" modify_external_catalogs: true
I20250830 07:54:49.899012 13614 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "3525652a73b8413b8ccbcb5824cc5880" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:49.899484 13629 raft_consensus.cc:3058] T 4828280e6fec4338b35422917966ac8c P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:49.900875 13486 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "3525652a73b8413b8ccbcb5824cc5880" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba"
I20250830 07:54:49.901032 13486 raft_consensus.cc:3058] T 3525652a73b8413b8ccbcb5824cc5880 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:49.901083 13230 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_e28fa3cd9d874266905f2bf1bfd1afca"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:49.901566 13230 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e28fa3cd9d874266905f2bf1bfd1afca in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250830 07:54:49.901611 13231 catalog_manager.cc:5415] Ignoring report from unknown tablet c0147310dad84226808332a4c2c6e09d
W20250830 07:54:49.901665 13231 catalog_manager.cc:5415] Ignoring report from unknown tablet d206f6b6e7524a27a9f95787bcd5de77
I20250830 07:54:49.902383 13602 tablet_service.cc:1515] Processing DeleteTablet for tablet 8ee98b748d0245bc8bf9eeac727b495e with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:49 UTC) from {username='slave'} at 127.0.0.1:45306
W20250830 07:54:49.903065 13220 catalog_manager.cc:4908] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet 8ee98b748d0245bc8bf9eeac727b495e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8ee98b748d0245bc8bf9eeac727b495e already in progress: creating tablet
I20250830 07:54:49.903541 13231 catalog_manager.cc:5674] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743) does not have the latest schema for tablet 13df49c2c2cd4e5cae26a540835b74c9 (table default.Table_cbbde0aa8e5b47e69f1a0db288d36cdf [id=f366e4f894174aeb837a8749180c3a34]). Expected version 1 got 0
I20250830 07:54:49.904695 13486 raft_consensus.cc:2466] T 3525652a73b8413b8ccbcb5824cc5880 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 1.
I20250830 07:54:49.904853 13231 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_d90f6f25635a473197a57573ff913d59"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:49.905494 13231 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d90f6f25635a473197a57573ff913d59 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250830 07:54:49.906562 13225 catalog_manager.cc:5415] Ignoring report from unknown tablet 4828280e6fec4338b35422917966ac8c
I20250830 07:54:49.907063 13701 leader_election.cc:304] T 3525652a73b8413b8ccbcb5824cc5880 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters:
I20250830 07:54:49.908008 14974 raft_consensus.cc:2802] T 3525652a73b8413b8ccbcb5824cc5880 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election won for term 1
I20250830 07:54:49.908123 14974 raft_consensus.cc:695] T 3525652a73b8413b8ccbcb5824cc5880 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 LEADER]: Becoming Leader. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Running, Role: LEADER
I20250830 07:54:49.908331 14974 consensus_queue.cc:237] T 3525652a73b8413b8ccbcb5824cc5880 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:49.909600 13886 tablet_bootstrap.cc:492] T de3a52a8e08a45808373902a0185e6f0 P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:54:49.911291 13886 tablet_bootstrap.cc:654] T de3a52a8e08a45808373902a0185e6f0 P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:49.913719 13562 leader_election.cc:304] T 66d59910b4b2451a851e9d2728d50f42 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b5e454d98894637b466ea27f1b647f9; no voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:54:49.914021 14748 raft_consensus.cc:2747] T 66d59910b4b2451a851e9d2728d50f42 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:54:49.914752 13562 leader_election.cc:304] T 8eb010d7955d47a89ff1d01be1b5b01e P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 2065c332f15a4739899af79f3669c3ba
I20250830 07:54:49.915025 14748 raft_consensus.cc:2802] T 8eb010d7955d47a89ff1d01be1b5b01e P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Leader election won for term 1
I20250830 07:54:49.915174 14748 raft_consensus.cc:695] T 8eb010d7955d47a89ff1d01be1b5b01e P 6b5e454d98894637b466ea27f1b647f9 [term 1 LEADER]: Becoming Leader. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Running, Role: LEADER
I20250830 07:54:49.915804 14748 consensus_queue.cc:237] T 8eb010d7955d47a89ff1d01be1b5b01e P 6b5e454d98894637b466ea27f1b647f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:49.915328 13882 ts_tablet_manager.cc:1428] T acca1a8240454b889c63c82d3c75087e P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.020s user 0.001s sys 0.000s
I20250830 07:54:49.919230 13882 tablet_bootstrap.cc:492] T 51cee993ce4249c0830b29cb1808fe80 P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:54:49.927299 13887 tablet_bootstrap.cc:492] T 28c2f7a3a6dd444585f0f5d337b985e9 P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:54:49.927469 13887 ts_tablet_manager.cc:1397] T 28c2f7a3a6dd444585f0f5d337b985e9 P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.117s user 0.002s sys 0.001s
I20250830 07:54:49.928267 13887 raft_consensus.cc:357] T 28c2f7a3a6dd444585f0f5d337b985e9 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:49.928481 13887 raft_consensus.cc:383] T 28c2f7a3a6dd444585f0f5d337b985e9 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:49.928584 13887 raft_consensus.cc:738] T 28c2f7a3a6dd444585f0f5d337b985e9 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:54:49.928846 13887 consensus_queue.cc:260] T 28c2f7a3a6dd444585f0f5d337b985e9 P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:49.929314 13887 ts_tablet_manager.cc:1428] T 28c2f7a3a6dd444585f0f5d337b985e9 P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20250830 07:54:49.930210 13887 tablet_bootstrap.cc:492] T ec47a59c22ff4370bd21bc2a18336049 P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:54:49.931857 13887 tablet_bootstrap.cc:654] T ec47a59c22ff4370bd21bc2a18336049 P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:49.946429 13228 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet 5e2da5434e95445aa4deafce7fde0c6c
I20250830 07:54:49.946852 13882 tablet_bootstrap.cc:654] T 51cee993ce4249c0830b29cb1808fe80 P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:49.947314 13602 tablet_service.cc:1515] Processing DeleteTablet for tablet 5e2da5434e95445aa4deafce7fde0c6c with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:49 UTC) from {username='slave'} at 127.0.0.1:45306
W20250830 07:54:49.947930 13220 catalog_manager.cc:4908] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet 5e2da5434e95445aa4deafce7fde0c6c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5e2da5434e95445aa4deafce7fde0c6c already in progress: creating tablet
I20250830 07:54:49.960906 13234 catalog_manager.cc:5864] Not sending DeleteTablet requests; no consensus state for tablet 470ff1e476cf4fdb91765cc1ac18078a
I20250830 07:54:49.961344 13228 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_34028d46b5fa400a959628ad3dded830" } new_table_name: "default.Table_27e1bf25b5ab42e5a55443ff1f770c84" modify_external_catalogs: true
I20250830 07:54:49.959802 13562 leader_election.cc:304] T 4828280e6fec4338b35422917966ac8c P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b5e454d98894637b466ea27f1b647f9; no voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:54:49.964313 13227 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_bdb5ae7d204748da94e533777f6a1541"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250830 07:54:49.965512 14974 raft_consensus.cc:491] T d1bf58d367f54ba8bad64887b9a8d9cc P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:49.965879 15237 raft_consensus.cc:2747] T 4828280e6fec4338b35422917966ac8c P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:54:49.965724 14974 raft_consensus.cc:513] T d1bf58d367f54ba8bad64887b9a8d9cc P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:49.968152 13486 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "d1bf58d367f54ba8bad64887b9a8d9cc" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:54:49.968456 13887 tablet_bootstrap.cc:492] T ec47a59c22ff4370bd21bc2a18336049 P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:54:49.968638 13887 ts_tablet_manager.cc:1397] T ec47a59c22ff4370bd21bc2a18336049 P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.038s user 0.001s sys 0.003s
I20250830 07:54:49.968623 14974 leader_election.cc:290] T d1bf58d367f54ba8bad64887b9a8d9cc P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967)
I20250830 07:54:49.968719 13234 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_59d6841afff14535b58ecb6c143b6f80"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:49.969151 13234 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_59d6841afff14535b58ecb6c143b6f80 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:49.969779 13887 raft_consensus.cc:357] T ec47a59c22ff4370bd21bc2a18336049 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:49.970129 13887 raft_consensus.cc:383] T ec47a59c22ff4370bd21bc2a18336049 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20250830 07:54:49.970759 13227 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bdb5ae7d204748da94e533777f6a1541 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250830 07:54:49.971184 13701 leader_election.cc:343] T d1bf58d367f54ba8bad64887b9a8d9cc P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): Illegal state: must be running to vote when last-logged opid is not known
W20250830 07:54:49.971149 13225 catalog_manager.cc:5415] Ignoring report from unknown tablet ec4a3975961d4f85ad9da94835417574
W20250830 07:54:49.971444 13225 catalog_manager.cc:5415] Ignoring report from unknown tablet 4828280e6fec4338b35422917966ac8c
I20250830 07:54:49.973125 13536 heartbeater.cc:344] Connected to a master server at 127.12.209.60:43889
I20250830 07:54:49.981307 14974 raft_consensus.cc:491] T b83dfc54383d4e7b96523568aea5c9f3 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:49.981494 14974 raft_consensus.cc:513] T b83dfc54383d4e7b96523568aea5c9f3 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:49.982246 14974 leader_election.cc:290] T b83dfc54383d4e7b96523568aea5c9f3 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967)
I20250830 07:54:49.970221 13887 raft_consensus.cc:738] T ec47a59c22ff4370bd21bc2a18336049 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:54:49.985385 13887 consensus_queue.cc:260] T ec47a59c22ff4370bd21bc2a18336049 P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:49.968497 13562 leader_election.cc:304] T e4ca3110247640fbae4241448e8d5ef7 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 2065c332f15a4739899af79f3669c3ba
I20250830 07:54:49.987601 15237 raft_consensus.cc:2802] T e4ca3110247640fbae4241448e8d5ef7 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:54:49.987673 15237 raft_consensus.cc:491] T e4ca3110247640fbae4241448e8d5ef7 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:54:49.987736 15237 raft_consensus.cc:3058] T e4ca3110247640fbae4241448e8d5ef7 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Advancing to term 1
W20250830 07:54:49.987994 13703 leader_election.cc:343] T 3525652a73b8413b8ccbcb5824cc5880 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:49.988550 15244 consensus_queue.cc:1035] T 4828280e6fec4338b35422917966ac8c P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:54:49.988883 13615 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "3525652a73b8413b8ccbcb5824cc5880" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9"
I20250830 07:54:49.991498 13233 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_6dbeeb382b9a4cef84a165dc351d2c20" } new_table_name: "default.Table_70dfb33e85024d38b036a0515b129f8f" modify_external_catalogs: true
W20250830 07:54:49.993355 13229 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 14550e5f0308438fbd5eb78429720c2c has no consensus state
W20250830 07:54:49.996134 13232 catalog_manager.cc:5415] Ignoring report from unknown tablet 28c2f7a3a6dd444585f0f5d337b985e9
I20250830 07:54:49.997711 13232 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_f5c54fd926d448d7be37ee5a95f99b09" } new_table_name: "default.Table_c953ff3e77a649ba977aab615109ef51" modify_external_catalogs: true
W20250830 07:54:49.998423 13225 catalog_manager.cc:5415] Ignoring report from unknown tablet d206f6b6e7524a27a9f95787bcd5de77
I20250830 07:54:49.999065 13225 catalog_manager.cc:5582] T 3525652a73b8413b8ccbcb5824cc5880 P 9b057ade5dce45af9f8bf0bedf8b917f reported cstate change: term changed from 0 to 1, leader changed from <none> to 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3). New cstate: current_term: 1 leader_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } health_report { overall_health: HEALTHY } } }
I20250830 07:54:50.002346 13229 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_56e6d3dc00b343a386af2994a3d5d904" } modify_external_catalogs: true
I20250830 07:54:50.002526 13229 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_56e6d3dc00b343a386af2994a3d5d904" } modify_external_catalogs: true
I20250830 07:54:50.002677 13629 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "d1bf58d367f54ba8bad64887b9a8d9cc" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:50.002977 13614 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "b83dfc54383d4e7b96523568aea5c9f3" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
W20250830 07:54:50.007601 13703 leader_election.cc:343] T 3525652a73b8413b8ccbcb5824cc5880 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:50.008173 13882 tablet_bootstrap.cc:492] T 51cee993ce4249c0830b29cb1808fe80 P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:54:50.008306 13882 ts_tablet_manager.cc:1397] T 51cee993ce4249c0830b29cb1808fe80 P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.089s user 0.004s sys 0.000s
I20250830 07:54:50.008955 13230 master_service.cc:948] ReplaceTablet: received request to replace tablet a3ac09a6d8604297aa8736d1f60484e2 from {username='slave'} at 127.0.0.1:42126
I20250830 07:54:50.009610 13882 raft_consensus.cc:357] T 51cee993ce4249c0830b29cb1808fe80 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:50.009757 13882 raft_consensus.cc:383] T 51cee993ce4249c0830b29cb1808fe80 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:50.009804 13882 raft_consensus.cc:738] T 51cee993ce4249c0830b29cb1808fe80 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:54:50.010005 13882 consensus_queue.cc:260] T 51cee993ce4249c0830b29cb1808fe80 P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:50.010325 15237 raft_consensus.cc:513] T e4ca3110247640fbae4241448e8d5ef7 P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:50.010640 13882 ts_tablet_manager.cc:1428] T 51cee993ce4249c0830b29cb1808fe80 P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20250830 07:54:50.010874 13882 tablet_bootstrap.cc:492] T ec4a3975961d4f85ad9da94835417574 P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:54:50.011797 15237 leader_election.cc:290] T e4ca3110247640fbae4241448e8d5ef7 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 election: Requested vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:50.012179 13486 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "b83dfc54383d4e7b96523568aea5c9f3" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:54:50.012337 13486 raft_consensus.cc:2466] T b83dfc54383d4e7b96523568aea5c9f3 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 0.
I20250830 07:54:50.012717 13701 leader_election.cc:304] T b83dfc54383d4e7b96523568aea5c9f3 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters:
I20250830 07:54:50.013063 14974 raft_consensus.cc:2802] T b83dfc54383d4e7b96523568aea5c9f3 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:54:50.013144 14974 raft_consensus.cc:491] T b83dfc54383d4e7b96523568aea5c9f3 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:54:50.013201 14974 raft_consensus.cc:3058] T b83dfc54383d4e7b96523568aea5c9f3 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:50.015674 14974 raft_consensus.cc:513] T b83dfc54383d4e7b96523568aea5c9f3 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:50.016160 13231 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_202b8705ef95410a9d716197ee3171c3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250830 07:54:50.016253 14974 leader_election.cc:290] T b83dfc54383d4e7b96523568aea5c9f3 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Requested vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967)
W20250830 07:54:50.016665 13231 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_202b8705ef95410a9d716197ee3171c3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:50.018239 13882 tablet_bootstrap.cc:654] T ec4a3975961d4f85ad9da94835417574 P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:50.033591 14974 raft_consensus.cc:491] T 8ae468b43b4c450ca7591b543c2539d9 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:50.033713 14974 raft_consensus.cc:513] T 8ae468b43b4c450ca7591b543c2539d9 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:50.034144 14974 leader_election.cc:290] T 8ae468b43b4c450ca7591b543c2539d9 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967)
W20250830 07:54:50.036329 13703 leader_election.cc:343] T d1bf58d367f54ba8bad64887b9a8d9cc P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:50.036419 13703 leader_election.cc:304] T d1bf58d367f54ba8bad64887b9a8d9cc P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 2065c332f15a4739899af79f3669c3ba, 6b5e454d98894637b466ea27f1b647f9
I20250830 07:54:50.036823 14974 raft_consensus.cc:2747] T d1bf58d367f54ba8bad64887b9a8d9cc P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20250830 07:54:50.037245 13703 leader_election.cc:343] T b83dfc54383d4e7b96523568aea5c9f3 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
W20250830 07:54:50.038039 13703 consensus_peers.cc:489] T 74891b8103e144c486750f64ba2003f4 P 9b057ade5dce45af9f8bf0bedf8b917f -> Peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Couldn't send request to peer 6b5e454d98894637b466ea27f1b647f9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20250830 07:54:50.038965 13764 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "e4ca3110247640fbae4241448e8d5ef7" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f"
I20250830 07:54:50.039114 13764 raft_consensus.cc:3058] T e4ca3110247640fbae4241448e8d5ef7 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:50.041481 13764 raft_consensus.cc:2466] T e4ca3110247640fbae4241448e8d5ef7 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b5e454d98894637b466ea27f1b647f9 in term 1.
I20250830 07:54:50.042965 13624 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "b83dfc54383d4e7b96523568aea5c9f3" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9"
I20250830 07:54:50.043071 13615 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "8ae468b43b4c450ca7591b543c2539d9" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
W20250830 07:54:50.043336 13703 leader_election.cc:343] T b83dfc54383d4e7b96523568aea5c9f3 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
W20250830 07:54:50.045102 13703 leader_election.cc:343] T 8ae468b43b4c450ca7591b543c2539d9 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:50.045359 13562 leader_election.cc:304] T e4ca3110247640fbae4241448e8d5ef7 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f; no voters:
I20250830 07:54:50.045595 15237 raft_consensus.cc:2802] T e4ca3110247640fbae4241448e8d5ef7 P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Leader election won for term 1
I20250830 07:54:50.045682 15237 raft_consensus.cc:695] T e4ca3110247640fbae4241448e8d5ef7 P 6b5e454d98894637b466ea27f1b647f9 [term 1 LEADER]: Becoming Leader. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Running, Role: LEADER
I20250830 07:54:50.045852 15237 consensus_queue.cc:237] T e4ca3110247640fbae4241448e8d5ef7 P 6b5e454d98894637b466ea27f1b647f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:50.054260 14974 raft_consensus.cc:491] T d206f6b6e7524a27a9f95787bcd5de77 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:50.054379 14974 raft_consensus.cc:513] T d206f6b6e7524a27a9f95787bcd5de77 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:50.054836 14974 leader_election.cc:290] T d206f6b6e7524a27a9f95787bcd5de77 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967)
W20250830 07:54:50.055390 13228 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 40f5260a18a7454788078458f49a3ffa consensus state has no leader
I20250830 07:54:50.055711 13228 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_b3bbd69f2357492c8a10ce75ea4c393a" } modify_external_catalogs: true
I20250830 07:54:50.055823 13615 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "d206f6b6e7524a27a9f95787bcd5de77" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:50.055878 13228 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_b3bbd69f2357492c8a10ce75ea4c393a" } modify_external_catalogs: true
W20250830 07:54:50.056232 13703 leader_election.cc:343] T d206f6b6e7524a27a9f95787bcd5de77 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:50.069334 13887 ts_tablet_manager.cc:1428] T ec47a59c22ff4370bd21bc2a18336049 P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.101s user 0.001s sys 0.001s
W20250830 07:54:50.070492 13561 leader_election.cc:343] T e4ca3110247640fbae4241448e8d5ef7 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): Not found: Tablet not found: e4ca3110247640fbae4241448e8d5ef7
I20250830 07:54:50.070756 13479 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "8ae468b43b4c450ca7591b543c2539d9" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:54:50.070912 13479 raft_consensus.cc:2466] T 8ae468b43b4c450ca7591b543c2539d9 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 0.
I20250830 07:54:50.072017 13234 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_bdec155b14db4e059c5eb39102f4956a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250830 07:54:50.072187 13225 master_service.cc:948] ReplaceTablet: received request to replace tablet 94e28f0788664448b53edb5240a4a4b6 from {username='slave'} at 127.0.0.1:42126
W20250830 07:54:50.072522 13234 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bdec155b14db4e059c5eb39102f4956a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:50.072566 13225 master_service.cc:948] ReplaceTablet: received request to replace tablet 40ce920462584c25b19befa4146b340f from {username='slave'} at 127.0.0.1:42126
W20250830 07:54:50.073793 13233 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f32ebc2605c34a68aed50379f028052c consensus state has no leader
I20250830 07:54:50.074031 13482 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "b83dfc54383d4e7b96523568aea5c9f3" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba"
I20250830 07:54:50.074173 13482 raft_consensus.cc:3058] T b83dfc54383d4e7b96523568aea5c9f3 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:50.074925 13701 leader_election.cc:304] T 8ae468b43b4c450ca7591b543c2539d9 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:54:50.075834 14974 raft_consensus.cc:2802] T 8ae468b43b4c450ca7591b543c2539d9 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:54:50.075904 14974 raft_consensus.cc:491] T 8ae468b43b4c450ca7591b543c2539d9 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:54:50.075951 14974 raft_consensus.cc:3058] T 8ae468b43b4c450ca7591b543c2539d9 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:50.077363 13887 tablet_bootstrap.cc:492] T c1e0e774b86d4ef9a75e2635295f3e2a P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:54:50.078258 14974 raft_consensus.cc:513] T 8ae468b43b4c450ca7591b543c2539d9 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:50.079156 13624 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "8ae468b43b4c450ca7591b543c2539d9" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9"
I20250830 07:54:50.079754 14974 leader_election.cc:290] T 8ae468b43b4c450ca7591b543c2539d9 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Requested vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967)
W20250830 07:54:50.081174 13232 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet e96f321d803549f5bf34e5bcd433e6eb has no consensus state
W20250830 07:54:50.080263 13703 leader_election.cc:343] T 8ae468b43b4c450ca7591b543c2539d9 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
W20250830 07:54:50.081898 13701 leader_election.cc:343] T d206f6b6e7524a27a9f95787bcd5de77 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): Not found: Tablet not found: d206f6b6e7524a27a9f95787bcd5de77
I20250830 07:54:50.083686 13701 leader_election.cc:304] T d206f6b6e7524a27a9f95787bcd5de77 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 2065c332f15a4739899af79f3669c3ba, 6b5e454d98894637b466ea27f1b647f9
I20250830 07:54:50.084100 15246 raft_consensus.cc:2747] T d206f6b6e7524a27a9f95787bcd5de77 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20250830 07:54:50.084707 13703 consensus_peers.cc:489] T aee84a97524e4568acdc4ae1c74fb492 P 9b057ade5dce45af9f8bf0bedf8b917f -> Peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Couldn't send request to peer 6b5e454d98894637b466ea27f1b647f9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20250830 07:54:50.085032 13232 catalog_manager.cc:5415] Ignoring report from unknown tablet ec47a59c22ff4370bd21bc2a18336049
W20250830 07:54:50.085172 13232 catalog_manager.cc:5415] Ignoring report from unknown tablet 28c2f7a3a6dd444585f0f5d337b985e9
I20250830 07:54:50.087781 13482 raft_consensus.cc:2466] T b83dfc54383d4e7b96523568aea5c9f3 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 1.
I20250830 07:54:50.088719 13484 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "8ae468b43b4c450ca7591b543c2539d9" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba"
I20250830 07:54:50.088745 13701 leader_election.cc:304] T b83dfc54383d4e7b96523568aea5c9f3 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:54:50.088855 13484 raft_consensus.cc:3058] T 8ae468b43b4c450ca7591b543c2539d9 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:50.091068 14974 raft_consensus.cc:2802] T b83dfc54383d4e7b96523568aea5c9f3 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election won for term 1
I20250830 07:54:50.091516 14974 raft_consensus.cc:695] T b83dfc54383d4e7b96523568aea5c9f3 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 LEADER]: Becoming Leader. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Running, Role: LEADER
I20250830 07:54:50.094897 13232 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_2a1215c34df8484ca99228faa7e3747b" } new_table_name: "default.Table_33ec157fb4a5440a8cd600063ba5975f" modify_external_catalogs: true
I20250830 07:54:50.095081 15248 raft_consensus.cc:491] T 713c12e1efec4e6f9895c65dc8a9c4b9 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:50.095186 15248 raft_consensus.cc:513] T 713c12e1efec4e6f9895c65dc8a9c4b9 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:50.095223 14974 consensus_queue.cc:237] T b83dfc54383d4e7b96523568aea5c9f3 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:50.097003 13484 raft_consensus.cc:2466] T 8ae468b43b4c450ca7591b543c2539d9 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 1.
I20250830 07:54:50.097643 13701 leader_election.cc:304] T 8ae468b43b4c450ca7591b543c2539d9 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:54:50.097968 15246 raft_consensus.cc:2802] T 8ae468b43b4c450ca7591b543c2539d9 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election won for term 1
I20250830 07:54:50.098090 15246 raft_consensus.cc:695] T 8ae468b43b4c450ca7591b543c2539d9 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 LEADER]: Becoming Leader. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Running, Role: LEADER
I20250830 07:54:50.098220 13887 tablet_bootstrap.cc:654] T c1e0e774b86d4ef9a75e2635295f3e2a P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:50.098286 15246 consensus_queue.cc:237] T 8ae468b43b4c450ca7591b543c2539d9 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:50.099828 13229 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet 7af74bdde363493f8061eba450ecf4b4
I20250830 07:54:50.100200 15248 leader_election.cc:290] T 713c12e1efec4e6f9895c65dc8a9c4b9 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:50.100659 13764 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "713c12e1efec4e6f9895c65dc8a9c4b9" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:50.100919 13602 tablet_service.cc:1515] Processing DeleteTablet for tablet 7af74bdde363493f8061eba450ecf4b4 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:49 UTC) from {username='slave'} at 127.0.0.1:45306
I20250830 07:54:50.101154 15047 tablet_replica.cc:331] T 7af74bdde363493f8061eba450ecf4b4 P 6b5e454d98894637b466ea27f1b647f9: stopping tablet replica
W20250830 07:54:50.101178 13422 leader_election.cc:343] T 713c12e1efec4e6f9895c65dc8a9c4b9 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:50.101351 15047 raft_consensus.cc:2241] T 7af74bdde363493f8061eba450ecf4b4 P 6b5e454d98894637b466ea27f1b647f9 [term 1 LEADER]: Raft consensus shutting down.
I20250830 07:54:50.101625 15047 raft_consensus.cc:2270] T 7af74bdde363493f8061eba450ecf4b4 P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250830 07:54:50.102618 15047 ts_tablet_manager.cc:1905] T 7af74bdde363493f8061eba450ecf4b4 P 6b5e454d98894637b466ea27f1b647f9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250830 07:54:50.103992 13887 tablet_bootstrap.cc:492] T c1e0e774b86d4ef9a75e2635295f3e2a P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:54:50.104116 13887 ts_tablet_manager.cc:1397] T c1e0e774b86d4ef9a75e2635295f3e2a P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.027s user 0.001s sys 0.001s
I20250830 07:54:50.104696 13887 raft_consensus.cc:357] T c1e0e774b86d4ef9a75e2635295f3e2a P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:50.104827 13887 raft_consensus.cc:383] T c1e0e774b86d4ef9a75e2635295f3e2a P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:50.104876 13887 raft_consensus.cc:738] T c1e0e774b86d4ef9a75e2635295f3e2a P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:54:50.107548 13887 consensus_queue.cc:260] T c1e0e774b86d4ef9a75e2635295f3e2a P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:50.108253 13887 ts_tablet_manager.cc:1428] T c1e0e774b86d4ef9a75e2635295f3e2a P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20250830 07:54:50.108520 13887 tablet_bootstrap.cc:492] T 91705fc35a1b4977b89bac1765c886c0 P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:54:50.109767 13887 tablet_bootstrap.cc:654] T 91705fc35a1b4977b89bac1765c886c0 P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:50.111727 15245 raft_consensus.cc:491] T 0ceccc5f18294356894695fe08d73e30 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:50.111851 15245 raft_consensus.cc:513] T 0ceccc5f18294356894695fe08d73e30 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:50.112300 15245 leader_election.cc:290] T 0ceccc5f18294356894695fe08d73e30 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967)
I20250830 07:54:50.113909 13484 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "0ceccc5f18294356894695fe08d73e30" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:54:50.114089 13484 raft_consensus.cc:2466] T 0ceccc5f18294356894695fe08d73e30 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 0.
I20250830 07:54:50.114491 13701 leader_election.cc:304] T 0ceccc5f18294356894695fe08d73e30 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters:
I20250830 07:54:50.114764 15245 raft_consensus.cc:2802] T 0ceccc5f18294356894695fe08d73e30 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:54:50.114822 15245 raft_consensus.cc:491] T 0ceccc5f18294356894695fe08d73e30 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:54:50.114871 15245 raft_consensus.cc:3058] T 0ceccc5f18294356894695fe08d73e30 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:50.117429 15245 raft_consensus.cc:513] T 0ceccc5f18294356894695fe08d73e30 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:50.119524 15245 leader_election.cc:290] T 0ceccc5f18294356894695fe08d73e30 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Requested vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967)
I20250830 07:54:50.119747 13484 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "0ceccc5f18294356894695fe08d73e30" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba"
I20250830 07:54:50.119901 13484 raft_consensus.cc:3058] T 0ceccc5f18294356894695fe08d73e30 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:50.121140 15047 ts_tablet_manager.cc:1918] T 7af74bdde363493f8061eba450ecf4b4 P 6b5e454d98894637b466ea27f1b647f9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20250830 07:54:50.122821 13484 raft_consensus.cc:2466] T 0ceccc5f18294356894695fe08d73e30 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 1.
I20250830 07:54:50.123872 13701 leader_election.cc:304] T 0ceccc5f18294356894695fe08d73e30 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters:
I20250830 07:54:50.124519 15244 raft_consensus.cc:2802] T 0ceccc5f18294356894695fe08d73e30 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election won for term 1
I20250830 07:54:50.124634 15244 raft_consensus.cc:695] T 0ceccc5f18294356894695fe08d73e30 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 LEADER]: Becoming Leader. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Running, Role: LEADER
I20250830 07:54:50.124881 15244 consensus_queue.cc:237] T 0ceccc5f18294356894695fe08d73e30 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:50.125671 15047 log.cc:1199] T 7af74bdde363493f8061eba450ecf4b4 P 6b5e454d98894637b466ea27f1b647f9: Deleting WAL directory at /tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/ts-1/wal/wals/7af74bdde363493f8061eba450ecf4b4
I20250830 07:54:50.126004 15047 ts_tablet_manager.cc:1939] T 7af74bdde363493f8061eba450ecf4b4 P 6b5e454d98894637b466ea27f1b647f9: Deleting consensus metadata
I20250830 07:54:50.128162 13624 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "0ceccc5f18294356894695fe08d73e30" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9"
W20250830 07:54:50.129117 13703 leader_election.cc:343] T 0ceccc5f18294356894695fe08d73e30 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:50.128317 13614 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "713c12e1efec4e6f9895c65dc8a9c4b9" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:50.128301 13615 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "0ceccc5f18294356894695fe08d73e30" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
W20250830 07:54:50.130441 13423 leader_election.cc:343] T 713c12e1efec4e6f9895c65dc8a9c4b9 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:50.130548 13423 leader_election.cc:304] T 713c12e1efec4e6f9895c65dc8a9c4b9 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba; no voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:54:50.130924 15248 raft_consensus.cc:2747] T 713c12e1efec4e6f9895c65dc8a9c4b9 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:54:50.131181 13220 catalog_manager.cc:4928] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): tablet 7af74bdde363493f8061eba450ecf4b4 (table default.Table_56e6d3dc00b343a386af2994a3d5d904 [id=dfa51a12131743428fa066bbe3b6982e]) successfully deleted
W20250830 07:54:50.134457 13703 leader_election.cc:343] T 0ceccc5f18294356894695fe08d73e30 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
W20250830 07:54:50.138031 13229 catalog_manager.cc:5415] Ignoring report from unknown tablet ec47a59c22ff4370bd21bc2a18336049
I20250830 07:54:50.138294 13887 tablet_bootstrap.cc:492] T 91705fc35a1b4977b89bac1765c886c0 P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:54:50.138433 13887 ts_tablet_manager.cc:1397] T 91705fc35a1b4977b89bac1765c886c0 P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.030s user 0.005s sys 0.005s
I20250830 07:54:50.138682 15237 raft_consensus.cc:491] T acca1a8240454b889c63c82d3c75087e P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:50.138789 15237 raft_consensus.cc:513] T acca1a8240454b889c63c82d3c75087e P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:50.138417 13227 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_70dfb33e85024d38b036a0515b129f8f" } modify_external_catalogs: true
I20250830 07:54:50.139101 13227 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_70dfb33e85024d38b036a0515b129f8f" } modify_external_catalogs: true
I20250830 07:54:50.139370 15237 leader_election.cc:290] T acca1a8240454b889c63c82d3c75087e P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:50.139791 13484 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "acca1a8240454b889c63c82d3c75087e" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:54:50.140668 13887 raft_consensus.cc:357] T 91705fc35a1b4977b89bac1765c886c0 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:50.140816 13887 raft_consensus.cc:383] T 91705fc35a1b4977b89bac1765c886c0 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:50.140872 13887 raft_consensus.cc:738] T 91705fc35a1b4977b89bac1765c886c0 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:54:50.141072 13887 consensus_queue.cc:260] T 91705fc35a1b4977b89bac1765c886c0 P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:50.138765 13233 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_baa6927f8af54785bab679ab4d706c98"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:50.141755 13233 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_baa6927f8af54785bab679ab4d706c98 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:50.143651 13229 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_9d575bc5f1cd4a498ebc95b8b34c51ef"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:50.144304 13229 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9d575bc5f1cd4a498ebc95b8b34c51ef in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:50.144856 13887 ts_tablet_manager.cc:1428] T 91705fc35a1b4977b89bac1765c886c0 P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.006s user 0.000s sys 0.001s
I20250830 07:54:50.147775 13887 tablet_bootstrap.cc:492] T d1bf58d367f54ba8bad64887b9a8d9cc P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:54:50.149247 13887 tablet_bootstrap.cc:654] T d1bf58d367f54ba8bad64887b9a8d9cc P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:50.149389 15248 raft_consensus.cc:491] T 410b1e2d520c470eb4b9ab60104e0cd4 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:50.149497 15248 raft_consensus.cc:513] T 410b1e2d520c470eb4b9ab60104e0cd4 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:50.149976 15248 leader_election.cc:290] T 410b1e2d520c470eb4b9ab60104e0cd4 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:50.150712 13764 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "410b1e2d520c470eb4b9ab60104e0cd4" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
W20250830 07:54:50.151175 13422 leader_election.cc:343] T 410b1e2d520c470eb4b9ab60104e0cd4 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:50.159271 13764 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "acca1a8240454b889c63c82d3c75087e" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:50.161887 13562 leader_election.cc:304] T acca1a8240454b889c63c82d3c75087e P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b5e454d98894637b466ea27f1b647f9; no voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:54:50.162165 15237 raft_consensus.cc:2747] T acca1a8240454b889c63c82d3c75087e P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:54:50.163748 13882 tablet_bootstrap.cc:492] T ec4a3975961d4f85ad9da94835417574 P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:54:50.163882 13882 ts_tablet_manager.cc:1397] T ec4a3975961d4f85ad9da94835417574 P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.153s user 0.014s sys 0.003s
I20250830 07:54:50.162514 13624 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "410b1e2d520c470eb4b9ab60104e0cd4" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
W20250830 07:54:50.166472 13423 leader_election.cc:343] T 410b1e2d520c470eb4b9ab60104e0cd4 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:50.166564 13423 leader_election.cc:304] T 410b1e2d520c470eb4b9ab60104e0cd4 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba; no voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:54:50.166625 13882 raft_consensus.cc:357] T ec4a3975961d4f85ad9da94835417574 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:50.166762 13882 raft_consensus.cc:383] T ec4a3975961d4f85ad9da94835417574 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:50.166808 13882 raft_consensus.cc:738] T ec4a3975961d4f85ad9da94835417574 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:54:50.166880 15248 raft_consensus.cc:2747] T 410b1e2d520c470eb4b9ab60104e0cd4 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:54:50.166955 13230 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet a3ac09a6d8604297aa8736d1f60484e2
I20250830 07:54:50.167027 13882 consensus_queue.cc:260] T ec4a3975961d4f85ad9da94835417574 P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:50.167373 13230 catalog_manager.cc:6652] ReplaceTablet: tablet a3ac09a6d8604297aa8736d1f60484e2 deleted and replaced by tablet 1d93c9e3e00a428ba3e4bbbcdc5db45a
I20250830 07:54:50.167461 13882 ts_tablet_manager.cc:1428] T ec4a3975961d4f85ad9da94835417574 P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.004s user 0.001s sys 0.000s
I20250830 07:54:50.167711 13882 tablet_bootstrap.cc:492] T e6b7646588fe4134b2db62ff84ca4791 P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:54:50.169948 15199 log.cc:826] T 00000000000000000000000000000000 P 3ea183a890b84f408b20b55e9eb7c7ed: Log is configured to *not* fsync() on all Append() calls
I20250830 07:54:50.170727 13230 catalog_manager.cc:5674] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325) does not have the latest schema for tablet c1e0e774b86d4ef9a75e2635295f3e2a (table default.Table_2ef4fd56f595442da659bbfe83fea326 [id=d05616fc48704721ad64764335e6505a]). Expected version 1 got 0
I20250830 07:54:50.171494 13230 catalog_manager.cc:5674] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325) does not have the latest schema for tablet 91705fc35a1b4977b89bac1765c886c0 (table default.Table_4f53e333521540848fc99c0bf37c1639 [id=48089766c3514336991a5ada71b03dd0]). Expected version 1 got 0
I20250830 07:54:50.172027 13602 tablet_service.cc:1515] Processing DeleteTablet for tablet a3ac09a6d8604297aa8736d1f60484e2 with delete_type TABLET_DATA_DELETED (replaced by tablet 1d93c9e3e00a428ba3e4bbbcdc5db45a) from {username='slave'} at 127.0.0.1:45306
I20250830 07:54:50.173324 15248 raft_consensus.cc:491] T de3a52a8e08a45808373902a0185e6f0 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:50.173431 15248 raft_consensus.cc:513] T de3a52a8e08a45808373902a0185e6f0 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:50.173897 15248 leader_election.cc:290] T de3a52a8e08a45808373902a0185e6f0 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:50.173817 13230 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_52010ca92ca74b059544914b19145906"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250830 07:54:50.174527 13764 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "de3a52a8e08a45808373902a0185e6f0" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
W20250830 07:54:50.174777 13230 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_52010ca92ca74b059544914b19145906 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250830 07:54:50.174962 13422 leader_election.cc:343] T de3a52a8e08a45808373902a0185e6f0 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:50.183131 13615 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "de3a52a8e08a45808373902a0185e6f0" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
W20250830 07:54:50.183504 13423 leader_election.cc:343] T de3a52a8e08a45808373902a0185e6f0 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:50.183599 13423 leader_election.cc:304] T de3a52a8e08a45808373902a0185e6f0 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba; no voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:54:50.183905 15248 raft_consensus.cc:2747] T de3a52a8e08a45808373902a0185e6f0 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20250830 07:54:50.195923 13220 catalog_manager.cc:4908] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet a3ac09a6d8604297aa8736d1f60484e2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a3ac09a6d8604297aa8736d1f60484e2 already in progress: creating tablet
I20250830 07:54:50.196230 13228 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet 581ae087d60d45e291d899fa03fb89e2
I20250830 07:54:50.199769 13882 tablet_bootstrap.cc:654] T e6b7646588fe4134b2db62ff84ca4791 P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:50.200151 13602 tablet_service.cc:1515] Processing DeleteTablet for tablet 581ae087d60d45e291d899fa03fb89e2 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:50 UTC) from {username='slave'} at 127.0.0.1:45306
I20250830 07:54:50.202075 13228 catalog_manager.cc:5674] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325) does not have the latest schema for tablet 91705fc35a1b4977b89bac1765c886c0 (table default.Table_4f53e333521540848fc99c0bf37c1639 [id=48089766c3514336991a5ada71b03dd0]). Expected version 1 got 0
I20250830 07:54:50.202996 13228 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_cacba29065c242789ac3e0da29384aa3" } modify_external_catalogs: true
I20250830 07:54:50.203208 13228 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_cacba29065c242789ac3e0da29384aa3" } modify_external_catalogs: true
I20250830 07:54:50.207588 13624 raft_consensus.cc:3058] T 51cee993ce4249c0830b29cb1808fe80 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:50.207589 15244 consensus_queue.cc:1035] T d2b8e6df64ef49e2ba36c093efd3c351 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20250830 07:54:50.208976 13220 catalog_manager.cc:4908] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet 581ae087d60d45e291d899fa03fb89e2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 581ae087d60d45e291d899fa03fb89e2 already in progress: creating tablet
I20250830 07:54:50.211072 15246 consensus_queue.cc:1035] T 09586fdda94c4aff9d3fa25d71fe6ac0 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:54:50.210840 13231 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_457b48606bd94a959a7675a3cded52ba" } modify_external_catalogs: true
I20250830 07:54:50.211512 13231 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_457b48606bd94a959a7675a3cded52ba" } modify_external_catalogs: true
I20250830 07:54:50.214866 13674 heartbeater.cc:344] Connected to a master server at 127.12.209.60:43889
I20250830 07:54:50.222594 13887 tablet_bootstrap.cc:492] T d1bf58d367f54ba8bad64887b9a8d9cc P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:54:50.222730 13887 ts_tablet_manager.cc:1397] T d1bf58d367f54ba8bad64887b9a8d9cc P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.075s user 0.008s sys 0.011s
I20250830 07:54:50.223383 13887 raft_consensus.cc:357] T d1bf58d367f54ba8bad64887b9a8d9cc P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:50.223555 13887 raft_consensus.cc:383] T d1bf58d367f54ba8bad64887b9a8d9cc P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:50.223644 13887 raft_consensus.cc:738] T d1bf58d367f54ba8bad64887b9a8d9cc P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:54:50.223873 13887 consensus_queue.cc:260] T d1bf58d367f54ba8bad64887b9a8d9cc P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
W20250830 07:54:50.226058 13234 catalog_manager.cc:5415] Ignoring report from unknown tablet ef16b9e2d444489699f4db1ac26d5f6c
I20250830 07:54:50.226799 13234 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_a82bd61017e3429693a4eb4b2b96b67b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:50.227348 13234 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a82bd61017e3429693a4eb4b2b96b67b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:50.230506 13887 ts_tablet_manager.cc:1428] T d1bf58d367f54ba8bad64887b9a8d9cc P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.008s user 0.002s sys 0.000s
I20250830 07:54:50.230791 13887 tablet_bootstrap.cc:492] T d37fe59b4f964f30bb1ed4cb00868b75 P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:54:50.232033 14975 consensus_queue.cc:1035] T 74891b8103e144c486750f64ba2003f4 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:54:50.233502 13887 tablet_bootstrap.cc:654] T d37fe59b4f964f30bb1ed4cb00868b75 P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:50.235807 13225 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet 40ce920462584c25b19befa4146b340f
I20250830 07:54:50.236234 13225 catalog_manager.cc:6652] ReplaceTablet: tablet 40ce920462584c25b19befa4146b340f deleted and replaced by tablet c2dcae39ce0c4890872ebebef2e1054f
I20250830 07:54:50.236569 13225 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_a4097958af86408498f5bc26a4fc0871" } new_table_name: "default.Table_f63ba9417d6048d89cb3f06e7da4c0a8" modify_external_catalogs: true
I20250830 07:54:50.241941 13602 tablet_service.cc:1515] Processing DeleteTablet for tablet 40ce920462584c25b19befa4146b340f with delete_type TABLET_DATA_DELETED (replaced by tablet c2dcae39ce0c4890872ebebef2e1054f) from {username='slave'} at 127.0.0.1:45306
W20250830 07:54:50.242513 13232 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 8921c85fefac415f9a4e5bb7dc38a134 consensus state has no leader
W20250830 07:54:50.243654 13220 catalog_manager.cc:4908] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet 40ce920462584c25b19befa4146b340f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 40ce920462584c25b19befa4146b340f already in progress: creating tablet
I20250830 07:54:50.244108 15009 raft_consensus.cc:491] T 28c2f7a3a6dd444585f0f5d337b985e9 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:50.244243 15009 raft_consensus.cc:513] T 28c2f7a3a6dd444585f0f5d337b985e9 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:50.244937 15009 leader_election.cc:290] T 28c2f7a3a6dd444585f0f5d337b985e9 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:50.245672 13764 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "28c2f7a3a6dd444585f0f5d337b985e9" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
W20250830 07:54:50.246642 13422 leader_election.cc:343] T 28c2f7a3a6dd444585f0f5d337b985e9 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:50.248258 13232 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_e7d7152ed2374013b98e8486284c203e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:50.248759 13232 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e7d7152ed2374013b98e8486284c203e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:50.253152 13227 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet f32ebc2605c34a68aed50379f028052c
I20250830 07:54:50.256863 13227 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_3efb203c49e444568f4050cd42e50edf"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:50.257306 13227 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3efb203c49e444568f4050cd42e50edf in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:50.259577 13887 tablet_bootstrap.cc:492] T d37fe59b4f964f30bb1ed4cb00868b75 P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:54:50.260591 13887 ts_tablet_manager.cc:1397] T d37fe59b4f964f30bb1ed4cb00868b75 P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.030s user 0.006s sys 0.003s
I20250830 07:54:50.261200 13887 raft_consensus.cc:357] T d37fe59b4f964f30bb1ed4cb00868b75 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:50.261462 13887 raft_consensus.cc:383] T d37fe59b4f964f30bb1ed4cb00868b75 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:50.261550 13887 raft_consensus.cc:738] T d37fe59b4f964f30bb1ed4cb00868b75 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:54:50.261759 13887 consensus_queue.cc:260] T d37fe59b4f964f30bb1ed4cb00868b75 P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:50.262322 13887 ts_tablet_manager.cc:1428] T d37fe59b4f964f30bb1ed4cb00868b75 P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20250830 07:54:50.262684 13887 tablet_bootstrap.cc:492] T 8cce7e5537794e9484f5a7c82b9e6e1d P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:54:50.264205 13887 tablet_bootstrap.cc:654] T 8cce7e5537794e9484f5a7c82b9e6e1d P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:50.267954 13233 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_bff4eb83b12a4825993387659d6b3428" } new_table_name: "default.Table_7a50f4e8c38f4807b9e0bf1f22e2eddb" modify_external_catalogs: true
I20250830 07:54:50.274075 13602 tablet_service.cc:1515] Processing DeleteTablet for tablet f32ebc2605c34a68aed50379f028052c with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:50 UTC) from {username='slave'} at 127.0.0.1:45306
W20250830 07:54:50.275102 13703 consensus_peers.cc:489] T 09586fdda94c4aff9d3fa25d71fe6ac0 P 9b057ade5dce45af9f8bf0bedf8b917f -> Peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Couldn't send request to peer 6b5e454d98894637b466ea27f1b647f9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20250830 07:54:50.275449 13615 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "28c2f7a3a6dd444585f0f5d337b985e9" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
W20250830 07:54:50.275980 13423 leader_election.cc:343] T 28c2f7a3a6dd444585f0f5d337b985e9 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:50.276104 13423 leader_election.cc:304] T 28c2f7a3a6dd444585f0f5d337b985e9 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba; no voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:54:50.276487 15009 raft_consensus.cc:2747] T 28c2f7a3a6dd444585f0f5d337b985e9 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20250830 07:54:50.277012 13220 catalog_manager.cc:4908] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet f32ebc2605c34a68aed50379f028052c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f32ebc2605c34a68aed50379f028052c already in progress: creating tablet
I20250830 07:54:50.314555 13882 tablet_bootstrap.cc:492] T e6b7646588fe4134b2db62ff84ca4791 P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:54:50.314705 13882 ts_tablet_manager.cc:1397] T e6b7646588fe4134b2db62ff84ca4791 P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.147s user 0.007s sys 0.002s
I20250830 07:54:50.316269 13882 raft_consensus.cc:357] T e6b7646588fe4134b2db62ff84ca4791 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:50.316535 13882 raft_consensus.cc:383] T e6b7646588fe4134b2db62ff84ca4791 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:50.316617 13882 raft_consensus.cc:738] T e6b7646588fe4134b2db62ff84ca4791 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:54:50.316924 13882 consensus_queue.cc:260] T e6b7646588fe4134b2db62ff84ca4791 P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
W20250830 07:54:50.319247 13229 catalog_manager.cc:5415] Ignoring report from unknown tablet d33a5d107c6849aca6eb48ffdf8a5463
W20250830 07:54:50.319684 13229 catalog_manager.cc:5415] Ignoring report from unknown tablet d2b8e6df64ef49e2ba36c093efd3c351
I20250830 07:54:50.321198 13229 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_056a3568c0844814a6c7afd463359b81"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:50.321817 13229 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_056a3568c0844814a6c7afd463359b81 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:50.323860 13230 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_36034e8bf07a4f7897aa3d11dc36f17b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:50.324406 13230 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_36034e8bf07a4f7897aa3d11dc36f17b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:50.341653 13882 ts_tablet_manager.cc:1428] T e6b7646588fe4134b2db62ff84ca4791 P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.027s user 0.002s sys 0.000s
I20250830 07:54:50.342123 13882 tablet_bootstrap.cc:492] T f1fe024f0de048a5a0931ee38752d5a1 P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:54:50.356158 13228 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet 669e649b53984db3bad8c6121f39fb73
W20250830 07:54:50.359884 13228 catalog_manager.cc:5415] Ignoring report from unknown tablet b83dfc54383d4e7b96523568aea5c9f3
I20250830 07:54:50.360729 13228 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_34ab4571d5784a7dbeb8066f8940f9ce" } new_table_name: "default.Table_e7b4e9634b1a44f7a571b021b1dcc1fe" modify_external_catalogs: true
I20250830 07:54:50.363018 13602 tablet_service.cc:1515] Processing DeleteTablet for tablet 669e649b53984db3bad8c6121f39fb73 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:50 UTC) from {username='slave'} at 127.0.0.1:45306
W20250830 07:54:50.366729 13220 catalog_manager.cc:4908] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet 669e649b53984db3bad8c6121f39fb73 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 669e649b53984db3bad8c6121f39fb73 already in progress: creating tablet
W20250830 07:54:50.367269 13703 consensus_peers.cc:489] T d2b8e6df64ef49e2ba36c093efd3c351 P 9b057ade5dce45af9f8bf0bedf8b917f -> Peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Couldn't send request to peer 6b5e454d98894637b466ea27f1b647f9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20250830 07:54:50.368319 14975 consensus_queue.cc:1035] T aee84a97524e4568acdc4ae1c74fb492 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:54:50.372038 15115 raft_consensus.cc:491] T d37fe59b4f964f30bb1ed4cb00868b75 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:50.372157 15115 raft_consensus.cc:513] T d37fe59b4f964f30bb1ed4cb00868b75 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:50.372699 15115 leader_election.cc:290] T d37fe59b4f964f30bb1ed4cb00868b75 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:50.373407 13612 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "d37fe59b4f964f30bb1ed4cb00868b75" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:50.374042 13764 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "d37fe59b4f964f30bb1ed4cb00868b75" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:50.374290 13231 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet f2ebc809f1074db78720920286d9385b
W20250830 07:54:50.374528 13422 leader_election.cc:343] T d37fe59b4f964f30bb1ed4cb00868b75 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Illegal state: must be running to vote when last-logged opid is not known
W20250830 07:54:50.375424 13423 leader_election.cc:343] T d37fe59b4f964f30bb1ed4cb00868b75 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:50.375551 13423 leader_election.cc:304] T d37fe59b4f964f30bb1ed4cb00868b75 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba; no voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:54:50.376015 15115 raft_consensus.cc:2747] T d37fe59b4f964f30bb1ed4cb00868b75 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:54:50.376566 13602 tablet_service.cc:1515] Processing DeleteTablet for tablet f2ebc809f1074db78720920286d9385b with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:50 UTC) from {username='slave'} at 127.0.0.1:45306
W20250830 07:54:50.377274 13220 catalog_manager.cc:4908] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet f2ebc809f1074db78720920286d9385b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f2ebc809f1074db78720920286d9385b already in progress: creating tablet
W20250830 07:54:50.386124 13231 catalog_manager.cc:5415] Ignoring report from unknown tablet ff0f9cccc8ed43b1a8cd38de0e9d4097
W20250830 07:54:50.386417 13231 catalog_manager.cc:5415] Ignoring report from unknown tablet 2b4ce50fbd26484faba3faa2ec5115c0
W20250830 07:54:50.386586 13231 catalog_manager.cc:5415] Ignoring report from unknown tablet 6a82ea7078e344a497c34f932e139bcd
W20250830 07:54:50.387017 13231 catalog_manager.cc:5415] Ignoring report from unknown tablet 8ae468b43b4c450ca7591b543c2539d9
I20250830 07:54:50.387486 13231 catalog_manager.cc:5582] T 0ceccc5f18294356894695fe08d73e30 P 9b057ade5dce45af9f8bf0bedf8b917f reported cstate change: term changed from 0 to 1, leader changed from <none> to 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3). New cstate: current_term: 1 leader_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } health_report { overall_health: HEALTHY } } }
I20250830 07:54:50.387972 13231 catalog_manager.cc:5674] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743) does not have the latest schema for tablet 0ceccc5f18294356894695fe08d73e30 (table default.Table_32d032fe8fba47348e797c68bb7ea866 [id=0e99ba575a7a4f8dae74a98627249018]). Expected version 1 got 0
I20250830 07:54:50.408322 15115 raft_consensus.cc:491] T 042fd7ff08fc4695b87bb8f9d225ef12 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:50.408458 15115 raft_consensus.cc:513] T 042fd7ff08fc4695b87bb8f9d225ef12 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:50.409173 15115 leader_election.cc:290] T 042fd7ff08fc4695b87bb8f9d225ef12 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:50.409794 13612 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "042fd7ff08fc4695b87bb8f9d225ef12" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:50.410333 14975 raft_consensus.cc:491] T 74ea2298876a4066b297915c135d4618 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:50.410506 14975 raft_consensus.cc:513] T 74ea2298876a4066b297915c135d4618 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:50.411430 14975 leader_election.cc:290] T 74ea2298876a4066b297915c135d4618 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967)
I20250830 07:54:50.411490 13615 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "74ea2298876a4066b297915c135d4618" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
W20250830 07:54:50.411967 13423 leader_election.cc:343] T 042fd7ff08fc4695b87bb8f9d225ef12 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
W20250830 07:54:50.412210 13703 leader_election.cc:343] T 74ea2298876a4066b297915c135d4618 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
W20250830 07:54:50.415045 13701 leader_election.cc:343] T 74ea2298876a4066b297915c135d4618 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): Not found: Tablet not found: 74ea2298876a4066b297915c135d4618
I20250830 07:54:50.415181 13701 leader_election.cc:304] T 74ea2298876a4066b297915c135d4618 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 2065c332f15a4739899af79f3669c3ba, 6b5e454d98894637b466ea27f1b647f9
I20250830 07:54:50.417073 14975 raft_consensus.cc:2747] T 74ea2298876a4066b297915c135d4618 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:54:50.417119 13764 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "042fd7ff08fc4695b87bb8f9d225ef12" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
W20250830 07:54:50.417590 13422 leader_election.cc:343] T 042fd7ff08fc4695b87bb8f9d225ef12 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:50.417683 13422 leader_election.cc:304] T 042fd7ff08fc4695b87bb8f9d225ef12 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba; no voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:54:50.417984 15248 raft_consensus.cc:2747] T 042fd7ff08fc4695b87bb8f9d225ef12 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:54:50.421981 13234 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_29b9901c90514282855f50d19ebedb4c" } new_table_name: "default.Table_7e1aa3ed101845e5931c80bba38a4d44" modify_external_catalogs: true
I20250830 07:54:50.426350 13886 tablet_bootstrap.cc:492] T de3a52a8e08a45808373902a0185e6f0 P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:54:50.426522 13886 ts_tablet_manager.cc:1397] T de3a52a8e08a45808373902a0185e6f0 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.517s user 0.019s sys 0.004s
I20250830 07:54:50.427211 13886 raft_consensus.cc:357] T de3a52a8e08a45808373902a0185e6f0 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:50.427425 13886 raft_consensus.cc:383] T de3a52a8e08a45808373902a0185e6f0 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:50.427518 13886 raft_consensus.cc:738] T de3a52a8e08a45808373902a0185e6f0 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:54:50.427747 13886 consensus_queue.cc:260] T de3a52a8e08a45808373902a0185e6f0 P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
W20250830 07:54:50.431046 13225 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 53766699d42e4f6e9b42d9a98613726c consensus state has no leader
W20250830 07:54:50.435216 13225 catalog_manager.cc:5415] Ignoring report from unknown tablet d37fe59b4f964f30bb1ed4cb00868b75
W20250830 07:54:50.435346 13225 catalog_manager.cc:5415] Ignoring report from unknown tablet d1bf58d367f54ba8bad64887b9a8d9cc
W20250830 07:54:50.435431 13225 catalog_manager.cc:5415] Ignoring report from unknown tablet d2b8e6df64ef49e2ba36c093efd3c351
I20250830 07:54:50.440914 13886 ts_tablet_manager.cc:1428] T de3a52a8e08a45808373902a0185e6f0 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.014s user 0.001s sys 0.000s
I20250830 07:54:50.443655 13886 tablet_bootstrap.cc:492] T 28c2f7a3a6dd444585f0f5d337b985e9 P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:54:50.443805 13882 tablet_bootstrap.cc:654] T f1fe024f0de048a5a0931ee38752d5a1 P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:50.445376 13232 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_990e59015a9844b9b7d257d83b0700a0" } modify_external_catalogs: true
I20250830 07:54:50.445572 13232 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_990e59015a9844b9b7d257d83b0700a0" } modify_external_catalogs: true
I20250830 07:54:50.453604 13886 tablet_bootstrap.cc:654] T 28c2f7a3a6dd444585f0f5d337b985e9 P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:50.457302 13227 master_service.cc:948] ReplaceTablet: received request to replace tablet 6fb5cd3618584dd3a0ee43a10f7a2660 from {username='slave'} at 127.0.0.1:42126
I20250830 07:54:50.461939 13887 tablet_bootstrap.cc:492] T 8cce7e5537794e9484f5a7c82b9e6e1d P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:54:50.462126 13887 ts_tablet_manager.cc:1397] T 8cce7e5537794e9484f5a7c82b9e6e1d P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.200s user 0.025s sys 0.053s
I20250830 07:54:50.462755 13887 raft_consensus.cc:357] T 8cce7e5537794e9484f5a7c82b9e6e1d P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:50.462987 13887 raft_consensus.cc:383] T 8cce7e5537794e9484f5a7c82b9e6e1d P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:50.463090 13887 raft_consensus.cc:738] T 8cce7e5537794e9484f5a7c82b9e6e1d P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:54:50.463294 13887 consensus_queue.cc:260] T 8cce7e5537794e9484f5a7c82b9e6e1d P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:50.463758 13887 ts_tablet_manager.cc:1428] T 8cce7e5537794e9484f5a7c82b9e6e1d P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20250830 07:54:50.464038 13887 tablet_bootstrap.cc:492] T 924403105a6a40f28aad60647a2a8987 P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:54:50.465502 13887 tablet_bootstrap.cc:654] T 924403105a6a40f28aad60647a2a8987 P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
W20250830 07:54:50.467025 13233 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d64f20df166a46249c08444f44422fc3 consensus state has no leader
I20250830 07:54:50.469864 13233 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_89e31bbe0cde4122a2d98a13059c5b87" } modify_external_catalogs: true
I20250830 07:54:50.470050 13233 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_89e31bbe0cde4122a2d98a13059c5b87" } modify_external_catalogs: true
I20250830 07:54:50.480645 13229 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_1a2de735765a4e87833de97d8b4197ca"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:50.481179 13229 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1a2de735765a4e87833de97d8b4197ca in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:50.488122 13887 tablet_bootstrap.cc:492] T 924403105a6a40f28aad60647a2a8987 P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:54:50.488322 13887 ts_tablet_manager.cc:1397] T 924403105a6a40f28aad60647a2a8987 P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.024s user 0.003s sys 0.003s
I20250830 07:54:50.489471 13887 raft_consensus.cc:357] T 924403105a6a40f28aad60647a2a8987 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:50.489799 13887 raft_consensus.cc:383] T 924403105a6a40f28aad60647a2a8987 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:50.489895 13887 raft_consensus.cc:738] T 924403105a6a40f28aad60647a2a8987 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:54:50.490159 13887 consensus_queue.cc:260] T 924403105a6a40f28aad60647a2a8987 P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:50.490682 13887 ts_tablet_manager.cc:1428] T 924403105a6a40f28aad60647a2a8987 P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20250830 07:54:50.490988 13887 tablet_bootstrap.cc:492] T da5c7b084e1f4fda92fff35a9cb2c7fc P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:54:50.491044 13882 tablet_bootstrap.cc:492] T f1fe024f0de048a5a0931ee38752d5a1 P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:54:50.491175 13882 ts_tablet_manager.cc:1397] T f1fe024f0de048a5a0931ee38752d5a1 P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.149s user 0.004s sys 0.000s
I20250830 07:54:50.492117 13882 raft_consensus.cc:357] T f1fe024f0de048a5a0931ee38752d5a1 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:50.492281 13882 raft_consensus.cc:383] T f1fe024f0de048a5a0931ee38752d5a1 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:50.492337 13882 raft_consensus.cc:738] T f1fe024f0de048a5a0931ee38752d5a1 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:54:50.492506 13882 consensus_queue.cc:260] T f1fe024f0de048a5a0931ee38752d5a1 P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:50.492758 13230 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_9b6c66a97dcd482c9c5238996bebccac"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250830 07:54:50.493094 13882 ts_tablet_manager.cc:1428] T f1fe024f0de048a5a0931ee38752d5a1 P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20250830 07:54:50.493342 13882 tablet_bootstrap.cc:492] T 856e644662334f8194ffef6ca1232248 P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
W20250830 07:54:50.493741 13230 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9b6c66a97dcd482c9c5238996bebccac in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:50.494813 13882 tablet_bootstrap.cc:654] T 856e644662334f8194ffef6ca1232248 P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:50.497624 13887 tablet_bootstrap.cc:654] T da5c7b084e1f4fda92fff35a9cb2c7fc P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:50.516639 13887 tablet_bootstrap.cc:492] T da5c7b084e1f4fda92fff35a9cb2c7fc P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:54:50.516867 13887 ts_tablet_manager.cc:1397] T da5c7b084e1f4fda92fff35a9cb2c7fc P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.026s user 0.004s sys 0.000s
I20250830 07:54:50.517433 13887 raft_consensus.cc:357] T da5c7b084e1f4fda92fff35a9cb2c7fc P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
W20250830 07:54:50.517671 13228 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet b85843ab0e3a40e1b453cfdd71bbae5e consensus state has no leader
I20250830 07:54:50.517681 13887 raft_consensus.cc:383] T da5c7b084e1f4fda92fff35a9cb2c7fc P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:50.517735 13887 raft_consensus.cc:738] T da5c7b084e1f4fda92fff35a9cb2c7fc P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:54:50.517910 13887 consensus_queue.cc:260] T da5c7b084e1f4fda92fff35a9cb2c7fc P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:50.517993 13228 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_65ab52329c314c13817e7261f5108188" } new_table_name: "default.Table_c3c97f9e7537410bbc60629e7bd27373" modify_external_catalogs: true
I20250830 07:54:50.518478 13887 ts_tablet_manager.cc:1428] T da5c7b084e1f4fda92fff35a9cb2c7fc P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20250830 07:54:50.518689 13887 tablet_bootstrap.cc:492] T 5235e1a32f044f0cbf882e338c482003 P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:54:50.520674 13887 tablet_bootstrap.cc:654] T 5235e1a32f044f0cbf882e338c482003 P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:50.527372 14906 raft_consensus.cc:491] T 04eadf45b82e4c319eb7b316a402d81a P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2065c332f15a4739899af79f3669c3ba)
I20250830 07:54:50.527508 14906 raft_consensus.cc:513] T 04eadf45b82e4c319eb7b316a402d81a P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:50.528106 14906 leader_election.cc:290] T 04eadf45b82e4c319eb7b316a402d81a P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:50.528709 13484 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "04eadf45b82e4c319eb7b316a402d81a" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:54:50.528870 13484 raft_consensus.cc:2466] T 04eadf45b82e4c319eb7b316a402d81a P 2065c332f15a4739899af79f3669c3ba [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b5e454d98894637b466ea27f1b647f9 in term 2.
I20250830 07:54:50.529307 13561 leader_election.cc:304] T 04eadf45b82e4c319eb7b316a402d81a P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 6b5e454d98894637b466ea27f1b647f9; no voters:
I20250830 07:54:50.529616 15259 raft_consensus.cc:2802] T 04eadf45b82e4c319eb7b316a402d81a P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20250830 07:54:50.529687 15259 raft_consensus.cc:491] T 04eadf45b82e4c319eb7b316a402d81a P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2065c332f15a4739899af79f3669c3ba)
I20250830 07:54:50.529758 15259 raft_consensus.cc:3058] T 04eadf45b82e4c319eb7b316a402d81a P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Advancing to term 2
I20250830 07:54:50.531952 13231 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_ed5d4615fae445629ebd6be55862b4bf" } modify_external_catalogs: true
I20250830 07:54:50.532095 13231 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_ed5d4615fae445629ebd6be55862b4bf" } modify_external_catalogs: true
I20250830 07:54:50.532403 15259 raft_consensus.cc:513] T 04eadf45b82e4c319eb7b316a402d81a P 6b5e454d98894637b466ea27f1b647f9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:50.532931 15259 leader_election.cc:290] T 04eadf45b82e4c319eb7b316a402d81a P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 2 election: Requested vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:50.533643 13225 catalog_manager.cc:5674] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325) does not have the latest schema for tablet 74891b8103e144c486750f64ba2003f4 (table default.Table_f898ce75325a436ca3a63a3c9e46fb68 [id=63f62da0ba61488791fcce76368d92a8]). Expected version 1 got 0
I20250830 07:54:50.535791 13484 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "04eadf45b82e4c319eb7b316a402d81a" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba"
I20250830 07:54:50.536420 15245 consensus_queue.cc:1035] T 4b403cadfb7b42f8896b2ee16b50ecb1 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:54:50.538427 13484 raft_consensus.cc:2466] T 04eadf45b82e4c319eb7b316a402d81a P 2065c332f15a4739899af79f3669c3ba [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b5e454d98894637b466ea27f1b647f9 in term 2.
I20250830 07:54:50.539505 13225 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_b368f9852ef141498ec1b9107db7b417"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250830 07:54:50.539682 13561 leader_election.cc:304] T 04eadf45b82e4c319eb7b316a402d81a P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 6b5e454d98894637b466ea27f1b647f9; no voters:
I20250830 07:54:50.539896 13886 tablet_bootstrap.cc:492] T 28c2f7a3a6dd444585f0f5d337b985e9 P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:54:50.540038 15237 raft_consensus.cc:2802] T 04eadf45b82e4c319eb7b316a402d81a P 6b5e454d98894637b466ea27f1b647f9 [term 2 FOLLOWER]: Leader election won for term 2
W20250830 07:54:50.540045 13225 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b368f9852ef141498ec1b9107db7b417 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:50.540136 13886 ts_tablet_manager.cc:1397] T 28c2f7a3a6dd444585f0f5d337b985e9 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.097s user 0.002s sys 0.000s
I20250830 07:54:50.540151 15237 raft_consensus.cc:695] T 04eadf45b82e4c319eb7b316a402d81a P 6b5e454d98894637b466ea27f1b647f9 [term 2 LEADER]: Becoming Leader. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Running, Role: LEADER
I20250830 07:54:50.540386 15237 consensus_queue.cc:237] T 04eadf45b82e4c319eb7b316a402d81a P 6b5e454d98894637b466ea27f1b647f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:50.540725 13886 raft_consensus.cc:357] T 28c2f7a3a6dd444585f0f5d337b985e9 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:50.540849 13886 raft_consensus.cc:383] T 28c2f7a3a6dd444585f0f5d337b985e9 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:50.540889 13886 raft_consensus.cc:738] T 28c2f7a3a6dd444585f0f5d337b985e9 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:54:50.541067 13886 consensus_queue.cc:260] T 28c2f7a3a6dd444585f0f5d337b985e9 P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:50.542205 13775 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "04eadf45b82e4c319eb7b316a402d81a" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f"
I20250830 07:54:50.542436 13775 raft_consensus.cc:2391] T 04eadf45b82e4c319eb7b316a402d81a P 9b057ade5dce45af9f8bf0bedf8b917f [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b5e454d98894637b466ea27f1b647f9 in current term 2: Already voted for candidate 9b057ade5dce45af9f8bf0bedf8b917f in this term.
I20250830 07:54:50.542484 13886 ts_tablet_manager.cc:1428] T 28c2f7a3a6dd444585f0f5d337b985e9 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
W20250830 07:54:50.543411 13234 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a4a4fc69f68643c1acf6471cee80b581 consensus state has no leader
I20250830 07:54:50.542223 13764 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "04eadf45b82e4c319eb7b316a402d81a" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:50.547335 13764 raft_consensus.cc:2391] T 04eadf45b82e4c319eb7b316a402d81a P 9b057ade5dce45af9f8bf0bedf8b917f [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b5e454d98894637b466ea27f1b647f9 in current term 2: Already voted for candidate 9b057ade5dce45af9f8bf0bedf8b917f in this term.
W20250830 07:54:50.548046 13234 catalog_manager.cc:5415] Ignoring report from unknown tablet f398e12cd9f543738d5163354f8a9d9d
W20250830 07:54:50.548218 13234 catalog_manager.cc:5415] Ignoring report from unknown tablet 1fa571e9490e499792225d7b786e8658
W20250830 07:54:50.548302 13234 catalog_manager.cc:5415] Ignoring report from unknown tablet d2b8e6df64ef49e2ba36c093efd3c351
W20250830 07:54:50.548377 13234 catalog_manager.cc:5415] Ignoring report from unknown tablet de3a52a8e08a45808373902a0185e6f0
I20250830 07:54:50.548826 13234 catalog_manager.cc:5674] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743) does not have the latest schema for tablet aee84a97524e4568acdc4ae1c74fb492 (table default.Table_65ab52329c314c13817e7261f5108188 [id=18b2c25896e546748465c4807b839cbf]). Expected version 2 got 0
I20250830 07:54:50.549103 13234 catalog_manager.cc:5674] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743) does not have the latest schema for tablet 74891b8103e144c486750f64ba2003f4 (table default.Table_f898ce75325a436ca3a63a3c9e46fb68 [id=63f62da0ba61488791fcce76368d92a8]). Expected version 1 got 0
I20250830 07:54:50.556273 13232 catalog_manager.cc:5864] Not sending DeleteTablet requests; no consensus state for tablet b185bb25f6ca4405a47cbea16f3503a6
I20250830 07:54:50.562690 13820 heartbeater.cc:344] Connected to a master server at 127.12.209.60:43889
W20250830 07:54:50.567544 13703 consensus_peers.cc:489] T 4b403cadfb7b42f8896b2ee16b50ecb1 P 9b057ade5dce45af9f8bf0bedf8b917f -> Peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Couldn't send request to peer 6b5e454d98894637b466ea27f1b647f9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20250830 07:54:50.568940 13232 catalog_manager.cc:5415] Ignoring report from unknown tablet da5c7b084e1f4fda92fff35a9cb2c7fc
W20250830 07:54:50.569115 13232 catalog_manager.cc:5415] Ignoring report from unknown tablet 8cce7e5537794e9484f5a7c82b9e6e1d
W20250830 07:54:50.569315 13232 catalog_manager.cc:5415] Ignoring report from unknown tablet b4ab964a64a64e00a78ffd2b220aef46
I20250830 07:54:50.569950 13232 catalog_manager.cc:5674] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325) does not have the latest schema for tablet 74891b8103e144c486750f64ba2003f4 (table default.Table_f898ce75325a436ca3a63a3c9e46fb68 [id=63f62da0ba61488791fcce76368d92a8]). Expected version 1 got 0
I20250830 07:54:50.570186 13232 catalog_manager.cc:5674] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325) does not have the latest schema for tablet aee84a97524e4568acdc4ae1c74fb492 (table default.Table_65ab52329c314c13817e7261f5108188 [id=18b2c25896e546748465c4807b839cbf]). Expected version 2 got 0
I20250830 07:54:50.570386 13232 catalog_manager.cc:5674] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325) does not have the latest schema for tablet 924403105a6a40f28aad60647a2a8987 (table default.Table_5caf352b482f4b9ba4d727ab7fbd00bb [id=46ec9117fe9146cb807dd092284616fc]). Expected version 1 got 0
I20250830 07:54:50.578544 13227 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet 6fb5cd3618584dd3a0ee43a10f7a2660
I20250830 07:54:50.578961 13227 catalog_manager.cc:6652] ReplaceTablet: tablet 6fb5cd3618584dd3a0ee43a10f7a2660 deleted and replaced by tablet 63e461477fb34468a5972a2945be5e53
I20250830 07:54:50.579829 13602 tablet_service.cc:1515] Processing DeleteTablet for tablet 6fb5cd3618584dd3a0ee43a10f7a2660 with delete_type TABLET_DATA_DELETED (replaced by tablet 63e461477fb34468a5972a2945be5e53) from {username='slave'} at 127.0.0.1:45306
I20250830 07:54:50.583364 13886 tablet_bootstrap.cc:492] T d64f20df166a46249c08444f44422fc3 P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:54:50.583586 13227 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_e60b3afef41a4393bd214404c744eaef"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:50.584095 13227 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e60b3afef41a4393bd214404c744eaef in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:50.584685 13886 tablet_bootstrap.cc:654] T d64f20df166a46249c08444f44422fc3 P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
W20250830 07:54:50.585431 13220 catalog_manager.cc:4908] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet 6fb5cd3618584dd3a0ee43a10f7a2660 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6fb5cd3618584dd3a0ee43a10f7a2660 already in progress: creating tablet
I20250830 07:54:50.602530 13882 tablet_bootstrap.cc:492] T 856e644662334f8194ffef6ca1232248 P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:54:50.602732 13882 ts_tablet_manager.cc:1397] T 856e644662334f8194ffef6ca1232248 P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.109s user 0.003s sys 0.000s
I20250830 07:54:50.603648 13887 tablet_bootstrap.cc:492] T 5235e1a32f044f0cbf882e338c482003 P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:54:50.603634 13882 raft_consensus.cc:357] T 856e644662334f8194ffef6ca1232248 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:50.603766 13887 ts_tablet_manager.cc:1397] T 5235e1a32f044f0cbf882e338c482003 P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.085s user 0.010s sys 0.000s
I20250830 07:54:50.603780 13882 raft_consensus.cc:383] T 856e644662334f8194ffef6ca1232248 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:50.603832 13882 raft_consensus.cc:738] T 856e644662334f8194ffef6ca1232248 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:54:50.604162 13882 consensus_queue.cc:260] T 856e644662334f8194ffef6ca1232248 P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:50.604473 13887 raft_consensus.cc:357] T 5235e1a32f044f0cbf882e338c482003 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:50.604616 13887 raft_consensus.cc:383] T 5235e1a32f044f0cbf882e338c482003 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:50.604653 13887 raft_consensus.cc:738] T 5235e1a32f044f0cbf882e338c482003 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:54:50.604810 13887 consensus_queue.cc:260] T 5235e1a32f044f0cbf882e338c482003 P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:50.605234 13887 ts_tablet_manager.cc:1428] T 5235e1a32f044f0cbf882e338c482003 P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20250830 07:54:50.611217 13886 tablet_bootstrap.cc:492] T d64f20df166a46249c08444f44422fc3 P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:54:50.611390 13886 ts_tablet_manager.cc:1397] T d64f20df166a46249c08444f44422fc3 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.028s user 0.001s sys 0.008s
I20250830 07:54:50.611884 13233 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet 087bb1e80d2d44bf8619b0341ff99527
I20250830 07:54:50.612095 13886 raft_consensus.cc:357] T d64f20df166a46249c08444f44422fc3 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:50.612314 13886 raft_consensus.cc:383] T d64f20df166a46249c08444f44422fc3 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:50.612408 13886 raft_consensus.cc:738] T d64f20df166a46249c08444f44422fc3 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:54:50.612597 13233 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_8c4ddf0970974f489ce646ddef8c1b22"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250830 07:54:50.612700 13886 consensus_queue.cc:260] T d64f20df166a46249c08444f44422fc3 P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
W20250830 07:54:50.613090 13233 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8c4ddf0970974f489ce646ddef8c1b22 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:50.613456 13886 ts_tablet_manager.cc:1428] T d64f20df166a46249c08444f44422fc3 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20250830 07:54:50.613726 13886 tablet_bootstrap.cc:492] T a8baad9c419e436b9659d8d5582d4066 P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:54:50.615434 13886 tablet_bootstrap.cc:654] T a8baad9c419e436b9659d8d5582d4066 P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:50.615489 13887 tablet_bootstrap.cc:492] T 3bb48fce24074a8e8ec99d3172a655d8 P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:54:50.617024 13887 tablet_bootstrap.cc:654] T 3bb48fce24074a8e8ec99d3172a655d8 P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:50.617868 13602 tablet_service.cc:1515] Processing DeleteTablet for tablet 087bb1e80d2d44bf8619b0341ff99527 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:50 UTC) from {username='slave'} at 127.0.0.1:45306
W20250830 07:54:50.618546 13220 catalog_manager.cc:4908] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet 087bb1e80d2d44bf8619b0341ff99527 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 087bb1e80d2d44bf8619b0341ff99527 already in progress: creating tablet
I20250830 07:54:50.619928 13882 ts_tablet_manager.cc:1428] T 856e644662334f8194ffef6ca1232248 P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.017s user 0.000s sys 0.002s
I20250830 07:54:50.623359 13882 tablet_bootstrap.cc:492] T 09586fdda94c4aff9d3fa25d71fe6ac0 P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:54:50.635628 13886 tablet_bootstrap.cc:492] T a8baad9c419e436b9659d8d5582d4066 P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:54:50.635627 13887 tablet_bootstrap.cc:492] T 3bb48fce24074a8e8ec99d3172a655d8 P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:54:50.635756 13887 ts_tablet_manager.cc:1397] T 3bb48fce24074a8e8ec99d3172a655d8 P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.020s user 0.002s sys 0.007s
I20250830 07:54:50.635857 13886 ts_tablet_manager.cc:1397] T a8baad9c419e436b9659d8d5582d4066 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.022s user 0.003s sys 0.001s
I20250830 07:54:50.636341 13887 raft_consensus.cc:357] T 3bb48fce24074a8e8ec99d3172a655d8 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:50.636495 13887 raft_consensus.cc:383] T 3bb48fce24074a8e8ec99d3172a655d8 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:50.636554 13887 raft_consensus.cc:738] T 3bb48fce24074a8e8ec99d3172a655d8 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:54:50.636461 13886 raft_consensus.cc:357] T a8baad9c419e436b9659d8d5582d4066 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:50.636768 13886 raft_consensus.cc:383] T a8baad9c419e436b9659d8d5582d4066 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:50.636750 13887 consensus_queue.cc:260] T 3bb48fce24074a8e8ec99d3172a655d8 P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:50.636847 13886 raft_consensus.cc:738] T a8baad9c419e436b9659d8d5582d4066 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:54:50.637276 13887 ts_tablet_manager.cc:1428] T 3bb48fce24074a8e8ec99d3172a655d8 P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.001s user 0.001s sys 0.001s
I20250830 07:54:50.637576 13887 tablet_bootstrap.cc:492] T 23d2c7013c9c4b4aacf47e6ac7ab5a0b P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:54:50.637596 13886 consensus_queue.cc:260] T a8baad9c419e436b9659d8d5582d4066 P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:50.638181 13886 ts_tablet_manager.cc:1428] T a8baad9c419e436b9659d8d5582d4066 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20250830 07:54:50.639182 13887 tablet_bootstrap.cc:654] T 23d2c7013c9c4b4aacf47e6ac7ab5a0b P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:50.641782 13886 tablet_bootstrap.cc:492] T d37fe59b4f964f30bb1ed4cb00868b75 P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:54:50.643157 13886 tablet_bootstrap.cc:654] T d37fe59b4f964f30bb1ed4cb00868b75 P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:50.649153 13887 tablet_bootstrap.cc:492] T 23d2c7013c9c4b4aacf47e6ac7ab5a0b P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:54:50.649333 13887 ts_tablet_manager.cc:1397] T 23d2c7013c9c4b4aacf47e6ac7ab5a0b P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.012s user 0.004s sys 0.000s
I20250830 07:54:50.649885 13882 tablet_bootstrap.cc:654] T 09586fdda94c4aff9d3fa25d71fe6ac0 P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:50.649937 13887 raft_consensus.cc:357] T 23d2c7013c9c4b4aacf47e6ac7ab5a0b P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:50.650202 13887 raft_consensus.cc:383] T 23d2c7013c9c4b4aacf47e6ac7ab5a0b P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:50.650295 13887 raft_consensus.cc:738] T 23d2c7013c9c4b4aacf47e6ac7ab5a0b P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:54:50.650548 13887 consensus_queue.cc:260] T 23d2c7013c9c4b4aacf47e6ac7ab5a0b P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:50.650987 13887 ts_tablet_manager.cc:1428] T 23d2c7013c9c4b4aacf47e6ac7ab5a0b P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20250830 07:54:50.651413 13887 tablet_bootstrap.cc:492] T 3c9dd258e6be47f68e039e4cdcd899b2 P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:54:50.651408 13229 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_a82bd61017e3429693a4eb4b2b96b67b" } modify_external_catalogs: true
I20250830 07:54:50.651604 13229 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_a82bd61017e3429693a4eb4b2b96b67b" } modify_external_catalogs: true
I20250830 07:54:50.652709 13887 tablet_bootstrap.cc:654] T 3c9dd258e6be47f68e039e4cdcd899b2 P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:50.656473 13886 tablet_bootstrap.cc:492] T d37fe59b4f964f30bb1ed4cb00868b75 P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:54:50.656579 13886 ts_tablet_manager.cc:1397] T d37fe59b4f964f30bb1ed4cb00868b75 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.015s user 0.002s sys 0.000s
I20250830 07:54:50.657130 13886 raft_consensus.cc:357] T d37fe59b4f964f30bb1ed4cb00868b75 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:50.657265 13886 raft_consensus.cc:383] T d37fe59b4f964f30bb1ed4cb00868b75 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:50.657315 13886 raft_consensus.cc:738] T d37fe59b4f964f30bb1ed4cb00868b75 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:54:50.657464 13886 consensus_queue.cc:260] T d37fe59b4f964f30bb1ed4cb00868b75 P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:50.657830 13886 ts_tablet_manager.cc:1428] T d37fe59b4f964f30bb1ed4cb00868b75 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20250830 07:54:50.658049 13886 tablet_bootstrap.cc:492] T ff72a0fd9a0e46a6bd54a15e4ad783b4 P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:54:50.665350 13886 tablet_bootstrap.cc:654] T ff72a0fd9a0e46a6bd54a15e4ad783b4 P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:50.668123 15237 raft_consensus.cc:491] T e6b7646588fe4134b2db62ff84ca4791 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:50.668287 15237 raft_consensus.cc:513] T e6b7646588fe4134b2db62ff84ca4791 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:50.668933 15237 leader_election.cc:290] T e6b7646588fe4134b2db62ff84ca4791 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
W20250830 07:54:50.669781 13561 leader_election.cc:343] T e6b7646588fe4134b2db62ff84ca4791 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): Not found: Tablet not found: e6b7646588fe4134b2db62ff84ca4791
I20250830 07:54:50.670432 13775 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "e6b7646588fe4134b2db62ff84ca4791" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:50.671067 13562 leader_election.cc:304] T e6b7646588fe4134b2db62ff84ca4791 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b5e454d98894637b466ea27f1b647f9; no voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:54:50.671475 15237 raft_consensus.cc:2747] T e6b7646588fe4134b2db62ff84ca4791 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:54:50.686676 13886 tablet_bootstrap.cc:492] T ff72a0fd9a0e46a6bd54a15e4ad783b4 P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:54:50.686861 13886 ts_tablet_manager.cc:1397] T ff72a0fd9a0e46a6bd54a15e4ad783b4 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.029s user 0.002s sys 0.002s
I20250830 07:54:50.687979 13886 raft_consensus.cc:357] T ff72a0fd9a0e46a6bd54a15e4ad783b4 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:50.688192 13886 raft_consensus.cc:383] T ff72a0fd9a0e46a6bd54a15e4ad783b4 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:50.688320 13886 raft_consensus.cc:738] T ff72a0fd9a0e46a6bd54a15e4ad783b4 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:54:50.688611 13886 consensus_queue.cc:260] T ff72a0fd9a0e46a6bd54a15e4ad783b4 P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:50.689216 13886 ts_tablet_manager.cc:1428] T ff72a0fd9a0e46a6bd54a15e4ad783b4 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20250830 07:54:50.689555 13886 tablet_bootstrap.cc:492] T 9ffa3c1d128c49c8b8e2566c6a64304a P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:54:50.691170 13228 master_service.cc:948] ReplaceTablet: received request to replace tablet 3bb48fce24074a8e8ec99d3172a655d8 from {username='slave'} at 127.0.0.1:42126
I20250830 07:54:50.695103 15245 raft_consensus.cc:491] T a04bf79de30a42a98e71f622efc90c22 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:50.695140 13886 tablet_bootstrap.cc:654] T 9ffa3c1d128c49c8b8e2566c6a64304a P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:50.695210 15245 raft_consensus.cc:513] T a04bf79de30a42a98e71f622efc90c22 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:50.695734 15245 leader_election.cc:290] T a04bf79de30a42a98e71f622efc90c22 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
W20250830 07:54:50.696723 13701 leader_election.cc:343] T a04bf79de30a42a98e71f622efc90c22 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): Not found: Tablet not found: a04bf79de30a42a98e71f622efc90c22
I20250830 07:54:50.714145 13886 tablet_bootstrap.cc:492] T 9ffa3c1d128c49c8b8e2566c6a64304a P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:54:50.714267 13886 ts_tablet_manager.cc:1397] T 9ffa3c1d128c49c8b8e2566c6a64304a P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.025s user 0.002s sys 0.002s
I20250830 07:54:50.715013 13886 raft_consensus.cc:357] T 9ffa3c1d128c49c8b8e2566c6a64304a P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:50.715138 13886 raft_consensus.cc:383] T 9ffa3c1d128c49c8b8e2566c6a64304a P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:50.715184 13886 raft_consensus.cc:738] T 9ffa3c1d128c49c8b8e2566c6a64304a P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:54:50.715354 13886 consensus_queue.cc:260] T 9ffa3c1d128c49c8b8e2566c6a64304a P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:50.715801 13886 ts_tablet_manager.cc:1428] T 9ffa3c1d128c49c8b8e2566c6a64304a P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250830 07:54:50.716023 13886 tablet_bootstrap.cc:492] T 70703eb1d47841a1a227e277ed6a268d P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
W20250830 07:54:50.718725 13703 leader_election.cc:343] T a04bf79de30a42a98e71f622efc90c22 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Not found: Tablet not found: a04bf79de30a42a98e71f622efc90c22
I20250830 07:54:50.718820 13703 leader_election.cc:304] T a04bf79de30a42a98e71f622efc90c22 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 2065c332f15a4739899af79f3669c3ba, 6b5e454d98894637b466ea27f1b647f9
I20250830 07:54:50.719504 15245 raft_consensus.cc:2747] T a04bf79de30a42a98e71f622efc90c22 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20250830 07:54:50.719751 13886 tablet_bootstrap.cc:654] T 70703eb1d47841a1a227e277ed6a268d P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:50.732374 13231 catalog_manager.cc:5864] Not sending DeleteTablet requests; no consensus state for tablet 034432105c9745b4a02227e65faab578
I20250830 07:54:50.740461 13887 tablet_bootstrap.cc:492] T 3c9dd258e6be47f68e039e4cdcd899b2 P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:54:50.740662 13887 ts_tablet_manager.cc:1397] T 3c9dd258e6be47f68e039e4cdcd899b2 P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.089s user 0.011s sys 0.008s
I20250830 07:54:50.741245 13887 raft_consensus.cc:357] T 3c9dd258e6be47f68e039e4cdcd899b2 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:50.741469 13887 raft_consensus.cc:383] T 3c9dd258e6be47f68e039e4cdcd899b2 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:50.741556 13887 raft_consensus.cc:738] T 3c9dd258e6be47f68e039e4cdcd899b2 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:54:50.741823 13887 consensus_queue.cc:260] T 3c9dd258e6be47f68e039e4cdcd899b2 P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:50.742357 13887 ts_tablet_manager.cc:1428] T 3c9dd258e6be47f68e039e4cdcd899b2 P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20250830 07:54:50.743818 13886 tablet_bootstrap.cc:492] T 70703eb1d47841a1a227e277ed6a268d P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:54:50.744011 13886 ts_tablet_manager.cc:1397] T 70703eb1d47841a1a227e277ed6a268d P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.028s user 0.006s sys 0.001s
I20250830 07:54:50.744730 13886 raft_consensus.cc:357] T 70703eb1d47841a1a227e277ed6a268d P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:50.744931 13886 raft_consensus.cc:383] T 70703eb1d47841a1a227e277ed6a268d P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:50.745021 13886 raft_consensus.cc:738] T 70703eb1d47841a1a227e277ed6a268d P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:54:50.745283 13886 consensus_queue.cc:260] T 70703eb1d47841a1a227e277ed6a268d P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:50.745913 13886 ts_tablet_manager.cc:1428] T 70703eb1d47841a1a227e277ed6a268d P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20250830 07:54:50.750552 13612 raft_consensus.cc:3058] T 66d59910b4b2451a851e9d2728d50f42 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:50.751140 13887 tablet_bootstrap.cc:492] T a8baad9c419e436b9659d8d5582d4066 P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:54:50.752521 13887 tablet_bootstrap.cc:654] T a8baad9c419e436b9659d8d5582d4066 P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:50.767748 13232 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_7c5efa2ac47f4d1583ab3a89270e94f9" } new_table_name: "default.Table_ae6a18b6912546819781d5cde5995524" modify_external_catalogs: true
I20250830 07:54:50.771199 13233 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_5f5c89c4cba84fe0b7ffb6b9b8254eec"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:50.771770 13233 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5f5c89c4cba84fe0b7ffb6b9b8254eec in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:50.774580 13234 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_85af6852b3b948dbbb9d49294dc2ee25"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:50.775066 13234 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_85af6852b3b948dbbb9d49294dc2ee25 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:50.776404 13886 tablet_bootstrap.cc:492] T 519b3e58b63b402d84e234f5e180b98c P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:54:50.776515 13227 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_714f4e74f99d42399d305344ea3dab28"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:50.777499 13227 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_714f4e74f99d42399d305344ea3dab28 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:50.782269 13230 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_f440bd2200c547deb37ad7cba486eb5a" } modify_external_catalogs: true
I20250830 07:54:50.782444 13230 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_f440bd2200c547deb37ad7cba486eb5a" } modify_external_catalogs: true
W20250830 07:54:50.789243 13225 catalog_manager.cc:5415] Ignoring report from unknown tablet d37fe59b4f964f30bb1ed4cb00868b75
I20250830 07:54:50.789258 13886 tablet_bootstrap.cc:654] T 519b3e58b63b402d84e234f5e180b98c P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
W20250830 07:54:50.789350 13225 catalog_manager.cc:5415] Ignoring report from unknown tablet 44313f1a11b74e6d996cafd3c03d1836
W20250830 07:54:50.789403 13225 catalog_manager.cc:5415] Ignoring report from unknown tablet f0144701d459480d96c1ece519951442
W20250830 07:54:50.789470 13225 catalog_manager.cc:5415] Ignoring report from unknown tablet c0147310dad84226808332a4c2c6e09d
W20250830 07:54:50.789528 13225 catalog_manager.cc:5415] Ignoring report from unknown tablet 4c4a8eea119044b49e2b29f10a703097
W20250830 07:54:50.789673 13225 catalog_manager.cc:5415] Ignoring report from unknown tablet ec4a3975961d4f85ad9da94835417574
W20250830 07:54:50.789765 13225 catalog_manager.cc:5415] Ignoring report from unknown tablet 4828280e6fec4338b35422917966ac8c
W20250830 07:54:50.789878 13225 catalog_manager.cc:5415] Ignoring report from unknown tablet b83dfc54383d4e7b96523568aea5c9f3
W20250830 07:54:50.789937 13225 catalog_manager.cc:5415] Ignoring report from unknown tablet e6491d149c0646848680cfdadb6fc76c
W20250830 07:54:50.789997 13225 catalog_manager.cc:5415] Ignoring report from unknown tablet 66d59910b4b2451a851e9d2728d50f42
W20250830 07:54:50.790076 13225 catalog_manager.cc:5415] Ignoring report from unknown tablet 01771fa171374e92892345e7402c33d1
W20250830 07:54:50.790140 13225 catalog_manager.cc:5415] Ignoring report from unknown tablet 73853894da074ecd8147a94ac28bfab8
W20250830 07:54:50.790194 13225 catalog_manager.cc:5415] Ignoring report from unknown tablet acca1a8240454b889c63c82d3c75087e
W20250830 07:54:50.790261 13225 catalog_manager.cc:5415] Ignoring report from unknown tablet 6a82ea7078e344a497c34f932e139bcd
W20250830 07:54:50.790314 13225 catalog_manager.cc:5415] Ignoring report from unknown tablet 8ae468b43b4c450ca7591b543c2539d9
W20250830 07:54:50.790380 13225 catalog_manager.cc:5415] Ignoring report from unknown tablet d3f207cee78a43a1b5e030c09752c78c
W20250830 07:54:50.790463 13225 catalog_manager.cc:5415] Ignoring report from unknown tablet 2b4ce50fbd26484faba3faa2ec5115c0
W20250830 07:54:50.790553 13225 catalog_manager.cc:5415] Ignoring report from unknown tablet e6b7646588fe4134b2db62ff84ca4791
W20250830 07:54:50.790608 13225 catalog_manager.cc:5415] Ignoring report from unknown tablet a8baad9c419e436b9659d8d5582d4066
W20250830 07:54:50.790735 13225 catalog_manager.cc:5415] Ignoring report from unknown tablet 0507245aa8c74aeb9f3eafba0682590d
W20250830 07:54:50.790787 13225 catalog_manager.cc:5415] Ignoring report from unknown tablet a41c1455404f4ed0a782a0c4ddd4140d
W20250830 07:54:50.790843 13225 catalog_manager.cc:5415] Ignoring report from unknown tablet 4b403cadfb7b42f8896b2ee16b50ecb1
W20250830 07:54:50.794301 13231 catalog_manager.cc:5415] Ignoring report from unknown tablet 23d2c7013c9c4b4aacf47e6ac7ab5a0b
W20250830 07:54:50.794450 13231 catalog_manager.cc:5415] Ignoring report from unknown tablet 5235e1a32f044f0cbf882e338c482003
W20250830 07:54:50.794509 13231 catalog_manager.cc:5415] Ignoring report from unknown tablet 4b403cadfb7b42f8896b2ee16b50ecb1
I20250830 07:54:50.807878 15009 raft_consensus.cc:491] T 924403105a6a40f28aad60647a2a8987 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:50.808005 15009 raft_consensus.cc:513] T 924403105a6a40f28aad60647a2a8987 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
W20250830 07:54:50.790886 13225 catalog_manager.cc:5415] Ignoring report from unknown tablet 28c2f7a3a6dd444585f0f5d337b985e9
I20250830 07:54:50.808562 15009 leader_election.cc:290] T 924403105a6a40f28aad60647a2a8987 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:50.809203 13775 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "924403105a6a40f28aad60647a2a8987" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:50.809306 13624 raft_consensus.cc:3058] T ec4a3975961d4f85ad9da94835417574 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Advancing to term 1
W20250830 07:54:50.809697 13422 leader_election.cc:343] T 924403105a6a40f28aad60647a2a8987 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Illegal state: must be running to vote when last-logged opid is not known
W20250830 07:54:50.810612 13225 catalog_manager.cc:5415] Ignoring report from unknown tablet d2b8e6df64ef49e2ba36c093efd3c351
I20250830 07:54:50.811061 13229 catalog_manager.cc:5864] Not sending DeleteTablet requests; no consensus state for tablet ad412e24e3e841eda67288cb1f9aea04
I20250830 07:54:50.811491 13229 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_439642f4ff764ffb9bec5b62836ea3c9" } new_table_name: "default.Table_a7fa8986aeef48c8853824d6a9d7444c" modify_external_catalogs: true
I20250830 07:54:50.812275 13225 catalog_manager.cc:5674] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743) does not have the latest schema for tablet aee84a97524e4568acdc4ae1c74fb492 (table default.Table_c3c97f9e7537410bbc60629e7bd27373 [id=18b2c25896e546748465c4807b839cbf]). Expected version 3 got 0
I20250830 07:54:50.812528 13225 catalog_manager.cc:5674] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743) does not have the latest schema for tablet 74891b8103e144c486750f64ba2003f4 (table default.Table_f898ce75325a436ca3a63a3c9e46fb68 [id=63f62da0ba61488791fcce76368d92a8]). Expected version 1 got 0
I20250830 07:54:50.812731 13225 catalog_manager.cc:5674] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743) does not have the latest schema for tablet 13df49c2c2cd4e5cae26a540835b74c9 (table default.Table_cbbde0aa8e5b47e69f1a0db288d36cdf [id=f366e4f894174aeb837a8749180c3a34]). Expected version 1 got 0
I20250830 07:54:50.812892 13225 catalog_manager.cc:5674] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743) does not have the latest schema for tablet d64f20df166a46249c08444f44422fc3 (table default.Table_7a50f4e8c38f4807b9e0bf1f22e2eddb [id=26a7abb1aee44e438ca996ebb2ab37b2]). Expected version 3 got 0
I20250830 07:54:50.813511 13233 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_51f119b48b6b48c0b21224e17a10dd5e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:50.813946 13233 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_51f119b48b6b48c0b21224e17a10dd5e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250830 07:54:50.814514 13232 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet b731285205a942c8b41ca06df5274636 consensus state has no leader
I20250830 07:54:50.814859 13232 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_edf75eb4c974487a8a012311104d7c13"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:50.815284 13232 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_edf75eb4c974487a8a012311104d7c13 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:50.818238 13622 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "924403105a6a40f28aad60647a2a8987" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:50.818533 13615 raft_consensus.cc:3058] T e6b7646588fe4134b2db62ff84ca4791 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Advancing to term 1
W20250830 07:54:50.818728 13703 consensus_peers.cc:489] T 3525652a73b8413b8ccbcb5824cc5880 P 9b057ade5dce45af9f8bf0bedf8b917f -> Peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Couldn't send request to peer 6b5e454d98894637b466ea27f1b647f9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20250830 07:54:50.813053 13225 catalog_manager.cc:5674] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743) does not have the latest schema for tablet 0ceccc5f18294356894695fe08d73e30 (table default.Table_32d032fe8fba47348e797c68bb7ea866 [id=0e99ba575a7a4f8dae74a98627249018]). Expected version 1 got 0
I20250830 07:54:50.820993 13225 catalog_manager.cc:5674] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743) does not have the latest schema for tablet 856e644662334f8194ffef6ca1232248 (table default.Table_5a48429e0b894a6ea2c01b3ce40de1e9 [id=fe3e5972240046eaa659a06b4eea8648]). Expected version 1 got 0
I20250830 07:54:50.821588 13887 tablet_bootstrap.cc:492] T a8baad9c419e436b9659d8d5582d4066 P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:54:50.821571 13225 catalog_manager.cc:5674] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743) does not have the latest schema for tablet ff72a0fd9a0e46a6bd54a15e4ad783b4 (table default.Table_85e7f0b13c094fd7841dcabce61fd911 [id=de7b214458f247ef831f43727543afc5]). Expected version 1 got 0
I20250830 07:54:50.821710 13887 ts_tablet_manager.cc:1397] T a8baad9c419e436b9659d8d5582d4066 P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.071s user 0.003s sys 0.004s
I20250830 07:54:50.822248 13887 raft_consensus.cc:357] T a8baad9c419e436b9659d8d5582d4066 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:50.822378 13887 raft_consensus.cc:383] T a8baad9c419e436b9659d8d5582d4066 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:50.822414 13887 raft_consensus.cc:738] T a8baad9c419e436b9659d8d5582d4066 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:54:50.822566 13887 consensus_queue.cc:260] T a8baad9c419e436b9659d8d5582d4066 P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:50.822643 15248 raft_consensus.cc:491] T ec47a59c22ff4370bd21bc2a18336049 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:50.822178 13225 catalog_manager.cc:5674] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743) does not have the latest schema for tablet 29f0695563854e45965a1cc36ac54138 (table default.Table_e40b329adbd0475da2669620084f75f3 [id=7d0a5ef4aaf64241be34eba188f2cbcd]). Expected version 2 got 0
I20250830 07:54:50.822743 15248 raft_consensus.cc:513] T ec47a59c22ff4370bd21bc2a18336049 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:50.822950 13887 ts_tablet_manager.cc:1428] T a8baad9c419e436b9659d8d5582d4066 P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.001s user 0.001s sys 0.001s
I20250830 07:54:50.823192 13887 tablet_bootstrap.cc:492] T 3c3c798b2b7b460b98a30605464763e6 P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:54:50.823302 15248 leader_election.cc:290] T ec47a59c22ff4370bd21bc2a18336049 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:50.824271 13764 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "ec47a59c22ff4370bd21bc2a18336049" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
W20250830 07:54:50.824713 13423 leader_election.cc:343] T 924403105a6a40f28aad60647a2a8987 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:50.824797 13423 leader_election.cc:304] T 924403105a6a40f28aad60647a2a8987 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba; no voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:54:50.825188 15115 raft_consensus.cc:2747] T 924403105a6a40f28aad60647a2a8987 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20250830 07:54:50.825337 13422 leader_election.cc:343] T ec47a59c22ff4370bd21bc2a18336049 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:50.826943 13887 tablet_bootstrap.cc:654] T 3c3c798b2b7b460b98a30605464763e6 P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:50.832757 13614 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "ec47a59c22ff4370bd21bc2a18336049" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
W20250830 07:54:50.835987 13423 leader_election.cc:343] T ec47a59c22ff4370bd21bc2a18336049 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:50.836083 13423 leader_election.cc:304] T ec47a59c22ff4370bd21bc2a18336049 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba; no voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:54:50.836465 15115 raft_consensus.cc:2747] T ec47a59c22ff4370bd21bc2a18336049 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:54:50.836900 13622 raft_consensus.cc:3058] T acca1a8240454b889c63c82d3c75087e P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:50.840960 15009 raft_consensus.cc:491] T 8cce7e5537794e9484f5a7c82b9e6e1d P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:50.841069 15009 raft_consensus.cc:513] T 8cce7e5537794e9484f5a7c82b9e6e1d P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:50.841617 15009 leader_election.cc:290] T 8cce7e5537794e9484f5a7c82b9e6e1d P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:50.843242 13775 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "8cce7e5537794e9484f5a7c82b9e6e1d" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
W20250830 07:54:50.843766 13422 leader_election.cc:343] T 8cce7e5537794e9484f5a7c82b9e6e1d P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:50.844501 13614 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "8cce7e5537794e9484f5a7c82b9e6e1d" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
W20250830 07:54:50.845244 13423 leader_election.cc:343] T 8cce7e5537794e9484f5a7c82b9e6e1d P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:50.845332 13423 leader_election.cc:304] T 8cce7e5537794e9484f5a7c82b9e6e1d P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba; no voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:54:50.845703 15115 raft_consensus.cc:2747] T 8cce7e5537794e9484f5a7c82b9e6e1d P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:54:50.846242 13882 tablet_bootstrap.cc:492] T 09586fdda94c4aff9d3fa25d71fe6ac0 P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:54:50.847426 13882 ts_tablet_manager.cc:1397] T 09586fdda94c4aff9d3fa25d71fe6ac0 P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.224s user 0.011s sys 0.008s
W20250830 07:54:50.868861 13225 catalog_manager.cc:5415] Ignoring report from unknown tablet 70703eb1d47841a1a227e277ed6a268d
W20250830 07:54:50.869063 13225 catalog_manager.cc:5415] Ignoring report from unknown tablet 44313f1a11b74e6d996cafd3c03d1836
W20250830 07:54:50.869168 13225 catalog_manager.cc:5415] Ignoring report from unknown tablet 4c4a8eea119044b49e2b29f10a703097
W20250830 07:54:50.869637 13225 catalog_manager.cc:5415] Ignoring report from unknown tablet 4828280e6fec4338b35422917966ac8c
W20250830 07:54:50.870113 13225 catalog_manager.cc:5415] Ignoring report from unknown tablet 01771fa171374e92892345e7402c33d1
I20250830 07:54:50.871887 13886 tablet_bootstrap.cc:492] T 519b3e58b63b402d84e234f5e180b98c P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:54:50.872017 13886 ts_tablet_manager.cc:1397] T 519b3e58b63b402d84e234f5e180b98c P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.096s user 0.001s sys 0.001s
I20250830 07:54:50.872689 13886 raft_consensus.cc:357] T 519b3e58b63b402d84e234f5e180b98c P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:50.872844 13886 raft_consensus.cc:383] T 519b3e58b63b402d84e234f5e180b98c P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:50.872896 13886 raft_consensus.cc:738] T 519b3e58b63b402d84e234f5e180b98c P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:54:50.873095 13886 consensus_queue.cc:260] T 519b3e58b63b402d84e234f5e180b98c P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:50.873510 13886 ts_tablet_manager.cc:1428] T 519b3e58b63b402d84e234f5e180b98c P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
W20250830 07:54:50.876319 13220 catalog_manager.cc:4726] Async tablet task AlterTable RPC for tablet b731285205a942c8b41ca06df5274636 (table default.Table_ae6a18b6912546819781d5cde5995524 [id=97f7e71b5e3043b7a2e6c2eae33f18a2], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet b731285205a942c8b41ca06df5274636 consensus state has no leader
I20250830 07:54:50.884938 13886 tablet_bootstrap.cc:492] T 5235e1a32f044f0cbf882e338c482003 P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:54:50.886580 13886 tablet_bootstrap.cc:654] T 5235e1a32f044f0cbf882e338c482003 P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:50.896013 13887 tablet_bootstrap.cc:492] T 3c3c798b2b7b460b98a30605464763e6 P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:54:50.896142 13887 ts_tablet_manager.cc:1397] T 3c3c798b2b7b460b98a30605464763e6 P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.073s user 0.005s sys 0.000s
I20250830 07:54:50.896761 13887 raft_consensus.cc:357] T 3c3c798b2b7b460b98a30605464763e6 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:50.896903 13887 raft_consensus.cc:383] T 3c3c798b2b7b460b98a30605464763e6 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:50.896945 13887 raft_consensus.cc:738] T 3c3c798b2b7b460b98a30605464763e6 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:54:50.897219 13887 consensus_queue.cc:260] T 3c3c798b2b7b460b98a30605464763e6 P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:50.899665 13227 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_be8b189bfdc7429499032a5cb02b19cd" } new_table_name: "default.Table_dfc647b17b2544e98af73d3048cf55d9" modify_external_catalogs: true
I20250830 07:54:50.900931 13228 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet 3bb48fce24074a8e8ec99d3172a655d8
I20250830 07:54:50.901472 13230 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet 7efdf13fd50d419da921c28e21c25757
I20250830 07:54:50.901743 13231 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_c6ab1627ea6e446eb1345ca8898a905d" } new_table_name: "default.Table_50d4652c477d4ff08d6d7e52bf96f2f2" modify_external_catalogs: true
I20250830 07:54:50.902011 13230 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_286f41edfff142439df1257c3c4559e0" } modify_external_catalogs: true
W20250830 07:54:50.902446 13229 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet abac856cdaa747f7a162d57c607a359c has no consensus state
I20250830 07:54:50.902719 13229 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_52010ca92ca74b059544914b19145906" } modify_external_catalogs: true
I20250830 07:54:50.902840 13229 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_52010ca92ca74b059544914b19145906" } modify_external_catalogs: true
I20250830 07:54:50.904458 13232 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_506f4acebdfe42b4bfa9608d6427ca70"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:50.904914 13232 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_506f4acebdfe42b4bfa9608d6427ca70 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:50.905315 15115 raft_consensus.cc:491] T 5235e1a32f044f0cbf882e338c482003 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:50.905418 15115 raft_consensus.cc:513] T 5235e1a32f044f0cbf882e338c482003 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:50.905910 15115 leader_election.cc:290] T 5235e1a32f044f0cbf882e338c482003 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:50.906047 13233 master_service.cc:948] ReplaceTablet: received request to replace tablet 7dc061ebaa334c109d1e457e2dc860df from {username='slave'} at 127.0.0.1:42126
I20250830 07:54:50.906571 13775 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "5235e1a32f044f0cbf882e338c482003" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
W20250830 07:54:50.907021 13422 leader_election.cc:343] T 5235e1a32f044f0cbf882e338c482003 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:50.908721 13228 catalog_manager.cc:6652] ReplaceTablet: tablet 3bb48fce24074a8e8ec99d3172a655d8 deleted and replaced by tablet 51d373a917a44a70b9b0c900f3fa0b8e
I20250830 07:54:50.908799 13887 ts_tablet_manager.cc:1428] T 3c3c798b2b7b460b98a30605464763e6 P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.013s user 0.002s sys 0.000s
I20250830 07:54:50.909089 13887 tablet_bootstrap.cc:492] T 70703eb1d47841a1a227e277ed6a268d P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:54:50.909058 13228 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_011b0ea583e6482e81f163f362a9b454"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:50.909585 13228 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_011b0ea583e6482e81f163f362a9b454 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:50.910831 13887 tablet_bootstrap.cc:654] T 70703eb1d47841a1a227e277ed6a268d P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:50.911515 13602 tablet_service.cc:1515] Processing DeleteTablet for tablet 3bb48fce24074a8e8ec99d3172a655d8 with delete_type TABLET_DATA_DELETED (replaced by tablet 51d373a917a44a70b9b0c900f3fa0b8e) from {username='slave'} at 127.0.0.1:45306
I20250830 07:54:50.911698 13593 tablet_service.cc:1515] Processing DeleteTablet for tablet 7efdf13fd50d419da921c28e21c25757 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:50 UTC) from {username='slave'} at 127.0.0.1:45306
I20250830 07:54:50.902163 13230 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_286f41edfff142439df1257c3c4559e0" } modify_external_catalogs: true
W20250830 07:54:50.913623 13220 catalog_manager.cc:4908] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet 3bb48fce24074a8e8ec99d3172a655d8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3bb48fce24074a8e8ec99d3172a655d8 already in progress: creating tablet
W20250830 07:54:50.913841 13220 catalog_manager.cc:4908] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet 7efdf13fd50d419da921c28e21c25757 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7efdf13fd50d419da921c28e21c25757 already in progress: creating tablet
I20250830 07:54:50.927351 13225 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_3abc6459ae534133b6d4f903931c1389" } new_table_name: "default.Table_41f84caea9ad4a22ad498cf3e5de6242" modify_external_catalogs: true
I20250830 07:54:50.911510 13536 heartbeater.cc:344] Connected to a master server at 127.12.209.60:43889
I20250830 07:54:50.922325 15009 raft_consensus.cc:491] T c1e0e774b86d4ef9a75e2635295f3e2a P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:50.929210 15009 raft_consensus.cc:513] T c1e0e774b86d4ef9a75e2635295f3e2a P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:50.929555 15259 raft_consensus.cc:491] T f1fe024f0de048a5a0931ee38752d5a1 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:50.929690 15259 raft_consensus.cc:513] T f1fe024f0de048a5a0931ee38752d5a1 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:50.929805 15009 leader_election.cc:290] T c1e0e774b86d4ef9a75e2635295f3e2a P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:50.930260 15259 leader_election.cc:290] T f1fe024f0de048a5a0931ee38752d5a1 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:50.930258 13775 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "c1e0e774b86d4ef9a75e2635295f3e2a" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
W20250830 07:54:50.930763 13422 leader_election.cc:343] T c1e0e774b86d4ef9a75e2635295f3e2a P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Illegal state: must be running to vote when last-logged opid is not known
W20250830 07:54:50.931176 13561 leader_election.cc:343] T f1fe024f0de048a5a0931ee38752d5a1 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): Not found: Tablet not found: f1fe024f0de048a5a0931ee38752d5a1
W20250830 07:54:50.932380 13234 catalog_manager.cc:5415] Ignoring report from unknown tablet a8baad9c419e436b9659d8d5582d4066
I20250830 07:54:50.933626 13882 raft_consensus.cc:357] T 09586fdda94c4aff9d3fa25d71fe6ac0 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:50.933782 13882 raft_consensus.cc:383] T 09586fdda94c4aff9d3fa25d71fe6ac0 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:50.933828 13882 raft_consensus.cc:738] T 09586fdda94c4aff9d3fa25d71fe6ac0 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:54:50.933998 13882 consensus_queue.cc:260] T 09586fdda94c4aff9d3fa25d71fe6ac0 P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:50.937232 15246 raft_consensus.cc:491] T de3a52a8e08a45808373902a0185e6f0 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:50.937352 15246 raft_consensus.cc:513] T de3a52a8e08a45808373902a0185e6f0 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:50.937891 15246 leader_election.cc:290] T de3a52a8e08a45808373902a0185e6f0 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967)
I20250830 07:54:50.938967 13482 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "de3a52a8e08a45808373902a0185e6f0" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:54:50.939123 13482 raft_consensus.cc:2466] T de3a52a8e08a45808373902a0185e6f0 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 0.
I20250830 07:54:50.939558 13701 leader_election.cc:304] T de3a52a8e08a45808373902a0185e6f0 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters:
I20250830 07:54:50.940071 15246 raft_consensus.cc:2802] T de3a52a8e08a45808373902a0185e6f0 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:54:50.940152 15246 raft_consensus.cc:491] T de3a52a8e08a45808373902a0185e6f0 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:54:50.940220 15246 raft_consensus.cc:3058] T de3a52a8e08a45808373902a0185e6f0 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:50.944278 15246 raft_consensus.cc:513] T de3a52a8e08a45808373902a0185e6f0 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:50.944628 13882 ts_tablet_manager.cc:1428] T 09586fdda94c4aff9d3fa25d71fe6ac0 P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.096s user 0.001s sys 0.001s
I20250830 07:54:50.945164 13482 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "de3a52a8e08a45808373902a0185e6f0" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba"
I20250830 07:54:50.945292 13882 tablet_bootstrap.cc:492] T 13df49c2c2cd4e5cae26a540835b74c9 P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:54:50.945327 13482 raft_consensus.cc:3058] T de3a52a8e08a45808373902a0185e6f0 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:50.949227 13482 raft_consensus.cc:2466] T de3a52a8e08a45808373902a0185e6f0 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 1.
I20250830 07:54:50.949677 13701 leader_election.cc:304] T de3a52a8e08a45808373902a0185e6f0 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters:
I20250830 07:54:50.949929 14975 raft_consensus.cc:2802] T de3a52a8e08a45808373902a0185e6f0 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election won for term 1
I20250830 07:54:50.950033 14975 raft_consensus.cc:695] T de3a52a8e08a45808373902a0185e6f0 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 LEADER]: Becoming Leader. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Running, Role: LEADER
I20250830 07:54:50.950332 14975 consensus_queue.cc:237] T de3a52a8e08a45808373902a0185e6f0 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
W20250830 07:54:50.953190 13561 consensus_peers.cc:489] T 8eb010d7955d47a89ff1d01be1b5b01e P 6b5e454d98894637b466ea27f1b647f9 -> Peer 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): Couldn't send request to peer 2065c332f15a4739899af79f3669c3ba. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8eb010d7955d47a89ff1d01be1b5b01e. This is attempt 1: this message will repeat every 5th retry.
I20250830 07:54:50.954067 15245 raft_consensus.cc:491] T 04eadf45b82e4c319eb7b316a402d81a P 9b057ade5dce45af9f8bf0bedf8b917f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:50.954186 15245 raft_consensus.cc:513] T 04eadf45b82e4c319eb7b316a402d81a P 9b057ade5dce45af9f8bf0bedf8b917f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:50.954704 15245 leader_election.cc:290] T 04eadf45b82e4c319eb7b316a402d81a P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
I20250830 07:54:50.955489 13482 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "04eadf45b82e4c319eb7b316a402d81a" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:54:50.955698 13482 raft_consensus.cc:2466] T 04eadf45b82e4c319eb7b316a402d81a P 2065c332f15a4739899af79f3669c3ba [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 2.
I20250830 07:54:50.956291 13701 leader_election.cc:304] T 04eadf45b82e4c319eb7b316a402d81a P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters:
I20250830 07:54:50.956720 14975 raft_consensus.cc:2802] T 04eadf45b82e4c319eb7b316a402d81a P 9b057ade5dce45af9f8bf0bedf8b917f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20250830 07:54:50.956799 14975 raft_consensus.cc:491] T 04eadf45b82e4c319eb7b316a402d81a P 9b057ade5dce45af9f8bf0bedf8b917f [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:54:50.956866 14975 raft_consensus.cc:3058] T 04eadf45b82e4c319eb7b316a402d81a P 9b057ade5dce45af9f8bf0bedf8b917f [term 2 FOLLOWER]: Advancing to term 3
I20250830 07:54:50.959439 13619 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "de3a52a8e08a45808373902a0185e6f0" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9"
I20250830 07:54:50.959575 13625 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "de3a52a8e08a45808373902a0185e6f0" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:50.960008 13625 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "c1e0e774b86d4ef9a75e2635295f3e2a" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:50.960031 13611 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "5235e1a32f044f0cbf882e338c482003" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:50.960345 13629 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "04eadf45b82e4c319eb7b316a402d81a" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
W20250830 07:54:50.960662 13562 leader_election.cc:343] T f1fe024f0de048a5a0931ee38752d5a1 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Not found: Tablet not found: f1fe024f0de048a5a0931ee38752d5a1
I20250830 07:54:50.960749 13562 leader_election.cc:304] T f1fe024f0de048a5a0931ee38752d5a1 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b5e454d98894637b466ea27f1b647f9; no voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f
W20250830 07:54:50.961541 13423 leader_election.cc:343] T c1e0e774b86d4ef9a75e2635295f3e2a P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:50.961639 13423 leader_election.cc:304] T c1e0e774b86d4ef9a75e2635295f3e2a P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba; no voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:54:50.961833 14975 raft_consensus.cc:513] T 04eadf45b82e4c319eb7b316a402d81a P 9b057ade5dce45af9f8bf0bedf8b917f [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
W20250830 07:54:50.962036 13423 leader_election.cc:343] T 5235e1a32f044f0cbf882e338c482003 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:50.962122 13423 leader_election.cc:304] T 5235e1a32f044f0cbf882e338c482003 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba; no voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:54:50.962545 15237 raft_consensus.cc:2747] T f1fe024f0de048a5a0931ee38752d5a1 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:54:50.962661 15321 raft_consensus.cc:2747] T c1e0e774b86d4ef9a75e2635295f3e2a P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:54:50.962855 15248 raft_consensus.cc:2747] T 5235e1a32f044f0cbf882e338c482003 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:54:50.963034 15246 leader_election.cc:290] T de3a52a8e08a45808373902a0185e6f0 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Requested vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967)
W20250830 07:54:50.964325 13703 consensus_peers.cc:489] T 8ae468b43b4c450ca7591b543c2539d9 P 9b057ade5dce45af9f8bf0bedf8b917f -> Peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Couldn't send request to peer 6b5e454d98894637b466ea27f1b647f9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20250830 07:54:50.964463 13703 leader_election.cc:343] T de3a52a8e08a45808373902a0185e6f0 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:50.964529 14975 leader_election.cc:290] T 04eadf45b82e4c319eb7b316a402d81a P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 3 election: Requested vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
W20250830 07:54:50.964697 13703 leader_election.cc:343] T de3a52a8e08a45808373902a0185e6f0 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:50.966104 13886 tablet_bootstrap.cc:492] T 5235e1a32f044f0cbf882e338c482003 P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:54:50.966351 14906 consensus_queue.cc:1035] T e4ca3110247640fbae4241448e8d5ef7 P 6b5e454d98894637b466ea27f1b647f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:54:50.966835 13886 ts_tablet_manager.cc:1397] T 5235e1a32f044f0cbf882e338c482003 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.082s user 0.004s sys 0.001s
I20250830 07:54:50.968959 13886 raft_consensus.cc:357] T 5235e1a32f044f0cbf882e338c482003 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:50.969638 13886 raft_consensus.cc:383] T 5235e1a32f044f0cbf882e338c482003 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:50.969821 13886 raft_consensus.cc:738] T 5235e1a32f044f0cbf882e338c482003 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:54:50.970216 13886 consensus_queue.cc:260] T 5235e1a32f044f0cbf882e338c482003 P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:50.971365 13886 ts_tablet_manager.cc:1428] T 5235e1a32f044f0cbf882e338c482003 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20250830 07:54:50.972016 13886 tablet_bootstrap.cc:492] T 95b6f084eb5240ea94c125eaa154ac9f P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:54:50.975478 13882 tablet_bootstrap.cc:654] T 13df49c2c2cd4e5cae26a540835b74c9 P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:50.976823 13612 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "04eadf45b82e4c319eb7b316a402d81a" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9"
I20250830 07:54:50.977169 13887 tablet_bootstrap.cc:492] T 70703eb1d47841a1a227e277ed6a268d P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:54:50.977396 13887 ts_tablet_manager.cc:1397] T 70703eb1d47841a1a227e277ed6a268d P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.068s user 0.001s sys 0.006s
I20250830 07:54:50.980118 13887 raft_consensus.cc:357] T 70703eb1d47841a1a227e277ed6a268d P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:50.980751 13887 raft_consensus.cc:383] T 70703eb1d47841a1a227e277ed6a268d P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20250830 07:54:50.987615 13561 consensus_peers.cc:489] T e4ca3110247640fbae4241448e8d5ef7 P 6b5e454d98894637b466ea27f1b647f9 -> Peer 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): Couldn't send request to peer 2065c332f15a4739899af79f3669c3ba. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e4ca3110247640fbae4241448e8d5ef7. This is attempt 1: this message will repeat every 5th retry.
I20250830 07:54:50.995260 13482 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "04eadf45b82e4c319eb7b316a402d81a" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba"
I20250830 07:54:50.995563 13482 raft_consensus.cc:3058] T 04eadf45b82e4c319eb7b316a402d81a P 2065c332f15a4739899af79f3669c3ba [term 2 FOLLOWER]: Advancing to term 3
I20250830 07:54:50.980913 13887 raft_consensus.cc:738] T 70703eb1d47841a1a227e277ed6a268d P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:54:50.997584 13887 consensus_queue.cc:260] T 70703eb1d47841a1a227e277ed6a268d P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:51.000177 13887 ts_tablet_manager.cc:1428] T 70703eb1d47841a1a227e277ed6a268d P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.022s user 0.002s sys 0.000s
I20250830 07:54:51.001988 13887 tablet_bootstrap.cc:492] T 74f2fcc22fd545fb8ca7c20619843023 P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:54:51.004520 15248 raft_consensus.cc:491] T 23d2c7013c9c4b4aacf47e6ac7ab5a0b P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:51.004652 15248 raft_consensus.cc:513] T 23d2c7013c9c4b4aacf47e6ac7ab5a0b P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:51.005223 15248 leader_election.cc:290] T 23d2c7013c9c4b4aacf47e6ac7ab5a0b P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:51.007089 13614 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "23d2c7013c9c4b4aacf47e6ac7ab5a0b" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:51.008220 15237 consensus_queue.cc:1035] T 8eb010d7955d47a89ff1d01be1b5b01e P 6b5e454d98894637b466ea27f1b647f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:54:51.013885 13775 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "23d2c7013c9c4b4aacf47e6ac7ab5a0b" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
W20250830 07:54:51.015146 13422 leader_election.cc:343] T 23d2c7013c9c4b4aacf47e6ac7ab5a0b P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:51.017035 13887 tablet_bootstrap.cc:654] T 74f2fcc22fd545fb8ca7c20619843023 P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
W20250830 07:54:51.019598 13423 leader_election.cc:343] T 23d2c7013c9c4b4aacf47e6ac7ab5a0b P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:51.019752 13423 leader_election.cc:304] T 23d2c7013c9c4b4aacf47e6ac7ab5a0b P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba; no voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:54:51.020385 15115 raft_consensus.cc:2747] T 23d2c7013c9c4b4aacf47e6ac7ab5a0b P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:54:51.029693 13234 catalog_manager.cc:5674] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325) does not have the latest schema for tablet 3c3c798b2b7b460b98a30605464763e6 (table default.Table_c84716cd62b9446384ad71e0503211db [id=9407d235897b4b56927798496fd114c4]). Expected version 1 got 0
I20250830 07:54:51.031199 13233 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet 7dc061ebaa334c109d1e457e2dc860df
I20250830 07:54:51.031692 13233 catalog_manager.cc:6652] ReplaceTablet: tablet 7dc061ebaa334c109d1e457e2dc860df deleted and replaced by tablet 39fa4ac0699546c99e181c8a187e128e
I20250830 07:54:51.031811 13593 tablet_service.cc:1515] Processing DeleteTablet for tablet 7dc061ebaa334c109d1e457e2dc860df with delete_type TABLET_DATA_DELETED (replaced by tablet 39fa4ac0699546c99e181c8a187e128e) from {username='slave'} at 127.0.0.1:45306
W20250830 07:54:51.032785 13220 catalog_manager.cc:4908] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet 7dc061ebaa334c109d1e457e2dc860df because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7dc061ebaa334c109d1e457e2dc860df already in progress: creating tablet
I20250830 07:54:51.034264 13886 tablet_bootstrap.cc:654] T 95b6f084eb5240ea94c125eaa154ac9f P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:51.037582 15115 raft_consensus.cc:491] T 91705fc35a1b4977b89bac1765c886c0 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:51.037752 13887 tablet_bootstrap.cc:492] T 74f2fcc22fd545fb8ca7c20619843023 P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:54:51.037902 13887 ts_tablet_manager.cc:1397] T 74f2fcc22fd545fb8ca7c20619843023 P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.036s user 0.003s sys 0.001s
I20250830 07:54:51.037695 15115 raft_consensus.cc:513] T 91705fc35a1b4977b89bac1765c886c0 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:51.038522 15115 leader_election.cc:290] T 91705fc35a1b4977b89bac1765c886c0 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:51.039017 15115 raft_consensus.cc:491] T d1bf58d367f54ba8bad64887b9a8d9cc P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:51.039112 15115 raft_consensus.cc:513] T d1bf58d367f54ba8bad64887b9a8d9cc P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:51.039295 13775 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "91705fc35a1b4977b89bac1765c886c0" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:51.039618 15115 leader_election.cc:290] T d1bf58d367f54ba8bad64887b9a8d9cc P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:51.040033 13234 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_c2c6c57d30d440d691f87632feae3633" } modify_external_catalogs: true
I20250830 07:54:51.040294 13234 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_c2c6c57d30d440d691f87632feae3633" } modify_external_catalogs: true
I20250830 07:54:51.040557 13614 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "d1bf58d367f54ba8bad64887b9a8d9cc" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
W20250830 07:54:51.040990 13423 leader_election.cc:343] T d1bf58d367f54ba8bad64887b9a8d9cc P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:51.038540 13887 raft_consensus.cc:357] T 74f2fcc22fd545fb8ca7c20619843023 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:51.041469 13887 raft_consensus.cc:383] T 74f2fcc22fd545fb8ca7c20619843023 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:51.041599 13887 raft_consensus.cc:738] T 74f2fcc22fd545fb8ca7c20619843023 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:54:51.041599 13624 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "91705fc35a1b4977b89bac1765c886c0" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
W20250830 07:54:51.041990 13423 leader_election.cc:343] T 91705fc35a1b4977b89bac1765c886c0 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:51.042466 13775 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "d1bf58d367f54ba8bad64887b9a8d9cc" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
W20250830 07:54:51.042505 13422 leader_election.cc:343] T 91705fc35a1b4977b89bac1765c886c0 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:51.042637 13775 raft_consensus.cc:2466] T d1bf58d367f54ba8bad64887b9a8d9cc P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2065c332f15a4739899af79f3669c3ba in term 0.
I20250830 07:54:51.042663 13422 leader_election.cc:304] T 91705fc35a1b4977b89bac1765c886c0 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba; no voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f
W20250830 07:54:51.031222 13231 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 2f4d321785c84a9eb7d4aa3f5953bdce has no consensus state
I20250830 07:54:51.043409 13231 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_b98c73d6c6324f4b89a004c99c84cdd7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:51.043931 13231 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b98c73d6c6324f4b89a004c99c84cdd7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:51.043944 15115 raft_consensus.cc:2747] T 91705fc35a1b4977b89bac1765c886c0 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:54:51.044262 13422 leader_election.cc:304] T d1bf58d367f54ba8bad64887b9a8d9cc P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:54:51.044478 15115 raft_consensus.cc:2802] T d1bf58d367f54ba8bad64887b9a8d9cc P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:54:51.044539 15115 raft_consensus.cc:491] T d1bf58d367f54ba8bad64887b9a8d9cc P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:54:51.044586 15115 raft_consensus.cc:3058] T d1bf58d367f54ba8bad64887b9a8d9cc P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:51.046695 13886 tablet_bootstrap.cc:492] T 95b6f084eb5240ea94c125eaa154ac9f P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:54:51.046826 13886 ts_tablet_manager.cc:1397] T 95b6f084eb5240ea94c125eaa154ac9f P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.075s user 0.001s sys 0.002s
I20250830 07:54:51.047559 13886 raft_consensus.cc:357] T 95b6f084eb5240ea94c125eaa154ac9f P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:51.047616 15115 raft_consensus.cc:513] T d1bf58d367f54ba8bad64887b9a8d9cc P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:51.047713 13886 raft_consensus.cc:383] T 95b6f084eb5240ea94c125eaa154ac9f P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:51.047775 13886 raft_consensus.cc:738] T 95b6f084eb5240ea94c125eaa154ac9f P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:54:51.048130 15115 leader_election.cc:290] T d1bf58d367f54ba8bad64887b9a8d9cc P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 election: Requested vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:51.048704 13775 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "d1bf58d367f54ba8bad64887b9a8d9cc" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f"
I20250830 07:54:51.048843 13775 raft_consensus.cc:3058] T d1bf58d367f54ba8bad64887b9a8d9cc P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
W20250830 07:54:51.049548 13232 catalog_manager.cc:5415] Ignoring report from unknown tablet 70703eb1d47841a1a227e277ed6a268d
I20250830 07:54:51.049609 13482 raft_consensus.cc:2466] T 04eadf45b82e4c319eb7b316a402d81a P 2065c332f15a4739899af79f3669c3ba [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 3.
I20250830 07:54:51.051455 13775 raft_consensus.cc:2466] T d1bf58d367f54ba8bad64887b9a8d9cc P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2065c332f15a4739899af79f3669c3ba in term 1.
W20250830 07:54:51.051355 13232 catalog_manager.cc:5415] Ignoring report from unknown tablet ef16b9e2d444489699f4db1ac26d5f6c
I20250830 07:54:51.052074 13229 catalog_manager.cc:5864] Not sending DeleteTablet requests; no consensus state for tablet 06e65ec3609b47029409f9a8666dbe97
I20250830 07:54:51.052428 13229 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_ddc698ca5abf45f0b00bb549d4e55e18"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:51.053282 13227 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 5a458e862c4f43a4aada13f87cfe3ed5 has no consensus state
I20250830 07:54:51.053671 13227 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_2e04b6c5e32b45cca8fa0c57d41eacbb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250830 07:54:51.054388 13230 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet 33701eeb12fc451d90ae0b1c4dd7d134
I20250830 07:54:51.055454 13593 tablet_service.cc:1515] Processing DeleteTablet for tablet 33701eeb12fc451d90ae0b1c4dd7d134 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:50 UTC) from {username='slave'} at 127.0.0.1:45306
I20250830 07:54:51.055711 13230 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_725c911448e748acb9cafa0e244f9912" } modify_external_catalogs: true
I20250830 07:54:51.055851 13230 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_725c911448e748acb9cafa0e244f9912" } modify_external_catalogs: true
I20250830 07:54:51.056864 13228 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_3accdb20952244b2b7745b6754452a64"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:51.057483 13225 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 7f452a38bf584637b7708a42b2a5a35f consensus state has no leader
I20250830 07:54:51.057772 13225 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_cb4f14be94f441bbb2f3e8f3a336f1b7" } new_table_name: "default.Table_7ff1913d594849109d737f944df0f5c9" modify_external_catalogs: true
I20250830 07:54:51.061079 15246 raft_consensus.cc:491] T 9ffa3c1d128c49c8b8e2566c6a64304a P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:51.061226 15246 raft_consensus.cc:513] T 9ffa3c1d128c49c8b8e2566c6a64304a P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:51.062095 15246 leader_election.cc:290] T 9ffa3c1d128c49c8b8e2566c6a64304a P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967)
W20250830 07:54:51.063441 13229 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ddc698ca5abf45f0b00bb549d4e55e18 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:51.064270 13614 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "d1bf58d367f54ba8bad64887b9a8d9cc" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9"
I20250830 07:54:51.065318 13612 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "9ffa3c1d128c49c8b8e2566c6a64304a" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
W20250830 07:54:51.065836 13703 leader_election.cc:343] T 9ffa3c1d128c49c8b8e2566c6a64304a P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
W20250830 07:54:51.063827 13227 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2e04b6c5e32b45cca8fa0c57d41eacbb in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250830 07:54:51.067327 13228 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3accdb20952244b2b7745b6754452a64 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250830 07:54:51.081523 13220 catalog_manager.cc:4908] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet 33701eeb12fc451d90ae0b1c4dd7d134 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 33701eeb12fc451d90ae0b1c4dd7d134 already in progress: creating tablet
I20250830 07:54:51.085140 13619 raft_consensus.cc:3058] T 856e644662334f8194ffef6ca1232248 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:51.097225 15246 raft_consensus.cc:491] T d64f20df166a46249c08444f44422fc3 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:51.097340 15246 raft_consensus.cc:513] T d64f20df166a46249c08444f44422fc3 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:51.097836 15246 leader_election.cc:290] T d64f20df166a46249c08444f44422fc3 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967)
W20250830 07:54:51.064733 13423 leader_election.cc:343] T d1bf58d367f54ba8bad64887b9a8d9cc P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:51.051254 13887 consensus_queue.cc:260] T 74f2fcc22fd545fb8ca7c20619843023 P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:51.082296 13484 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "9ffa3c1d128c49c8b8e2566c6a64304a" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:54:51.102536 13484 raft_consensus.cc:2466] T 9ffa3c1d128c49c8b8e2566c6a64304a P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 0.
I20250830 07:54:51.103123 13887 ts_tablet_manager.cc:1428] T 74f2fcc22fd545fb8ca7c20619843023 P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.065s user 0.002s sys 0.000s
I20250830 07:54:51.103370 13887 tablet_bootstrap.cc:492] T 10ec97b8a82145479e0bb526c4cc7c05 P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:54:51.105450 13887 tablet_bootstrap.cc:654] T 10ec97b8a82145479e0bb526c4cc7c05 P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:51.107730 13886 consensus_queue.cc:260] T 95b6f084eb5240ea94c125eaa154ac9f P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:51.108201 13886 ts_tablet_manager.cc:1428] T 95b6f084eb5240ea94c125eaa154ac9f P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.061s user 0.002s sys 0.000s
I20250830 07:54:51.108433 13886 tablet_bootstrap.cc:492] T 7c5e50cb605c4a40b47984f328eedd93 P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:54:51.110188 13886 tablet_bootstrap.cc:654] T 7c5e50cb605c4a40b47984f328eedd93 P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:51.110483 13231 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_7339c154343f42daa3c5f078e4e8a7d0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:51.113471 13231 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7339c154343f42daa3c5f078e4e8a7d0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250830 07:54:51.116899 15199 log.cc:927] Time spent T 00000000000000000000000000000000 P 3ea183a890b84f408b20b55e9eb7c7ed: Append to log took a long time: real 0.178s user 0.000s sys 0.003s
I20250830 07:54:51.119064 15246 raft_consensus.cc:491] T d37fe59b4f964f30bb1ed4cb00868b75 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:51.119261 15246 raft_consensus.cc:513] T d37fe59b4f964f30bb1ed4cb00868b75 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:51.119828 15246 leader_election.cc:290] T d37fe59b4f964f30bb1ed4cb00868b75 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967)
I20250830 07:54:51.128108 13887 tablet_bootstrap.cc:492] T 10ec97b8a82145479e0bb526c4cc7c05 P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:54:51.128283 13887 ts_tablet_manager.cc:1397] T 10ec97b8a82145479e0bb526c4cc7c05 P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.025s user 0.004s sys 0.000s
I20250830 07:54:51.128929 13887 raft_consensus.cc:357] T 10ec97b8a82145479e0bb526c4cc7c05 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:51.129137 13887 raft_consensus.cc:383] T 10ec97b8a82145479e0bb526c4cc7c05 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:51.129256 13887 raft_consensus.cc:738] T 10ec97b8a82145479e0bb526c4cc7c05 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:54:51.129779 13887 consensus_queue.cc:260] T 10ec97b8a82145479e0bb526c4cc7c05 P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:51.133680 13230 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet 7aed56dba39e40518e9c3325bcccd74a
W20250830 07:54:51.134109 13225 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ea147cc572e14d7696a2d0f5521ef147 has no consensus state
I20250830 07:54:51.133893 15323 raft_consensus.cc:491] T 3c9dd258e6be47f68e039e4cdcd899b2 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:51.134393 13225 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_d1157e0797784cdca583812222959656" } modify_external_catalogs: true
I20250830 07:54:51.134564 13225 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_d1157e0797784cdca583812222959656" } modify_external_catalogs: true
I20250830 07:54:51.134749 15323 raft_consensus.cc:513] T 3c9dd258e6be47f68e039e4cdcd899b2 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:51.135353 13229 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_86c9025e70234ffeb1cafaac64f9b691" } new_table_name: "default.Table_f9379201a5de4169a46eeb2ff2cc0ac7" modify_external_catalogs: true
I20250830 07:54:51.135430 15323 leader_election.cc:290] T 3c9dd258e6be47f68e039e4cdcd899b2 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
W20250830 07:54:51.137136 13230 catalog_manager.cc:5415] Ignoring report from unknown tablet 8eb010d7955d47a89ff1d01be1b5b01e
W20250830 07:54:51.137220 13230 catalog_manager.cc:5415] Ignoring report from unknown tablet e4ca3110247640fbae4241448e8d5ef7
W20250830 07:54:51.137281 13230 catalog_manager.cc:5415] Ignoring report from unknown tablet 5235e1a32f044f0cbf882e338c482003
W20250830 07:54:51.137322 13230 catalog_manager.cc:5415] Ignoring report from unknown tablet de3a52a8e08a45808373902a0185e6f0
I20250830 07:54:51.138779 13887 ts_tablet_manager.cc:1428] T 10ec97b8a82145479e0bb526c4cc7c05 P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.010s user 0.001s sys 0.000s
I20250830 07:54:51.138953 13232 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_393f2d8fc88242109d5f7d3e5d7b0220"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250830 07:54:51.139099 13887 tablet_bootstrap.cc:492] T 88bbd6b4c795433d9b6ad746353f3aa1 P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
W20250830 07:54:51.139910 13232 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_393f2d8fc88242109d5f7d3e5d7b0220 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:51.140116 13593 tablet_service.cc:1515] Processing DeleteTablet for tablet 7aed56dba39e40518e9c3325bcccd74a with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:51 UTC) from {username='slave'} at 127.0.0.1:45306
W20250830 07:54:51.141094 13220 catalog_manager.cc:4908] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet 7aed56dba39e40518e9c3325bcccd74a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7aed56dba39e40518e9c3325bcccd74a already in progress: creating tablet
I20250830 07:54:51.141427 13233 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_10f656ee9fc44b5f9cf1478f5a8768c7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250830 07:54:51.141774 13614 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "d37fe59b4f964f30bb1ed4cb00868b75" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:51.142014 13622 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "d64f20df166a46249c08444f44422fc3" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:51.142504 13624 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "3c9dd258e6be47f68e039e4cdcd899b2" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:51.142597 13887 tablet_bootstrap.cc:654] T 88bbd6b4c795433d9b6ad746353f3aa1 P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
W20250830 07:54:51.143023 13423 leader_election.cc:343] T 3c9dd258e6be47f68e039e4cdcd899b2 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
W20250830 07:54:51.143177 13233 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_10f656ee9fc44b5f9cf1478f5a8768c7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250830 07:54:51.143570 13703 leader_election.cc:343] T d37fe59b4f964f30bb1ed4cb00868b75 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
W20250830 07:54:51.143848 13703 leader_election.cc:343] T d64f20df166a46249c08444f44422fc3 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:51.149937 13227 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_f7936c2b545c4e209a6a93aa2e6e6077"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:51.150375 13227 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f7936c2b545c4e209a6a93aa2e6e6077 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:51.151885 13422 leader_election.cc:304] T d1bf58d367f54ba8bad64887b9a8d9cc P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
W20250830 07:54:51.152215 13422 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.209.3:38743, user_credentials={real_user=slave}} blocked reactor thread for 69770.2us
I20250830 07:54:51.152585 15323 raft_consensus.cc:2802] T d1bf58d367f54ba8bad64887b9a8d9cc P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election won for term 1
I20250830 07:54:51.152779 15323 raft_consensus.cc:695] T d1bf58d367f54ba8bad64887b9a8d9cc P 2065c332f15a4739899af79f3669c3ba [term 1 LEADER]: Becoming Leader. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Running, Role: LEADER
I20250830 07:54:51.153033 15323 consensus_queue.cc:237] T d1bf58d367f54ba8bad64887b9a8d9cc P 2065c332f15a4739899af79f3669c3ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:51.155125 13230 master_service.cc:948] ReplaceTablet: received request to replace tablet 3bb48fce24074a8e8ec99d3172a655d8 from {username='slave'} at 127.0.0.1:42126
I20250830 07:54:51.156035 13234 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet 51cee993ce4249c0830b29cb1808fe80
I20250830 07:54:51.157096 13701 leader_election.cc:304] T 04eadf45b82e4c319eb7b316a402d81a P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:54:51.157596 13701 leader_election.cc:304] T 9ffa3c1d128c49c8b8e2566c6a64304a P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:54:51.158125 15246 raft_consensus.cc:2802] T 04eadf45b82e4c319eb7b316a402d81a P 9b057ade5dce45af9f8bf0bedf8b917f [term 3 FOLLOWER]: Leader election won for term 3
I20250830 07:54:51.158219 15246 raft_consensus.cc:695] T 04eadf45b82e4c319eb7b316a402d81a P 9b057ade5dce45af9f8bf0bedf8b917f [term 3 LEADER]: Becoming Leader. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Running, Role: LEADER
I20250830 07:54:51.158437 15246 consensus_queue.cc:237] T 04eadf45b82e4c319eb7b316a402d81a P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:51.161836 14975 raft_consensus.cc:2802] T 9ffa3c1d128c49c8b8e2566c6a64304a P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:54:51.162142 14975 raft_consensus.cc:491] T 9ffa3c1d128c49c8b8e2566c6a64304a P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:54:51.162424 14975 raft_consensus.cc:3058] T 9ffa3c1d128c49c8b8e2566c6a64304a P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:51.163118 15322 raft_consensus.cc:491] T da5c7b084e1f4fda92fff35a9cb2c7fc P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:51.163280 15322 raft_consensus.cc:513] T da5c7b084e1f4fda92fff35a9cb2c7fc P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:51.163784 15322 leader_election.cc:290] T da5c7b084e1f4fda92fff35a9cb2c7fc P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:51.165673 13593 tablet_service.cc:1515] Processing DeleteTablet for tablet 51cee993ce4249c0830b29cb1808fe80 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:51 UTC) from {username='slave'} at 127.0.0.1:45306
I20250830 07:54:51.167181 13624 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "da5c7b084e1f4fda92fff35a9cb2c7fc" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:51.169571 13886 tablet_bootstrap.cc:492] T 7c5e50cb605c4a40b47984f328eedd93 P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:54:51.169694 13886 ts_tablet_manager.cc:1397] T 7c5e50cb605c4a40b47984f328eedd93 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.061s user 0.001s sys 0.002s
I20250830 07:54:51.174616 14975 raft_consensus.cc:513] T 9ffa3c1d128c49c8b8e2566c6a64304a P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
W20250830 07:54:51.174726 13229 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet c8bc6e07377a4ba99c39a909dae11402 consensus state has no leader
I20250830 07:54:51.175181 13225 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet d1d5e0d40a91457da65a0e925289309e
W20250830 07:54:51.176105 13423 leader_election.cc:343] T da5c7b084e1f4fda92fff35a9cb2c7fc P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:51.176920 13593 tablet_service.cc:1515] Processing DeleteTablet for tablet d1d5e0d40a91457da65a0e925289309e with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:51 UTC) from {username='slave'} at 127.0.0.1:45306
W20250830 07:54:51.177912 13228 catalog_manager.cc:5415] Ignoring report from unknown tablet ff0f9cccc8ed43b1a8cd38de0e9d4097
W20250830 07:54:51.178001 13228 catalog_manager.cc:5415] Ignoring report from unknown tablet e6b7646588fe4134b2db62ff84ca4791
W20250830 07:54:51.178061 13228 catalog_manager.cc:5415] Ignoring report from unknown tablet 95b6f084eb5240ea94c125eaa154ac9f
W20250830 07:54:51.178128 13228 catalog_manager.cc:5415] Ignoring report from unknown tablet 8eb010d7955d47a89ff1d01be1b5b01e
I20250830 07:54:51.184561 13482 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "d64f20df166a46249c08444f44422fc3" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:54:51.184720 13482 raft_consensus.cc:2466] T d64f20df166a46249c08444f44422fc3 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 0.
W20250830 07:54:51.185093 13231 catalog_manager.cc:5415] Ignoring report from unknown tablet 74f2fcc22fd545fb8ca7c20619843023
I20250830 07:54:51.181862 13886 raft_consensus.cc:357] T 7c5e50cb605c4a40b47984f328eedd93 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:51.186332 13886 raft_consensus.cc:383] T 7c5e50cb605c4a40b47984f328eedd93 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:51.186424 13886 raft_consensus.cc:738] T 7c5e50cb605c4a40b47984f328eedd93 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:54:51.186609 13886 consensus_queue.cc:260] T 7c5e50cb605c4a40b47984f328eedd93 P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:51.187086 13886 ts_tablet_manager.cc:1428] T 7c5e50cb605c4a40b47984f328eedd93 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.017s user 0.002s sys 0.000s
I20250830 07:54:51.182163 13764 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "3c9dd258e6be47f68e039e4cdcd899b2" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:51.187731 13482 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "d37fe59b4f964f30bb1ed4cb00868b75" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:54:51.187880 13482 raft_consensus.cc:2466] T d37fe59b4f964f30bb1ed4cb00868b75 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 0.
I20250830 07:54:51.195158 14975 leader_election.cc:290] T 9ffa3c1d128c49c8b8e2566c6a64304a P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Requested vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967)
I20250830 07:54:51.196206 13482 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "9ffa3c1d128c49c8b8e2566c6a64304a" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba"
I20250830 07:54:51.196412 13482 raft_consensus.cc:3058] T 9ffa3c1d128c49c8b8e2566c6a64304a P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:51.198884 15047 tablet_replica.cc:331] T 51cee993ce4249c0830b29cb1808fe80 P 6b5e454d98894637b466ea27f1b647f9: stopping tablet replica
I20250830 07:54:51.199149 15047 raft_consensus.cc:2241] T 51cee993ce4249c0830b29cb1808fe80 P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250830 07:54:51.199290 15047 raft_consensus.cc:2270] T 51cee993ce4249c0830b29cb1808fe80 P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250830 07:54:51.199888 13482 raft_consensus.cc:2466] T 9ffa3c1d128c49c8b8e2566c6a64304a P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 1.
I20250830 07:54:51.200137 15047 ts_tablet_manager.cc:1905] T 51cee993ce4249c0830b29cb1808fe80 P 6b5e454d98894637b466ea27f1b647f9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250830 07:54:51.200718 13764 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "da5c7b084e1f4fda92fff35a9cb2c7fc" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:51.202138 14975 consensus_queue.cc:1035] T 3525652a73b8413b8ccbcb5824cc5880 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:54:51.203379 13701 leader_election.cc:304] T d64f20df166a46249c08444f44422fc3 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:54:51.204146 15246 consensus_queue.cc:1035] T 0ceccc5f18294356894695fe08d73e30 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:54:51.204612 15246 raft_consensus.cc:2802] T d64f20df166a46249c08444f44422fc3 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:54:51.204730 15246 raft_consensus.cc:491] T d64f20df166a46249c08444f44422fc3 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:54:51.204838 15246 raft_consensus.cc:3058] T d64f20df166a46249c08444f44422fc3 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:51.207208 15246 raft_consensus.cc:513] T d64f20df166a46249c08444f44422fc3 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:51.207890 15246 leader_election.cc:290] T d64f20df166a46249c08444f44422fc3 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Requested vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967)
I20250830 07:54:51.208061 15246 raft_consensus.cc:491] T a8baad9c419e436b9659d8d5582d4066 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:51.208200 15246 raft_consensus.cc:513] T a8baad9c419e436b9659d8d5582d4066 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
W20250830 07:54:51.208946 15199 log.cc:927] Time spent T 00000000000000000000000000000000 P 3ea183a890b84f408b20b55e9eb7c7ed: Append to log took a long time: real 0.083s user 0.002s sys 0.001s
I20250830 07:54:51.208930 15246 leader_election.cc:290] T a8baad9c419e436b9659d8d5582d4066 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967)
I20250830 07:54:51.209769 13701 leader_election.cc:304] T d37fe59b4f964f30bb1ed4cb00868b75 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:54:51.210218 14975 raft_consensus.cc:2802] T d37fe59b4f964f30bb1ed4cb00868b75 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:54:51.210458 14975 raft_consensus.cc:491] T d37fe59b4f964f30bb1ed4cb00868b75 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:54:51.210753 14975 raft_consensus.cc:3058] T d37fe59b4f964f30bb1ed4cb00868b75 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:51.211396 15245 consensus_queue.cc:1035] T 8ae468b43b4c450ca7591b543c2539d9 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:54:51.218688 13615 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "a8baad9c419e436b9659d8d5582d4066" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:51.219115 13624 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "d64f20df166a46249c08444f44422fc3" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9"
I20250830 07:54:51.223198 15047 ts_tablet_manager.cc:1918] T 51cee993ce4249c0830b29cb1808fe80 P 6b5e454d98894637b466ea27f1b647f9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250830 07:54:51.223345 15047 log.cc:1199] T 51cee993ce4249c0830b29cb1808fe80 P 6b5e454d98894637b466ea27f1b647f9: Deleting WAL directory at /tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/ts-1/wal/wals/51cee993ce4249c0830b29cb1808fe80
I20250830 07:54:51.224817 15246 raft_consensus.cc:491] T 50360492db824755a6de251436cab5c6 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:51.224939 15246 raft_consensus.cc:513] T 50360492db824755a6de251436cab5c6 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:51.225571 15246 leader_election.cc:290] T 50360492db824755a6de251436cab5c6 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
I20250830 07:54:51.230350 15047 ts_tablet_manager.cc:1939] T 51cee993ce4249c0830b29cb1808fe80 P 6b5e454d98894637b466ea27f1b647f9: Deleting consensus metadata
I20250830 07:54:51.230612 13617 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "9ffa3c1d128c49c8b8e2566c6a64304a" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9"
I20250830 07:54:51.230623 13701 leader_election.cc:304] T 9ffa3c1d128c49c8b8e2566c6a64304a P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters:
W20250830 07:54:51.231197 13422 leader_election.cc:343] T 3c9dd258e6be47f68e039e4cdcd899b2 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:51.231369 13422 leader_election.cc:304] T 3c9dd258e6be47f68e039e4cdcd899b2 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba; no voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f
W20250830 07:54:51.231829 13422 leader_election.cc:343] T da5c7b084e1f4fda92fff35a9cb2c7fc P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:51.231911 13422 leader_election.cc:304] T da5c7b084e1f4fda92fff35a9cb2c7fc P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba; no voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:54:51.232518 15323 raft_consensus.cc:2747] T 3c9dd258e6be47f68e039e4cdcd899b2 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:54:51.232575 15248 raft_consensus.cc:2747] T da5c7b084e1f4fda92fff35a9cb2c7fc P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:54:51.236719 15340 raft_consensus.cc:2802] T 9ffa3c1d128c49c8b8e2566c6a64304a P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election won for term 1
I20250830 07:54:51.236835 15340 raft_consensus.cc:695] T 9ffa3c1d128c49c8b8e2566c6a64304a P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 LEADER]: Becoming Leader. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Running, Role: LEADER
I20250830 07:54:51.237042 15340 consensus_queue.cc:237] T 9ffa3c1d128c49c8b8e2566c6a64304a P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:51.238662 13220 catalog_manager.cc:4928] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): tablet 51cee993ce4249c0830b29cb1808fe80 (table default.Table_c2c6c57d30d440d691f87632feae3633 [id=34fc9dab5c14465d8f3362d4c9ff5748]) successfully deleted
W20250830 07:54:51.239786 13220 catalog_manager.cc:4908] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet d1d5e0d40a91457da65a0e925289309e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d1d5e0d40a91457da65a0e925289309e already in progress: creating tablet
I20250830 07:54:51.243599 13886 tablet_bootstrap.cc:492] T d1153d8cd2994377ac0dcbfeeda1fd52 P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:54:51.245483 13882 tablet_bootstrap.cc:492] T 13df49c2c2cd4e5cae26a540835b74c9 P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:54:51.245539 13886 tablet_bootstrap.cc:654] T d1153d8cd2994377ac0dcbfeeda1fd52 P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:51.245672 13882 ts_tablet_manager.cc:1397] T 13df49c2c2cd4e5cae26a540835b74c9 P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.300s user 0.005s sys 0.008s
I20250830 07:54:51.247210 13882 raft_consensus.cc:357] T 13df49c2c2cd4e5cae26a540835b74c9 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:51.247422 13882 raft_consensus.cc:383] T 13df49c2c2cd4e5cae26a540835b74c9 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:51.247568 13882 raft_consensus.cc:738] T 13df49c2c2cd4e5cae26a540835b74c9 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:54:51.247936 13882 consensus_queue.cc:260] T 13df49c2c2cd4e5cae26a540835b74c9 P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:51.249734 14975 raft_consensus.cc:513] T d37fe59b4f964f30bb1ed4cb00868b75 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:51.251724 13882 ts_tablet_manager.cc:1428] T 13df49c2c2cd4e5cae26a540835b74c9 P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.006s user 0.001s sys 0.001s
I20250830 07:54:51.252764 13480 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "a8baad9c419e436b9659d8d5582d4066" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:54:51.252925 13480 raft_consensus.cc:2466] T a8baad9c419e436b9659d8d5582d4066 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 0.
I20250830 07:54:51.253199 13479 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "d64f20df166a46249c08444f44422fc3" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba"
I20250830 07:54:51.253360 13479 raft_consensus.cc:3058] T d64f20df166a46249c08444f44422fc3 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:51.252440 13882 tablet_bootstrap.cc:492] T f52dd8eeb64a4b8a92babf34387b6c5b P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:54:51.254056 13887 tablet_bootstrap.cc:492] T 88bbd6b4c795433d9b6ad746353f3aa1 P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:54:51.254164 13887 ts_tablet_manager.cc:1397] T 88bbd6b4c795433d9b6ad746353f3aa1 P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.115s user 0.016s sys 0.032s
I20250830 07:54:51.255184 13887 raft_consensus.cc:357] T 88bbd6b4c795433d9b6ad746353f3aa1 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:51.255355 13887 raft_consensus.cc:383] T 88bbd6b4c795433d9b6ad746353f3aa1 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:51.255401 13887 raft_consensus.cc:738] T 88bbd6b4c795433d9b6ad746353f3aa1 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:54:51.255548 13887 consensus_queue.cc:260] T 88bbd6b4c795433d9b6ad746353f3aa1 P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:51.255926 13887 ts_tablet_manager.cc:1428] T 88bbd6b4c795433d9b6ad746353f3aa1 P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20250830 07:54:51.256213 13887 tablet_bootstrap.cc:492] T a7dc529c40544bafbc9e7f0ab34086bd P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:54:51.255972 13479 raft_consensus.cc:2466] T d64f20df166a46249c08444f44422fc3 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 1.
I20250830 07:54:51.257738 13887 tablet_bootstrap.cc:654] T a7dc529c40544bafbc9e7f0ab34086bd P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:51.251353 13886 tablet_bootstrap.cc:492] T d1153d8cd2994377ac0dcbfeeda1fd52 P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:54:51.264413 13886 ts_tablet_manager.cc:1397] T d1153d8cd2994377ac0dcbfeeda1fd52 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.021s user 0.003s sys 0.001s
I20250830 07:54:51.269344 13886 raft_consensus.cc:357] T d1153d8cd2994377ac0dcbfeeda1fd52 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:51.270643 13886 raft_consensus.cc:383] T d1153d8cd2994377ac0dcbfeeda1fd52 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:51.270720 13886 raft_consensus.cc:738] T d1153d8cd2994377ac0dcbfeeda1fd52 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:54:51.271575 13886 consensus_queue.cc:260] T d1153d8cd2994377ac0dcbfeeda1fd52 P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:51.272666 13887 tablet_bootstrap.cc:492] T a7dc529c40544bafbc9e7f0ab34086bd P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:54:51.272811 13887 ts_tablet_manager.cc:1397] T a7dc529c40544bafbc9e7f0ab34086bd P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.017s user 0.002s sys 0.004s
I20250830 07:54:51.272943 13886 ts_tablet_manager.cc:1428] T d1153d8cd2994377ac0dcbfeeda1fd52 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.005s user 0.000s sys 0.001s
I20250830 07:54:51.273192 13886 tablet_bootstrap.cc:492] T ca959e42c8764eeba0faee96caf8b39f P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:54:51.273850 13229 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_9b6c66a97dcd482c9c5238996bebccac" } new_table_name: "default.Table_470c1b7551fc4784bc81ab9f97646e40" modify_external_catalogs: true
I20250830 07:54:51.275303 13227 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_9fe110ab062c400d8861f86ac328ea71" } modify_external_catalogs: true
I20250830 07:54:51.275465 13227 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_9fe110ab062c400d8861f86ac328ea71" } modify_external_catalogs: true
I20250830 07:54:51.276670 13228 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_4cf8a9545bf849008cfb13c060b591ab" } modify_external_catalogs: true
I20250830 07:54:51.276844 13228 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_4cf8a9545bf849008cfb13c060b591ab" } modify_external_catalogs: true
I20250830 07:54:51.282307 13886 tablet_bootstrap.cc:654] T ca959e42c8764eeba0faee96caf8b39f P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:51.282639 13887 raft_consensus.cc:357] T a7dc529c40544bafbc9e7f0ab34086bd P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:51.282809 13887 raft_consensus.cc:383] T a7dc529c40544bafbc9e7f0ab34086bd P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:51.282860 13887 raft_consensus.cc:738] T a7dc529c40544bafbc9e7f0ab34086bd P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:54:51.283033 13232 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_966292469ec54ce987013f67893e9903" } new_table_name: "default.Table_0f5408ace198422d8b5c5855ee96a0c9" modify_external_catalogs: true
I20250830 07:54:51.283038 13887 consensus_queue.cc:260] T a7dc529c40544bafbc9e7f0ab34086bd P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:51.283514 13887 ts_tablet_manager.cc:1428] T a7dc529c40544bafbc9e7f0ab34086bd P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.011s user 0.001s sys 0.000s
I20250830 07:54:51.283756 13887 tablet_bootstrap.cc:492] T 7aed56dba39e40518e9c3325bcccd74a P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:54:51.285604 13225 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_fe16369ddb654acd98eb87c289bc56c6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250830 07:54:51.285683 13231 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_aa8142e34d1a4709acfb060513a54001" } new_table_name: "default.Table_cf20bfd85547402e8b8191449bd43a99" modify_external_catalogs: true
W20250830 07:54:51.286132 13225 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fe16369ddb654acd98eb87c289bc56c6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:51.286679 13233 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_b30af2897319434da09d1a2dd2103658"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:51.287307 13233 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b30af2897319434da09d1a2dd2103658 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:51.291333 13887 tablet_bootstrap.cc:654] T 7aed56dba39e40518e9c3325bcccd74a P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:51.297103 13882 tablet_bootstrap.cc:654] T f52dd8eeb64a4b8a92babf34387b6c5b P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
W20250830 07:54:51.304512 13229 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 19114685516b487e966b2b62ce634380 has no consensus state
I20250830 07:54:51.305040 13227 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet 0c70140d87d34bde919714f08a5c94d4
I20250830 07:54:51.305723 13593 tablet_service.cc:1515] Processing DeleteTablet for tablet 0c70140d87d34bde919714f08a5c94d4 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:51 UTC) from {username='slave'} at 127.0.0.1:45306
W20250830 07:54:51.306461 13220 catalog_manager.cc:4908] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet 0c70140d87d34bde919714f08a5c94d4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0c70140d87d34bde919714f08a5c94d4 already in progress: creating tablet
I20250830 07:54:51.306468 15237 raft_consensus.cc:491] T 09586fdda94c4aff9d3fa25d71fe6ac0 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:51.306607 15237 raft_consensus.cc:513] T 09586fdda94c4aff9d3fa25d71fe6ac0 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:51.307349 15237 leader_election.cc:290] T 09586fdda94c4aff9d3fa25d71fe6ac0 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:51.308163 13230 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_76298eb2ea294f03a44aeeff4fb0391f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:51.308818 13230 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_76298eb2ea294f03a44aeeff4fb0391f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:51.311424 13482 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "09586fdda94c4aff9d3fa25d71fe6ac0" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:54:51.311688 13887 tablet_bootstrap.cc:492] T 7aed56dba39e40518e9c3325bcccd74a P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:54:51.311885 13887 ts_tablet_manager.cc:1397] T 7aed56dba39e40518e9c3325bcccd74a P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.028s user 0.003s sys 0.001s
I20250830 07:54:51.312754 13887 raft_consensus.cc:357] T 7aed56dba39e40518e9c3325bcccd74a P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:51.312985 13887 raft_consensus.cc:383] T 7aed56dba39e40518e9c3325bcccd74a P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:51.313089 13887 raft_consensus.cc:738] T 7aed56dba39e40518e9c3325bcccd74a P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:54:51.313360 13887 consensus_queue.cc:260] T 7aed56dba39e40518e9c3325bcccd74a P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:51.314018 13886 tablet_bootstrap.cc:492] T ca959e42c8764eeba0faee96caf8b39f P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:54:51.314015 13887 ts_tablet_manager.cc:1428] T 7aed56dba39e40518e9c3325bcccd74a P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20250830 07:54:51.314158 13886 ts_tablet_manager.cc:1397] T ca959e42c8764eeba0faee96caf8b39f P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.041s user 0.002s sys 0.003s
I20250830 07:54:51.314420 13887 tablet_bootstrap.cc:492] T 33701eeb12fc451d90ae0b1c4dd7d134 P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:54:51.315995 13887 tablet_bootstrap.cc:654] T 33701eeb12fc451d90ae0b1c4dd7d134 P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:51.319026 13228 catalog_manager.cc:5864] Not sending DeleteTablet requests; no consensus state for tablet cf80d82d0a3b4a2c8b48a7da221efff6
I20250830 07:54:51.328066 13887 tablet_bootstrap.cc:492] T 33701eeb12fc451d90ae0b1c4dd7d134 P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:54:51.328255 13887 ts_tablet_manager.cc:1397] T 33701eeb12fc451d90ae0b1c4dd7d134 P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.014s user 0.003s sys 0.002s
I20250830 07:54:51.329674 13478 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "d37fe59b4f964f30bb1ed4cb00868b75" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba"
I20250830 07:54:51.329893 13882 tablet_bootstrap.cc:492] T f52dd8eeb64a4b8a92babf34387b6c5b P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:54:51.329891 13478 raft_consensus.cc:3058] T d37fe59b4f964f30bb1ed4cb00868b75 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:51.330034 13882 ts_tablet_manager.cc:1397] T f52dd8eeb64a4b8a92babf34387b6c5b P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.078s user 0.005s sys 0.000s
I20250830 07:54:51.329909 13887 raft_consensus.cc:357] T 33701eeb12fc451d90ae0b1c4dd7d134 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:51.330402 13887 raft_consensus.cc:383] T 33701eeb12fc451d90ae0b1c4dd7d134 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:51.330549 13887 raft_consensus.cc:738] T 33701eeb12fc451d90ae0b1c4dd7d134 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:54:51.330775 13882 raft_consensus.cc:357] T f52dd8eeb64a4b8a92babf34387b6c5b P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:51.330823 13887 consensus_queue.cc:260] T 33701eeb12fc451d90ae0b1c4dd7d134 P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:51.330998 13882 raft_consensus.cc:383] T f52dd8eeb64a4b8a92babf34387b6c5b P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:51.331131 13882 raft_consensus.cc:738] T f52dd8eeb64a4b8a92babf34387b6c5b P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:54:51.331604 13887 ts_tablet_manager.cc:1428] T 33701eeb12fc451d90ae0b1c4dd7d134 P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20250830 07:54:51.331568 13882 consensus_queue.cc:260] T f52dd8eeb64a4b8a92babf34387b6c5b P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:51.331975 13887 tablet_bootstrap.cc:492] T 62bc8168176e4678a77827c5b7cc0f3e P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:54:51.332638 13478 raft_consensus.cc:2466] T d37fe59b4f964f30bb1ed4cb00868b75 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 1.
I20250830 07:54:51.332840 13882 ts_tablet_manager.cc:1428] T f52dd8eeb64a4b8a92babf34387b6c5b P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20250830 07:54:51.333918 13887 tablet_bootstrap.cc:654] T 62bc8168176e4678a77827c5b7cc0f3e P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:51.334410 13882 tablet_bootstrap.cc:492] T 74891b8103e144c486750f64ba2003f4 P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
W20250830 07:54:51.336733 13232 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet bdeb89bbb3ad4e67bbc74b78454eeb7e consensus state has no leader
W20250830 07:54:51.337951 13228 catalog_manager.cc:5415] Ignoring report from unknown tablet b4ab964a64a64e00a78ffd2b220aef46
W20250830 07:54:51.338038 13228 catalog_manager.cc:5415] Ignoring report from unknown tablet d1bf58d367f54ba8bad64887b9a8d9cc
W20250830 07:54:51.338156 13228 catalog_manager.cc:5415] Ignoring report from unknown tablet 74f2fcc22fd545fb8ca7c20619843023
I20250830 07:54:51.339625 13227 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_dfb8cb02c2eb48d4b9058e5a38c7f47d" } new_table_name: "default.Table_d3a725d507884adc938feab927a067ca" modify_external_catalogs: true
I20250830 07:54:51.339843 13232 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_fac26069a6524a66878ca41a78358f44" } modify_external_catalogs: true
I20250830 07:54:51.340015 13232 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_fac26069a6524a66878ca41a78358f44" } modify_external_catalogs: true
I20250830 07:54:51.340835 13229 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_11cc7b1953e742b583ccd68b50f2b02c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:51.341892 13229 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_11cc7b1953e742b583ccd68b50f2b02c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250830 07:54:51.346432 13234 catalog_manager.cc:5415] Ignoring report from unknown tablet 7c5e50cb605c4a40b47984f328eedd93
I20250830 07:54:51.350476 13882 tablet_bootstrap.cc:654] T 74891b8103e144c486750f64ba2003f4 P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
W20250830 07:54:51.352595 13234 catalog_manager.cc:5415] Ignoring report from unknown tablet 04eadf45b82e4c319eb7b316a402d81a
I20250830 07:54:51.352864 13887 tablet_bootstrap.cc:492] T 62bc8168176e4678a77827c5b7cc0f3e P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:54:51.352689 13228 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_3003a2f50d0e4ad0a20914b0311ba9e5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250830 07:54:51.353086 13887 ts_tablet_manager.cc:1397] T 62bc8168176e4678a77827c5b7cc0f3e P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.021s user 0.002s sys 0.003s
W20250830 07:54:51.353101 13231 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 8c01157324ba45bda5b3a9a328bf319b consensus state has no leader
I20250830 07:54:51.353896 13887 raft_consensus.cc:357] T 62bc8168176e4678a77827c5b7cc0f3e P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:51.354084 13887 raft_consensus.cc:383] T 62bc8168176e4678a77827c5b7cc0f3e P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:51.354157 13887 raft_consensus.cc:738] T 62bc8168176e4678a77827c5b7cc0f3e P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:54:51.354368 13887 consensus_queue.cc:260] T 62bc8168176e4678a77827c5b7cc0f3e P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:51.355003 13887 ts_tablet_manager.cc:1428] T 62bc8168176e4678a77827c5b7cc0f3e P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20250830 07:54:51.355289 13887 tablet_bootstrap.cc:492] T d1153d8cd2994377ac0dcbfeeda1fd52 P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
W20250830 07:54:51.356048 13228 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3003a2f50d0e4ad0a20914b0311ba9e5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:51.356781 13887 tablet_bootstrap.cc:654] T d1153d8cd2994377ac0dcbfeeda1fd52 P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:51.314821 13886 raft_consensus.cc:357] T ca959e42c8764eeba0faee96caf8b39f P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:51.357451 13886 raft_consensus.cc:383] T ca959e42c8764eeba0faee96caf8b39f P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:51.357537 13886 raft_consensus.cc:738] T ca959e42c8764eeba0faee96caf8b39f P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:54:51.357749 13886 consensus_queue.cc:260] T ca959e42c8764eeba0faee96caf8b39f P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:51.358891 13886 ts_tablet_manager.cc:1428] T ca959e42c8764eeba0faee96caf8b39f P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.045s user 0.001s sys 0.001s
I20250830 07:54:51.333770 13701 leader_election.cc:304] T a8baad9c419e436b9659d8d5582d4066 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters:
I20250830 07:54:51.359941 13231 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_ceaf585c8f1744e1b9df594f917269d8" } modify_external_catalogs: true
I20250830 07:54:51.360133 13231 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_ceaf585c8f1744e1b9df594f917269d8" } modify_external_catalogs: true
I20250830 07:54:51.361285 15339 raft_consensus.cc:2802] T a8baad9c419e436b9659d8d5582d4066 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:54:51.361394 15339 raft_consensus.cc:491] T a8baad9c419e436b9659d8d5582d4066 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:54:51.361502 15339 raft_consensus.cc:3058] T a8baad9c419e436b9659d8d5582d4066 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:51.362953 13234 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_cd54532fe57a49b8a1cc29a5538321d7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:51.369506 13234 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_cd54532fe57a49b8a1cc29a5538321d7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:51.372643 15339 raft_consensus.cc:513] T a8baad9c419e436b9659d8d5582d4066 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:51.373510 15339 leader_election.cc:290] T a8baad9c419e436b9659d8d5582d4066 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Requested vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967)
I20250830 07:54:51.373646 15339 raft_consensus.cc:491] T 95b6f084eb5240ea94c125eaa154ac9f P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:51.373749 15339 raft_consensus.cc:513] T 95b6f084eb5240ea94c125eaa154ac9f P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:51.377069 13233 master_service.cc:948] ReplaceTablet: received request to replace tablet 0208de98277c4d6889fb0289b6013ae1 from {username='slave'} at 127.0.0.1:42126
I20250830 07:54:51.378857 15339 leader_election.cc:290] T 95b6f084eb5240ea94c125eaa154ac9f P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967)
I20250830 07:54:51.327706 14975 leader_election.cc:290] T d37fe59b4f964f30bb1ed4cb00868b75 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Requested vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967)
W20250830 07:54:51.380417 13701 leader_election.cc:343] T 50360492db824755a6de251436cab5c6 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): Not found: Tablet not found: 50360492db824755a6de251436cab5c6
I20250830 07:54:51.381104 13701 leader_election.cc:304] T d64f20df166a46249c08444f44422fc3 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters:
I20250830 07:54:51.382015 15342 raft_consensus.cc:2802] T d64f20df166a46249c08444f44422fc3 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election won for term 1
I20250830 07:54:51.382375 15342 raft_consensus.cc:695] T d64f20df166a46249c08444f44422fc3 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 LEADER]: Becoming Leader. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Running, Role: LEADER
I20250830 07:54:51.382652 13887 tablet_bootstrap.cc:492] T d1153d8cd2994377ac0dcbfeeda1fd52 P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:54:51.382835 13887 ts_tablet_manager.cc:1397] T d1153d8cd2994377ac0dcbfeeda1fd52 P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.028s user 0.004s sys 0.000s
I20250830 07:54:51.383634 13887 raft_consensus.cc:357] T d1153d8cd2994377ac0dcbfeeda1fd52 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:51.383867 13887 raft_consensus.cc:383] T d1153d8cd2994377ac0dcbfeeda1fd52 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:51.384014 13887 raft_consensus.cc:738] T d1153d8cd2994377ac0dcbfeeda1fd52 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:54:51.384302 13887 consensus_queue.cc:260] T d1153d8cd2994377ac0dcbfeeda1fd52 P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:51.385001 13887 ts_tablet_manager.cc:1428] T d1153d8cd2994377ac0dcbfeeda1fd52 P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20250830 07:54:51.385329 13887 tablet_bootstrap.cc:492] T 6ccbaf109e36453ea6645dfd090f5a1a P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:54:51.387571 13887 tablet_bootstrap.cc:654] T 6ccbaf109e36453ea6645dfd090f5a1a P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:51.388007 13233 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_e8e9b4f20799486282c3998dac420480" } new_table_name: "default.Table_155d9585246a4bc79c07cb9e86f6279b" modify_external_catalogs: true
W20250830 07:54:51.388509 13703 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.209.2:38967, user_credentials={real_user=slave}} blocked reactor thread for 163805us
W20250830 07:54:51.388746 13703 consensus_peers.cc:489] T b83dfc54383d4e7b96523568aea5c9f3 P 9b057ade5dce45af9f8bf0bedf8b917f -> Peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Couldn't send request to peer 6b5e454d98894637b466ea27f1b647f9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20250830 07:54:51.390794 13225 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_e622be14e2824ec1939de81fe5d6f1f8" } modify_external_catalogs: true
I20250830 07:54:51.391001 13225 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_e622be14e2824ec1939de81fe5d6f1f8" } modify_external_catalogs: true
I20250830 07:54:51.400946 13230 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_9e79664b7b3a40c395755c0ff1ea6322"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:51.401561 13230 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9e79664b7b3a40c395755c0ff1ea6322 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:51.409379 13887 tablet_bootstrap.cc:492] T 6ccbaf109e36453ea6645dfd090f5a1a P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:54:51.409369 13478 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "a8baad9c419e436b9659d8d5582d4066" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba"
I20250830 07:54:51.409783 13478 raft_consensus.cc:3058] T a8baad9c419e436b9659d8d5582d4066 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:51.409929 13887 ts_tablet_manager.cc:1397] T 6ccbaf109e36453ea6645dfd090f5a1a P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.025s user 0.002s sys 0.006s
I20250830 07:54:51.412312 13478 raft_consensus.cc:2466] T a8baad9c419e436b9659d8d5582d4066 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 1.
I20250830 07:54:51.411998 13887 raft_consensus.cc:357] T 6ccbaf109e36453ea6645dfd090f5a1a P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:51.412745 13478 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "95b6f084eb5240ea94c125eaa154ac9f" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:54:51.412642 13887 raft_consensus.cc:383] T 6ccbaf109e36453ea6645dfd090f5a1a P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:51.412917 13478 raft_consensus.cc:2466] T 95b6f084eb5240ea94c125eaa154ac9f P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 0.
I20250830 07:54:51.413084 13887 raft_consensus.cc:738] T 6ccbaf109e36453ea6645dfd090f5a1a P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:54:51.413981 13887 consensus_queue.cc:260] T 6ccbaf109e36453ea6645dfd090f5a1a P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:51.382848 15342 consensus_queue.cc:237] T d64f20df166a46249c08444f44422fc3 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:51.416844 13886 tablet_bootstrap.cc:492] T 057bcce2860345da860acc262dc4d339 P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:54:51.417260 13887 ts_tablet_manager.cc:1428] T 6ccbaf109e36453ea6645dfd090f5a1a P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.007s user 0.001s sys 0.001s
I20250830 07:54:51.418571 13887 tablet_bootstrap.cc:492] T 852e353f6ee945628ddebdbdd1bd76fb P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:54:51.427750 13887 tablet_bootstrap.cc:654] T 852e353f6ee945628ddebdbdd1bd76fb P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:51.433454 15322 raft_consensus.cc:491] T 88bbd6b4c795433d9b6ad746353f3aa1 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:51.433585 15322 raft_consensus.cc:513] T 88bbd6b4c795433d9b6ad746353f3aa1 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:51.434121 15322 leader_election.cc:290] T 88bbd6b4c795433d9b6ad746353f3aa1 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:51.436764 13887 tablet_bootstrap.cc:492] T 852e353f6ee945628ddebdbdd1bd76fb P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:54:51.437299 13887 ts_tablet_manager.cc:1397] T 852e353f6ee945628ddebdbdd1bd76fb P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.019s user 0.004s sys 0.000s
I20250830 07:54:51.441517 13887 raft_consensus.cc:357] T 852e353f6ee945628ddebdbdd1bd76fb P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:51.442390 13887 raft_consensus.cc:383] T 852e353f6ee945628ddebdbdd1bd76fb P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:51.442667 13887 raft_consensus.cc:738] T 852e353f6ee945628ddebdbdd1bd76fb P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:54:51.443578 13887 consensus_queue.cc:260] T 852e353f6ee945628ddebdbdd1bd76fb P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:51.446763 13887 ts_tablet_manager.cc:1428] T 852e353f6ee945628ddebdbdd1bd76fb P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.009s user 0.001s sys 0.001s
I20250830 07:54:51.448208 13887 tablet_bootstrap.cc:492] T ef1ab62a5b7845e58d50f34206eaaa27 P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
W20250830 07:54:51.451040 13227 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 381b57c8b76a4b1bb9acab08c0544588 consensus state has no leader
I20250830 07:54:51.454322 13232 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet b2248b305c9f448a9e30661142ad10ea
I20250830 07:54:51.455621 13232 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_1cb0265666a24b4fb1b96f5c47d3d1e6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:51.456523 13232 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1cb0265666a24b4fb1b96f5c47d3d1e6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:51.456984 13887 tablet_bootstrap.cc:654] T ef1ab62a5b7845e58d50f34206eaaa27 P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:51.459241 15323 raft_consensus.cc:491] T a7dc529c40544bafbc9e7f0ab34086bd P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:51.459357 15323 raft_consensus.cc:513] T a7dc529c40544bafbc9e7f0ab34086bd P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
W20250830 07:54:51.459918 13227 catalog_manager.cc:5415] Ignoring report from unknown tablet 6ccbaf109e36453ea6645dfd090f5a1a
I20250830 07:54:51.459931 15323 leader_election.cc:290] T a7dc529c40544bafbc9e7f0ab34086bd P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
W20250830 07:54:51.460083 13227 catalog_manager.cc:5415] Ignoring report from unknown tablet d33a5d107c6849aca6eb48ffdf8a5463
W20250830 07:54:51.460172 13227 catalog_manager.cc:5415] Ignoring report from unknown tablet d1153d8cd2994377ac0dcbfeeda1fd52
W20250830 07:54:51.460405 13227 catalog_manager.cc:5415] Ignoring report from unknown tablet 62bc8168176e4678a77827c5b7cc0f3e
W20250830 07:54:51.460610 13227 catalog_manager.cc:5415] Ignoring report from unknown tablet 88bbd6b4c795433d9b6ad746353f3aa1
W20250830 07:54:51.460721 13227 catalog_manager.cc:5415] Ignoring report from unknown tablet 8ae468b43b4c450ca7591b543c2539d9
I20250830 07:54:51.461745 13227 catalog_manager.cc:5674] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325) does not have the latest schema for tablet 0ceccc5f18294356894695fe08d73e30 (table default.Table_32d032fe8fba47348e797c68bb7ea866 [id=0e99ba575a7a4f8dae74a98627249018]). Expected version 1 got 0
I20250830 07:54:51.473789 13227 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_a1408cb2875640438258e1ee153b6b3a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:51.474503 13227 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a1408cb2875640438258e1ee153b6b3a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:51.492892 15323 raft_consensus.cc:491] T 3bb48fce24074a8e8ec99d3172a655d8 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:51.493065 15323 raft_consensus.cc:513] T 3bb48fce24074a8e8ec99d3172a655d8 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:51.493675 15323 leader_election.cc:290] T 3bb48fce24074a8e8ec99d3172a655d8 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:51.495733 13593 tablet_service.cc:1515] Processing DeleteTablet for tablet b2248b305c9f448a9e30661142ad10ea with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:51 UTC) from {username='slave'} at 127.0.0.1:45306
I20250830 07:54:51.495929 13887 tablet_bootstrap.cc:492] T ef1ab62a5b7845e58d50f34206eaaa27 P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:54:51.496539 13887 ts_tablet_manager.cc:1397] T ef1ab62a5b7845e58d50f34206eaaa27 P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.049s user 0.003s sys 0.006s
I20250830 07:54:51.501284 13887 raft_consensus.cc:357] T ef1ab62a5b7845e58d50f34206eaaa27 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:51.502439 13887 raft_consensus.cc:383] T ef1ab62a5b7845e58d50f34206eaaa27 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:51.502887 13887 raft_consensus.cc:738] T ef1ab62a5b7845e58d50f34206eaaa27 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:54:51.504926 13617 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "88bbd6b4c795433d9b6ad746353f3aa1" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:51.504438 13887 consensus_queue.cc:260] T ef1ab62a5b7845e58d50f34206eaaa27 P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:51.505903 13617 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "3bb48fce24074a8e8ec99d3172a655d8" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:51.506045 13615 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "a7dc529c40544bafbc9e7f0ab34086bd" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
W20250830 07:54:51.506534 13423 leader_election.cc:343] T 88bbd6b4c795433d9b6ad746353f3aa1 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
W20250830 07:54:51.507113 13220 catalog_manager.cc:4908] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet b2248b305c9f448a9e30661142ad10ea because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b2248b305c9f448a9e30661142ad10ea already in progress: creating tablet
I20250830 07:54:51.507604 13887 ts_tablet_manager.cc:1428] T ef1ab62a5b7845e58d50f34206eaaa27 P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.011s user 0.000s sys 0.003s
I20250830 07:54:51.508898 13887 tablet_bootstrap.cc:492] T 057bcce2860345da860acc262dc4d339 P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
W20250830 07:54:51.508934 13423 leader_election.cc:343] T 3bb48fce24074a8e8ec99d3172a655d8 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
W20250830 07:54:51.509675 13423 leader_election.cc:343] T a7dc529c40544bafbc9e7f0ab34086bd P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:51.513991 13886 tablet_bootstrap.cc:654] T 057bcce2860345da860acc262dc4d339 P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:51.515023 13887 tablet_bootstrap.cc:654] T 057bcce2860345da860acc262dc4d339 P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:51.530329 13882 tablet_bootstrap.cc:492] T 74891b8103e144c486750f64ba2003f4 P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:54:51.530810 13882 ts_tablet_manager.cc:1397] T 74891b8103e144c486750f64ba2003f4 P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.197s user 0.015s sys 0.015s
I20250830 07:54:51.535229 13887 tablet_bootstrap.cc:492] T 057bcce2860345da860acc262dc4d339 P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:54:51.535458 13887 ts_tablet_manager.cc:1397] T 057bcce2860345da860acc262dc4d339 P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.027s user 0.001s sys 0.006s
W20250830 07:54:51.536500 13703 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.209.2:38967, user_credentials={real_user=slave}} blocked reactor thread for 147563us
I20250830 07:54:51.536489 13887 raft_consensus.cc:357] T 057bcce2860345da860acc262dc4d339 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
W20250830 07:54:51.536736 13703 leader_election.cc:343] T a8baad9c419e436b9659d8d5582d4066 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:51.536747 13887 raft_consensus.cc:383] T 057bcce2860345da860acc262dc4d339 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:51.536823 13887 raft_consensus.cc:738] T 057bcce2860345da860acc262dc4d339 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
W20250830 07:54:51.537079 13703 leader_election.cc:343] T d64f20df166a46249c08444f44422fc3 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:51.537145 13887 consensus_queue.cc:260] T 057bcce2860345da860acc262dc4d339 P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
W20250830 07:54:51.537824 13703 leader_election.cc:343] T 9ffa3c1d128c49c8b8e2566c6a64304a P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:51.538154 13887 ts_tablet_manager.cc:1428] T 057bcce2860345da860acc262dc4d339 P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20250830 07:54:51.538622 13887 tablet_bootstrap.cc:492] T db4077bf8e184ac5809ef629222f2cc5 P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
W20250830 07:54:51.541013 13701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.209.1:45325, user_credentials={real_user=slave}} blocked reactor thread for 154841us
I20250830 07:54:51.543531 15245 raft_consensus.cc:491] T 70703eb1d47841a1a227e277ed6a268d P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:51.543684 15245 raft_consensus.cc:513] T 70703eb1d47841a1a227e277ed6a268d P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:51.544215 15245 leader_election.cc:290] T 70703eb1d47841a1a227e277ed6a268d P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967)
I20250830 07:54:51.547595 13617 raft_consensus.cc:3058] T 09586fdda94c4aff9d3fa25d71fe6ac0 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:51.548475 13622 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "95b6f084eb5240ea94c125eaa154ac9f" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:51.549036 13629 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "d37fe59b4f964f30bb1ed4cb00868b75" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9"
I20250830 07:54:51.549469 13611 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "a8baad9c419e436b9659d8d5582d4066" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9"
I20250830 07:54:51.551971 13882 raft_consensus.cc:357] T 74891b8103e144c486750f64ba2003f4 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:51.552125 13882 raft_consensus.cc:383] T 74891b8103e144c486750f64ba2003f4 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:51.552178 13882 raft_consensus.cc:738] T 74891b8103e144c486750f64ba2003f4 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:54:51.552340 13882 consensus_queue.cc:260] T 74891b8103e144c486750f64ba2003f4 P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:51.560684 13882 ts_tablet_manager.cc:1428] T 74891b8103e144c486750f64ba2003f4 P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.030s user 0.001s sys 0.000s
I20250830 07:54:51.561954 13882 tablet_bootstrap.cc:492] T 65f1ee59e6e9498381d686f16a865e23 P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:54:51.571218 13882 tablet_bootstrap.cc:654] T 65f1ee59e6e9498381d686f16a865e23 P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:51.571440 15245 raft_consensus.cc:491] T ca959e42c8764eeba0faee96caf8b39f P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:51.571564 15245 raft_consensus.cc:513] T ca959e42c8764eeba0faee96caf8b39f P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:51.572141 15245 leader_election.cc:290] T ca959e42c8764eeba0faee96caf8b39f P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967)
I20250830 07:54:51.573709 13764 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "88bbd6b4c795433d9b6ad746353f3aa1" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:51.574100 13764 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "a7dc529c40544bafbc9e7f0ab34086bd" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:51.575320 13764 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "3bb48fce24074a8e8ec99d3172a655d8" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:51.576280 13701 leader_election.cc:304] T d37fe59b4f964f30bb1ed4cb00868b75 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters:
I20250830 07:54:51.577139 15245 raft_consensus.cc:2802] T d37fe59b4f964f30bb1ed4cb00868b75 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election won for term 1
I20250830 07:54:51.577306 15245 raft_consensus.cc:695] T d37fe59b4f964f30bb1ed4cb00868b75 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 LEADER]: Becoming Leader. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Running, Role: LEADER
I20250830 07:54:51.577589 15245 consensus_queue.cc:237] T d37fe59b4f964f30bb1ed4cb00868b75 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:51.582085 13820 heartbeater.cc:344] Connected to a master server at 127.12.209.60:43889
I20250830 07:54:51.583089 15246 raft_consensus.cc:491] T 28c2f7a3a6dd444585f0f5d337b985e9 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:51.583249 15246 raft_consensus.cc:513] T 28c2f7a3a6dd444585f0f5d337b985e9 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:51.583819 15246 leader_election.cc:290] T 28c2f7a3a6dd444585f0f5d337b985e9 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967)
I20250830 07:54:51.586622 13231 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet 76ab56c469cf4675a4e21acbe0a8085d
W20250830 07:54:51.590412 13229 catalog_manager.cc:5415] Ignoring report from unknown tablet 852e353f6ee945628ddebdbdd1bd76fb
W20250830 07:54:51.590510 13229 catalog_manager.cc:5415] Ignoring report from unknown tablet 6ccbaf109e36453ea6645dfd090f5a1a
W20250830 07:54:51.591024 13231 catalog_manager.cc:5415] Ignoring report from unknown tablet d1153d8cd2994377ac0dcbfeeda1fd52
I20250830 07:54:51.591351 13231 catalog_manager.cc:5582] T 9ffa3c1d128c49c8b8e2566c6a64304a P 9b057ade5dce45af9f8bf0bedf8b917f reported cstate change: term changed from 0 to 1, leader changed from <none> to 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3). New cstate: current_term: 1 leader_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } health_report { overall_health: HEALTHY } } }
I20250830 07:54:51.591641 13228 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_c1beaa156a2345c5a5d403b043c9bd63"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:51.592222 13228 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c1beaa156a2345c5a5d403b043c9bd63 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:51.594197 13593 tablet_service.cc:1515] Processing DeleteTablet for tablet 76ab56c469cf4675a4e21acbe0a8085d with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:51 UTC) from {username='slave'} at 127.0.0.1:45306
I20250830 07:54:51.595548 13229 master_service.cc:948] ReplaceTablet: received request to replace tablet 713c12e1efec4e6f9895c65dc8a9c4b9 from {username='slave'} at 127.0.0.1:42126
I20250830 07:54:51.596005 13234 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_e28fa3cd9d874266905f2bf1bfd1afca" } new_table_name: "default.Table_5a06577c7cb44c0891fea3118230a083" modify_external_catalogs: true
I20250830 07:54:51.602252 13886 tablet_bootstrap.cc:492] T 057bcce2860345da860acc262dc4d339 P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:54:51.602392 13886 ts_tablet_manager.cc:1397] T 057bcce2860345da860acc262dc4d339 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.186s user 0.000s sys 0.003s
I20250830 07:54:51.603143 13886 raft_consensus.cc:357] T 057bcce2860345da860acc262dc4d339 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
W20250830 07:54:51.603250 13220 catalog_manager.cc:4908] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet 76ab56c469cf4675a4e21acbe0a8085d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 76ab56c469cf4675a4e21acbe0a8085d already in progress: creating tablet
I20250830 07:54:51.607106 13886 raft_consensus.cc:383] T 057bcce2860345da860acc262dc4d339 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:51.607185 13886 raft_consensus.cc:738] T 057bcce2860345da860acc262dc4d339 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:54:51.607375 13886 consensus_queue.cc:260] T 057bcce2860345da860acc262dc4d339 P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:51.607770 13886 ts_tablet_manager.cc:1428] T 057bcce2860345da860acc262dc4d339 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20250830 07:54:51.608166 13887 tablet_bootstrap.cc:654] T db4077bf8e184ac5809ef629222f2cc5 P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
W20250830 07:54:51.608464 13233 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet e5c8a6e8e5854274bd0548c6ece9bf2d consensus state has no leader
I20250830 07:54:51.608598 13886 tablet_bootstrap.cc:492] T da5c7b084e1f4fda92fff35a9cb2c7fc P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:54:51.608619 15246 raft_consensus.cc:491] T 519b3e58b63b402d84e234f5e180b98c P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:51.608790 13233 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_ff25925f1f064f088911049c80b77237" } modify_external_catalogs: true
I20250830 07:54:51.608780 15246 raft_consensus.cc:513] T 519b3e58b63b402d84e234f5e180b98c P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:51.608940 13233 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_ff25925f1f064f088911049c80b77237" } modify_external_catalogs: true
I20250830 07:54:51.609391 15246 leader_election.cc:290] T 519b3e58b63b402d84e234f5e180b98c P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967)
I20250830 07:54:51.609894 13886 tablet_bootstrap.cc:654] T da5c7b084e1f4fda92fff35a9cb2c7fc P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:51.605603 13701 leader_election.cc:304] T a8baad9c419e436b9659d8d5582d4066 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters:
I20250830 07:54:51.611941 13701 leader_election.cc:304] T 95b6f084eb5240ea94c125eaa154ac9f P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters:
I20250830 07:54:51.615044 15342 raft_consensus.cc:2802] T 95b6f084eb5240ea94c125eaa154ac9f P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:54:51.615121 15342 raft_consensus.cc:491] T 95b6f084eb5240ea94c125eaa154ac9f P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:54:51.615183 15342 raft_consensus.cc:3058] T 95b6f084eb5240ea94c125eaa154ac9f P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:51.617914 14975 consensus_queue.cc:1035] T b83dfc54383d4e7b96523568aea5c9f3 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:54:51.612355 13764 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "09586fdda94c4aff9d3fa25d71fe6ac0" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:51.612520 13775 raft_consensus.cc:1238] T 04eadf45b82e4c319eb7b316a402d81a P 9b057ade5dce45af9f8bf0bedf8b917f [term 3 LEADER]: Rejecting Update request from peer 6b5e454d98894637b466ea27f1b647f9 for earlier term 2. Current term is 3. Ops: []
I20250830 07:54:51.617978 15342 raft_consensus.cc:513] T 95b6f084eb5240ea94c125eaa154ac9f P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:51.619050 13619 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "70703eb1d47841a1a227e277ed6a268d" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:51.619239 15342 leader_election.cc:290] T 95b6f084eb5240ea94c125eaa154ac9f P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Requested vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967)
I20250830 07:54:51.621482 13619 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "ca959e42c8764eeba0faee96caf8b39f" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
W20250830 07:54:51.621734 13422 leader_election.cc:343] T 88bbd6b4c795433d9b6ad746353f3aa1 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:51.621847 13422 leader_election.cc:304] T 88bbd6b4c795433d9b6ad746353f3aa1 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba; no voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:54:51.622103 15009 raft_consensus.cc:2747] T 88bbd6b4c795433d9b6ad746353f3aa1 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20250830 07:54:51.622231 13422 leader_election.cc:343] T a7dc529c40544bafbc9e7f0ab34086bd P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:51.622315 13422 leader_election.cc:304] T a7dc529c40544bafbc9e7f0ab34086bd P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba; no voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:54:51.622646 15322 raft_consensus.cc:2747] T a7dc529c40544bafbc9e7f0ab34086bd P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20250830 07:54:51.622756 13422 leader_election.cc:343] T 3bb48fce24074a8e8ec99d3172a655d8 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:51.622838 13422 leader_election.cc:304] T 3bb48fce24074a8e8ec99d3172a655d8 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba; no voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:54:51.623099 15009 raft_consensus.cc:2747] T 3bb48fce24074a8e8ec99d3172a655d8 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:54:51.612079 15246 raft_consensus.cc:2802] T a8baad9c419e436b9659d8d5582d4066 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election won for term 1
I20250830 07:54:51.623574 15246 raft_consensus.cc:695] T a8baad9c419e436b9659d8d5582d4066 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 LEADER]: Becoming Leader. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Running, Role: LEADER
I20250830 07:54:51.623829 15246 consensus_queue.cc:237] T a8baad9c419e436b9659d8d5582d4066 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:51.625128 13478 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "ca959e42c8764eeba0faee96caf8b39f" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:54:51.625293 13478 raft_consensus.cc:2466] T ca959e42c8764eeba0faee96caf8b39f P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 0.
I20250830 07:54:51.625504 13886 tablet_bootstrap.cc:492] T da5c7b084e1f4fda92fff35a9cb2c7fc P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:54:51.625659 13886 ts_tablet_manager.cc:1397] T da5c7b084e1f4fda92fff35a9cb2c7fc P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.017s user 0.002s sys 0.001s
I20250830 07:54:51.625944 13486 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "28c2f7a3a6dd444585f0f5d337b985e9" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:54:51.626111 13486 raft_consensus.cc:2466] T 28c2f7a3a6dd444585f0f5d337b985e9 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 0.
I20250830 07:54:51.626293 13886 raft_consensus.cc:357] T da5c7b084e1f4fda92fff35a9cb2c7fc P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:51.626487 13886 raft_consensus.cc:383] T da5c7b084e1f4fda92fff35a9cb2c7fc P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:51.626571 13886 raft_consensus.cc:738] T da5c7b084e1f4fda92fff35a9cb2c7fc P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:54:51.626770 13886 consensus_queue.cc:260] T da5c7b084e1f4fda92fff35a9cb2c7fc P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:51.627327 13886 ts_tablet_manager.cc:1428] T da5c7b084e1f4fda92fff35a9cb2c7fc P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20250830 07:54:51.627549 13482 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "519b3e58b63b402d84e234f5e180b98c" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:54:51.627606 13886 tablet_bootstrap.cc:492] T 3c3c798b2b7b460b98a30605464763e6 P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:54:51.627697 13482 raft_consensus.cc:2466] T 519b3e58b63b402d84e234f5e180b98c P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 0.
I20250830 07:54:51.627725 13619 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "28c2f7a3a6dd444585f0f5d337b985e9" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:51.629392 13886 tablet_bootstrap.cc:654] T 3c3c798b2b7b460b98a30605464763e6 P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:51.631103 13619 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "519b3e58b63b402d84e234f5e180b98c" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:51.632467 13882 tablet_bootstrap.cc:492] T 65f1ee59e6e9498381d686f16a865e23 P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:54:51.636530 13482 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "95b6f084eb5240ea94c125eaa154ac9f" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba"
I20250830 07:54:51.636688 13482 raft_consensus.cc:3058] T 95b6f084eb5240ea94c125eaa154ac9f P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:51.637876 13882 ts_tablet_manager.cc:1397] T 65f1ee59e6e9498381d686f16a865e23 P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.076s user 0.004s sys 0.001s
I20250830 07:54:51.639384 13882 raft_consensus.cc:357] T 65f1ee59e6e9498381d686f16a865e23 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:51.639462 13701 leader_election.cc:304] T ca959e42c8764eeba0faee96caf8b39f P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters:
I20250830 07:54:51.639858 13701 leader_election.cc:304] T 28c2f7a3a6dd444585f0f5d337b985e9 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters:
I20250830 07:54:51.640223 13701 leader_election.cc:304] T 519b3e58b63b402d84e234f5e180b98c P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters:
I20250830 07:54:51.640503 13882 raft_consensus.cc:383] T 65f1ee59e6e9498381d686f16a865e23 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:51.640627 13882 raft_consensus.cc:738] T 65f1ee59e6e9498381d686f16a865e23 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:54:51.640836 15361 raft_consensus.cc:2802] T ca959e42c8764eeba0faee96caf8b39f P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:54:51.635071 13481 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "70703eb1d47841a1a227e277ed6a268d" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:54:51.640913 15361 raft_consensus.cc:491] T ca959e42c8764eeba0faee96caf8b39f P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:54:51.640973 15361 raft_consensus.cc:3058] T ca959e42c8764eeba0faee96caf8b39f P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:51.640781 13482 raft_consensus.cc:2466] T 95b6f084eb5240ea94c125eaa154ac9f P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 1.
I20250830 07:54:51.641014 13481 raft_consensus.cc:2466] T 70703eb1d47841a1a227e277ed6a268d P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 0.
I20250830 07:54:51.642488 13225 catalog_manager.cc:5864] Not sending DeleteTablet requests; no consensus state for tablet 83b32e6560a04fac9545315c554f0d83
I20250830 07:54:51.642782 13225 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_7db597e6145e4826a32a5ed5ba6f2397" } modify_external_catalogs: true
I20250830 07:54:51.642954 13225 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_7db597e6145e4826a32a5ed5ba6f2397" } modify_external_catalogs: true
I20250830 07:54:51.643288 15339 raft_consensus.cc:2802] T 28c2f7a3a6dd444585f0f5d337b985e9 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:54:51.643366 15339 raft_consensus.cc:491] T 28c2f7a3a6dd444585f0f5d337b985e9 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:54:51.643427 15339 raft_consensus.cc:3058] T 28c2f7a3a6dd444585f0f5d337b985e9 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:51.646128 15339 raft_consensus.cc:513] T 28c2f7a3a6dd444585f0f5d337b985e9 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:51.646806 15339 leader_election.cc:290] T 28c2f7a3a6dd444585f0f5d337b985e9 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Requested vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967)
I20250830 07:54:51.647293 15367 raft_consensus.cc:2802] T 519b3e58b63b402d84e234f5e180b98c P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:54:51.647374 15367 raft_consensus.cc:491] T 519b3e58b63b402d84e234f5e180b98c P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:54:51.647444 15367 raft_consensus.cc:3058] T 519b3e58b63b402d84e234f5e180b98c P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:51.648802 13481 raft_consensus.cc:1238] T 04eadf45b82e4c319eb7b316a402d81a P 2065c332f15a4739899af79f3669c3ba [term 3 FOLLOWER]: Rejecting Update request from peer 6b5e454d98894637b466ea27f1b647f9 for earlier term 2. Current term is 3. Ops: []
I20250830 07:54:51.649890 15367 raft_consensus.cc:513] T 519b3e58b63b402d84e234f5e180b98c P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:51.650404 15367 leader_election.cc:290] T 519b3e58b63b402d84e234f5e180b98c P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Requested vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967)
I20250830 07:54:51.651741 15361 raft_consensus.cc:513] T ca959e42c8764eeba0faee96caf8b39f P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:51.652247 15361 leader_election.cc:290] T ca959e42c8764eeba0faee96caf8b39f P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Requested vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967)
W20250830 07:54:51.656201 13230 catalog_manager.cc:5415] Ignoring report from unknown tablet 057bcce2860345da860acc262dc4d339
W20250830 07:54:51.656335 13230 catalog_manager.cc:5415] Ignoring report from unknown tablet ef1ab62a5b7845e58d50f34206eaaa27
I20250830 07:54:51.656966 13230 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_e326fff272534f8ba6bbb330b4be2815" } new_table_name: "default.Table_de45d4a3edad47b98cf701e1194c0182" modify_external_catalogs: true
I20250830 07:54:51.665151 13228 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_50d4652c477d4ff08d6d7e52bf96f2f2" } new_table_name: "default.Table_5eaa058c9c1d4f8ea326e10670fe3b8c" modify_external_catalogs: true
I20250830 07:54:51.666380 13232 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_63ea2781d7fe44ef80424cb95aa119e2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:51.666855 13232 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_63ea2781d7fe44ef80424cb95aa119e2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:51.667670 13886 tablet_bootstrap.cc:492] T 3c3c798b2b7b460b98a30605464763e6 P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:54:51.667779 13886 ts_tablet_manager.cc:1397] T 3c3c798b2b7b460b98a30605464763e6 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.040s user 0.001s sys 0.002s
I20250830 07:54:51.668452 13886 raft_consensus.cc:357] T 3c3c798b2b7b460b98a30605464763e6 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:51.668620 13886 raft_consensus.cc:383] T 3c3c798b2b7b460b98a30605464763e6 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:51.668677 13886 raft_consensus.cc:738] T 3c3c798b2b7b460b98a30605464763e6 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:54:51.668824 13886 consensus_queue.cc:260] T 3c3c798b2b7b460b98a30605464763e6 P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:51.668947 13231 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_8f4096dfe88744eba43d043570d30126"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250830 07:54:51.669281 13886 ts_tablet_manager.cc:1428] T 3c3c798b2b7b460b98a30605464763e6 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.001s user 0.001s sys 0.001s
W20250830 07:54:51.669386 13231 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8f4096dfe88744eba43d043570d30126 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:51.669552 13886 tablet_bootstrap.cc:492] T 924403105a6a40f28aad60647a2a8987 P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:54:51.672818 13886 tablet_bootstrap.cc:654] T 924403105a6a40f28aad60647a2a8987 P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:51.674348 13887 tablet_bootstrap.cc:492] T db4077bf8e184ac5809ef629222f2cc5 P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:54:51.674479 13887 ts_tablet_manager.cc:1397] T db4077bf8e184ac5809ef629222f2cc5 P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.136s user 0.004s sys 0.007s
I20250830 07:54:51.675340 13887 raft_consensus.cc:357] T db4077bf8e184ac5809ef629222f2cc5 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:51.675537 13887 raft_consensus.cc:383] T db4077bf8e184ac5809ef629222f2cc5 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:51.675603 13887 raft_consensus.cc:738] T db4077bf8e184ac5809ef629222f2cc5 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:54:51.676057 13229 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet 713c12e1efec4e6f9895c65dc8a9c4b9
I20250830 07:54:51.676159 13887 consensus_queue.cc:260] T db4077bf8e184ac5809ef629222f2cc5 P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:51.676457 13229 catalog_manager.cc:6652] ReplaceTablet: tablet 713c12e1efec4e6f9895c65dc8a9c4b9 deleted and replaced by tablet 499bb6e005d44537852ae5ecb1ce6c6b
I20250830 07:54:51.677429 13229 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_879220e9fdd849c8b4353e345fa075ea"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250830 07:54:51.677443 13887 ts_tablet_manager.cc:1428] T db4077bf8e184ac5809ef629222f2cc5 P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
W20250830 07:54:51.678058 13229 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_879220e9fdd849c8b4353e345fa075ea in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:51.678128 13887 tablet_bootstrap.cc:492] T a8660a6ff9254d4f9f0ef047b8682ed1 P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:54:51.681113 13486 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "28c2f7a3a6dd444585f0f5d337b985e9" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba"
I20250830 07:54:51.681260 13486 raft_consensus.cc:3058] T 28c2f7a3a6dd444585f0f5d337b985e9 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
W20250830 07:54:51.681681 13234 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 420a0d55b9d1484d81b97581f459ba5a has no consensus state
I20250830 07:54:51.683524 13701 leader_election.cc:304] T 95b6f084eb5240ea94c125eaa154ac9f P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters:
I20250830 07:54:51.683689 13486 raft_consensus.cc:2466] T 28c2f7a3a6dd444585f0f5d337b985e9 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 1.
I20250830 07:54:51.683740 15339 raft_consensus.cc:2802] T 95b6f084eb5240ea94c125eaa154ac9f P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election won for term 1
I20250830 07:54:51.683830 15339 raft_consensus.cc:695] T 95b6f084eb5240ea94c125eaa154ac9f P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 LEADER]: Becoming Leader. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Running, Role: LEADER
I20250830 07:54:51.684142 15339 consensus_queue.cc:237] T 95b6f084eb5240ea94c125eaa154ac9f P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:51.684746 13482 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "ca959e42c8764eeba0faee96caf8b39f" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba"
I20250830 07:54:51.684895 13482 raft_consensus.cc:3058] T ca959e42c8764eeba0faee96caf8b39f P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:51.685293 13701 leader_election.cc:304] T 70703eb1d47841a1a227e277ed6a268d P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters:
I20250830 07:54:51.686102 15342 raft_consensus.cc:2802] T 70703eb1d47841a1a227e277ed6a268d P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:54:51.686211 15342 raft_consensus.cc:491] T 70703eb1d47841a1a227e277ed6a268d P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:54:51.686280 15342 raft_consensus.cc:3058] T 70703eb1d47841a1a227e277ed6a268d P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
W20250830 07:54:51.686847 13234 catalog_manager.cc:5415] Ignoring report from unknown tablet ec4a3975961d4f85ad9da94835417574
I20250830 07:54:51.687471 13482 raft_consensus.cc:2466] T ca959e42c8764eeba0faee96caf8b39f P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 1.
I20250830 07:54:51.687949 13486 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "519b3e58b63b402d84e234f5e180b98c" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba"
I20250830 07:54:51.688189 13486 raft_consensus.cc:3058] T 519b3e58b63b402d84e234f5e180b98c P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:51.688658 15342 raft_consensus.cc:513] T 70703eb1d47841a1a227e277ed6a268d P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:51.689102 15342 leader_election.cc:290] T 70703eb1d47841a1a227e277ed6a268d P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Requested vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967)
I20250830 07:54:51.689888 13701 leader_election.cc:304] T 28c2f7a3a6dd444585f0f5d337b985e9 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters:
I20250830 07:54:51.690688 13486 raft_consensus.cc:2466] T 519b3e58b63b402d84e234f5e180b98c P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 1.
I20250830 07:54:51.690990 13886 tablet_bootstrap.cc:492] T 924403105a6a40f28aad60647a2a8987 P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:54:51.691540 15361 raft_consensus.cc:2802] T 28c2f7a3a6dd444585f0f5d337b985e9 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election won for term 1
I20250830 07:54:51.691591 13886 ts_tablet_manager.cc:1397] T 924403105a6a40f28aad60647a2a8987 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.022s user 0.003s sys 0.000s
I20250830 07:54:51.691655 15361 raft_consensus.cc:695] T 28c2f7a3a6dd444585f0f5d337b985e9 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 LEADER]: Becoming Leader. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Running, Role: LEADER
I20250830 07:54:51.691891 15361 consensus_queue.cc:237] T 28c2f7a3a6dd444585f0f5d337b985e9 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:51.692202 13886 raft_consensus.cc:357] T 924403105a6a40f28aad60647a2a8987 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:51.692350 13886 raft_consensus.cc:383] T 924403105a6a40f28aad60647a2a8987 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:51.692405 13886 raft_consensus.cc:738] T 924403105a6a40f28aad60647a2a8987 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:54:51.693493 13482 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "70703eb1d47841a1a227e277ed6a268d" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba"
I20250830 07:54:51.693653 13482 raft_consensus.cc:3058] T 70703eb1d47841a1a227e277ed6a268d P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:51.692764 15340 raft_consensus.cc:491] T ff72a0fd9a0e46a6bd54a15e4ad783b4 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:51.694454 15340 raft_consensus.cc:513] T ff72a0fd9a0e46a6bd54a15e4ad783b4 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:51.694881 15340 leader_election.cc:290] T ff72a0fd9a0e46a6bd54a15e4ad783b4 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967)
I20250830 07:54:51.692556 13886 consensus_queue.cc:260] T 924403105a6a40f28aad60647a2a8987 P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:51.697538 13482 raft_consensus.cc:2466] T 70703eb1d47841a1a227e277ed6a268d P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 1.
I20250830 07:54:51.699134 13886 ts_tablet_manager.cc:1428] T 924403105a6a40f28aad60647a2a8987 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.007s user 0.001s sys 0.000s
I20250830 07:54:51.699596 13886 tablet_bootstrap.cc:492] T 1e48641532cd439e9b4074712033c737 P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:54:51.699997 13701 leader_election.cc:304] T ca959e42c8764eeba0faee96caf8b39f P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters:
I20250830 07:54:51.701189 15340 raft_consensus.cc:2802] T ca959e42c8764eeba0faee96caf8b39f P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election won for term 1
I20250830 07:54:51.701565 15340 raft_consensus.cc:695] T ca959e42c8764eeba0faee96caf8b39f P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 LEADER]: Becoming Leader. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Running, Role: LEADER
I20250830 07:54:51.701785 15340 consensus_queue.cc:237] T ca959e42c8764eeba0faee96caf8b39f P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:51.702296 13478 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "ff72a0fd9a0e46a6bd54a15e4ad783b4" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:54:51.702450 13478 raft_consensus.cc:2466] T ff72a0fd9a0e46a6bd54a15e4ad783b4 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 0.
I20250830 07:54:51.701187 13886 tablet_bootstrap.cc:654] T 1e48641532cd439e9b4074712033c737 P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:51.711127 13701 leader_election.cc:304] T 519b3e58b63b402d84e234f5e180b98c P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters:
I20250830 07:54:51.711872 15246 raft_consensus.cc:2802] T 519b3e58b63b402d84e234f5e180b98c P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election won for term 1
I20250830 07:54:51.712029 15246 raft_consensus.cc:695] T 519b3e58b63b402d84e234f5e180b98c P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 LEADER]: Becoming Leader. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Running, Role: LEADER
I20250830 07:54:51.712288 15246 consensus_queue.cc:237] T 519b3e58b63b402d84e234f5e180b98c P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:51.724754 13887 tablet_bootstrap.cc:654] T a8660a6ff9254d4f9f0ef047b8682ed1 P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:51.727538 13701 leader_election.cc:304] T 70703eb1d47841a1a227e277ed6a268d P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters:
I20250830 07:54:51.727802 15245 raft_consensus.cc:2802] T 70703eb1d47841a1a227e277ed6a268d P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election won for term 1
I20250830 07:54:51.727950 15245 raft_consensus.cc:695] T 70703eb1d47841a1a227e277ed6a268d P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 LEADER]: Becoming Leader. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Running, Role: LEADER
I20250830 07:54:51.728188 15245 consensus_queue.cc:237] T 70703eb1d47841a1a227e277ed6a268d P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:51.736469 13701 leader_election.cc:304] T ff72a0fd9a0e46a6bd54a15e4ad783b4 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters:
I20250830 07:54:51.736975 15365 raft_consensus.cc:2802] T ff72a0fd9a0e46a6bd54a15e4ad783b4 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:54:51.737048 15365 raft_consensus.cc:491] T ff72a0fd9a0e46a6bd54a15e4ad783b4 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:54:51.737104 15365 raft_consensus.cc:3058] T ff72a0fd9a0e46a6bd54a15e4ad783b4 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
W20250830 07:54:51.737712 13234 catalog_manager.cc:5415] Ignoring report from unknown tablet da5c7b084e1f4fda92fff35a9cb2c7fc
W20250830 07:54:51.738075 13234 catalog_manager.cc:5415] Ignoring report from unknown tablet a8baad9c419e436b9659d8d5582d4066
W20250830 07:54:51.738284 13234 catalog_manager.cc:5415] Ignoring report from unknown tablet 057bcce2860345da860acc262dc4d339
W20250830 07:54:51.738680 13234 catalog_manager.cc:5415] Ignoring report from unknown tablet d37fe59b4f964f30bb1ed4cb00868b75
W20250830 07:54:51.739212 13234 catalog_manager.cc:5415] Ignoring report from unknown tablet 1fa571e9490e499792225d7b786e8658
W20250830 07:54:51.739439 13234 catalog_manager.cc:5415] Ignoring report from unknown tablet 8ae468b43b4c450ca7591b543c2539d9
I20250830 07:54:51.739622 15365 raft_consensus.cc:513] T ff72a0fd9a0e46a6bd54a15e4ad783b4 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
W20250830 07:54:51.739617 13234 catalog_manager.cc:5415] Ignoring report from unknown tablet f398e12cd9f543738d5163354f8a9d9d
I20250830 07:54:51.740219 15365 leader_election.cc:290] T ff72a0fd9a0e46a6bd54a15e4ad783b4 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Requested vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967)
W20250830 07:54:51.741683 13234 catalog_manager.cc:5415] Ignoring report from unknown tablet ca959e42c8764eeba0faee96caf8b39f
I20250830 07:54:51.742384 13233 catalog_manager.cc:5864] Not sending DeleteTablet requests; no consensus state for tablet 55feb267e3e5496da10ba707e2a93f4c
W20250830 07:54:51.743221 13228 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 2f4d321785c84a9eb7d4aa3f5953bdce has no consensus state
I20250830 07:54:51.744016 13228 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_ddc698ca5abf45f0b00bb549d4e55e18" } new_table_name: "default.Table_897a451bd01e4cf4b674cee03faa0c7f" modify_external_catalogs: true
I20250830 07:54:51.745695 13478 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "ff72a0fd9a0e46a6bd54a15e4ad783b4" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba"
I20250830 07:54:51.745833 13478 raft_consensus.cc:3058] T ff72a0fd9a0e46a6bd54a15e4ad783b4 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:51.749872 13478 raft_consensus.cc:2466] T ff72a0fd9a0e46a6bd54a15e4ad783b4 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 1.
I20250830 07:54:51.752301 13225 catalog_manager.cc:5864] Not sending DeleteTablet requests; no consensus state for tablet f783b6e91a584ffc8d21645f73264ec7
I20250830 07:54:51.752542 13225 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_fa88ef9c651348d287efdd7af42e9526" } modify_external_catalogs: true
I20250830 07:54:51.752679 13225 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_fa88ef9c651348d287efdd7af42e9526" } modify_external_catalogs: true
I20250830 07:54:51.753149 15381 raft_consensus.cc:491] T da5c7b084e1f4fda92fff35a9cb2c7fc P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:51.753252 15381 raft_consensus.cc:513] T da5c7b084e1f4fda92fff35a9cb2c7fc P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:51.754011 15381 leader_election.cc:290] T da5c7b084e1f4fda92fff35a9cb2c7fc P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967)
I20250830 07:54:51.754885 13701 leader_election.cc:304] T ff72a0fd9a0e46a6bd54a15e4ad783b4 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters:
I20250830 07:54:51.755086 13482 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "da5c7b084e1f4fda92fff35a9cb2c7fc" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:54:51.755235 13482 raft_consensus.cc:2466] T da5c7b084e1f4fda92fff35a9cb2c7fc P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 0.
I20250830 07:54:51.755316 15365 raft_consensus.cc:2802] T ff72a0fd9a0e46a6bd54a15e4ad783b4 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election won for term 1
I20250830 07:54:51.755419 15365 raft_consensus.cc:695] T ff72a0fd9a0e46a6bd54a15e4ad783b4 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 LEADER]: Becoming Leader. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Running, Role: LEADER
I20250830 07:54:51.755622 15365 consensus_queue.cc:237] T ff72a0fd9a0e46a6bd54a15e4ad783b4 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
W20250830 07:54:51.758374 13233 catalog_manager.cc:5415] Ignoring report from unknown tablet b83dfc54383d4e7b96523568aea5c9f3
W20250830 07:54:51.758508 13233 catalog_manager.cc:5415] Ignoring report from unknown tablet 8ae468b43b4c450ca7591b543c2539d9
W20250830 07:54:51.759690 13230 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 964fa8581b7f48a9a264072241a37d64 consensus state has no leader
I20250830 07:54:51.640879 13882 consensus_queue.cc:260] T 65f1ee59e6e9498381d686f16a865e23 P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:51.677165 13593 tablet_service.cc:1515] Processing DeleteTablet for tablet 713c12e1efec4e6f9895c65dc8a9c4b9 with delete_type TABLET_DATA_DELETED (replaced by tablet 499bb6e005d44537852ae5ecb1ce6c6b) from {username='slave'} at 127.0.0.1:45306
I20250830 07:54:51.762442 13882 ts_tablet_manager.cc:1428] T 65f1ee59e6e9498381d686f16a865e23 P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.124s user 0.002s sys 0.000s
I20250830 07:54:51.649394 14748 consensus_queue.cc:1046] T 04eadf45b82e4c319eb7b316a402d81a P 6b5e454d98894637b466ea27f1b647f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.113s
I20250830 07:54:51.762647 13882 tablet_bootstrap.cc:492] T 0ceccc5f18294356894695fe08d73e30 P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:54:51.762703 14748 raft_consensus.cc:3053] T 04eadf45b82e4c319eb7b316a402d81a P 6b5e454d98894637b466ea27f1b647f9 [term 2 LEADER]: Stepping down as leader of term 2
I20250830 07:54:51.762773 14748 raft_consensus.cc:738] T 04eadf45b82e4c319eb7b316a402d81a P 6b5e454d98894637b466ea27f1b647f9 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Running, Role: LEADER
I20250830 07:54:51.763082 14748 consensus_queue.cc:260] T 04eadf45b82e4c319eb7b316a402d81a P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:51.763386 14748 raft_consensus.cc:3058] T 04eadf45b82e4c319eb7b316a402d81a P 6b5e454d98894637b466ea27f1b647f9 [term 2 FOLLOWER]: Advancing to term 3
I20250830 07:54:51.764276 13701 leader_election.cc:304] T da5c7b084e1f4fda92fff35a9cb2c7fc P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters:
I20250830 07:54:51.764425 13882 tablet_bootstrap.cc:654] T 0ceccc5f18294356894695fe08d73e30 P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:51.764714 15342 raft_consensus.cc:2802] T da5c7b084e1f4fda92fff35a9cb2c7fc P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:54:51.764773 15342 raft_consensus.cc:491] T da5c7b084e1f4fda92fff35a9cb2c7fc P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:54:51.764819 15342 raft_consensus.cc:3058] T da5c7b084e1f4fda92fff35a9cb2c7fc P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
W20250830 07:54:51.767001 13220 catalog_manager.cc:4908] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet 713c12e1efec4e6f9895c65dc8a9c4b9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 713c12e1efec4e6f9895c65dc8a9c4b9 already in progress: creating tablet
I20250830 07:54:51.767266 15342 raft_consensus.cc:513] T da5c7b084e1f4fda92fff35a9cb2c7fc P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:51.767701 15342 leader_election.cc:290] T da5c7b084e1f4fda92fff35a9cb2c7fc P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Requested vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967)
I20250830 07:54:51.768572 13478 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "da5c7b084e1f4fda92fff35a9cb2c7fc" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba"
I20250830 07:54:51.768741 13478 raft_consensus.cc:3058] T da5c7b084e1f4fda92fff35a9cb2c7fc P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:51.771687 13478 raft_consensus.cc:2466] T da5c7b084e1f4fda92fff35a9cb2c7fc P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 1.
I20250830 07:54:51.772437 13887 tablet_bootstrap.cc:492] T a8660a6ff9254d4f9f0ef047b8682ed1 P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:54:51.772588 13887 ts_tablet_manager.cc:1397] T a8660a6ff9254d4f9f0ef047b8682ed1 P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.095s user 0.003s sys 0.001s
I20250830 07:54:51.774207 13887 raft_consensus.cc:357] T a8660a6ff9254d4f9f0ef047b8682ed1 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:51.774576 13887 raft_consensus.cc:383] T a8660a6ff9254d4f9f0ef047b8682ed1 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:51.774674 13887 raft_consensus.cc:738] T a8660a6ff9254d4f9f0ef047b8682ed1 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:54:51.775104 13887 consensus_queue.cc:260] T a8660a6ff9254d4f9f0ef047b8682ed1 P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:51.776288 13887 ts_tablet_manager.cc:1428] T a8660a6ff9254d4f9f0ef047b8682ed1 P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.004s user 0.001s sys 0.002s
I20250830 07:54:51.777009 13887 tablet_bootstrap.cc:492] T 796e01f6a36241fc94e335253929d6ab P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:54:51.777361 13701 leader_election.cc:304] T da5c7b084e1f4fda92fff35a9cb2c7fc P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters:
I20250830 07:54:51.777784 15342 raft_consensus.cc:2802] T da5c7b084e1f4fda92fff35a9cb2c7fc P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election won for term 1
I20250830 07:54:51.777885 15342 raft_consensus.cc:695] T da5c7b084e1f4fda92fff35a9cb2c7fc P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 LEADER]: Becoming Leader. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Running, Role: LEADER
I20250830 07:54:51.778065 15342 consensus_queue.cc:237] T da5c7b084e1f4fda92fff35a9cb2c7fc P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:51.780251 13227 master_service.cc:948] ReplaceTablet: received request to replace tablet cd9903bdfaef4139a1a582c54689da4a from {username='slave'} at 127.0.0.1:42126
I20250830 07:54:51.783562 13234 catalog_manager.cc:5582] T d64f20df166a46249c08444f44422fc3 P 9b057ade5dce45af9f8bf0bedf8b917f reported cstate change: term changed from 0 to 1, leader changed from <none> to 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3). New cstate: current_term: 1 leader_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } health_report { overall_health: HEALTHY } } }
I20250830 07:54:51.783919 13234 catalog_manager.cc:5674] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743) does not have the latest schema for tablet d64f20df166a46249c08444f44422fc3 (table default.Table_7a50f4e8c38f4807b9e0bf1f22e2eddb [id=26a7abb1aee44e438ca996ebb2ab37b2]). Expected version 3 got 0
I20250830 07:54:51.784228 13234 catalog_manager.cc:5674] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743) does not have the latest schema for tablet 0ceccc5f18294356894695fe08d73e30 (table default.Table_32d032fe8fba47348e797c68bb7ea866 [id=0e99ba575a7a4f8dae74a98627249018]). Expected version 1 got 0
I20250830 07:54:51.784464 13234 catalog_manager.cc:5674] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743) does not have the latest schema for tablet 3c3c798b2b7b460b98a30605464763e6 (table default.Table_c84716cd62b9446384ad71e0503211db [id=9407d235897b4b56927798496fd114c4]). Expected version 1 got 0
I20250830 07:54:51.791239 13674 heartbeater.cc:344] Connected to a master server at 127.12.209.60:43889
I20250830 07:54:51.796025 13232 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_6cf2cdc2d05c4b499e3ea116b3ac5108"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:51.796501 13232 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6cf2cdc2d05c4b499e3ea116b3ac5108 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:51.799345 13231 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_aa5b0ed256eb418ba139d9678acfa3ff"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:51.800174 13231 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_aa5b0ed256eb418ba139d9678acfa3ff in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:51.802676 13230 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_ac25d9b6411c4b45be69794a94042fad" } modify_external_catalogs: true
I20250830 07:54:51.802875 13230 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_ac25d9b6411c4b45be69794a94042fad" } modify_external_catalogs: true
W20250830 07:54:51.805413 13703 leader_election.cc:343] T 95b6f084eb5240ea94c125eaa154ac9f P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
W20250830 07:54:51.805773 13703 leader_election.cc:343] T 50360492db824755a6de251436cab5c6 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Not found: Tablet not found: 50360492db824755a6de251436cab5c6
I20250830 07:54:51.806164 13703 leader_election.cc:304] T 50360492db824755a6de251436cab5c6 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 2065c332f15a4739899af79f3669c3ba, 6b5e454d98894637b466ea27f1b647f9
W20250830 07:54:51.806622 13703 leader_election.cc:343] T d37fe59b4f964f30bb1ed4cb00868b75 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:51.806788 15361 raft_consensus.cc:2747] T 50360492db824755a6de251436cab5c6 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:54:51.817217 13887 tablet_bootstrap.cc:654] T 796e01f6a36241fc94e335253929d6ab P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:51.823217 13225 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet 473fcf65d49b42dabe9b787cee681f76
I20250830 07:54:51.823912 13593 tablet_service.cc:1515] Processing DeleteTablet for tablet 473fcf65d49b42dabe9b787cee681f76 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:51 UTC) from {username='slave'} at 127.0.0.1:45306
I20250830 07:54:51.824044 13225 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_e511bf2440d5467b8c99f1cc7d61b487"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:51.824512 13225 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e511bf2440d5467b8c99f1cc7d61b487 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250830 07:54:51.825657 13220 catalog_manager.cc:4908] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet 473fcf65d49b42dabe9b787cee681f76 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 473fcf65d49b42dabe9b787cee681f76 already in progress: creating tablet
I20250830 07:54:51.825896 13232 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_93ef94dcadb54242892fcefbec3892a4" } new_table_name: "default.Table_b2462f34066f4cb59a4313b24ac1f54f" modify_external_catalogs: true
I20250830 07:54:51.826144 15323 raft_consensus.cc:491] T db4077bf8e184ac5809ef629222f2cc5 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:51.826285 15323 raft_consensus.cc:513] T db4077bf8e184ac5809ef629222f2cc5 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:51.826859 15323 leader_election.cc:290] T db4077bf8e184ac5809ef629222f2cc5 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
W20250830 07:54:51.826964 13228 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 0ef345c011e247f6a84085bc669ae9ca has no consensus state
I20250830 07:54:51.827622 13619 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "db4077bf8e184ac5809ef629222f2cc5" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:51.827633 13771 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "db4077bf8e184ac5809ef629222f2cc5" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
W20250830 07:54:51.828044 13423 leader_election.cc:343] T db4077bf8e184ac5809ef629222f2cc5 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
W20250830 07:54:51.828272 13422 leader_election.cc:343] T db4077bf8e184ac5809ef629222f2cc5 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:51.828357 13422 leader_election.cc:304] T db4077bf8e184ac5809ef629222f2cc5 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba; no voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:54:51.828800 15323 raft_consensus.cc:2747] T db4077bf8e184ac5809ef629222f2cc5 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:54:51.832443 15009 raft_consensus.cc:491] T 3c3c798b2b7b460b98a30605464763e6 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:51.832574 15009 raft_consensus.cc:513] T 3c3c798b2b7b460b98a30605464763e6 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:51.833195 15009 leader_election.cc:290] T 3c3c798b2b7b460b98a30605464763e6 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:51.833400 13230 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet 3d9c884ac05e44ddb59f96588fdd6f4b
I20250830 07:54:51.834101 13593 tablet_service.cc:1515] Processing DeleteTablet for tablet 3d9c884ac05e44ddb59f96588fdd6f4b with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:51 UTC) from {username='slave'} at 127.0.0.1:45306
I20250830 07:54:51.834431 13771 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "3c3c798b2b7b460b98a30605464763e6" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:51.834638 13771 raft_consensus.cc:2466] T 3c3c798b2b7b460b98a30605464763e6 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2065c332f15a4739899af79f3669c3ba in term 0.
W20250830 07:54:51.834803 13220 catalog_manager.cc:4908] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet 3d9c884ac05e44ddb59f96588fdd6f4b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3d9c884ac05e44ddb59f96588fdd6f4b already in progress: creating tablet
I20250830 07:54:51.835085 13422 leader_election.cc:304] T 3c3c798b2b7b460b98a30605464763e6 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters:
I20250830 07:54:51.835124 13619 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "3c3c798b2b7b460b98a30605464763e6" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
W20250830 07:54:51.835620 13423 leader_election.cc:343] T 3c3c798b2b7b460b98a30605464763e6 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:51.836086 15323 raft_consensus.cc:2802] T 3c3c798b2b7b460b98a30605464763e6 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:54:51.836184 15323 raft_consensus.cc:491] T 3c3c798b2b7b460b98a30605464763e6 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:54:51.836261 15323 raft_consensus.cc:3058] T 3c3c798b2b7b460b98a30605464763e6 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:51.836256 13227 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet cd9903bdfaef4139a1a582c54689da4a
I20250830 07:54:51.836710 13593 tablet_service.cc:1515] Processing DeleteTablet for tablet cd9903bdfaef4139a1a582c54689da4a with delete_type TABLET_DATA_DELETED (replaced by tablet d05b0e744947471a8b704d0fdbe729b3) from {username='slave'} at 127.0.0.1:45306
W20250830 07:54:51.837226 13220 catalog_manager.cc:4908] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet cd9903bdfaef4139a1a582c54689da4a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cd9903bdfaef4139a1a582c54689da4a already in progress: creating tablet
I20250830 07:54:51.837576 13227 catalog_manager.cc:6652] ReplaceTablet: tablet cd9903bdfaef4139a1a582c54689da4a deleted and replaced by tablet d05b0e744947471a8b704d0fdbe729b3
I20250830 07:54:51.839975 15323 raft_consensus.cc:513] T 3c3c798b2b7b460b98a30605464763e6 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:51.841382 13619 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "3c3c798b2b7b460b98a30605464763e6" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9"
W20250830 07:54:51.841836 13423 leader_election.cc:343] T 3c3c798b2b7b460b98a30605464763e6 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:51.842932 15323 leader_election.cc:290] T 3c3c798b2b7b460b98a30605464763e6 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 election: Requested vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:51.842926 13771 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "3c3c798b2b7b460b98a30605464763e6" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f"
I20250830 07:54:51.843101 13771 raft_consensus.cc:3058] T 3c3c798b2b7b460b98a30605464763e6 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
W20250830 07:54:51.845580 13703 consensus_peers.cc:489] T 0ceccc5f18294356894695fe08d73e30 P 9b057ade5dce45af9f8bf0bedf8b917f -> Peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Couldn't send request to peer 6b5e454d98894637b466ea27f1b647f9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20250830 07:54:51.845997 13771 raft_consensus.cc:2466] T 3c3c798b2b7b460b98a30605464763e6 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2065c332f15a4739899af79f3669c3ba in term 1.
W20250830 07:54:51.845700 13703 leader_election.cc:343] T a8baad9c419e436b9659d8d5582d4066 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:51.846648 13422 leader_election.cc:304] T 3c3c798b2b7b460b98a30605464763e6 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:54:51.847038 13227 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_cbbde0aa8e5b47e69f1a0db288d36cdf" } modify_external_catalogs: true
I20250830 07:54:51.847157 15323 raft_consensus.cc:2802] T 3c3c798b2b7b460b98a30605464763e6 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election won for term 1
I20250830 07:54:51.847232 13227 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_cbbde0aa8e5b47e69f1a0db288d36cdf" } modify_external_catalogs: true
I20250830 07:54:51.847503 15323 raft_consensus.cc:695] T 3c3c798b2b7b460b98a30605464763e6 P 2065c332f15a4739899af79f3669c3ba [term 1 LEADER]: Becoming Leader. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Running, Role: LEADER
I20250830 07:54:51.847836 15323 consensus_queue.cc:237] T 3c3c798b2b7b460b98a30605464763e6 P 2065c332f15a4739899af79f3669c3ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:51.850610 13233 catalog_manager.cc:5674] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325) does not have the latest schema for tablet 0ceccc5f18294356894695fe08d73e30 (table default.Table_32d032fe8fba47348e797c68bb7ea866 [id=0e99ba575a7a4f8dae74a98627249018]). Expected version 1 got 0
I20250830 07:54:51.854810 13886 tablet_bootstrap.cc:492] T 1e48641532cd439e9b4074712033c737 P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:54:51.856134 13886 ts_tablet_manager.cc:1397] T 1e48641532cd439e9b4074712033c737 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.157s user 0.021s sys 0.018s
I20250830 07:54:51.863382 13233 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_66d3622748cd4a58a4559b525344ab29"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:51.864106 13233 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_66d3622748cd4a58a4559b525344ab29 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:51.868363 13886 raft_consensus.cc:357] T 1e48641532cd439e9b4074712033c737 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:51.868597 13886 raft_consensus.cc:383] T 1e48641532cd439e9b4074712033c737 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:51.868693 13886 raft_consensus.cc:738] T 1e48641532cd439e9b4074712033c737 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:54:51.868920 13886 consensus_queue.cc:260] T 1e48641532cd439e9b4074712033c737 P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:51.869509 13886 ts_tablet_manager.cc:1428] T 1e48641532cd439e9b4074712033c737 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.013s user 0.001s sys 0.001s
I20250830 07:54:51.869815 13886 tablet_bootstrap.cc:492] T e6060a3dc6444483b8fb2944b8090cb6 P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:54:51.871588 13886 tablet_bootstrap.cc:654] T e6060a3dc6444483b8fb2944b8090cb6 P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
W20250830 07:54:51.872036 13703 leader_election.cc:343] T 70703eb1d47841a1a227e277ed6a268d P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
W20250830 07:54:51.873144 13703 leader_election.cc:343] T ca959e42c8764eeba0faee96caf8b39f P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
W20250830 07:54:51.873953 13703 leader_election.cc:343] T 28c2f7a3a6dd444585f0f5d337b985e9 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
W20250830 07:54:51.875072 13703 leader_election.cc:343] T 519b3e58b63b402d84e234f5e180b98c P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:51.876473 13886 tablet_bootstrap.cc:492] T e6060a3dc6444483b8fb2944b8090cb6 P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:54:51.876741 13886 ts_tablet_manager.cc:1397] T e6060a3dc6444483b8fb2944b8090cb6 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.007s user 0.001s sys 0.003s
I20250830 07:54:51.877035 13562 leader_election.cc:304] T 09586fdda94c4aff9d3fa25d71fe6ac0 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b5e454d98894637b466ea27f1b647f9; no voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:54:51.877163 13231 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_679b513618b846569c2407c7ea4f2392"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250830 07:54:51.877283 14906 raft_consensus.cc:2747] T 09586fdda94c4aff9d3fa25d71fe6ac0 P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20250830 07:54:51.877628 13231 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_679b513618b846569c2407c7ea4f2392 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:51.878353 13619 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "95b6f084eb5240ea94c125eaa154ac9f" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9"
I20250830 07:54:51.878466 13886 raft_consensus.cc:357] T e6060a3dc6444483b8fb2944b8090cb6 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:51.878614 13886 raft_consensus.cc:383] T e6060a3dc6444483b8fb2944b8090cb6 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:51.878664 13886 raft_consensus.cc:738] T e6060a3dc6444483b8fb2944b8090cb6 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:54:51.879045 13611 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "519b3e58b63b402d84e234f5e180b98c" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9"
I20250830 07:54:51.879794 13612 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "70703eb1d47841a1a227e277ed6a268d" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9"
I20250830 07:54:51.880148 13610 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "ca959e42c8764eeba0faee96caf8b39f" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9"
I20250830 07:54:51.880311 13624 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "ff72a0fd9a0e46a6bd54a15e4ad783b4" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:51.880657 13619 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "28c2f7a3a6dd444585f0f5d337b985e9" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9"
I20250830 07:54:51.880985 13886 consensus_queue.cc:260] T e6060a3dc6444483b8fb2944b8090cb6 P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:51.881500 13886 ts_tablet_manager.cc:1428] T e6060a3dc6444483b8fb2944b8090cb6 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.004s user 0.001s sys 0.000s
I20250830 07:54:51.881736 13886 tablet_bootstrap.cc:492] T 087bb1e80d2d44bf8619b0341ff99527 P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:54:51.881856 13230 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_f8d1ca09f14a44cf8a330cacc1309428"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:51.882277 13230 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f8d1ca09f14a44cf8a330cacc1309428 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:51.884593 15245 raft_consensus.cc:491] T 5235e1a32f044f0cbf882e338c482003 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:51.884745 15245 raft_consensus.cc:513] T 5235e1a32f044f0cbf882e338c482003 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:51.885689 15245 leader_election.cc:290] T 5235e1a32f044f0cbf882e338c482003 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967)
I20250830 07:54:51.886310 15115 raft_consensus.cc:491] T 057bcce2860345da860acc262dc4d339 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:51.886327 13612 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "ff72a0fd9a0e46a6bd54a15e4ad783b4" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9"
I20250830 07:54:51.886427 15115 raft_consensus.cc:513] T 057bcce2860345da860acc262dc4d339 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:51.887019 15115 leader_election.cc:290] T 057bcce2860345da860acc262dc4d339 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:51.887281 13617 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "da5c7b084e1f4fda92fff35a9cb2c7fc" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:51.887369 13771 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "057bcce2860345da860acc262dc4d339" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:51.887511 13771 raft_consensus.cc:2466] T 057bcce2860345da860acc262dc4d339 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2065c332f15a4739899af79f3669c3ba in term 0.
I20250830 07:54:51.887884 13229 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_3accdb20952244b2b7745b6754452a64" } new_table_name: "default.Table_456f55a62b0e4bad879a02054f214d30" modify_external_catalogs: true
I20250830 07:54:51.887921 13617 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "da5c7b084e1f4fda92fff35a9cb2c7fc" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9"
I20250830 07:54:51.888082 13422 leader_election.cc:304] T 057bcce2860345da860acc262dc4d339 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters:
I20250830 07:54:51.888309 15115 raft_consensus.cc:2802] T 057bcce2860345da860acc262dc4d339 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:54:51.888418 15115 raft_consensus.cc:491] T 057bcce2860345da860acc262dc4d339 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:54:51.888473 15115 raft_consensus.cc:3058] T 057bcce2860345da860acc262dc4d339 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:51.890120 13478 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "5235e1a32f044f0cbf882e338c482003" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:54:51.890270 13886 tablet_bootstrap.cc:654] T 087bb1e80d2d44bf8619b0341ff99527 P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:51.890283 13478 raft_consensus.cc:2466] T 5235e1a32f044f0cbf882e338c482003 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 0.
W20250830 07:54:51.890478 13220 catalog_manager.cc:4726] Async tablet task AlterTable RPC for tablet 2f4d321785c84a9eb7d4aa3f5953bdce (table default.Table_5eaa058c9c1d4f8ea326e10670fe3b8c [id=8e6f8e189d834d2db03f41e4c9e538f1], current schema version=2) failed: Not found: failed to reset TS proxy: No leader found: Tablet 2f4d321785c84a9eb7d4aa3f5953bdce has no consensus state
I20250830 07:54:51.890630 13701 leader_election.cc:304] T 5235e1a32f044f0cbf882e338c482003 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters:
I20250830 07:54:51.891163 15245 raft_consensus.cc:2802] T 5235e1a32f044f0cbf882e338c482003 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:54:51.891288 15245 raft_consensus.cc:491] T 5235e1a32f044f0cbf882e338c482003 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:54:51.891407 15245 raft_consensus.cc:3058] T 5235e1a32f044f0cbf882e338c482003 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:51.894038 15245 raft_consensus.cc:513] T 5235e1a32f044f0cbf882e338c482003 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:51.895180 13478 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "5235e1a32f044f0cbf882e338c482003" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba"
I20250830 07:54:51.895359 13478 raft_consensus.cc:3058] T 5235e1a32f044f0cbf882e338c482003 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:51.895844 15245 leader_election.cc:290] T 5235e1a32f044f0cbf882e338c482003 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Requested vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967)
I20250830 07:54:51.896776 13617 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "057bcce2860345da860acc262dc4d339" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
W20250830 07:54:51.897269 13423 leader_election.cc:343] T 057bcce2860345da860acc262dc4d339 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
W20250830 07:54:51.902019 13703 leader_election.cc:343] T 95b6f084eb5240ea94c125eaa154ac9f P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
W20250830 07:54:51.903642 13703 leader_election.cc:343] T 519b3e58b63b402d84e234f5e180b98c P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
W20250830 07:54:51.904721 13703 leader_election.cc:343] T 70703eb1d47841a1a227e277ed6a268d P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
W20250830 07:54:51.905375 13703 leader_election.cc:343] T ca959e42c8764eeba0faee96caf8b39f P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:51.905606 15115 raft_consensus.cc:513] T 057bcce2860345da860acc262dc4d339 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:51.905687 14906 raft_consensus.cc:491] T 65f1ee59e6e9498381d686f16a865e23 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:51.905792 14906 raft_consensus.cc:513] T 65f1ee59e6e9498381d686f16a865e23 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:51.906141 15115 leader_election.cc:290] T 057bcce2860345da860acc262dc4d339 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 election: Requested vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:51.906309 14906 leader_election.cc:290] T 65f1ee59e6e9498381d686f16a865e23 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:51.906450 13771 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "057bcce2860345da860acc262dc4d339" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f"
I20250830 07:54:51.906595 13771 raft_consensus.cc:3058] T 057bcce2860345da860acc262dc4d339 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
W20250830 07:54:51.906972 13561 leader_election.cc:343] T 65f1ee59e6e9498381d686f16a865e23 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): Not found: Tablet not found: 65f1ee59e6e9498381d686f16a865e23
I20250830 07:54:51.909042 13771 raft_consensus.cc:2466] T 057bcce2860345da860acc262dc4d339 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2065c332f15a4739899af79f3669c3ba in term 1.
I20250830 07:54:51.909442 13422 leader_election.cc:304] T 057bcce2860345da860acc262dc4d339 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters:
W20250830 07:54:51.909718 13703 leader_election.cc:343] T 28c2f7a3a6dd444585f0f5d337b985e9 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:51.909885 15009 raft_consensus.cc:2802] T 057bcce2860345da860acc262dc4d339 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election won for term 1
I20250830 07:54:51.910359 15009 raft_consensus.cc:695] T 057bcce2860345da860acc262dc4d339 P 2065c332f15a4739899af79f3669c3ba [term 1 LEADER]: Becoming Leader. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Running, Role: LEADER
I20250830 07:54:51.910656 15009 consensus_queue.cc:237] T 057bcce2860345da860acc262dc4d339 P 2065c332f15a4739899af79f3669c3ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
W20250830 07:54:51.911264 13703 leader_election.cc:343] T ff72a0fd9a0e46a6bd54a15e4ad783b4 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
W20250830 07:54:51.912209 13703 leader_election.cc:343] T da5c7b084e1f4fda92fff35a9cb2c7fc P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
W20250830 07:54:51.912508 13703 leader_election.cc:343] T da5c7b084e1f4fda92fff35a9cb2c7fc P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:51.914170 13617 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "5235e1a32f044f0cbf882e338c482003" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:51.914762 13617 raft_consensus.cc:3058] T 13df49c2c2cd4e5cae26a540835b74c9 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Advancing to term 1
W20250830 07:54:51.921514 13703 leader_election.cc:343] T 5235e1a32f044f0cbf882e338c482003 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:51.927510 13771 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "65f1ee59e6e9498381d686f16a865e23" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:51.927717 13882 tablet_bootstrap.cc:492] T 0ceccc5f18294356894695fe08d73e30 P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:54:51.927699 13771 raft_consensus.cc:2466] T 65f1ee59e6e9498381d686f16a865e23 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b5e454d98894637b466ea27f1b647f9 in term 0.
I20250830 07:54:51.927865 13882 ts_tablet_manager.cc:1397] T 0ceccc5f18294356894695fe08d73e30 P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.165s user 0.003s sys 0.000s
I20250830 07:54:51.928372 13629 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "057bcce2860345da860acc262dc4d339" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9"
I20250830 07:54:51.928552 13882 raft_consensus.cc:357] T 0ceccc5f18294356894695fe08d73e30 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:51.928699 13882 raft_consensus.cc:383] T 0ceccc5f18294356894695fe08d73e30 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:51.928758 13882 raft_consensus.cc:738] T 0ceccc5f18294356894695fe08d73e30 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:54:51.928815 13612 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "5235e1a32f044f0cbf882e338c482003" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9"
W20250830 07:54:51.928829 13423 leader_election.cc:343] T 057bcce2860345da860acc262dc4d339 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:51.928915 13882 consensus_queue.cc:260] T 0ceccc5f18294356894695fe08d73e30 P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:51.929378 13882 ts_tablet_manager.cc:1428] T 0ceccc5f18294356894695fe08d73e30 P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250830 07:54:51.929565 15339 raft_consensus.cc:491] T 7c5e50cb605c4a40b47984f328eedd93 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:51.929662 13882 tablet_bootstrap.cc:492] T aee84a97524e4568acdc4ae1c74fb492 P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:54:51.929679 15339 raft_consensus.cc:513] T 7c5e50cb605c4a40b47984f328eedd93 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:51.930507 15339 leader_election.cc:290] T 7c5e50cb605c4a40b47984f328eedd93 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967)
I20250830 07:54:51.930476 13482 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "7c5e50cb605c4a40b47984f328eedd93" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:54:51.930652 13482 raft_consensus.cc:2466] T 7c5e50cb605c4a40b47984f328eedd93 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 0.
I20250830 07:54:51.930737 15245 raft_consensus.cc:491] T 924403105a6a40f28aad60647a2a8987 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:51.930835 15245 raft_consensus.cc:513] T 924403105a6a40f28aad60647a2a8987 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:51.931016 13701 leader_election.cc:304] T 7c5e50cb605c4a40b47984f328eedd93 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters:
I20250830 07:54:51.931238 15246 raft_consensus.cc:2802] T 7c5e50cb605c4a40b47984f328eedd93 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:54:51.931303 15246 raft_consensus.cc:491] T 7c5e50cb605c4a40b47984f328eedd93 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:54:51.931365 15245 leader_election.cc:290] T 924403105a6a40f28aad60647a2a8987 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967)
I20250830 07:54:51.931355 15246 raft_consensus.cc:3058] T 7c5e50cb605c4a40b47984f328eedd93 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:51.934170 15246 raft_consensus.cc:513] T 7c5e50cb605c4a40b47984f328eedd93 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:51.934717 15246 leader_election.cc:290] T 7c5e50cb605c4a40b47984f328eedd93 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Requested vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967)
I20250830 07:54:51.935667 13486 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "7c5e50cb605c4a40b47984f328eedd93" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba"
I20250830 07:54:51.935822 13486 raft_consensus.cc:3058] T 7c5e50cb605c4a40b47984f328eedd93 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
W20250830 07:54:51.936069 13234 catalog_manager.cc:5415] Ignoring report from unknown tablet 70703eb1d47841a1a227e277ed6a268d
W20250830 07:54:51.936125 13234 catalog_manager.cc:5415] Ignoring report from unknown tablet b83dfc54383d4e7b96523568aea5c9f3
W20250830 07:54:51.936199 13234 catalog_manager.cc:5415] Ignoring report from unknown tablet 28c2f7a3a6dd444585f0f5d337b985e9
W20250830 07:54:51.936225 13234 catalog_manager.cc:5415] Ignoring report from unknown tablet acca1a8240454b889c63c82d3c75087e
W20250830 07:54:51.936249 13234 catalog_manager.cc:5415] Ignoring report from unknown tablet 95b6f084eb5240ea94c125eaa154ac9f
W20250830 07:54:51.936271 13234 catalog_manager.cc:5415] Ignoring report from unknown tablet da5c7b084e1f4fda92fff35a9cb2c7fc
W20250830 07:54:51.936295 13234 catalog_manager.cc:5415] Ignoring report from unknown tablet f398e12cd9f543738d5163354f8a9d9d
W20250830 07:54:51.936318 13234 catalog_manager.cc:5415] Ignoring report from unknown tablet ca959e42c8764eeba0faee96caf8b39f
I20250830 07:54:51.936817 13234 catalog_manager.cc:5674] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743) does not have the latest schema for tablet 924403105a6a40f28aad60647a2a8987 (table default.Table_5caf352b482f4b9ba4d727ab7fbd00bb [id=46ec9117fe9146cb807dd092284616fc]). Expected version 1 got 0
I20250830 07:54:51.937009 13234 catalog_manager.cc:5582] T 519b3e58b63b402d84e234f5e180b98c P 9b057ade5dce45af9f8bf0bedf8b917f reported cstate change: term changed from 0 to 1, leader changed from <none> to 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3). New cstate: current_term: 1 leader_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } health_report { overall_health: HEALTHY } } }
I20250830 07:54:51.937397 13882 tablet_bootstrap.cc:654] T aee84a97524e4568acdc4ae1c74fb492 P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:51.937472 13234 catalog_manager.cc:5674] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743) does not have the latest schema for tablet 1e48641532cd439e9b4074712033c737 (table default.Table_da41ab7e69f34ff880f61dd2168a0ea6 [id=4e107bdebbc749af933e7cd0ee557f9f]). Expected version 1 got 0
I20250830 07:54:51.937642 13234 catalog_manager.cc:5582] T ff72a0fd9a0e46a6bd54a15e4ad783b4 P 9b057ade5dce45af9f8bf0bedf8b917f reported cstate change: term changed from 0 to 1, leader changed from <none> to 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3). New cstate: current_term: 1 leader_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } health_report { overall_health: HEALTHY } } }
I20250830 07:54:51.937958 13234 catalog_manager.cc:5674] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743) does not have the latest schema for tablet ff72a0fd9a0e46a6bd54a15e4ad783b4 (table default.Table_85e7f0b13c094fd7841dcabce61fd911 [id=de7b214458f247ef831f43727543afc5]). Expected version 1 got 0
I20250830 07:54:51.939139 13619 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "7c5e50cb605c4a40b47984f328eedd93" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:51.939208 15115 raft_consensus.cc:491] T ef1ab62a5b7845e58d50f34206eaaa27 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:51.939322 15115 raft_consensus.cc:513] T ef1ab62a5b7845e58d50f34206eaaa27 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:51.940925 13562 leader_election.cc:304] T 65f1ee59e6e9498381d686f16a865e23 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 2065c332f15a4739899af79f3669c3ba
I20250830 07:54:51.941356 14906 raft_consensus.cc:2802] T 65f1ee59e6e9498381d686f16a865e23 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:54:51.941478 14906 raft_consensus.cc:491] T 65f1ee59e6e9498381d686f16a865e23 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:54:51.941605 14906 raft_consensus.cc:3058] T 65f1ee59e6e9498381d686f16a865e23 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:51.943168 13886 tablet_bootstrap.cc:492] T 087bb1e80d2d44bf8619b0341ff99527 P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:54:51.943364 13886 ts_tablet_manager.cc:1397] T 087bb1e80d2d44bf8619b0341ff99527 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.062s user 0.002s sys 0.008s
I20250830 07:54:51.944391 14906 raft_consensus.cc:513] T 65f1ee59e6e9498381d686f16a865e23 P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:51.945164 14906 leader_election.cc:290] T 65f1ee59e6e9498381d686f16a865e23 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 election: Requested vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:51.945659 13482 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "924403105a6a40f28aad60647a2a8987" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:54:51.945801 13482 raft_consensus.cc:2466] T 924403105a6a40f28aad60647a2a8987 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 0.
I20250830 07:54:51.945969 13486 raft_consensus.cc:2466] T 7c5e50cb605c4a40b47984f328eedd93 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 1.
I20250830 07:54:51.946277 15322 raft_consensus.cc:491] T 74f2fcc22fd545fb8ca7c20619843023 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:51.946398 15322 raft_consensus.cc:513] T 74f2fcc22fd545fb8ca7c20619843023 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
W20250830 07:54:51.946623 13561 leader_election.cc:343] T 65f1ee59e6e9498381d686f16a865e23 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): Not found: Tablet not found: 65f1ee59e6e9498381d686f16a865e23
I20250830 07:54:51.946933 15322 leader_election.cc:290] T 74f2fcc22fd545fb8ca7c20619843023 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:51.947055 15115 leader_election.cc:290] T ef1ab62a5b7845e58d50f34206eaaa27 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:51.947206 13701 leader_election.cc:304] T 924403105a6a40f28aad60647a2a8987 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters:
I20250830 07:54:51.947480 13701 leader_election.cc:304] T 7c5e50cb605c4a40b47984f328eedd93 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters:
I20250830 07:54:51.947666 15339 raft_consensus.cc:2802] T 924403105a6a40f28aad60647a2a8987 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:54:51.947733 15339 raft_consensus.cc:491] T 924403105a6a40f28aad60647a2a8987 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:54:51.947813 15339 raft_consensus.cc:3058] T 924403105a6a40f28aad60647a2a8987 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:51.948313 13775 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "ef1ab62a5b7845e58d50f34206eaaa27" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:51.948482 13771 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "74f2fcc22fd545fb8ca7c20619843023" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:51.948884 15361 raft_consensus.cc:2802] T 7c5e50cb605c4a40b47984f328eedd93 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election won for term 1
I20250830 07:54:51.948982 15361 raft_consensus.cc:695] T 7c5e50cb605c4a40b47984f328eedd93 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 LEADER]: Becoming Leader. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Running, Role: LEADER
I20250830 07:54:51.949220 15381 raft_consensus.cc:491] T 8dddcfe56522436287aea212e316a729 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6b5e454d98894637b466ea27f1b647f9)
I20250830 07:54:51.949168 15361 consensus_queue.cc:237] T 7c5e50cb605c4a40b47984f328eedd93 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:51.949330 15381 raft_consensus.cc:513] T 8dddcfe56522436287aea212e316a729 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:51.949805 15381 leader_election.cc:290] T 8dddcfe56522436287aea212e316a729 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
W20250830 07:54:51.950088 13422 leader_election.cc:343] T ef1ab62a5b7845e58d50f34206eaaa27 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Illegal state: must be running to vote when last-logged opid is not known
W20250830 07:54:51.950286 13422 leader_election.cc:343] T 74f2fcc22fd545fb8ca7c20619843023 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:51.952150 15339 raft_consensus.cc:513] T 924403105a6a40f28aad60647a2a8987 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:51.952960 15339 leader_election.cc:290] T 924403105a6a40f28aad60647a2a8987 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Requested vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967)
I20250830 07:54:51.953361 13886 raft_consensus.cc:357] T 087bb1e80d2d44bf8619b0341ff99527 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:51.953501 13886 raft_consensus.cc:383] T 087bb1e80d2d44bf8619b0341ff99527 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:51.953548 13886 raft_consensus.cc:738] T 087bb1e80d2d44bf8619b0341ff99527 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:54:51.953713 13886 consensus_queue.cc:260] T 087bb1e80d2d44bf8619b0341ff99527 P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:51.954191 13886 ts_tablet_manager.cc:1428] T 087bb1e80d2d44bf8619b0341ff99527 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.011s user 0.000s sys 0.000s
I20250830 07:54:51.954437 13886 tablet_bootstrap.cc:492] T ef1ab62a5b7845e58d50f34206eaaa27 P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:54:51.955895 13478 raft_consensus.cc:2466] T 5235e1a32f044f0cbf882e338c482003 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 1.
I20250830 07:54:51.956514 13228 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_d298f39e826645b180dcd8eba4030ebb" } modify_external_catalogs: true
I20250830 07:54:51.956681 13228 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_d298f39e826645b180dcd8eba4030ebb" } modify_external_catalogs: true
I20250830 07:54:51.956945 13619 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "74f2fcc22fd545fb8ca7c20619843023" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:51.957257 13611 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "ef1ab62a5b7845e58d50f34206eaaa27" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:51.962122 15361 raft_consensus.cc:491] T 1e48641532cd439e9b4074712033c737 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:51.962247 15361 raft_consensus.cc:513] T 1e48641532cd439e9b4074712033c737 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:51.962693 15361 leader_election.cc:290] T 1e48641532cd439e9b4074712033c737 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967)
W20250830 07:54:51.968096 13232 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ad7a45187569416bad6c71db9f8ab702 consensus state has no leader
I20250830 07:54:51.968451 13227 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet 13df49c2c2cd4e5cae26a540835b74c9
W20250830 07:54:51.969698 13229 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d05f9a73ccb246828e58e1914aa22b95 has no consensus state
I20250830 07:54:51.970161 13611 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "7c5e50cb605c4a40b47984f328eedd93" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9"
I20250830 07:54:51.970844 13612 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "924403105a6a40f28aad60647a2a8987" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9"
I20250830 07:54:51.971122 13611 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "1e48641532cd439e9b4074712033c737" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:51.971674 13593 tablet_service.cc:1515] Processing DeleteTablet for tablet 13df49c2c2cd4e5cae26a540835b74c9 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:51 UTC) from {username='slave'} at 127.0.0.1:45306
I20250830 07:54:51.971866 15047 tablet_replica.cc:331] T 13df49c2c2cd4e5cae26a540835b74c9 P 6b5e454d98894637b466ea27f1b647f9: stopping tablet replica
I20250830 07:54:51.972050 15047 raft_consensus.cc:2241] T 13df49c2c2cd4e5cae26a540835b74c9 P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250830 07:54:51.972187 15047 raft_consensus.cc:2270] T 13df49c2c2cd4e5cae26a540835b74c9 P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250830 07:54:51.974285 13225 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_2186ac7d5cd94641967f9459854c7fb0" } new_table_name: "default.Table_f0716cbf23644e13b931581d24a150d5" modify_external_catalogs: true
I20250830 07:54:51.975311 13231 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_c3c97f9e7537410bbc60629e7bd27373" } modify_external_catalogs: true
I20250830 07:54:51.975432 13231 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_c3c97f9e7537410bbc60629e7bd27373" } modify_external_catalogs: true
I20250830 07:54:51.976454 13233 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_960351ceee624437bf1bf56870b66b69"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:51.976866 13233 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_960351ceee624437bf1bf56870b66b69 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:51.977847 13229 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_fdf6b173da034defb96d857c29760d5e" } new_table_name: "default.Table_dce5b4109f4448b9b32e8e35aec0d698" modify_external_catalogs: true
I20250830 07:54:51.979507 13771 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "65f1ee59e6e9498381d686f16a865e23" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f"
I20250830 07:54:51.979656 13771 raft_consensus.cc:3058] T 65f1ee59e6e9498381d686f16a865e23 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:51.978842 13232 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_42e855e899794478ac4aa86b31bbc1eb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:51.981966 13232 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_42e855e899794478ac4aa86b31bbc1eb in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:51.982088 13771 raft_consensus.cc:2466] T 65f1ee59e6e9498381d686f16a865e23 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b5e454d98894637b466ea27f1b647f9 in term 1.
I20250830 07:54:51.983001 13227 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_86fde52726544125aec7da61ebd81e08"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:51.983362 13227 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_86fde52726544125aec7da61ebd81e08 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250830 07:54:51.984532 13703 leader_election.cc:343] T 5235e1a32f044f0cbf882e338c482003 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:51.984839 13624 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "924403105a6a40f28aad60647a2a8987" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
W20250830 07:54:51.993468 13703 consensus_peers.cc:489] T de3a52a8e08a45808373902a0185e6f0 P 9b057ade5dce45af9f8bf0bedf8b917f -> Peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Couldn't send request to peer 6b5e454d98894637b466ea27f1b647f9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20250830 07:54:51.993664 13703 leader_election.cc:343] T 7c5e50cb605c4a40b47984f328eedd93 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:51.996218 13228 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet 82111604312e4240a66df81ba20bc046
W20250830 07:54:51.997867 13230 catalog_manager.cc:5415] Ignoring report from unknown tablet 66d59910b4b2451a851e9d2728d50f42
W20250830 07:54:51.997928 13230 catalog_manager.cc:5415] Ignoring report from unknown tablet 7c5e50cb605c4a40b47984f328eedd93
W20250830 07:54:51.997956 13230 catalog_manager.cc:5415] Ignoring report from unknown tablet e6060a3dc6444483b8fb2944b8090cb6
W20250830 07:54:51.999264 13703 leader_election.cc:343] T ff72a0fd9a0e46a6bd54a15e4ad783b4 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
W20250830 07:54:51.999536 13703 leader_election.cc:343] T 7c5e50cb605c4a40b47984f328eedd93 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
W20250830 07:54:52.002346 13703 leader_election.cc:343] T 8dddcfe56522436287aea212e316a729 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Not found: Tablet not found: 8dddcfe56522436287aea212e316a729
W20250830 07:54:52.002548 13703 leader_election.cc:343] T 924403105a6a40f28aad60647a2a8987 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
W20250830 07:54:52.002687 13703 leader_election.cc:343] T 1e48641532cd439e9b4074712033c737 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
W20250830 07:54:52.002851 13703 leader_election.cc:343] T 924403105a6a40f28aad60647a2a8987 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:52.003791 13562 leader_election.cc:304] T 65f1ee59e6e9498381d686f16a865e23 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 2065c332f15a4739899af79f3669c3ba
I20250830 07:54:52.004036 14906 raft_consensus.cc:2802] T 65f1ee59e6e9498381d686f16a865e23 P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Leader election won for term 1
I20250830 07:54:52.004210 14906 raft_consensus.cc:695] T 65f1ee59e6e9498381d686f16a865e23 P 6b5e454d98894637b466ea27f1b647f9 [term 1 LEADER]: Becoming Leader. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Running, Role: LEADER
W20250830 07:54:52.004266 13225 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ec4818b75d0e490bb604698a09d46b76 has no consensus state
W20250830 07:54:52.005198 13229 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet dad2dfa1a19d45778933780b1029d924 consensus state has no leader
I20250830 07:54:52.005817 13231 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet aee84a97524e4568acdc4ae1c74fb492
W20250830 07:54:51.959178 13423 leader_election.cc:343] T 74f2fcc22fd545fb8ca7c20619843023 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:52.011962 13423 leader_election.cc:304] T 74f2fcc22fd545fb8ca7c20619843023 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba; no voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f
W20250830 07:54:52.012351 13423 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.209.2:38967, user_credentials={real_user=slave}} blocked reactor thread for 53175.7us
W20250830 07:54:52.012666 13423 leader_election.cc:343] T ef1ab62a5b7845e58d50f34206eaaa27 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:52.012768 13423 leader_election.cc:304] T ef1ab62a5b7845e58d50f34206eaaa27 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba; no voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:54:52.013048 15322 raft_consensus.cc:2747] T 74f2fcc22fd545fb8ca7c20619843023 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:54:52.013666 15322 raft_consensus.cc:2747] T ef1ab62a5b7845e58d50f34206eaaa27 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20250830 07:54:52.000038 15400 consensus_queue.cc:1162] T 13df49c2c2cd4e5cae26a540835b74c9 P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "6b5e454d98894637b466ea27f1b647f9" status { last_received { term: 1 index: 1 } last_committed_idx: 1 last_received_current_leader { term: 1 index: 1 } }
I20250830 07:54:52.014880 13593 tablet_service.cc:1515] Processing DeleteTablet for tablet 82111604312e4240a66df81ba20bc046 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:51 UTC) from {username='slave'} at 127.0.0.1:45306
I20250830 07:54:52.015110 14906 consensus_queue.cc:237] T 65f1ee59e6e9498381d686f16a865e23 P 6b5e454d98894637b466ea27f1b647f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:52.015359 15047 ts_tablet_manager.cc:1905] T 13df49c2c2cd4e5cae26a540835b74c9 P 6b5e454d98894637b466ea27f1b647f9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250830 07:54:52.022073 13593 tablet_service.cc:1515] Processing DeleteTablet for tablet aee84a97524e4568acdc4ae1c74fb492 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:51 UTC) from {username='slave'} at 127.0.0.1:45306
I20250830 07:54:52.030344 13233 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_eace0187f8ea486e94d4ff049b2752dd" } new_table_name: "default.Table_3ad1bb0fd8424a7097a2260d0342104c" modify_external_catalogs: true
I20250830 07:54:52.031224 13231 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_31dd5db3b258485ba550d9da0e1d3cf2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:52.031783 13231 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_31dd5db3b258485ba550d9da0e1d3cf2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:52.033329 13232 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_8328de94ee574e429f650408a6a94f3a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:52.033799 13232 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8328de94ee574e429f650408a6a94f3a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:52.035521 13227 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_a41ba45f1ed84fecae2f9b5e1c9c54c2" } modify_external_catalogs: true
I20250830 07:54:52.035704 13227 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_a41ba45f1ed84fecae2f9b5e1c9c54c2" } modify_external_catalogs: true
I20250830 07:54:52.038995 13617 raft_consensus.cc:3058] T 74891b8103e144c486750f64ba2003f4 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:52.038905 13229 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_0aff81e8ebe64c298a60fbaf4e650cf6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:52.039345 13229 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0aff81e8ebe64c298a60fbaf4e650cf6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250830 07:54:52.044654 13225 catalog_manager.cc:5415] Ignoring report from unknown tablet ff0f9cccc8ed43b1a8cd38de0e9d4097
I20250830 07:54:52.046607 13234 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_7a50f4e8c38f4807b9e0bf1f22e2eddb" } modify_external_catalogs: true
I20250830 07:54:52.046777 13234 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_7a50f4e8c38f4807b9e0bf1f22e2eddb" } modify_external_catalogs: true
I20250830 07:54:52.049315 13886 tablet_bootstrap.cc:654] T ef1ab62a5b7845e58d50f34206eaaa27 P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:52.051064 13886 tablet_bootstrap.cc:492] T ef1ab62a5b7845e58d50f34206eaaa27 P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:54:52.051177 13886 ts_tablet_manager.cc:1397] T ef1ab62a5b7845e58d50f34206eaaa27 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.097s user 0.005s sys 0.000s
I20250830 07:54:52.051885 13886 raft_consensus.cc:357] T ef1ab62a5b7845e58d50f34206eaaa27 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:52.052037 13886 raft_consensus.cc:383] T ef1ab62a5b7845e58d50f34206eaaa27 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:52.052086 13886 raft_consensus.cc:738] T ef1ab62a5b7845e58d50f34206eaaa27 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:54:52.052354 13886 consensus_queue.cc:260] T ef1ab62a5b7845e58d50f34206eaaa27 P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:52.053463 13886 ts_tablet_manager.cc:1428] T ef1ab62a5b7845e58d50f34206eaaa27 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20250830 07:54:52.054381 15115 raft_consensus.cc:491] T 10ec97b8a82145479e0bb526c4cc7c05 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:52.054504 15115 raft_consensus.cc:513] T 10ec97b8a82145479e0bb526c4cc7c05 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:52.055171 15115 leader_election.cc:290] T 10ec97b8a82145479e0bb526c4cc7c05 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:52.056457 13886 tablet_bootstrap.cc:492] T c1e0e774b86d4ef9a75e2635295f3e2a P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
W20250830 07:54:52.058902 13703 consensus_peers.cc:489] T 9ffa3c1d128c49c8b8e2566c6a64304a P 9b057ade5dce45af9f8bf0bedf8b917f -> Peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Couldn't send request to peer 6b5e454d98894637b466ea27f1b647f9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20250830 07:54:52.061826 13703 consensus_peers.cc:489] T 51cee993ce4249c0830b29cb1808fe80 P 9b057ade5dce45af9f8bf0bedf8b917f -> Peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Couldn't send request to peer 6b5e454d98894637b466ea27f1b647f9. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 51cee993ce4249c0830b29cb1808fe80. This is attempt 1: this message will repeat every 5th retry.
W20250830 07:54:52.063249 13233 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 14550e5f0308438fbd5eb78429720c2c has no consensus state
I20250830 07:54:52.063911 13227 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet e7ac2e088ad94f64aa52cd9c5038a0c2
I20250830 07:54:52.064769 13593 tablet_service.cc:1515] Processing DeleteTablet for tablet e7ac2e088ad94f64aa52cd9c5038a0c2 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:52 UTC) from {username='slave'} at 127.0.0.1:45306
I20250830 07:54:52.066584 13886 tablet_bootstrap.cc:654] T c1e0e774b86d4ef9a75e2635295f3e2a P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
W20250830 07:54:52.074434 13225 catalog_manager.cc:5415] Ignoring report from unknown tablet ef1ab62a5b7845e58d50f34206eaaa27
I20250830 07:54:52.088474 13624 raft_consensus.cc:1273] T 04eadf45b82e4c319eb7b316a402d81a P 6b5e454d98894637b466ea27f1b647f9 [term 3 FOLLOWER]: Refusing update from remote peer 9b057ade5dce45af9f8bf0bedf8b917f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20250830 07:54:52.088593 13624 pending_rounds.cc:85] T 04eadf45b82e4c319eb7b316a402d81a P 6b5e454d98894637b466ea27f1b647f9: Aborting all ops after (but not including) 1
I20250830 07:54:52.088649 13624 pending_rounds.cc:107] T 04eadf45b82e4c319eb7b316a402d81a P 6b5e454d98894637b466ea27f1b647f9: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20250830 07:54:52.088740 13624 raft_consensus.cc:2887] T 04eadf45b82e4c319eb7b316a402d81a P 6b5e454d98894637b466ea27f1b647f9 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20250830 07:54:52.089258 15245 consensus_queue.cc:1035] T 04eadf45b82e4c319eb7b316a402d81a P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250830 07:54:52.105727 13234 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet d64f20df166a46249c08444f44422fc3
I20250830 07:54:52.106524 13593 tablet_service.cc:1515] Processing DeleteTablet for tablet d64f20df166a46249c08444f44422fc3 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:52 UTC) from {username='slave'} at 127.0.0.1:45306
I20250830 07:54:52.108554 13886 tablet_bootstrap.cc:492] T c1e0e774b86d4ef9a75e2635295f3e2a P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:54:52.108875 13886 ts_tablet_manager.cc:1397] T c1e0e774b86d4ef9a75e2635295f3e2a P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.053s user 0.007s sys 0.001s
W20250830 07:54:52.112100 13229 catalog_manager.cc:5415] Ignoring report from unknown tablet ef1ab62a5b7845e58d50f34206eaaa27
I20250830 07:54:52.112794 13886 raft_consensus.cc:357] T c1e0e774b86d4ef9a75e2635295f3e2a P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:52.113725 13886 raft_consensus.cc:383] T c1e0e774b86d4ef9a75e2635295f3e2a P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:52.114198 13886 raft_consensus.cc:738] T c1e0e774b86d4ef9a75e2635295f3e2a P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:54:52.115149 13886 consensus_queue.cc:260] T c1e0e774b86d4ef9a75e2635295f3e2a P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:52.118613 13886 ts_tablet_manager.cc:1428] T c1e0e774b86d4ef9a75e2635295f3e2a P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.010s user 0.003s sys 0.000s
I20250830 07:54:52.122627 13886 tablet_bootstrap.cc:492] T 43e93d3038f7496ebb18319420ab67e0 P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
W20250830 07:54:52.123893 13229 catalog_manager.cc:5415] Ignoring report from unknown tablet 04eadf45b82e4c319eb7b316a402d81a
I20250830 07:54:52.128291 15115 raft_consensus.cc:491] T a8660a6ff9254d4f9f0ef047b8682ed1 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:52.128419 15115 raft_consensus.cc:513] T a8660a6ff9254d4f9f0ef047b8682ed1 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:52.128647 13701 leader_election.cc:304] T 5235e1a32f044f0cbf882e338c482003 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:54:52.129381 15340 raft_consensus.cc:2802] T 5235e1a32f044f0cbf882e338c482003 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election won for term 1
I20250830 07:54:52.129518 15340 raft_consensus.cc:695] T 5235e1a32f044f0cbf882e338c482003 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 LEADER]: Becoming Leader. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Running, Role: LEADER
I20250830 07:54:52.129719 15340 consensus_queue.cc:237] T 5235e1a32f044f0cbf882e338c482003 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:52.130709 13771 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "10ec97b8a82145479e0bb526c4cc7c05" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:52.131410 13886 tablet_bootstrap.cc:654] T 43e93d3038f7496ebb18319420ab67e0 P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:52.137053 15115 leader_election.cc:290] T a8660a6ff9254d4f9f0ef047b8682ed1 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:52.129387 15322 raft_consensus.cc:491] T 62ee2d0fbd774d38a4a4c4a033584ef9 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6b5e454d98894637b466ea27f1b647f9)
I20250830 07:54:52.140475 13887 tablet_bootstrap.cc:492] T 796e01f6a36241fc94e335253929d6ab P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:54:52.140672 13887 ts_tablet_manager.cc:1397] T 796e01f6a36241fc94e335253929d6ab P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.364s user 0.018s sys 0.040s
I20250830 07:54:52.141592 13887 raft_consensus.cc:357] T 796e01f6a36241fc94e335253929d6ab P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:52.141799 13887 raft_consensus.cc:383] T 796e01f6a36241fc94e335253929d6ab P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:52.141884 13887 raft_consensus.cc:738] T 796e01f6a36241fc94e335253929d6ab P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:54:52.142107 13887 consensus_queue.cc:260] T 796e01f6a36241fc94e335253929d6ab P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:52.142343 15115 raft_consensus.cc:491] T 796e01f6a36241fc94e335253929d6ab P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:52.142499 15115 raft_consensus.cc:513] T 796e01f6a36241fc94e335253929d6ab P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:52.142645 13887 ts_tablet_manager.cc:1428] T 796e01f6a36241fc94e335253929d6ab P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20250830 07:54:52.142885 13887 tablet_bootstrap.cc:492] T 689b4fee1dd04b3d9ccdea334b0f6b59 P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:54:52.143080 15115 leader_election.cc:290] T 796e01f6a36241fc94e335253929d6ab P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:52.137230 15322 raft_consensus.cc:513] T 62ee2d0fbd774d38a4a4c4a033584ef9 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:52.145052 15322 leader_election.cc:290] T 62ee2d0fbd774d38a4a4c4a033584ef9 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:52.145382 13486 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "8dddcfe56522436287aea212e316a729" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:54:52.150159 13887 tablet_bootstrap.cc:654] T 689b4fee1dd04b3d9ccdea334b0f6b59 P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:52.150170 13886 tablet_bootstrap.cc:492] T 43e93d3038f7496ebb18319420ab67e0 P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:54:52.150380 13886 ts_tablet_manager.cc:1397] T 43e93d3038f7496ebb18319420ab67e0 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.028s user 0.005s sys 0.000s
I20250830 07:54:52.152719 13886 raft_consensus.cc:357] T 43e93d3038f7496ebb18319420ab67e0 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:52.153055 13886 raft_consensus.cc:383] T 43e93d3038f7496ebb18319420ab67e0 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:52.153213 13886 raft_consensus.cc:738] T 43e93d3038f7496ebb18319420ab67e0 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:54:52.153617 13886 consensus_queue.cc:260] T 43e93d3038f7496ebb18319420ab67e0 P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:52.155208 13886 ts_tablet_manager.cc:1428] T 43e93d3038f7496ebb18319420ab67e0 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.005s user 0.003s sys 0.000s
I20250830 07:54:52.155822 13886 tablet_bootstrap.cc:492] T 33701eeb12fc451d90ae0b1c4dd7d134 P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:54:52.160310 13886 tablet_bootstrap.cc:654] T 33701eeb12fc451d90ae0b1c4dd7d134 P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:52.160957 13887 tablet_bootstrap.cc:492] T 689b4fee1dd04b3d9ccdea334b0f6b59 P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:54:52.161417 13887 ts_tablet_manager.cc:1397] T 689b4fee1dd04b3d9ccdea334b0f6b59 P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.019s user 0.005s sys 0.002s
I20250830 07:54:52.161760 13482 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "1e48641532cd439e9b4074712033c737" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:54:52.162649 13482 raft_consensus.cc:2466] T 1e48641532cd439e9b4074712033c737 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 0.
I20250830 07:54:52.162422 13486 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "924403105a6a40f28aad60647a2a8987" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba"
I20250830 07:54:52.163021 13486 raft_consensus.cc:3058] T 924403105a6a40f28aad60647a2a8987 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
W20250830 07:54:52.163587 13423 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.209.2:38967, user_credentials={real_user=slave}} blocked reactor thread for 150918us
I20250830 07:54:52.164111 13481 raft_consensus.cc:1273] T 04eadf45b82e4c319eb7b316a402d81a P 2065c332f15a4739899af79f3669c3ba [term 3 FOLLOWER]: Refusing update from remote peer 9b057ade5dce45af9f8bf0bedf8b917f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20250830 07:54:52.165341 13624 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "10ec97b8a82145479e0bb526c4cc7c05" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:52.166414 13486 raft_consensus.cc:2466] T 924403105a6a40f28aad60647a2a8987 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 1.
I20250830 07:54:52.166440 13771 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "a8660a6ff9254d4f9f0ef047b8682ed1" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:52.166487 13624 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "a8660a6ff9254d4f9f0ef047b8682ed1" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:52.166800 15411 raft_consensus.cc:491] T 33701eeb12fc451d90ae0b1c4dd7d134 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:52.167107 13624 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "796e01f6a36241fc94e335253929d6ab" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:52.167347 13771 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "796e01f6a36241fc94e335253929d6ab" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:52.168556 13771 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "62ee2d0fbd774d38a4a4c4a033584ef9" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:52.169363 13701 leader_election.cc:304] T 8dddcfe56522436287aea212e316a729 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 2065c332f15a4739899af79f3669c3ba, 6b5e454d98894637b466ea27f1b647f9
I20250830 07:54:52.169729 15339 raft_consensus.cc:2747] T 8dddcfe56522436287aea212e316a729 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20250830 07:54:52.170434 15339 consensus_queue.cc:1035] T de3a52a8e08a45808373902a0185e6f0 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:54:52.171083 13701 leader_election.cc:304] T 1e48641532cd439e9b4074712033c737 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:54:52.171432 15339 raft_consensus.cc:2802] T 1e48641532cd439e9b4074712033c737 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:54:52.171496 15339 raft_consensus.cc:491] T 1e48641532cd439e9b4074712033c737 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:54:52.171545 15339 raft_consensus.cc:3058] T 1e48641532cd439e9b4074712033c737 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:52.171875 13886 tablet_bootstrap.cc:492] T 33701eeb12fc451d90ae0b1c4dd7d134 P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:54:52.172067 13886 ts_tablet_manager.cc:1397] T 33701eeb12fc451d90ae0b1c4dd7d134 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.016s user 0.011s sys 0.000s
I20250830 07:54:52.173857 15339 raft_consensus.cc:513] T 1e48641532cd439e9b4074712033c737 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:52.175211 15339 leader_election.cc:290] T 1e48641532cd439e9b4074712033c737 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Requested vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967)
I20250830 07:54:52.175555 13624 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "1e48641532cd439e9b4074712033c737" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9"
W20250830 07:54:52.175957 13703 leader_election.cc:343] T 1e48641532cd439e9b4074712033c737 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:52.176301 15411 raft_consensus.cc:513] T 33701eeb12fc451d90ae0b1c4dd7d134 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:52.176975 15411 leader_election.cc:290] T 33701eeb12fc451d90ae0b1c4dd7d134 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:52.173358 13886 raft_consensus.cc:357] T 33701eeb12fc451d90ae0b1c4dd7d134 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:52.178473 13886 raft_consensus.cc:383] T 33701eeb12fc451d90ae0b1c4dd7d134 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:52.178601 13886 raft_consensus.cc:738] T 33701eeb12fc451d90ae0b1c4dd7d134 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:54:52.179328 13234 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_3efb203c49e444568f4050cd42e50edf" } new_table_name: "default.Table_39ee3984c7f14096ba80b43f5baa4339" modify_external_catalogs: true
I20250830 07:54:52.179224 13886 consensus_queue.cc:260] T 33701eeb12fc451d90ae0b1c4dd7d134 P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:52.179966 13231 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_f2003681d72a4da9a7e8884c5c79b5b1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:52.180516 13231 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f2003681d72a4da9a7e8884c5c79b5b1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:52.180866 13233 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_155d9585246a4bc79c07cb9e86f6279b" } new_table_name: "default.Table_097bafb0f46a4dbb86cb65eaf52668d9" modify_external_catalogs: true
I20250830 07:54:52.185639 15339 consensus_queue.cc:1035] T 04eadf45b82e4c319eb7b316a402d81a P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250830 07:54:52.186528 13227 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_32dc339738e4413ba84c4575276f6c35"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250830 07:54:52.186928 15339 consensus_queue.cc:1035] T 9ffa3c1d128c49c8b8e2566c6a64304a P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20250830 07:54:52.187079 13227 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_32dc339738e4413ba84c4575276f6c35 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:52.188733 13232 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_32d55f31323849d2b32207a7f166608e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:52.189260 13232 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_32d55f31323849d2b32207a7f166608e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:52.167459 13887 raft_consensus.cc:357] T 689b4fee1dd04b3d9ccdea334b0f6b59 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:52.191144 13229 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_f89e751249c54ec88ac21741a7de5024"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250830 07:54:52.191289 13887 raft_consensus.cc:383] T 689b4fee1dd04b3d9ccdea334b0f6b59 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:52.191354 13887 raft_consensus.cc:738] T 689b4fee1dd04b3d9ccdea334b0f6b59 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
W20250830 07:54:52.191512 13229 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f89e751249c54ec88ac21741a7de5024 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:52.191509 13887 consensus_queue.cc:260] T 689b4fee1dd04b3d9ccdea334b0f6b59 P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:52.191951 13887 ts_tablet_manager.cc:1428] T 689b4fee1dd04b3d9ccdea334b0f6b59 P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.025s user 0.001s sys 0.000s
I20250830 07:54:52.192821 13887 tablet_bootstrap.cc:492] T 49165f0001044d72b68263a60ef56457 P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:54:52.192797 13225 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_b30af2897319434da09d1a2dd2103658" } modify_external_catalogs: true
I20250830 07:54:52.192919 13225 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_b30af2897319434da09d1a2dd2103658" } modify_external_catalogs: true
W20250830 07:54:52.169059 13423 leader_election.cc:343] T 10ec97b8a82145479e0bb526c4cc7c05 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
W20250830 07:54:52.193815 13422 leader_election.cc:343] T 10ec97b8a82145479e0bb526c4cc7c05 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Illegal state: must be running to vote when last-logged opid is not known
W20250830 07:54:52.193965 13423 leader_election.cc:343] T a8660a6ff9254d4f9f0ef047b8682ed1 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:52.194000 13422 leader_election.cc:304] T 10ec97b8a82145479e0bb526c4cc7c05 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba; no voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f
W20250830 07:54:52.194094 13423 leader_election.cc:343] T 796e01f6a36241fc94e335253929d6ab P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:52.194187 15412 raft_consensus.cc:2747] T 10ec97b8a82145479e0bb526c4cc7c05 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20250830 07:54:52.194461 13422 leader_election.cc:343] T a8660a6ff9254d4f9f0ef047b8682ed1 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:52.194559 13422 leader_election.cc:304] T a8660a6ff9254d4f9f0ef047b8682ed1 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba; no voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:54:52.194732 15412 raft_consensus.cc:2747] T a8660a6ff9254d4f9f0ef047b8682ed1 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20250830 07:54:52.194922 13422 leader_election.cc:343] T 796e01f6a36241fc94e335253929d6ab P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:52.195045 13422 leader_election.cc:304] T 796e01f6a36241fc94e335253929d6ab P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba; no voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:54:52.195264 15412 raft_consensus.cc:2747] T 796e01f6a36241fc94e335253929d6ab P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20250830 07:54:52.194197 13423 leader_election.cc:343] T 62ee2d0fbd774d38a4a4c4a033584ef9 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Not found: Tablet not found: 62ee2d0fbd774d38a4a4c4a033584ef9
I20250830 07:54:52.197190 15405 raft_consensus.cc:491] T f52dd8eeb64a4b8a92babf34387b6c5b P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:52.197350 15405 raft_consensus.cc:513] T f52dd8eeb64a4b8a92babf34387b6c5b P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:52.197976 15405 leader_election.cc:290] T f52dd8eeb64a4b8a92babf34387b6c5b P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:52.198480 13771 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f52dd8eeb64a4b8a92babf34387b6c5b" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:52.198673 13771 raft_consensus.cc:2466] T f52dd8eeb64a4b8a92babf34387b6c5b P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b5e454d98894637b466ea27f1b647f9 in term 0.
W20250830 07:54:52.198858 13561 leader_election.cc:343] T f52dd8eeb64a4b8a92babf34387b6c5b P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): Not found: Tablet not found: f52dd8eeb64a4b8a92babf34387b6c5b
W20250830 07:54:52.196803 13423 consensus_peers.cc:489] T d1bf58d367f54ba8bad64887b9a8d9cc P 2065c332f15a4739899af79f3669c3ba -> Peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Couldn't send request to peer 6b5e454d98894637b466ea27f1b647f9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20250830 07:54:52.196779 13422 leader_election.cc:304] T 62ee2d0fbd774d38a4a4c4a033584ef9 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba; no voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:54:52.196960 13887 tablet_bootstrap.cc:654] T 49165f0001044d72b68263a60ef56457 P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:52.199748 13701 leader_election.cc:304] T 924403105a6a40f28aad60647a2a8987 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:54:52.200165 15322 raft_consensus.cc:2747] T 62ee2d0fbd774d38a4a4c4a033584ef9 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20250830 07:54:52.200312 15322 raft_consensus.cc:491] T 7aed56dba39e40518e9c3325bcccd74a P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:52.200402 15322 raft_consensus.cc:513] T 7aed56dba39e40518e9c3325bcccd74a P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:52.200121 15340 raft_consensus.cc:2802] T 924403105a6a40f28aad60647a2a8987 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election won for term 1
I20250830 07:54:52.200937 15322 leader_election.cc:290] T 7aed56dba39e40518e9c3325bcccd74a P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:52.201017 15340 raft_consensus.cc:695] T 924403105a6a40f28aad60647a2a8987 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 LEADER]: Becoming Leader. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Running, Role: LEADER
I20250830 07:54:52.201220 15340 consensus_queue.cc:237] T 924403105a6a40f28aad60647a2a8987 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:52.199102 13562 leader_election.cc:304] T f52dd8eeb64a4b8a92babf34387b6c5b P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 2065c332f15a4739899af79f3669c3ba
I20250830 07:54:52.203648 13611 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "33701eeb12fc451d90ae0b1c4dd7d134" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:52.204231 15047 ts_tablet_manager.cc:1918] T 13df49c2c2cd4e5cae26a540835b74c9 P 6b5e454d98894637b466ea27f1b647f9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250830 07:54:52.204296 15405 raft_consensus.cc:2802] T f52dd8eeb64a4b8a92babf34387b6c5b P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:54:52.204331 15047 log.cc:1199] T 13df49c2c2cd4e5cae26a540835b74c9 P 6b5e454d98894637b466ea27f1b647f9: Deleting WAL directory at /tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/ts-1/wal/wals/13df49c2c2cd4e5cae26a540835b74c9
I20250830 07:54:52.204360 15405 raft_consensus.cc:491] T f52dd8eeb64a4b8a92babf34387b6c5b P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:54:52.204420 15405 raft_consensus.cc:3058] T f52dd8eeb64a4b8a92babf34387b6c5b P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:52.204445 13629 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "7aed56dba39e40518e9c3325bcccd74a" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
W20250830 07:54:52.204831 13423 leader_election.cc:343] T 33701eeb12fc451d90ae0b1c4dd7d134 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
W20250830 07:54:52.205080 13423 leader_election.cc:343] T 7aed56dba39e40518e9c3325bcccd74a P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:52.212515 15322 raft_consensus.cc:491] T d1153d8cd2994377ac0dcbfeeda1fd52 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:52.212648 15322 raft_consensus.cc:513] T d1153d8cd2994377ac0dcbfeeda1fd52 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:52.213143 15322 leader_election.cc:290] T d1153d8cd2994377ac0dcbfeeda1fd52 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:52.214987 15047 ts_tablet_manager.cc:1939] T 13df49c2c2cd4e5cae26a540835b74c9 P 6b5e454d98894637b466ea27f1b647f9: Deleting consensus metadata
I20250830 07:54:52.217105 13230 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_0ace36b202294925a0a5ba37727867c5" } modify_external_catalogs: true
I20250830 07:54:52.217262 13230 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_0ace36b202294925a0a5ba37727867c5" } modify_external_catalogs: true
I20250830 07:54:52.218261 13629 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "d1153d8cd2994377ac0dcbfeeda1fd52" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:52.220602 13220 catalog_manager.cc:4928] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): tablet 13df49c2c2cd4e5cae26a540835b74c9 (table default.Table_cbbde0aa8e5b47e69f1a0db288d36cdf [id=f366e4f894174aeb837a8749180c3a34]) successfully deleted
W20250830 07:54:52.225507 13423 leader_election.cc:343] T d1153d8cd2994377ac0dcbfeeda1fd52 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
W20250830 07:54:52.226737 13220 catalog_manager.cc:4908] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet 82111604312e4240a66df81ba20bc046 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 82111604312e4240a66df81ba20bc046 already in progress: creating tablet
I20250830 07:54:52.227999 13228 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_ae9e802339b345f5ad2cfd671b29e3b5" } new_table_name: "default.Table_50658f5ec9ba40ffaf681fc817ae6b47" modify_external_catalogs: true
W20250830 07:54:52.229286 13220 catalog_manager.cc:4908] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet aee84a97524e4568acdc4ae1c74fb492 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet aee84a97524e4568acdc4ae1c74fb492 already in progress: creating tablet
W20250830 07:54:52.231808 13220 catalog_manager.cc:4908] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet e7ac2e088ad94f64aa52cd9c5038a0c2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e7ac2e088ad94f64aa52cd9c5038a0c2 already in progress: creating tablet
I20250830 07:54:52.231928 13887 tablet_bootstrap.cc:492] T 49165f0001044d72b68263a60ef56457 P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:54:52.232065 13887 ts_tablet_manager.cc:1397] T 49165f0001044d72b68263a60ef56457 P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.039s user 0.002s sys 0.003s
I20250830 07:54:52.180523 13886 ts_tablet_manager.cc:1428] T 33701eeb12fc451d90ae0b1c4dd7d134 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.008s user 0.002s sys 0.000s
W20250830 07:54:52.233040 13220 catalog_manager.cc:4908] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet d64f20df166a46249c08444f44422fc3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d64f20df166a46249c08444f44422fc3 already in progress: creating tablet
I20250830 07:54:52.234781 13886 tablet_bootstrap.cc:492] T 74f2fcc22fd545fb8ca7c20619843023 P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:54:52.235443 15405 raft_consensus.cc:513] T f52dd8eeb64a4b8a92babf34387b6c5b P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:52.235971 15405 leader_election.cc:290] T f52dd8eeb64a4b8a92babf34387b6c5b P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 election: Requested vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:52.236812 13771 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f52dd8eeb64a4b8a92babf34387b6c5b" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f"
I20250830 07:54:52.236982 13771 raft_consensus.cc:3058] T f52dd8eeb64a4b8a92babf34387b6c5b P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
W20250830 07:54:52.241840 13226 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.12.209.3:49453 (request call id 137) took 4717 ms (client timeout 1000 ms). Trace:
W20250830 07:54:52.241925 13226 rpcz_store.cc:269] 0830 07:54:47.524741 (+ 0us) service_pool.cc:168] Inserting onto call queue
0830 07:54:47.541485 (+ 16744us) service_pool.cc:225] Handling call
0830 07:54:47.585317 (+ 43832us) spinlock_profiling.cc:243] Waited 36.8 ms on lock 0x616000040f54. stack: 00007f4985b867d6 00007f4985b86590 00007f4984b793ad 0000000000972d94 0000000000972d5d 00007f499495114d 00007f4994951243 00007f4991610941 00007f499919ba5d 00007f499931f6d8 00007f4990159c86 00007f49901599b5 00007f498c9342ce 00007f498c9331ae 00007f498c9393e5 00007f498c939d0f
0830 07:54:52.241822 (+4656505us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0830 07:54:48.315574 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0830 07:54:48.315684 (+ 110us) write_op.cc:432] Acquiring schema lock in shared mode
0830 07:54:48.315690 (+ 6us) write_op.cc:435] Acquired schema lock
0830 07:54:48.315694 (+ 4us) tablet.cc:660] Decoding operations
0830 07:54:48.315776 (+ 82us) write_op.cc:620] Acquiring the partition lock for write op
0830 07:54:48.315786 (+ 10us) write_op.cc:641] Partition lock acquired for write op
0830 07:54:48.315792 (+ 6us) tablet.cc:683] Acquiring locks for 1 operations
0830 07:54:48.315843 (+ 51us) tablet.cc:699] Row locks acquired
0830 07:54:48.315847 (+ 4us) write_op.cc:260] PREPARE: finished
0830 07:54:48.315873 (+ 26us) write_op.cc:270] Start()
0830 07:54:48.315898 (+ 25us) write_op.cc:276] Timestamp: P: 1756540488315851 usec, L: 0
0830 07:54:48.315903 (+ 5us) op_driver.cc:348] REPLICATION: starting
0830 07:54:48.316053 (+ 150us) log.cc:844] Serialized 356 byte log entry
0830 07:54:48.560545 (+244492us) op_driver.cc:464] REPLICATION: finished
0830 07:54:48.560663 (+ 118us) write_op.cc:301] APPLY: starting
0830 07:54:48.560674 (+ 11us) tablet.cc:1365] starting BulkCheckPresence
0830 07:54:48.560708 (+ 34us) tablet.cc:1368] finished BulkCheckPresence
0830 07:54:48.560735 (+ 27us) tablet.cc:1370] starting ApplyRowOperation cycle
0830 07:54:48.560776 (+ 41us) tablet.cc:1381] finished ApplyRowOperation cycle
0830 07:54:48.560802 (+ 26us) tablet_metrics.cc:563] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0830 07:54:48.560808 (+ 6us) write_op.cc:312] APPLY: finished
0830 07:54:48.560872 (+ 64us) log.cc:844] Serialized 23 byte log entry
0830 07:54:48.560923 (+ 51us) write_op.cc:489] Releasing partition, row and schema locks
0830 07:54:48.560936 (+ 13us) write_op.cc:454] Released schema lock
0830 07:54:48.560942 (+ 6us) write_op.cc:341] FINISH: Updating metrics
0830 07:54:48.561013 (+ 71us) write_op.cc:489] Releasing partition, row and schema locks
0830 07:54:48.561017 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":19,"spinlock_wait_cycles":84667776,"child_traces":[["op",{"apply.queue_time_us":78,"apply.run_cpu_time_us":342,"apply.run_wall_time_us":342,"num_ops":1,"prepare.queue_time_us":9810,"prepare.run_cpu_time_us":540,"prepare.run_wall_time_us":790,"replication_time_us":244614}]]}
I20250830 07:54:52.242669 13226 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_800922101ede43af952ed138bc5b9e1e" } new_table_name: "default.Table_73a88c901a864dc68f6bb834b4f49236" modify_external_catalogs: true
I20250830 07:54:52.243891 13771 raft_consensus.cc:2466] T f52dd8eeb64a4b8a92babf34387b6c5b P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b5e454d98894637b466ea27f1b647f9 in term 1.
I20250830 07:54:52.244274 13562 leader_election.cc:304] T f52dd8eeb64a4b8a92babf34387b6c5b P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f; no voters:
I20250830 07:54:52.244621 15405 raft_consensus.cc:2802] T f52dd8eeb64a4b8a92babf34387b6c5b P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Leader election won for term 1
I20250830 07:54:52.244736 15405 raft_consensus.cc:695] T f52dd8eeb64a4b8a92babf34387b6c5b P 6b5e454d98894637b466ea27f1b647f9 [term 1 LEADER]: Becoming Leader. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Running, Role: LEADER
I20250830 07:54:52.245407 13882 tablet_bootstrap.cc:492] T aee84a97524e4568acdc4ae1c74fb492 P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:54:52.245527 13882 ts_tablet_manager.cc:1397] T aee84a97524e4568acdc4ae1c74fb492 P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.316s user 0.010s sys 0.036s
W20250830 07:54:52.246917 13561 leader_election.cc:343] T f52dd8eeb64a4b8a92babf34387b6c5b P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): Not found: Tablet not found: f52dd8eeb64a4b8a92babf34387b6c5b
I20250830 07:54:52.246534 15405 consensus_queue.cc:237] T f52dd8eeb64a4b8a92babf34387b6c5b P 6b5e454d98894637b466ea27f1b647f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
W20250830 07:54:52.252655 13233 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet e5c8a6e8e5854274bd0548c6ece9bf2d consensus state has no leader
W20250830 07:54:52.253338 13234 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ab667e34aab14233ad1755c45e6828a6 has no consensus state
W20250830 07:54:52.255139 13228 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet fbb1cc8f8eea4a0795f6f8e213b8180f consensus state has no leader
I20250830 07:54:52.255455 13225 catalog_manager.cc:5864] Not sending DeleteTablet requests; no consensus state for tablet 13f78c9ba1574e05bd9acf86f08c2c7e
I20250830 07:54:52.255643 13230 catalog_manager.cc:5864] Not sending DeleteTablet requests; no consensus state for tablet 51d373a917a44a70b9b0c900f3fa0b8e
I20250830 07:54:52.259295 13882 raft_consensus.cc:357] T aee84a97524e4568acdc4ae1c74fb492 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:52.259445 13882 raft_consensus.cc:383] T aee84a97524e4568acdc4ae1c74fb492 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:52.259516 13882 raft_consensus.cc:738] T aee84a97524e4568acdc4ae1c74fb492 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:54:52.259685 13882 consensus_queue.cc:260] T aee84a97524e4568acdc4ae1c74fb492 P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:52.260159 13882 ts_tablet_manager.cc:1428] T aee84a97524e4568acdc4ae1c74fb492 P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.015s user 0.000s sys 0.000s
I20250830 07:54:52.260416 13882 tablet_bootstrap.cc:492] T 3525652a73b8413b8ccbcb5824cc5880 P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:54:52.261696 13882 tablet_bootstrap.cc:654] T 3525652a73b8413b8ccbcb5824cc5880 P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:52.262758 13887 raft_consensus.cc:357] T 49165f0001044d72b68263a60ef56457 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:52.262943 13887 raft_consensus.cc:383] T 49165f0001044d72b68263a60ef56457 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:52.263015 13887 raft_consensus.cc:738] T 49165f0001044d72b68263a60ef56457 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:54:52.263180 13887 consensus_queue.cc:260] T 49165f0001044d72b68263a60ef56457 P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:52.263391 13233 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_5a036741975e421cb0e252a3edd54928"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250830 07:54:52.263638 13887 ts_tablet_manager.cc:1428] T 49165f0001044d72b68263a60ef56457 P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.031s user 0.001s sys 0.000s
W20250830 07:54:52.263872 13233 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5a036741975e421cb0e252a3edd54928 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:52.265089 13234 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_ced659e469e94825a721eb09ccadeaa6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250830 07:54:52.265321 15342 raft_consensus.cc:491] T 33701eeb12fc451d90ae0b1c4dd7d134 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:52.265424 15342 raft_consensus.cc:513] T 33701eeb12fc451d90ae0b1c4dd7d134 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
W20250830 07:54:52.265553 13234 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ced659e469e94825a721eb09ccadeaa6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:52.265923 15342 leader_election.cc:290] T 33701eeb12fc451d90ae0b1c4dd7d134 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967)
I20250830 07:54:52.266021 15342 raft_consensus.cc:491] T d1153d8cd2994377ac0dcbfeeda1fd52 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:52.266099 15342 raft_consensus.cc:513] T d1153d8cd2994377ac0dcbfeeda1fd52 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
W20250830 07:54:52.266289 15199 log.cc:927] Time spent T 00000000000000000000000000000000 P 3ea183a890b84f408b20b55e9eb7c7ed: Append to log took a long time: real 0.055s user 0.002s sys 0.000s
I20250830 07:54:52.266502 15342 leader_election.cc:290] T d1153d8cd2994377ac0dcbfeeda1fd52 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967)
I20250830 07:54:52.267809 13610 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "d1153d8cd2994377ac0dcbfeeda1fd52" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
W20250830 07:54:52.268211 13703 leader_election.cc:343] T d1153d8cd2994377ac0dcbfeeda1fd52 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:52.270504 15339 raft_consensus.cc:491] T 7af74bdde363493f8061eba450ecf4b4 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6b5e454d98894637b466ea27f1b647f9)
I20250830 07:54:52.270694 15339 raft_consensus.cc:513] T 7af74bdde363493f8061eba450ecf4b4 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:52.271036 13619 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "33701eeb12fc451d90ae0b1c4dd7d134" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:52.271375 15339 leader_election.cc:290] T 7af74bdde363493f8061eba450ecf4b4 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
W20250830 07:54:52.272006 13703 leader_election.cc:343] T 33701eeb12fc451d90ae0b1c4dd7d134 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:52.273300 13886 tablet_bootstrap.cc:654] T 74f2fcc22fd545fb8ca7c20619843023 P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:52.275518 13887 tablet_bootstrap.cc:492] T c8bc6e07377a4ba99c39a909dae11402 P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:54:52.276749 13230 master_service.cc:948] ReplaceTablet: received request to replace tablet d206f6b6e7524a27a9f95787bcd5de77 from {username='slave'} at 127.0.0.1:42126
I20250830 07:54:52.277500 13887 tablet_bootstrap.cc:654] T c8bc6e07377a4ba99c39a909dae11402 P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
W20250830 07:54:52.284957 13703 leader_election.cc:343] T 7af74bdde363493f8061eba450ecf4b4 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Not found: Tablet not found: 7af74bdde363493f8061eba450ecf4b4
I20250830 07:54:52.294492 15342 raft_consensus.cc:491] T 62ee2d0fbd774d38a4a4c4a033584ef9 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6b5e454d98894637b466ea27f1b647f9)
I20250830 07:54:52.294595 15342 raft_consensus.cc:513] T 62ee2d0fbd774d38a4a4c4a033584ef9 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:52.295096 15342 leader_election.cc:290] T 62ee2d0fbd774d38a4a4c4a033584ef9 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967)
I20250830 07:54:52.295117 13228 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_79eac01717044a179c06e461fe6f82bb" } new_table_name: "default.Table_938062c755124244958f72a0f1e26569" modify_external_catalogs: true
I20250830 07:54:52.295516 13231 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_f9c7bbd999bd4bfbb0ce5579b195c8db" } modify_external_catalogs: true
W20250830 07:54:52.295943 13703 leader_election.cc:343] T 62ee2d0fbd774d38a4a4c4a033584ef9 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Not found: Tablet not found: 62ee2d0fbd774d38a4a4c4a033584ef9
I20250830 07:54:52.296720 13887 tablet_bootstrap.cc:492] T c8bc6e07377a4ba99c39a909dae11402 P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:54:52.296828 13887 ts_tablet_manager.cc:1397] T c8bc6e07377a4ba99c39a909dae11402 P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.021s user 0.003s sys 0.002s
W20250830 07:54:52.297214 13226 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet becf9667a0fc4507bc114407090c055c consensus state has no leader
I20250830 07:54:52.297473 13226 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_f0716cbf23644e13b931581d24a150d5" } modify_external_catalogs: true
I20250830 07:54:52.297473 13887 raft_consensus.cc:357] T c8bc6e07377a4ba99c39a909dae11402 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:52.297611 13887 raft_consensus.cc:383] T c8bc6e07377a4ba99c39a909dae11402 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:52.297588 13226 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_f0716cbf23644e13b931581d24a150d5" } modify_external_catalogs: true
I20250830 07:54:52.297654 13887 raft_consensus.cc:738] T c8bc6e07377a4ba99c39a909dae11402 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
W20250830 07:54:52.298048 13229 catalog_manager.cc:5415] Ignoring report from unknown tablet 43e93d3038f7496ebb18319420ab67e0
W20250830 07:54:52.298146 13229 catalog_manager.cc:5415] Ignoring report from unknown tablet 5235e1a32f044f0cbf882e338c482003
I20250830 07:54:52.298092 13232 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_cec0576a4d7545dbaed4d008213b74fc"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:52.298486 13232 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_cec0576a4d7545dbaed4d008213b74fc in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:52.298933 13233 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_fd5ae3d5b77b4b5eb094912087eb1b26"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250830 07:54:52.299053 13887 consensus_queue.cc:260] T c8bc6e07377a4ba99c39a909dae11402 P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:52.295656 13231 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_f9c7bbd999bd4bfbb0ce5579b195c8db" } modify_external_catalogs: true
W20250830 07:54:52.299382 13233 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fd5ae3d5b77b4b5eb094912087eb1b26 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:52.299566 13887 ts_tablet_manager.cc:1428] T c8bc6e07377a4ba99c39a909dae11402 P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20250830 07:54:52.299786 13887 tablet_bootstrap.cc:492] T 97d49a1f600f4c13a4aafca99cedabe8 P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:54:52.301245 13887 tablet_bootstrap.cc:654] T 97d49a1f600f4c13a4aafca99cedabe8 P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:52.302829 13227 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_fcbe03bb31c84baf99f5b5e81dd03a7c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:52.303300 13227 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fcbe03bb31c84baf99f5b5e81dd03a7c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:52.303324 13225 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_f99558cee54143bdac50cbc8940edf4b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:52.303781 13225 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f99558cee54143bdac50cbc8940edf4b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:52.305434 13771 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "33701eeb12fc451d90ae0b1c4dd7d134" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:52.305593 13771 raft_consensus.cc:2466] T 33701eeb12fc451d90ae0b1c4dd7d134 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2065c332f15a4739899af79f3669c3ba in term 0.
I20250830 07:54:52.306423 13486 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "1e48641532cd439e9b4074712033c737" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba"
I20250830 07:54:52.306562 13486 raft_consensus.cc:3058] T 1e48641532cd439e9b4074712033c737 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:52.309042 13486 raft_consensus.cc:2466] T 1e48641532cd439e9b4074712033c737 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 1.
I20250830 07:54:52.309922 13230 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_da41ab7e69f34ff880f61dd2168a0ea6" } modify_external_catalogs: true
I20250830 07:54:52.310134 13230 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_da41ab7e69f34ff880f61dd2168a0ea6" } modify_external_catalogs: true
I20250830 07:54:52.298506 13229 catalog_manager.cc:5674] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743) does not have the latest schema for tablet c1e0e774b86d4ef9a75e2635295f3e2a (table default.Table_2ef4fd56f595442da659bbfe83fea326 [id=d05616fc48704721ad64764335e6505a]). Expected version 1 got 0
I20250830 07:54:52.319525 13229 catalog_manager.cc:5674] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743) does not have the latest schema for tablet 856e644662334f8194ffef6ca1232248 (table default.Table_5a48429e0b894a6ea2c01b3ce40de1e9 [id=fe3e5972240046eaa659a06b4eea8648]). Expected version 1 got 0
I20250830 07:54:52.321520 13226 catalog_manager.cc:5864] Not sending DeleteTablet requests; no consensus state for tablet ec4818b75d0e490bb604698a09d46b76
I20250830 07:54:52.332039 13612 raft_consensus.cc:3058] T aee84a97524e4568acdc4ae1c74fb492 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:52.335391 15323 raft_consensus.cc:491] T 62bc8168176e4678a77827c5b7cc0f3e P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:52.335580 15323 raft_consensus.cc:513] T 62bc8168176e4678a77827c5b7cc0f3e P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:52.336145 15323 leader_election.cc:290] T 62bc8168176e4678a77827c5b7cc0f3e P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:52.337947 13617 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "62bc8168176e4678a77827c5b7cc0f3e" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
W20250830 07:54:52.338801 13423 leader_election.cc:343] T 62bc8168176e4678a77827c5b7cc0f3e P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:52.339999 13882 tablet_bootstrap.cc:492] T 3525652a73b8413b8ccbcb5824cc5880 P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:54:52.340260 13882 ts_tablet_manager.cc:1397] T 3525652a73b8413b8ccbcb5824cc5880 P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.080s user 0.003s sys 0.004s
I20250830 07:54:52.340371 13482 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "33701eeb12fc451d90ae0b1c4dd7d134" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:54:52.340577 13482 raft_consensus.cc:2466] T 33701eeb12fc451d90ae0b1c4dd7d134 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 0.
I20250830 07:54:52.341264 13882 raft_consensus.cc:357] T 3525652a73b8413b8ccbcb5824cc5880 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:52.341998 13482 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "d1153d8cd2994377ac0dcbfeeda1fd52" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:54:52.342335 13482 raft_consensus.cc:2466] T d1153d8cd2994377ac0dcbfeeda1fd52 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 0.
I20250830 07:54:52.342718 13882 raft_consensus.cc:383] T 3525652a73b8413b8ccbcb5824cc5880 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20250830 07:54:52.342759 13226 catalog_manager.cc:5415] Ignoring report from unknown tablet e6b7646588fe4134b2db62ff84ca4791
I20250830 07:54:52.343083 13484 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "7af74bdde363493f8061eba450ecf4b4" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:54:52.343698 13882 raft_consensus.cc:738] T 3525652a73b8413b8ccbcb5824cc5880 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:54:52.343899 13882 consensus_queue.cc:260] T 3525652a73b8413b8ccbcb5824cc5880 P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:52.343940 13226 catalog_manager.cc:5582] T 924403105a6a40f28aad60647a2a8987 P 9b057ade5dce45af9f8bf0bedf8b917f reported cstate change: term changed from 0 to 1, leader changed from <none> to 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3). New cstate: current_term: 1 leader_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } health_report { overall_health: HEALTHY } } }
I20250830 07:54:52.344323 13226 catalog_manager.cc:5674] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743) does not have the latest schema for tablet 924403105a6a40f28aad60647a2a8987 (table default.Table_5caf352b482f4b9ba4d727ab7fbd00bb [id=46ec9117fe9146cb807dd092284616fc]). Expected version 1 got 0
I20250830 07:54:52.345889 13882 ts_tablet_manager.cc:1428] T 3525652a73b8413b8ccbcb5824cc5880 P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.006s user 0.001s sys 0.000s
I20250830 07:54:52.346131 13882 tablet_bootstrap.cc:492] T d2b8e6df64ef49e2ba36c093efd3c351 P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:54:52.348196 13229 master_service.cc:948] ReplaceTablet: received request to replace tablet 3c3c798b2b7b460b98a30605464763e6 from {username='slave'} at 127.0.0.1:42126
I20250830 07:54:52.350013 13482 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "62ee2d0fbd774d38a4a4c4a033584ef9" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:54:52.350181 13482 raft_consensus.cc:2466] T 62ee2d0fbd774d38a4a4c4a033584ef9 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 1.
I20250830 07:54:52.351511 13771 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "7aed56dba39e40518e9c3325bcccd74a" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:52.352378 13771 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "d1153d8cd2994377ac0dcbfeeda1fd52" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:52.352547 13771 raft_consensus.cc:2466] T d1153d8cd2994377ac0dcbfeeda1fd52 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2065c332f15a4739899af79f3669c3ba in term 0.
I20250830 07:54:52.353771 13701 leader_election.cc:304] T 1e48641532cd439e9b4074712033c737 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:54:52.354194 15339 raft_consensus.cc:2802] T 1e48641532cd439e9b4074712033c737 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election won for term 1
I20250830 07:54:52.354300 15339 raft_consensus.cc:695] T 1e48641532cd439e9b4074712033c737 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 LEADER]: Becoming Leader. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Running, Role: LEADER
I20250830 07:54:52.354525 15339 consensus_queue.cc:237] T 1e48641532cd439e9b4074712033c737 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:52.354679 13882 tablet_bootstrap.cc:654] T d2b8e6df64ef49e2ba36c093efd3c351 P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
W20250830 07:54:52.357280 13703 consensus_peers.cc:489] T d64f20df166a46249c08444f44422fc3 P 9b057ade5dce45af9f8bf0bedf8b917f -> Peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Couldn't send request to peer 6b5e454d98894637b466ea27f1b647f9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20250830 07:54:52.358227 13771 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "62bc8168176e4678a77827c5b7cc0f3e" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:52.359382 13701 leader_election.cc:304] T 33701eeb12fc451d90ae0b1c4dd7d134 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:54:52.359802 15340 raft_consensus.cc:2802] T 33701eeb12fc451d90ae0b1c4dd7d134 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:54:52.359927 15340 raft_consensus.cc:491] T 33701eeb12fc451d90ae0b1c4dd7d134 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:54:52.360062 15340 raft_consensus.cc:3058] T 33701eeb12fc451d90ae0b1c4dd7d134 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:52.363178 15340 raft_consensus.cc:513] T 33701eeb12fc451d90ae0b1c4dd7d134 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:52.364269 15340 leader_election.cc:290] T 33701eeb12fc451d90ae0b1c4dd7d134 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Requested vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967)
I20250830 07:54:52.364356 13617 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "33701eeb12fc451d90ae0b1c4dd7d134" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9"
W20250830 07:54:52.364893 13703 leader_election.cc:343] T 33701eeb12fc451d90ae0b1c4dd7d134 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:52.370743 13701 leader_election.cc:304] T d1153d8cd2994377ac0dcbfeeda1fd52 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:54:52.371276 13701 leader_election.cc:304] T 7af74bdde363493f8061eba450ecf4b4 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 2065c332f15a4739899af79f3669c3ba, 6b5e454d98894637b466ea27f1b647f9
I20250830 07:54:52.371639 15365 raft_consensus.cc:2802] T d1153d8cd2994377ac0dcbfeeda1fd52 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:54:52.371708 15365 raft_consensus.cc:491] T d1153d8cd2994377ac0dcbfeeda1fd52 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:54:52.371768 15365 raft_consensus.cc:3058] T d1153d8cd2994377ac0dcbfeeda1fd52 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:52.374460 15365 raft_consensus.cc:513] T d1153d8cd2994377ac0dcbfeeda1fd52 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:52.375254 15339 raft_consensus.cc:2747] T 7af74bdde363493f8061eba450ecf4b4 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20250830 07:54:52.376296 15365 leader_election.cc:290] T d1153d8cd2994377ac0dcbfeeda1fd52 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Requested vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967)
I20250830 07:54:52.376524 15323 raft_consensus.cc:491] T 6ccbaf109e36453ea6645dfd090f5a1a P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:52.376682 15323 raft_consensus.cc:513] T 6ccbaf109e36453ea6645dfd090f5a1a P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:52.377871 13619 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "6ccbaf109e36453ea6645dfd090f5a1a" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
W20250830 07:54:52.378547 13423 leader_election.cc:343] T 6ccbaf109e36453ea6645dfd090f5a1a P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:52.378736 13617 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "d1153d8cd2994377ac0dcbfeeda1fd52" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9"
I20250830 07:54:52.379303 15323 leader_election.cc:290] T 6ccbaf109e36453ea6645dfd090f5a1a P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:52.381233 13231 catalog_manager.cc:5864] Not sending DeleteTablet requests; no consensus state for tablet b71c34850a3148df8a914240cbe40944
W20250830 07:54:52.383654 13703 leader_election.cc:343] T d1153d8cd2994377ac0dcbfeeda1fd52 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
W20250830 07:54:52.385408 13228 catalog_manager.cc:5415] Ignoring report from unknown tablet a8660a6ff9254d4f9f0ef047b8682ed1
W20250830 07:54:52.385464 13228 catalog_manager.cc:5415] Ignoring report from unknown tablet db4077bf8e184ac5809ef629222f2cc5
W20250830 07:54:52.385491 13228 catalog_manager.cc:5415] Ignoring report from unknown tablet b83dfc54383d4e7b96523568aea5c9f3
I20250830 07:54:52.422683 13230 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet 1e48641532cd439e9b4074712033c737
I20250830 07:54:52.423657 13229 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet 3c3c798b2b7b460b98a30605464763e6
I20250830 07:54:52.423930 13593 tablet_service.cc:1515] Processing DeleteTablet for tablet 1e48641532cd439e9b4074712033c737 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:52 UTC) from {username='slave'} at 127.0.0.1:45306
I20250830 07:54:52.424183 13229 catalog_manager.cc:6652] ReplaceTablet: tablet 3c3c798b2b7b460b98a30605464763e6 deleted and replaced by tablet c08d370cd76c495ebc108a340f5e5be8
W20250830 07:54:52.424654 13220 catalog_manager.cc:4908] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet 1e48641532cd439e9b4074712033c737 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1e48641532cd439e9b4074712033c737 already in progress: creating tablet
I20250830 07:54:52.425096 13593 tablet_service.cc:1515] Processing DeleteTablet for tablet 3c3c798b2b7b460b98a30605464763e6 with delete_type TABLET_DATA_DELETED (replaced by tablet c08d370cd76c495ebc108a340f5e5be8) from {username='slave'} at 127.0.0.1:45306
W20250830 07:54:52.425799 13220 catalog_manager.cc:4908] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet 3c3c798b2b7b460b98a30605464763e6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3c3c798b2b7b460b98a30605464763e6 already in progress: creating tablet
I20250830 07:54:52.447824 15323 raft_consensus.cc:491] T 8dddcfe56522436287aea212e316a729 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6b5e454d98894637b466ea27f1b647f9)
I20250830 07:54:52.447955 15323 raft_consensus.cc:513] T 8dddcfe56522436287aea212e316a729 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:52.448478 15323 leader_election.cc:290] T 8dddcfe56522436287aea212e316a729 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:52.450321 13701 leader_election.cc:304] T 62ee2d0fbd774d38a4a4c4a033584ef9 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:54:52.450564 15340 consensus_queue.cc:1035] T d64f20df166a46249c08444f44422fc3 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:54:52.450935 15340 raft_consensus.cc:2802] T 62ee2d0fbd774d38a4a4c4a033584ef9 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20250830 07:54:52.451539 15340 raft_consensus.cc:491] T 62ee2d0fbd774d38a4a4c4a033584ef9 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6b5e454d98894637b466ea27f1b647f9)
I20250830 07:54:52.451597 15340 raft_consensus.cc:3058] T 62ee2d0fbd774d38a4a4c4a033584ef9 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Advancing to term 2
I20250830 07:54:52.452284 13226 master_service.cc:948] ReplaceTablet: received request to replace tablet 3c3c798b2b7b460b98a30605464763e6 from {username='slave'} at 127.0.0.1:42126
I20250830 07:54:52.452311 15412 raft_consensus.cc:491] T 852e353f6ee945628ddebdbdd1bd76fb P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:52.452416 15412 raft_consensus.cc:513] T 852e353f6ee945628ddebdbdd1bd76fb P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
W20250830 07:54:52.452951 13423 leader_election.cc:343] T 8dddcfe56522436287aea212e316a729 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Not found: Tablet not found: 8dddcfe56522436287aea212e316a729
I20250830 07:54:52.453567 13422 leader_election.cc:304] T 33701eeb12fc451d90ae0b1c4dd7d134 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
W20250830 07:54:52.453892 13422 leader_election.cc:343] T 7aed56dba39e40518e9c3325bcccd74a P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:52.453984 13422 leader_election.cc:304] T 7aed56dba39e40518e9c3325bcccd74a P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba; no voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:54:52.454303 13422 leader_election.cc:304] T d1153d8cd2994377ac0dcbfeeda1fd52 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:54:52.454386 15009 raft_consensus.cc:2802] T 33701eeb12fc451d90ae0b1c4dd7d134 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:54:52.454463 15009 raft_consensus.cc:491] T 33701eeb12fc451d90ae0b1c4dd7d134 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:54:52.454495 15115 raft_consensus.cc:2747] T 7aed56dba39e40518e9c3325bcccd74a P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:54:52.454515 15009 raft_consensus.cc:3058] T 33701eeb12fc451d90ae0b1c4dd7d134 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:52.454622 15115 raft_consensus.cc:2802] T d1153d8cd2994377ac0dcbfeeda1fd52 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:54:52.454667 15115 raft_consensus.cc:491] T d1153d8cd2994377ac0dcbfeeda1fd52 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:54:52.454775 15115 raft_consensus.cc:3058] T d1153d8cd2994377ac0dcbfeeda1fd52 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
W20250830 07:54:52.454667 13422 leader_election.cc:343] T 62bc8168176e4678a77827c5b7cc0f3e P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:52.454022 15340 raft_consensus.cc:513] T 62ee2d0fbd774d38a4a4c4a033584ef9 P 9b057ade5dce45af9f8bf0bedf8b917f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:52.454955 13422 leader_election.cc:304] T 62bc8168176e4678a77827c5b7cc0f3e P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba; no voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:54:52.455509 13226 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_b74f6d70eec54d93aaddd5ceca3de985"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250830 07:54:52.455680 15340 leader_election.cc:290] T 62ee2d0fbd774d38a4a4c4a033584ef9 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 2 election: Requested vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967)
I20250830 07:54:52.455984 15411 raft_consensus.cc:2747] T 62bc8168176e4678a77827c5b7cc0f3e P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20250830 07:54:52.456020 13226 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b74f6d70eec54d93aaddd5ceca3de985 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250830 07:54:52.456871 13703 leader_election.cc:343] T 62ee2d0fbd774d38a4a4c4a033584ef9 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Not found: Tablet not found: 62ee2d0fbd774d38a4a4c4a033584ef9
I20250830 07:54:52.457567 13771 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "6ccbaf109e36453ea6645dfd090f5a1a" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:52.457844 13764 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "8dddcfe56522436287aea212e316a729" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:52.457989 13764 raft_consensus.cc:2466] T 8dddcfe56522436287aea212e316a729 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2065c332f15a4739899af79f3669c3ba in term 1.
I20250830 07:54:52.454694 15248 consensus_queue.cc:1035] T d1bf58d367f54ba8bad64887b9a8d9cc P 2065c332f15a4739899af79f3669c3ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20250830 07:54:52.462000 13228 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_e615ab9a87834e418ebf3407a8c1a207"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:52.462495 13228 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e615ab9a87834e418ebf3407a8c1a207 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:52.463433 13886 tablet_bootstrap.cc:492] T 74f2fcc22fd545fb8ca7c20619843023 P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:54:52.463762 13886 ts_tablet_manager.cc:1397] T 74f2fcc22fd545fb8ca7c20619843023 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.230s user 0.016s sys 0.010s
I20250830 07:54:52.465423 13229 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_ad1e059ca08e421ab7fe406c6dd762ac" } new_table_name: "default.Table_d8fc3dffa80d4ed9b4222d7d6445bd9f" modify_external_catalogs: true
I20250830 07:54:52.465575 13886 raft_consensus.cc:357] T 74f2fcc22fd545fb8ca7c20619843023 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:52.465902 13886 raft_consensus.cc:383] T 74f2fcc22fd545fb8ca7c20619843023 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:52.466043 13886 raft_consensus.cc:738] T 74f2fcc22fd545fb8ca7c20619843023 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:54:52.466614 15322 raft_consensus.cc:491] T c8bc6e07377a4ba99c39a909dae11402 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:52.466729 15322 raft_consensus.cc:513] T c8bc6e07377a4ba99c39a909dae11402 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:52.467398 15322 leader_election.cc:290] T c8bc6e07377a4ba99c39a909dae11402 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:52.466949 13886 consensus_queue.cc:260] T 74f2fcc22fd545fb8ca7c20619843023 P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:52.468228 13619 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "c8bc6e07377a4ba99c39a909dae11402" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
W20250830 07:54:52.468690 13423 leader_election.cc:343] T c8bc6e07377a4ba99c39a909dae11402 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:52.468629 13230 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_23b0e4524e4e4482a40077900c74a197"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:52.469159 13230 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_23b0e4524e4e4482a40077900c74a197 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:52.469293 13225 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_41eb28f070d04bf69d643c4208052120" } new_table_name: "default.Table_39a24b3df73845288264cd44ba598cf7" modify_external_catalogs: true
I20250830 07:54:52.470911 13231 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_f67d45bb30d642c09937bf138415d474"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250830 07:54:52.470847 13227 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_cec0576a4d7545dbaed4d008213b74fc" } modify_external_catalogs: true
I20250830 07:54:52.471191 13227 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_cec0576a4d7545dbaed4d008213b74fc" } modify_external_catalogs: true
W20250830 07:54:52.471329 13231 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f67d45bb30d642c09937bf138415d474 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:52.472373 13232 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_06f5b3c7c1d64d37b8f57cd4c75a3074" } new_table_name: "default.Table_285c50883c76449d80d3cc478f5566ad" modify_external_catalogs: true
I20250830 07:54:52.473497 13886 ts_tablet_manager.cc:1428] T 74f2fcc22fd545fb8ca7c20619843023 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.010s user 0.002s sys 0.000s
I20250830 07:54:52.473536 13234 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_470c1b7551fc4784bc81ab9f97646e40" } modify_external_catalogs: true
I20250830 07:54:52.473650 13234 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_470c1b7551fc4784bc81ab9f97646e40" } modify_external_catalogs: true
I20250830 07:54:52.473837 13886 tablet_bootstrap.cc:492] T 410b1e2d520c470eb4b9ab60104e0cd4 P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:54:52.475566 13886 tablet_bootstrap.cc:654] T 410b1e2d520c470eb4b9ab60104e0cd4 P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:52.476361 13882 tablet_bootstrap.cc:492] T d2b8e6df64ef49e2ba36c093efd3c351 P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:54:52.476485 13882 ts_tablet_manager.cc:1397] T d2b8e6df64ef49e2ba36c093efd3c351 P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.130s user 0.017s sys 0.003s
I20250830 07:54:52.477114 13882 raft_consensus.cc:357] T d2b8e6df64ef49e2ba36c093efd3c351 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:52.477285 13882 raft_consensus.cc:383] T d2b8e6df64ef49e2ba36c093efd3c351 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:52.477347 13882 raft_consensus.cc:738] T d2b8e6df64ef49e2ba36c093efd3c351 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:54:52.477526 13882 consensus_queue.cc:260] T d2b8e6df64ef49e2ba36c093efd3c351 P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:52.477950 13882 ts_tablet_manager.cc:1428] T d2b8e6df64ef49e2ba36c093efd3c351 P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20250830 07:54:52.478222 13882 tablet_bootstrap.cc:492] T 4b403cadfb7b42f8896b2ee16b50ecb1 P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
W20250830 07:54:52.484436 13233 catalog_manager.cc:5415] Ignoring report from unknown tablet de3a52a8e08a45808373902a0185e6f0
W20250830 07:54:52.484591 13233 catalog_manager.cc:5415] Ignoring report from unknown tablet f398e12cd9f543738d5163354f8a9d9d
I20250830 07:54:52.485841 13233 master_service.cc:948] ReplaceTablet: received request to replace tablet 9b9c2ae8805a48f7959d6745677a96f2 from {username='slave'} at 127.0.0.1:42126
I20250830 07:54:52.485919 15009 raft_consensus.cc:513] T 33701eeb12fc451d90ae0b1c4dd7d134 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:52.486429 15009 leader_election.cc:290] T 33701eeb12fc451d90ae0b1c4dd7d134 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 election: Requested vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:52.487113 13882 tablet_bootstrap.cc:654] T 4b403cadfb7b42f8896b2ee16b50ecb1 P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:52.488333 15412 leader_election.cc:290] T 852e353f6ee945628ddebdbdd1bd76fb P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:52.489179 13619 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "33701eeb12fc451d90ae0b1c4dd7d134" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9"
I20250830 07:54:52.489207 13612 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "852e353f6ee945628ddebdbdd1bd76fb" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
W20250830 07:54:52.489722 13423 leader_election.cc:343] T 33701eeb12fc451d90ae0b1c4dd7d134 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
W20250830 07:54:52.489898 13423 leader_election.cc:343] T 852e353f6ee945628ddebdbdd1bd76fb P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:52.494092 13886 tablet_bootstrap.cc:492] T 410b1e2d520c470eb4b9ab60104e0cd4 P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:54:52.494208 13886 ts_tablet_manager.cc:1397] T 410b1e2d520c470eb4b9ab60104e0cd4 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.020s user 0.003s sys 0.000s
I20250830 07:54:52.494390 13484 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "33701eeb12fc451d90ae0b1c4dd7d134" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba"
I20250830 07:54:52.494570 13484 raft_consensus.cc:2391] T 33701eeb12fc451d90ae0b1c4dd7d134 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 9b057ade5dce45af9f8bf0bedf8b917f in current term 1: Already voted for candidate 2065c332f15a4739899af79f3669c3ba in this term.
I20250830 07:54:52.494877 13886 raft_consensus.cc:357] T 410b1e2d520c470eb4b9ab60104e0cd4 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:52.495046 13886 raft_consensus.cc:383] T 410b1e2d520c470eb4b9ab60104e0cd4 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:52.495098 13886 raft_consensus.cc:738] T 410b1e2d520c470eb4b9ab60104e0cd4 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:54:52.495275 13886 consensus_queue.cc:260] T 410b1e2d520c470eb4b9ab60104e0cd4 P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:52.495513 13481 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "d1153d8cd2994377ac0dcbfeeda1fd52" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba"
I20250830 07:54:52.495736 13886 ts_tablet_manager.cc:1428] T 410b1e2d520c470eb4b9ab60104e0cd4 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250830 07:54:52.496079 13886 tablet_bootstrap.cc:492] T 042fd7ff08fc4695b87bb8f9d225ef12 P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:54:52.498404 13886 tablet_bootstrap.cc:654] T 042fd7ff08fc4695b87bb8f9d225ef12 P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:52.502118 15115 raft_consensus.cc:513] T d1153d8cd2994377ac0dcbfeeda1fd52 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:52.502676 15115 leader_election.cc:290] T d1153d8cd2994377ac0dcbfeeda1fd52 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 election: Requested vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:52.503410 13612 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "d1153d8cd2994377ac0dcbfeeda1fd52" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9"
I20250830 07:54:52.503886 13481 raft_consensus.cc:2391] T d1153d8cd2994377ac0dcbfeeda1fd52 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 9b057ade5dce45af9f8bf0bedf8b917f in current term 1: Already voted for candidate 2065c332f15a4739899af79f3669c3ba in this term.
W20250830 07:54:52.505728 13423 leader_election.cc:343] T d1153d8cd2994377ac0dcbfeeda1fd52 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:52.507748 13226 master_service.cc:948] ReplaceTablet: received request to replace tablet 122bec4220c74dfaa8228f6d153cd50e from {username='slave'} at 127.0.0.1:42126
I20250830 07:54:52.509248 13479 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "62ee2d0fbd774d38a4a4c4a033584ef9" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba"
I20250830 07:54:52.509421 13479 raft_consensus.cc:3058] T 62ee2d0fbd774d38a4a4c4a033584ef9 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Advancing to term 2
W20250830 07:54:52.510057 13422 leader_election.cc:343] T 6ccbaf109e36453ea6645dfd090f5a1a P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:52.510169 13422 leader_election.cc:304] T 6ccbaf109e36453ea6645dfd090f5a1a P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba; no voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:54:52.510653 15412 raft_consensus.cc:2747] T 6ccbaf109e36453ea6645dfd090f5a1a P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:54:52.512020 13479 raft_consensus.cc:2466] T 62ee2d0fbd774d38a4a4c4a033584ef9 P 2065c332f15a4739899af79f3669c3ba [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 2.
I20250830 07:54:52.512602 13701 leader_election.cc:304] T 33701eeb12fc451d90ae0b1c4dd7d134 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 2065c332f15a4739899af79f3669c3ba, 6b5e454d98894637b466ea27f1b647f9
I20250830 07:54:52.512840 13422 leader_election.cc:304] T 8dddcfe56522436287aea212e316a729 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:54:52.513159 13701 leader_election.cc:304] T d1153d8cd2994377ac0dcbfeeda1fd52 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 2065c332f15a4739899af79f3669c3ba, 6b5e454d98894637b466ea27f1b647f9
I20250830 07:54:52.513232 15412 raft_consensus.cc:2802] T 8dddcfe56522436287aea212e316a729 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader pre-election won for term 2
I20250830 07:54:52.513303 15412 raft_consensus.cc:491] T 8dddcfe56522436287aea212e316a729 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6b5e454d98894637b466ea27f1b647f9)
I20250830 07:54:52.513373 15412 raft_consensus.cc:3058] T 8dddcfe56522436287aea212e316a729 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Advancing to term 2
I20250830 07:54:52.513900 15246 raft_consensus.cc:2747] T 33701eeb12fc451d90ae0b1c4dd7d134 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20250830 07:54:52.514104 15340 raft_consensus.cc:2747] T d1153d8cd2994377ac0dcbfeeda1fd52 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20250830 07:54:52.514402 13775 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "c8bc6e07377a4ba99c39a909dae11402" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:52.514645 13764 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "852e353f6ee945628ddebdbdd1bd76fb" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:52.515630 15412 raft_consensus.cc:513] T 8dddcfe56522436287aea212e316a729 P 2065c332f15a4739899af79f3669c3ba [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:52.516242 15412 leader_election.cc:290] T 8dddcfe56522436287aea212e316a729 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 2 election: Requested vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:52.516755 13765 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "33701eeb12fc451d90ae0b1c4dd7d134" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f"
I20250830 07:54:52.516973 13765 raft_consensus.cc:2391] T 33701eeb12fc451d90ae0b1c4dd7d134 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 2065c332f15a4739899af79f3669c3ba in current term 1: Already voted for candidate 9b057ade5dce45af9f8bf0bedf8b917f in this term.
I20250830 07:54:52.517203 13771 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "d1153d8cd2994377ac0dcbfeeda1fd52" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f"
I20250830 07:54:52.517453 13771 raft_consensus.cc:2391] T d1153d8cd2994377ac0dcbfeeda1fd52 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 2065c332f15a4739899af79f3669c3ba in current term 1: Already voted for candidate 9b057ade5dce45af9f8bf0bedf8b917f in this term.
W20250830 07:54:52.519369 13423 leader_election.cc:343] T 8dddcfe56522436287aea212e316a729 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Not found: Tablet not found: 8dddcfe56522436287aea212e316a729
I20250830 07:54:52.520645 13886 tablet_bootstrap.cc:492] T 042fd7ff08fc4695b87bb8f9d225ef12 P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:54:52.520763 13886 ts_tablet_manager.cc:1397] T 042fd7ff08fc4695b87bb8f9d225ef12 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.025s user 0.005s sys 0.000s
W20250830 07:54:52.521582 13422 leader_election.cc:343] T c8bc6e07377a4ba99c39a909dae11402 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:52.521485 13886 raft_consensus.cc:357] T 042fd7ff08fc4695b87bb8f9d225ef12 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:52.521693 13886 raft_consensus.cc:383] T 042fd7ff08fc4695b87bb8f9d225ef12 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:52.521754 13886 raft_consensus.cc:738] T 042fd7ff08fc4695b87bb8f9d225ef12 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:54:52.521944 13886 consensus_queue.cc:260] T 042fd7ff08fc4695b87bb8f9d225ef12 P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:52.522035 13422 leader_election.cc:304] T c8bc6e07377a4ba99c39a909dae11402 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba; no voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:54:52.523007 15009 raft_consensus.cc:2747] T c8bc6e07377a4ba99c39a909dae11402 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20250830 07:54:52.523538 13422 leader_election.cc:343] T 852e353f6ee945628ddebdbdd1bd76fb P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:52.524096 13886 ts_tablet_manager.cc:1428] T 042fd7ff08fc4695b87bb8f9d225ef12 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20250830 07:54:52.524242 13422 leader_election.cc:304] T 852e353f6ee945628ddebdbdd1bd76fb P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba; no voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:54:52.525648 15009 raft_consensus.cc:2747] T 852e353f6ee945628ddebdbdd1bd76fb P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:54:52.526031 13422 leader_election.cc:304] T 33701eeb12fc451d90ae0b1c4dd7d134 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba; no voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:54:52.526260 13886 tablet_bootstrap.cc:492] T 3bb48fce24074a8e8ec99d3172a655d8 P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:54:52.526517 14906 raft_consensus.cc:491] T 0ceccc5f18294356894695fe08d73e30 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:52.526623 14906 raft_consensus.cc:513] T 0ceccc5f18294356894695fe08d73e30 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:52.527204 14906 leader_election.cc:290] T 0ceccc5f18294356894695fe08d73e30 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:52.527666 13771 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "0ceccc5f18294356894695fe08d73e30" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:52.530627 13478 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "0ceccc5f18294356894695fe08d73e30" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:54:52.531464 13886 tablet_bootstrap.cc:654] T 3bb48fce24074a8e8ec99d3172a655d8 P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:52.535542 13561 leader_election.cc:304] T 0ceccc5f18294356894695fe08d73e30 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b5e454d98894637b466ea27f1b647f9; no voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:54:52.536069 15237 raft_consensus.cc:2747] T 0ceccc5f18294356894695fe08d73e30 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:54:52.536832 13422 leader_election.cc:304] T d1153d8cd2994377ac0dcbfeeda1fd52 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba; no voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:54:52.537068 15412 raft_consensus.cc:2747] T 33701eeb12fc451d90ae0b1c4dd7d134 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20250830 07:54:52.538203 13887 tablet_bootstrap.cc:492] T 97d49a1f600f4c13a4aafca99cedabe8 P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:54:52.540788 13701 leader_election.cc:304] T 62ee2d0fbd774d38a4a4c4a033584ef9 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:54:52.538385 15115 raft_consensus.cc:2747] T d1153d8cd2994377ac0dcbfeeda1fd52 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20250830 07:54:52.549503 13887 ts_tablet_manager.cc:1397] T 97d49a1f600f4c13a4aafca99cedabe8 P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.250s user 0.008s sys 0.008s
W20250830 07:54:52.550113 13229 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 135d754d83ad422eb05909d2daa19d34 consensus state has no leader
I20250830 07:54:52.550647 13230 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_b755f70318f4435689e640c0b4283116" } new_table_name: "default.Table_f88a6bcea0184098a5844bf601959c55" modify_external_catalogs: true
I20250830 07:54:52.550736 13887 raft_consensus.cc:357] T 97d49a1f600f4c13a4aafca99cedabe8 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:52.550971 13887 raft_consensus.cc:383] T 97d49a1f600f4c13a4aafca99cedabe8 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:52.551059 13887 raft_consensus.cc:738] T 97d49a1f600f4c13a4aafca99cedabe8 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:54:52.551276 13887 consensus_queue.cc:260] T 97d49a1f600f4c13a4aafca99cedabe8 P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:52.552368 13228 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_4846e70f774243ec9dc46669ac7b5981"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:52.553085 13228 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4846e70f774243ec9dc46669ac7b5981 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250830 07:54:52.554371 13229 catalog_manager.cc:5415] Ignoring report from unknown tablet 04eadf45b82e4c319eb7b316a402d81a
W20250830 07:54:52.554487 13229 catalog_manager.cc:5415] Ignoring report from unknown tablet 49165f0001044d72b68263a60ef56457
W20250830 07:54:52.554580 13229 catalog_manager.cc:5415] Ignoring report from unknown tablet b4ab964a64a64e00a78ffd2b220aef46
W20250830 07:54:52.554656 13229 catalog_manager.cc:5415] Ignoring report from unknown tablet 689b4fee1dd04b3d9ccdea334b0f6b59
W20250830 07:54:52.554729 13229 catalog_manager.cc:5415] Ignoring report from unknown tablet de3a52a8e08a45808373902a0185e6f0
W20250830 07:54:52.554805 13229 catalog_manager.cc:5415] Ignoring report from unknown tablet d33a5d107c6849aca6eb48ffdf8a5463
W20250830 07:54:52.554922 13229 catalog_manager.cc:5415] Ignoring report from unknown tablet ef16b9e2d444489699f4db1ac26d5f6c
W20250830 07:54:52.555034 13229 catalog_manager.cc:5415] Ignoring report from unknown tablet 057bcce2860345da860acc262dc4d339
I20250830 07:54:52.555510 13229 catalog_manager.cc:5674] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325) does not have the latest schema for tablet c8bc6e07377a4ba99c39a909dae11402 (table default.Table_f9379201a5de4169a46eeb2ff2cc0ac7 [id=dce926f371dd4b4ba61511c14d245622]). Expected version 2 got 0
I20250830 07:54:52.556814 13229 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_d4027e6c40ff4fbeb92d0f423f3eaff5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:52.557617 13229 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d4027e6c40ff4fbeb92d0f423f3eaff5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:52.558125 13887 ts_tablet_manager.cc:1428] T 97d49a1f600f4c13a4aafca99cedabe8 P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.008s user 0.000s sys 0.002s
I20250830 07:54:52.558388 13887 tablet_bootstrap.cc:492] T 6251a06d1efe44e38d35d962c468f8b2 P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:54:52.560195 13887 tablet_bootstrap.cc:654] T 6251a06d1efe44e38d35d962c468f8b2 P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
W20250830 07:54:52.563637 13225 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 63168840534246b59a2fdbfdfeebff47 consensus state has no leader
I20250830 07:54:52.563903 13225 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_456f55a62b0e4bad879a02054f214d30" } new_table_name: "default.Table_0e124eb0d1ae42beb445b3ba5edc7b76" modify_external_catalogs: true
I20250830 07:54:52.564922 13227 catalog_manager.cc:5864] Not sending DeleteTablet requests; no consensus state for tablet e94fe2a8bc9541c096b11db7caf201b6
I20250830 07:54:52.566821 13227 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_98a00559f592459ba64aaa784044fc41" } modify_external_catalogs: true
I20250830 07:54:52.567056 13227 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_98a00559f592459ba64aaa784044fc41" } modify_external_catalogs: true
W20250830 07:54:52.569113 13233 catalog_manager.cc:5415] Ignoring report from unknown tablet 74f2fcc22fd545fb8ca7c20619843023
I20250830 07:54:52.571072 15237 raft_consensus.cc:491] T 3525652a73b8413b8ccbcb5824cc5880 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:52.571238 15237 raft_consensus.cc:513] T 3525652a73b8413b8ccbcb5824cc5880 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:52.571751 15237 leader_election.cc:290] T 3525652a73b8413b8ccbcb5824cc5880 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:52.572418 13478 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "3525652a73b8413b8ccbcb5824cc5880" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:54:52.572537 13771 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "3525652a73b8413b8ccbcb5824cc5880" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:52.573019 13562 leader_election.cc:304] T 3525652a73b8413b8ccbcb5824cc5880 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b5e454d98894637b466ea27f1b647f9; no voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:54:52.573356 15237 raft_consensus.cc:2747] T 3525652a73b8413b8ccbcb5824cc5880 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:54:52.574784 13882 tablet_bootstrap.cc:492] T 4b403cadfb7b42f8896b2ee16b50ecb1 P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:54:52.574901 13882 ts_tablet_manager.cc:1397] T 4b403cadfb7b42f8896b2ee16b50ecb1 P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.097s user 0.002s sys 0.007s
I20250830 07:54:52.575850 13882 raft_consensus.cc:357] T 4b403cadfb7b42f8896b2ee16b50ecb1 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:52.575994 13882 raft_consensus.cc:383] T 4b403cadfb7b42f8896b2ee16b50ecb1 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:52.576062 13882 raft_consensus.cc:738] T 4b403cadfb7b42f8896b2ee16b50ecb1 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:54:52.576244 13882 consensus_queue.cc:260] T 4b403cadfb7b42f8896b2ee16b50ecb1 P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:52.576576 13882 ts_tablet_manager.cc:1428] T 4b403cadfb7b42f8896b2ee16b50ecb1 P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20250830 07:54:52.583685 15365 raft_consensus.cc:491] T 43e93d3038f7496ebb18319420ab67e0 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:52.583855 15365 raft_consensus.cc:513] T 43e93d3038f7496ebb18319420ab67e0 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:52.584403 15365 leader_election.cc:290] T 43e93d3038f7496ebb18319420ab67e0 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967)
I20250830 07:54:52.585304 13619 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "43e93d3038f7496ebb18319420ab67e0" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:52.585898 13619 raft_consensus.cc:3058] T 0ceccc5f18294356894695fe08d73e30 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Advancing to term 1
W20250830 07:54:52.586767 13232 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 986878a23a0b47ee865e09277b027bb0 consensus state has no leader
I20250830 07:54:52.587136 13234 catalog_manager.cc:5864] Not sending DeleteTablet requests; no consensus state for tablet 19114685516b487e966b2b62ce634380
I20250830 07:54:52.587210 13882 tablet_bootstrap.cc:492] T 74ea2298876a4066b297915c135d4618 P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:54:52.588984 13882 tablet_bootstrap.cc:654] T 74ea2298876a4066b297915c135d4618 P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
W20250830 07:54:52.589254 13703 leader_election.cc:343] T 43e93d3038f7496ebb18319420ab67e0 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:52.602149 13232 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_121c000db61e4a7cb68990176b0a09da"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:52.602597 13232 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_121c000db61e4a7cb68990176b0a09da in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:52.603693 13231 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_812995c9d8ac47a89a232b73ff63ed59" } modify_external_catalogs: true
I20250830 07:54:52.603824 13231 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_812995c9d8ac47a89a232b73ff63ed59" } modify_external_catalogs: true
I20250830 07:54:52.604856 13887 tablet_bootstrap.cc:492] T 6251a06d1efe44e38d35d962c468f8b2 P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:54:52.606067 13887 ts_tablet_manager.cc:1397] T 6251a06d1efe44e38d35d962c468f8b2 P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.048s user 0.000s sys 0.003s
I20250830 07:54:52.606663 13887 raft_consensus.cc:357] T 6251a06d1efe44e38d35d962c468f8b2 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:52.606817 13887 raft_consensus.cc:383] T 6251a06d1efe44e38d35d962c468f8b2 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:52.606870 13887 raft_consensus.cc:738] T 6251a06d1efe44e38d35d962c468f8b2 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:54:52.607118 13887 consensus_queue.cc:260] T 6251a06d1efe44e38d35d962c468f8b2 P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:52.607688 13887 ts_tablet_manager.cc:1428] T 6251a06d1efe44e38d35d962c468f8b2 P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20250830 07:54:52.607923 13887 tablet_bootstrap.cc:492] T 52e910677ae34630a919d1d3f21b7e83 P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
W20250830 07:54:52.608945 13234 catalog_manager.cc:5415] Ignoring report from unknown tablet f398e12cd9f543738d5163354f8a9d9d
W20250830 07:54:52.609002 13234 catalog_manager.cc:5415] Ignoring report from unknown tablet 042fd7ff08fc4695b87bb8f9d225ef12
W20250830 07:54:52.609027 13234 catalog_manager.cc:5415] Ignoring report from unknown tablet d1bf58d367f54ba8bad64887b9a8d9cc
I20250830 07:54:52.609413 13887 tablet_bootstrap.cc:654] T 52e910677ae34630a919d1d3f21b7e83 P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:52.609403 13234 catalog_manager.cc:5674] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743) does not have the latest schema for tablet 410b1e2d520c470eb4b9ab60104e0cd4 (table default.Table_98c8314f6ad34324b9f857226d762d7d [id=6a8f7192d53441c383824fb67bed40df]). Expected version 1 got 0
W20250830 07:54:52.614478 13234 catalog_manager.cc:5415] Ignoring report from unknown tablet 97d49a1f600f4c13a4aafca99cedabe8
I20250830 07:54:52.620116 13233 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_269db21294114833bfa217979ad3ba29"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:52.622148 13233 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_269db21294114833bfa217979ad3ba29 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250830 07:54:52.622553 13234 catalog_manager.cc:5415] Ignoring report from unknown tablet de3a52a8e08a45808373902a0185e6f0
I20250830 07:54:52.623129 13226 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet 122bec4220c74dfaa8228f6d153cd50e
I20250830 07:54:52.623525 13226 catalog_manager.cc:6652] ReplaceTablet: tablet 122bec4220c74dfaa8228f6d153cd50e deleted and replaced by tablet 6aa038743d0c4aff9c0a02fea15ca7be
I20250830 07:54:52.623805 13226 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_e260a44af0d642ba8a6d4aa534da9976"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:52.624243 13226 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e260a44af0d642ba8a6d4aa534da9976 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250830 07:54:52.625484 13230 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet bbe66fc62de74dfe823e0a66ad297142 consensus state has no leader
I20250830 07:54:52.625767 13230 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_cb95c5e3dc364fe791a61a2053ed833b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:52.626166 13230 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_cb95c5e3dc364fe791a61a2053ed833b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:52.627628 13593 tablet_service.cc:1515] Processing DeleteTablet for tablet 122bec4220c74dfaa8228f6d153cd50e with delete_type TABLET_DATA_DELETED (replaced by tablet 6aa038743d0c4aff9c0a02fea15ca7be) from {username='slave'} at 127.0.0.1:45306
W20250830 07:54:52.628425 13220 catalog_manager.cc:4908] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet 122bec4220c74dfaa8228f6d153cd50e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 122bec4220c74dfaa8228f6d153cd50e already in progress: creating tablet
W20250830 07:54:52.631006 13703 consensus_peers.cc:489] T ca959e42c8764eeba0faee96caf8b39f P 9b057ade5dce45af9f8bf0bedf8b917f -> Peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Couldn't send request to peer 6b5e454d98894637b466ea27f1b647f9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20250830 07:54:52.631655 13703 consensus_peers.cc:489] T 28c2f7a3a6dd444585f0f5d337b985e9 P 9b057ade5dce45af9f8bf0bedf8b917f -> Peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Couldn't send request to peer 6b5e454d98894637b466ea27f1b647f9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20250830 07:54:52.631973 13703 consensus_peers.cc:489] T 95b6f084eb5240ea94c125eaa154ac9f P 9b057ade5dce45af9f8bf0bedf8b917f -> Peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Couldn't send request to peer 6b5e454d98894637b466ea27f1b647f9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20250830 07:54:52.648289 15115 raft_consensus.cc:491] T 689b4fee1dd04b3d9ccdea334b0f6b59 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:52.648517 15115 raft_consensus.cc:513] T 689b4fee1dd04b3d9ccdea334b0f6b59 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:52.649196 15115 leader_election.cc:290] T 689b4fee1dd04b3d9ccdea334b0f6b59 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:52.651759 13234 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_9d575bc5f1cd4a498ebc95b8b34c51ef" } modify_external_catalogs: true
I20250830 07:54:52.652817 13234 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_9d575bc5f1cd4a498ebc95b8b34c51ef" } modify_external_catalogs: true
I20250830 07:54:52.653440 13882 tablet_bootstrap.cc:492] T 74ea2298876a4066b297915c135d4618 P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:54:52.653548 13882 ts_tablet_manager.cc:1397] T 74ea2298876a4066b297915c135d4618 P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.066s user 0.005s sys 0.001s
I20250830 07:54:52.654126 13882 raft_consensus.cc:357] T 74ea2298876a4066b297915c135d4618 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:52.654279 13882 raft_consensus.cc:383] T 74ea2298876a4066b297915c135d4618 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:52.654321 13882 raft_consensus.cc:738] T 74ea2298876a4066b297915c135d4618 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:54:52.654544 13882 consensus_queue.cc:260] T 74ea2298876a4066b297915c135d4618 P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:52.655551 13882 ts_tablet_manager.cc:1428] T 74ea2298876a4066b297915c135d4618 P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20250830 07:54:52.657140 15365 raft_consensus.cc:491] T e6060a3dc6444483b8fb2944b8090cb6 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:52.657258 15365 raft_consensus.cc:513] T e6060a3dc6444483b8fb2944b8090cb6 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:52.657779 15365 leader_election.cc:290] T e6060a3dc6444483b8fb2944b8090cb6 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967)
I20250830 07:54:52.662367 13612 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "689b4fee1dd04b3d9ccdea334b0f6b59" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:52.662616 13619 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "e6060a3dc6444483b8fb2944b8090cb6" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
W20250830 07:54:52.663261 13423 leader_election.cc:343] T 689b4fee1dd04b3d9ccdea334b0f6b59 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
W20250830 07:54:52.664431 13703 leader_election.cc:343] T e6060a3dc6444483b8fb2944b8090cb6 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:52.665253 13882 tablet_bootstrap.cc:492] T de3a52a8e08a45808373902a0185e6f0 P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:54:52.666642 13882 tablet_bootstrap.cc:654] T de3a52a8e08a45808373902a0185e6f0 P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
W20250830 07:54:52.680547 13225 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d05f9a73ccb246828e58e1914aa22b95 has no consensus state
I20250830 07:54:52.680883 13227 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet 835bb0ae1a49413a9d510fd1b518ae01
I20250830 07:54:52.681689 13231 catalog_manager.cc:5864] Not sending DeleteTablet requests; no consensus state for tablet 10065e3a4ec34708a36a790b0f0ff9f3
W20250830 07:54:52.682389 13229 catalog_manager.cc:5415] Ignoring report from unknown tablet 97d49a1f600f4c13a4aafca99cedabe8
W20250830 07:54:52.685256 13703 consensus_peers.cc:489] T ff72a0fd9a0e46a6bd54a15e4ad783b4 P 9b057ade5dce45af9f8bf0bedf8b917f -> Peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Couldn't send request to peer 6b5e454d98894637b466ea27f1b647f9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20250830 07:54:52.692531 13229 catalog_manager.cc:5415] Ignoring report from unknown tablet 1fa571e9490e499792225d7b786e8658
I20250830 07:54:52.686131 13593 tablet_service.cc:1515] Processing DeleteTablet for tablet 835bb0ae1a49413a9d510fd1b518ae01 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:52 UTC) from {username='slave'} at 127.0.0.1:45306
W20250830 07:54:52.703596 13220 catalog_manager.cc:4908] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet 835bb0ae1a49413a9d510fd1b518ae01 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 835bb0ae1a49413a9d510fd1b518ae01 already in progress: creating tablet
I20250830 07:54:52.704141 15245 raft_consensus.cc:2802] T 62ee2d0fbd774d38a4a4c4a033584ef9 P 9b057ade5dce45af9f8bf0bedf8b917f [term 2 FOLLOWER]: Leader election won for term 2
I20250830 07:54:52.704283 15245 raft_consensus.cc:695] T 62ee2d0fbd774d38a4a4c4a033584ef9 P 9b057ade5dce45af9f8bf0bedf8b917f [term 2 LEADER]: Becoming Leader. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Running, Role: LEADER
I20250830 07:54:52.704501 15245 consensus_queue.cc:237] T 62ee2d0fbd774d38a4a4c4a033584ef9 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:52.706518 13886 tablet_bootstrap.cc:492] T 3bb48fce24074a8e8ec99d3172a655d8 P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:54:52.706677 13886 ts_tablet_manager.cc:1397] T 3bb48fce24074a8e8ec99d3172a655d8 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.181s user 0.029s sys 0.029s
I20250830 07:54:52.707718 13886 raft_consensus.cc:357] T 3bb48fce24074a8e8ec99d3172a655d8 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:52.707872 13886 raft_consensus.cc:383] T 3bb48fce24074a8e8ec99d3172a655d8 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:52.707923 13886 raft_consensus.cc:738] T 3bb48fce24074a8e8ec99d3172a655d8 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:54:52.708117 13886 consensus_queue.cc:260] T 3bb48fce24074a8e8ec99d3172a655d8 P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:52.708599 13886 ts_tablet_manager.cc:1428] T 3bb48fce24074a8e8ec99d3172a655d8 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20250830 07:54:52.708922 13886 tablet_bootstrap.cc:492] T 91705fc35a1b4977b89bac1765c886c0 P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:54:52.710615 13886 tablet_bootstrap.cc:654] T 91705fc35a1b4977b89bac1765c886c0 P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:52.713526 13229 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_7c1a9d881689485e8b9394de74535821"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:52.714006 13229 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7c1a9d881689485e8b9394de74535821 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:52.720204 15339 raft_consensus.cc:491] T 087bb1e80d2d44bf8619b0341ff99527 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:52.720337 15339 raft_consensus.cc:513] T 087bb1e80d2d44bf8619b0341ff99527 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:52.720865 15339 leader_election.cc:290] T 087bb1e80d2d44bf8619b0341ff99527 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967)
I20250830 07:54:52.722167 13617 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "087bb1e80d2d44bf8619b0341ff99527" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
W20250830 07:54:52.722632 13703 leader_election.cc:343] T 087bb1e80d2d44bf8619b0341ff99527 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:52.723459 13820 heartbeater.cc:344] Connected to a master server at 127.12.209.60:43889
W20250830 07:54:52.723829 13701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.209.1:45325, user_credentials={real_user=slave}} blocked reactor thread for 183047us
I20250830 07:54:52.724867 13887 tablet_bootstrap.cc:492] T 52e910677ae34630a919d1d3f21b7e83 P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:54:52.728264 13234 catalog_manager.cc:5864] Not sending DeleteTablet requests; no consensus state for tablet adfa603fd1044444811999617971ae9e
W20250830 07:54:52.729887 13703 consensus_peers.cc:489] T a8baad9c419e436b9659d8d5582d4066 P 9b057ade5dce45af9f8bf0bedf8b917f -> Peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Couldn't send request to peer 6b5e454d98894637b466ea27f1b647f9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20250830 07:54:52.737576 13703 consensus_peers.cc:489] T 519b3e58b63b402d84e234f5e180b98c P 9b057ade5dce45af9f8bf0bedf8b917f -> Peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Couldn't send request to peer 6b5e454d98894637b466ea27f1b647f9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20250830 07:54:52.740312 13882 tablet_bootstrap.cc:492] T de3a52a8e08a45808373902a0185e6f0 P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:54:52.740486 13882 ts_tablet_manager.cc:1397] T de3a52a8e08a45808373902a0185e6f0 P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.075s user 0.002s sys 0.002s
I20250830 07:54:52.741252 13882 raft_consensus.cc:357] T de3a52a8e08a45808373902a0185e6f0 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:52.741526 13882 raft_consensus.cc:383] T de3a52a8e08a45808373902a0185e6f0 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:52.741627 13882 raft_consensus.cc:738] T de3a52a8e08a45808373902a0185e6f0 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:54:52.741875 13882 consensus_queue.cc:260] T de3a52a8e08a45808373902a0185e6f0 P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:52.743018 13882 ts_tablet_manager.cc:1428] T de3a52a8e08a45808373902a0185e6f0 P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20250830 07:54:52.746466 13486 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "43e93d3038f7496ebb18319420ab67e0" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:54:52.751591 15245 raft_consensus.cc:491] T ef1ab62a5b7845e58d50f34206eaaa27 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:52.751749 13882 tablet_bootstrap.cc:492] T ff72a0fd9a0e46a6bd54a15e4ad783b4 P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:54:52.751729 15245 raft_consensus.cc:513] T ef1ab62a5b7845e58d50f34206eaaa27 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:52.752380 15245 leader_election.cc:290] T ef1ab62a5b7845e58d50f34206eaaa27 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967)
W20250830 07:54:52.752650 13703 consensus_peers.cc:489] T 70703eb1d47841a1a227e277ed6a268d P 9b057ade5dce45af9f8bf0bedf8b917f -> Peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Couldn't send request to peer 6b5e454d98894637b466ea27f1b647f9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20250830 07:54:52.753041 13617 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "ef1ab62a5b7845e58d50f34206eaaa27" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
W20250830 07:54:52.753784 13703 leader_election.cc:343] T ef1ab62a5b7845e58d50f34206eaaa27 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:52.755932 13766 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "8dddcfe56522436287aea212e316a729" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f"
I20250830 07:54:52.756074 13617 raft_consensus.cc:3058] T de3a52a8e08a45808373902a0185e6f0 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:52.756095 13766 raft_consensus.cc:3058] T 8dddcfe56522436287aea212e316a729 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Advancing to term 2
I20250830 07:54:52.758572 13766 raft_consensus.cc:2466] T 8dddcfe56522436287aea212e316a729 P 9b057ade5dce45af9f8bf0bedf8b917f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2065c332f15a4739899af79f3669c3ba in term 2.
I20250830 07:54:52.761006 13619 raft_consensus.cc:3058] T 3525652a73b8413b8ccbcb5824cc5880 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:52.763413 13233 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_fd5ae3d5b77b4b5eb094912087eb1b26" } new_table_name: "default.Table_c8691380fb7546fdbf2b7e92ec777cbd" modify_external_catalogs: true
W20250830 07:54:52.763550 13229 catalog_manager.cc:5415] Ignoring report from unknown tablet d1bf58d367f54ba8bad64887b9a8d9cc
I20250830 07:54:52.769702 13487 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "e6060a3dc6444483b8fb2944b8090cb6" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:54:52.769883 13487 raft_consensus.cc:2466] T e6060a3dc6444483b8fb2944b8090cb6 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 0.
I20250830 07:54:52.770200 13486 raft_consensus.cc:2466] T 43e93d3038f7496ebb18319420ab67e0 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 0.
I20250830 07:54:52.771584 13483 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "087bb1e80d2d44bf8619b0341ff99527" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:54:52.771741 13886 tablet_bootstrap.cc:492] T 91705fc35a1b4977b89bac1765c886c0 P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:54:52.771735 13483 raft_consensus.cc:2466] T 087bb1e80d2d44bf8619b0341ff99527 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 0.
I20250830 07:54:52.771849 13886 ts_tablet_manager.cc:1397] T 91705fc35a1b4977b89bac1765c886c0 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.063s user 0.008s sys 0.012s
I20250830 07:54:52.774945 13887 ts_tablet_manager.cc:1397] T 52e910677ae34630a919d1d3f21b7e83 P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.143s user 0.006s sys 0.002s
I20250830 07:54:52.774170 13886 raft_consensus.cc:357] T 91705fc35a1b4977b89bac1765c886c0 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:52.775105 13886 raft_consensus.cc:383] T 91705fc35a1b4977b89bac1765c886c0 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:52.775179 13886 raft_consensus.cc:738] T 91705fc35a1b4977b89bac1765c886c0 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:54:52.775839 13887 raft_consensus.cc:357] T 52e910677ae34630a919d1d3f21b7e83 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:52.776070 13887 raft_consensus.cc:383] T 52e910677ae34630a919d1d3f21b7e83 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:52.776187 13887 raft_consensus.cc:738] T 52e910677ae34630a919d1d3f21b7e83 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:54:52.776141 13886 consensus_queue.cc:260] T 91705fc35a1b4977b89bac1765c886c0 P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:52.778378 13886 ts_tablet_manager.cc:1428] T 91705fc35a1b4977b89bac1765c886c0 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.006s user 0.001s sys 0.001s
I20250830 07:54:52.778656 13886 tablet_bootstrap.cc:492] T db4077bf8e184ac5809ef629222f2cc5 P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:54:52.779460 13771 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "689b4fee1dd04b3d9ccdea334b0f6b59" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:52.778612 13887 consensus_queue.cc:260] T 52e910677ae34630a919d1d3f21b7e83 P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:52.782640 13886 tablet_bootstrap.cc:654] T db4077bf8e184ac5809ef629222f2cc5 P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:52.786079 13231 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_2e04b6c5e32b45cca8fa0c57d41eacbb" } modify_external_catalogs: true
I20250830 07:54:52.786265 13231 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_2e04b6c5e32b45cca8fa0c57d41eacbb" } modify_external_catalogs: true
I20250830 07:54:52.786731 13887 ts_tablet_manager.cc:1428] T 52e910677ae34630a919d1d3f21b7e83 P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.012s user 0.001s sys 0.000s
I20250830 07:54:52.787801 13232 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_8dce2383bd0a44fdae5651b85ae26dbc"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:52.788379 13232 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8dce2383bd0a44fdae5651b85ae26dbc in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:52.789371 13887 tablet_bootstrap.cc:492] T db7144b25ff34bed8c7b779ba9497ef4 P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:54:52.789712 13226 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_9496092ee37348cebec93de7bbe38ee3" } new_table_name: "default.Table_0bd285757a6146eabc2053757f950a0f" modify_external_catalogs: true
I20250830 07:54:52.791236 13882 tablet_bootstrap.cc:654] T ff72a0fd9a0e46a6bd54a15e4ad783b4 P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:52.794797 13887 tablet_bootstrap.cc:654] T db7144b25ff34bed8c7b779ba9497ef4 P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
W20250830 07:54:52.795173 13233 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f4d87048a4a44eb8ad5c818a129180c9 has no consensus state
I20250830 07:54:52.796905 13225 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_cff60520ee6942269d4b80f84cf356c1" } modify_external_catalogs: true
I20250830 07:54:52.797046 13225 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_cff60520ee6942269d4b80f84cf356c1" } modify_external_catalogs: true
I20250830 07:54:52.798187 13230 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_9f8bb2afedee4eab8d1e58c9b97d8c28"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250830 07:54:52.799019 13233 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_73e8585b02314403984ee9385f37f7dc" } new_table_name: "default.Table_2304149d09f64828bcefc26abbe8457e" modify_external_catalogs: true
W20250830 07:54:52.801533 13226 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 53b439ae9c434041a65420391df79d6b has no consensus state
I20250830 07:54:52.801945 13231 catalog_manager.cc:5864] Not sending DeleteTablet requests; no consensus state for tablet 4ebcf798f7174742b033c714cf2a17ab
I20250830 07:54:52.808229 13227 catalog_manager.cc:5674] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325) does not have the latest schema for tablet 52e910677ae34630a919d1d3f21b7e83 (table default.Table_96df3a05fc564aba9ae2d0e0f1e94abb [id=b3fced981b2a4b44a8eab43675699ba5]). Expected version 1 got 0
W20250830 07:54:52.808363 13230 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9f8bb2afedee4eab8d1e58c9b97d8c28 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:52.808607 13229 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_9cf9a577c6bb40d0847b00f66c9f9256"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:52.810443 13229 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9cf9a577c6bb40d0847b00f66c9f9256 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250830 07:54:52.810592 13703 consensus_peers.cc:489] T d37fe59b4f964f30bb1ed4cb00868b75 P 9b057ade5dce45af9f8bf0bedf8b917f -> Peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Couldn't send request to peer 6b5e454d98894637b466ea27f1b647f9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20250830 07:54:52.812387 13225 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet f332d1b56d924c91a79cf6572dea1cd2
W20250830 07:54:52.813025 13703 consensus_peers.cc:489] T 13df49c2c2cd4e5cae26a540835b74c9 P 9b057ade5dce45af9f8bf0bedf8b917f -> Peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Couldn't send request to peer 6b5e454d98894637b466ea27f1b647f9. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 13df49c2c2cd4e5cae26a540835b74c9. This is attempt 1: this message will repeat every 5th retry.
I20250830 07:54:52.813875 13593 tablet_service.cc:1515] Processing DeleteTablet for tablet f332d1b56d924c91a79cf6572dea1cd2 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:52 UTC) from {username='slave'} at 127.0.0.1:45306
W20250830 07:54:52.814847 13220 catalog_manager.cc:4908] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet f332d1b56d924c91a79cf6572dea1cd2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f332d1b56d924c91a79cf6572dea1cd2 already in progress: creating tablet
W20250830 07:54:52.822045 13233 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 529383a22e6341dcb85b7b001a54ec96 has no consensus state
I20250830 07:54:52.825599 13886 tablet_bootstrap.cc:492] T db4077bf8e184ac5809ef629222f2cc5 P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:54:52.825747 13886 ts_tablet_manager.cc:1397] T db4077bf8e184ac5809ef629222f2cc5 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.047s user 0.004s sys 0.000s
W20250830 07:54:52.830345 13233 catalog_manager.cc:5415] Ignoring report from unknown tablet d1bf58d367f54ba8bad64887b9a8d9cc
I20250830 07:54:52.830416 15339 consensus_queue.cc:1035] T a8baad9c419e436b9659d8d5582d4066 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:54:52.830966 13233 catalog_manager.cc:5674] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743) does not have the latest schema for tablet 91705fc35a1b4977b89bac1765c886c0 (table default.Table_4f53e333521540848fc99c0bf37c1639 [id=48089766c3514336991a5ada71b03dd0]). Expected version 1 got 0
I20250830 07:54:52.831189 13225 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_a3e896cc4e73408889eef5912ca3a88b" } new_table_name: "default.Table_e3b4cbde7b4842cca80dc361162cc937" modify_external_catalogs: true
I20250830 07:54:52.832422 13886 raft_consensus.cc:357] T db4077bf8e184ac5809ef629222f2cc5 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:52.832549 13886 raft_consensus.cc:383] T db4077bf8e184ac5809ef629222f2cc5 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:52.832587 13886 raft_consensus.cc:738] T db4077bf8e184ac5809ef629222f2cc5 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:54:52.832724 13886 consensus_queue.cc:260] T db4077bf8e184ac5809ef629222f2cc5 P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:52.833173 13886 ts_tablet_manager.cc:1428] T db4077bf8e184ac5809ef629222f2cc5 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.007s user 0.001s sys 0.001s
I20250830 07:54:52.839759 15245 consensus_queue.cc:1035] T 70703eb1d47841a1a227e277ed6a268d P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:54:52.840699 15245 consensus_queue.cc:1035] T 95b6f084eb5240ea94c125eaa154ac9f P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20250830 07:54:52.841542 13701 consensus_peers.cc:489] T 1fa571e9490e499792225d7b786e8658 P 9b057ade5dce45af9f8bf0bedf8b917f -> Peer 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): Couldn't send request to peer 2065c332f15a4739899af79f3669c3ba. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1fa571e9490e499792225d7b786e8658. This is attempt 6: this message will repeat every 5th retry.
I20250830 07:54:52.841750 13701 leader_election.cc:304] T e6060a3dc6444483b8fb2944b8090cb6 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:54:52.842072 15245 raft_consensus.cc:2802] T e6060a3dc6444483b8fb2944b8090cb6 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:54:52.842140 15245 raft_consensus.cc:491] T e6060a3dc6444483b8fb2944b8090cb6 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:54:52.842197 15245 raft_consensus.cc:3058] T e6060a3dc6444483b8fb2944b8090cb6 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:52.843863 13230 catalog_manager.cc:5674] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325) does not have the latest schema for tablet 52e910677ae34630a919d1d3f21b7e83 (table default.Table_96df3a05fc564aba9ae2d0e0f1e94abb [id=b3fced981b2a4b44a8eab43675699ba5]). Expected version 1 got 0
I20250830 07:54:52.845278 15245 raft_consensus.cc:513] T e6060a3dc6444483b8fb2944b8090cb6 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:52.845999 15245 leader_election.cc:290] T e6060a3dc6444483b8fb2944b8090cb6 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Requested vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967)
I20250830 07:54:52.846480 13612 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "e6060a3dc6444483b8fb2944b8090cb6" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9"
W20250830 07:54:52.847102 13703 leader_election.cc:343] T e6060a3dc6444483b8fb2944b8090cb6 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
W20250830 07:54:52.827311 13423 consensus_peers.cc:489] T 3c3c798b2b7b460b98a30605464763e6 P 2065c332f15a4739899af79f3669c3ba -> Peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Couldn't send request to peer 6b5e454d98894637b466ea27f1b647f9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20250830 07:54:52.849650 13886 tablet_bootstrap.cc:492] T 3c9dd258e6be47f68e039e4cdcd899b2 P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:54:52.851527 13886 tablet_bootstrap.cc:654] T 3c9dd258e6be47f68e039e4cdcd899b2 P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:52.853184 13229 master_service.cc:948] ReplaceTablet: received request to replace tablet a8660a6ff9254d4f9f0ef047b8682ed1 from {username='slave'} at 127.0.0.1:42126
I20250830 07:54:52.857878 15245 consensus_queue.cc:1035] T 28c2f7a3a6dd444585f0f5d337b985e9 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:54:52.858495 13701 leader_election.cc:304] T 43e93d3038f7496ebb18319420ab67e0 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:54:52.858791 15245 raft_consensus.cc:2802] T 43e93d3038f7496ebb18319420ab67e0 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:54:52.858893 15245 raft_consensus.cc:491] T 43e93d3038f7496ebb18319420ab67e0 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:54:52.859058 15245 raft_consensus.cc:3058] T 43e93d3038f7496ebb18319420ab67e0 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:52.859709 13887 tablet_bootstrap.cc:492] T db7144b25ff34bed8c7b779ba9497ef4 P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:54:52.859863 13887 ts_tablet_manager.cc:1397] T db7144b25ff34bed8c7b779ba9497ef4 P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.071s user 0.002s sys 0.001s
I20250830 07:54:52.860991 13887 raft_consensus.cc:357] T db7144b25ff34bed8c7b779ba9497ef4 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:52.861184 13887 raft_consensus.cc:383] T db7144b25ff34bed8c7b779ba9497ef4 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:52.861270 13887 raft_consensus.cc:738] T db7144b25ff34bed8c7b779ba9497ef4 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:54:52.862287 15245 raft_consensus.cc:513] T 43e93d3038f7496ebb18319420ab67e0 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:52.863569 15245 leader_election.cc:290] T 43e93d3038f7496ebb18319420ab67e0 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Requested vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967)
I20250830 07:54:52.863984 13701 leader_election.cc:304] T 087bb1e80d2d44bf8619b0341ff99527 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:54:52.864454 15339 raft_consensus.cc:2802] T 087bb1e80d2d44bf8619b0341ff99527 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:54:52.864566 15339 raft_consensus.cc:491] T 087bb1e80d2d44bf8619b0341ff99527 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:54:52.864624 13886 tablet_bootstrap.cc:492] T 3c9dd258e6be47f68e039e4cdcd899b2 P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:54:52.864740 15339 raft_consensus.cc:3058] T 087bb1e80d2d44bf8619b0341ff99527 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:52.864774 13886 ts_tablet_manager.cc:1397] T 3c9dd258e6be47f68e039e4cdcd899b2 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.015s user 0.000s sys 0.004s
I20250830 07:54:52.867396 15339 raft_consensus.cc:513] T 087bb1e80d2d44bf8619b0341ff99527 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:52.868039 15339 leader_election.cc:290] T 087bb1e80d2d44bf8619b0341ff99527 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Requested vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967)
I20250830 07:54:52.868886 13487 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "ef1ab62a5b7845e58d50f34206eaaa27" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:54:52.869092 13487 raft_consensus.cc:2466] T ef1ab62a5b7845e58d50f34206eaaa27 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 0.
I20250830 07:54:52.870365 13886 raft_consensus.cc:357] T 3c9dd258e6be47f68e039e4cdcd899b2 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:52.870529 13886 raft_consensus.cc:383] T 3c9dd258e6be47f68e039e4cdcd899b2 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:52.870581 13886 raft_consensus.cc:738] T 3c9dd258e6be47f68e039e4cdcd899b2 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:54:52.870720 13422 leader_election.cc:304] T 8dddcfe56522436287aea212e316a729 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:54:52.870738 13886 consensus_queue.cc:260] T 3c9dd258e6be47f68e039e4cdcd899b2 P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:52.871019 15009 raft_consensus.cc:2802] T 8dddcfe56522436287aea212e316a729 P 2065c332f15a4739899af79f3669c3ba [term 2 FOLLOWER]: Leader election won for term 2
I20250830 07:54:52.871133 15009 raft_consensus.cc:695] T 8dddcfe56522436287aea212e316a729 P 2065c332f15a4739899af79f3669c3ba [term 2 LEADER]: Becoming Leader. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Running, Role: LEADER
I20250830 07:54:52.871265 13886 ts_tablet_manager.cc:1428] T 3c9dd258e6be47f68e039e4cdcd899b2 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.006s user 0.001s sys 0.000s
I20250830 07:54:52.871362 15245 raft_consensus.cc:491] T 3bb48fce24074a8e8ec99d3172a655d8 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:52.871393 15009 consensus_queue.cc:237] T 8dddcfe56522436287aea212e316a729 P 2065c332f15a4739899af79f3669c3ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:52.871474 15245 raft_consensus.cc:513] T 3bb48fce24074a8e8ec99d3172a655d8 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:52.872076 15245 leader_election.cc:290] T 3bb48fce24074a8e8ec99d3172a655d8 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967)
W20250830 07:54:52.873896 13422 leader_election.cc:343] T 689b4fee1dd04b3d9ccdea334b0f6b59 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:52.874097 13422 leader_election.cc:304] T 689b4fee1dd04b3d9ccdea334b0f6b59 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba; no voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:54:52.874405 15412 raft_consensus.cc:2747] T 689b4fee1dd04b3d9ccdea334b0f6b59 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:54:52.875087 15412 consensus_queue.cc:1035] T 3c3c798b2b7b460b98a30605464763e6 P 2065c332f15a4739899af79f3669c3ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20250830 07:54:52.875811 13225 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a0cf1de8485941eb8a557a6e2f783047 consensus state has no leader
I20250830 07:54:52.876502 15412 consensus_queue.cc:1035] T 057bcce2860345da860acc262dc4d339 P 2065c332f15a4739899af79f3669c3ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:54:52.881862 13886 tablet_bootstrap.cc:492] T 49165f0001044d72b68263a60ef56457 P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:54:52.884194 13886 tablet_bootstrap.cc:654] T 49165f0001044d72b68263a60ef56457 P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:52.885530 13225 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_23d20e572ed14d72947c039cbed88eb2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:52.886097 13225 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_23d20e572ed14d72947c039cbed88eb2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:52.887272 13229 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_9af3c1635b114fb6aa1532fa16998dd2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250830 07:54:52.887347 13610 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "43e93d3038f7496ebb18319420ab67e0" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9"
W20250830 07:54:52.887678 13229 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9af3c1635b114fb6aa1532fa16998dd2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:52.888988 13612 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "087bb1e80d2d44bf8619b0341ff99527" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9"
I20250830 07:54:52.889276 13232 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_cd8e40951aea4b65bfb67ac183f399de"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250830 07:54:52.889353 13230 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_c6ae99ff685c419c85e78e738f8a077e" } new_table_name: "default.Table_c8ae99834e3f4804aad49e8e527dbdcf" modify_external_catalogs: true
W20250830 07:54:52.889701 13232 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_cd8e40951aea4b65bfb67ac183f399de in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:52.870860 13887 consensus_queue.cc:260] T db7144b25ff34bed8c7b779ba9497ef4 P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:52.890578 13233 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_23a80551e20d428a8445437be69cffb5" } modify_external_catalogs: true
I20250830 07:54:52.890705 13233 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_23a80551e20d428a8445437be69cffb5" } modify_external_catalogs: true
I20250830 07:54:52.891129 13887 ts_tablet_manager.cc:1428] T db7144b25ff34bed8c7b779ba9497ef4 P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.031s user 0.001s sys 0.001s
I20250830 07:54:52.891402 13887 tablet_bootstrap.cc:492] T f5baa35307a1425c8d52666d130d6d8a P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
W20250830 07:54:52.892050 13220 catalog_manager.cc:4726] Async tablet task AlterTable RPC for tablet d05f9a73ccb246828e58e1914aa22b95 (table default.Table_0e124eb0d1ae42beb445b3ba5edc7b76 [id=b0dca751a8bd40b4b10b2ec3d438fa99], current schema version=2) failed: Not found: failed to reset TS proxy: No leader found: Tablet d05f9a73ccb246828e58e1914aa22b95 has no consensus state
W20250830 07:54:52.892546 13703 leader_election.cc:343] T 43e93d3038f7496ebb18319420ab67e0 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:52.892580 15237 raft_consensus.cc:491] T 02be33dc658d428fa55e59784a2342f6 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:52.892702 15237 raft_consensus.cc:513] T 02be33dc658d428fa55e59784a2342f6 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
W20250830 07:54:52.892777 13703 leader_election.cc:343] T 087bb1e80d2d44bf8619b0341ff99527 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:52.893244 15237 leader_election.cc:290] T 02be33dc658d428fa55e59784a2342f6 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:52.893369 13887 tablet_bootstrap.cc:654] T f5baa35307a1425c8d52666d130d6d8a P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
W20250830 07:54:52.894022 13561 leader_election.cc:343] T 02be33dc658d428fa55e59784a2342f6 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): Not found: Tablet not found: 02be33dc658d428fa55e59784a2342f6
I20250830 07:54:52.893937 13227 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_9805da1e797d4d098781c5ca9fcf8de8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:52.894393 13227 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9805da1e797d4d098781c5ca9fcf8de8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:52.895373 13234 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_423718714b4c41f394a8af89b1a82ff3" } modify_external_catalogs: true
I20250830 07:54:52.895555 13234 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_423718714b4c41f394a8af89b1a82ff3" } modify_external_catalogs: true
I20250830 07:54:52.895839 13882 tablet_bootstrap.cc:492] T ff72a0fd9a0e46a6bd54a15e4ad783b4 P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:54:52.895964 13882 ts_tablet_manager.cc:1397] T ff72a0fd9a0e46a6bd54a15e4ad783b4 P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.144s user 0.006s sys 0.002s
I20250830 07:54:52.897454 13610 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "3bb48fce24074a8e8ec99d3172a655d8" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
W20250830 07:54:52.899636 13703 leader_election.cc:343] T 3bb48fce24074a8e8ec99d3172a655d8 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
W20250830 07:54:52.902360 13562 leader_election.cc:343] T 02be33dc658d428fa55e59784a2342f6 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Not found: Tablet not found: 02be33dc658d428fa55e59784a2342f6
I20250830 07:54:52.902576 13882 raft_consensus.cc:357] T ff72a0fd9a0e46a6bd54a15e4ad783b4 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:52.902733 13882 raft_consensus.cc:383] T ff72a0fd9a0e46a6bd54a15e4ad783b4 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:52.902793 13882 raft_consensus.cc:738] T ff72a0fd9a0e46a6bd54a15e4ad783b4 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:54:52.902928 13562 leader_election.cc:304] T 02be33dc658d428fa55e59784a2342f6 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b5e454d98894637b466ea27f1b647f9; no voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:54:52.903465 15237 raft_consensus.cc:2747] T 02be33dc658d428fa55e59784a2342f6 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:54:52.902988 13882 consensus_queue.cc:260] T ff72a0fd9a0e46a6bd54a15e4ad783b4 P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
W20250830 07:54:52.914093 13229 catalog_manager.cc:5415] Ignoring report from unknown tablet db4077bf8e184ac5809ef629222f2cc5
I20250830 07:54:52.914350 13674 heartbeater.cc:344] Connected to a master server at 127.12.209.60:43889
I20250830 07:54:52.915257 13229 catalog_manager.cc:5674] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743) does not have the latest schema for tablet 74891b8103e144c486750f64ba2003f4 (table default.Table_f898ce75325a436ca3a63a3c9e46fb68 [id=63f62da0ba61488791fcce76368d92a8]). Expected version 1 got 0
I20250830 07:54:52.918035 13480 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "e6060a3dc6444483b8fb2944b8090cb6" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba"
I20250830 07:54:52.918220 13480 raft_consensus.cc:3058] T e6060a3dc6444483b8fb2944b8090cb6 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:52.920996 13480 raft_consensus.cc:2466] T e6060a3dc6444483b8fb2944b8090cb6 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 1.
W20250830 07:54:52.921483 13230 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 2f3bec2c98574a9393e0fae77e228ce0 consensus state has no leader
I20250830 07:54:52.924301 13882 ts_tablet_manager.cc:1428] T ff72a0fd9a0e46a6bd54a15e4ad783b4 P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.028s user 0.002s sys 0.000s
I20250830 07:54:52.924566 13882 tablet_bootstrap.cc:492] T 8ae468b43b4c450ca7591b543c2539d9 P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:54:52.928566 13230 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_bf641d5daae74e52902c7fb5847d2c00"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:52.929208 13230 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bf641d5daae74e52902c7fb5847d2c00 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:52.930733 13225 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_cf20bfd85547402e8b8191449bd43a99" } modify_external_catalogs: true
I20250830 07:54:52.930948 13225 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_cf20bfd85547402e8b8191449bd43a99" } modify_external_catalogs: true
I20250830 07:54:52.942579 13231 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_5e1d8a69e0574504aa042a00171ba2c6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:52.943179 13231 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5e1d8a69e0574504aa042a00171ba2c6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:52.944703 13229 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_23974e2d53fb40b2a3a9eb3c40342288"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:52.945398 13229 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_23974e2d53fb40b2a3a9eb3c40342288 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:52.949929 13886 tablet_bootstrap.cc:492] T 49165f0001044d72b68263a60ef56457 P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:54:52.950151 13886 ts_tablet_manager.cc:1397] T 49165f0001044d72b68263a60ef56457 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.068s user 0.003s sys 0.001s
I20250830 07:54:52.950954 13886 raft_consensus.cc:357] T 49165f0001044d72b68263a60ef56457 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:52.951175 13886 raft_consensus.cc:383] T 49165f0001044d72b68263a60ef56457 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:52.951259 13886 raft_consensus.cc:738] T 49165f0001044d72b68263a60ef56457 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:54:52.951521 13886 consensus_queue.cc:260] T 49165f0001044d72b68263a60ef56457 P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:52.952008 13886 ts_tablet_manager.cc:1428] T 49165f0001044d72b68263a60ef56457 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20250830 07:54:52.952277 13886 tablet_bootstrap.cc:492] T ec47a59c22ff4370bd21bc2a18336049 P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:54:52.953891 13886 tablet_bootstrap.cc:654] T ec47a59c22ff4370bd21bc2a18336049 P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:52.961248 15009 raft_consensus.cc:491] T 7af74bdde363493f8061eba450ecf4b4 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6b5e454d98894637b466ea27f1b647f9)
I20250830 07:54:52.961393 15009 raft_consensus.cc:513] T 7af74bdde363493f8061eba450ecf4b4 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:52.961961 15009 leader_election.cc:290] T 7af74bdde363493f8061eba450ecf4b4 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:52.962096 13233 catalog_manager.cc:5864] Not sending DeleteTablet requests; no consensus state for tablet 1c00015209dd40898364d3c5bdc67198
I20250830 07:54:52.962169 13234 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet 9bc54e40f9eb4271aa3132986c249e51
I20250830 07:54:52.962828 13887 tablet_bootstrap.cc:492] T f5baa35307a1425c8d52666d130d6d8a P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:54:52.962983 13887 ts_tablet_manager.cc:1397] T f5baa35307a1425c8d52666d130d6d8a P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.072s user 0.003s sys 0.000s
I20250830 07:54:52.963464 13593 tablet_service.cc:1515] Processing DeleteTablet for tablet 9bc54e40f9eb4271aa3132986c249e51 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:52 UTC) from {username='slave'} at 127.0.0.1:45306
I20250830 07:54:52.963653 13887 raft_consensus.cc:357] T f5baa35307a1425c8d52666d130d6d8a P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:52.963805 13887 raft_consensus.cc:383] T f5baa35307a1425c8d52666d130d6d8a P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:52.963871 13887 raft_consensus.cc:738] T f5baa35307a1425c8d52666d130d6d8a P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:54:52.964064 13887 consensus_queue.cc:260] T f5baa35307a1425c8d52666d130d6d8a P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:52.964615 13887 ts_tablet_manager.cc:1428] T f5baa35307a1425c8d52666d130d6d8a P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20250830 07:54:52.964865 13887 tablet_bootstrap.cc:492] T 1520d7257f864ea4ba4b9a5d0443f8a7 P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:54:52.966295 13887 tablet_bootstrap.cc:654] T 1520d7257f864ea4ba4b9a5d0443f8a7 P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:52.969014 13225 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet 8c01157324ba45bda5b3a9a328bf319b
I20250830 07:54:52.969843 13593 tablet_service.cc:1515] Processing DeleteTablet for tablet 8c01157324ba45bda5b3a9a328bf319b with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:52 UTC) from {username='slave'} at 127.0.0.1:45306
I20250830 07:54:52.970511 13231 master_service.cc:948] ReplaceTablet: received request to replace tablet 208995abd6d44dbea3b5ebbea27d6a39 from {username='slave'} at 127.0.0.1:42126
I20250830 07:54:52.980065 13886 tablet_bootstrap.cc:492] T ec47a59c22ff4370bd21bc2a18336049 P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:54:52.980190 13886 ts_tablet_manager.cc:1397] T ec47a59c22ff4370bd21bc2a18336049 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.028s user 0.002s sys 0.000s
I20250830 07:54:52.981184 13886 raft_consensus.cc:357] T ec47a59c22ff4370bd21bc2a18336049 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:52.981331 13886 raft_consensus.cc:383] T ec47a59c22ff4370bd21bc2a18336049 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:52.981374 13886 raft_consensus.cc:738] T ec47a59c22ff4370bd21bc2a18336049 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:54:52.981513 13886 consensus_queue.cc:260] T ec47a59c22ff4370bd21bc2a18336049 P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:52.982050 13886 ts_tablet_manager.cc:1428] T ec47a59c22ff4370bd21bc2a18336049 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20250830 07:54:52.982285 13886 tablet_bootstrap.cc:492] T 713c12e1efec4e6f9895c65dc8a9c4b9 P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:54:52.984980 13886 tablet_bootstrap.cc:654] T 713c12e1efec4e6f9895c65dc8a9c4b9 P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:52.985942 13231 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet 208995abd6d44dbea3b5ebbea27d6a39
I20250830 07:54:52.986366 13231 catalog_manager.cc:6652] ReplaceTablet: tablet 208995abd6d44dbea3b5ebbea27d6a39 deleted and replaced by tablet d9a18967958046bc866a5883585507e5
I20250830 07:54:52.986855 13593 tablet_service.cc:1515] Processing DeleteTablet for tablet 208995abd6d44dbea3b5ebbea27d6a39 with delete_type TABLET_DATA_DELETED (replaced by tablet d9a18967958046bc866a5883585507e5) from {username='slave'} at 127.0.0.1:45306
I20250830 07:54:52.991045 15115 raft_consensus.cc:491] T 97d49a1f600f4c13a4aafca99cedabe8 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:52.991187 15115 raft_consensus.cc:513] T 97d49a1f600f4c13a4aafca99cedabe8 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:52.991662 15115 leader_election.cc:290] T 97d49a1f600f4c13a4aafca99cedabe8 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
W20250830 07:54:52.994145 13423 leader_election.cc:343] T 7af74bdde363493f8061eba450ecf4b4 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Not found: Tablet not found: 7af74bdde363493f8061eba450ecf4b4
W20250830 07:54:52.995020 13423 consensus_peers.cc:489] T 057bcce2860345da860acc262dc4d339 P 2065c332f15a4739899af79f3669c3ba -> Peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Couldn't send request to peer 6b5e454d98894637b466ea27f1b647f9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20250830 07:54:52.996493 13231 catalog_manager.cc:5415] Ignoring report from unknown tablet 49165f0001044d72b68263a60ef56457
I20250830 07:54:52.997713 13882 tablet_bootstrap.cc:654] T 8ae468b43b4c450ca7591b543c2539d9 P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:52.992630 13619 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "97d49a1f600f4c13a4aafca99cedabe8" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:52.999157 13487 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "087bb1e80d2d44bf8619b0341ff99527" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba"
I20250830 07:54:52.999327 13487 raft_consensus.cc:3058] T 087bb1e80d2d44bf8619b0341ff99527 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:53.000234 13231 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_9805da1e797d4d098781c5ca9fcf8de8" } new_table_name: "default.Table_1dec56ca06ca461a8c014564f892d894" modify_external_catalogs: true
W20250830 07:54:53.000921 13423 leader_election.cc:343] T 97d49a1f600f4c13a4aafca99cedabe8 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:53.003468 13230 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_296357f9b1b946b2858b94eb7266630b" } modify_external_catalogs: true
I20250830 07:54:53.003688 13230 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_296357f9b1b946b2858b94eb7266630b" } modify_external_catalogs: true
I20250830 07:54:53.004405 13487 raft_consensus.cc:2466] T 087bb1e80d2d44bf8619b0341ff99527 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 1.
I20250830 07:54:53.004665 13225 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_11c05d685c1d4a1e9d6b1cede36d73b3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:53.005134 13225 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_11c05d685c1d4a1e9d6b1cede36d73b3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:53.005154 13483 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "43e93d3038f7496ebb18319420ab67e0" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba"
I20250830 07:54:53.005329 13483 raft_consensus.cc:3058] T 43e93d3038f7496ebb18319420ab67e0 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:53.006173 13229 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_9a69fe1a51464ff9bd75cc9902331abf" } new_table_name: "default.Table_7e0dd322b340488ba39ed8049eca0e73" modify_external_catalogs: true
I20250830 07:54:53.006702 15115 raft_consensus.cc:491] T 52e910677ae34630a919d1d3f21b7e83 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:53.006796 15115 raft_consensus.cc:513] T 52e910677ae34630a919d1d3f21b7e83 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:53.007335 15115 leader_election.cc:290] T 52e910677ae34630a919d1d3f21b7e83 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
W20250830 07:54:53.011397 13231 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 951077f2f51545a49cfdf1c1c3b7d358 has no consensus state
I20250830 07:54:53.012029 13483 raft_consensus.cc:2466] T 43e93d3038f7496ebb18319420ab67e0 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 1.
I20250830 07:54:53.015471 13230 catalog_manager.cc:5864] Not sending DeleteTablet requests; no consensus state for tablet 5c4c03ca24e24a6784ab065cefad2e07
W20250830 07:54:53.016069 13229 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 34199145292d4ddb8c603e5c581f1d15 consensus state has no leader
I20250830 07:54:53.016577 13231 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_ced659e469e94825a721eb09ccadeaa6" } modify_external_catalogs: true
I20250830 07:54:53.017104 13231 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_ced659e469e94825a721eb09ccadeaa6" } modify_external_catalogs: true
I20250830 07:54:53.017831 13887 tablet_bootstrap.cc:492] T 1520d7257f864ea4ba4b9a5d0443f8a7 P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:54:53.017946 13887 ts_tablet_manager.cc:1397] T 1520d7257f864ea4ba4b9a5d0443f8a7 P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.053s user 0.002s sys 0.000s
I20250830 07:54:53.018687 13887 raft_consensus.cc:357] T 1520d7257f864ea4ba4b9a5d0443f8a7 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:53.018986 13887 raft_consensus.cc:383] T 1520d7257f864ea4ba4b9a5d0443f8a7 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:53.019071 13887 raft_consensus.cc:738] T 1520d7257f864ea4ba4b9a5d0443f8a7 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:54:53.019299 13887 consensus_queue.cc:260] T 1520d7257f864ea4ba4b9a5d0443f8a7 P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:53.019980 13887 ts_tablet_manager.cc:1428] T 1520d7257f864ea4ba4b9a5d0443f8a7 P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20250830 07:54:53.020318 13887 tablet_bootstrap.cc:492] T 2048c04578104c78aa6504fd9d5953a3 P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
W20250830 07:54:53.021827 13220 catalog_manager.cc:4908] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet 9bc54e40f9eb4271aa3132986c249e51 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9bc54e40f9eb4271aa3132986c249e51 already in progress: creating tablet
I20250830 07:54:53.025528 13617 raft_consensus.cc:3058] T d2b8e6df64ef49e2ba36c093efd3c351 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:53.025732 13767 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "7af74bdde363493f8061eba450ecf4b4" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:53.025902 13767 raft_consensus.cc:2466] T 7af74bdde363493f8061eba450ecf4b4 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2065c332f15a4739899af79f3669c3ba in term 1.
I20250830 07:54:53.027597 13229 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_d3a725d507884adc938feab927a067ca" } new_table_name: "default.Table_4257df025a2449a4b6993213db82006a" modify_external_catalogs: true
I20250830 07:54:53.030267 13767 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "97d49a1f600f4c13a4aafca99cedabe8" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:53.035488 13767 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "52e910677ae34630a919d1d3f21b7e83" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:53.036377 13483 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "3bb48fce24074a8e8ec99d3172a655d8" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:54:53.036579 13483 raft_consensus.cc:2466] T 3bb48fce24074a8e8ec99d3172a655d8 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 0.
W20250830 07:54:53.037789 13225 catalog_manager.cc:5415] Ignoring report from unknown tablet db7144b25ff34bed8c7b779ba9497ef4
W20250830 07:54:53.039070 13225 catalog_manager.cc:5415] Ignoring report from unknown tablet a8baad9c419e436b9659d8d5582d4066
I20250830 07:54:53.040926 15115 raft_consensus.cc:491] T 1520d7257f864ea4ba4b9a5d0443f8a7 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:53.041049 15115 raft_consensus.cc:513] T 1520d7257f864ea4ba4b9a5d0443f8a7 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:53.041575 15115 leader_election.cc:290] T 1520d7257f864ea4ba4b9a5d0443f8a7 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:53.044014 13230 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_8c3ddc82e5b542269bfdd5f828bed3a7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:53.044495 13230 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8c3ddc82e5b542269bfdd5f828bed3a7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250830 07:54:53.045821 13229 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 381b57c8b76a4b1bb9acab08c0544588 consensus state has no leader
I20250830 07:54:53.046393 13231 catalog_manager.cc:5864] Not sending DeleteTablet requests; no consensus state for tablet 471c6dea68ca4aa28a6316cf240265d7
I20250830 07:54:53.050031 13887 tablet_bootstrap.cc:654] T 2048c04578104c78aa6504fd9d5953a3 P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:53.050369 15115 raft_consensus.cc:491] T 49165f0001044d72b68263a60ef56457 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:53.050484 15115 raft_consensus.cc:513] T 49165f0001044d72b68263a60ef56457 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:53.051010 15115 leader_election.cc:290] T 49165f0001044d72b68263a60ef56457 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
W20250830 07:54:53.056162 13229 catalog_manager.cc:5415] Ignoring report from unknown tablet 1520d7257f864ea4ba4b9a5d0443f8a7
W20250830 07:54:53.056332 13229 catalog_manager.cc:5415] Ignoring report from unknown tablet d33a5d107c6849aca6eb48ffdf8a5463
W20250830 07:54:53.056469 13229 catalog_manager.cc:5415] Ignoring report from unknown tablet 28c2f7a3a6dd444585f0f5d337b985e9
W20250830 07:54:53.056444 13220 catalog_manager.cc:4908] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet 8c01157324ba45bda5b3a9a328bf319b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8c01157324ba45bda5b3a9a328bf319b already in progress: creating tablet
W20250830 07:54:53.056576 13229 catalog_manager.cc:5415] Ignoring report from unknown tablet 95b6f084eb5240ea94c125eaa154ac9f
W20250830 07:54:53.056639 13229 catalog_manager.cc:5415] Ignoring report from unknown tablet 70703eb1d47841a1a227e277ed6a268d
W20250830 07:54:53.056752 13220 catalog_manager.cc:4908] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet 208995abd6d44dbea3b5ebbea27d6a39 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 208995abd6d44dbea3b5ebbea27d6a39 already in progress: creating tablet
I20250830 07:54:53.056885 13229 catalog_manager.cc:5674] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325) does not have the latest schema for tablet f5baa35307a1425c8d52666d130d6d8a (table default.Table_57e5674478754ca0b44cec01ba4e73e8 [id=6a35c4abd132478caba0152786455169]). Expected version 1 got 0
I20250830 07:54:53.057590 13231 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_6684339e3f6a4aa486b7c3adcf862558"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:53.058204 13231 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6684339e3f6a4aa486b7c3adcf862558 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:53.065848 13619 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "52e910677ae34630a919d1d3f21b7e83" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:53.067109 13887 tablet_bootstrap.cc:492] T 2048c04578104c78aa6504fd9d5953a3 P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:54:53.067620 13887 ts_tablet_manager.cc:1397] T 2048c04578104c78aa6504fd9d5953a3 P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.047s user 0.003s sys 0.000s
I20250830 07:54:53.071097 13619 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "1520d7257f864ea4ba4b9a5d0443f8a7" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
W20250830 07:54:53.071899 13423 leader_election.cc:343] T 52e910677ae34630a919d1d3f21b7e83 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:53.071911 13619 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "49165f0001044d72b68263a60ef56457" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
W20250830 07:54:53.072171 13423 leader_election.cc:343] T 1520d7257f864ea4ba4b9a5d0443f8a7 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:53.068893 13887 raft_consensus.cc:357] T 2048c04578104c78aa6504fd9d5953a3 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:53.073159 13887 raft_consensus.cc:383] T 2048c04578104c78aa6504fd9d5953a3 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:53.073616 13422 leader_election.cc:304] T 7af74bdde363493f8061eba450ecf4b4 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:54:53.073824 15115 raft_consensus.cc:2802] T 7af74bdde363493f8061eba450ecf4b4 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader pre-election won for term 2
I20250830 07:54:53.073889 15115 raft_consensus.cc:491] T 7af74bdde363493f8061eba450ecf4b4 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6b5e454d98894637b466ea27f1b647f9)
I20250830 07:54:53.073948 15115 raft_consensus.cc:3058] T 7af74bdde363493f8061eba450ecf4b4 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Advancing to term 2
I20250830 07:54:53.075336 15342 raft_consensus.cc:491] T c1e0e774b86d4ef9a75e2635295f3e2a P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:53.075469 15342 raft_consensus.cc:513] T c1e0e774b86d4ef9a75e2635295f3e2a P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:53.076026 15342 leader_election.cc:290] T c1e0e774b86d4ef9a75e2635295f3e2a P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967)
I20250830 07:54:53.076324 15115 raft_consensus.cc:513] T 7af74bdde363493f8061eba450ecf4b4 P 2065c332f15a4739899af79f3669c3ba [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:53.075232 13701 leader_election.cc:304] T ef1ab62a5b7845e58d50f34206eaaa27 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:54:53.076782 15342 raft_consensus.cc:2802] T ef1ab62a5b7845e58d50f34206eaaa27 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:54:53.076804 15115 leader_election.cc:290] T 7af74bdde363493f8061eba450ecf4b4 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 2 election: Requested vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:53.076881 15342 raft_consensus.cc:491] T ef1ab62a5b7845e58d50f34206eaaa27 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:54:53.076967 15342 raft_consensus.cc:3058] T ef1ab62a5b7845e58d50f34206eaaa27 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
W20250830 07:54:53.077915 13423 leader_election.cc:343] T 49165f0001044d72b68263a60ef56457 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:53.073415 13887 raft_consensus.cc:738] T 2048c04578104c78aa6504fd9d5953a3 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:54:53.078135 13619 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "c1e0e774b86d4ef9a75e2635295f3e2a" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
W20250830 07:54:53.079414 13703 consensus_peers.cc:489] T da5c7b084e1f4fda92fff35a9cb2c7fc P 9b057ade5dce45af9f8bf0bedf8b917f -> Peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Couldn't send request to peer 6b5e454d98894637b466ea27f1b647f9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20250830 07:54:53.079015 13887 consensus_queue.cc:260] T 2048c04578104c78aa6504fd9d5953a3 P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:53.080931 15342 raft_consensus.cc:513] T ef1ab62a5b7845e58d50f34206eaaa27 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:53.082008 15342 leader_election.cc:290] T ef1ab62a5b7845e58d50f34206eaaa27 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Requested vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967)
I20250830 07:54:53.082422 13229 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_e6e8ed8d3fb245729dfbc091e5e237a3" } new_table_name: "default.Table_f263c355c0ac403db44473d24d18db9c" modify_external_catalogs: true
W20250830 07:54:53.083633 13703 leader_election.cc:343] T c1e0e774b86d4ef9a75e2635295f3e2a P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:53.084045 13619 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "ef1ab62a5b7845e58d50f34206eaaa27" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9"
W20250830 07:54:53.085022 13703 leader_election.cc:343] T ef1ab62a5b7845e58d50f34206eaaa27 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
W20250830 07:54:53.085088 13423 leader_election.cc:343] T 7af74bdde363493f8061eba450ecf4b4 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Not found: Tablet not found: 7af74bdde363493f8061eba450ecf4b4
W20250830 07:54:53.090770 13229 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 55d6b2e221c34d159ff5e71606be86f0 consensus state has no leader
I20250830 07:54:53.090803 13887 ts_tablet_manager.cc:1428] T 2048c04578104c78aa6504fd9d5953a3 P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.023s user 0.003s sys 0.000s
I20250830 07:54:53.091822 15342 consensus_queue.cc:1035] T ca959e42c8764eeba0faee96caf8b39f P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:54:53.092630 15342 consensus_queue.cc:1035] T da5c7b084e1f4fda92fff35a9cb2c7fc P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20250830 07:54:53.094587 13231 catalog_manager.cc:5415] Ignoring report from unknown tablet 057bcce2860345da860acc262dc4d339
I20250830 07:54:53.094348 13887 tablet_bootstrap.cc:492] T f66e1d07039841088a444ee0203a4eb0 P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
W20250830 07:54:53.095045 13231 catalog_manager.cc:5415] Ignoring report from unknown tablet ff0f9cccc8ed43b1a8cd38de0e9d4097
W20250830 07:54:53.095520 13422 leader_election.cc:343] T 97d49a1f600f4c13a4aafca99cedabe8 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Illegal state: must be running to vote when last-logged opid is not known
W20250830 07:54:53.095676 13231 catalog_manager.cc:5415] Ignoring report from unknown tablet ec47a59c22ff4370bd21bc2a18336049
I20250830 07:54:53.095757 13422 leader_election.cc:304] T 97d49a1f600f4c13a4aafca99cedabe8 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba; no voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:54:53.095983 15009 raft_consensus.cc:2747] T 97d49a1f600f4c13a4aafca99cedabe8 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20250830 07:54:53.096369 13422 leader_election.cc:343] T 52e910677ae34630a919d1d3f21b7e83 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:53.096519 13422 leader_election.cc:304] T 52e910677ae34630a919d1d3f21b7e83 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba; no voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:54:53.096735 15009 raft_consensus.cc:2747] T 52e910677ae34630a919d1d3f21b7e83 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:54:53.100535 13229 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_48f1c7b89d7d4b5bb524ad7d11b41f21"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:53.101034 13229 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_48f1c7b89d7d4b5bb524ad7d11b41f21 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:53.101715 13882 tablet_bootstrap.cc:492] T 8ae468b43b4c450ca7591b543c2539d9 P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:54:53.103073 13882 ts_tablet_manager.cc:1397] T 8ae468b43b4c450ca7591b543c2539d9 P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.179s user 0.006s sys 0.000s
I20250830 07:54:53.103799 13882 raft_consensus.cc:357] T 8ae468b43b4c450ca7591b543c2539d9 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:53.108982 13230 catalog_manager.cc:5674] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325) does not have the latest schema for tablet 2048c04578104c78aa6504fd9d5953a3 (table default.Table_774eed33394d4f4a839a3a0b14b5ad71 [id=2f37d76cb66742b5ac3d9f0714c6394d]). Expected version 1 got 0
I20250830 07:54:53.104249 13231 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_fab6ffd5b0c2409ca791505f20921026"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250830 07:54:53.110900 15340 consensus_queue.cc:1035] T 519b3e58b63b402d84e234f5e180b98c P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20250830 07:54:53.111258 13231 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fab6ffd5b0c2409ca791505f20921026 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:53.111176 13887 tablet_bootstrap.cc:654] T f66e1d07039841088a444ee0203a4eb0 P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:53.114493 13882 raft_consensus.cc:383] T 8ae468b43b4c450ca7591b543c2539d9 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:53.114949 13882 raft_consensus.cc:738] T 8ae468b43b4c450ca7591b543c2539d9 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:54:53.115375 15340 raft_consensus.cc:491] T d206f6b6e7524a27a9f95787bcd5de77 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:53.115324 13882 consensus_queue.cc:260] T 8ae468b43b4c450ca7591b543c2539d9 P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:53.115497 15340 raft_consensus.cc:513] T d206f6b6e7524a27a9f95787bcd5de77 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:53.115887 13882 ts_tablet_manager.cc:1428] T 8ae468b43b4c450ca7591b543c2539d9 P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.013s user 0.001s sys 0.001s
I20250830 07:54:53.115972 15340 leader_election.cc:290] T d206f6b6e7524a27a9f95787bcd5de77 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967)
I20250830 07:54:53.116145 13882 tablet_bootstrap.cc:492] T d1bf58d367f54ba8bad64887b9a8d9cc P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:54:53.120041 13610 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "d206f6b6e7524a27a9f95787bcd5de77" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
W20250830 07:54:53.121171 13703 consensus_peers.cc:489] T 7c5e50cb605c4a40b47984f328eedd93 P 9b057ade5dce45af9f8bf0bedf8b917f -> Peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Couldn't send request to peer 6b5e454d98894637b466ea27f1b647f9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20250830 07:54:53.121515 13703 leader_election.cc:343] T d206f6b6e7524a27a9f95787bcd5de77 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:53.123821 13230 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_c8fac6974ea94c7e863c1ded184f9230" } new_table_name: "default.Table_450c8e4da4c940928589c450d6d5b693" modify_external_catalogs: true
I20250830 07:54:53.126430 13882 tablet_bootstrap.cc:654] T d1bf58d367f54ba8bad64887b9a8d9cc P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:53.130154 13225 catalog_manager.cc:5674] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325) does not have the latest schema for tablet 2048c04578104c78aa6504fd9d5953a3 (table default.Table_774eed33394d4f4a839a3a0b14b5ad71 [id=2f37d76cb66742b5ac3d9f0714c6394d]). Expected version 1 got 0
W20250830 07:54:53.131258 13703 consensus_peers.cc:489] T 1e48641532cd439e9b4074712033c737 P 9b057ade5dce45af9f8bf0bedf8b917f -> Peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Couldn't send request to peer 6b5e454d98894637b466ea27f1b647f9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20250830 07:54:53.134260 13701 leader_election.cc:304] T e6060a3dc6444483b8fb2944b8090cb6 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:54:53.143580 15340 raft_consensus.cc:2802] T e6060a3dc6444483b8fb2944b8090cb6 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election won for term 1
I20250830 07:54:53.144230 15340 raft_consensus.cc:695] T e6060a3dc6444483b8fb2944b8090cb6 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 LEADER]: Becoming Leader. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Running, Role: LEADER
I20250830 07:54:53.144480 15340 consensus_queue.cc:237] T e6060a3dc6444483b8fb2944b8090cb6 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:53.145071 14906 raft_consensus.cc:491] T 8ae468b43b4c450ca7591b543c2539d9 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:53.145208 14906 raft_consensus.cc:513] T 8ae468b43b4c450ca7591b543c2539d9 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:53.145776 14906 leader_election.cc:290] T 8ae468b43b4c450ca7591b543c2539d9 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
W20250830 07:54:53.147723 13561 consensus_peers.cc:489] T f52dd8eeb64a4b8a92babf34387b6c5b P 6b5e454d98894637b466ea27f1b647f9 -> Peer 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): Couldn't send request to peer 2065c332f15a4739899af79f3669c3ba. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f52dd8eeb64a4b8a92babf34387b6c5b. This is attempt 1: this message will repeat every 5th retry.
I20250830 07:54:53.151139 13487 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "8ae468b43b4c450ca7591b543c2539d9" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:54:53.151625 15342 raft_consensus.cc:491] T 042fd7ff08fc4695b87bb8f9d225ef12 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:53.151829 15342 raft_consensus.cc:513] T 042fd7ff08fc4695b87bb8f9d225ef12 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:53.154639 15342 leader_election.cc:290] T 042fd7ff08fc4695b87bb8f9d225ef12 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967)
I20250830 07:54:53.155370 13887 tablet_bootstrap.cc:492] T f66e1d07039841088a444ee0203a4eb0 P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:54:53.155423 13771 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "8ae468b43b4c450ca7591b543c2539d9" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:53.155628 13887 ts_tablet_manager.cc:1397] T f66e1d07039841088a444ee0203a4eb0 P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.062s user 0.005s sys 0.000s
I20250830 07:54:53.157330 13887 raft_consensus.cc:357] T f66e1d07039841088a444ee0203a4eb0 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:53.157630 13887 raft_consensus.cc:383] T f66e1d07039841088a444ee0203a4eb0 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:53.157752 13887 raft_consensus.cc:738] T f66e1d07039841088a444ee0203a4eb0 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:54:53.158093 13887 consensus_queue.cc:260] T f66e1d07039841088a444ee0203a4eb0 P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:53.159313 13562 leader_election.cc:304] T 8ae468b43b4c450ca7591b543c2539d9 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b5e454d98894637b466ea27f1b647f9; no voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:54:53.159606 14906 raft_consensus.cc:2747] T 8ae468b43b4c450ca7591b543c2539d9 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:54:53.159919 13617 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "042fd7ff08fc4695b87bb8f9d225ef12" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
W20250830 07:54:53.160379 13703 leader_election.cc:343] T 042fd7ff08fc4695b87bb8f9d225ef12 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:53.160602 14906 consensus_queue.cc:1035] T f52dd8eeb64a4b8a92babf34387b6c5b P 6b5e454d98894637b466ea27f1b647f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:54:53.160398 13886 tablet_bootstrap.cc:492] T 713c12e1efec4e6f9895c65dc8a9c4b9 P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:54:53.161267 13886 ts_tablet_manager.cc:1397] T 713c12e1efec4e6f9895c65dc8a9c4b9 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.179s user 0.001s sys 0.005s
I20250830 07:54:53.161947 13886 raft_consensus.cc:357] T 713c12e1efec4e6f9895c65dc8a9c4b9 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:53.162109 13886 raft_consensus.cc:383] T 713c12e1efec4e6f9895c65dc8a9c4b9 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:53.162184 13886 raft_consensus.cc:738] T 713c12e1efec4e6f9895c65dc8a9c4b9 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:54:53.162401 13886 consensus_queue.cc:260] T 713c12e1efec4e6f9895c65dc8a9c4b9 P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:53.162868 13886 ts_tablet_manager.cc:1428] T 713c12e1efec4e6f9895c65dc8a9c4b9 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20250830 07:54:53.163152 13886 tablet_bootstrap.cc:492] T 88bbd6b4c795433d9b6ad746353f3aa1 P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:54:53.165184 13887 ts_tablet_manager.cc:1428] T f66e1d07039841088a444ee0203a4eb0 P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.008s user 0.002s sys 0.000s
I20250830 07:54:53.168958 13233 master_service.cc:948] ReplaceTablet: received request to replace tablet 7aed56dba39e40518e9c3325bcccd74a from {username='slave'} at 127.0.0.1:42126
I20250830 07:54:53.177649 13887 tablet_bootstrap.cc:492] T 0208de98277c4d6889fb0289b6013ae1 P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:54:53.178884 13887 tablet_bootstrap.cc:654] T 0208de98277c4d6889fb0289b6013ae1 P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:53.179625 13225 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_b65ac2e88cd54c05ba4cc54faa2c4954"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:53.180255 13225 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b65ac2e88cd54c05ba4cc54faa2c4954 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:53.182317 13228 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_44f111fefe114dc393e26190811e90b7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250830 07:54:53.182933 13232 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_7d4d46b07c514fc08c171683a78494dc"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250830 07:54:53.183579 13231 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_42e855e899794478ac4aa86b31bbc1eb" } modify_external_catalogs: true
I20250830 07:54:53.183717 13231 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_42e855e899794478ac4aa86b31bbc1eb" } modify_external_catalogs: true
W20250830 07:54:53.184381 13230 catalog_manager.cc:5415] Ignoring report from unknown tablet ef16b9e2d444489699f4db1ac26d5f6c
I20250830 07:54:53.184932 13234 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_41ce7b564e1c4e19a5f705c818bb7d9f" } modify_external_catalogs: true
I20250830 07:54:53.185076 13234 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_41ce7b564e1c4e19a5f705c818bb7d9f" } modify_external_catalogs: true
I20250830 07:54:53.186055 13227 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_c1beaa156a2345c5a5d403b043c9bd63" } modify_external_catalogs: true
I20250830 07:54:53.186190 13227 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_c1beaa156a2345c5a5d403b043c9bd63" } modify_external_catalogs: true
I20250830 07:54:53.186515 13229 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_ec434940db7d47c4a472d406cfa60d8c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:53.187039 13229 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ec434940db7d47c4a472d406cfa60d8c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:53.186101 13226 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_190c884b4d014a1ab4b2d71b4b8c7c33"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:53.187528 13226 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_190c884b4d014a1ab4b2d71b4b8c7c33 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250830 07:54:53.188658 13232 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7d4d46b07c514fc08c171683a78494dc in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250830 07:54:53.189463 13228 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_44f111fefe114dc393e26190811e90b7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:53.190969 15470 raft_consensus.cc:491] T f5baa35307a1425c8d52666d130d6d8a P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:53.191231 15470 raft_consensus.cc:513] T f5baa35307a1425c8d52666d130d6d8a P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
W20250830 07:54:53.191444 13561 consensus_peers.cc:489] T 65f1ee59e6e9498381d686f16a865e23 P 6b5e454d98894637b466ea27f1b647f9 -> Peer 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): Couldn't send request to peer 2065c332f15a4739899af79f3669c3ba. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 65f1ee59e6e9498381d686f16a865e23. This is attempt 1: this message will repeat every 5th retry.
I20250830 07:54:53.192610 15470 leader_election.cc:290] T f5baa35307a1425c8d52666d130d6d8a P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:53.192629 13617 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f5baa35307a1425c8d52666d130d6d8a" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
W20250830 07:54:53.193159 13423 leader_election.cc:343] T f5baa35307a1425c8d52666d130d6d8a P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
W20250830 07:54:53.194561 13233 catalog_manager.cc:5415] Ignoring report from unknown tablet f66e1d07039841088a444ee0203a4eb0
I20250830 07:54:53.199007 13701 leader_election.cc:304] T 43e93d3038f7496ebb18319420ab67e0 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:54:53.201236 13701 leader_election.cc:304] T 3bb48fce24074a8e8ec99d3172a655d8 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:54:53.203588 13887 tablet_bootstrap.cc:492] T 0208de98277c4d6889fb0289b6013ae1 P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:54:53.203701 13887 ts_tablet_manager.cc:1397] T 0208de98277c4d6889fb0289b6013ae1 P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.026s user 0.003s sys 0.000s
I20250830 07:54:53.204332 13887 raft_consensus.cc:357] T 0208de98277c4d6889fb0289b6013ae1 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:53.204484 13887 raft_consensus.cc:383] T 0208de98277c4d6889fb0289b6013ae1 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:53.204540 13887 raft_consensus.cc:738] T 0208de98277c4d6889fb0289b6013ae1 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:54:53.204725 13887 consensus_queue.cc:260] T 0208de98277c4d6889fb0289b6013ae1 P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:53.205315 13887 ts_tablet_manager.cc:1428] T 0208de98277c4d6889fb0289b6013ae1 P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20250830 07:54:53.205557 13887 tablet_bootstrap.cc:492] T 76ab56c469cf4675a4e21acbe0a8085d P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:54:53.205552 15339 raft_consensus.cc:2802] T 43e93d3038f7496ebb18319420ab67e0 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election won for term 1
I20250830 07:54:53.205672 15339 raft_consensus.cc:695] T 43e93d3038f7496ebb18319420ab67e0 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 LEADER]: Becoming Leader. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Running, Role: LEADER
I20250830 07:54:53.205881 15339 consensus_queue.cc:237] T 43e93d3038f7496ebb18319420ab67e0 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:53.206825 14975 raft_consensus.cc:2802] T 3bb48fce24074a8e8ec99d3172a655d8 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:54:53.206926 14975 raft_consensus.cc:491] T 3bb48fce24074a8e8ec99d3172a655d8 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:54:53.207003 14975 raft_consensus.cc:3058] T 3bb48fce24074a8e8ec99d3172a655d8 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:53.210085 14975 raft_consensus.cc:513] T 3bb48fce24074a8e8ec99d3172a655d8 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:53.210825 14975 leader_election.cc:290] T 3bb48fce24074a8e8ec99d3172a655d8 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Requested vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967)
I20250830 07:54:53.214851 13225 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_4c8064376b504b74bea14908e716c0b3" } new_table_name: "default.Table_50afa500710741f4a5f9bcd8c01a13a3" modify_external_catalogs: true
I20250830 07:54:53.219012 13233 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_dce5b4109f4448b9b32e8e35aec0d698" } modify_external_catalogs: true
I20250830 07:54:53.219271 13233 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_dce5b4109f4448b9b32e8e35aec0d698" } modify_external_catalogs: true
I20250830 07:54:53.220854 13230 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_5caf352b482f4b9ba4d727ab7fbd00bb" } new_table_name: "default.Table_f62c15a884574e3ebe9ce39aa18d1e00" modify_external_catalogs: true
I20250830 07:54:53.222736 13882 tablet_bootstrap.cc:492] T d1bf58d367f54ba8bad64887b9a8d9cc P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:54:53.222990 13882 ts_tablet_manager.cc:1397] T d1bf58d367f54ba8bad64887b9a8d9cc P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.107s user 0.004s sys 0.001s
I20250830 07:54:53.223839 13882 raft_consensus.cc:357] T d1bf58d367f54ba8bad64887b9a8d9cc P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:53.224344 13882 raft_consensus.cc:383] T d1bf58d367f54ba8bad64887b9a8d9cc P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:53.224481 13882 raft_consensus.cc:738] T d1bf58d367f54ba8bad64887b9a8d9cc P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:54:53.224783 13882 consensus_queue.cc:260] T d1bf58d367f54ba8bad64887b9a8d9cc P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:53.225515 13882 ts_tablet_manager.cc:1428] T d1bf58d367f54ba8bad64887b9a8d9cc P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20250830 07:54:53.225785 13882 tablet_bootstrap.cc:492] T b83dfc54383d4e7b96523568aea5c9f3 P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:54:53.226517 13887 tablet_bootstrap.cc:654] T 76ab56c469cf4675a4e21acbe0a8085d P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:53.227221 13882 tablet_bootstrap.cc:654] T b83dfc54383d4e7b96523568aea5c9f3 P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:53.229633 13886 tablet_bootstrap.cc:654] T 88bbd6b4c795433d9b6ad746353f3aa1 P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:53.228873 14906 raft_consensus.cc:491] T 74ea2298876a4066b297915c135d4618 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:53.233981 14906 raft_consensus.cc:513] T 74ea2298876a4066b297915c135d4618 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:53.234575 14906 leader_election.cc:290] T 74ea2298876a4066b297915c135d4618 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:53.229378 13619 raft_consensus.cc:3058] T d1bf58d367f54ba8bad64887b9a8d9cc P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:53.236351 13617 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "3bb48fce24074a8e8ec99d3172a655d8" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9"
W20250830 07:54:53.239288 13561 leader_election.cc:343] T 74ea2298876a4066b297915c135d4618 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): Not found: Tablet not found: 74ea2298876a4066b297915c135d4618
W20250830 07:54:53.240775 13423 consensus_peers.cc:489] T b4ab964a64a64e00a78ffd2b220aef46 P 2065c332f15a4739899af79f3669c3ba -> Peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Couldn't send request to peer 6b5e454d98894637b466ea27f1b647f9. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b4ab964a64a64e00a78ffd2b220aef46. This is attempt 11: this message will repeat every 5th retry.
I20250830 07:54:53.249765 13231 catalog_manager.cc:5864] Not sending DeleteTablet requests; no consensus state for tablet 70defd2d04824397ab922739fd78ebac
I20250830 07:54:53.254354 13234 catalog_manager.cc:5864] Not sending DeleteTablet requests; no consensus state for tablet 931331f570474f87a6d8d14d3a41a4a7
I20250830 07:54:53.254626 13234 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_66ed26b353ce4c86ac9bf850149839a5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250830 07:54:53.255086 14748 raft_consensus.cc:491] T ff72a0fd9a0e46a6bd54a15e4ad783b4 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:53.255189 14748 raft_consensus.cc:513] T ff72a0fd9a0e46a6bd54a15e4ad783b4 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:53.255760 14748 leader_election.cc:290] T ff72a0fd9a0e46a6bd54a15e4ad783b4 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
W20250830 07:54:53.256064 13234 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_66ed26b353ce4c86ac9bf850149839a5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:53.256026 13487 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "ff72a0fd9a0e46a6bd54a15e4ad783b4" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:54:53.256207 13487 raft_consensus.cc:2391] T ff72a0fd9a0e46a6bd54a15e4ad783b4 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b5e454d98894637b466ea27f1b647f9 in current term 1: Already voted for candidate 9b057ade5dce45af9f8bf0bedf8b917f in this term.
I20250830 07:54:53.257594 13887 tablet_bootstrap.cc:492] T 76ab56c469cf4675a4e21acbe0a8085d P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:54:53.257717 13887 ts_tablet_manager.cc:1397] T 76ab56c469cf4675a4e21acbe0a8085d P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.052s user 0.003s sys 0.000s
W20250830 07:54:53.258164 13231 catalog_manager.cc:5415] Ignoring report from unknown tablet 0208de98277c4d6889fb0289b6013ae1
I20250830 07:54:53.258319 13887 raft_consensus.cc:357] T 76ab56c469cf4675a4e21acbe0a8085d P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:53.258471 13887 raft_consensus.cc:383] T 76ab56c469cf4675a4e21acbe0a8085d P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:53.258519 13887 raft_consensus.cc:738] T 76ab56c469cf4675a4e21acbe0a8085d P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:54:53.258689 13887 consensus_queue.cc:260] T 76ab56c469cf4675a4e21acbe0a8085d P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:53.259300 13231 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_aa5b0ed256eb418ba139d9678acfa3ff" } new_table_name: "default.Table_287a1c2aa5874779a5b0856f956270b6" modify_external_catalogs: true
W20250830 07:54:53.269058 13701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.209.1:45325, user_credentials={real_user=slave}} blocked reactor thread for 50433.7us
I20250830 07:54:53.269472 14975 consensus_queue.cc:1035] T ff72a0fd9a0e46a6bd54a15e4ad783b4 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:54:53.269551 15481 consensus_queue.cc:1035] T d37fe59b4f964f30bb1ed4cb00868b75 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:54:53.271371 13882 tablet_bootstrap.cc:492] T b83dfc54383d4e7b96523568aea5c9f3 P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:54:53.271503 13882 ts_tablet_manager.cc:1397] T b83dfc54383d4e7b96523568aea5c9f3 P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.046s user 0.003s sys 0.000s
I20250830 07:54:53.272212 13882 raft_consensus.cc:357] T b83dfc54383d4e7b96523568aea5c9f3 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:53.272351 13882 raft_consensus.cc:383] T b83dfc54383d4e7b96523568aea5c9f3 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:53.272408 13882 raft_consensus.cc:738] T b83dfc54383d4e7b96523568aea5c9f3 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
W20250830 07:54:53.272735 13703 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.209.2:38967, user_credentials={real_user=slave}} blocked reactor thread for 53818.2us
I20250830 07:54:53.277176 13701 leader_election.cc:304] T 087bb1e80d2d44bf8619b0341ff99527 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:54:53.277508 15365 raft_consensus.cc:2802] T 087bb1e80d2d44bf8619b0341ff99527 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election won for term 1
I20250830 07:54:53.277748 15365 raft_consensus.cc:695] T 087bb1e80d2d44bf8619b0341ff99527 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 LEADER]: Becoming Leader. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Running, Role: LEADER
I20250830 07:54:53.278092 15365 consensus_queue.cc:237] T 087bb1e80d2d44bf8619b0341ff99527 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:53.279804 13766 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "74ea2298876a4066b297915c135d4618" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:53.280020 13766 raft_consensus.cc:2466] T 74ea2298876a4066b297915c135d4618 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b5e454d98894637b466ea27f1b647f9 in term 0.
I20250830 07:54:53.280794 13771 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "ff72a0fd9a0e46a6bd54a15e4ad783b4" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
W20250830 07:54:53.281276 13703 leader_election.cc:343] T 3bb48fce24074a8e8ec99d3172a655d8 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:53.281719 13562 leader_election.cc:304] T 74ea2298876a4066b297915c135d4618 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 2065c332f15a4739899af79f3669c3ba
I20250830 07:54:53.282058 14748 raft_consensus.cc:2802] T 74ea2298876a4066b297915c135d4618 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:54:53.282116 14748 raft_consensus.cc:491] T 74ea2298876a4066b297915c135d4618 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:54:53.282171 14748 raft_consensus.cc:3058] T 74ea2298876a4066b297915c135d4618 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:53.282967 13886 tablet_bootstrap.cc:492] T 88bbd6b4c795433d9b6ad746353f3aa1 P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:54:53.283147 13886 ts_tablet_manager.cc:1397] T 88bbd6b4c795433d9b6ad746353f3aa1 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.120s user 0.002s sys 0.001s
I20250830 07:54:53.283773 13886 raft_consensus.cc:357] T 88bbd6b4c795433d9b6ad746353f3aa1 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:53.283912 13886 raft_consensus.cc:383] T 88bbd6b4c795433d9b6ad746353f3aa1 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:53.283998 13886 raft_consensus.cc:738] T 88bbd6b4c795433d9b6ad746353f3aa1 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:54:53.284174 13886 consensus_queue.cc:260] T 88bbd6b4c795433d9b6ad746353f3aa1 P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:53.284574 13886 ts_tablet_manager.cc:1428] T 88bbd6b4c795433d9b6ad746353f3aa1 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20250830 07:54:53.284816 13886 tablet_bootstrap.cc:492] T 10ec97b8a82145479e0bb526c4cc7c05 P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:54:53.284894 14748 raft_consensus.cc:513] T 74ea2298876a4066b297915c135d4618 P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:53.285408 14748 leader_election.cc:290] T 74ea2298876a4066b297915c135d4618 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 election: Requested vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
W20250830 07:54:53.285995 13561 leader_election.cc:343] T 74ea2298876a4066b297915c135d4618 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): Not found: Tablet not found: 74ea2298876a4066b297915c135d4618
I20250830 07:54:53.286538 14748 consensus_queue.cc:1035] T 65f1ee59e6e9498381d686f16a865e23 P 6b5e454d98894637b466ea27f1b647f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:54:53.287642 13562 leader_election.cc:304] T ff72a0fd9a0e46a6bd54a15e4ad783b4 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b5e454d98894637b466ea27f1b647f9; no voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:54:53.288038 14748 raft_consensus.cc:3058] T ff72a0fd9a0e46a6bd54a15e4ad783b4 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:53.290625 13227 catalog_manager.cc:5864] Not sending DeleteTablet requests; no consensus state for tablet 9d5696a9d3d148ba9cbadc09f4622d8d
I20250830 07:54:53.290899 14748 raft_consensus.cc:2747] T ff72a0fd9a0e46a6bd54a15e4ad783b4 P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:54:53.291043 13227 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_6a958507c89649f0b5da3534949c2122" } modify_external_catalogs: true
I20250830 07:54:53.291224 13227 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_6a958507c89649f0b5da3534949c2122" } modify_external_catalogs: true
I20250830 07:54:53.291494 13771 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "74ea2298876a4066b297915c135d4618" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f"
I20250830 07:54:53.291636 13771 raft_consensus.cc:3058] T 74ea2298876a4066b297915c135d4618 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:53.293713 13229 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_cd702a9d2fda42ba98b22a3a046e8034"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250830 07:54:53.293932 13771 raft_consensus.cc:2466] T 74ea2298876a4066b297915c135d4618 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b5e454d98894637b466ea27f1b647f9 in term 1.
W20250830 07:54:53.294377 13229 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_cd702a9d2fda42ba98b22a3a046e8034 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:53.299021 15115 raft_consensus.cc:491] T db7144b25ff34bed8c7b779ba9497ef4 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:53.299150 15115 raft_consensus.cc:513] T db7144b25ff34bed8c7b779ba9497ef4 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:53.299747 15115 leader_election.cc:290] T db7144b25ff34bed8c7b779ba9497ef4 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:53.300040 13483 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "c1e0e774b86d4ef9a75e2635295f3e2a" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:54:53.300199 13483 raft_consensus.cc:2466] T c1e0e774b86d4ef9a75e2635295f3e2a P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 0.
I20250830 07:54:53.300433 13476 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "ef1ab62a5b7845e58d50f34206eaaa27" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba"
I20250830 07:54:53.300567 13476 raft_consensus.cc:3058] T ef1ab62a5b7845e58d50f34206eaaa27 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:53.302662 13226 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_797309d8a52a45d89660d9f9cbdf1810"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:53.303323 13226 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_797309d8a52a45d89660d9f9cbdf1810 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:53.306104 13882 consensus_queue.cc:260] T b83dfc54383d4e7b96523568aea5c9f3 P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:53.306882 13619 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "db7144b25ff34bed8c7b779ba9497ef4" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
W20250830 07:54:53.309418 13423 leader_election.cc:343] T db7144b25ff34bed8c7b779ba9497ef4 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:53.310843 13482 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "042fd7ff08fc4695b87bb8f9d225ef12" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:54:53.311012 13482 raft_consensus.cc:2466] T 042fd7ff08fc4695b87bb8f9d225ef12 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 0.
I20250830 07:54:53.311172 13476 raft_consensus.cc:2466] T ef1ab62a5b7845e58d50f34206eaaa27 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 1.
I20250830 07:54:53.312199 13484 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "3bb48fce24074a8e8ec99d3172a655d8" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba"
I20250830 07:54:53.312326 13484 raft_consensus.cc:3058] T 3bb48fce24074a8e8ec99d3172a655d8 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:53.313525 13232 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_774eed33394d4f4a839a3a0b14b5ad71" } new_table_name: "default.Table_3dbb041fb2074a1ea6ae46c7f9a05ce9" modify_external_catalogs: true
I20250830 07:54:53.314828 13484 raft_consensus.cc:2466] T 3bb48fce24074a8e8ec99d3172a655d8 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 1.
I20250830 07:54:53.307907 13882 ts_tablet_manager.cc:1428] T b83dfc54383d4e7b96523568aea5c9f3 P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.036s user 0.002s sys 0.000s
I20250830 07:54:53.316532 13882 tablet_bootstrap.cc:492] T d206f6b6e7524a27a9f95787bcd5de77 P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:54:53.328034 14748 raft_consensus.cc:491] T 4b403cadfb7b42f8896b2ee16b50ecb1 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:53.328150 14748 raft_consensus.cc:513] T 4b403cadfb7b42f8896b2ee16b50ecb1 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:53.329121 14748 leader_election.cc:290] T 4b403cadfb7b42f8896b2ee16b50ecb1 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:53.329427 13486 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "4b403cadfb7b42f8896b2ee16b50ecb1" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
W20250830 07:54:53.333791 13228 catalog_manager.cc:5415] Ignoring report from unknown tablet b4ab964a64a64e00a78ffd2b220aef46
I20250830 07:54:53.334630 15412 raft_consensus.cc:491] T 76ab56c469cf4675a4e21acbe0a8085d P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:53.334758 15412 raft_consensus.cc:513] T 76ab56c469cf4675a4e21acbe0a8085d P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:53.335263 15412 leader_election.cc:290] T 76ab56c469cf4675a4e21acbe0a8085d P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:53.335379 13887 ts_tablet_manager.cc:1428] T 76ab56c469cf4675a4e21acbe0a8085d P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.078s user 0.002s sys 0.000s
I20250830 07:54:53.336498 13619 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "76ab56c469cf4675a4e21acbe0a8085d" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
W20250830 07:54:53.336971 13423 leader_election.cc:343] T 76ab56c469cf4675a4e21acbe0a8085d P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:53.337381 13228 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_c4a636c729fe4982bec27dec6c84bc98" } new_table_name: "default.Table_5a5b28c333d44830939ae69ccdec33c5" modify_external_catalogs: true
I20250830 07:54:53.339161 13887 tablet_bootstrap.cc:492] T ee44ab24333742909f773889ad5c3e00 P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:54:53.359939 13562 leader_election.cc:304] T 74ea2298876a4066b297915c135d4618 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 2065c332f15a4739899af79f3669c3ba
I20250830 07:54:53.360319 14748 raft_consensus.cc:2802] T 74ea2298876a4066b297915c135d4618 P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Leader election won for term 1
I20250830 07:54:53.360577 14748 raft_consensus.cc:695] T 74ea2298876a4066b297915c135d4618 P 6b5e454d98894637b466ea27f1b647f9 [term 1 LEADER]: Becoming Leader. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Running, Role: LEADER
I20250830 07:54:53.360651 13886 tablet_bootstrap.cc:654] T 10ec97b8a82145479e0bb526c4cc7c05 P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:53.360922 14748 consensus_queue.cc:237] T 74ea2298876a4066b297915c135d4618 P 6b5e454d98894637b466ea27f1b647f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:53.377265 13771 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "4b403cadfb7b42f8896b2ee16b50ecb1" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
W20250830 07:54:53.382498 13225 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet e7e9d2e9b1ca4ddfb0c6a7bced613c35 consensus state has no leader
I20250830 07:54:53.387542 13562 leader_election.cc:304] T 4b403cadfb7b42f8896b2ee16b50ecb1 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b5e454d98894637b466ea27f1b647f9; no voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:54:53.387908 15237 raft_consensus.cc:2747] T 4b403cadfb7b42f8896b2ee16b50ecb1 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:54:53.389053 15500 raft_consensus.cc:491] T 74f2fcc22fd545fb8ca7c20619843023 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:53.389258 15500 raft_consensus.cc:513] T 74f2fcc22fd545fb8ca7c20619843023 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:53.389868 15500 leader_election.cc:290] T 74f2fcc22fd545fb8ca7c20619843023 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967)
W20250830 07:54:53.394313 13225 catalog_manager.cc:5415] Ignoring report from unknown tablet 43e93d3038f7496ebb18319420ab67e0
W20250830 07:54:53.394562 13225 catalog_manager.cc:5415] Ignoring report from unknown tablet 28c2f7a3a6dd444585f0f5d337b985e9
W20250830 07:54:53.394673 13225 catalog_manager.cc:5415] Ignoring report from unknown tablet f52dd8eeb64a4b8a92babf34387b6c5b
W20250830 07:54:53.394770 13225 catalog_manager.cc:5415] Ignoring report from unknown tablet e6060a3dc6444483b8fb2944b8090cb6
W20250830 07:54:53.394878 13225 catalog_manager.cc:5415] Ignoring report from unknown tablet e6b7646588fe4134b2db62ff84ca4791
I20250830 07:54:53.396328 13225 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_7612df80e1494497b661e08bfb3cee9d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:53.396996 13225 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7612df80e1494497b661e08bfb3cee9d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:53.400818 13882 tablet_bootstrap.cc:654] T d206f6b6e7524a27a9f95787bcd5de77 P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:53.402606 13233 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet dad2dfa1a19d45778933780b1029d924
I20250830 07:54:53.403169 13233 master_service.cc:948] ReplaceTablet: received request to replace tablet b85843ab0e3a40e1b453cfdd71bbae5e from {username='slave'} at 127.0.0.1:42126
I20250830 07:54:53.403928 13593 tablet_service.cc:1515] Processing DeleteTablet for tablet dad2dfa1a19d45778933780b1029d924 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:53 UTC) from {username='slave'} at 127.0.0.1:45306
W20250830 07:54:53.404639 13220 catalog_manager.cc:4908] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet dad2dfa1a19d45778933780b1029d924 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet dad2dfa1a19d45778933780b1029d924 already in progress: creating tablet
I20250830 07:54:53.415520 13617 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "74f2fcc22fd545fb8ca7c20619843023" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
W20250830 07:54:53.416394 13703 leader_election.cc:343] T 74f2fcc22fd545fb8ca7c20619843023 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:53.427767 13771 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "1520d7257f864ea4ba4b9a5d0443f8a7" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:53.428709 13617 raft_consensus.cc:3058] T 8ae468b43b4c450ca7591b543c2539d9 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:53.418458 15483 raft_consensus.cc:491] T 49165f0001044d72b68263a60ef56457 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:53.429889 15483 raft_consensus.cc:513] T 49165f0001044d72b68263a60ef56457 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:53.430450 15483 leader_election.cc:290] T 49165f0001044d72b68263a60ef56457 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967)
W20250830 07:54:53.431881 13129 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerService.ListTablets -> {remote=127.12.209.2:38967, user_credentials={real_user=slave}} blocked reactor thread for 49299.4us
I20250830 07:54:53.433885 13771 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "49165f0001044d72b68263a60ef56457" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:53.434377 13771 raft_consensus.cc:2466] T 49165f0001044d72b68263a60ef56457 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2065c332f15a4739899af79f3669c3ba in term 0.
I20250830 07:54:53.434880 13536 heartbeater.cc:344] Connected to a master server at 127.12.209.60:43889
W20250830 07:54:53.435192 13230 catalog_manager.cc:5415] Ignoring report from unknown tablet d37fe59b4f964f30bb1ed4cb00868b75
W20250830 07:54:53.435351 13230 catalog_manager.cc:5415] Ignoring report from unknown tablet a8baad9c419e436b9659d8d5582d4066
W20250830 07:54:53.435549 13230 catalog_manager.cc:5415] Ignoring report from unknown tablet 70703eb1d47841a1a227e277ed6a268d
W20250830 07:54:53.435655 13230 catalog_manager.cc:5415] Ignoring report from unknown tablet 95b6f084eb5240ea94c125eaa154ac9f
W20250830 07:54:53.435761 13230 catalog_manager.cc:5415] Ignoring report from unknown tablet 28c2f7a3a6dd444585f0f5d337b985e9
W20250830 07:54:53.435853 13230 catalog_manager.cc:5415] Ignoring report from unknown tablet da5c7b084e1f4fda92fff35a9cb2c7fc
I20250830 07:54:53.435880 13610 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "49165f0001044d72b68263a60ef56457" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
W20250830 07:54:53.435956 13230 catalog_manager.cc:5415] Ignoring report from unknown tablet ca959e42c8764eeba0faee96caf8b39f
I20250830 07:54:53.435912 13771 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "7af74bdde363493f8061eba450ecf4b4" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f"
I20250830 07:54:53.436051 13771 raft_consensus.cc:3058] T 7af74bdde363493f8061eba450ecf4b4 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Advancing to term 2
I20250830 07:54:53.436602 13230 catalog_manager.cc:5674] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325) does not have the latest schema for tablet ff72a0fd9a0e46a6bd54a15e4ad783b4 (table default.Table_85e7f0b13c094fd7841dcabce61fd911 [id=de7b214458f247ef831f43727543afc5]). Expected version 1 got 0
I20250830 07:54:53.437836 13230 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_ae22b41f9e3a49d39710369989f0f047"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:53.438491 13230 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ae22b41f9e3a49d39710369989f0f047 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:53.438947 13771 raft_consensus.cc:2466] T 7af74bdde363493f8061eba450ecf4b4 P 9b057ade5dce45af9f8bf0bedf8b917f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2065c332f15a4739899af79f3669c3ba in term 2.
I20250830 07:54:53.439563 13767 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f5baa35307a1425c8d52666d130d6d8a" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:53.444591 13234 master_service.cc:948] ReplaceTablet: received request to replace tablet d0d8a3d95b4b4529a3c95be4c2d7a409 from {username='slave'} at 127.0.0.1:42126
I20250830 07:54:53.444788 13765 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "db7144b25ff34bed8c7b779ba9497ef4" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:53.445979 13765 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "76ab56c469cf4675a4e21acbe0a8085d" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:53.447556 13886 tablet_bootstrap.cc:492] T 10ec97b8a82145479e0bb526c4cc7c05 P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:54:53.447764 13886 ts_tablet_manager.cc:1397] T 10ec97b8a82145479e0bb526c4cc7c05 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.163s user 0.001s sys 0.003s
I20250830 07:54:53.448523 13886 raft_consensus.cc:357] T 10ec97b8a82145479e0bb526c4cc7c05 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:53.448696 13886 raft_consensus.cc:383] T 10ec97b8a82145479e0bb526c4cc7c05 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:53.448796 13886 raft_consensus.cc:738] T 10ec97b8a82145479e0bb526c4cc7c05 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:54:53.449097 13886 consensus_queue.cc:260] T 10ec97b8a82145479e0bb526c4cc7c05 P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
W20250830 07:54:53.451191 13703 leader_election.cc:343] T 49165f0001044d72b68263a60ef56457 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:53.454449 13886 ts_tablet_manager.cc:1428] T 10ec97b8a82145479e0bb526c4cc7c05 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.007s user 0.001s sys 0.000s
I20250830 07:54:53.455210 13886 tablet_bootstrap.cc:492] T 2048c04578104c78aa6504fd9d5953a3 P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:54:53.457931 13882 tablet_bootstrap.cc:492] T d206f6b6e7524a27a9f95787bcd5de77 P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:54:53.458068 13882 ts_tablet_manager.cc:1397] T d206f6b6e7524a27a9f95787bcd5de77 P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.142s user 0.002s sys 0.000s
I20250830 07:54:53.458813 13882 raft_consensus.cc:357] T d206f6b6e7524a27a9f95787bcd5de77 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:53.458998 13882 raft_consensus.cc:383] T d206f6b6e7524a27a9f95787bcd5de77 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:53.459395 13882 raft_consensus.cc:738] T d206f6b6e7524a27a9f95787bcd5de77 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:54:53.459636 13882 consensus_queue.cc:260] T d206f6b6e7524a27a9f95787bcd5de77 P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:53.460247 13882 ts_tablet_manager.cc:1428] T d206f6b6e7524a27a9f95787bcd5de77 P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
W20250830 07:54:53.461467 13231 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a0170d6430d248888ad83a959cc5418c has no consensus state
I20250830 07:54:53.461817 13231 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_a16a99917f304d8e8387f630efaec482"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:53.462308 13231 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a16a99917f304d8e8387f630efaec482 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:53.465322 13227 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet f479eef0171c401bbd27beec4486a8b2
I20250830 07:54:53.465902 13227 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_0f5408ace198422d8b5c5855ee96a0c9" } modify_external_catalogs: true
I20250830 07:54:53.465993 13477 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "74f2fcc22fd545fb8ca7c20619843023" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:54:53.466084 13227 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_0f5408ace198422d8b5c5855ee96a0c9" } modify_external_catalogs: true
I20250830 07:54:53.466132 13477 raft_consensus.cc:2466] T 74f2fcc22fd545fb8ca7c20619843023 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 0.
I20250830 07:54:53.467408 13593 tablet_service.cc:1515] Processing DeleteTablet for tablet f479eef0171c401bbd27beec4486a8b2 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:53 UTC) from {username='slave'} at 127.0.0.1:45306
I20250830 07:54:53.468997 13229 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_34baaf5f8c9e4e8f9ac45d692fff219e" } modify_external_catalogs: true
I20250830 07:54:53.469146 13229 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_34baaf5f8c9e4e8f9ac45d692fff219e" } modify_external_catalogs: true
W20250830 07:54:53.469303 13422 leader_election.cc:343] T 1520d7257f864ea4ba4b9a5d0443f8a7 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:53.469405 13422 leader_election.cc:304] T 1520d7257f864ea4ba4b9a5d0443f8a7 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba; no voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:54:53.469614 15470 raft_consensus.cc:2747] T 1520d7257f864ea4ba4b9a5d0443f8a7 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:54:53.470297 13477 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "49165f0001044d72b68263a60ef56457" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:54:53.470458 13477 raft_consensus.cc:2466] T 49165f0001044d72b68263a60ef56457 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 0.
I20250830 07:54:53.471099 13422 leader_election.cc:304] T 49165f0001044d72b68263a60ef56457 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:54:53.471315 15470 raft_consensus.cc:2802] T 49165f0001044d72b68263a60ef56457 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:54:53.471393 15470 raft_consensus.cc:491] T 49165f0001044d72b68263a60ef56457 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:54:53.471462 15470 raft_consensus.cc:3058] T 49165f0001044d72b68263a60ef56457 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:53.471567 15412 raft_consensus.cc:491] T 6251a06d1efe44e38d35d962c468f8b2 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:53.471685 15412 raft_consensus.cc:513] T 6251a06d1efe44e38d35d962c468f8b2 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:53.472203 15412 leader_election.cc:290] T 6251a06d1efe44e38d35d962c468f8b2 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:53.473419 13882 tablet_bootstrap.cc:492] T a8baad9c419e436b9659d8d5582d4066 P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:54:53.473798 15470 raft_consensus.cc:513] T 49165f0001044d72b68263a60ef56457 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:53.474304 15470 leader_election.cc:290] T 49165f0001044d72b68263a60ef56457 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 election: Requested vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:53.474663 13619 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "6251a06d1efe44e38d35d962c468f8b2" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:53.474754 13610 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "49165f0001044d72b68263a60ef56457" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9"
I20250830 07:54:53.474869 13882 tablet_bootstrap.cc:654] T a8baad9c419e436b9659d8d5582d4066 P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
W20250830 07:54:53.475034 13423 leader_election.cc:343] T 6251a06d1efe44e38d35d962c468f8b2 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
W20250830 07:54:53.475229 13423 leader_election.cc:343] T 49165f0001044d72b68263a60ef56457 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:53.477447 13887 tablet_bootstrap.cc:654] T ee44ab24333742909f773889ad5c3e00 P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:53.493062 13422 leader_election.cc:304] T 7af74bdde363493f8061eba450ecf4b4 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:54:53.493582 15470 raft_consensus.cc:2802] T 7af74bdde363493f8061eba450ecf4b4 P 2065c332f15a4739899af79f3669c3ba [term 2 FOLLOWER]: Leader election won for term 2
I20250830 07:54:53.493773 15470 raft_consensus.cc:695] T 7af74bdde363493f8061eba450ecf4b4 P 2065c332f15a4739899af79f3669c3ba [term 2 LEADER]: Becoming Leader. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Running, Role: LEADER
I20250830 07:54:53.494001 15470 consensus_queue.cc:237] T 7af74bdde363493f8061eba450ecf4b4 P 2065c332f15a4739899af79f3669c3ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 3, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
W20250830 07:54:53.496501 13226 catalog_manager.cc:5415] Ignoring report from unknown tablet 057bcce2860345da860acc262dc4d339
W20250830 07:54:53.499297 13228 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 843370e8d324489caeb51077cbdc6aa1 consensus state has no leader
W20250830 07:54:53.499409 13232 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 2048c04578104c78aa6504fd9d5953a3 consensus state has no leader
I20250830 07:54:53.499524 13228 master_service.cc:948] ReplaceTablet: received request to replace tablet e74a3e4b3b234c41aca30f772525652e from {username='slave'} at 127.0.0.1:42126
I20250830 07:54:53.499938 13233 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet b85843ab0e3a40e1b453cfdd71bbae5e
I20250830 07:54:53.500469 13233 catalog_manager.cc:6652] ReplaceTablet: tablet b85843ab0e3a40e1b453cfdd71bbae5e deleted and replaced by tablet fcad0ae767a241d2b6babae6c896e9cb
I20250830 07:54:53.501114 13593 tablet_service.cc:1515] Processing DeleteTablet for tablet b85843ab0e3a40e1b453cfdd71bbae5e with delete_type TABLET_DATA_DELETED (replaced by tablet fcad0ae767a241d2b6babae6c896e9cb) from {username='slave'} at 127.0.0.1:45306
I20250830 07:54:53.508466 13225 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_c3d508cca9be462eb81d300064b6c7f1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:53.509027 13225 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c3d508cca9be462eb81d300064b6c7f1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:53.510461 13233 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_afd08643b892462bb9fad8027b002a99"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:53.510941 13233 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_afd08643b892462bb9fad8027b002a99 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:53.512428 13232 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_3fc8320fad174384a19616004d3b6e4e" } modify_external_catalogs: true
I20250830 07:54:53.512601 13232 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_3fc8320fad174384a19616004d3b6e4e" } modify_external_catalogs: true
W20250830 07:54:53.515372 13220 catalog_manager.cc:4908] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet f479eef0171c401bbd27beec4486a8b2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f479eef0171c401bbd27beec4486a8b2 already in progress: creating tablet
W20250830 07:54:53.515584 13220 catalog_manager.cc:4908] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet b85843ab0e3a40e1b453cfdd71bbae5e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b85843ab0e3a40e1b453cfdd71bbae5e already in progress: creating tablet
I20250830 07:54:53.517606 13226 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_c6c765c0af65411b834e2d8dd077ba55"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:53.523590 13226 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c6c765c0af65411b834e2d8dd077ba55 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:53.525086 15342 raft_consensus.cc:491] T 410b1e2d520c470eb4b9ab60104e0cd4 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20250830 07:54:53.527850 13422 leader_election.cc:343] T f5baa35307a1425c8d52666d130d6d8a P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:53.527987 13422 leader_election.cc:304] T f5baa35307a1425c8d52666d130d6d8a P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba; no voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:54:53.528352 15470 raft_consensus.cc:2747] T f5baa35307a1425c8d52666d130d6d8a P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:54:53.529466 13887 tablet_bootstrap.cc:492] T ee44ab24333742909f773889ad5c3e00 P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:54:53.529575 13887 ts_tablet_manager.cc:1397] T ee44ab24333742909f773889ad5c3e00 P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.190s user 0.012s sys 0.001s
I20250830 07:54:53.530198 13887 raft_consensus.cc:357] T ee44ab24333742909f773889ad5c3e00 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:53.530349 13887 raft_consensus.cc:383] T ee44ab24333742909f773889ad5c3e00 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:53.530395 13887 raft_consensus.cc:738] T ee44ab24333742909f773889ad5c3e00 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:54:53.530561 13887 consensus_queue.cc:260] T ee44ab24333742909f773889ad5c3e00 P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:53.534106 13228 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_d0d3f5ffb8794aa7bb8f717df02ebf7e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:53.534644 13228 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d0d3f5ffb8794aa7bb8f717df02ebf7e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:53.537254 13619 raft_consensus.cc:3058] T 4b403cadfb7b42f8896b2ee16b50ecb1 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:53.537209 15481 consensus_queue.cc:1035] T 924403105a6a40f28aad60647a2a8987 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20250830 07:54:53.538518 15342 raft_consensus.cc:513] T 410b1e2d520c470eb4b9ab60104e0cd4 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:53.539362 13617 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "410b1e2d520c470eb4b9ab60104e0cd4" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
W20250830 07:54:53.539822 13703 leader_election.cc:343] T 410b1e2d520c470eb4b9ab60104e0cd4 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:53.539953 13701 leader_election.cc:304] T c1e0e774b86d4ef9a75e2635295f3e2a P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:54:53.540181 15483 raft_consensus.cc:2802] T c1e0e774b86d4ef9a75e2635295f3e2a P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:54:53.540272 15483 raft_consensus.cc:491] T c1e0e774b86d4ef9a75e2635295f3e2a P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:54:53.540349 15483 raft_consensus.cc:3058] T c1e0e774b86d4ef9a75e2635295f3e2a P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:53.542824 15483 raft_consensus.cc:513] T c1e0e774b86d4ef9a75e2635295f3e2a P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:53.543336 15483 leader_election.cc:290] T c1e0e774b86d4ef9a75e2635295f3e2a P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Requested vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967)
I20250830 07:54:53.543462 15342 leader_election.cc:290] T 410b1e2d520c470eb4b9ab60104e0cd4 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967)
I20250830 07:54:53.544147 13886 tablet_bootstrap.cc:654] T 2048c04578104c78aa6504fd9d5953a3 P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:53.547657 13617 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "c1e0e774b86d4ef9a75e2635295f3e2a" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9"
I20250830 07:54:53.550417 13882 tablet_bootstrap.cc:492] T a8baad9c419e436b9659d8d5582d4066 P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:54:53.550542 13882 ts_tablet_manager.cc:1397] T a8baad9c419e436b9659d8d5582d4066 P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.077s user 0.002s sys 0.000s
I20250830 07:54:53.551223 13882 raft_consensus.cc:357] T a8baad9c419e436b9659d8d5582d4066 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:53.551505 15245 raft_consensus.cc:491] T 713c12e1efec4e6f9895c65dc8a9c4b9 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:53.552798 15245 raft_consensus.cc:513] T 713c12e1efec4e6f9895c65dc8a9c4b9 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:53.553224 13887 ts_tablet_manager.cc:1428] T ee44ab24333742909f773889ad5c3e00 P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.024s user 0.001s sys 0.001s
I20250830 07:54:53.553403 15245 leader_election.cc:290] T 713c12e1efec4e6f9895c65dc8a9c4b9 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967)
W20250830 07:54:53.553623 13703 leader_election.cc:343] T c1e0e774b86d4ef9a75e2635295f3e2a P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:53.555123 13617 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "713c12e1efec4e6f9895c65dc8a9c4b9" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:53.556736 13887 tablet_bootstrap.cc:492] T 208995abd6d44dbea3b5ebbea27d6a39 P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
W20250830 07:54:53.557860 13703 leader_election.cc:343] T 713c12e1efec4e6f9895c65dc8a9c4b9 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:53.562757 13882 raft_consensus.cc:383] T a8baad9c419e436b9659d8d5582d4066 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:53.562835 13882 raft_consensus.cc:738] T a8baad9c419e436b9659d8d5582d4066 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:54:53.563036 13882 consensus_queue.cc:260] T a8baad9c419e436b9659d8d5582d4066 P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:53.567062 13882 ts_tablet_manager.cc:1428] T a8baad9c419e436b9659d8d5582d4066 P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.016s user 0.002s sys 0.000s
I20250830 07:54:53.567183 15470 raft_consensus.cc:491] T f66e1d07039841088a444ee0203a4eb0 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:53.567317 15470 raft_consensus.cc:513] T f66e1d07039841088a444ee0203a4eb0 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:53.568284 15470 leader_election.cc:290] T f66e1d07039841088a444ee0203a4eb0 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:53.568511 13619 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f66e1d07039841088a444ee0203a4eb0" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
W20250830 07:54:53.568874 13423 leader_election.cc:343] T f66e1d07039841088a444ee0203a4eb0 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:53.569779 13887 tablet_bootstrap.cc:654] T 208995abd6d44dbea3b5ebbea27d6a39 P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:53.571889 13882 tablet_bootstrap.cc:492] T d37fe59b4f964f30bb1ed4cb00868b75 P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:54:53.573271 13882 tablet_bootstrap.cc:654] T d37fe59b4f964f30bb1ed4cb00868b75 P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:53.573741 13234 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet d0d8a3d95b4b4529a3c95be4c2d7a409
I20250830 07:54:53.574184 13234 catalog_manager.cc:6652] ReplaceTablet: tablet d0d8a3d95b4b4529a3c95be4c2d7a409 deleted and replaced by tablet 0adb8886148c4bd1a6f4936fb858986a
I20250830 07:54:53.574527 13227 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet bdeb89bbb3ad4e67bbc74b78454eeb7e
I20250830 07:54:53.576030 13593 tablet_service.cc:1515] Processing DeleteTablet for tablet d0d8a3d95b4b4529a3c95be4c2d7a409 with delete_type TABLET_DATA_DELETED (replaced by tablet 0adb8886148c4bd1a6f4936fb858986a) from {username='slave'} at 127.0.0.1:45306
I20250830 07:54:53.576232 13602 tablet_service.cc:1515] Processing DeleteTablet for tablet bdeb89bbb3ad4e67bbc74b78454eeb7e with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:53 UTC) from {username='slave'} at 127.0.0.1:45306
W20250830 07:54:53.577282 13220 catalog_manager.cc:4908] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet d0d8a3d95b4b4529a3c95be4c2d7a409 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d0d8a3d95b4b4529a3c95be4c2d7a409 already in progress: creating tablet
W20250830 07:54:53.577541 13220 catalog_manager.cc:4908] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet bdeb89bbb3ad4e67bbc74b78454eeb7e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bdeb89bbb3ad4e67bbc74b78454eeb7e already in progress: creating tablet
W20250830 07:54:53.577534 13231 catalog_manager.cc:5415] Ignoring report from unknown tablet f398e12cd9f543738d5163354f8a9d9d
W20250830 07:54:53.577867 13231 catalog_manager.cc:5415] Ignoring report from unknown tablet 65f1ee59e6e9498381d686f16a865e23
W20250830 07:54:53.577931 13231 catalog_manager.cc:5415] Ignoring report from unknown tablet 95b6f084eb5240ea94c125eaa154ac9f
W20250830 07:54:53.578038 13231 catalog_manager.cc:5415] Ignoring report from unknown tablet 70703eb1d47841a1a227e277ed6a268d
W20250830 07:54:53.578109 13231 catalog_manager.cc:5415] Ignoring report from unknown tablet 88bbd6b4c795433d9b6ad746353f3aa1
W20250830 07:54:53.579604 13422 leader_election.cc:343] T db7144b25ff34bed8c7b779ba9497ef4 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:53.579704 13422 leader_election.cc:304] T db7144b25ff34bed8c7b779ba9497ef4 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba; no voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:54:53.579926 15115 raft_consensus.cc:2747] T db7144b25ff34bed8c7b779ba9497ef4 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20250830 07:54:53.581210 13422 leader_election.cc:343] T 76ab56c469cf4675a4e21acbe0a8085d P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:53.581323 13422 leader_election.cc:304] T 76ab56c469cf4675a4e21acbe0a8085d P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba; no voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:54:53.581691 15115 raft_consensus.cc:2747] T 76ab56c469cf4675a4e21acbe0a8085d P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:54:53.588310 13231 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_3ad1bb0fd8424a7097a2260d0342104c" } new_table_name: "default.Table_8cb6efa5525540c481fca99dcf71177c" modify_external_catalogs: true
I20250830 07:54:53.590761 13227 master_service.cc:948] ReplaceTablet: received request to replace tablet f0b5a16ef15e466d908a623e64391a0f from {username='slave'} at 127.0.0.1:42126
I20250830 07:54:53.592517 13882 tablet_bootstrap.cc:492] T d37fe59b4f964f30bb1ed4cb00868b75 P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:54:53.592650 13882 ts_tablet_manager.cc:1397] T d37fe59b4f964f30bb1ed4cb00868b75 P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.021s user 0.002s sys 0.000s
I20250830 07:54:53.593366 13882 raft_consensus.cc:357] T d37fe59b4f964f30bb1ed4cb00868b75 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:53.593519 13882 raft_consensus.cc:383] T d37fe59b4f964f30bb1ed4cb00868b75 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:53.593568 13882 raft_consensus.cc:738] T d37fe59b4f964f30bb1ed4cb00868b75 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:54:53.593878 15245 raft_consensus.cc:491] T 91705fc35a1b4977b89bac1765c886c0 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:53.594012 15245 raft_consensus.cc:513] T 91705fc35a1b4977b89bac1765c886c0 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:53.594573 15245 leader_election.cc:290] T 91705fc35a1b4977b89bac1765c886c0 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967)
I20250830 07:54:53.595484 13619 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "91705fc35a1b4977b89bac1765c886c0" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:53.596906 13882 consensus_queue.cc:260] T d37fe59b4f964f30bb1ed4cb00868b75 P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:53.597404 13882 ts_tablet_manager.cc:1428] T d37fe59b4f964f30bb1ed4cb00868b75 P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20250830 07:54:53.597663 13882 tablet_bootstrap.cc:492] T 1e48641532cd439e9b4074712033c737 P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
W20250830 07:54:53.598491 13230 catalog_manager.cc:5415] Ignoring report from unknown tablet ee44ab24333742909f773889ad5c3e00
I20250830 07:54:53.598973 13882 tablet_bootstrap.cc:654] T 1e48641532cd439e9b4074712033c737 P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:53.606066 13234 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_7369fede0ccd48d1bc738e5dcda4ab25" } modify_external_catalogs: true
I20250830 07:54:53.606201 13234 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_7369fede0ccd48d1bc738e5dcda4ab25" } modify_external_catalogs: true
W20250830 07:54:53.611438 13703 leader_election.cc:343] T 91705fc35a1b4977b89bac1765c886c0 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
W20250830 07:54:53.611867 13701 leader_election.cc:343] T d206f6b6e7524a27a9f95787bcd5de77 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): Not found: Tablet not found: d206f6b6e7524a27a9f95787bcd5de77
I20250830 07:54:53.612028 13701 leader_election.cc:304] T d206f6b6e7524a27a9f95787bcd5de77 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 2065c332f15a4739899af79f3669c3ba, 6b5e454d98894637b466ea27f1b647f9
I20250830 07:54:53.612304 15245 raft_consensus.cc:2747] T d206f6b6e7524a27a9f95787bcd5de77 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20250830 07:54:53.612383 13701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.209.1:45325, user_credentials={real_user=slave}} blocked reactor thread for 59821.1us
I20250830 07:54:53.612828 13701 leader_election.cc:304] T 042fd7ff08fc4695b87bb8f9d225ef12 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:54:53.613185 13701 leader_election.cc:304] T ef1ab62a5b7845e58d50f34206eaaa27 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:54:53.613205 15245 raft_consensus.cc:2802] T 042fd7ff08fc4695b87bb8f9d225ef12 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:54:53.613438 15245 raft_consensus.cc:491] T 042fd7ff08fc4695b87bb8f9d225ef12 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:54:53.613548 15245 raft_consensus.cc:3058] T 042fd7ff08fc4695b87bb8f9d225ef12 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:53.614193 15483 consensus_queue.cc:1035] T 1e48641532cd439e9b4074712033c737 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:54:53.613436 15481 raft_consensus.cc:2802] T ef1ab62a5b7845e58d50f34206eaaa27 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election won for term 1
I20250830 07:54:53.615067 15481 raft_consensus.cc:695] T ef1ab62a5b7845e58d50f34206eaaa27 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 LEADER]: Becoming Leader. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Running, Role: LEADER
I20250830 07:54:53.615650 15481 consensus_queue.cc:237] T ef1ab62a5b7845e58d50f34206eaaa27 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:53.622215 13882 tablet_bootstrap.cc:492] T 1e48641532cd439e9b4074712033c737 P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:54:53.622367 13882 ts_tablet_manager.cc:1397] T 1e48641532cd439e9b4074712033c737 P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.025s user 0.003s sys 0.000s
I20250830 07:54:53.623016 13882 raft_consensus.cc:357] T 1e48641532cd439e9b4074712033c737 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:53.623165 13882 raft_consensus.cc:383] T 1e48641532cd439e9b4074712033c737 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:53.623217 13882 raft_consensus.cc:738] T 1e48641532cd439e9b4074712033c737 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:54:53.623409 13882 consensus_queue.cc:260] T 1e48641532cd439e9b4074712033c737 P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:53.631110 13882 ts_tablet_manager.cc:1428] T 1e48641532cd439e9b4074712033c737 P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.009s user 0.002s sys 0.000s
I20250830 07:54:53.631398 13882 tablet_bootstrap.cc:492] T 28c2f7a3a6dd444585f0f5d337b985e9 P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:54:53.632875 13882 tablet_bootstrap.cc:654] T 28c2f7a3a6dd444585f0f5d337b985e9 P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
W20250830 07:54:53.636054 13423 consensus_peers.cc:489] T 8dddcfe56522436287aea212e316a729 P 2065c332f15a4739899af79f3669c3ba -> Peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Couldn't send request to peer 6b5e454d98894637b466ea27f1b647f9. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8dddcfe56522436287aea212e316a729. This is attempt 1: this message will repeat every 5th retry.
I20250830 07:54:53.640192 13882 tablet_bootstrap.cc:492] T 28c2f7a3a6dd444585f0f5d337b985e9 P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:54:53.640318 13882 ts_tablet_manager.cc:1397] T 28c2f7a3a6dd444585f0f5d337b985e9 P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.009s user 0.002s sys 0.000s
I20250830 07:54:53.640882 13882 raft_consensus.cc:357] T 28c2f7a3a6dd444585f0f5d337b985e9 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:53.647927 13882 raft_consensus.cc:383] T 28c2f7a3a6dd444585f0f5d337b985e9 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:53.648001 13882 raft_consensus.cc:738] T 28c2f7a3a6dd444585f0f5d337b985e9 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:54:53.648185 13882 consensus_queue.cc:260] T 28c2f7a3a6dd444585f0f5d337b985e9 P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:53.648664 13882 ts_tablet_manager.cc:1428] T 28c2f7a3a6dd444585f0f5d337b985e9 P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.008s user 0.001s sys 0.000s
I20250830 07:54:53.648933 13882 tablet_bootstrap.cc:492] T 43e93d3038f7496ebb18319420ab67e0 P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
W20250830 07:54:53.649380 13230 catalog_manager.cc:5415] Ignoring report from unknown tablet ee44ab24333742909f773889ad5c3e00
I20250830 07:54:53.649899 13229 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet 99c52db41f6747d1a8a1e59157aa4bfd
I20250830 07:54:53.650148 13225 master_service.cc:948] ReplaceTablet: received request to replace tablet f0144701d459480d96c1ece519951442 from {username='slave'} at 127.0.0.1:42126
I20250830 07:54:53.650414 13882 tablet_bootstrap.cc:654] T 43e93d3038f7496ebb18319420ab67e0 P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:53.650136 13230 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_81a5aa0cda9840df824cfce03907e9fa" } new_table_name: "default.Table_f7fd7f508e974a608e35bb9433fc39ec" modify_external_catalogs: true
I20250830 07:54:53.650511 13229 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_a71580c6a95d42d88c3b398b15b8198d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:53.651036 13229 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a71580c6a95d42d88c3b398b15b8198d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:53.653251 13602 tablet_service.cc:1515] Processing DeleteTablet for tablet 99c52db41f6747d1a8a1e59157aa4bfd with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:53 UTC) from {username='slave'} at 127.0.0.1:45306
I20250830 07:54:53.654181 13887 tablet_bootstrap.cc:492] T 208995abd6d44dbea3b5ebbea27d6a39 P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:54:53.654296 13887 ts_tablet_manager.cc:1397] T 208995abd6d44dbea3b5ebbea27d6a39 P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.101s user 0.001s sys 0.011s
I20250830 07:54:53.654438 15245 raft_consensus.cc:513] T 042fd7ff08fc4695b87bb8f9d225ef12 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:53.655314 15245 leader_election.cc:290] T 042fd7ff08fc4695b87bb8f9d225ef12 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Requested vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967)
I20250830 07:54:53.655840 13617 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "042fd7ff08fc4695b87bb8f9d225ef12" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9"
W20250830 07:54:53.659448 13220 catalog_manager.cc:4908] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet 99c52db41f6747d1a8a1e59157aa4bfd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 99c52db41f6747d1a8a1e59157aa4bfd already in progress: creating tablet
I20250830 07:54:53.662722 13887 raft_consensus.cc:357] T 208995abd6d44dbea3b5ebbea27d6a39 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:53.659121 13886 tablet_bootstrap.cc:492] T 2048c04578104c78aa6504fd9d5953a3 P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:54:53.662933 13887 raft_consensus.cc:383] T 208995abd6d44dbea3b5ebbea27d6a39 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:53.662982 13887 raft_consensus.cc:738] T 208995abd6d44dbea3b5ebbea27d6a39 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
W20250830 07:54:53.656257 13703 leader_election.cc:343] T 042fd7ff08fc4695b87bb8f9d225ef12 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:53.663182 13887 consensus_queue.cc:260] T 208995abd6d44dbea3b5ebbea27d6a39 P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:53.669070 13225 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_8f4096dfe88744eba43d043570d30126" } new_table_name: "default.Table_9e37885b3ed4486d979037e283831c39" modify_external_catalogs: true
I20250830 07:54:53.673210 13887 ts_tablet_manager.cc:1428] T 208995abd6d44dbea3b5ebbea27d6a39 P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.019s user 0.000s sys 0.002s
I20250830 07:54:53.673944 13886 ts_tablet_manager.cc:1397] T 2048c04578104c78aa6504fd9d5953a3 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.208s user 0.002s sys 0.002s
I20250830 07:54:53.683310 13887 tablet_bootstrap.cc:492] T 2b4103f07e96490488913059a95af0c3 P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:54:53.683336 13233 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_1cb0265666a24b4fb1b96f5c47d3d1e6" } modify_external_catalogs: true
I20250830 07:54:53.683472 13233 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_1cb0265666a24b4fb1b96f5c47d3d1e6" } modify_external_catalogs: true
I20250830 07:54:53.685078 13887 tablet_bootstrap.cc:654] T 2b4103f07e96490488913059a95af0c3 P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:53.686479 13232 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet a5eea1950d1945f1b755fd34597b2fb4
I20250830 07:54:53.689334 13232 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_545b6e61bc5e4bc58db55a95cfdb3531"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:53.689862 13232 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_545b6e61bc5e4bc58db55a95cfdb3531 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:53.695377 13886 raft_consensus.cc:357] T 2048c04578104c78aa6504fd9d5953a3 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:53.695549 13886 raft_consensus.cc:383] T 2048c04578104c78aa6504fd9d5953a3 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:53.695617 13886 raft_consensus.cc:738] T 2048c04578104c78aa6504fd9d5953a3 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:54:53.695803 13886 consensus_queue.cc:260] T 2048c04578104c78aa6504fd9d5953a3 P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:53.696470 13886 ts_tablet_manager.cc:1428] T 2048c04578104c78aa6504fd9d5953a3 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.022s user 0.001s sys 0.000s
I20250830 07:54:53.703058 13602 tablet_service.cc:1515] Processing DeleteTablet for tablet a5eea1950d1945f1b755fd34597b2fb4 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:53 UTC) from {username='slave'} at 127.0.0.1:45306
I20250830 07:54:53.703712 13629 raft_consensus.cc:3058] T a8baad9c419e436b9659d8d5582d4066 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:53.703830 13226 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_9fe89cf5d2644f189bce96e2a92e8faa"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:53.704330 13226 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9fe89cf5d2644f189bce96e2a92e8faa in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:53.707779 13886 tablet_bootstrap.cc:492] T 97d49a1f600f4c13a4aafca99cedabe8 P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:54:53.709338 13886 tablet_bootstrap.cc:654] T 97d49a1f600f4c13a4aafca99cedabe8 P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
W20250830 07:54:53.709375 13220 catalog_manager.cc:4908] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet a5eea1950d1945f1b755fd34597b2fb4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a5eea1950d1945f1b755fd34597b2fb4 already in progress: creating tablet
I20250830 07:54:53.719048 13887 tablet_bootstrap.cc:492] T 2b4103f07e96490488913059a95af0c3 P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:54:53.719172 13887 ts_tablet_manager.cc:1397] T 2b4103f07e96490488913059a95af0c3 P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.036s user 0.002s sys 0.002s
I20250830 07:54:53.719849 13887 raft_consensus.cc:357] T 2b4103f07e96490488913059a95af0c3 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:53.720010 13887 raft_consensus.cc:383] T 2b4103f07e96490488913059a95af0c3 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:53.720065 13887 raft_consensus.cc:738] T 2b4103f07e96490488913059a95af0c3 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:54:53.720291 13887 consensus_queue.cc:260] T 2b4103f07e96490488913059a95af0c3 P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:53.722775 13228 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_200f184b944748a08e37e88ac1a2d08d" } new_table_name: "default.Table_cbe304346fbe42a8896b8f45deb07292" modify_external_catalogs: true
I20250830 07:54:53.725252 13887 ts_tablet_manager.cc:1428] T 2b4103f07e96490488913059a95af0c3 P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
I20250830 07:54:53.725507 13887 tablet_bootstrap.cc:492] T 14d4d2506e2a47ea906bfb81d5509829 P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
W20250830 07:54:53.727712 13231 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 14550e5f0308438fbd5eb78429720c2c has no consensus state
I20250830 07:54:53.728055 13231 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_11c05d685c1d4a1e9d6b1cede36d73b3" } new_table_name: "default.Table_0e0efb79fc16404bae9fc0544ef6aa04" modify_external_catalogs: true
W20250830 07:54:53.728595 13230 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 6bd5f6b3e0a0420c8c4e6e2987d97db3 has no consensus state
I20250830 07:54:53.728957 13230 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_a3d8084312ea451494bee95674f46b8d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:53.729441 13230 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a3d8084312ea451494bee95674f46b8d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:53.729468 13227 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet f0b5a16ef15e466d908a623e64391a0f
I20250830 07:54:53.729909 13227 catalog_manager.cc:6652] ReplaceTablet: tablet f0b5a16ef15e466d908a623e64391a0f deleted and replaced by tablet 3ce6f41484c048e3ac6bc88dddd8ce33
I20250830 07:54:53.730204 13234 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet 3525652a73b8413b8ccbcb5824cc5880
W20250830 07:54:53.731156 13225 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet de6696dfa435483797fe2cda3e06190b has no consensus state
I20250830 07:54:53.731374 15514 raft_consensus.cc:491] T 0208de98277c4d6889fb0289b6013ae1 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:53.731477 15514 raft_consensus.cc:513] T 0208de98277c4d6889fb0289b6013ae1 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:53.731565 13602 tablet_service.cc:1515] Processing DeleteTablet for tablet f0b5a16ef15e466d908a623e64391a0f with delete_type TABLET_DATA_DELETED (replaced by tablet 3ce6f41484c048e3ac6bc88dddd8ce33) from {username='slave'} at 127.0.0.1:45306
I20250830 07:54:53.731758 13593 tablet_service.cc:1515] Processing DeleteTablet for tablet 3525652a73b8413b8ccbcb5824cc5880 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:53 UTC) from {username='slave'} at 127.0.0.1:45306
I20250830 07:54:53.732003 15514 leader_election.cc:290] T 0208de98277c4d6889fb0289b6013ae1 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:53.732105 15047 tablet_replica.cc:331] T 3525652a73b8413b8ccbcb5824cc5880 P 6b5e454d98894637b466ea27f1b647f9: stopping tablet replica
I20250830 07:54:53.732292 15047 raft_consensus.cc:2241] T 3525652a73b8413b8ccbcb5824cc5880 P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250830 07:54:53.732440 15047 raft_consensus.cc:2270] T 3525652a73b8413b8ccbcb5824cc5880 P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250830 07:54:53.732749 13619 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "0208de98277c4d6889fb0289b6013ae1" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
W20250830 07:54:53.734431 13220 catalog_manager.cc:4908] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet f0b5a16ef15e466d908a623e64391a0f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f0b5a16ef15e466d908a623e64391a0f already in progress: creating tablet
W20250830 07:54:53.735525 13423 leader_election.cc:343] T 0208de98277c4d6889fb0289b6013ae1 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:53.736320 13887 tablet_bootstrap.cc:654] T 14d4d2506e2a47ea906bfb81d5509829 P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:53.736368 15047 ts_tablet_manager.cc:1905] T 3525652a73b8413b8ccbcb5824cc5880 P 6b5e454d98894637b466ea27f1b647f9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250830 07:54:53.739629 15514 raft_consensus.cc:491] T 2b4103f07e96490488913059a95af0c3 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:53.739773 15514 raft_consensus.cc:513] T 2b4103f07e96490488913059a95af0c3 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:53.740248 15514 leader_election.cc:290] T 2b4103f07e96490488913059a95af0c3 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:53.741771 13619 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "2b4103f07e96490488913059a95af0c3" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
W20250830 07:54:53.742244 13423 leader_election.cc:343] T 2b4103f07e96490488913059a95af0c3 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:53.744401 13887 tablet_bootstrap.cc:492] T 14d4d2506e2a47ea906bfb81d5509829 P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:54:53.744513 13887 ts_tablet_manager.cc:1397] T 14d4d2506e2a47ea906bfb81d5509829 P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.019s user 0.001s sys 0.003s
I20250830 07:54:53.745080 13887 raft_consensus.cc:357] T 14d4d2506e2a47ea906bfb81d5509829 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:53.745209 13887 raft_consensus.cc:383] T 14d4d2506e2a47ea906bfb81d5509829 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:53.745268 13887 raft_consensus.cc:738] T 14d4d2506e2a47ea906bfb81d5509829 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:54:53.748927 15047 ts_tablet_manager.cc:1918] T 3525652a73b8413b8ccbcb5824cc5880 P 6b5e454d98894637b466ea27f1b647f9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250830 07:54:53.749096 15047 log.cc:1199] T 3525652a73b8413b8ccbcb5824cc5880 P 6b5e454d98894637b466ea27f1b647f9: Deleting WAL directory at /tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/ts-1/wal/wals/3525652a73b8413b8ccbcb5824cc5880
I20250830 07:54:53.752573 15047 ts_tablet_manager.cc:1939] T 3525652a73b8413b8ccbcb5824cc5880 P 6b5e454d98894637b466ea27f1b647f9: Deleting consensus metadata
I20250830 07:54:53.755019 13220 catalog_manager.cc:4928] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): tablet 3525652a73b8413b8ccbcb5824cc5880 (table default.Table_7369fede0ccd48d1bc738e5dcda4ab25 [id=af6c7908ff81481bbd041214ae6cf74c]) successfully deleted
I20250830 07:54:53.755049 13887 consensus_queue.cc:260] T 14d4d2506e2a47ea906bfb81d5509829 P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:53.756330 13887 ts_tablet_manager.cc:1428] T 14d4d2506e2a47ea906bfb81d5509829 P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.012s user 0.001s sys 0.001s
I20250830 07:54:53.756603 13887 tablet_bootstrap.cc:492] T f32ebc2605c34a68aed50379f028052c P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:54:53.760896 13233 catalog_manager.cc:5864] Not sending DeleteTablet requests; no consensus state for tablet f451f8da149440ec9a252a642d98a339
I20250830 07:54:53.756549 13701 leader_election.cc:304] T 3bb48fce24074a8e8ec99d3172a655d8 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:54:53.764931 15481 raft_consensus.cc:2802] T 3bb48fce24074a8e8ec99d3172a655d8 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election won for term 1
I20250830 07:54:53.765195 15481 raft_consensus.cc:695] T 3bb48fce24074a8e8ec99d3172a655d8 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 LEADER]: Becoming Leader. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Running, Role: LEADER
I20250830 07:54:53.765482 15481 consensus_queue.cc:237] T 3bb48fce24074a8e8ec99d3172a655d8 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:53.766970 13887 tablet_bootstrap.cc:654] T f32ebc2605c34a68aed50379f028052c P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
W20250830 07:54:53.767074 13701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.209.1:45325, user_credentials={real_user=slave}} blocked reactor thread for 108933us
I20250830 07:54:53.772984 15115 raft_consensus.cc:491] T 410b1e2d520c470eb4b9ab60104e0cd4 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:53.773102 15115 raft_consensus.cc:513] T 410b1e2d520c470eb4b9ab60104e0cd4 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:53.773631 15115 leader_election.cc:290] T 410b1e2d520c470eb4b9ab60104e0cd4 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
W20250830 07:54:53.776129 13703 consensus_peers.cc:489] T 3525652a73b8413b8ccbcb5824cc5880 P 9b057ade5dce45af9f8bf0bedf8b917f -> Peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Couldn't send request to peer 6b5e454d98894637b466ea27f1b647f9. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3525652a73b8413b8ccbcb5824cc5880. This is attempt 1: this message will repeat every 5th retry.
I20250830 07:54:53.779426 13617 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "410b1e2d520c470eb4b9ab60104e0cd4" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
W20250830 07:54:53.780021 13423 leader_election.cc:343] T 410b1e2d520c470eb4b9ab60104e0cd4 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:53.786866 13887 tablet_bootstrap.cc:492] T f32ebc2605c34a68aed50379f028052c P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:54:53.787057 13887 ts_tablet_manager.cc:1397] T f32ebc2605c34a68aed50379f028052c P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.031s user 0.004s sys 0.000s
I20250830 07:54:53.788347 13887 raft_consensus.cc:357] T f32ebc2605c34a68aed50379f028052c P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:53.788558 13887 raft_consensus.cc:383] T f32ebc2605c34a68aed50379f028052c P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:53.788674 13887 raft_consensus.cc:738] T f32ebc2605c34a68aed50379f028052c P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:54:53.788933 13887 consensus_queue.cc:260] T f32ebc2605c34a68aed50379f028052c P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:53.789741 13887 ts_tablet_manager.cc:1428] T f32ebc2605c34a68aed50379f028052c P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20250830 07:54:53.795995 13887 tablet_bootstrap.cc:492] T 240a6bfad8fa478598a67a27c2dedf62 P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:54:53.797605 13887 tablet_bootstrap.cc:654] T 240a6bfad8fa478598a67a27c2dedf62 P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:53.799865 13233 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_4fcd22dc65a5427aa8148aeee40b28b7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:53.800485 13233 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4fcd22dc65a5427aa8148aeee40b28b7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:53.801815 13229 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_a46508e1ad0746d7a50bfe30cbaeb98a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:53.802311 13229 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a46508e1ad0746d7a50bfe30cbaeb98a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:53.802901 13225 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_8328de94ee574e429f650408a6a94f3a" } modify_external_catalogs: true
I20250830 07:54:53.803073 13225 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_8328de94ee574e429f650408a6a94f3a" } modify_external_catalogs: true
W20250830 07:54:53.805969 13232 catalog_manager.cc:5415] Ignoring report from unknown tablet 1fa571e9490e499792225d7b786e8658
W20250830 07:54:53.806147 13232 catalog_manager.cc:5415] Ignoring report from unknown tablet 057bcce2860345da860acc262dc4d339
W20250830 07:54:53.806273 13232 catalog_manager.cc:5415] Ignoring report from unknown tablet 04eadf45b82e4c319eb7b316a402d81a
W20250830 07:54:53.806371 13232 catalog_manager.cc:5415] Ignoring report from unknown tablet a8baad9c419e436b9659d8d5582d4066
W20250830 07:54:53.806452 13232 catalog_manager.cc:5415] Ignoring report from unknown tablet f398e12cd9f543738d5163354f8a9d9d
I20250830 07:54:53.807054 13232 catalog_manager.cc:5674] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743) does not have the latest schema for tablet 0ceccc5f18294356894695fe08d73e30 (table default.Table_32d032fe8fba47348e797c68bb7ea866 [id=0e99ba575a7a4f8dae74a98627249018]). Expected version 1 got 0
I20250830 07:54:53.814396 13882 tablet_bootstrap.cc:492] T 43e93d3038f7496ebb18319420ab67e0 P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:54:53.818044 13887 tablet_bootstrap.cc:492] T 240a6bfad8fa478598a67a27c2dedf62 P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:54:53.818172 13887 ts_tablet_manager.cc:1397] T 240a6bfad8fa478598a67a27c2dedf62 P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.022s user 0.004s sys 0.003s
I20250830 07:54:53.818841 13887 raft_consensus.cc:357] T 240a6bfad8fa478598a67a27c2dedf62 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:53.819017 13887 raft_consensus.cc:383] T 240a6bfad8fa478598a67a27c2dedf62 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:53.819079 13887 raft_consensus.cc:738] T 240a6bfad8fa478598a67a27c2dedf62 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:54:53.819293 13887 consensus_queue.cc:260] T 240a6bfad8fa478598a67a27c2dedf62 P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:53.819772 13887 ts_tablet_manager.cc:1428] T 240a6bfad8fa478598a67a27c2dedf62 P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20250830 07:54:53.820036 13887 tablet_bootstrap.cc:492] T 579324e1f6474d398db10da3093650dd P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:54:53.821604 13887 tablet_bootstrap.cc:654] T 579324e1f6474d398db10da3093650dd P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
W20250830 07:54:53.821755 13228 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 91da20bcd25341b5a0f6605b3ec58fb3 consensus state has no leader
W20250830 07:54:53.827447 13228 catalog_manager.cc:5415] Ignoring report from unknown tablet d33a5d107c6849aca6eb48ffdf8a5463
W20250830 07:54:53.827589 13228 catalog_manager.cc:5415] Ignoring report from unknown tablet 2b4103f07e96490488913059a95af0c3
W20250830 07:54:53.831105 13231 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet e2e92957ca6b498c9fd76a97225492d5 has no consensus state
I20250830 07:54:53.832274 13882 ts_tablet_manager.cc:1397] T 43e93d3038f7496ebb18319420ab67e0 P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.183s user 0.002s sys 0.007s
I20250830 07:54:53.832860 13882 raft_consensus.cc:357] T 43e93d3038f7496ebb18319420ab67e0 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:53.833022 13882 raft_consensus.cc:383] T 43e93d3038f7496ebb18319420ab67e0 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:53.833074 13882 raft_consensus.cc:738] T 43e93d3038f7496ebb18319420ab67e0 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:54:53.839689 13887 tablet_bootstrap.cc:492] T 579324e1f6474d398db10da3093650dd P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:54:53.840317 13887 ts_tablet_manager.cc:1397] T 579324e1f6474d398db10da3093650dd P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.020s user 0.002s sys 0.001s
I20250830 07:54:53.841374 13887 raft_consensus.cc:357] T 579324e1f6474d398db10da3093650dd P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:53.841529 13887 raft_consensus.cc:383] T 579324e1f6474d398db10da3093650dd P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:53.841578 13887 raft_consensus.cc:738] T 579324e1f6474d398db10da3093650dd P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:54:53.841773 13887 consensus_queue.cc:260] T 579324e1f6474d398db10da3093650dd P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:53.842309 13887 ts_tablet_manager.cc:1428] T 579324e1f6474d398db10da3093650dd P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20250830 07:54:53.842551 13887 tablet_bootstrap.cc:492] T a0cf1de8485941eb8a557a6e2f783047 P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:54:53.837872 13231 catalog_manager.cc:5674] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325) does not have the latest schema for tablet 240a6bfad8fa478598a67a27c2dedf62 (table default.Table_f6bd1f04d55045ef97fc62076520c6a6 [id=5cf34164ee9a4670ae243486fc71bd5f]). Expected version 1 got 0
I20250830 07:54:53.844071 13887 tablet_bootstrap.cc:654] T a0cf1de8485941eb8a557a6e2f783047 P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:53.851755 13231 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_1baaad25c30a45fa8d70fd9fafe5fc89" } modify_external_catalogs: true
I20250830 07:54:53.851966 13231 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_1baaad25c30a45fa8d70fd9fafe5fc89" } modify_external_catalogs: true
I20250830 07:54:53.853375 13230 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_c8c1c225830447f8ac3a929bfd4c63bf"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:53.854003 13230 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c8c1c225830447f8ac3a929bfd4c63bf in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:53.858212 13882 consensus_queue.cc:260] T 43e93d3038f7496ebb18319420ab67e0 P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:53.858758 13882 ts_tablet_manager.cc:1428] T 43e93d3038f7496ebb18319420ab67e0 P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.026s user 0.000s sys 0.001s
I20250830 07:54:53.867579 15483 consensus_queue.cc:1035] T 5235e1a32f044f0cbf882e338c482003 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:54:53.870183 15483 consensus_queue.cc:1035] T 7c5e50cb605c4a40b47984f328eedd93 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:54:53.870462 13882 tablet_bootstrap.cc:492] T 087bb1e80d2d44bf8619b0341ff99527 P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:54:53.874573 13701 leader_election.cc:304] T 74f2fcc22fd545fb8ca7c20619843023 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:54:53.875255 15500 raft_consensus.cc:2802] T 74f2fcc22fd545fb8ca7c20619843023 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:54:53.875375 15500 raft_consensus.cc:491] T 74f2fcc22fd545fb8ca7c20619843023 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:54:53.875465 15500 raft_consensus.cc:3058] T 74f2fcc22fd545fb8ca7c20619843023 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:53.877969 15500 raft_consensus.cc:513] T 74f2fcc22fd545fb8ca7c20619843023 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:53.878561 15500 leader_election.cc:290] T 74f2fcc22fd545fb8ca7c20619843023 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Requested vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967)
I20250830 07:54:53.879513 13617 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "74f2fcc22fd545fb8ca7c20619843023" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9"
W20250830 07:54:53.880072 13703 leader_election.cc:343] T 74f2fcc22fd545fb8ca7c20619843023 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:53.887414 13887 tablet_bootstrap.cc:492] T a0cf1de8485941eb8a557a6e2f783047 P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:54:53.887562 13887 ts_tablet_manager.cc:1397] T a0cf1de8485941eb8a557a6e2f783047 P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.045s user 0.003s sys 0.000s
I20250830 07:54:53.888345 13887 raft_consensus.cc:357] T a0cf1de8485941eb8a557a6e2f783047 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:53.888533 13887 raft_consensus.cc:383] T a0cf1de8485941eb8a557a6e2f783047 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:53.888589 13887 raft_consensus.cc:738] T a0cf1de8485941eb8a557a6e2f783047 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:54:53.888804 13887 consensus_queue.cc:260] T a0cf1de8485941eb8a557a6e2f783047 P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:53.889297 13887 ts_tablet_manager.cc:1428] T a0cf1de8485941eb8a557a6e2f783047 P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20250830 07:54:53.889549 13887 tablet_bootstrap.cc:492] T ddedd1f141c147c69f178c6cd2b287da P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:54:53.891100 13887 tablet_bootstrap.cc:654] T ddedd1f141c147c69f178c6cd2b287da P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:53.900033 13886 tablet_bootstrap.cc:492] T 97d49a1f600f4c13a4aafca99cedabe8 P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:54:53.900240 13886 ts_tablet_manager.cc:1397] T 97d49a1f600f4c13a4aafca99cedabe8 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.193s user 0.001s sys 0.009s
I20250830 07:54:53.905061 13882 tablet_bootstrap.cc:654] T 087bb1e80d2d44bf8619b0341ff99527 P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:53.910131 15500 raft_consensus.cc:491] T 10ec97b8a82145479e0bb526c4cc7c05 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:53.910277 15500 raft_consensus.cc:513] T 10ec97b8a82145479e0bb526c4cc7c05 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:53.910866 15500 leader_election.cc:290] T 10ec97b8a82145479e0bb526c4cc7c05 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967)
I20250830 07:54:53.912824 13701 leader_election.cc:304] T 49165f0001044d72b68263a60ef56457 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:54:53.913223 15500 raft_consensus.cc:2802] T 49165f0001044d72b68263a60ef56457 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:54:53.913316 15500 raft_consensus.cc:491] T 49165f0001044d72b68263a60ef56457 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:54:53.913394 15500 raft_consensus.cc:3058] T 49165f0001044d72b68263a60ef56457 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:53.914724 13619 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "10ec97b8a82145479e0bb526c4cc7c05" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:53.916087 15500 raft_consensus.cc:513] T 49165f0001044d72b68263a60ef56457 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:53.916510 13225 catalog_manager.cc:5864] Not sending DeleteTablet requests; no consensus state for tablet bf3edd80b15f4e2895b9c1b4bb2e36f9
I20250830 07:54:53.916747 15500 leader_election.cc:290] T 49165f0001044d72b68263a60ef56457 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Requested vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967)
I20250830 07:54:53.916918 13234 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_1ee848207f8a41f8b2571a976cf26389"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:53.917411 13234 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1ee848207f8a41f8b2571a976cf26389 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:53.918637 13226 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_c9d4e0d978fd457ba6fe42b41b30f607"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:53.919104 13226 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c9d4e0d978fd457ba6fe42b41b30f607 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250830 07:54:53.919323 13703 leader_election.cc:343] T 10ec97b8a82145479e0bb526c4cc7c05 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:53.919298 13619 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "49165f0001044d72b68263a60ef56457" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9"
W20250830 07:54:53.919759 13703 leader_election.cc:343] T 49165f0001044d72b68263a60ef56457 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:53.920202 13886 raft_consensus.cc:357] T 97d49a1f600f4c13a4aafca99cedabe8 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:53.920284 13232 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_3c2f79a13fe642769065e2bc5fb22872" } modify_external_catalogs: true
I20250830 07:54:53.920359 13886 raft_consensus.cc:383] T 97d49a1f600f4c13a4aafca99cedabe8 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:53.920430 13886 raft_consensus.cc:738] T 97d49a1f600f4c13a4aafca99cedabe8 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:54:53.920428 13232 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_3c2f79a13fe642769065e2bc5fb22872" } modify_external_catalogs: true
I20250830 07:54:53.920621 13886 consensus_queue.cc:260] T 97d49a1f600f4c13a4aafca99cedabe8 P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:53.921106 13886 ts_tablet_manager.cc:1428] T 97d49a1f600f4c13a4aafca99cedabe8 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.021s user 0.001s sys 0.001s
I20250830 07:54:53.921382 13886 tablet_bootstrap.cc:492] T 6251a06d1efe44e38d35d962c468f8b2 P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
W20250830 07:54:53.922379 13220 catalog_manager.cc:4726] Async tablet task AlterTable RPC for tablet f4d87048a4a44eb8ad5c818a129180c9 (table default.Table_c8691380fb7546fdbf2b7e92ec777cbd [id=c194c20aca144145b019f088c144fb8d], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet f4d87048a4a44eb8ad5c818a129180c9 has no consensus state
I20250830 07:54:53.922567 13231 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet 579324e1f6474d398db10da3093650dd
I20250830 07:54:53.923563 13593 tablet_service.cc:1515] Processing DeleteTablet for tablet 579324e1f6474d398db10da3093650dd with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:53 UTC) from {username='slave'} at 127.0.0.1:45306
W20250830 07:54:53.924229 13220 catalog_manager.cc:4908] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet 579324e1f6474d398db10da3093650dd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 579324e1f6474d398db10da3093650dd already in progress: creating tablet
I20250830 07:54:53.926780 13228 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_723fcb2cd7134974844767cfe9622e4e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:53.927223 13228 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_723fcb2cd7134974844767cfe9622e4e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:53.930022 15115 raft_consensus.cc:491] T 8cce7e5537794e9484f5a7c82b9e6e1d P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:53.930157 15115 raft_consensus.cc:513] T 8cce7e5537794e9484f5a7c82b9e6e1d P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:53.930719 15115 leader_election.cc:290] T 8cce7e5537794e9484f5a7c82b9e6e1d P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:53.931243 15115 raft_consensus.cc:491] T 2048c04578104c78aa6504fd9d5953a3 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:53.931351 15115 raft_consensus.cc:513] T 2048c04578104c78aa6504fd9d5953a3 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:53.931842 15115 leader_election.cc:290] T 2048c04578104c78aa6504fd9d5953a3 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:53.932511 13619 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "8cce7e5537794e9484f5a7c82b9e6e1d" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:53.932811 13617 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "2048c04578104c78aa6504fd9d5953a3" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
W20250830 07:54:53.933226 13423 leader_election.cc:343] T 8cce7e5537794e9484f5a7c82b9e6e1d P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
W20250830 07:54:53.933393 13423 leader_election.cc:343] T 2048c04578104c78aa6504fd9d5953a3 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:53.933449 13231 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_88d35396b3cc42279534b96adf03c731" } new_table_name: "default.Table_9448db42e6794109b73536d8a0dd8264" modify_external_catalogs: true
I20250830 07:54:53.935657 13230 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_50658f5ec9ba40ffaf681fc817ae6b47" } new_table_name: "default.Table_c5f5589680204e3398db84e86cb9a590" modify_external_catalogs: true
I20250830 07:54:53.935727 13225 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_e3b4cbde7b4842cca80dc361162cc937" } modify_external_catalogs: true
I20250830 07:54:53.935868 13225 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_e3b4cbde7b4842cca80dc361162cc937" } modify_external_catalogs: true
I20250830 07:54:53.936695 13887 tablet_bootstrap.cc:492] T ddedd1f141c147c69f178c6cd2b287da P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:54:53.936815 13887 ts_tablet_manager.cc:1397] T ddedd1f141c147c69f178c6cd2b287da P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.047s user 0.001s sys 0.002s
I20250830 07:54:53.937290 13229 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_fca7e4d8a83e4108a127b5dd45c1ffee"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250830 07:54:53.937590 13887 raft_consensus.cc:357] T ddedd1f141c147c69f178c6cd2b287da P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
W20250830 07:54:53.937717 13229 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fca7e4d8a83e4108a127b5dd45c1ffee in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:53.937783 13887 raft_consensus.cc:383] T ddedd1f141c147c69f178c6cd2b287da P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:53.937834 13887 raft_consensus.cc:738] T ddedd1f141c147c69f178c6cd2b287da P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:54:53.939321 13887 consensus_queue.cc:260] T ddedd1f141c147c69f178c6cd2b287da P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:53.939800 13887 ts_tablet_manager.cc:1428] T ddedd1f141c147c69f178c6cd2b287da P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20250830 07:54:53.948912 13227 master_service.cc:948] ReplaceTablet: received request to replace tablet f0144701d459480d96c1ece519951442 from {username='slave'} at 127.0.0.1:42126
I20250830 07:54:53.950254 13617 raft_consensus.cc:3058] T d37fe59b4f964f30bb1ed4cb00868b75 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:53.957196 13887 tablet_bootstrap.cc:492] T e72402ca3cdf452fa8f4534c67226253 P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:54:53.957733 13233 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_9bdcf0c2f2aa4dc18f78900c21e4cbf7" } new_table_name: "default.Table_f2854f37a49f4c0db82c12fabdfacc03" modify_external_catalogs: true
I20250830 07:54:53.959218 13887 tablet_bootstrap.cc:654] T e72402ca3cdf452fa8f4534c67226253 P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:53.961050 13232 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet 736de5dbaf7f4f449f6fc323ab6a72d8
W20250830 07:54:53.961102 13231 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 73692fe73235422dbbb342caabfb0927 consensus state has no leader
I20250830 07:54:53.961643 13593 tablet_service.cc:1515] Processing DeleteTablet for tablet 736de5dbaf7f4f449f6fc323ab6a72d8 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:53 UTC) from {username='slave'} at 127.0.0.1:45306
W20250830 07:54:53.962354 13220 catalog_manager.cc:4908] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet 736de5dbaf7f4f449f6fc323ab6a72d8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 736de5dbaf7f4f449f6fc323ab6a72d8 already in progress: creating tablet
I20250830 07:54:53.962774 13232 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_a3d8084312ea451494bee95674f46b8d" } modify_external_catalogs: true
I20250830 07:54:53.962942 13232 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_a3d8084312ea451494bee95674f46b8d" } modify_external_catalogs: true
I20250830 07:54:53.966424 13228 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_8548f2b1bc5942aeae4f2ae46f7f3d41"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:53.966879 13228 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8548f2b1bc5942aeae4f2ae46f7f3d41 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:53.968025 13882 tablet_bootstrap.cc:492] T 087bb1e80d2d44bf8619b0341ff99527 P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:54:53.968199 13882 ts_tablet_manager.cc:1397] T 087bb1e80d2d44bf8619b0341ff99527 P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.098s user 0.002s sys 0.001s
I20250830 07:54:53.969652 13882 raft_consensus.cc:357] T 087bb1e80d2d44bf8619b0341ff99527 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:53.969875 13882 raft_consensus.cc:383] T 087bb1e80d2d44bf8619b0341ff99527 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:53.969965 13882 raft_consensus.cc:738] T 087bb1e80d2d44bf8619b0341ff99527 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:54:53.970248 13882 consensus_queue.cc:260] T 087bb1e80d2d44bf8619b0341ff99527 P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:53.971071 13882 ts_tablet_manager.cc:1428] T 087bb1e80d2d44bf8619b0341ff99527 P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20250830 07:54:53.971374 13882 tablet_bootstrap.cc:492] T e6060a3dc6444483b8fb2944b8090cb6 P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:54:53.973713 13882 tablet_bootstrap.cc:654] T e6060a3dc6444483b8fb2944b8090cb6 P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
W20250830 07:54:53.988708 13233 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 7e5c24ecafb04287bc51bbfb68f294ee has no consensus state
I20250830 07:54:53.989141 13225 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet a0cf1de8485941eb8a557a6e2f783047
I20250830 07:54:53.989630 13887 tablet_bootstrap.cc:492] T e72402ca3cdf452fa8f4534c67226253 P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:54:53.989766 13887 ts_tablet_manager.cc:1397] T e72402ca3cdf452fa8f4534c67226253 P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.033s user 0.002s sys 0.006s
W20250830 07:54:53.990335 13230 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet fbb1cc8f8eea4a0795f6f8e213b8180f consensus state has no leader
I20250830 07:54:53.990943 13887 raft_consensus.cc:357] T e72402ca3cdf452fa8f4534c67226253 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:53.991112 13887 raft_consensus.cc:383] T e72402ca3cdf452fa8f4534c67226253 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:53.991165 13887 raft_consensus.cc:738] T e72402ca3cdf452fa8f4534c67226253 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:54:53.991359 13887 consensus_queue.cc:260] T e72402ca3cdf452fa8f4534c67226253 P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:53.991953 13887 ts_tablet_manager.cc:1428] T e72402ca3cdf452fa8f4534c67226253 P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20250830 07:54:53.992218 13887 tablet_bootstrap.cc:492] T 5fee48de90014f94b796e726a4d16b85 P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:54:53.976831 13619 raft_consensus.cc:3058] T b83dfc54383d4e7b96523568aea5c9f3 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:53.997759 13887 tablet_bootstrap.cc:654] T 5fee48de90014f94b796e726a4d16b85 P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:53.989768 13593 tablet_service.cc:1515] Processing DeleteTablet for tablet a0cf1de8485941eb8a557a6e2f783047 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:53 UTC) from {username='slave'} at 127.0.0.1:45306
W20250830 07:54:53.998631 13220 catalog_manager.cc:4908] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet a0cf1de8485941eb8a557a6e2f783047 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a0cf1de8485941eb8a557a6e2f783047 already in progress: creating tablet
I20250830 07:54:53.998865 13232 catalog_manager.cc:5864] Not sending DeleteTablet requests; no consensus state for tablet 93832dbc25b343ad9bafafab084d5655
I20250830 07:54:54.015136 13887 tablet_bootstrap.cc:492] T 5fee48de90014f94b796e726a4d16b85 P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:54:54.015278 13887 ts_tablet_manager.cc:1397] T 5fee48de90014f94b796e726a4d16b85 P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.023s user 0.001s sys 0.002s
I20250830 07:54:54.015532 13882 tablet_bootstrap.cc:492] T e6060a3dc6444483b8fb2944b8090cb6 P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:54:54.015645 13882 ts_tablet_manager.cc:1397] T e6060a3dc6444483b8fb2944b8090cb6 P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.044s user 0.004s sys 0.001s
I20250830 07:54:54.016306 13882 raft_consensus.cc:357] T e6060a3dc6444483b8fb2944b8090cb6 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:54.016477 13882 raft_consensus.cc:383] T e6060a3dc6444483b8fb2944b8090cb6 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:54.016405 13480 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "c1e0e774b86d4ef9a75e2635295f3e2a" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba"
I20250830 07:54:54.016534 13882 raft_consensus.cc:738] T e6060a3dc6444483b8fb2944b8090cb6 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:54:54.016589 13480 raft_consensus.cc:3058] T c1e0e774b86d4ef9a75e2635295f3e2a P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:54.016680 13485 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "410b1e2d520c470eb4b9ab60104e0cd4" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:54:54.016750 13882 consensus_queue.cc:260] T e6060a3dc6444483b8fb2944b8090cb6 P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:54.016855 13485 raft_consensus.cc:2466] T 410b1e2d520c470eb4b9ab60104e0cd4 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 0.
I20250830 07:54:54.017652 13882 ts_tablet_manager.cc:1428] T e6060a3dc6444483b8fb2944b8090cb6 P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20250830 07:54:54.017650 13485 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "713c12e1efec4e6f9895c65dc8a9c4b9" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:54:54.017815 13485 raft_consensus.cc:2466] T 713c12e1efec4e6f9895c65dc8a9c4b9 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 0.
I20250830 07:54:54.017895 13882 tablet_bootstrap.cc:492] T 410b1e2d520c470eb4b9ab60104e0cd4 P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:54:54.018646 13485 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "91705fc35a1b4977b89bac1765c886c0" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:54:54.018795 13485 raft_consensus.cc:2466] T 91705fc35a1b4977b89bac1765c886c0 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 0.
I20250830 07:54:54.019256 13882 tablet_bootstrap.cc:654] T 410b1e2d520c470eb4b9ab60104e0cd4 P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:54.020442 13480 raft_consensus.cc:2466] T c1e0e774b86d4ef9a75e2635295f3e2a P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 1.
I20250830 07:54:54.022477 13887 raft_consensus.cc:357] T 5fee48de90014f94b796e726a4d16b85 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:54.022723 13887 raft_consensus.cc:383] T 5fee48de90014f94b796e726a4d16b85 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:54.022789 13887 raft_consensus.cc:738] T 5fee48de90014f94b796e726a4d16b85 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:54:54.023022 13887 consensus_queue.cc:260] T 5fee48de90014f94b796e726a4d16b85 P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:54.023331 13629 raft_consensus.cc:3058] T e6060a3dc6444483b8fb2944b8090cb6 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:54.023487 13887 ts_tablet_manager.cc:1428] T 5fee48de90014f94b796e726a4d16b85 P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.008s user 0.002s sys 0.000s
I20250830 07:54:54.023734 13887 tablet_bootstrap.cc:492] T 2c31d119743f49589703c434ac6c7548 P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:54:54.024372 13228 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_f2003681d72a4da9a7e8884c5c79b5b1" } new_table_name: "default.Table_19fd51d532df4b06ac26c3b2b50d51db" modify_external_catalogs: true
I20250830 07:54:54.025194 13887 tablet_bootstrap.cc:654] T 2c31d119743f49589703c434ac6c7548 P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:54.026448 15365 consensus_queue.cc:1035] T e6060a3dc6444483b8fb2944b8090cb6 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:54:54.026767 13232 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_099bcc62239543ad8c7992faebeecb32"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:54.027448 13232 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_099bcc62239543ad8c7992faebeecb32 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250830 07:54:54.031813 13228 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a97b6434118b4fbc9182e009e072ccc8 has no consensus state
I20250830 07:54:54.033994 13228 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_726218820e3c4b4ebe1b7f625afaccdf"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:54.034550 13228 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_726218820e3c4b4ebe1b7f625afaccdf in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:54.035593 13882 tablet_bootstrap.cc:492] T 410b1e2d520c470eb4b9ab60104e0cd4 P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:54:54.036321 13882 ts_tablet_manager.cc:1397] T 410b1e2d520c470eb4b9ab60104e0cd4 P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.018s user 0.004s sys 0.002s
I20250830 07:54:54.037752 13230 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_1bea3c4b6c2d4a8280397f4141c185b6" } new_table_name: "default.Table_75c990312c794354a26618c53fa44352" modify_external_catalogs: true
I20250830 07:54:54.041914 13887 tablet_bootstrap.cc:492] T 2c31d119743f49589703c434ac6c7548 P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:54:54.042340 15365 raft_consensus.cc:491] T 88bbd6b4c795433d9b6ad746353f3aa1 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:54.042479 15365 raft_consensus.cc:513] T 88bbd6b4c795433d9b6ad746353f3aa1 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:54.042065 13887 ts_tablet_manager.cc:1397] T 2c31d119743f49589703c434ac6c7548 P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.018s user 0.004s sys 0.000s
I20250830 07:54:54.043103 15365 leader_election.cc:290] T 88bbd6b4c795433d9b6ad746353f3aa1 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967)
I20250830 07:54:54.043262 13882 raft_consensus.cc:357] T 410b1e2d520c470eb4b9ab60104e0cd4 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:54.043402 13882 raft_consensus.cc:383] T 410b1e2d520c470eb4b9ab60104e0cd4 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:54.043355 13887 raft_consensus.cc:357] T 2c31d119743f49589703c434ac6c7548 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:54.043448 13882 raft_consensus.cc:738] T 410b1e2d520c470eb4b9ab60104e0cd4 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:54:54.043519 13887 raft_consensus.cc:383] T 2c31d119743f49589703c434ac6c7548 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:54.043581 13887 raft_consensus.cc:738] T 2c31d119743f49589703c434ac6c7548 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:54:54.043637 13610 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "88bbd6b4c795433d9b6ad746353f3aa1" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:54.043669 13882 consensus_queue.cc:260] T 410b1e2d520c470eb4b9ab60104e0cd4 P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:54.043744 13887 consensus_queue.cc:260] T 2c31d119743f49589703c434ac6c7548 P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
W20250830 07:54:54.044109 13703 leader_election.cc:343] T 88bbd6b4c795433d9b6ad746353f3aa1 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:54.044102 13882 ts_tablet_manager.cc:1428] T 410b1e2d520c470eb4b9ab60104e0cd4 P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.008s user 0.001s sys 0.000s
I20250830 07:54:54.044418 13882 tablet_bootstrap.cc:492] T 3c9dd258e6be47f68e039e4cdcd899b2 P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:54:54.044405 13887 ts_tablet_manager.cc:1428] T 2c31d119743f49589703c434ac6c7548 P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20250830 07:54:54.044643 13887 tablet_bootstrap.cc:492] T fbb1cc8f8eea4a0795f6f8e213b8180f P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:54:54.045910 13887 tablet_bootstrap.cc:654] T fbb1cc8f8eea4a0795f6f8e213b8180f P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:54.047726 14748 raft_consensus.cc:491] T 28c2f7a3a6dd444585f0f5d337b985e9 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:54.047853 14748 raft_consensus.cc:513] T 28c2f7a3a6dd444585f0f5d337b985e9 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:54.048354 14748 leader_election.cc:290] T 28c2f7a3a6dd444585f0f5d337b985e9 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
W20250830 07:54:54.048563 13230 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet c4f444c65afc4006a3747a5d7e2609c4 has no consensus state
I20250830 07:54:54.048903 13480 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "28c2f7a3a6dd444585f0f5d337b985e9" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:54:54.049320 13771 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "28c2f7a3a6dd444585f0f5d337b985e9" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:54.049926 13562 leader_election.cc:304] T 28c2f7a3a6dd444585f0f5d337b985e9 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b5e454d98894637b466ea27f1b647f9; no voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:54:54.050159 14748 raft_consensus.cc:2747] T 28c2f7a3a6dd444585f0f5d337b985e9 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:54:54.050379 13882 tablet_bootstrap.cc:654] T 3c9dd258e6be47f68e039e4cdcd899b2 P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:54.051654 13886 tablet_bootstrap.cc:654] T 6251a06d1efe44e38d35d962c468f8b2 P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:54.054461 15115 raft_consensus.cc:491] T ee44ab24333742909f773889ad5c3e00 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:54.054598 15115 raft_consensus.cc:513] T ee44ab24333742909f773889ad5c3e00 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:54.055280 15115 leader_election.cc:290] T ee44ab24333742909f773889ad5c3e00 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:54.055717 13610 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "ee44ab24333742909f773889ad5c3e00" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
W20250830 07:54:54.056200 13423 leader_election.cc:343] T ee44ab24333742909f773889ad5c3e00 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:54.058307 13887 tablet_bootstrap.cc:492] T fbb1cc8f8eea4a0795f6f8e213b8180f P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:54:54.058454 13887 ts_tablet_manager.cc:1397] T fbb1cc8f8eea4a0795f6f8e213b8180f P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.014s user 0.002s sys 0.000s
I20250830 07:54:54.059334 13887 raft_consensus.cc:357] T fbb1cc8f8eea4a0795f6f8e213b8180f P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:54.059527 13887 raft_consensus.cc:383] T fbb1cc8f8eea4a0795f6f8e213b8180f P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:54.059603 13887 raft_consensus.cc:738] T fbb1cc8f8eea4a0795f6f8e213b8180f P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:54:54.059842 13887 consensus_queue.cc:260] T fbb1cc8f8eea4a0795f6f8e213b8180f P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:54.060401 13887 ts_tablet_manager.cc:1428] T fbb1cc8f8eea4a0795f6f8e213b8180f P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20250830 07:54:54.060688 13887 tablet_bootstrap.cc:492] T 1cf23cf78eee46be953bd701aa6bef07 P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:54:54.069116 13887 tablet_bootstrap.cc:654] T 1cf23cf78eee46be953bd701aa6bef07 P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:54.071813 13480 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "042fd7ff08fc4695b87bb8f9d225ef12" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba"
I20250830 07:54:54.071979 13480 raft_consensus.cc:3058] T 042fd7ff08fc4695b87bb8f9d225ef12 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
W20250830 07:54:54.073459 13230 catalog_manager.cc:5415] Ignoring report from unknown tablet d37fe59b4f964f30bb1ed4cb00868b75
W20250830 07:54:54.073578 13230 catalog_manager.cc:5415] Ignoring report from unknown tablet ef1ab62a5b7845e58d50f34206eaaa27
I20250830 07:54:54.074321 13230 catalog_manager.cc:5674] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743) does not have the latest schema for tablet 2048c04578104c78aa6504fd9d5953a3 (table default.Table_3dbb041fb2074a1ea6ae46c7f9a05ce9 [id=2f37d76cb66742b5ac3d9f0714c6394d]). Expected version 2 got 0
I20250830 07:54:54.076347 13480 raft_consensus.cc:2466] T 042fd7ff08fc4695b87bb8f9d225ef12 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 1.
I20250830 07:54:54.083374 13882 tablet_bootstrap.cc:492] T 3c9dd258e6be47f68e039e4cdcd899b2 P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:54:54.083526 13882 ts_tablet_manager.cc:1397] T 3c9dd258e6be47f68e039e4cdcd899b2 P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.039s user 0.005s sys 0.003s
I20250830 07:54:54.084306 13882 raft_consensus.cc:357] T 3c9dd258e6be47f68e039e4cdcd899b2 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:54.084483 13882 raft_consensus.cc:383] T 3c9dd258e6be47f68e039e4cdcd899b2 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:54.084535 13882 raft_consensus.cc:738] T 3c9dd258e6be47f68e039e4cdcd899b2 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:54:54.084728 13882 consensus_queue.cc:260] T 3c9dd258e6be47f68e039e4cdcd899b2 P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:54.085244 13882 ts_tablet_manager.cc:1428] T 3c9dd258e6be47f68e039e4cdcd899b2 P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20250830 07:54:54.085485 13882 tablet_bootstrap.cc:492] T d64f20df166a46249c08444f44422fc3 P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:54:54.088994 13882 tablet_bootstrap.cc:654] T d64f20df166a46249c08444f44422fc3 P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:54.092334 13886 tablet_bootstrap.cc:492] T 6251a06d1efe44e38d35d962c468f8b2 P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:54:54.095988 13886 ts_tablet_manager.cc:1397] T 6251a06d1efe44e38d35d962c468f8b2 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.174s user 0.004s sys 0.003s
I20250830 07:54:54.101336 13484 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "74f2fcc22fd545fb8ca7c20619843023" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba"
I20250830 07:54:54.101549 13484 raft_consensus.cc:3058] T 74f2fcc22fd545fb8ca7c20619843023 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:54.104226 13484 raft_consensus.cc:2466] T 74f2fcc22fd545fb8ca7c20619843023 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 1.
I20250830 07:54:54.107831 13887 tablet_bootstrap.cc:492] T 1cf23cf78eee46be953bd701aa6bef07 P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:54:54.108228 13887 ts_tablet_manager.cc:1397] T 1cf23cf78eee46be953bd701aa6bef07 P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.048s user 0.004s sys 0.005s
I20250830 07:54:54.112820 13882 tablet_bootstrap.cc:492] T d64f20df166a46249c08444f44422fc3 P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:54:54.112977 13882 ts_tablet_manager.cc:1397] T d64f20df166a46249c08444f44422fc3 P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.028s user 0.001s sys 0.009s
I20250830 07:54:54.114845 13882 raft_consensus.cc:357] T d64f20df166a46249c08444f44422fc3 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:54.115123 13882 raft_consensus.cc:383] T d64f20df166a46249c08444f44422fc3 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:54.115219 13882 raft_consensus.cc:738] T d64f20df166a46249c08444f44422fc3 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:54:54.115458 13882 consensus_queue.cc:260] T d64f20df166a46249c08444f44422fc3 P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:54.116027 13882 ts_tablet_manager.cc:1428] T d64f20df166a46249c08444f44422fc3 P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20250830 07:54:54.116441 13882 tablet_bootstrap.cc:492] T 057bcce2860345da860acc262dc4d339 P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:54:54.118592 13882 tablet_bootstrap.cc:654] T 057bcce2860345da860acc262dc4d339 P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:54.120003 15115 raft_consensus.cc:491] T fbb1cc8f8eea4a0795f6f8e213b8180f P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:54.120179 15115 raft_consensus.cc:513] T fbb1cc8f8eea4a0795f6f8e213b8180f P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:54.121011 15115 leader_election.cc:290] T fbb1cc8f8eea4a0795f6f8e213b8180f P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:54.117383 13887 raft_consensus.cc:357] T 1cf23cf78eee46be953bd701aa6bef07 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:54.121534 13619 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "fbb1cc8f8eea4a0795f6f8e213b8180f" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
W20250830 07:54:54.121981 13423 leader_election.cc:343] T fbb1cc8f8eea4a0795f6f8e213b8180f P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:54.122282 13887 raft_consensus.cc:383] T 1cf23cf78eee46be953bd701aa6bef07 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:54.124330 13887 raft_consensus.cc:738] T 1cf23cf78eee46be953bd701aa6bef07 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:54:54.127149 13230 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_735b64466af64805b228abbbcd984f26" } modify_external_catalogs: true
I20250830 07:54:54.127341 13230 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_735b64466af64805b228abbbcd984f26" } modify_external_catalogs: true
I20250830 07:54:54.127488 13229 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_fcbe03bb31c84baf99f5b5e81dd03a7c" } modify_external_catalogs: true
I20250830 07:54:54.127619 13229 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_fcbe03bb31c84baf99f5b5e81dd03a7c" } modify_external_catalogs: true
I20250830 07:54:54.128602 13225 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_9bd9dfeb23324440b759f33fdd544ea5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250830 07:54:54.122888 13886 raft_consensus.cc:357] T 6251a06d1efe44e38d35d962c468f8b2 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
W20250830 07:54:54.129102 13225 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9bd9dfeb23324440b759f33fdd544ea5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:54.129412 13886 raft_consensus.cc:383] T 6251a06d1efe44e38d35d962c468f8b2 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:54.130710 13228 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_f404b758637145609f5b439ff64ea208"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250830 07:54:54.130537 13886 raft_consensus.cc:738] T 6251a06d1efe44e38d35d962c468f8b2 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
W20250830 07:54:54.131209 13228 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f404b758637145609f5b439ff64ea208 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:54.130410 13887 consensus_queue.cc:260] T 1cf23cf78eee46be953bd701aa6bef07 P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:54.133363 13232 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_7ef605c14a4f4d6492336ea33caaca59"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250830 07:54:54.132547 13886 consensus_queue.cc:260] T 6251a06d1efe44e38d35d962c468f8b2 P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
W20250830 07:54:54.133841 13232 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7ef605c14a4f4d6492336ea33caaca59 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:54.135499 13619 raft_consensus.cc:3058] T 1e48641532cd439e9b4074712033c737 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:54.136330 13887 ts_tablet_manager.cc:1428] T 1cf23cf78eee46be953bd701aa6bef07 P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.028s user 0.003s sys 0.000s
I20250830 07:54:54.138005 13886 ts_tablet_manager.cc:1428] T 6251a06d1efe44e38d35d962c468f8b2 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.040s user 0.003s sys 0.000s
I20250830 07:54:54.139684 13887 tablet_bootstrap.cc:492] T 846338e46b834ae0b5f4e74c7f1325d2 P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:54:54.141237 13230 catalog_manager.cc:5864] Not sending DeleteTablet requests; no consensus state for tablet 4a4e7fc956d44685917b5fb22b475321
I20250830 07:54:54.141498 13229 catalog_manager.cc:5864] Not sending DeleteTablet requests; no consensus state for tablet c4200bdcdf8f470494ff3af7e6795631
I20250830 07:54:54.152127 13477 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "10ec97b8a82145479e0bb526c4cc7c05" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:54:54.153129 13481 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "49165f0001044d72b68263a60ef56457" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba"
I20250830 07:54:54.153277 13887 tablet_bootstrap.cc:654] T 846338e46b834ae0b5f4e74c7f1325d2 P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
W20250830 07:54:54.155901 13703 consensus_peers.cc:489] T 5235e1a32f044f0cbf882e338c482003 P 9b057ade5dce45af9f8bf0bedf8b917f -> Peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Couldn't send request to peer 6b5e454d98894637b466ea27f1b647f9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20250830 07:54:54.156082 13703 consensus_peers.cc:489] T 924403105a6a40f28aad60647a2a8987 P 9b057ade5dce45af9f8bf0bedf8b917f -> Peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Couldn't send request to peer 6b5e454d98894637b466ea27f1b647f9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20250830 07:54:54.156275 13703 consensus_peers.cc:489] T 62ee2d0fbd774d38a4a4c4a033584ef9 P 9b057ade5dce45af9f8bf0bedf8b917f -> Peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Couldn't send request to peer 6b5e454d98894637b466ea27f1b647f9. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 62ee2d0fbd774d38a4a4c4a033584ef9. This is attempt 1: this message will repeat every 5th retry.
I20250830 07:54:54.153348 13481 raft_consensus.cc:2391] T 49165f0001044d72b68263a60ef56457 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 9b057ade5dce45af9f8bf0bedf8b917f in current term 1: Already voted for candidate 2065c332f15a4739899af79f3669c3ba in this term.
I20250830 07:54:54.166066 13225 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_844cfa31981f4db594c87b260d390b06" } modify_external_catalogs: true
I20250830 07:54:54.166236 13225 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_844cfa31981f4db594c87b260d390b06" } modify_external_catalogs: true
I20250830 07:54:54.168380 13229 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_57e5674478754ca0b44cec01ba4e73e8" } new_table_name: "default.Table_72fd60e35a35441a92bd2cffb809c0db" modify_external_catalogs: true
I20250830 07:54:54.170305 13230 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_c54374b7c0284fde94ca6c2b597b9cb1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:54.170729 13230 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c54374b7c0284fde94ca6c2b597b9cb1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:54.172540 13233 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_a4ace807387941a2a7e694254b74c89b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:54.172952 13233 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a4ace807387941a2a7e694254b74c89b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:54.176082 13228 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_1ac40b5a080246b99e34f715845393b0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:54.176610 13228 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1ac40b5a080246b99e34f715845393b0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:54.179221 13617 raft_consensus.cc:3058] T d64f20df166a46249c08444f44422fc3 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:54.180164 13477 raft_consensus.cc:2466] T 10ec97b8a82145479e0bb526c4cc7c05 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 0.
I20250830 07:54:54.181077 13887 tablet_bootstrap.cc:492] T 846338e46b834ae0b5f4e74c7f1325d2 P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:54:54.181198 13887 ts_tablet_manager.cc:1397] T 846338e46b834ae0b5f4e74c7f1325d2 P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.042s user 0.005s sys 0.002s
I20250830 07:54:54.181828 13887 raft_consensus.cc:357] T 846338e46b834ae0b5f4e74c7f1325d2 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:54.181993 13887 raft_consensus.cc:383] T 846338e46b834ae0b5f4e74c7f1325d2 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:54.182049 13887 raft_consensus.cc:738] T 846338e46b834ae0b5f4e74c7f1325d2 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:54:54.182225 13887 consensus_queue.cc:260] T 846338e46b834ae0b5f4e74c7f1325d2 P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:54.182632 13887 ts_tablet_manager.cc:1428] T 846338e46b834ae0b5f4e74c7f1325d2 P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20250830 07:54:54.183144 13887 tablet_bootstrap.cc:492] T 3d9c884ac05e44ddb59f96588fdd6f4b P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:54:54.184291 13225 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet c6355878115a4907ae1f0a45fb2c6492
I20250830 07:54:54.184406 13887 tablet_bootstrap.cc:654] T 3d9c884ac05e44ddb59f96588fdd6f4b P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:54.184870 13593 tablet_service.cc:1515] Processing DeleteTablet for tablet c6355878115a4907ae1f0a45fb2c6492 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:54 UTC) from {username='slave'} at 127.0.0.1:45306
W20250830 07:54:54.185582 13220 catalog_manager.cc:4908] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet c6355878115a4907ae1f0a45fb2c6492 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c6355878115a4907ae1f0a45fb2c6492 already in progress: creating tablet
I20250830 07:54:54.188432 14906 raft_consensus.cc:491] T f1fe024f0de048a5a0931ee38752d5a1 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:54.188550 14906 raft_consensus.cc:513] T f1fe024f0de048a5a0931ee38752d5a1 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:54.189067 14906 leader_election.cc:290] T f1fe024f0de048a5a0931ee38752d5a1 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
W20250830 07:54:54.189769 13562 leader_election.cc:343] T f1fe024f0de048a5a0931ee38752d5a1 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Not found: Tablet not found: f1fe024f0de048a5a0931ee38752d5a1
I20250830 07:54:54.199579 15115 raft_consensus.cc:491] T a0cf1de8485941eb8a557a6e2f783047 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:54.199712 15115 raft_consensus.cc:513] T a0cf1de8485941eb8a557a6e2f783047 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
W20250830 07:54:54.200044 13561 leader_election.cc:343] T f1fe024f0de048a5a0931ee38752d5a1 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): Not found: Tablet not found: f1fe024f0de048a5a0931ee38752d5a1
I20250830 07:54:54.200138 13561 leader_election.cc:304] T f1fe024f0de048a5a0931ee38752d5a1 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b5e454d98894637b466ea27f1b647f9; no voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:54:54.200253 15115 leader_election.cc:290] T a0cf1de8485941eb8a557a6e2f783047 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:54.200466 14906 raft_consensus.cc:2747] T f1fe024f0de048a5a0931ee38752d5a1 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:54:54.203197 13629 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "a0cf1de8485941eb8a557a6e2f783047" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
W20250830 07:54:54.205086 13423 leader_election.cc:343] T a0cf1de8485941eb8a557a6e2f783047 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:54.206314 13234 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_a2e96e9e547e4a07a6ccd9839e3d909c" } new_table_name: "default.Table_502abe123cb8464db797ed4744730f2c" modify_external_catalogs: true
W20250830 07:54:54.207906 13229 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f5baa35307a1425c8d52666d130d6d8a consensus state has no leader
I20250830 07:54:54.208449 13227 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_50cbbfc7bad042cba3685666e8d931f8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250830 07:54:54.208678 13231 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_9ea8aaa6727d4d4c9a728c1deb363c95" } new_table_name: "default.Table_2a8177fee3884fbdb1278f21d791987f" modify_external_catalogs: true
W20250830 07:54:54.208913 13227 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_50cbbfc7bad042cba3685666e8d931f8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:54.209661 13226 master_service.cc:948] ReplaceTablet: received request to replace tablet c1e0e774b86d4ef9a75e2635295f3e2a from {username='slave'} at 127.0.0.1:42126
I20250830 07:54:54.211197 13229 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_c08e2c34885940b5aec6ab02c4f3edf6" } modify_external_catalogs: true
I20250830 07:54:54.211334 13229 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_c08e2c34885940b5aec6ab02c4f3edf6" } modify_external_catalogs: true
I20250830 07:54:54.212482 13225 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_dabc7588cbb441859f6adbe7728463ce" } modify_external_catalogs: true
I20250830 07:54:54.212611 13225 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_dabc7588cbb441859f6adbe7728463ce" } modify_external_catalogs: true
I20250830 07:54:54.214074 13232 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_44675b94a3bc49e3bdcf8ca7109ae9b6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:54.214464 13232 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_44675b94a3bc49e3bdcf8ca7109ae9b6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:54.219460 14906 consensus_queue.cc:1035] T 74ea2298876a4066b297915c135d4618 P 6b5e454d98894637b466ea27f1b647f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:54:54.225291 14748 raft_consensus.cc:491] T 410b1e2d520c470eb4b9ab60104e0cd4 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:54.225404 14748 raft_consensus.cc:513] T 410b1e2d520c470eb4b9ab60104e0cd4 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:54.225982 14748 leader_election.cc:290] T 410b1e2d520c470eb4b9ab60104e0cd4 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:54.226927 13765 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "410b1e2d520c470eb4b9ab60104e0cd4" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:54.227113 13765 raft_consensus.cc:2466] T 410b1e2d520c470eb4b9ab60104e0cd4 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b5e454d98894637b466ea27f1b647f9 in term 0.
I20250830 07:54:54.227448 13562 leader_election.cc:304] T 410b1e2d520c470eb4b9ab60104e0cd4 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f; no voters:
I20250830 07:54:54.227433 13477 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "410b1e2d520c470eb4b9ab60104e0cd4" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:54:54.227697 14906 raft_consensus.cc:2802] T 410b1e2d520c470eb4b9ab60104e0cd4 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:54:54.227761 14906 raft_consensus.cc:491] T 410b1e2d520c470eb4b9ab60104e0cd4 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:54:54.227805 14906 raft_consensus.cc:3058] T 410b1e2d520c470eb4b9ab60104e0cd4 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:54.228832 15245 raft_consensus.cc:491] T db4077bf8e184ac5809ef629222f2cc5 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:54.228981 15245 raft_consensus.cc:513] T db4077bf8e184ac5809ef629222f2cc5 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:54.229502 15245 leader_election.cc:290] T db4077bf8e184ac5809ef629222f2cc5 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967)
I20250830 07:54:54.229972 13619 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "db4077bf8e184ac5809ef629222f2cc5" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:54.230264 14906 raft_consensus.cc:513] T 410b1e2d520c470eb4b9ab60104e0cd4 P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
W20250830 07:54:54.230476 13703 leader_election.cc:343] T db4077bf8e184ac5809ef629222f2cc5 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:54.230779 15500 raft_consensus.cc:491] T 3c9dd258e6be47f68e039e4cdcd899b2 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:54.230926 15500 raft_consensus.cc:513] T 3c9dd258e6be47f68e039e4cdcd899b2 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:54.231244 14906 leader_election.cc:290] T 410b1e2d520c470eb4b9ab60104e0cd4 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 election: Requested vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:54.231456 15500 leader_election.cc:290] T 3c9dd258e6be47f68e039e4cdcd899b2 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967)
I20250830 07:54:54.231485 13487 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "410b1e2d520c470eb4b9ab60104e0cd4" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba"
I20250830 07:54:54.231662 13487 raft_consensus.cc:3058] T 410b1e2d520c470eb4b9ab60104e0cd4 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:54.231705 15500 raft_consensus.cc:491] T ec47a59c22ff4370bd21bc2a18336049 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:54.231866 15500 raft_consensus.cc:513] T ec47a59c22ff4370bd21bc2a18336049 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:54.232522 15500 leader_election.cc:290] T ec47a59c22ff4370bd21bc2a18336049 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967)
I20250830 07:54:54.233264 13629 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "ec47a59c22ff4370bd21bc2a18336049" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:54.234158 13619 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "3c9dd258e6be47f68e039e4cdcd899b2" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:54.234354 13619 raft_consensus.cc:2466] T 3c9dd258e6be47f68e039e4cdcd899b2 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 0.
W20250830 07:54:54.234797 13703 leader_election.cc:343] T ec47a59c22ff4370bd21bc2a18336049 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:54.234804 13487 raft_consensus.cc:2466] T 410b1e2d520c470eb4b9ab60104e0cd4 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b5e454d98894637b466ea27f1b647f9 in term 1.
I20250830 07:54:54.235020 13765 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "410b1e2d520c470eb4b9ab60104e0cd4" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f"
I20250830 07:54:54.235067 13703 leader_election.cc:304] T 3c9dd258e6be47f68e039e4cdcd899b2 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f; no voters:
I20250830 07:54:54.235222 13765 raft_consensus.cc:3058] T 410b1e2d520c470eb4b9ab60104e0cd4 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:54.235333 15245 raft_consensus.cc:2802] T 3c9dd258e6be47f68e039e4cdcd899b2 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:54:54.235420 15245 raft_consensus.cc:491] T 3c9dd258e6be47f68e039e4cdcd899b2 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:54:54.235507 15245 raft_consensus.cc:3058] T 3c9dd258e6be47f68e039e4cdcd899b2 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:54.237699 13765 raft_consensus.cc:2466] T 410b1e2d520c470eb4b9ab60104e0cd4 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b5e454d98894637b466ea27f1b647f9 in term 1.
I20250830 07:54:54.238008 15245 raft_consensus.cc:513] T 3c9dd258e6be47f68e039e4cdcd899b2 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:54.238329 13561 leader_election.cc:304] T 410b1e2d520c470eb4b9ab60104e0cd4 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 6b5e454d98894637b466ea27f1b647f9; no voters:
I20250830 07:54:54.238636 14906 raft_consensus.cc:2802] T 410b1e2d520c470eb4b9ab60104e0cd4 P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Leader election won for term 1
I20250830 07:54:54.238755 14906 raft_consensus.cc:695] T 410b1e2d520c470eb4b9ab60104e0cd4 P 6b5e454d98894637b466ea27f1b647f9 [term 1 LEADER]: Becoming Leader. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Running, Role: LEADER
I20250830 07:54:54.239377 14906 consensus_queue.cc:237] T 410b1e2d520c470eb4b9ab60104e0cd4 P 6b5e454d98894637b466ea27f1b647f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:54.241526 13226 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet c1e0e774b86d4ef9a75e2635295f3e2a
I20250830 07:54:54.241799 15245 leader_election.cc:290] T 3c9dd258e6be47f68e039e4cdcd899b2 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Requested vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967)
I20250830 07:54:54.242002 13226 catalog_manager.cc:6652] ReplaceTablet: tablet c1e0e774b86d4ef9a75e2635295f3e2a deleted and replaced by tablet 77ecaf2c25d7468cabbca4c5964a676a
I20250830 07:54:54.242697 13593 tablet_service.cc:1515] Processing DeleteTablet for tablet c1e0e774b86d4ef9a75e2635295f3e2a with delete_type TABLET_DATA_DELETED (replaced by tablet 77ecaf2c25d7468cabbca4c5964a676a) from {username='slave'} at 127.0.0.1:45306
I20250830 07:54:54.243253 13619 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "3c9dd258e6be47f68e039e4cdcd899b2" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9"
W20250830 07:54:54.243361 13220 catalog_manager.cc:4908] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet c1e0e774b86d4ef9a75e2635295f3e2a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c1e0e774b86d4ef9a75e2635295f3e2a already in progress: creating tablet
I20250830 07:54:54.243554 13619 raft_consensus.cc:3058] T 3c9dd258e6be47f68e039e4cdcd899b2 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Advancing to term 1
W20250830 07:54:54.243770 13231 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet e498b17956514a9d93807598f8dfb351 consensus state has no leader
I20250830 07:54:54.244202 13229 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet d1a99857f707440d9edd0b30d918b2ff
I20250830 07:54:54.244782 13593 tablet_service.cc:1515] Processing DeleteTablet for tablet d1a99857f707440d9edd0b30d918b2ff with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:54 UTC) from {username='slave'} at 127.0.0.1:45306
I20250830 07:54:54.244946 13225 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet 0eddd1d33f9647358e650d4395e30ac8
W20250830 07:54:54.245390 13220 catalog_manager.cc:4908] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet d1a99857f707440d9edd0b30d918b2ff because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d1a99857f707440d9edd0b30d918b2ff already in progress: creating tablet
I20250830 07:54:54.246245 13593 tablet_service.cc:1515] Processing DeleteTablet for tablet 0eddd1d33f9647358e650d4395e30ac8 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:54 UTC) from {username='slave'} at 127.0.0.1:45306
W20250830 07:54:54.250957 13220 catalog_manager.cc:4908] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet 0eddd1d33f9647358e650d4395e30ac8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0eddd1d33f9647358e650d4395e30ac8 already in progress: creating tablet
I20250830 07:54:54.243319 13886 tablet_bootstrap.cc:492] T f66e1d07039841088a444ee0203a4eb0 P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:54:54.251395 15470 raft_consensus.cc:491] T 208995abd6d44dbea3b5ebbea27d6a39 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:54.251545 15470 raft_consensus.cc:513] T 208995abd6d44dbea3b5ebbea27d6a39 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:54.252182 15470 leader_election.cc:290] T 208995abd6d44dbea3b5ebbea27d6a39 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:54.252441 13766 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "6251a06d1efe44e38d35d962c468f8b2" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:54.252609 13766 raft_consensus.cc:2466] T 6251a06d1efe44e38d35d962c468f8b2 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2065c332f15a4739899af79f3669c3ba in term 0.
I20250830 07:54:54.253194 13886 tablet_bootstrap.cc:654] T f66e1d07039841088a444ee0203a4eb0 P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:54.254591 13766 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "49165f0001044d72b68263a60ef56457" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f"
I20250830 07:54:54.254807 13766 raft_consensus.cc:2391] T 49165f0001044d72b68263a60ef56457 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 2065c332f15a4739899af79f3669c3ba in current term 1: Already voted for candidate 9b057ade5dce45af9f8bf0bedf8b917f in this term.
W20250830 07:54:54.254774 13231 catalog_manager.cc:5415] Ignoring report from unknown tablet 97d49a1f600f4c13a4aafca99cedabe8
W20250830 07:54:54.254873 13231 catalog_manager.cc:5415] Ignoring report from unknown tablet da5c7b084e1f4fda92fff35a9cb2c7fc
W20250830 07:54:54.254999 13231 catalog_manager.cc:5415] Ignoring report from unknown tablet ca959e42c8764eeba0faee96caf8b39f
W20250830 07:54:54.255065 13231 catalog_manager.cc:5415] Ignoring report from unknown tablet e6b7646588fe4134b2db62ff84ca4791
I20250830 07:54:54.255764 13619 raft_consensus.cc:2466] T 3c9dd258e6be47f68e039e4cdcd899b2 P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 1.
I20250830 07:54:54.255795 13231 catalog_manager.cc:5674] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743) does not have the latest schema for tablet ff72a0fd9a0e46a6bd54a15e4ad783b4 (table default.Table_85e7f0b13c094fd7841dcabce61fd911 [id=de7b214458f247ef831f43727543afc5]). Expected version 1 got 0
I20250830 07:54:54.257638 13766 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f66e1d07039841088a444ee0203a4eb0" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:54.260375 13887 tablet_bootstrap.cc:492] T 3d9c884ac05e44ddb59f96588fdd6f4b P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:54:54.260496 13887 ts_tablet_manager.cc:1397] T 3d9c884ac05e44ddb59f96588fdd6f4b P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.077s user 0.001s sys 0.006s
I20250830 07:54:54.260975 13232 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_261e750e5d584609b5bd31ea2833252e" } new_table_name: "default.Table_993e7325346d495cb8c7a43441c3536a" modify_external_catalogs: true
I20250830 07:54:54.261197 13887 raft_consensus.cc:357] T 3d9c884ac05e44ddb59f96588fdd6f4b P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:54.261368 13887 raft_consensus.cc:383] T 3d9c884ac05e44ddb59f96588fdd6f4b P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:54.261418 13887 raft_consensus.cc:738] T 3d9c884ac05e44ddb59f96588fdd6f4b P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:54:54.261633 13887 consensus_queue.cc:260] T 3d9c884ac05e44ddb59f96588fdd6f4b P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:54.262298 13887 ts_tablet_manager.cc:1428] T 3d9c884ac05e44ddb59f96588fdd6f4b P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20250830 07:54:54.262542 13887 tablet_bootstrap.cc:492] T 15f8fd7d9e6242c6b6c51251d618ef09 P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:54:54.263643 13227 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_07d0c3a0826d4256a87a0f066a710041"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250830 07:54:54.263844 13887 tablet_bootstrap.cc:654] T 15f8fd7d9e6242c6b6c51251d618ef09 P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
W20250830 07:54:54.264169 13227 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_07d0c3a0826d4256a87a0f066a710041 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:54.267081 13234 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_be3850e767324f069b36137e5537a763"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250830 07:54:54.267475 13886 tablet_bootstrap.cc:492] T f66e1d07039841088a444ee0203a4eb0 P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:54:54.267599 13886 ts_tablet_manager.cc:1397] T f66e1d07039841088a444ee0203a4eb0 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.024s user 0.003s sys 0.000s
W20250830 07:54:54.267566 13234 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_be3850e767324f069b36137e5537a763 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:54.268327 13886 raft_consensus.cc:357] T f66e1d07039841088a444ee0203a4eb0 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:54.268471 13886 raft_consensus.cc:383] T f66e1d07039841088a444ee0203a4eb0 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:54.268528 13886 raft_consensus.cc:738] T f66e1d07039841088a444ee0203a4eb0 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:54:54.268697 13886 consensus_queue.cc:260] T f66e1d07039841088a444ee0203a4eb0 P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:54.269120 13886 ts_tablet_manager.cc:1428] T f66e1d07039841088a444ee0203a4eb0 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20250830 07:54:54.269392 13886 tablet_bootstrap.cc:492] T a7dc529c40544bafbc9e7f0ab34086bd P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:54:54.271063 13886 tablet_bootstrap.cc:654] T a7dc529c40544bafbc9e7f0ab34086bd P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:54.271234 13225 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_beafa4a487df443aaf66f0c49eb97cca" } new_table_name: "default.Table_4b166cee7058429e8cb18ae83e4865ed" modify_external_catalogs: true
I20250830 07:54:54.272724 15470 raft_consensus.cc:491] T 2c31d119743f49589703c434ac6c7548 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:54.272837 15470 raft_consensus.cc:513] T 2c31d119743f49589703c434ac6c7548 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:54.273346 15470 leader_election.cc:290] T 2c31d119743f49589703c434ac6c7548 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:54.273689 13229 master_service.cc:948] ReplaceTablet: received request to replace tablet 15f8fd7d9e6242c6b6c51251d618ef09 from {username='slave'} at 127.0.0.1:42126
I20250830 07:54:54.273777 13887 tablet_bootstrap.cc:492] T 15f8fd7d9e6242c6b6c51251d618ef09 P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:54:54.273875 13887 ts_tablet_manager.cc:1397] T 15f8fd7d9e6242c6b6c51251d618ef09 P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.011s user 0.005s sys 0.000s
I20250830 07:54:54.274473 13887 raft_consensus.cc:357] T 15f8fd7d9e6242c6b6c51251d618ef09 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:54.274619 13887 raft_consensus.cc:383] T 15f8fd7d9e6242c6b6c51251d618ef09 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:54.274675 13887 raft_consensus.cc:738] T 15f8fd7d9e6242c6b6c51251d618ef09 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:54:54.274842 13887 consensus_queue.cc:260] T 15f8fd7d9e6242c6b6c51251d618ef09 P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:54.278831 13886 tablet_bootstrap.cc:492] T a7dc529c40544bafbc9e7f0ab34086bd P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:54:54.278978 13886 ts_tablet_manager.cc:1397] T a7dc529c40544bafbc9e7f0ab34086bd P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.010s user 0.001s sys 0.005s
I20250830 07:54:54.279759 13886 raft_consensus.cc:357] T a7dc529c40544bafbc9e7f0ab34086bd P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:54.279925 13886 raft_consensus.cc:383] T a7dc529c40544bafbc9e7f0ab34086bd P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:54.279990 13886 raft_consensus.cc:738] T a7dc529c40544bafbc9e7f0ab34086bd P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:54:54.280625 13886 consensus_queue.cc:260] T a7dc529c40544bafbc9e7f0ab34086bd P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:54.281109 13886 ts_tablet_manager.cc:1428] T a7dc529c40544bafbc9e7f0ab34086bd P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20250830 07:54:54.281381 13886 tablet_bootstrap.cc:492] T 23d2c7013c9c4b4aacf47e6ac7ab5a0b P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:54:54.257164 13629 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "208995abd6d44dbea3b5ebbea27d6a39" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:54.272189 14748 raft_consensus.cc:491] T d206f6b6e7524a27a9f95787bcd5de77 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:54.276525 13882 tablet_bootstrap.cc:492] T 057bcce2860345da860acc262dc4d339 P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:54:54.291873 13766 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "0208de98277c4d6889fb0289b6013ae1" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:54.293128 13766 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "2b4103f07e96490488913059a95af0c3" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:54.293973 13766 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "410b1e2d520c470eb4b9ab60104e0cd4" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:54.294154 13766 raft_consensus.cc:2391] T 410b1e2d520c470eb4b9ab60104e0cd4 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2065c332f15a4739899af79f3669c3ba in current term 1: Already voted for candidate 6b5e454d98894637b466ea27f1b647f9 in this term.
I20250830 07:54:54.294323 13887 ts_tablet_manager.cc:1428] T 15f8fd7d9e6242c6b6c51251d618ef09 P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.020s user 0.001s sys 0.000s
I20250830 07:54:54.294554 13887 tablet_bootstrap.cc:492] T f332d1b56d924c91a79cf6572dea1cd2 P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:54:54.294751 13766 raft_consensus.cc:1273] T 8dddcfe56522436287aea212e316a729 P 9b057ade5dce45af9f8bf0bedf8b917f [term 2 FOLLOWER]: Refusing update from remote peer 2065c332f15a4739899af79f3669c3ba: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20250830 07:54:54.295655 13766 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "8cce7e5537794e9484f5a7c82b9e6e1d" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:54.296157 13766 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "2048c04578104c78aa6504fd9d5953a3" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:54.296324 13766 raft_consensus.cc:2466] T 2048c04578104c78aa6504fd9d5953a3 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2065c332f15a4739899af79f3669c3ba in term 0.
I20250830 07:54:54.297417 13887 tablet_bootstrap.cc:654] T f332d1b56d924c91a79cf6572dea1cd2 P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
W20250830 07:54:54.297439 13423 leader_election.cc:343] T 208995abd6d44dbea3b5ebbea27d6a39 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:54.297950 13536 heartbeater.cc:344] Connected to a master server at 127.12.209.60:43889
W20250830 07:54:54.297022 13129 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerService.ListTablets -> {remote=127.12.209.2:38967, user_credentials={real_user=slave}} blocked reactor thread for 74539.8us
I20250830 07:54:54.300339 13703 leader_election.cc:304] T 3c9dd258e6be47f68e039e4cdcd899b2 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f; no voters:
I20250830 07:54:54.300848 15500 raft_consensus.cc:2802] T 3c9dd258e6be47f68e039e4cdcd899b2 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election won for term 1
I20250830 07:54:54.301029 15500 raft_consensus.cc:695] T 3c9dd258e6be47f68e039e4cdcd899b2 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 LEADER]: Becoming Leader. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Running, Role: LEADER
I20250830 07:54:54.301313 15500 consensus_queue.cc:237] T 3c9dd258e6be47f68e039e4cdcd899b2 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:54.306138 13887 tablet_bootstrap.cc:492] T f332d1b56d924c91a79cf6572dea1cd2 P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:54:54.306253 13887 ts_tablet_manager.cc:1397] T f332d1b56d924c91a79cf6572dea1cd2 P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.012s user 0.003s sys 0.000s
I20250830 07:54:54.306802 13887 raft_consensus.cc:357] T f332d1b56d924c91a79cf6572dea1cd2 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:54.306959 13887 raft_consensus.cc:383] T f332d1b56d924c91a79cf6572dea1cd2 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:54.307029 13887 raft_consensus.cc:738] T f332d1b56d924c91a79cf6572dea1cd2 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
W20250830 07:54:54.311487 13231 catalog_manager.cc:5415] Ignoring report from unknown tablet b4ab964a64a64e00a78ffd2b220aef46
I20250830 07:54:54.311733 13887 consensus_queue.cc:260] T f332d1b56d924c91a79cf6572dea1cd2 P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
W20250830 07:54:54.311937 13231 catalog_manager.cc:5415] Ignoring report from unknown tablet d37fe59b4f964f30bb1ed4cb00868b75
W20250830 07:54:54.312808 13231 catalog_manager.cc:5415] Ignoring report from unknown tablet 846338e46b834ae0b5f4e74c7f1325d2
W20250830 07:54:54.312940 13231 catalog_manager.cc:5415] Ignoring report from unknown tablet da5c7b084e1f4fda92fff35a9cb2c7fc
W20250830 07:54:54.314117 13231 catalog_manager.cc:5415] Ignoring report from unknown tablet 7c5e50cb605c4a40b47984f328eedd93
W20250830 07:54:54.314373 13231 catalog_manager.cc:5415] Ignoring report from unknown tablet 5235e1a32f044f0cbf882e338c482003
W20250830 07:54:54.314493 13231 catalog_manager.cc:5415] Ignoring report from unknown tablet ca959e42c8764eeba0faee96caf8b39f
I20250830 07:54:54.314481 13887 ts_tablet_manager.cc:1428] T f332d1b56d924c91a79cf6572dea1cd2 P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.008s user 0.002s sys 0.000s
W20250830 07:54:54.314644 13231 catalog_manager.cc:5415] Ignoring report from unknown tablet d1bf58d367f54ba8bad64887b9a8d9cc
W20250830 07:54:54.314752 13231 catalog_manager.cc:5415] Ignoring report from unknown tablet 2c31d119743f49589703c434ac6c7548
I20250830 07:54:54.316243 13231 catalog_manager.cc:5674] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325) does not have the latest schema for tablet ff72a0fd9a0e46a6bd54a15e4ad783b4 (table default.Table_85e7f0b13c094fd7841dcabce61fd911 [id=de7b214458f247ef831f43727543afc5]). Expected version 1 got 0
I20250830 07:54:54.321676 13764 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "ee44ab24333742909f773889ad5c3e00" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:54.322801 13767 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "fbb1cc8f8eea4a0795f6f8e213b8180f" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:54.324990 13764 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "a0cf1de8485941eb8a557a6e2f783047" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:54.325491 13764 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "208995abd6d44dbea3b5ebbea27d6a39" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:54.325968 13764 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "2c31d119743f49589703c434ac6c7548" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:54.326783 13487 raft_consensus.cc:1273] T 62ee2d0fbd774d38a4a4c4a033584ef9 P 2065c332f15a4739899af79f3669c3ba [term 2 FOLLOWER]: Refusing update from remote peer 9b057ade5dce45af9f8bf0bedf8b917f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
W20250830 07:54:54.319157 13232 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet b678fd915c534a2dac8521c21ab93396 consensus state has no leader
I20250830 07:54:54.320277 13229 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet 15f8fd7d9e6242c6b6c51251d618ef09
I20250830 07:54:54.332440 13229 catalog_manager.cc:6652] ReplaceTablet: tablet 15f8fd7d9e6242c6b6c51251d618ef09 deleted and replaced by tablet 0c1e946a6f47494aa6e282ef6d53b469
I20250830 07:54:54.333160 13231 catalog_manager.cc:5674] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325) does not have the latest schema for tablet 924403105a6a40f28aad60647a2a8987 (table default.Table_f62c15a884574e3ebe9ce39aa18d1e00 [id=46ec9117fe9146cb807dd092284616fc]). Expected version 2 got 0
I20250830 07:54:54.333433 13602 tablet_service.cc:1515] Processing DeleteTablet for tablet 15f8fd7d9e6242c6b6c51251d618ef09 with delete_type TABLET_DATA_DELETED (replaced by tablet 0c1e946a6f47494aa6e282ef6d53b469) from {username='slave'} at 127.0.0.1:45306
W20250830 07:54:54.333959 13220 catalog_manager.cc:4908] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet 15f8fd7d9e6242c6b6c51251d618ef09 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 15f8fd7d9e6242c6b6c51251d618ef09 already in progress: creating tablet
I20250830 07:54:54.334923 14748 raft_consensus.cc:513] T d206f6b6e7524a27a9f95787bcd5de77 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:54.335351 13882 ts_tablet_manager.cc:1397] T 057bcce2860345da860acc262dc4d339 P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.175s user 0.001s sys 0.003s
I20250830 07:54:54.334448 13231 catalog_manager.cc:5674] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325) does not have the latest schema for tablet fbb1cc8f8eea4a0795f6f8e213b8180f (table default.Table_c5f5589680204e3398db84e86cb9a590 [id=60d4b91855134b03860cf7dab25e1775]). Expected version 3 got 0
I20250830 07:54:54.337661 13610 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "2c31d119743f49589703c434ac6c7548" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
W20250830 07:54:54.338323 13423 leader_election.cc:343] T 2c31d119743f49589703c434ac6c7548 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:54.342057 14748 leader_election.cc:290] T d206f6b6e7524a27a9f95787bcd5de77 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:54.343607 13886 tablet_bootstrap.cc:654] T 23d2c7013c9c4b4aacf47e6ac7ab5a0b P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:54.355286 13477 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "88bbd6b4c795433d9b6ad746353f3aa1" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:54:54.355479 13477 raft_consensus.cc:2466] T 88bbd6b4c795433d9b6ad746353f3aa1 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 0.
I20250830 07:54:54.356010 13229 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_3dbb041fb2074a1ea6ae46c7f9a05ce9" } modify_external_catalogs: true
I20250830 07:54:54.357367 13229 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_3dbb041fb2074a1ea6ae46c7f9a05ce9" } modify_external_catalogs: true
I20250830 07:54:54.356244 13232 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_34956728c70b428f8d3533023793e73d" } modify_external_catalogs: true
I20250830 07:54:54.358610 13232 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_34956728c70b428f8d3533023793e73d" } modify_external_catalogs: true
I20250830 07:54:54.362497 15470 raft_consensus.cc:491] T f332d1b56d924c91a79cf6572dea1cd2 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:54.362609 15470 raft_consensus.cc:513] T f332d1b56d924c91a79cf6572dea1cd2 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:54.363180 15470 leader_election.cc:290] T f332d1b56d924c91a79cf6572dea1cd2 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:54.363471 13887 tablet_bootstrap.cc:492] T 509e08290f3842cfbde8b74ff9f4f70f P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:54:54.364452 13234 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_2f4fde18fea441d5bb5dd37170cbb3b0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250830 07:54:54.364769 13887 tablet_bootstrap.cc:654] T 509e08290f3842cfbde8b74ff9f4f70f P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
W20250830 07:54:54.364924 13234 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2f4fde18fea441d5bb5dd37170cbb3b0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250830 07:54:54.352962 13231 catalog_manager.cc:5415] Ignoring report from unknown tablet f66e1d07039841088a444ee0203a4eb0
I20250830 07:54:54.368867 13886 tablet_bootstrap.cc:492] T 23d2c7013c9c4b4aacf47e6ac7ab5a0b P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:54:54.369012 13886 ts_tablet_manager.cc:1397] T 23d2c7013c9c4b4aacf47e6ac7ab5a0b P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.088s user 0.001s sys 0.002s
W20250830 07:54:54.374225 13231 catalog_manager.cc:5415] Ignoring report from unknown tablet 74ea2298876a4066b297915c135d4618
W20250830 07:54:54.374861 13231 catalog_manager.cc:5415] Ignoring report from unknown tablet ff0f9cccc8ed43b1a8cd38de0e9d4097
W20250830 07:54:54.375939 13231 catalog_manager.cc:5415] Ignoring report from unknown tablet de3a52a8e08a45808373902a0185e6f0
W20250830 07:54:54.376749 13231 catalog_manager.cc:5415] Ignoring report from unknown tablet e6060a3dc6444483b8fb2944b8090cb6
W20250830 07:54:54.378039 13231 catalog_manager.cc:5415] Ignoring report from unknown tablet d2b8e6df64ef49e2ba36c093efd3c351
I20250830 07:54:54.381064 13232 catalog_manager.cc:5864] Not sending DeleteTablet requests; no consensus state for tablet 2c2afc0c5f3f48c788b95e71d2596e45
I20250830 07:54:54.381367 13229 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet 2048c04578104c78aa6504fd9d5953a3
I20250830 07:54:54.381975 13602 tablet_service.cc:1515] Processing DeleteTablet for tablet 2048c04578104c78aa6504fd9d5953a3 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:54 UTC) from {username='slave'} at 127.0.0.1:45306
W20250830 07:54:54.382567 13220 catalog_manager.cc:4908] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet 2048c04578104c78aa6504fd9d5953a3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2048c04578104c78aa6504fd9d5953a3 already in progress: creating tablet
I20250830 07:54:54.383423 13229 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_a6267f184c1f4d8fa0a3d08ffcd4c628"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250830 07:54:54.383846 13477 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "db4077bf8e184ac5809ef629222f2cc5" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
W20250830 07:54:54.383939 13229 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a6267f184c1f4d8fa0a3d08ffcd4c628 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:54.384023 13477 raft_consensus.cc:2466] T db4077bf8e184ac5809ef629222f2cc5 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 0.
I20250830 07:54:54.372287 13886 raft_consensus.cc:357] T 23d2c7013c9c4b4aacf47e6ac7ab5a0b P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:54.384344 13886 raft_consensus.cc:383] T 23d2c7013c9c4b4aacf47e6ac7ab5a0b P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:54.384400 13886 raft_consensus.cc:738] T 23d2c7013c9c4b4aacf47e6ac7ab5a0b P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:54:54.384792 13477 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "3c9dd258e6be47f68e039e4cdcd899b2" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:54:54.384920 13477 raft_consensus.cc:2466] T 3c9dd258e6be47f68e039e4cdcd899b2 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 0.
I20250830 07:54:54.385732 13477 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "ec47a59c22ff4370bd21bc2a18336049" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:54:54.386755 13232 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_5c9697e28036435584a21f8ecccda3d7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250830 07:54:54.385910 13477 raft_consensus.cc:2466] T ec47a59c22ff4370bd21bc2a18336049 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 0.
W20250830 07:54:54.387291 13232 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5c9697e28036435584a21f8ecccda3d7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:54.388300 13886 consensus_queue.cc:260] T 23d2c7013c9c4b4aacf47e6ac7ab5a0b P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:54.389439 13882 raft_consensus.cc:357] T 057bcce2860345da860acc262dc4d339 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:54.389746 13227 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_bf641d5daae74e52902c7fb5847d2c00" } modify_external_catalogs: true
I20250830 07:54:54.389916 13227 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_bf641d5daae74e52902c7fb5847d2c00" } modify_external_catalogs: true
I20250830 07:54:54.390048 13477 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "3c9dd258e6be47f68e039e4cdcd899b2" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba"
I20250830 07:54:54.390177 13477 raft_consensus.cc:3058] T 3c9dd258e6be47f68e039e4cdcd899b2 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:54.393684 13477 raft_consensus.cc:2466] T 3c9dd258e6be47f68e039e4cdcd899b2 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 1.
I20250830 07:54:54.394399 13882 raft_consensus.cc:383] T 057bcce2860345da860acc262dc4d339 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:54.394512 13882 raft_consensus.cc:738] T 057bcce2860345da860acc262dc4d339 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:54:54.394738 13882 consensus_queue.cc:260] T 057bcce2860345da860acc262dc4d339 P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:54.397157 13887 tablet_bootstrap.cc:492] T 509e08290f3842cfbde8b74ff9f4f70f P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:54:54.397348 13887 ts_tablet_manager.cc:1397] T 509e08290f3842cfbde8b74ff9f4f70f P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.034s user 0.003s sys 0.002s
I20250830 07:54:54.398025 13887 raft_consensus.cc:357] T 509e08290f3842cfbde8b74ff9f4f70f P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:54.398226 13887 raft_consensus.cc:383] T 509e08290f3842cfbde8b74ff9f4f70f P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:54.398329 13887 raft_consensus.cc:738] T 509e08290f3842cfbde8b74ff9f4f70f P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:54:54.398571 13887 consensus_queue.cc:260] T 509e08290f3842cfbde8b74ff9f4f70f P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:54.399561 13887 ts_tablet_manager.cc:1428] T 509e08290f3842cfbde8b74ff9f4f70f P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20250830 07:54:54.399890 13887 tablet_bootstrap.cc:492] T 2f3bec2c98574a9393e0fae77e228ce0 P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:54:54.401711 13887 tablet_bootstrap.cc:654] T 2f3bec2c98574a9393e0fae77e228ce0 P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:54.404825 13886 ts_tablet_manager.cc:1428] T 23d2c7013c9c4b4aacf47e6ac7ab5a0b P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.033s user 0.000s sys 0.001s
I20250830 07:54:54.409825 13422 leader_election.cc:304] T 6251a06d1efe44e38d35d962c468f8b2 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:54:54.410144 15470 raft_consensus.cc:2802] T 6251a06d1efe44e38d35d962c468f8b2 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:54:54.410225 15470 raft_consensus.cc:491] T 6251a06d1efe44e38d35d962c468f8b2 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:54:54.410297 15470 raft_consensus.cc:3058] T 6251a06d1efe44e38d35d962c468f8b2 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:54.410673 13227 catalog_manager.cc:5864] Not sending DeleteTablet requests; no consensus state for tablet 29539c923f964f9fab0f506b4d90888d
I20250830 07:54:54.412681 13227 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_419fdcf91b934420b06078d6a526e9c1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250830 07:54:54.412767 15470 raft_consensus.cc:513] T 6251a06d1efe44e38d35d962c468f8b2 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
W20250830 07:54:54.413123 13227 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_419fdcf91b934420b06078d6a526e9c1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:54.414088 15470 leader_election.cc:290] T 6251a06d1efe44e38d35d962c468f8b2 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 election: Requested vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:54.415400 13229 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_130992e56c244ef48918ebf28377d703" } new_table_name: "default.Table_fbcb77b93b694961a6bf34e7dd764df9" modify_external_catalogs: true
I20250830 07:54:54.416193 13422 leader_election.cc:304] T 49165f0001044d72b68263a60ef56457 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba; no voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:54:54.416409 15470 raft_consensus.cc:2747] T 49165f0001044d72b68263a60ef56457 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20250830 07:54:54.418609 13232 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_daeb6945eeb54c8f8bb523267b6cc6f3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:54.417441 13422 leader_election.cc:343] T f66e1d07039841088a444ee0203a4eb0 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Illegal state: must be running to vote when last-logged opid is not known
W20250830 07:54:54.419026 13232 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_daeb6945eeb54c8f8bb523267b6cc6f3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:54.419039 13422 leader_election.cc:304] T f66e1d07039841088a444ee0203a4eb0 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba; no voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:54:54.419241 15470 raft_consensus.cc:2747] T f66e1d07039841088a444ee0203a4eb0 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:54:54.421581 13234 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_992956602d8d4df9be565e842608b74e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250830 07:54:54.421880 13887 tablet_bootstrap.cc:492] T 2f3bec2c98574a9393e0fae77e228ce0 P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
W20250830 07:54:54.421950 13234 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_992956602d8d4df9be565e842608b74e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:54.421976 13887 ts_tablet_manager.cc:1397] T 2f3bec2c98574a9393e0fae77e228ce0 P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.022s user 0.001s sys 0.001s
I20250830 07:54:54.422344 13882 ts_tablet_manager.cc:1428] T 057bcce2860345da860acc262dc4d339 P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.087s user 0.000s sys 0.002s
I20250830 07:54:54.422549 13887 raft_consensus.cc:357] T 2f3bec2c98574a9393e0fae77e228ce0 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:54.422624 13882 tablet_bootstrap.cc:492] T c1e0e774b86d4ef9a75e2635295f3e2a P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:54:54.422673 13887 raft_consensus.cc:383] T 2f3bec2c98574a9393e0fae77e228ce0 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:54.422715 13887 raft_consensus.cc:738] T 2f3bec2c98574a9393e0fae77e228ce0 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:54:54.423031 13886 tablet_bootstrap.cc:492] T 689b4fee1dd04b3d9ccdea334b0f6b59 P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:54:54.424269 13882 tablet_bootstrap.cc:654] T c1e0e774b86d4ef9a75e2635295f3e2a P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
W20250830 07:54:54.427979 13229 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 166493c5f21843b8860fea147419ef5e has no consensus state
I20250830 07:54:54.435015 15470 raft_consensus.cc:491] T 579324e1f6474d398db10da3093650dd P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:54.435122 15470 raft_consensus.cc:513] T 579324e1f6474d398db10da3093650dd P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:54.435642 15470 leader_election.cc:290] T 579324e1f6474d398db10da3093650dd P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
W20250830 07:54:54.439356 13422 leader_election.cc:343] T 0208de98277c4d6889fb0289b6013ae1 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:54.439456 13422 leader_election.cc:304] T 0208de98277c4d6889fb0289b6013ae1 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba; no voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:54:54.439616 15470 raft_consensus.cc:2747] T 0208de98277c4d6889fb0289b6013ae1 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:54:54.439630 13227 master_service.cc:948] ReplaceTablet: received request to replace tablet 8028ac4c928a48f3a077d61aec24f3bd from {username='slave'} at 127.0.0.1:42126
W20250830 07:54:54.440665 13561 consensus_peers.cc:489] T 74ea2298876a4066b297915c135d4618 P 6b5e454d98894637b466ea27f1b647f9 -> Peer 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): Couldn't send request to peer 2065c332f15a4739899af79f3669c3ba. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 74ea2298876a4066b297915c135d4618. This is attempt 1: this message will repeat every 5th retry.
W20250830 07:54:54.440853 13561 leader_election.cc:343] T d206f6b6e7524a27a9f95787bcd5de77 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): Not found: Tablet not found: d206f6b6e7524a27a9f95787bcd5de77
W20250830 07:54:54.445778 13422 leader_election.cc:343] T 2b4103f07e96490488913059a95af0c3 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:54.445878 13422 leader_election.cc:304] T 2b4103f07e96490488913059a95af0c3 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba; no voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:54:54.446077 15470 raft_consensus.cc:2747] T 2b4103f07e96490488913059a95af0c3 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:54:54.448029 13422 leader_election.cc:304] T 410b1e2d520c470eb4b9ab60104e0cd4 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba; no voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:54:54.448251 15470 raft_consensus.cc:2747] T 410b1e2d520c470eb4b9ab60104e0cd4 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:54:54.448593 15470 consensus_queue.cc:1035] T 8dddcfe56522436287aea212e316a729 P 2065c332f15a4739899af79f3669c3ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20250830 07:54:54.449430 13422 leader_election.cc:343] T 8cce7e5537794e9484f5a7c82b9e6e1d P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:54.449522 13422 leader_election.cc:304] T 8cce7e5537794e9484f5a7c82b9e6e1d P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba; no voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:54:54.449584 13227 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet 8028ac4c928a48f3a077d61aec24f3bd
I20250830 07:54:54.449712 15470 raft_consensus.cc:2747] T 8cce7e5537794e9484f5a7c82b9e6e1d P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:54:54.450052 13422 leader_election.cc:304] T 2048c04578104c78aa6504fd9d5953a3 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:54:54.450246 13227 catalog_manager.cc:6652] ReplaceTablet: tablet 8028ac4c928a48f3a077d61aec24f3bd deleted and replaced by tablet 9800018e8b97423e87eb88cd9e6becd0
W20250830 07:54:54.450269 13562 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.209.3:38743, user_credentials={real_user=slave}} blocked reactor thread for 108019us
I20250830 07:54:54.450515 15470 raft_consensus.cc:2802] T 2048c04578104c78aa6504fd9d5953a3 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:54:54.450598 15470 raft_consensus.cc:491] T 2048c04578104c78aa6504fd9d5953a3 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:54:54.450668 15470 raft_consensus.cc:3058] T 2048c04578104c78aa6504fd9d5953a3 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:54.453135 15470 raft_consensus.cc:513] T 2048c04578104c78aa6504fd9d5953a3 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:54.453696 15470 leader_election.cc:290] T 2048c04578104c78aa6504fd9d5953a3 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 election: Requested vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
W20250830 07:54:54.454145 13422 leader_election.cc:343] T ee44ab24333742909f773889ad5c3e00 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:54.454244 13422 leader_election.cc:304] T ee44ab24333742909f773889ad5c3e00 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba; no voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:54:54.454409 15514 raft_consensus.cc:2747] T ee44ab24333742909f773889ad5c3e00 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20250830 07:54:54.454679 13422 leader_election.cc:343] T fbb1cc8f8eea4a0795f6f8e213b8180f P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:54.454774 13422 leader_election.cc:304] T fbb1cc8f8eea4a0795f6f8e213b8180f P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba; no voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:54:54.454952 15115 raft_consensus.cc:2747] T fbb1cc8f8eea4a0795f6f8e213b8180f P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:54:54.455754 13886 tablet_bootstrap.cc:654] T 689b4fee1dd04b3d9ccdea334b0f6b59 P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:54.461655 13701 leader_election.cc:304] T 410b1e2d520c470eb4b9ab60104e0cd4 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:54:54.461947 15245 raft_consensus.cc:2762] T 410b1e2d520c470eb4b9ab60104e0cd4 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20250830 07:54:54.462291 13701 leader_election.cc:304] T 713c12e1efec4e6f9895c65dc8a9c4b9 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:54:54.462559 15245 raft_consensus.cc:2802] T 713c12e1efec4e6f9895c65dc8a9c4b9 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:54:54.462733 15245 raft_consensus.cc:491] T 713c12e1efec4e6f9895c65dc8a9c4b9 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:54:54.462795 15245 raft_consensus.cc:3058] T 713c12e1efec4e6f9895c65dc8a9c4b9 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:54.462730 15590 tablet.cc:1722] T f56cab43580a4ee3a912fc5e58a3bd9d P 2065c332f15a4739899af79f3669c3ba: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20250830 07:54:54.465380 15245 raft_consensus.cc:513] T 713c12e1efec4e6f9895c65dc8a9c4b9 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:54.466984 15245 leader_election.cc:290] T 713c12e1efec4e6f9895c65dc8a9c4b9 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Requested vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967)
W20250830 07:54:54.467173 15199 log.cc:927] Time spent T 00000000000000000000000000000000 P 3ea183a890b84f408b20b55e9eb7c7ed: Append to log took a long time: real 0.064s user 0.002s sys 0.000s
W20250830 07:54:54.471915 13231 catalog_manager.cc:5415] Ignoring report from unknown tablet f398e12cd9f543738d5163354f8a9d9d
W20250830 07:54:54.472072 13231 catalog_manager.cc:5415] Ignoring report from unknown tablet 23d2c7013c9c4b4aacf47e6ac7ab5a0b
I20250830 07:54:54.472872 15470 raft_consensus.cc:491] T 240a6bfad8fa478598a67a27c2dedf62 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:54.472977 15470 raft_consensus.cc:513] T 240a6bfad8fa478598a67a27c2dedf62 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:54.473424 15470 leader_election.cc:290] T 240a6bfad8fa478598a67a27c2dedf62 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:54.476776 13887 consensus_queue.cc:260] T 2f3bec2c98574a9393e0fae77e228ce0 P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:54.477761 13887 ts_tablet_manager.cc:1428] T 2f3bec2c98574a9393e0fae77e228ce0 P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.056s user 0.001s sys 0.001s
I20250830 07:54:54.478065 13887 tablet_bootstrap.cc:492] T 2e63eac2579844ef83bf43f1e6d58634 P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:54:54.479467 13887 tablet_bootstrap.cc:654] T 2e63eac2579844ef83bf43f1e6d58634 P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
W20250830 07:54:54.481912 13422 leader_election.cc:343] T a0cf1de8485941eb8a557a6e2f783047 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:54.482096 13422 leader_election.cc:304] T a0cf1de8485941eb8a557a6e2f783047 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba; no voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:54:54.482357 15470 raft_consensus.cc:2747] T a0cf1de8485941eb8a557a6e2f783047 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:54:54.482676 13227 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_c8691380fb7546fdbf2b7e92ec777cbd" } modify_external_catalogs: true
W20250830 07:54:54.482761 13422 leader_election.cc:343] T 208995abd6d44dbea3b5ebbea27d6a39 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:54.482868 13227 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_c8691380fb7546fdbf2b7e92ec777cbd" } modify_external_catalogs: true
I20250830 07:54:54.482977 13422 leader_election.cc:304] T 208995abd6d44dbea3b5ebbea27d6a39 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba; no voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:54:54.483269 15470 raft_consensus.cc:2747] T 208995abd6d44dbea3b5ebbea27d6a39 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:54:54.484174 13701 leader_election.cc:304] T 91705fc35a1b4977b89bac1765c886c0 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:54:54.484184 13232 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_dfc647b17b2544e98af73d3048cf55d9" } new_table_name: "default.Table_f770352f0a664de4870aae0a1ecf45ec" modify_external_catalogs: true
I20250830 07:54:54.484498 15245 raft_consensus.cc:2802] T 91705fc35a1b4977b89bac1765c886c0 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:54:54.484687 15245 raft_consensus.cc:491] T 91705fc35a1b4977b89bac1765c886c0 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:54:54.484803 15245 raft_consensus.cc:3058] T 91705fc35a1b4977b89bac1765c886c0 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:54.485349 13234 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_f4bee48d427e4bc883ddcf06fc1d8fb0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:54.485847 13234 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f4bee48d427e4bc883ddcf06fc1d8fb0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:54.487695 15245 raft_consensus.cc:513] T 91705fc35a1b4977b89bac1765c886c0 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:54.488785 15245 leader_election.cc:290] T 91705fc35a1b4977b89bac1765c886c0 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Requested vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967)
W20250830 07:54:54.489491 13422 leader_election.cc:343] T 2c31d119743f49589703c434ac6c7548 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:54.489646 13422 leader_election.cc:304] T 2c31d119743f49589703c434ac6c7548 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba; no voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:54:54.489890 15470 raft_consensus.cc:2747] T 2c31d119743f49589703c434ac6c7548 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:54:54.491147 13225 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_02d60b855aa948589714eac847227bfa"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:54.491554 13225 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_02d60b855aa948589714eac847227bfa in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:54.492599 13229 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_14f77b00de274b208bc290bf03dc0254" } new_table_name: "default.Table_13a62b08c4ae4b38ac2ed0bc64132f1d" modify_external_catalogs: true
I20250830 07:54:54.494324 13701 leader_election.cc:304] T c1e0e774b86d4ef9a75e2635295f3e2a P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:54:54.494953 15500 raft_consensus.cc:491] T 050e72b96c2d479896b3a54d85e6f6dd P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:54.495102 15500 raft_consensus.cc:513] T 050e72b96c2d479896b3a54d85e6f6dd P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:54.495877 15500 leader_election.cc:290] T 050e72b96c2d479896b3a54d85e6f6dd P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967)
I20250830 07:54:54.496650 15500 raft_consensus.cc:2802] T c1e0e774b86d4ef9a75e2635295f3e2a P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election won for term 1
I20250830 07:54:54.497334 15500 raft_consensus.cc:695] T c1e0e774b86d4ef9a75e2635295f3e2a P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 LEADER]: Becoming Leader. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Running, Role: LEADER
I20250830 07:54:54.497601 15500 consensus_queue.cc:237] T c1e0e774b86d4ef9a75e2635295f3e2a P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:54.497852 15585 tablet.cc:1722] T f56cab43580a4ee3a912fc5e58a3bd9d P 6b5e454d98894637b466ea27f1b647f9: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
W20250830 07:54:54.501592 13232 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 5a458e862c4f43a4aada13f87cfe3ed5 has no consensus state
I20250830 07:54:54.502526 13227 catalog_manager.cc:5864] Not sending DeleteTablet requests; no consensus state for tablet f4d87048a4a44eb8ad5c818a129180c9
I20250830 07:54:54.501840 15590 tablet.cc:1722] T d4e35395930f4c37b34649da5718aa1f P 2065c332f15a4739899af79f3669c3ba: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20250830 07:54:54.505401 13701 leader_election.cc:304] T 042fd7ff08fc4695b87bb8f9d225ef12 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:54:54.505632 15365 raft_consensus.cc:2802] T 042fd7ff08fc4695b87bb8f9d225ef12 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election won for term 1
I20250830 07:54:54.505728 15365 raft_consensus.cc:695] T 042fd7ff08fc4695b87bb8f9d225ef12 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 LEADER]: Becoming Leader. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Running, Role: LEADER
I20250830 07:54:54.505941 15365 consensus_queue.cc:237] T 042fd7ff08fc4695b87bb8f9d225ef12 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:54.512807 13886 tablet_bootstrap.cc:492] T 689b4fee1dd04b3d9ccdea334b0f6b59 P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:54:54.512919 13886 ts_tablet_manager.cc:1397] T 689b4fee1dd04b3d9ccdea334b0f6b59 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.090s user 0.000s sys 0.004s
I20250830 07:54:54.513622 13886 raft_consensus.cc:357] T 689b4fee1dd04b3d9ccdea334b0f6b59 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:54.513759 13886 raft_consensus.cc:383] T 689b4fee1dd04b3d9ccdea334b0f6b59 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:54.513808 13886 raft_consensus.cc:738] T 689b4fee1dd04b3d9ccdea334b0f6b59 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:54:54.513973 13886 consensus_queue.cc:260] T 689b4fee1dd04b3d9ccdea334b0f6b59 P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:54.514323 13886 ts_tablet_manager.cc:1428] T 689b4fee1dd04b3d9ccdea334b0f6b59 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.001s user 0.000s sys 0.002s
I20250830 07:54:54.514549 13886 tablet_bootstrap.cc:492] T 8cce7e5537794e9484f5a7c82b9e6e1d P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:54:54.522029 13226 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_001b4b819cd54981b09385489445ad90"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250830 07:54:54.522176 13887 tablet_bootstrap.cc:492] T 2e63eac2579844ef83bf43f1e6d58634 P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:54:54.522312 13887 ts_tablet_manager.cc:1397] T 2e63eac2579844ef83bf43f1e6d58634 P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.044s user 0.002s sys 0.000s
W20250830 07:54:54.522542 13226 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_001b4b819cd54981b09385489445ad90 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:54.523669 13234 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_2ef4fd56f595442da659bbfe83fea326" } new_table_name: "default.Table_a53e2c6edc4a42e08ef10c6f4f527a50" modify_external_catalogs: true
I20250830 07:54:54.524767 13227 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_3e502a4a3fdb4a9a853e5972df56090d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:54.525154 13227 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3e502a4a3fdb4a9a853e5972df56090d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:54.527817 13602 tablet_service.cc:1515] Processing DeleteTablet for tablet 8028ac4c928a48f3a077d61aec24f3bd with delete_type TABLET_DATA_DELETED (replaced by tablet 9800018e8b97423e87eb88cd9e6becd0) from {username='slave'} at 127.0.0.1:45306
I20250830 07:54:54.527981 13629 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f332d1b56d924c91a79cf6572dea1cd2" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:54.534920 13617 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "6251a06d1efe44e38d35d962c468f8b2" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9"
I20250830 07:54:54.535746 13228 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_980396fb4a82408bbe55bf0260c7431f" } new_table_name: "default.Table_452865f71f334c879ad8f25a38c12c35" modify_external_catalogs: true
W20250830 07:54:54.537925 13220 catalog_manager.cc:4908] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet 8028ac4c928a48f3a077d61aec24f3bd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8028ac4c928a48f3a077d61aec24f3bd already in progress: creating tablet
I20250830 07:54:54.542353 13882 tablet_bootstrap.cc:492] T c1e0e774b86d4ef9a75e2635295f3e2a P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:54:54.543740 15585 tablet.cc:1722] T d4e35395930f4c37b34649da5718aa1f P 6b5e454d98894637b466ea27f1b647f9: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20250830 07:54:54.543756 13617 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "579324e1f6474d398db10da3093650dd" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:54.544406 13629 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "2048c04578104c78aa6504fd9d5953a3" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9"
I20250830 07:54:54.546128 13882 ts_tablet_manager.cc:1397] T c1e0e774b86d4ef9a75e2635295f3e2a P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.120s user 0.013s sys 0.002s
I20250830 07:54:54.546518 13610 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "240a6bfad8fa478598a67a27c2dedf62" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
W20250830 07:54:54.547370 13229 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 6d2670e19bc042e7b62d9670df38525e has no consensus state
W20250830 07:54:54.547785 13234 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 77ecaf2c25d7468cabbca4c5964a676a has no consensus state
I20250830 07:54:54.547894 13701 leader_election.cc:304] T 74f2fcc22fd545fb8ca7c20619843023 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:54:54.548133 15484 raft_consensus.cc:2802] T 74f2fcc22fd545fb8ca7c20619843023 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election won for term 1
I20250830 07:54:54.548245 15484 raft_consensus.cc:695] T 74f2fcc22fd545fb8ca7c20619843023 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 LEADER]: Becoming Leader. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Running, Role: LEADER
I20250830 07:54:54.548458 15484 consensus_queue.cc:237] T 74f2fcc22fd545fb8ca7c20619843023 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:54.549508 15470 raft_consensus.cc:491] T e72402ca3cdf452fa8f4534c67226253 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:54.549638 15470 raft_consensus.cc:513] T e72402ca3cdf452fa8f4534c67226253 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:54.550185 15470 leader_election.cc:290] T e72402ca3cdf452fa8f4534c67226253 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:54.556075 13619 raft_consensus.cc:3058] T 43e93d3038f7496ebb18319420ab67e0 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Advancing to term 1
W20250830 07:54:54.557500 13228 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 51c4aed949bd40d6b9088d807a6b0dc3 consensus state has no leader
I20250830 07:54:54.557673 13610 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "713c12e1efec4e6f9895c65dc8a9c4b9" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9"
I20250830 07:54:54.560060 13624 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "91705fc35a1b4977b89bac1765c886c0" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9"
I20250830 07:54:54.560427 15245 raft_consensus.cc:491] T a7dc529c40544bafbc9e7f0ab34086bd P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:54.560782 13629 raft_consensus.cc:3058] T 087bb1e80d2d44bf8619b0341ff99527 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:54.560582 15245 raft_consensus.cc:513] T a7dc529c40544bafbc9e7f0ab34086bd P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:54.564970 15245 leader_election.cc:290] T a7dc529c40544bafbc9e7f0ab34086bd P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
I20250830 07:54:54.568478 13766 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "d206f6b6e7524a27a9f95787bcd5de77" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:54.568634 13766 raft_consensus.cc:2466] T d206f6b6e7524a27a9f95787bcd5de77 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b5e454d98894637b466ea27f1b647f9 in term 0.
I20250830 07:54:54.582683 13887 raft_consensus.cc:357] T 2e63eac2579844ef83bf43f1e6d58634 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:54.582976 13887 raft_consensus.cc:383] T 2e63eac2579844ef83bf43f1e6d58634 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:54.583689 13228 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_c5f5589680204e3398db84e86cb9a590" } modify_external_catalogs: true
I20250830 07:54:54.583878 13228 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_c5f5589680204e3398db84e86cb9a590" } modify_external_catalogs: true
I20250830 07:54:54.585592 13232 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_76298eb2ea294f03a44aeeff4fb0391f" } modify_external_catalogs: true
I20250830 07:54:54.585800 13232 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_76298eb2ea294f03a44aeeff4fb0391f" } modify_external_catalogs: true
I20250830 07:54:54.587025 13701 leader_election.cc:304] T 49165f0001044d72b68263a60ef56457 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 2065c332f15a4739899af79f3669c3ba, 6b5e454d98894637b466ea27f1b647f9
I20250830 07:54:54.587366 13701 leader_election.cc:304] T 10ec97b8a82145479e0bb526c4cc7c05 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:54:54.588182 15365 raft_consensus.cc:2747] T 49165f0001044d72b68263a60ef56457 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20250830 07:54:54.588394 15365 raft_consensus.cc:2802] T 10ec97b8a82145479e0bb526c4cc7c05 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:54:54.588487 15365 raft_consensus.cc:491] T 10ec97b8a82145479e0bb526c4cc7c05 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:54:54.588611 15365 raft_consensus.cc:3058] T 10ec97b8a82145479e0bb526c4cc7c05 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:54.591399 13887 raft_consensus.cc:738] T 2e63eac2579844ef83bf43f1e6d58634 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:54:54.591673 13887 consensus_queue.cc:260] T 2e63eac2579844ef83bf43f1e6d58634 P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:54.592293 13887 ts_tablet_manager.cc:1428] T 2e63eac2579844ef83bf43f1e6d58634 P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.070s user 0.002s sys 0.000s
I20250830 07:54:54.592945 13887 tablet_bootstrap.cc:492] T c56e3a30c18640e68c8b0c4ff4251d96 P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:54:54.593942 13886 tablet_bootstrap.cc:654] T 8cce7e5537794e9484f5a7c82b9e6e1d P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:54.597158 13228 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet fbb1cc8f8eea4a0795f6f8e213b8180f
W20250830 07:54:54.600307 13226 catalog_manager.cc:5415] Ignoring report from unknown tablet 74f2fcc22fd545fb8ca7c20619843023
W20250830 07:54:54.600369 13226 catalog_manager.cc:5415] Ignoring report from unknown tablet 689b4fee1dd04b3d9ccdea334b0f6b59
W20250830 07:54:54.600399 13226 catalog_manager.cc:5415] Ignoring report from unknown tablet 042fd7ff08fc4695b87bb8f9d225ef12
W20250830 07:54:54.600427 13226 catalog_manager.cc:5415] Ignoring report from unknown tablet f398e12cd9f543738d5163354f8a9d9d
I20250830 07:54:54.602919 13228 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_7a848fe3810548fc8459b7a06517e874"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:54.603422 13228 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7a848fe3810548fc8459b7a06517e874 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:54.607527 13227 catalog_manager.cc:5674] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325) does not have the latest schema for tablet 2f3bec2c98574a9393e0fae77e228ce0 (table default.Table_c8ae99834e3f4804aad49e8e527dbdcf [id=5fc49aaf98964a31a35fcc0405ac23ae]). Expected version 1 got 0
I20250830 07:54:54.609521 13232 catalog_manager.cc:5864] Not sending DeleteTablet requests; no consensus state for tablet 792ef34823054318be0481b97287269d
I20250830 07:54:54.611564 15365 raft_consensus.cc:513] T 10ec97b8a82145479e0bb526c4cc7c05 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:54.611955 13887 tablet_bootstrap.cc:654] T c56e3a30c18640e68c8b0c4ff4251d96 P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:54.615199 13231 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_993e7325346d495cb8c7a43441c3536a" } modify_external_catalogs: true
I20250830 07:54:54.615336 13231 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_993e7325346d495cb8c7a43441c3536a" } modify_external_catalogs: true
I20250830 07:54:54.616190 13228 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_ae6a18b6912546819781d5cde5995524" } modify_external_catalogs: true
I20250830 07:54:54.616411 13228 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_ae6a18b6912546819781d5cde5995524" } modify_external_catalogs: true
I20250830 07:54:54.617707 13232 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_920a4ed1ed944c529ef02d77159dc1d6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250830 07:54:54.618105 15365 leader_election.cc:290] T 10ec97b8a82145479e0bb526c4cc7c05 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Requested vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967)
I20250830 07:54:54.616588 13886 tablet_bootstrap.cc:492] T 8cce7e5537794e9484f5a7c82b9e6e1d P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
W20250830 07:54:54.618474 13232 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_920a4ed1ed944c529ef02d77159dc1d6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:54.618556 13886 ts_tablet_manager.cc:1397] T 8cce7e5537794e9484f5a7c82b9e6e1d P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.104s user 0.001s sys 0.002s
I20250830 07:54:54.619213 13886 raft_consensus.cc:357] T 8cce7e5537794e9484f5a7c82b9e6e1d P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:54.619385 13886 raft_consensus.cc:383] T 8cce7e5537794e9484f5a7c82b9e6e1d P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:54.619442 13886 raft_consensus.cc:738] T 8cce7e5537794e9484f5a7c82b9e6e1d P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:54:54.619589 13886 consensus_queue.cc:260] T 8cce7e5537794e9484f5a7c82b9e6e1d P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:54.620054 13886 ts_tablet_manager.cc:1428] T 8cce7e5537794e9484f5a7c82b9e6e1d P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250830 07:54:54.621002 13226 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_8453c811155f4ed68cb5b55f97f67816"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:54.621688 13226 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8453c811155f4ed68cb5b55f97f67816 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:54.624429 13624 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "a7dc529c40544bafbc9e7f0ab34086bd" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:54.624466 13629 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "e72402ca3cdf452fa8f4534c67226253" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:54.625861 13602 tablet_service.cc:1515] Processing DeleteTablet for tablet fbb1cc8f8eea4a0795f6f8e213b8180f with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:54 UTC) from {username='slave'} at 127.0.0.1:45306
I20250830 07:54:54.630782 13234 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_2f4fde18fea441d5bb5dd37170cbb3b0" } new_table_name: "default.Table_835f7ea40d0949f8befe28eccd0bc474" modify_external_catalogs: true
I20250830 07:54:54.631928 13229 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_505e1ab2760440e58ef1ed3c8dd6a96c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:54.632309 13229 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_505e1ab2760440e58ef1ed3c8dd6a96c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:54.634701 15583 raft_consensus.cc:491] T 2009012fddc24e4fb7ad0fab33a1103b P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:54.634846 15583 raft_consensus.cc:513] T 2009012fddc24e4fb7ad0fab33a1103b P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:54:54.635192 13882 raft_consensus.cc:357] T c1e0e774b86d4ef9a75e2635295f3e2a P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:54.635500 13887 tablet_bootstrap.cc:492] T c56e3a30c18640e68c8b0c4ff4251d96 P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:54:54.635617 13887 ts_tablet_manager.cc:1397] T c56e3a30c18640e68c8b0c4ff4251d96 P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.043s user 0.004s sys 0.000s
I20250830 07:54:54.635799 15583 leader_election.cc:290] T 2009012fddc24e4fb7ad0fab33a1103b P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
W20250830 07:54:54.637712 13561 leader_election.cc:343] T 2009012fddc24e4fb7ad0fab33a1103b P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): Not found: Tablet not found: 2009012fddc24e4fb7ad0fab33a1103b
W20250830 07:54:54.637960 13561 consensus_peers.cc:489] T ff2267fb411942ff826e2a72bcb89cd7 P 6b5e454d98894637b466ea27f1b647f9 -> Peer 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): Couldn't send request to peer 2065c332f15a4739899af79f3669c3ba. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ff2267fb411942ff826e2a72bcb89cd7. This is attempt 11: this message will repeat every 5th retry.
I20250830 07:54:54.637956 15470 raft_consensus.cc:491] T 5fee48de90014f94b796e726a4d16b85 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:54.638065 15470 raft_consensus.cc:513] T 5fee48de90014f94b796e726a4d16b85 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:54.638536 15470 leader_election.cc:290] T 5fee48de90014f94b796e726a4d16b85 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:54.638986 13882 raft_consensus.cc:383] T c1e0e774b86d4ef9a75e2635295f3e2a P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:54.639278 13227 catalog_manager.cc:6127] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: default.Table_502abe123cb8464db797ed4744730f2c [id=6fc5c53b47c24f8283191be07f6f3cb1] alter complete (version 2)
I20250830 07:54:54.640270 13882 raft_consensus.cc:738] T c1e0e774b86d4ef9a75e2635295f3e2a P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:54:54.640563 13882 consensus_queue.cc:260] T c1e0e774b86d4ef9a75e2635295f3e2a P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:54.641156 13882 ts_tablet_manager.cc:1428] T c1e0e774b86d4ef9a75e2635295f3e2a P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.095s user 0.001s sys 0.001s
I20250830 07:54:54.641487 13228 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet b731285205a942c8b41ca06df5274636
I20250830 07:54:54.636142 13887 raft_consensus.cc:357] T c56e3a30c18640e68c8b0c4ff4251d96 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:54.642561 13887 raft_consensus.cc:383] T c56e3a30c18640e68c8b0c4ff4251d96 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:54.642620 13887 raft_consensus.cc:738] T c56e3a30c18640e68c8b0c4ff4251d96 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:54:54.642707 13602 tablet_service.cc:1515] Processing DeleteTablet for tablet b731285205a942c8b41ca06df5274636 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:54 UTC) from {username='slave'} at 127.0.0.1:45306
W20250830 07:54:54.642777 13220 catalog_manager.cc:4908] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet fbb1cc8f8eea4a0795f6f8e213b8180f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fbb1cc8f8eea4a0795f6f8e213b8180f already in progress: creating tablet
I20250830 07:54:54.643322 13887 consensus_queue.cc:260] T c56e3a30c18640e68c8b0c4ff4251d96 P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:54.645396 13887 ts_tablet_manager.cc:1428] T c56e3a30c18640e68c8b0c4ff4251d96 P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.010s user 0.002s sys 0.000s
I20250830 07:54:54.647336 13225 master_service.cc:948] ReplaceTablet: received request to replace tablet fac764a2d269411c86b85ceeaec0b014 from {username='slave'} at 127.0.0.1:42126
W20250830 07:54:54.647553 13220 catalog_manager.cc:4908] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet b731285205a942c8b41ca06df5274636 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b731285205a942c8b41ca06df5274636 already in progress: creating tablet
I20250830 07:54:54.648922 13674 heartbeater.cc:344] Connected to a master server at 127.12.209.60:43889
I20250830 07:54:54.649942 13887 tablet_bootstrap.cc:492] T e74a3e4b3b234c41aca30f772525652e P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:54:54.651193 13227 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_4bfecb274a344101a49b53d6bc4bfb36"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:54.651770 13227 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4bfecb274a344101a49b53d6bc4bfb36 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:54.654064 13882 tablet_bootstrap.cc:492] T 519b3e58b63b402d84e234f5e180b98c P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:54:54.653945 13228 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_5211e25a50444b50acf8e8b072413a20"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:54.654508 13228 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5211e25a50444b50acf8e8b072413a20 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:54.656325 13887 tablet_bootstrap.cc:654] T e74a3e4b3b234c41aca30f772525652e P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:54.664798 13886 tablet_bootstrap.cc:492] T 6ccbaf109e36453ea6645dfd090f5a1a P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:54:54.665264 13882 tablet_bootstrap.cc:654] T 519b3e58b63b402d84e234f5e180b98c P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:54.666193 13886 tablet_bootstrap.cc:654] T 6ccbaf109e36453ea6645dfd090f5a1a P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:54.679186 15365 raft_consensus.cc:491] T 23d2c7013c9c4b4aacf47e6ac7ab5a0b P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:54.679383 15365 raft_consensus.cc:513] T 23d2c7013c9c4b4aacf47e6ac7ab5a0b P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:54.680003 15365 leader_election.cc:290] T 23d2c7013c9c4b4aacf47e6ac7ab5a0b P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967)
I20250830 07:54:54.680263 13231 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet b678fd915c534a2dac8521c21ab93396
I20250830 07:54:54.684360 13887 tablet_bootstrap.cc:492] T e74a3e4b3b234c41aca30f772525652e P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:54:54.684518 13887 ts_tablet_manager.cc:1397] T e74a3e4b3b234c41aca30f772525652e P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.035s user 0.002s sys 0.003s
I20250830 07:54:54.685253 13887 raft_consensus.cc:357] T e74a3e4b3b234c41aca30f772525652e P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:54.685546 13887 raft_consensus.cc:383] T e74a3e4b3b234c41aca30f772525652e P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:54.685608 13887 raft_consensus.cc:738] T e74a3e4b3b234c41aca30f772525652e P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:54:54.685772 13887 consensus_queue.cc:260] T e74a3e4b3b234c41aca30f772525652e P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:54.686378 13887 ts_tablet_manager.cc:1428] T e74a3e4b3b234c41aca30f772525652e P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
W20250830 07:54:54.688042 13233 catalog_manager.cc:5415] Ignoring report from unknown tablet c56e3a30c18640e68c8b0c4ff4251d96
W20250830 07:54:54.689960 13703 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.209.2:38967, user_credentials={real_user=slave}} blocked reactor thread for 120757us
W20250830 07:54:54.690969 13703 leader_election.cc:343] T 713c12e1efec4e6f9895c65dc8a9c4b9 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
W20250830 07:54:54.691262 13703 leader_election.cc:343] T 050e72b96c2d479896b3a54d85e6f6dd P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Not found: Tablet not found: 050e72b96c2d479896b3a54d85e6f6dd
W20250830 07:54:54.691860 13703 leader_election.cc:343] T 91705fc35a1b4977b89bac1765c886c0 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:54.691992 15481 consensus_queue.cc:1035] T 43e93d3038f7496ebb18319420ab67e0 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20250830 07:54:54.692212 13703 leader_election.cc:343] T a7dc529c40544bafbc9e7f0ab34086bd P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:54.692301 15481 consensus_queue.cc:1035] T 087bb1e80d2d44bf8619b0341ff99527 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:54:54.694545 14748 raft_consensus.cc:491] T 43e93d3038f7496ebb18319420ab67e0 P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:54.694733 13602 tablet_service.cc:1515] Processing DeleteTablet for tablet b678fd915c534a2dac8521c21ab93396 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:54 UTC) from {username='slave'} at 127.0.0.1:45306
I20250830 07:54:54.694737 14748 raft_consensus.cc:513] T 43e93d3038f7496ebb18319420ab67e0 P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:54.696146 13886 tablet_bootstrap.cc:492] T 6ccbaf109e36453ea6645dfd090f5a1a P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:54:54.696271 13886 ts_tablet_manager.cc:1397] T 6ccbaf109e36453ea6645dfd090f5a1a P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.032s user 0.003s sys 0.005s
I20250830 07:54:54.696960 13886 raft_consensus.cc:357] T 6ccbaf109e36453ea6645dfd090f5a1a P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:54.697103 13886 raft_consensus.cc:383] T 6ccbaf109e36453ea6645dfd090f5a1a P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:54.697149 13886 raft_consensus.cc:738] T 6ccbaf109e36453ea6645dfd090f5a1a P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:54:54.697305 13886 consensus_queue.cc:260] T 6ccbaf109e36453ea6645dfd090f5a1a P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:54.697422 14748 leader_election.cc:290] T 43e93d3038f7496ebb18319420ab67e0 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:54.697718 13886 ts_tablet_manager.cc:1428] T 6ccbaf109e36453ea6645dfd090f5a1a P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.001s user 0.001s sys 0.001s
I20250830 07:54:54.697732 13487 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "43e93d3038f7496ebb18319420ab67e0" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:54:54.697881 13487 raft_consensus.cc:2466] T 43e93d3038f7496ebb18319420ab67e0 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b5e454d98894637b466ea27f1b647f9 in term 1.
I20250830 07:54:54.697957 13886 tablet_bootstrap.cc:492] T 0208de98277c4d6889fb0289b6013ae1 P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:54:54.698267 13561 leader_election.cc:304] T 43e93d3038f7496ebb18319420ab67e0 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 6b5e454d98894637b466ea27f1b647f9; no voters:
W20250830 07:54:54.698338 13220 catalog_manager.cc:4908] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet b678fd915c534a2dac8521c21ab93396 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b678fd915c534a2dac8521c21ab93396 already in progress: creating tablet
I20250830 07:54:54.698736 14748 raft_consensus.cc:2802] T 43e93d3038f7496ebb18319420ab67e0 P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20250830 07:54:54.698841 14748 raft_consensus.cc:491] T 43e93d3038f7496ebb18319420ab67e0 P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:54:54.698936 14748 raft_consensus.cc:3058] T 43e93d3038f7496ebb18319420ab67e0 P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Advancing to term 2
I20250830 07:54:54.699165 13886 tablet_bootstrap.cc:654] T 0208de98277c4d6889fb0289b6013ae1 P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
W20250830 07:54:54.700167 13234 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ce68cb69909c42c4bb602338f73940d6 has no consensus state
I20250830 07:54:54.705188 13886 tablet_bootstrap.cc:492] T 0208de98277c4d6889fb0289b6013ae1 P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:54:54.705511 13562 leader_election.cc:304] T d206f6b6e7524a27a9f95787bcd5de77 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 2065c332f15a4739899af79f3669c3ba
I20250830 07:54:54.705858 13886 ts_tablet_manager.cc:1397] T 0208de98277c4d6889fb0289b6013ae1 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.008s user 0.003s sys 0.000s
I20250830 07:54:54.706986 14748 raft_consensus.cc:513] T 43e93d3038f7496ebb18319420ab67e0 P 6b5e454d98894637b466ea27f1b647f9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:54.707846 13487 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "43e93d3038f7496ebb18319420ab67e0" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba"
I20250830 07:54:54.708034 13487 raft_consensus.cc:3058] T 43e93d3038f7496ebb18319420ab67e0 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Advancing to term 2
I20250830 07:54:54.708539 13886 raft_consensus.cc:357] T 0208de98277c4d6889fb0289b6013ae1 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:54.708674 13886 raft_consensus.cc:383] T 0208de98277c4d6889fb0289b6013ae1 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:54.708679 15580 raft_consensus.cc:2802] T d206f6b6e7524a27a9f95787bcd5de77 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:54:54.708714 13886 raft_consensus.cc:738] T 0208de98277c4d6889fb0289b6013ae1 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:54:54.708961 13624 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "10ec97b8a82145479e0bb526c4cc7c05" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9"
I20250830 07:54:54.709249 15580 raft_consensus.cc:491] T d206f6b6e7524a27a9f95787bcd5de77 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:54:54.709343 15580 raft_consensus.cc:3058] T d206f6b6e7524a27a9f95787bcd5de77 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:54.709355 13886 consensus_queue.cc:260] T 0208de98277c4d6889fb0289b6013ae1 P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:54.710107 13886 ts_tablet_manager.cc:1428] T 0208de98277c4d6889fb0289b6013ae1 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.004s user 0.001s sys 0.000s
I20250830 07:54:54.710350 13886 tablet_bootstrap.cc:492] T 52e910677ae34630a919d1d3f21b7e83 P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:54:54.710897 13487 raft_consensus.cc:2466] T 43e93d3038f7496ebb18319420ab67e0 P 2065c332f15a4739899af79f3669c3ba [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b5e454d98894637b466ea27f1b647f9 in term 2.
I20250830 07:54:54.712139 13561 leader_election.cc:304] T 43e93d3038f7496ebb18319420ab67e0 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 6b5e454d98894637b466ea27f1b647f9; no voters:
I20250830 07:54:54.712491 15582 raft_consensus.cc:2802] T 43e93d3038f7496ebb18319420ab67e0 P 6b5e454d98894637b466ea27f1b647f9 [term 2 FOLLOWER]: Leader election won for term 2
I20250830 07:54:54.712646 15582 raft_consensus.cc:695] T 43e93d3038f7496ebb18319420ab67e0 P 6b5e454d98894637b466ea27f1b647f9 [term 2 LEADER]: Becoming Leader. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Running, Role: LEADER
I20250830 07:54:54.712611 15580 raft_consensus.cc:513] T d206f6b6e7524a27a9f95787bcd5de77 P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:54.713104 15582 consensus_queue.cc:237] T 43e93d3038f7496ebb18319420ab67e0 P 6b5e454d98894637b466ea27f1b647f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:54.714200 15580 leader_election.cc:290] T d206f6b6e7524a27a9f95787bcd5de77 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 election: Requested vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:54.714371 14748 leader_election.cc:290] T 43e93d3038f7496ebb18319420ab67e0 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 2 election: Requested vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
W20250830 07:54:54.714998 13561 leader_election.cc:343] T d206f6b6e7524a27a9f95787bcd5de77 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): Not found: Tablet not found: d206f6b6e7524a27a9f95787bcd5de77
I20250830 07:54:54.717460 13234 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_de45d4a3edad47b98cf701e1194c0182" } new_table_name: "default.Table_fe3e0cc42afa43d3a414721629ad65b4" modify_external_catalogs: true
I20250830 07:54:54.718732 13226 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_a3d67b6062f44266afff85d510239f6e" } modify_external_catalogs: true
I20250830 07:54:54.719108 13232 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_785308242878486abce6c25807f7cfa8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250830 07:54:54.719379 13629 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "23d2c7013c9c4b4aacf47e6ac7ab5a0b" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
W20250830 07:54:54.719573 13232 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_785308242878486abce6c25807f7cfa8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:54.719703 13226 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_a3d67b6062f44266afff85d510239f6e" } modify_external_catalogs: true
I20250830 07:54:54.731060 13886 tablet_bootstrap.cc:654] T 52e910677ae34630a919d1d3f21b7e83 P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:54.736116 15604 tablet.cc:1722] T f56cab43580a4ee3a912fc5e58a3bd9d P 9b057ade5dce45af9f8bf0bedf8b917f: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20250830 07:54:54.740697 15580 raft_consensus.cc:491] T 087bb1e80d2d44bf8619b0341ff99527 P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:54.740940 15580 raft_consensus.cc:513] T 087bb1e80d2d44bf8619b0341ff99527 P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:54.741983 13487 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "087bb1e80d2d44bf8619b0341ff99527" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:54:54.742164 13487 raft_consensus.cc:2466] T 087bb1e80d2d44bf8619b0341ff99527 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b5e454d98894637b466ea27f1b647f9 in term 1.
I20250830 07:54:54.742441 15115 raft_consensus.cc:491] T 14d4d2506e2a47ea906bfb81d5509829 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:54.742563 13561 leader_election.cc:304] T 087bb1e80d2d44bf8619b0341ff99527 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 6b5e454d98894637b466ea27f1b647f9; no voters:
I20250830 07:54:54.742566 15115 raft_consensus.cc:513] T 14d4d2506e2a47ea906bfb81d5509829 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:54.742971 14748 raft_consensus.cc:2802] T 087bb1e80d2d44bf8619b0341ff99527 P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20250830 07:54:54.743119 15115 leader_election.cc:290] T 14d4d2506e2a47ea906bfb81d5509829 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:54.743494 14748 raft_consensus.cc:491] T 087bb1e80d2d44bf8619b0341ff99527 P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:54:54.743620 14748 raft_consensus.cc:3058] T 087bb1e80d2d44bf8619b0341ff99527 P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Advancing to term 2
W20250830 07:54:54.745174 13423 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.209.2:38967, user_credentials={real_user=slave}} blocked reactor thread for 177945us
W20250830 07:54:54.745402 13423 leader_election.cc:343] T f332d1b56d924c91a79cf6572dea1cd2 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
W20250830 07:54:54.746347 13423 leader_election.cc:343] T 6251a06d1efe44e38d35d962c468f8b2 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
W20250830 07:54:54.747112 13423 leader_election.cc:343] T 579324e1f6474d398db10da3093650dd P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
W20250830 07:54:54.747928 13701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.209.1:45325, user_credentials={real_user=slave}} blocked reactor thread for 160242us
I20250830 07:54:54.748615 15601 consensus_queue.cc:1035] T 62ee2d0fbd774d38a4a4c4a033584ef9 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250830 07:54:54.747582 13887 tablet_bootstrap.cc:492] T d171ad1667fa44c993ec5fd7d701d8e0 P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:54:54.749814 13886 tablet_bootstrap.cc:492] T 52e910677ae34630a919d1d3f21b7e83 P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:54:54.749933 13886 ts_tablet_manager.cc:1397] T 52e910677ae34630a919d1d3f21b7e83 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.040s user 0.006s sys 0.002s
I20250830 07:54:54.751716 13887 tablet_bootstrap.cc:654] T d171ad1667fa44c993ec5fd7d701d8e0 P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:54.752298 13886 raft_consensus.cc:357] T 52e910677ae34630a919d1d3f21b7e83 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:54.752455 13886 raft_consensus.cc:383] T 52e910677ae34630a919d1d3f21b7e83 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:54.752512 13886 raft_consensus.cc:738] T 52e910677ae34630a919d1d3f21b7e83 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:54:54.752681 13886 consensus_queue.cc:260] T 52e910677ae34630a919d1d3f21b7e83 P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:54.753631 13886 ts_tablet_manager.cc:1428] T 52e910677ae34630a919d1d3f21b7e83 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20250830 07:54:54.753958 13886 tablet_bootstrap.cc:492] T 7aed56dba39e40518e9c3325bcccd74a P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
W20250830 07:54:54.755364 13423 leader_election.cc:343] T 2048c04578104c78aa6504fd9d5953a3 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:54.755867 13886 tablet_bootstrap.cc:654] T 7aed56dba39e40518e9c3325bcccd74a P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
W20250830 07:54:54.756464 13423 leader_election.cc:343] T 240a6bfad8fa478598a67a27c2dedf62 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:54.756687 13771 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "43e93d3038f7496ebb18319420ab67e0" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
W20250830 07:54:54.757229 13423 leader_election.cc:343] T e72402ca3cdf452fa8f4534c67226253 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:54.757525 13882 tablet_bootstrap.cc:492] T 519b3e58b63b402d84e234f5e180b98c P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:54:54.757675 13882 ts_tablet_manager.cc:1397] T 519b3e58b63b402d84e234f5e180b98c P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.115s user 0.001s sys 0.005s
I20250830 07:54:54.758096 13230 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_ab4bcb27ad764f5c8b7a0e6ab7fa343c" } new_table_name: "default.Table_218db01f3c744767ac6a6f723904a033" modify_external_catalogs: true
I20250830 07:54:54.758234 13771 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "43e93d3038f7496ebb18319420ab67e0" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f"
I20250830 07:54:54.758935 13771 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "d206f6b6e7524a27a9f95787bcd5de77" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f"
I20250830 07:54:54.759065 13771 raft_consensus.cc:3058] T d206f6b6e7524a27a9f95787bcd5de77 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:54.759150 13701 leader_election.cc:304] T 88bbd6b4c795433d9b6ad746353f3aa1 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:54:54.759620 15601 raft_consensus.cc:2802] T 88bbd6b4c795433d9b6ad746353f3aa1 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:54:54.759692 15601 raft_consensus.cc:491] T 88bbd6b4c795433d9b6ad746353f3aa1 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:54:54.759754 15601 raft_consensus.cc:3058] T 88bbd6b4c795433d9b6ad746353f3aa1 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:54.761603 13771 raft_consensus.cc:2466] T d206f6b6e7524a27a9f95787bcd5de77 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b5e454d98894637b466ea27f1b647f9 in term 1.
I20250830 07:54:54.763063 13765 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "087bb1e80d2d44bf8619b0341ff99527" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:54.763356 13225 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet fac764a2d269411c86b85ceeaec0b014
I20250830 07:54:54.763805 13225 catalog_manager.cc:6652] ReplaceTablet: tablet fac764a2d269411c86b85ceeaec0b014 deleted and replaced by tablet 082e7497e5bc419c807dd2f98d371d9c
I20250830 07:54:54.764205 13225 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_dbecb39f35884b0188fee0cc771e36f6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:54.764719 13225 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_dbecb39f35884b0188fee0cc771e36f6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:54.766734 13227 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_1853176e830a4a49b40b738cc9f2a87b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250830 07:54:54.762300 15580 leader_election.cc:290] T 087bb1e80d2d44bf8619b0341ff99527 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
W20250830 07:54:54.767575 13562 leader_election.cc:343] T 2009012fddc24e4fb7ad0fab33a1103b P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Not found: Tablet not found: 2009012fddc24e4fb7ad0fab33a1103b
I20250830 07:54:54.767726 13562 leader_election.cc:304] T 2009012fddc24e4fb7ad0fab33a1103b P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b5e454d98894637b466ea27f1b647f9; no voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:54:54.767781 13602 tablet_service.cc:1515] Processing DeleteTablet for tablet fac764a2d269411c86b85ceeaec0b014 with delete_type TABLET_DATA_DELETED (replaced by tablet 082e7497e5bc419c807dd2f98d371d9c) from {username='slave'} at 127.0.0.1:45306
W20250830 07:54:54.767838 13227 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1853176e830a4a49b40b738cc9f2a87b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:54.768946 13229 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_b2462f34066f4cb59a4313b24ac1f54f" } new_table_name: "default.Table_499c8922a998424698432b35b19201ce" modify_external_catalogs: true
I20250830 07:54:54.769539 15601 raft_consensus.cc:513] T 88bbd6b4c795433d9b6ad746353f3aa1 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:54.770092 15601 leader_election.cc:290] T 88bbd6b4c795433d9b6ad746353f3aa1 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Requested vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967)
W20250830 07:54:54.770902 13220 catalog_manager.cc:4908] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet fac764a2d269411c86b85ceeaec0b014 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fac764a2d269411c86b85ceeaec0b014 already in progress: creating tablet
I20250830 07:54:54.771268 13231 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_0beda1759cb64e91ba946fc884b58825"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:54.771896 13231 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0beda1759cb64e91ba946fc884b58825 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:54.771934 13629 raft_consensus.cc:1238] T 43e93d3038f7496ebb18319420ab67e0 P 6b5e454d98894637b466ea27f1b647f9 [term 2 LEADER]: Rejecting Update request from peer 9b057ade5dce45af9f8bf0bedf8b917f for earlier term 1. Current term is 2. Ops: [1.1-1.1]
W20250830 07:54:54.773566 13703 leader_election.cc:343] T 10ec97b8a82145479e0bb526c4cc7c05 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:54.767354 15514 raft_consensus.cc:491] T f32ebc2605c34a68aed50379f028052c P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:54.774986 15603 consensus_queue.cc:1035] T 087bb1e80d2d44bf8619b0341ff99527 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:54:54.775028 15514 raft_consensus.cc:513] T f32ebc2605c34a68aed50379f028052c P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:54.775583 15514 leader_election.cc:290] T f32ebc2605c34a68aed50379f028052c P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:54.775684 15514 raft_consensus.cc:491] T 2e63eac2579844ef83bf43f1e6d58634 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:54.775766 15514 raft_consensus.cc:513] T 2e63eac2579844ef83bf43f1e6d58634 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:54.776284 15514 leader_election.cc:290] T 2e63eac2579844ef83bf43f1e6d58634 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:54.776358 15604 tablet.cc:1722] T d4e35395930f4c37b34649da5718aa1f P 9b057ade5dce45af9f8bf0bedf8b917f: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20250830 07:54:54.776978 15603 consensus_queue.cc:1035] T e6060a3dc6444483b8fb2944b8090cb6 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:54:54.777441 15514 raft_consensus.cc:491] T 15f8fd7d9e6242c6b6c51251d618ef09 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:54.777550 15514 raft_consensus.cc:513] T 15f8fd7d9e6242c6b6c51251d618ef09 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:54.777983 15514 leader_election.cc:290] T 15f8fd7d9e6242c6b6c51251d618ef09 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:54.778934 15514 raft_consensus.cc:491] T ddedd1f141c147c69f178c6cd2b287da P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:54.779044 15514 raft_consensus.cc:513] T ddedd1f141c147c69f178c6cd2b287da P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:54.779501 15514 leader_election.cc:290] T ddedd1f141c147c69f178c6cd2b287da P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:54.781301 13701 leader_election.cc:304] T db4077bf8e184ac5809ef629222f2cc5 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:54:54.781539 15603 raft_consensus.cc:2802] T db4077bf8e184ac5809ef629222f2cc5 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:54:54.781602 15603 raft_consensus.cc:491] T db4077bf8e184ac5809ef629222f2cc5 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:54:54.781667 15603 raft_consensus.cc:3058] T db4077bf8e184ac5809ef629222f2cc5 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:54.784711 15603 raft_consensus.cc:513] T db4077bf8e184ac5809ef629222f2cc5 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:54.785200 15603 leader_election.cc:290] T db4077bf8e184ac5809ef629222f2cc5 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Requested vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967)
I20250830 07:54:54.785645 13701 leader_election.cc:304] T ec47a59c22ff4370bd21bc2a18336049 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:54:54.786743 15603 raft_consensus.cc:2802] T ec47a59c22ff4370bd21bc2a18336049 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:54:54.786823 15603 raft_consensus.cc:491] T ec47a59c22ff4370bd21bc2a18336049 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:54:54.786895 15603 raft_consensus.cc:3058] T ec47a59c22ff4370bd21bc2a18336049 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:54.787532 15601 raft_consensus.cc:491] T 0208de98277c4d6889fb0289b6013ae1 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:54.787626 15601 raft_consensus.cc:513] T 0208de98277c4d6889fb0289b6013ae1 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:54.788072 15601 leader_election.cc:290] T 0208de98277c4d6889fb0289b6013ae1 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
I20250830 07:54:54.788498 13882 raft_consensus.cc:357] T 519b3e58b63b402d84e234f5e180b98c P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:54.788726 13882 raft_consensus.cc:383] T 519b3e58b63b402d84e234f5e180b98c P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:54.789249 15603 raft_consensus.cc:513] T ec47a59c22ff4370bd21bc2a18336049 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:54.789748 15603 leader_election.cc:290] T ec47a59c22ff4370bd21bc2a18336049 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Requested vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967)
I20250830 07:54:54.790820 14748 raft_consensus.cc:513] T 087bb1e80d2d44bf8619b0341ff99527 P 6b5e454d98894637b466ea27f1b647f9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
W20250830 07:54:54.791910 13703 leader_election.cc:343] T 23d2c7013c9c4b4aacf47e6ac7ab5a0b P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:54.794103 13487 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "087bb1e80d2d44bf8619b0341ff99527" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba"
I20250830 07:54:54.794255 13487 raft_consensus.cc:3058] T 087bb1e80d2d44bf8619b0341ff99527 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Advancing to term 2
W20250830 07:54:54.794400 13234 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 964fa8581b7f48a9a264072241a37d64 consensus state has no leader
I20250830 07:54:54.794760 13234 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_9fe89cf5d2644f189bce96e2a92e8faa" } new_table_name: "default.Table_087307cd15dd4ae783426bfeaa35ea6c" modify_external_catalogs: true
I20250830 07:54:54.795887 13233 catalog_manager.cc:6127] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: default.Table_4b166cee7058429e8cb18ae83e4865ed [id=e946db3cd3504a69a61a7ed2cabcada7] alter complete (version 3)
I20250830 07:54:54.797041 13487 raft_consensus.cc:2466] T 087bb1e80d2d44bf8619b0341ff99527 P 2065c332f15a4739899af79f3669c3ba [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b5e454d98894637b466ea27f1b647f9 in term 2.
I20250830 07:54:54.799196 13561 leader_election.cc:304] T 087bb1e80d2d44bf8619b0341ff99527 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 6b5e454d98894637b466ea27f1b647f9; no voters:
I20250830 07:54:54.800114 14748 leader_election.cc:290] T 087bb1e80d2d44bf8619b0341ff99527 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 2 election: Requested vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:54.800112 13624 raft_consensus.cc:1238] T 087bb1e80d2d44bf8619b0341ff99527 P 6b5e454d98894637b466ea27f1b647f9 [term 2 FOLLOWER]: Rejecting Update request from peer 9b057ade5dce45af9f8bf0bedf8b917f for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20250830 07:54:54.800581 15580 raft_consensus.cc:2802] T 087bb1e80d2d44bf8619b0341ff99527 P 6b5e454d98894637b466ea27f1b647f9 [term 2 FOLLOWER]: Leader election won for term 2
I20250830 07:54:54.800740 15580 raft_consensus.cc:695] T 087bb1e80d2d44bf8619b0341ff99527 P 6b5e454d98894637b466ea27f1b647f9 [term 2 LEADER]: Becoming Leader. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Running, Role: LEADER
I20250830 07:54:54.801062 15580 consensus_queue.cc:237] T 087bb1e80d2d44bf8619b0341ff99527 P 6b5e454d98894637b466ea27f1b647f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:54.803634 15582 raft_consensus.cc:2747] T 2009012fddc24e4fb7ad0fab33a1103b P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:54:54.805209 13562 leader_election.cc:304] T d206f6b6e7524a27a9f95787bcd5de77 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 2065c332f15a4739899af79f3669c3ba
I20250830 07:54:54.805668 15582 raft_consensus.cc:2802] T d206f6b6e7524a27a9f95787bcd5de77 P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Leader election won for term 1
I20250830 07:54:54.805776 15582 raft_consensus.cc:695] T d206f6b6e7524a27a9f95787bcd5de77 P 6b5e454d98894637b466ea27f1b647f9 [term 1 LEADER]: Becoming Leader. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Running, Role: LEADER
I20250830 07:54:54.805991 15582 consensus_queue.cc:237] T d206f6b6e7524a27a9f95787bcd5de77 P 6b5e454d98894637b466ea27f1b647f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
W20250830 07:54:54.808998 13233 catalog_manager.cc:5415] Ignoring report from unknown tablet d33a5d107c6849aca6eb48ffdf8a5463
W20250830 07:54:54.809188 13233 catalog_manager.cc:5415] Ignoring report from unknown tablet c56e3a30c18640e68c8b0c4ff4251d96
I20250830 07:54:54.809285 13487 raft_consensus.cc:1238] T 43e93d3038f7496ebb18319420ab67e0 P 2065c332f15a4739899af79f3669c3ba [term 2 FOLLOWER]: Rejecting Update request from peer 9b057ade5dce45af9f8bf0bedf8b917f for earlier term 1. Current term is 2. Ops: []
I20250830 07:54:54.814603 13624 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "5fee48de90014f94b796e726a4d16b85" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:54.816998 13624 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "14d4d2506e2a47ea906bfb81d5509829" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:54.817451 13624 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f32ebc2605c34a68aed50379f028052c" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:54.817734 13486 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "91705fc35a1b4977b89bac1765c886c0" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba"
I20250830 07:54:54.817795 13481 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "713c12e1efec4e6f9895c65dc8a9c4b9" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba"
I20250830 07:54:54.817863 13486 raft_consensus.cc:3058] T 91705fc35a1b4977b89bac1765c886c0 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:54.817941 13481 raft_consensus.cc:3058] T 713c12e1efec4e6f9895c65dc8a9c4b9 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:54.820783 13486 raft_consensus.cc:2466] T 91705fc35a1b4977b89bac1765c886c0 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 1.
I20250830 07:54:54.821362 13624 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "2e63eac2579844ef83bf43f1e6d58634" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:54.821503 13481 raft_consensus.cc:2466] T 713c12e1efec4e6f9895c65dc8a9c4b9 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 1.
I20250830 07:54:54.821815 13624 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "15f8fd7d9e6242c6b6c51251d618ef09" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:54.822371 15245 raft_consensus.cc:491] T 50360492db824755a6de251436cab5c6 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:54.822566 13624 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "ddedd1f141c147c69f178c6cd2b287da" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:54.822537 15245 raft_consensus.cc:513] T 50360492db824755a6de251436cab5c6 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:54.823182 15245 leader_election.cc:290] T 50360492db824755a6de251436cab5c6 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
I20250830 07:54:54.823508 13232 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_accd635a5d39461a8ecd9d947700d768" } modify_external_catalogs: true
I20250830 07:54:54.823655 13232 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_accd635a5d39461a8ecd9d947700d768" } modify_external_catalogs: true
I20250830 07:54:54.824301 13624 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "88bbd6b4c795433d9b6ad746353f3aa1" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9"
I20250830 07:54:54.825407 13228 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_212693ef5d43495f976d99b2bc0ecbe1" } modify_external_catalogs: true
I20250830 07:54:54.825551 13228 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_212693ef5d43495f976d99b2bc0ecbe1" } modify_external_catalogs: true
I20250830 07:54:54.825640 13624 raft_consensus.cc:3058] T 28c2f7a3a6dd444585f0f5d337b985e9 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:54.832926 13629 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "db4077bf8e184ac5809ef629222f2cc5" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9"
I20250830 07:54:54.833704 13771 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "087bb1e80d2d44bf8619b0341ff99527" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f"
I20250830 07:54:54.834149 13629 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "0208de98277c4d6889fb0289b6013ae1" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:54.835081 15481 consensus_queue.cc:1046] T 43e93d3038f7496ebb18319420ab67e0 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:54:54.835139 15600 consensus_queue.cc:1046] T 087bb1e80d2d44bf8619b0341ff99527 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:54:54.835336 15481 consensus_queue.cc:1230] T 43e93d3038f7496ebb18319420ab67e0 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Peer 6b5e454d98894637b466ea27f1b647f9 log is divergent from this leader: its last log entry 2.1 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 0
I20250830 07:54:54.835438 15365 raft_consensus.cc:3053] T 43e93d3038f7496ebb18319420ab67e0 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 LEADER]: Stepping down as leader of term 1
I20250830 07:54:54.835505 15365 raft_consensus.cc:738] T 43e93d3038f7496ebb18319420ab67e0 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Running, Role: LEADER
I20250830 07:54:54.835738 15365 consensus_queue.cc:260] T 43e93d3038f7496ebb18319420ab67e0 P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:54.835991 15365 raft_consensus.cc:3058] T 43e93d3038f7496ebb18319420ab67e0 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Advancing to term 2
I20250830 07:54:54.839094 15481 raft_consensus.cc:3053] T 087bb1e80d2d44bf8619b0341ff99527 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 LEADER]: Stepping down as leader of term 1
I20250830 07:54:54.839152 15481 raft_consensus.cc:738] T 087bb1e80d2d44bf8619b0341ff99527 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Running, Role: LEADER
I20250830 07:54:54.839334 15481 consensus_queue.cc:260] T 087bb1e80d2d44bf8619b0341ff99527 P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:54.839483 15481 raft_consensus.cc:3058] T 087bb1e80d2d44bf8619b0341ff99527 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Advancing to term 2
I20250830 07:54:54.842523 13477 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "a7dc529c40544bafbc9e7f0ab34086bd" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:54:54.842680 13477 raft_consensus.cc:2466] T a7dc529c40544bafbc9e7f0ab34086bd P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 0.
I20250830 07:54:54.843670 13629 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "ec47a59c22ff4370bd21bc2a18336049" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9"
W20250830 07:54:54.849334 13233 catalog_manager.cc:5415] Ignoring report from unknown tablet 057bcce2860345da860acc262dc4d339
W20250830 07:54:54.849515 13233 catalog_manager.cc:5415] Ignoring report from unknown tablet d1bf58d367f54ba8bad64887b9a8d9cc
I20250830 07:54:54.851472 13477 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "10ec97b8a82145479e0bb526c4cc7c05" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba"
I20250830 07:54:54.851621 13477 raft_consensus.cc:3058] T 10ec97b8a82145479e0bb526c4cc7c05 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:54.854223 13477 raft_consensus.cc:2466] T 10ec97b8a82145479e0bb526c4cc7c05 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 1.
I20250830 07:54:54.854889 13226 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet dbae44ffd7494075abb2c46eb6fe115b
I20250830 07:54:54.855595 13226 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_2e94171cf3db418ca01ed0269631f53c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:54.856118 13226 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2e94171cf3db418ca01ed0269631f53c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250830 07:54:54.856447 13703 leader_election.cc:343] T 88bbd6b4c795433d9b6ad746353f3aa1 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:54.856616 13477 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "23d2c7013c9c4b4aacf47e6ac7ab5a0b" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:54:54.856797 13477 raft_consensus.cc:2466] T 23d2c7013c9c4b4aacf47e6ac7ab5a0b P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 0.
I20250830 07:54:54.857400 13602 tablet_service.cc:1515] Processing DeleteTablet for tablet dbae44ffd7494075abb2c46eb6fe115b with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:54 UTC) from {username='slave'} at 127.0.0.1:45306
W20250830 07:54:54.857457 13703 consensus_peers.cc:489] T ef1ab62a5b7845e58d50f34206eaaa27 P 9b057ade5dce45af9f8bf0bedf8b917f -> Peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Couldn't send request to peer 6b5e454d98894637b466ea27f1b647f9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20250830 07:54:54.857935 13220 catalog_manager.cc:4908] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet dbae44ffd7494075abb2c46eb6fe115b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet dbae44ffd7494075abb2c46eb6fe115b already in progress: creating tablet
W20250830 07:54:54.858340 13703 leader_election.cc:343] T db4077bf8e184ac5809ef629222f2cc5 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
W20250830 07:54:54.858578 13703 leader_election.cc:343] T 0208de98277c4d6889fb0289b6013ae1 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
W20250830 07:54:54.858713 13703 leader_election.cc:343] T ec47a59c22ff4370bd21bc2a18336049 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
W20250830 07:54:54.859447 13423 leader_election.cc:343] T 5fee48de90014f94b796e726a4d16b85 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
W20250830 07:54:54.859912 13423 leader_election.cc:343] T 14d4d2506e2a47ea906bfb81d5509829 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
W20250830 07:54:54.860085 13423 leader_election.cc:343] T f32ebc2605c34a68aed50379f028052c P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
W20250830 07:54:54.862249 13423 leader_election.cc:343] T 2e63eac2579844ef83bf43f1e6d58634 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
W20250830 07:54:54.862458 13423 leader_election.cc:343] T 15f8fd7d9e6242c6b6c51251d618ef09 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
W20250830 07:54:54.862756 13703 leader_election.cc:343] T 50360492db824755a6de251436cab5c6 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Not found: Tablet not found: 50360492db824755a6de251436cab5c6
W20250830 07:54:54.865528 13423 leader_election.cc:343] T ddedd1f141c147c69f178c6cd2b287da P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
W20250830 07:54:54.866187 13423 consensus_peers.cc:489] T 7af74bdde363493f8061eba450ecf4b4 P 2065c332f15a4739899af79f3669c3ba -> Peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Couldn't send request to peer 6b5e454d98894637b466ea27f1b647f9. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7af74bdde363493f8061eba450ecf4b4. This is attempt 1: this message will repeat every 5th retry.
I20250830 07:54:54.867484 13886 tablet_bootstrap.cc:492] T 7aed56dba39e40518e9c3325bcccd74a P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:54:54.867615 13886 ts_tablet_manager.cc:1397] T 7aed56dba39e40518e9c3325bcccd74a P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.114s user 0.001s sys 0.009s
W20250830 07:54:54.869441 13230 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 4eb1af594b3449b8b8e2f6d5d4f7933f has no consensus state
I20250830 07:54:54.869783 13230 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_545b6e61bc5e4bc58db55a95cfdb3531" } modify_external_catalogs: true
I20250830 07:54:54.869949 13230 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_545b6e61bc5e4bc58db55a95cfdb3531" } modify_external_catalogs: true
I20250830 07:54:54.875178 13886 raft_consensus.cc:357] T 7aed56dba39e40518e9c3325bcccd74a P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:54.875372 13886 raft_consensus.cc:383] T 7aed56dba39e40518e9c3325bcccd74a P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:54.875438 13886 raft_consensus.cc:738] T 7aed56dba39e40518e9c3325bcccd74a P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:54:54.875619 13886 consensus_queue.cc:260] T 7aed56dba39e40518e9c3325bcccd74a P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:54.876102 13886 ts_tablet_manager.cc:1428] T 7aed56dba39e40518e9c3325bcccd74a P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.008s user 0.000s sys 0.001s
I20250830 07:54:54.876435 13886 tablet_bootstrap.cc:492] T a8660a6ff9254d4f9f0ef047b8682ed1 P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:54:54.868656 13481 raft_consensus.cc:1238] T 087bb1e80d2d44bf8619b0341ff99527 P 2065c332f15a4739899af79f3669c3ba [term 2 FOLLOWER]: Rejecting Update request from peer 9b057ade5dce45af9f8bf0bedf8b917f for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20250830 07:54:54.878496 13886 tablet_bootstrap.cc:654] T a8660a6ff9254d4f9f0ef047b8682ed1 P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:54.868791 13887 tablet_bootstrap.cc:492] T d171ad1667fa44c993ec5fd7d701d8e0 P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:54:54.869032 13476 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "db4077bf8e184ac5809ef629222f2cc5" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba"
I20250830 07:54:54.869213 13480 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "ec47a59c22ff4370bd21bc2a18336049" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba"
I20250830 07:54:54.878947 13887 ts_tablet_manager.cc:1397] T d171ad1667fa44c993ec5fd7d701d8e0 P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.131s user 0.006s sys 0.009s
I20250830 07:54:54.878998 13480 raft_consensus.cc:3058] T ec47a59c22ff4370bd21bc2a18336049 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:54.879580 13887 raft_consensus.cc:357] T d171ad1667fa44c993ec5fd7d701d8e0 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:54.879729 13887 raft_consensus.cc:383] T d171ad1667fa44c993ec5fd7d701d8e0 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:54.879794 13887 raft_consensus.cc:738] T d171ad1667fa44c993ec5fd7d701d8e0 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:54:54.879945 13887 consensus_queue.cc:260] T d171ad1667fa44c993ec5fd7d701d8e0 P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:54.880669 13887 ts_tablet_manager.cc:1428] T d171ad1667fa44c993ec5fd7d701d8e0 P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20250830 07:54:54.881785 13480 raft_consensus.cc:2466] T ec47a59c22ff4370bd21bc2a18336049 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 1.
I20250830 07:54:54.882193 15245 raft_consensus.cc:491] T f66e1d07039841088a444ee0203a4eb0 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:54.882301 15245 raft_consensus.cc:513] T f66e1d07039841088a444ee0203a4eb0 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:54.882735 15245 leader_election.cc:290] T f66e1d07039841088a444ee0203a4eb0 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
I20250830 07:54:54.884464 13771 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f332d1b56d924c91a79cf6572dea1cd2" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:54.886144 13771 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "6251a06d1efe44e38d35d962c468f8b2" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f"
I20250830 07:54:54.886291 13771 raft_consensus.cc:3058] T 6251a06d1efe44e38d35d962c468f8b2 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:54.888087 15245 raft_consensus.cc:491] T 689b4fee1dd04b3d9ccdea334b0f6b59 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:54.888185 15245 raft_consensus.cc:513] T 689b4fee1dd04b3d9ccdea334b0f6b59 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:54.888626 15245 leader_election.cc:290] T 689b4fee1dd04b3d9ccdea334b0f6b59 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
I20250830 07:54:54.888695 13771 raft_consensus.cc:2466] T 6251a06d1efe44e38d35d962c468f8b2 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2065c332f15a4739899af79f3669c3ba in term 1.
I20250830 07:54:54.878947 13476 raft_consensus.cc:3058] T db4077bf8e184ac5809ef629222f2cc5 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:54.869423 13484 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "0208de98277c4d6889fb0289b6013ae1" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:54:54.870509 13487 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "88bbd6b4c795433d9b6ad746353f3aa1" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba"
I20250830 07:54:54.871093 15602 raft_consensus.cc:491] T 2f3bec2c98574a9393e0fae77e228ce0 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:54.892074 13484 raft_consensus.cc:2466] T 0208de98277c4d6889fb0289b6013ae1 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 0.
I20250830 07:54:54.892217 15602 raft_consensus.cc:513] T 2f3bec2c98574a9393e0fae77e228ce0 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:54.892814 15602 leader_election.cc:290] T 2f3bec2c98574a9393e0fae77e228ce0 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:54.892973 13487 raft_consensus.cc:3058] T 88bbd6b4c795433d9b6ad746353f3aa1 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:54.893882 13225 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_1ac40b5a080246b99e34f715845393b0" } modify_external_catalogs: true
I20250830 07:54:54.894037 13225 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_1ac40b5a080246b99e34f715845393b0" } modify_external_catalogs: true
I20250830 07:54:54.894281 13476 raft_consensus.cc:2466] T db4077bf8e184ac5809ef629222f2cc5 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 1.
I20250830 07:54:54.895258 13227 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_b6b768ead0f540ddb0f99bc8a562d646"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250830 07:54:54.895507 13487 raft_consensus.cc:2466] T 88bbd6b4c795433d9b6ad746353f3aa1 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 1.
W20250830 07:54:54.895737 13227 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b6b768ead0f540ddb0f99bc8a562d646 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:54.896092 15602 raft_consensus.cc:491] T 846338e46b834ae0b5f4e74c7f1325d2 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:54.896191 15602 raft_consensus.cc:513] T 846338e46b834ae0b5f4e74c7f1325d2 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:54.896466 13771 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "579324e1f6474d398db10da3093650dd" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:54.896610 15602 leader_election.cc:290] T 846338e46b834ae0b5f4e74c7f1325d2 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:54.898007 13765 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "240a6bfad8fa478598a67a27c2dedf62" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:54.902702 13775 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "2048c04578104c78aa6504fd9d5953a3" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f"
I20250830 07:54:54.902837 13775 raft_consensus.cc:3058] T 2048c04578104c78aa6504fd9d5953a3 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:54.904296 13765 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "e72402ca3cdf452fa8f4534c67226253" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:54.905238 13775 raft_consensus.cc:2466] T 2048c04578104c78aa6504fd9d5953a3 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2065c332f15a4739899af79f3669c3ba in term 1.
I20250830 07:54:54.905838 13765 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "14d4d2506e2a47ea906bfb81d5509829" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:54.906162 13887 tablet_bootstrap.cc:492] T 66432e73deea433d9df565d5fcace647 P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:54:54.907711 13887 tablet_bootstrap.cc:654] T 66432e73deea433d9df565d5fcace647 P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:54.913976 13765 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f32ebc2605c34a68aed50379f028052c" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:54.914264 13764 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "2e63eac2579844ef83bf43f1e6d58634" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:54.914682 13764 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "15f8fd7d9e6242c6b6c51251d618ef09" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:54.914877 13767 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "ddedd1f141c147c69f178c6cd2b287da" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:54.915701 13765 raft_consensus.cc:1273] T 7af74bdde363493f8061eba450ecf4b4 P 9b057ade5dce45af9f8bf0bedf8b917f [term 2 FOLLOWER]: Refusing update from remote peer 2065c332f15a4739899af79f3669c3ba: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20250830 07:54:54.917948 13766 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "846338e46b834ae0b5f4e74c7f1325d2" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:54.918326 13765 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "2f3bec2c98574a9393e0fae77e228ce0" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:54.918951 13775 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "5fee48de90014f94b796e726a4d16b85" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:54.922523 13886 tablet_bootstrap.cc:492] T a8660a6ff9254d4f9f0ef047b8682ed1 P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:54:54.922672 13886 ts_tablet_manager.cc:1397] T a8660a6ff9254d4f9f0ef047b8682ed1 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.046s user 0.000s sys 0.004s
I20250830 07:54:54.923547 13886 raft_consensus.cc:357] T a8660a6ff9254d4f9f0ef047b8682ed1 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:54.925999 13477 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f66e1d07039841088a444ee0203a4eb0" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:54:54.926203 13477 raft_consensus.cc:2466] T f66e1d07039841088a444ee0203a4eb0 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 0.
W20250830 07:54:54.926713 13422 leader_election.cc:343] T f332d1b56d924c91a79cf6572dea1cd2 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:54.926877 13422 leader_election.cc:304] T f332d1b56d924c91a79cf6572dea1cd2 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba; no voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f
W20250830 07:54:54.927063 13229 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ad7a45187569416bad6c71db9f8ab702 consensus state has no leader
I20250830 07:54:54.927152 15602 raft_consensus.cc:2747] T f332d1b56d924c91a79cf6572dea1cd2 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:54:54.927441 13229 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_ae95817d5867430aa1d3d0f213a0694b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:54.927979 13229 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ae95817d5867430aa1d3d0f213a0694b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:54.929024 13422 leader_election.cc:304] T 6251a06d1efe44e38d35d962c468f8b2 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:54:54.929293 15602 raft_consensus.cc:2802] T 6251a06d1efe44e38d35d962c468f8b2 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election won for term 1
I20250830 07:54:54.929414 15602 raft_consensus.cc:695] T 6251a06d1efe44e38d35d962c468f8b2 P 2065c332f15a4739899af79f3669c3ba [term 1 LEADER]: Becoming Leader. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Running, Role: LEADER
I20250830 07:54:54.929653 15602 consensus_queue.cc:237] T 6251a06d1efe44e38d35d962c468f8b2 P 2065c332f15a4739899af79f3669c3ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:54.930313 13886 raft_consensus.cc:383] T a8660a6ff9254d4f9f0ef047b8682ed1 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:54.930382 13886 raft_consensus.cc:738] T a8660a6ff9254d4f9f0ef047b8682ed1 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:54:54.930539 13886 consensus_queue.cc:260] T a8660a6ff9254d4f9f0ef047b8682ed1 P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:54.931133 13886 ts_tablet_manager.cc:1428] T a8660a6ff9254d4f9f0ef047b8682ed1 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.008s user 0.001s sys 0.001s
I20250830 07:54:54.931445 13886 tablet_bootstrap.cc:492] T 76ab56c469cf4675a4e21acbe0a8085d P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:54:54.933370 13886 tablet_bootstrap.cc:654] T 76ab56c469cf4675a4e21acbe0a8085d P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:54.933306 13629 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "2f3bec2c98574a9393e0fae77e228ce0" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:54.934975 13629 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "846338e46b834ae0b5f4e74c7f1325d2" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
W20250830 07:54:54.937868 13423 leader_election.cc:343] T 2f3bec2c98574a9393e0fae77e228ce0 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
W20250830 07:54:54.938120 13423 leader_election.cc:343] T 846338e46b834ae0b5f4e74c7f1325d2 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:54.938850 13477 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "689b4fee1dd04b3d9ccdea334b0f6b59" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:54:54.940274 13477 raft_consensus.cc:2466] T 689b4fee1dd04b3d9ccdea334b0f6b59 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 0.
I20250830 07:54:54.941828 13629 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f66e1d07039841088a444ee0203a4eb0" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
W20250830 07:54:54.942142 13234 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d61e0a9eb5b64eaca5f4626c6f836df1 has no consensus state
I20250830 07:54:54.942435 13629 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "689b4fee1dd04b3d9ccdea334b0f6b59" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:54.942467 13234 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_e79515802e1547b482585de9a1742c33" } new_table_name: "default.Table_079ce82820dd41b7bfe54880e2d23b4f" modify_external_catalogs: true
I20250830 07:54:54.943908 13231 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_aa9527e58f164273a017ed1690966739"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:54.944335 13231 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_aa9527e58f164273a017ed1690966739 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250830 07:54:54.949059 13233 catalog_manager.cc:5415] Ignoring report from unknown tablet 0208de98277c4d6889fb0289b6013ae1
W20250830 07:54:54.949474 13233 catalog_manager.cc:5415] Ignoring report from unknown tablet 6ccbaf109e36453ea6645dfd090f5a1a
I20250830 07:54:54.950366 13887 tablet_bootstrap.cc:492] T 66432e73deea433d9df565d5fcace647 P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:54:54.950491 13887 ts_tablet_manager.cc:1397] T 66432e73deea433d9df565d5fcace647 P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.044s user 0.000s sys 0.002s
I20250830 07:54:54.951174 13887 raft_consensus.cc:357] T 66432e73deea433d9df565d5fcace647 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:54.951361 13887 raft_consensus.cc:383] T 66432e73deea433d9df565d5fcace647 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:54.951423 13887 raft_consensus.cc:738] T 66432e73deea433d9df565d5fcace647 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:54:54.951642 13887 consensus_queue.cc:260] T 66432e73deea433d9df565d5fcace647 P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:54.952145 13887 ts_tablet_manager.cc:1428] T 66432e73deea433d9df565d5fcace647 P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20250830 07:54:54.952414 13887 tablet_bootstrap.cc:492] T ed364f03bdad42b88e181b7d0e1e4011 P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:54:54.954051 13887 tablet_bootstrap.cc:654] T ed364f03bdad42b88e181b7d0e1e4011 P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
W20250830 07:54:54.955576 13703 leader_election.cc:343] T f66e1d07039841088a444ee0203a4eb0 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
W20250830 07:54:54.955821 13703 leader_election.cc:343] T 689b4fee1dd04b3d9ccdea334b0f6b59 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
W20250830 07:54:54.968977 13422 leader_election.cc:343] T 579324e1f6474d398db10da3093650dd P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:54.969127 13422 leader_election.cc:304] T 579324e1f6474d398db10da3093650dd P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba; no voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:54:54.969587 15115 raft_consensus.cc:2747] T 579324e1f6474d398db10da3093650dd P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20250830 07:54:54.970309 13422 leader_election.cc:343] T 240a6bfad8fa478598a67a27c2dedf62 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:54.970466 13422 leader_election.cc:304] T 240a6bfad8fa478598a67a27c2dedf62 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba; no voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:54:54.970952 15115 raft_consensus.cc:2747] T 240a6bfad8fa478598a67a27c2dedf62 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20250830 07:54:54.971863 13422 leader_election.cc:343] T e72402ca3cdf452fa8f4534c67226253 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:54.972007 13422 leader_election.cc:304] T e72402ca3cdf452fa8f4534c67226253 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba; no voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:54:54.972222 15115 raft_consensus.cc:2747] T e72402ca3cdf452fa8f4534c67226253 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:54:54.973254 13422 leader_election.cc:304] T 2048c04578104c78aa6504fd9d5953a3 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:54:54.973515 15115 raft_consensus.cc:2802] T 2048c04578104c78aa6504fd9d5953a3 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election won for term 1
I20250830 07:54:54.973613 15115 raft_consensus.cc:695] T 2048c04578104c78aa6504fd9d5953a3 P 2065c332f15a4739899af79f3669c3ba [term 1 LEADER]: Becoming Leader. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Running, Role: LEADER
I20250830 07:54:54.973851 15115 consensus_queue.cc:237] T 2048c04578104c78aa6504fd9d5953a3 P 2065c332f15a4739899af79f3669c3ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:54.986583 13887 tablet_bootstrap.cc:492] T ed364f03bdad42b88e181b7d0e1e4011 P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:54:54.986719 13887 ts_tablet_manager.cc:1397] T ed364f03bdad42b88e181b7d0e1e4011 P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.034s user 0.002s sys 0.000s
I20250830 07:54:54.987435 13887 raft_consensus.cc:357] T ed364f03bdad42b88e181b7d0e1e4011 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:54.987603 13887 raft_consensus.cc:383] T ed364f03bdad42b88e181b7d0e1e4011 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:54.987666 13887 raft_consensus.cc:738] T ed364f03bdad42b88e181b7d0e1e4011 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:54:54.987834 13887 consensus_queue.cc:260] T ed364f03bdad42b88e181b7d0e1e4011 P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:54.988313 13887 ts_tablet_manager.cc:1428] T ed364f03bdad42b88e181b7d0e1e4011 P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20250830 07:54:54.988621 13887 tablet_bootstrap.cc:492] T 1db4109dc43b489d89c5de9eeb64a771 P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
W20250830 07:54:54.989058 13422 leader_election.cc:343] T 14d4d2506e2a47ea906bfb81d5509829 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:54.989457 13422 leader_election.cc:304] T 14d4d2506e2a47ea906bfb81d5509829 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba; no voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f
W20250830 07:54:54.950716 13220 catalog_manager.cc:4726] Async tablet task AlterTable RPC for tablet f4d87048a4a44eb8ad5c818a129180c9 (table default.Table_c8691380fb7546fdbf2b7e92ec777cbd [id=c194c20aca144145b019f088c144fb8d], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet f4d87048a4a44eb8ad5c818a129180c9 has no consensus state
W20250830 07:54:54.991389 13233 catalog_manager.cc:5415] Ignoring report from unknown tablet 74ea2298876a4066b297915c135d4618
W20250830 07:54:54.991725 13233 catalog_manager.cc:5415] Ignoring report from unknown tablet 7c5e50cb605c4a40b47984f328eedd93
W20250830 07:54:54.992048 13233 catalog_manager.cc:5415] Ignoring report from unknown tablet 8cce7e5537794e9484f5a7c82b9e6e1d
I20250830 07:54:54.992487 13232 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet 66432e73deea433d9df565d5fcace647
I20250830 07:54:54.993142 13232 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_edf831f0aad946ef88dc837a3b4b6ef0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:54.993603 13232 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_edf831f0aad946ef88dc837a3b4b6ef0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:54.994835 13602 tablet_service.cc:1515] Processing DeleteTablet for tablet 66432e73deea433d9df565d5fcace647 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:54 UTC) from {username='slave'} at 127.0.0.1:45306
W20250830 07:54:54.995465 13220 catalog_manager.cc:4908] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet 66432e73deea433d9df565d5fcace647 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 66432e73deea433d9df565d5fcace647 already in progress: creating tablet
I20250830 07:54:54.997212 13233 catalog_manager.cc:5674] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743) does not have the latest schema for tablet 924403105a6a40f28aad60647a2a8987 (table default.Table_f62c15a884574e3ebe9ce39aa18d1e00 [id=46ec9117fe9146cb807dd092284616fc]). Expected version 2 got 0
I20250830 07:54:54.997867 15602 raft_consensus.cc:2747] T 14d4d2506e2a47ea906bfb81d5509829 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:54:54.998126 13233 catalog_manager.cc:5674] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743) does not have the latest schema for tablet 52e910677ae34630a919d1d3f21b7e83 (table default.Table_96df3a05fc564aba9ae2d0e0f1e94abb [id=b3fced981b2a4b44a8eab43675699ba5]). Expected version 1 got 0
W20250830 07:54:54.998234 13422 leader_election.cc:343] T f32ebc2605c34a68aed50379f028052c P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:54.999013 15245 raft_consensus.cc:491] T 97d49a1f600f4c13a4aafca99cedabe8 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:54.999140 15245 raft_consensus.cc:513] T 97d49a1f600f4c13a4aafca99cedabe8 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:54.999634 15245 leader_election.cc:290] T 97d49a1f600f4c13a4aafca99cedabe8 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
W20250830 07:54:55.005234 13703 consensus_peers.cc:489] T 3bb48fce24074a8e8ec99d3172a655d8 P 9b057ade5dce45af9f8bf0bedf8b917f -> Peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Couldn't send request to peer 6b5e454d98894637b466ea27f1b647f9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20250830 07:54:55.006676 13422 leader_election.cc:304] T f32ebc2605c34a68aed50379f028052c P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba; no voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:54:54.990662 13887 tablet_bootstrap.cc:654] T 1db4109dc43b489d89c5de9eeb64a771 P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:55.002825 13629 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "97d49a1f600f4c13a4aafca99cedabe8" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:55.001609 13882 raft_consensus.cc:738] T 519b3e58b63b402d84e234f5e180b98c P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:54:55.008635 15602 raft_consensus.cc:2747] T f32ebc2605c34a68aed50379f028052c P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20250830 07:54:55.009024 13422 leader_election.cc:343] T 2e63eac2579844ef83bf43f1e6d58634 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Illegal state: must be running to vote when last-logged opid is not known
W20250830 07:54:55.009511 13703 leader_election.cc:343] T 97d49a1f600f4c13a4aafca99cedabe8 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:55.009236 13882 consensus_queue.cc:260] T 519b3e58b63b402d84e234f5e180b98c P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:55.014573 13882 ts_tablet_manager.cc:1428] T 519b3e58b63b402d84e234f5e180b98c P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.257s user 0.019s sys 0.003s
I20250830 07:54:55.016872 13882 tablet_bootstrap.cc:492] T 3c3c798b2b7b460b98a30605464763e6 P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:54:55.021551 13422 leader_election.cc:304] T 2e63eac2579844ef83bf43f1e6d58634 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba; no voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:54:55.021968 15580 raft_consensus.cc:491] T 057bcce2860345da860acc262dc4d339 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:55.022083 15580 raft_consensus.cc:513] T 057bcce2860345da860acc262dc4d339 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:55.022627 15580 leader_election.cc:290] T 057bcce2860345da860acc262dc4d339 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:55.023329 13477 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "057bcce2860345da860acc262dc4d339" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:54:55.024682 15514 raft_consensus.cc:491] T 1cf23cf78eee46be953bd701aa6bef07 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:55.024797 15514 raft_consensus.cc:513] T 1cf23cf78eee46be953bd701aa6bef07 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:55.025475 15514 leader_election.cc:290] T 1cf23cf78eee46be953bd701aa6bef07 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:55.025813 15602 raft_consensus.cc:2747] T 2e63eac2579844ef83bf43f1e6d58634 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:54:55.026027 13771 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "057bcce2860345da860acc262dc4d339" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:55.026268 13629 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "1cf23cf78eee46be953bd701aa6bef07" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:55.026810 13562 leader_election.cc:304] T 057bcce2860345da860acc262dc4d339 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b5e454d98894637b466ea27f1b647f9; no voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f
W20250830 07:54:55.027319 13423 leader_election.cc:343] T 1cf23cf78eee46be953bd701aa6bef07 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
W20250830 07:54:55.027640 13422 leader_election.cc:343] T 15f8fd7d9e6242c6b6c51251d618ef09 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:55.027729 13422 leader_election.cc:304] T 15f8fd7d9e6242c6b6c51251d618ef09 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba; no voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:54:55.029422 13701 leader_election.cc:304] T 91705fc35a1b4977b89bac1765c886c0 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:54:55.031294 15582 raft_consensus.cc:2747] T 057bcce2860345da860acc262dc4d339 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:54:55.033398 15602 raft_consensus.cc:2747] T 15f8fd7d9e6242c6b6c51251d618ef09 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20250830 07:54:55.033816 13422 leader_election.cc:343] T ddedd1f141c147c69f178c6cd2b287da P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:55.034988 13228 catalog_manager.cc:5864] Not sending DeleteTablet requests; no consensus state for tablet 7be1a4d423a042df988c772cfc4886a1
I20250830 07:54:55.035252 15481 raft_consensus.cc:2802] T 91705fc35a1b4977b89bac1765c886c0 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election won for term 1
I20250830 07:54:55.035362 15481 raft_consensus.cc:695] T 91705fc35a1b4977b89bac1765c886c0 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 LEADER]: Becoming Leader. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Running, Role: LEADER
I20250830 07:54:55.035573 15481 consensus_queue.cc:237] T 91705fc35a1b4977b89bac1765c886c0 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:55.039355 13226 master_service.cc:948] ReplaceTablet: received request to replace tablet 3bca390f6d4343cba7a9fb07f0d4d72b from {username='slave'} at 127.0.0.1:42126
I20250830 07:54:55.039906 13226 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_d2ebc02fa0a943d79900be72a77f947a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250830 07:54:55.040727 13230 catalog_manager.cc:5864] Not sending DeleteTablet requests; no consensus state for tablet 0cfcc6627ff542ac888ac667ad83283e
I20250830 07:54:55.040690 13701 leader_election.cc:304] T 713c12e1efec4e6f9895c65dc8a9c4b9 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:54:55.041004 13230 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_4c73315dcf504065a66df131136ca17a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250830 07:54:55.041117 13422 leader_election.cc:304] T ddedd1f141c147c69f178c6cd2b287da P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba; no voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:54:55.041787 13225 catalog_manager.cc:5864] Not sending DeleteTablet requests; no consensus state for tablet e4228dfefd794934b6f8519a5fc3ccdb
I20250830 07:54:55.041838 15115 raft_consensus.cc:2747] T ddedd1f141c147c69f178c6cd2b287da P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:54:55.042016 13225 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_67195b41a04042728399c4da5f841c6d" } new_table_name: "default.Table_bfb98760587b49119dcb5ed421754dba" modify_external_catalogs: true
I20250830 07:54:55.043632 15580 raft_consensus.cc:491] T 519b3e58b63b402d84e234f5e180b98c P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:55.043740 15580 raft_consensus.cc:513] T 519b3e58b63b402d84e234f5e180b98c P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:55.044332 15580 leader_election.cc:290] T 519b3e58b63b402d84e234f5e180b98c P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:55.044786 13477 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "519b3e58b63b402d84e234f5e180b98c" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
W20250830 07:54:55.045156 13230 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4c73315dcf504065a66df131136ca17a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:55.045776 15601 raft_consensus.cc:2802] T 713c12e1efec4e6f9895c65dc8a9c4b9 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election won for term 1
I20250830 07:54:55.045742 13771 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "519b3e58b63b402d84e234f5e180b98c" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:55.045895 15601 raft_consensus.cc:695] T 713c12e1efec4e6f9895c65dc8a9c4b9 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 LEADER]: Becoming Leader. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Running, Role: LEADER
I20250830 07:54:55.046130 15601 consensus_queue.cc:237] T 713c12e1efec4e6f9895c65dc8a9c4b9 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:55.046335 13562 leader_election.cc:304] T 519b3e58b63b402d84e234f5e180b98c P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b5e454d98894637b466ea27f1b647f9; no voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:54:55.046638 15580 raft_consensus.cc:2747] T 519b3e58b63b402d84e234f5e180b98c P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20250830 07:54:55.047757 13228 catalog_manager.cc:5415] Ignoring report from unknown tablet a8660a6ff9254d4f9f0ef047b8682ed1
W20250830 07:54:55.047852 13228 catalog_manager.cc:5415] Ignoring report from unknown tablet 4b403cadfb7b42f8896b2ee16b50ecb1
W20250830 07:54:55.047958 13228 catalog_manager.cc:5415] Ignoring report from unknown tablet 5235e1a32f044f0cbf882e338c482003
W20250830 07:54:55.048022 13228 catalog_manager.cc:5415] Ignoring report from unknown tablet a8baad9c419e436b9659d8d5582d4066
W20250830 07:54:55.048061 13228 catalog_manager.cc:5415] Ignoring report from unknown tablet e6b7646588fe4134b2db62ff84ca4791
W20250830 07:54:55.049424 13226 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d2ebc02fa0a943d79900be72a77f947a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:55.055810 13886 tablet_bootstrap.cc:492] T 76ab56c469cf4675a4e21acbe0a8085d P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:54:55.056107 13886 ts_tablet_manager.cc:1397] T 76ab56c469cf4675a4e21acbe0a8085d P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.125s user 0.004s sys 0.000s
W20250830 07:54:55.063661 13701 leader_election.cc:343] T 050e72b96c2d479896b3a54d85e6f6dd P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): Not found: Tablet not found: 050e72b96c2d479896b3a54d85e6f6dd
I20250830 07:54:55.071914 15602 consensus_queue.cc:1035] T 7af74bdde363493f8061eba450ecf4b4 P 2065c332f15a4739899af79f3669c3ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20250830 07:54:55.076279 15602 raft_consensus.cc:491] T 3d9c884ac05e44ddb59f96588fdd6f4b P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:55.076457 15602 raft_consensus.cc:513] T 3d9c884ac05e44ddb59f96588fdd6f4b P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:55.077179 15602 leader_election.cc:290] T 3d9c884ac05e44ddb59f96588fdd6f4b P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:55.077507 13887 tablet_bootstrap.cc:492] T 1db4109dc43b489d89c5de9eeb64a771 P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:54:55.077664 13887 ts_tablet_manager.cc:1397] T 1db4109dc43b489d89c5de9eeb64a771 P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.089s user 0.003s sys 0.001s
I20250830 07:54:55.078203 13227 master_service.cc:948] ReplaceTablet: received request to replace tablet 20a532a8db53426faa7b4231cfb393b8 from {username='slave'} at 127.0.0.1:42126
I20250830 07:54:55.078410 13887 raft_consensus.cc:357] T 1db4109dc43b489d89c5de9eeb64a771 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:55.078557 13887 raft_consensus.cc:383] T 1db4109dc43b489d89c5de9eeb64a771 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:55.078624 13887 raft_consensus.cc:738] T 1db4109dc43b489d89c5de9eeb64a771 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:54:55.078799 13887 consensus_queue.cc:260] T 1db4109dc43b489d89c5de9eeb64a771 P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:55.079337 13887 ts_tablet_manager.cc:1428] T 1db4109dc43b489d89c5de9eeb64a771 P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20250830 07:54:55.079604 13887 tablet_bootstrap.cc:492] T 8c01157324ba45bda5b3a9a328bf319b P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:54:55.080062 13882 tablet_bootstrap.cc:654] T 3c3c798b2b7b460b98a30605464763e6 P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:55.081766 13887 tablet_bootstrap.cc:654] T 8c01157324ba45bda5b3a9a328bf319b P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:55.083251 13629 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "3d9c884ac05e44ddb59f96588fdd6f4b" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
W20250830 07:54:55.084635 13423 leader_election.cc:343] T 3d9c884ac05e44ddb59f96588fdd6f4b P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:55.074800 13701 leader_election.cc:304] T 050e72b96c2d479896b3a54d85e6f6dd P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 2065c332f15a4739899af79f3669c3ba, 6b5e454d98894637b466ea27f1b647f9
W20250830 07:54:55.065301 13703 consensus_peers.cc:489] T f398e12cd9f543738d5163354f8a9d9d P 9b057ade5dce45af9f8bf0bedf8b917f -> Peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Couldn't send request to peer 6b5e454d98894637b466ea27f1b647f9. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f398e12cd9f543738d5163354f8a9d9d. This is attempt 11: this message will repeat every 5th retry.
I20250830 07:54:55.063593 13886 raft_consensus.cc:357] T 76ab56c469cf4675a4e21acbe0a8085d P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:55.089941 13886 raft_consensus.cc:383] T 76ab56c469cf4675a4e21acbe0a8085d P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:55.090147 13886 raft_consensus.cc:738] T 76ab56c469cf4675a4e21acbe0a8085d P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:54:55.090335 13886 consensus_queue.cc:260] T 76ab56c469cf4675a4e21acbe0a8085d P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:55.090783 13886 ts_tablet_manager.cc:1428] T 76ab56c469cf4675a4e21acbe0a8085d P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.034s user 0.002s sys 0.000s
I20250830 07:54:55.091496 13886 tablet_bootstrap.cc:492] T 1520d7257f864ea4ba4b9a5d0443f8a7 P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:54:55.093448 15601 raft_consensus.cc:2747] T 050e72b96c2d479896b3a54d85e6f6dd P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:54:55.093901 13701 leader_election.cc:304] T a7dc529c40544bafbc9e7f0ab34086bd P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:54:55.094192 15608 raft_consensus.cc:2802] T a7dc529c40544bafbc9e7f0ab34086bd P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:54:55.094261 15608 raft_consensus.cc:491] T a7dc529c40544bafbc9e7f0ab34086bd P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:54:55.094322 15608 raft_consensus.cc:3058] T a7dc529c40544bafbc9e7f0ab34086bd P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:55.094540 13701 leader_election.cc:304] T 10ec97b8a82145479e0bb526c4cc7c05 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:54:55.095155 15500 raft_consensus.cc:2802] T 10ec97b8a82145479e0bb526c4cc7c05 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election won for term 1
I20250830 07:54:55.095260 15500 raft_consensus.cc:695] T 10ec97b8a82145479e0bb526c4cc7c05 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 LEADER]: Becoming Leader. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Running, Role: LEADER
I20250830 07:54:55.095438 15500 consensus_queue.cc:237] T 10ec97b8a82145479e0bb526c4cc7c05 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:55.096134 15603 consensus_queue.cc:1035] T 3bb48fce24074a8e8ec99d3172a655d8 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:54:55.096509 13886 tablet_bootstrap.cc:654] T 1520d7257f864ea4ba4b9a5d0443f8a7 P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:55.096936 15608 raft_consensus.cc:513] T a7dc529c40544bafbc9e7f0ab34086bd P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:55.098129 13882 tablet_bootstrap.cc:492] T 3c3c798b2b7b460b98a30605464763e6 P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:54:55.098604 15608 leader_election.cc:290] T a7dc529c40544bafbc9e7f0ab34086bd P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Requested vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
I20250830 07:54:55.098549 13882 ts_tablet_manager.cc:1397] T 3c3c798b2b7b460b98a30605464763e6 P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.083s user 0.005s sys 0.001s
I20250830 07:54:55.099934 13882 raft_consensus.cc:357] T 3c3c798b2b7b460b98a30605464763e6 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:55.100226 13882 raft_consensus.cc:383] T 3c3c798b2b7b460b98a30605464763e6 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:55.100333 13882 raft_consensus.cc:738] T 3c3c798b2b7b460b98a30605464763e6 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:54:55.100646 13882 consensus_queue.cc:260] T 3c3c798b2b7b460b98a30605464763e6 P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:55.101202 13882 ts_tablet_manager.cc:1428] T 3c3c798b2b7b460b98a30605464763e6 P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20250830 07:54:55.101491 13882 tablet_bootstrap.cc:492] T 9ffa3c1d128c49c8b8e2566c6a64304a P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:54:55.101644 13619 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "a7dc529c40544bafbc9e7f0ab34086bd" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9"
W20250830 07:54:55.102032 13703 leader_election.cc:343] T a7dc529c40544bafbc9e7f0ab34086bd P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:55.102749 13882 tablet_bootstrap.cc:654] T 9ffa3c1d128c49c8b8e2566c6a64304a P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:55.103943 13886 tablet_bootstrap.cc:492] T 1520d7257f864ea4ba4b9a5d0443f8a7 P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:54:55.104097 13886 ts_tablet_manager.cc:1397] T 1520d7257f864ea4ba4b9a5d0443f8a7 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.013s user 0.004s sys 0.000s
I20250830 07:54:55.104804 13886 raft_consensus.cc:357] T 1520d7257f864ea4ba4b9a5d0443f8a7 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:55.104924 13886 raft_consensus.cc:383] T 1520d7257f864ea4ba4b9a5d0443f8a7 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:55.104966 13886 raft_consensus.cc:738] T 1520d7257f864ea4ba4b9a5d0443f8a7 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:54:55.105140 13886 consensus_queue.cc:260] T 1520d7257f864ea4ba4b9a5d0443f8a7 P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:55.105562 13886 ts_tablet_manager.cc:1428] T 1520d7257f864ea4ba4b9a5d0443f8a7 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250830 07:54:55.105788 13886 tablet_bootstrap.cc:492] T 62bc8168176e4678a77827c5b7cc0f3e P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:54:55.107192 13886 tablet_bootstrap.cc:654] T 62bc8168176e4678a77827c5b7cc0f3e P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:55.112442 13882 tablet_bootstrap.cc:492] T 9ffa3c1d128c49c8b8e2566c6a64304a P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:54:55.112608 13882 ts_tablet_manager.cc:1397] T 9ffa3c1d128c49c8b8e2566c6a64304a P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.011s user 0.002s sys 0.002s
I20250830 07:54:55.113354 13882 raft_consensus.cc:357] T 9ffa3c1d128c49c8b8e2566c6a64304a P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:55.113544 13882 raft_consensus.cc:383] T 9ffa3c1d128c49c8b8e2566c6a64304a P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:55.113624 13882 raft_consensus.cc:738] T 9ffa3c1d128c49c8b8e2566c6a64304a P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:54:55.113847 13882 consensus_queue.cc:260] T 9ffa3c1d128c49c8b8e2566c6a64304a P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:55.114451 13882 ts_tablet_manager.cc:1428] T 9ffa3c1d128c49c8b8e2566c6a64304a P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20250830 07:54:55.114748 13882 tablet_bootstrap.cc:492] T 70703eb1d47841a1a227e277ed6a268d P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:54:55.116957 13882 tablet_bootstrap.cc:654] T 70703eb1d47841a1a227e277ed6a268d P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
W20250830 07:54:55.119473 13234 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 312229620e7243539fcc77dff30bdba2 has no consensus state
I20250830 07:54:55.119623 13701 leader_election.cc:304] T 23d2c7013c9c4b4aacf47e6ac7ab5a0b P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:54:55.119837 15603 raft_consensus.cc:2802] T 23d2c7013c9c4b4aacf47e6ac7ab5a0b P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:54:55.119900 15603 raft_consensus.cc:491] T 23d2c7013c9c4b4aacf47e6ac7ab5a0b P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:54:55.119953 15603 raft_consensus.cc:3058] T 23d2c7013c9c4b4aacf47e6ac7ab5a0b P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:55.119824 13234 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_91331ba452404d0f896d7397534d9e65"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:55.120366 13234 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_91331ba452404d0f896d7397534d9e65 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:55.121688 13231 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_01801c98d3db46649e336d635ee7ebb4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:55.122087 13231 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_01801c98d3db46649e336d635ee7ebb4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:55.122371 15603 raft_consensus.cc:513] T 23d2c7013c9c4b4aacf47e6ac7ab5a0b P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:55.122880 15603 leader_election.cc:290] T 23d2c7013c9c4b4aacf47e6ac7ab5a0b P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Requested vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967)
I20250830 07:54:55.123240 13619 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "23d2c7013c9c4b4aacf47e6ac7ab5a0b" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9"
W20250830 07:54:55.123420 13225 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d94215b0b1f142178f0b791518d1baf2 consensus state has no leader
W20250830 07:54:55.123565 13703 leader_election.cc:343] T 23d2c7013c9c4b4aacf47e6ac7ab5a0b P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:55.126506 13882 tablet_bootstrap.cc:492] T 70703eb1d47841a1a227e277ed6a268d P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:54:55.126598 13882 ts_tablet_manager.cc:1397] T 70703eb1d47841a1a227e277ed6a268d P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.012s user 0.004s sys 0.001s
W20250830 07:54:55.126822 13229 catalog_manager.cc:5415] Ignoring report from unknown tablet 7c5e50cb605c4a40b47984f328eedd93
I20250830 07:54:55.127137 13882 raft_consensus.cc:357] T 70703eb1d47841a1a227e277ed6a268d P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:55.127279 13882 raft_consensus.cc:383] T 70703eb1d47841a1a227e277ed6a268d P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:55.127326 13882 raft_consensus.cc:738] T 70703eb1d47841a1a227e277ed6a268d P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:54:55.127485 13882 consensus_queue.cc:260] T 70703eb1d47841a1a227e277ed6a268d P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:55.129527 13228 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_a71580c6a95d42d88c3b398b15b8198d" } new_table_name: "default.Table_30040170a6764fa3bd3c662703ea909f" modify_external_catalogs: true
I20250830 07:54:55.130611 13882 ts_tablet_manager.cc:1428] T 70703eb1d47841a1a227e277ed6a268d P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20250830 07:54:55.130846 13882 tablet_bootstrap.cc:492] T d1153d8cd2994377ac0dcbfeeda1fd52 P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:54:55.131955 13882 tablet_bootstrap.cc:654] T d1153d8cd2994377ac0dcbfeeda1fd52 P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:55.132323 15115 raft_consensus.cc:491] T c56e3a30c18640e68c8b0c4ff4251d96 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:55.132373 13225 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_d8fc3dffa80d4ed9b4222d7d6445bd9f" } new_table_name: "default.Table_37ef227a5b7f40adb4d95830ed70af2b" modify_external_catalogs: true
I20250830 07:54:55.132552 15115 raft_consensus.cc:513] T c56e3a30c18640e68c8b0c4ff4251d96 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:55.133345 15115 leader_election.cc:290] T c56e3a30c18640e68c8b0c4ff4251d96 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:55.133855 13233 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_785308242878486abce6c25807f7cfa8" } modify_external_catalogs: true
I20250830 07:54:55.133994 13233 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_785308242878486abce6c25807f7cfa8" } modify_external_catalogs: true
I20250830 07:54:55.133373 13619 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "c56e3a30c18640e68c8b0c4ff4251d96" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
W20250830 07:54:55.134764 13423 leader_election.cc:343] T c56e3a30c18640e68c8b0c4ff4251d96 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:55.136443 13229 catalog_manager.cc:5674] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325) does not have the latest schema for tablet 924403105a6a40f28aad60647a2a8987 (table default.Table_f62c15a884574e3ebe9ce39aa18d1e00 [id=46ec9117fe9146cb807dd092284616fc]). Expected version 2 got 0
I20250830 07:54:55.143761 13227 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet 20a532a8db53426faa7b4231cfb393b8
I20250830 07:54:55.144192 13227 catalog_manager.cc:6652] ReplaceTablet: tablet 20a532a8db53426faa7b4231cfb393b8 deleted and replaced by tablet eb910d4e1fe5472fa766160d8d308b94
I20250830 07:54:55.144670 13602 tablet_service.cc:1515] Processing DeleteTablet for tablet 20a532a8db53426faa7b4231cfb393b8 with delete_type TABLET_DATA_DELETED (replaced by tablet eb910d4e1fe5472fa766160d8d308b94) from {username='slave'} at 127.0.0.1:45306
W20250830 07:54:55.145284 13220 catalog_manager.cc:4908] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet 20a532a8db53426faa7b4231cfb393b8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 20a532a8db53426faa7b4231cfb393b8 already in progress: creating tablet
I20250830 07:54:55.146085 13882 tablet_bootstrap.cc:492] T d1153d8cd2994377ac0dcbfeeda1fd52 P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:54:55.146399 13882 ts_tablet_manager.cc:1397] T d1153d8cd2994377ac0dcbfeeda1fd52 P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.016s user 0.006s sys 0.000s
I20250830 07:54:55.148351 13882 raft_consensus.cc:357] T d1153d8cd2994377ac0dcbfeeda1fd52 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:55.148646 13882 raft_consensus.cc:383] T d1153d8cd2994377ac0dcbfeeda1fd52 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:55.148739 13882 raft_consensus.cc:738] T d1153d8cd2994377ac0dcbfeeda1fd52 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:54:55.148747 13226 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_72fd60e35a35441a92bd2cffb809c0db" } new_table_name: "default.Table_2f6c360f9bbc48e880665078710bf673" modify_external_catalogs: true
I20250830 07:54:55.148991 13882 consensus_queue.cc:260] T d1153d8cd2994377ac0dcbfeeda1fd52 P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:55.149478 13882 ts_tablet_manager.cc:1428] T d1153d8cd2994377ac0dcbfeeda1fd52 P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20250830 07:54:55.149691 13882 tablet_bootstrap.cc:492] T 95b6f084eb5240ea94c125eaa154ac9f P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:54:55.150038 13230 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_36f755e85752462e9779bb889bcabce7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:55.150482 13230 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_36f755e85752462e9779bb889bcabce7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250830 07:54:55.151190 13227 catalog_manager.cc:5415] Ignoring report from unknown tablet ef16b9e2d444489699f4db1ac26d5f6c
W20250830 07:54:55.151364 13227 catalog_manager.cc:5415] Ignoring report from unknown tablet 5235e1a32f044f0cbf882e338c482003
W20250830 07:54:55.151474 13227 catalog_manager.cc:5415] Ignoring report from unknown tablet e6060a3dc6444483b8fb2944b8090cb6
I20250830 07:54:55.151567 13886 tablet_bootstrap.cc:492] T 62bc8168176e4678a77827c5b7cc0f3e P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:54:55.151714 13886 ts_tablet_manager.cc:1397] T 62bc8168176e4678a77827c5b7cc0f3e P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.046s user 0.014s sys 0.000s
I20250830 07:54:55.152491 13227 catalog_manager.cc:5674] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325) does not have the latest schema for tablet ed364f03bdad42b88e181b7d0e1e4011 (table default.Table_d72c9e458203404188b2329054b05d20 [id=41f959f5cad14060ae3f4bf1b0151b9f]). Expected version 1 got 0
I20250830 07:54:55.152493 13886 raft_consensus.cc:357] T 62bc8168176e4678a77827c5b7cc0f3e P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:55.152659 13886 raft_consensus.cc:383] T 62bc8168176e4678a77827c5b7cc0f3e P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:55.152729 13886 raft_consensus.cc:738] T 62bc8168176e4678a77827c5b7cc0f3e P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:54:55.153023 13886 consensus_queue.cc:260] T 62bc8168176e4678a77827c5b7cc0f3e P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:55.153525 13886 ts_tablet_manager.cc:1428] T 62bc8168176e4678a77827c5b7cc0f3e P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20250830 07:54:55.153793 13886 tablet_bootstrap.cc:492] T ee44ab24333742909f773889ad5c3e00 P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:54:55.155409 13886 tablet_bootstrap.cc:654] T ee44ab24333742909f773889ad5c3e00 P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:55.155613 15115 raft_consensus.cc:491] T d171ad1667fa44c993ec5fd7d701d8e0 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:55.155787 15115 raft_consensus.cc:513] T d171ad1667fa44c993ec5fd7d701d8e0 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:55.156543 15115 leader_election.cc:290] T d171ad1667fa44c993ec5fd7d701d8e0 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:55.156755 13227 master_service.cc:948] ReplaceTablet: received request to replace tablet b83dfc54383d4e7b96523568aea5c9f3 from {username='slave'} at 127.0.0.1:42126
I20250830 07:54:55.156802 13619 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "d171ad1667fa44c993ec5fd7d701d8e0" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
W20250830 07:54:55.157254 13423 leader_election.cc:343] T d171ad1667fa44c993ec5fd7d701d8e0 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:55.157678 13882 tablet_bootstrap.cc:654] T 95b6f084eb5240ea94c125eaa154ac9f P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:55.159286 13701 leader_election.cc:304] T ec47a59c22ff4370bd21bc2a18336049 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:54:55.159571 15603 raft_consensus.cc:2802] T ec47a59c22ff4370bd21bc2a18336049 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election won for term 1
I20250830 07:54:55.159730 15603 raft_consensus.cc:695] T ec47a59c22ff4370bd21bc2a18336049 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 LEADER]: Becoming Leader. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Running, Role: LEADER
I20250830 07:54:55.160529 15603 consensus_queue.cc:237] T ec47a59c22ff4370bd21bc2a18336049 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:55.168258 13701 leader_election.cc:304] T 0208de98277c4d6889fb0289b6013ae1 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:54:55.168556 15603 raft_consensus.cc:2802] T 0208de98277c4d6889fb0289b6013ae1 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:54:55.168668 15603 raft_consensus.cc:491] T 0208de98277c4d6889fb0289b6013ae1 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:54:55.168790 15603 raft_consensus.cc:3058] T 0208de98277c4d6889fb0289b6013ae1 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
W20250830 07:54:55.176143 13234 catalog_manager.cc:5415] Ignoring report from unknown tablet 8ae468b43b4c450ca7591b543c2539d9
I20250830 07:54:55.176826 13234 catalog_manager.cc:5582] T 91705fc35a1b4977b89bac1765c886c0 P 9b057ade5dce45af9f8bf0bedf8b917f reported cstate change: term changed from 0 to 1, leader changed from <none> to 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3). New cstate: current_term: 1 leader_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } health_report { overall_health: HEALTHY } } }
I20250830 07:54:55.177277 13234 catalog_manager.cc:5674] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743) does not have the latest schema for tablet 91705fc35a1b4977b89bac1765c886c0 (table default.Table_4f53e333521540848fc99c0bf37c1639 [id=48089766c3514336991a5ada71b03dd0]). Expected version 1 got 0
I20250830 07:54:55.178359 15603 raft_consensus.cc:513] T 0208de98277c4d6889fb0289b6013ae1 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:55.179236 13619 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "0208de98277c4d6889fb0289b6013ae1" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9"
I20250830 07:54:55.179307 15603 leader_election.cc:290] T 0208de98277c4d6889fb0289b6013ae1 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Requested vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
W20250830 07:54:55.179368 13228 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 9892c2dced9e42dfa5ef5e61409af0c1 has no consensus state
W20250830 07:54:55.179648 13703 leader_election.cc:343] T 0208de98277c4d6889fb0289b6013ae1 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
W20250830 07:54:55.188385 13225 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 135d754d83ad422eb05909d2daa19d34 consensus state has no leader
I20250830 07:54:55.196105 13882 tablet_bootstrap.cc:492] T 95b6f084eb5240ea94c125eaa154ac9f P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:54:55.196218 13882 ts_tablet_manager.cc:1397] T 95b6f084eb5240ea94c125eaa154ac9f P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.047s user 0.006s sys 0.000s
I20250830 07:54:55.196828 13882 raft_consensus.cc:357] T 95b6f084eb5240ea94c125eaa154ac9f P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:55.196954 13882 raft_consensus.cc:383] T 95b6f084eb5240ea94c125eaa154ac9f P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:55.197001 13882 raft_consensus.cc:738] T 95b6f084eb5240ea94c125eaa154ac9f P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:54:55.196977 13228 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_f6bd1f04d55045ef97fc62076520c6a6" } modify_external_catalogs: true
I20250830 07:54:55.197114 13228 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_f6bd1f04d55045ef97fc62076520c6a6" } modify_external_catalogs: true
I20250830 07:54:55.197353 13882 consensus_queue.cc:260] T 95b6f084eb5240ea94c125eaa154ac9f P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:55.198108 13886 tablet_bootstrap.cc:492] T ee44ab24333742909f773889ad5c3e00 P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:54:55.198309 13886 ts_tablet_manager.cc:1397] T ee44ab24333742909f773889ad5c3e00 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.045s user 0.005s sys 0.002s
I20250830 07:54:55.198889 13886 raft_consensus.cc:357] T ee44ab24333742909f773889ad5c3e00 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:55.199095 13886 raft_consensus.cc:383] T ee44ab24333742909f773889ad5c3e00 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:55.199143 13886 raft_consensus.cc:738] T ee44ab24333742909f773889ad5c3e00 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:54:55.199671 13233 catalog_manager.cc:5864] Not sending DeleteTablet requests; no consensus state for tablet 7b70c9e8d8b74f8385c23910d43e9023
W20250830 07:54:55.199975 13225 catalog_manager.cc:5415] Ignoring report from unknown tablet b4ab964a64a64e00a78ffd2b220aef46
I20250830 07:54:55.200810 13886 consensus_queue.cc:260] T ee44ab24333742909f773889ad5c3e00 P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:55.201318 13886 ts_tablet_manager.cc:1428] T ee44ab24333742909f773889ad5c3e00 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.003s user 0.000s sys 0.001s
I20250830 07:54:55.201586 13886 tablet_bootstrap.cc:492] T c8bc6e07377a4ba99c39a909dae11402 P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:54:55.203104 13886 tablet_bootstrap.cc:654] T c8bc6e07377a4ba99c39a909dae11402 P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:55.205379 13882 ts_tablet_manager.cc:1428] T 95b6f084eb5240ea94c125eaa154ac9f P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.009s user 0.002s sys 0.000s
I20250830 07:54:55.205614 13882 tablet_bootstrap.cc:492] T ca959e42c8764eeba0faee96caf8b39f P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:54:55.206130 13701 leader_election.cc:304] T db4077bf8e184ac5809ef629222f2cc5 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:54:55.206442 15481 raft_consensus.cc:2802] T db4077bf8e184ac5809ef629222f2cc5 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election won for term 1
I20250830 07:54:55.206532 13701 leader_election.cc:304] T 88bbd6b4c795433d9b6ad746353f3aa1 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:54:55.206673 15481 raft_consensus.cc:695] T db4077bf8e184ac5809ef629222f2cc5 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 LEADER]: Becoming Leader. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Running, Role: LEADER
I20250830 07:54:55.206823 15601 raft_consensus.cc:2802] T 88bbd6b4c795433d9b6ad746353f3aa1 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election won for term 1
I20250830 07:54:55.206971 15601 raft_consensus.cc:695] T 88bbd6b4c795433d9b6ad746353f3aa1 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 LEADER]: Becoming Leader. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Running, Role: LEADER
I20250830 07:54:55.207141 15601 consensus_queue.cc:237] T 88bbd6b4c795433d9b6ad746353f3aa1 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:55.207171 15481 consensus_queue.cc:237] T db4077bf8e184ac5809ef629222f2cc5 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:55.207532 13882 tablet_bootstrap.cc:654] T ca959e42c8764eeba0faee96caf8b39f P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:55.210393 14748 raft_consensus.cc:491] T d1153d8cd2994377ac0dcbfeeda1fd52 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:55.210515 14748 raft_consensus.cc:513] T d1153d8cd2994377ac0dcbfeeda1fd52 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:55.211089 14748 leader_election.cc:290] T d1153d8cd2994377ac0dcbfeeda1fd52 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:55.211671 13477 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "d1153d8cd2994377ac0dcbfeeda1fd52" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:54:55.211933 13477 raft_consensus.cc:2391] T d1153d8cd2994377ac0dcbfeeda1fd52 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b5e454d98894637b466ea27f1b647f9 in current term 1: Already voted for candidate 2065c332f15a4739899af79f3669c3ba in this term.
I20250830 07:54:55.212126 13775 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "d1153d8cd2994377ac0dcbfeeda1fd52" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:55.212294 13775 raft_consensus.cc:2391] T d1153d8cd2994377ac0dcbfeeda1fd52 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b5e454d98894637b466ea27f1b647f9 in current term 1: Already voted for candidate 9b057ade5dce45af9f8bf0bedf8b917f in this term.
I20250830 07:54:55.212769 13562 leader_election.cc:304] T d1153d8cd2994377ac0dcbfeeda1fd52 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b5e454d98894637b466ea27f1b647f9; no voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:54:55.213315 14748 raft_consensus.cc:3058] T d1153d8cd2994377ac0dcbfeeda1fd52 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:55.215606 14748 raft_consensus.cc:2747] T d1153d8cd2994377ac0dcbfeeda1fd52 P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20250830 07:54:55.221454 13701 leader_election.cc:343] T 50360492db824755a6de251436cab5c6 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): Not found: Tablet not found: 50360492db824755a6de251436cab5c6
I20250830 07:54:55.222038 13225 master_service.cc:948] ReplaceTablet: received request to replace tablet becf9667a0fc4507bc114407090c055c from {username='slave'} at 127.0.0.1:42126
I20250830 07:54:55.229475 13886 tablet_bootstrap.cc:492] T c8bc6e07377a4ba99c39a909dae11402 P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:54:55.229579 13886 ts_tablet_manager.cc:1397] T c8bc6e07377a4ba99c39a909dae11402 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.028s user 0.000s sys 0.005s
I20250830 07:54:55.229617 13887 tablet_bootstrap.cc:492] T 8c01157324ba45bda5b3a9a328bf319b P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:54:55.229847 13887 ts_tablet_manager.cc:1397] T 8c01157324ba45bda5b3a9a328bf319b P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.150s user 0.001s sys 0.003s
I20250830 07:54:55.230160 13886 raft_consensus.cc:357] T c8bc6e07377a4ba99c39a909dae11402 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:55.230305 13886 raft_consensus.cc:383] T c8bc6e07377a4ba99c39a909dae11402 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:55.230360 13886 raft_consensus.cc:738] T c8bc6e07377a4ba99c39a909dae11402 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:54:55.230544 13886 consensus_queue.cc:260] T c8bc6e07377a4ba99c39a909dae11402 P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:55.230966 13886 ts_tablet_manager.cc:1428] T c8bc6e07377a4ba99c39a909dae11402 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20250830 07:54:55.231118 13701 leader_election.cc:304] T 50360492db824755a6de251436cab5c6 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 2065c332f15a4739899af79f3669c3ba, 6b5e454d98894637b466ea27f1b647f9
I20250830 07:54:55.231719 15608 raft_consensus.cc:2747] T 50360492db824755a6de251436cab5c6 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:54:55.231185 13886 tablet_bootstrap.cc:492] T 852e353f6ee945628ddebdbdd1bd76fb P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:54:55.234732 15608 consensus_queue.cc:1035] T ef1ab62a5b7845e58d50f34206eaaa27 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:54:55.236415 13886 tablet_bootstrap.cc:654] T 852e353f6ee945628ddebdbdd1bd76fb P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:55.238253 13701 leader_election.cc:304] T f66e1d07039841088a444ee0203a4eb0 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:54:55.239374 15601 raft_consensus.cc:2802] T f66e1d07039841088a444ee0203a4eb0 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:54:55.239692 15601 raft_consensus.cc:491] T f66e1d07039841088a444ee0203a4eb0 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:54:55.239825 15601 raft_consensus.cc:3058] T f66e1d07039841088a444ee0203a4eb0 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:55.241742 13701 leader_election.cc:304] T 689b4fee1dd04b3d9ccdea334b0f6b59 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:54:55.245024 13882 tablet_bootstrap.cc:492] T ca959e42c8764eeba0faee96caf8b39f P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:54:55.245154 13882 ts_tablet_manager.cc:1397] T ca959e42c8764eeba0faee96caf8b39f P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.040s user 0.001s sys 0.006s
I20250830 07:54:55.245759 13882 raft_consensus.cc:357] T ca959e42c8764eeba0faee96caf8b39f P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:55.245901 13882 raft_consensus.cc:383] T ca959e42c8764eeba0faee96caf8b39f P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:55.245949 13882 raft_consensus.cc:738] T ca959e42c8764eeba0faee96caf8b39f P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:54:55.246120 13882 consensus_queue.cc:260] T ca959e42c8764eeba0faee96caf8b39f P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:55.246727 13882 ts_tablet_manager.cc:1428] T ca959e42c8764eeba0faee96caf8b39f P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20250830 07:54:55.246968 13882 tablet_bootstrap.cc:492] T ec47a59c22ff4370bd21bc2a18336049 P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:54:55.248145 15115 raft_consensus.cc:491] T 509e08290f3842cfbde8b74ff9f4f70f P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:55.248522 15608 raft_consensus.cc:2802] T 689b4fee1dd04b3d9ccdea334b0f6b59 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:54:55.248605 15608 raft_consensus.cc:491] T 689b4fee1dd04b3d9ccdea334b0f6b59 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:54:55.248661 15608 raft_consensus.cc:3058] T 689b4fee1dd04b3d9ccdea334b0f6b59 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:55.248800 13882 tablet_bootstrap.cc:654] T ec47a59c22ff4370bd21bc2a18336049 P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:55.249872 13886 tablet_bootstrap.cc:492] T 852e353f6ee945628ddebdbdd1bd76fb P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:54:55.250000 13886 ts_tablet_manager.cc:1397] T 852e353f6ee945628ddebdbdd1bd76fb P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.019s user 0.002s sys 0.002s
I20250830 07:54:55.250728 13886 raft_consensus.cc:357] T 852e353f6ee945628ddebdbdd1bd76fb P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:55.250874 13886 raft_consensus.cc:383] T 852e353f6ee945628ddebdbdd1bd76fb P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:55.251039 13886 raft_consensus.cc:738] T 852e353f6ee945628ddebdbdd1bd76fb P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:54:55.251245 13886 consensus_queue.cc:260] T 852e353f6ee945628ddebdbdd1bd76fb P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:55.251724 13886 ts_tablet_manager.cc:1428] T 852e353f6ee945628ddebdbdd1bd76fb P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20250830 07:54:55.251969 13886 tablet_bootstrap.cc:492] T 796e01f6a36241fc94e335253929d6ab P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:54:55.251935 15608 raft_consensus.cc:513] T 689b4fee1dd04b3d9ccdea334b0f6b59 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:55.252712 13619 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "689b4fee1dd04b3d9ccdea334b0f6b59" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9"
W20250830 07:54:55.253176 13703 leader_election.cc:343] T 689b4fee1dd04b3d9ccdea334b0f6b59 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:55.253430 15608 leader_election.cc:290] T 689b4fee1dd04b3d9ccdea334b0f6b59 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Requested vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
I20250830 07:54:55.253531 13233 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_9af3c1635b114fb6aa1532fa16998dd2" } modify_external_catalogs: true
I20250830 07:54:55.253731 13233 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_9af3c1635b114fb6aa1532fa16998dd2" } modify_external_catalogs: true
I20250830 07:54:55.242573 15601 raft_consensus.cc:513] T f66e1d07039841088a444ee0203a4eb0 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:55.255614 13619 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f66e1d07039841088a444ee0203a4eb0" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9"
W20250830 07:54:55.256013 13703 leader_election.cc:343] T f66e1d07039841088a444ee0203a4eb0 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:55.244088 13820 heartbeater.cc:344] Connected to a master server at 127.12.209.60:43889
I20250830 07:54:55.257978 15601 leader_election.cc:290] T f66e1d07039841088a444ee0203a4eb0 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Requested vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
I20250830 07:54:55.258533 15602 raft_consensus.cc:491] T 66432e73deea433d9df565d5fcace647 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:55.258637 15602 raft_consensus.cc:513] T 66432e73deea433d9df565d5fcace647 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:55.260389 13619 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "66432e73deea433d9df565d5fcace647" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
W20250830 07:54:55.261572 13423 leader_election.cc:343] T 66432e73deea433d9df565d5fcace647 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:55.261490 13231 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_710c97896bc64964a89122c5a5bab1ca"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250830 07:54:55.261657 13886 tablet_bootstrap.cc:654] T 796e01f6a36241fc94e335253929d6ab P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:55.261503 13227 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_e10bbdd0f2a94d74846b5c08c9971735"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:55.261993 13231 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_710c97896bc64964a89122c5a5bab1ca in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250830 07:54:55.262354 13227 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e10bbdd0f2a94d74846b5c08c9971735 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:55.263089 13229 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_bfb98760587b49119dcb5ed421754dba" } modify_external_catalogs: true
I20250830 07:54:55.263221 13229 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_bfb98760587b49119dcb5ed421754dba" } modify_external_catalogs: true
W20250830 07:54:55.263294 13422 leader_election.cc:343] T 846338e46b834ae0b5f4e74c7f1325d2 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:55.263411 13422 leader_election.cc:304] T 846338e46b834ae0b5f4e74c7f1325d2 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba; no voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:54:55.263626 15470 raft_consensus.cc:2747] T 846338e46b834ae0b5f4e74c7f1325d2 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:54:55.264281 13232 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_db9c792360074c4fada04b5bfd7ee523" } modify_external_catalogs: true
I20250830 07:54:55.264430 13232 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_db9c792360074c4fada04b5bfd7ee523" } modify_external_catalogs: true
I20250830 07:54:55.265156 13477 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "97d49a1f600f4c13a4aafca99cedabe8" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:54:55.265336 13477 raft_consensus.cc:2466] T 97d49a1f600f4c13a4aafca99cedabe8 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 0.
I20250830 07:54:55.266507 13882 tablet_bootstrap.cc:492] T ec47a59c22ff4370bd21bc2a18336049 P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:54:55.266649 13882 ts_tablet_manager.cc:1397] T ec47a59c22ff4370bd21bc2a18336049 P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.020s user 0.002s sys 0.002s
I20250830 07:54:55.267382 13882 raft_consensus.cc:357] T ec47a59c22ff4370bd21bc2a18336049 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:55.267877 13882 raft_consensus.cc:383] T ec47a59c22ff4370bd21bc2a18336049 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:55.267930 13882 raft_consensus.cc:738] T ec47a59c22ff4370bd21bc2a18336049 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:54:55.268097 13882 consensus_queue.cc:260] T ec47a59c22ff4370bd21bc2a18336049 P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:55.268548 13882 ts_tablet_manager.cc:1428] T ec47a59c22ff4370bd21bc2a18336049 P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20250830 07:54:55.268755 13882 tablet_bootstrap.cc:492] T 5235e1a32f044f0cbf882e338c482003 P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
W20250830 07:54:55.269452 13226 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f5baa35307a1425c8d52666d130d6d8a consensus state has no leader
I20250830 07:54:55.269500 13225 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet becf9667a0fc4507bc114407090c055c
I20250830 07:54:55.270037 13228 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet 240a6bfad8fa478598a67a27c2dedf62
I20250830 07:54:55.270043 13225 catalog_manager.cc:6652] ReplaceTablet: tablet becf9667a0fc4507bc114407090c055c deleted and replaced by tablet 819888ceeb384766947a2fb60294ecbb
I20250830 07:54:55.258158 15115 raft_consensus.cc:513] T 509e08290f3842cfbde8b74ff9f4f70f P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:55.270601 13882 tablet_bootstrap.cc:654] T 5235e1a32f044f0cbf882e338c482003 P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:55.270890 15602 leader_election.cc:290] T 66432e73deea433d9df565d5fcace647 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:55.271003 13602 tablet_service.cc:1515] Processing DeleteTablet for tablet becf9667a0fc4507bc114407090c055c with delete_type TABLET_DATA_DELETED (replaced by tablet 819888ceeb384766947a2fb60294ecbb) from {username='slave'} at 127.0.0.1:45306
I20250830 07:54:55.271509 15115 leader_election.cc:290] T 509e08290f3842cfbde8b74ff9f4f70f P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:55.271960 13619 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "509e08290f3842cfbde8b74ff9f4f70f" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:55.272342 13602 tablet_service.cc:1515] Processing DeleteTablet for tablet 240a6bfad8fa478598a67a27c2dedf62 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:55 UTC) from {username='slave'} at 127.0.0.1:45306
W20250830 07:54:55.272375 13423 leader_election.cc:343] T 509e08290f3842cfbde8b74ff9f4f70f P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
W20250830 07:54:55.272714 13220 catalog_manager.cc:4908] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet becf9667a0fc4507bc114407090c055c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet becf9667a0fc4507bc114407090c055c already in progress: creating tablet
I20250830 07:54:55.273018 15608 raft_consensus.cc:491] T 62bc8168176e4678a77827c5b7cc0f3e P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:55.273136 15608 raft_consensus.cc:513] T 62bc8168176e4678a77827c5b7cc0f3e P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
W20250830 07:54:55.273236 13220 catalog_manager.cc:4908] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet 240a6bfad8fa478598a67a27c2dedf62 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 240a6bfad8fa478598a67a27c2dedf62 already in progress: creating tablet
I20250830 07:54:55.276266 15608 leader_election.cc:290] T 62bc8168176e4678a77827c5b7cc0f3e P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
I20250830 07:54:55.277057 15582 consensus_queue.cc:1035] T 410b1e2d520c470eb4b9ab60104e0cd4 P 6b5e454d98894637b466ea27f1b647f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:54:55.277948 13228 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_3ea6f4e4e00d4a66b93c2b85da6bddd6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250830 07:54:55.278231 13619 raft_consensus.cc:3058] T 9ffa3c1d128c49c8b8e2566c6a64304a P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Advancing to term 1
W20250830 07:54:55.278381 13228 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3ea6f4e4e00d4a66b93c2b85da6bddd6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:55.279281 13629 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "62bc8168176e4678a77827c5b7cc0f3e" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
W20250830 07:54:55.282574 13703 leader_election.cc:343] T 62bc8168176e4678a77827c5b7cc0f3e P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:55.295408 13487 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "a7dc529c40544bafbc9e7f0ab34086bd" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba"
I20250830 07:54:55.295567 13487 raft_consensus.cc:3058] T a7dc529c40544bafbc9e7f0ab34086bd P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:55.298219 13487 raft_consensus.cc:2466] T a7dc529c40544bafbc9e7f0ab34086bd P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 1.
W20250830 07:54:55.299757 13422 leader_election.cc:343] T 2f3bec2c98574a9393e0fae77e228ce0 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:55.300026 13422 leader_election.cc:304] T 2f3bec2c98574a9393e0fae77e228ce0 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba; no voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:54:55.308694 15115 raft_consensus.cc:2747] T 2f3bec2c98574a9393e0fae77e228ce0 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:54:55.309535 13886 tablet_bootstrap.cc:492] T 796e01f6a36241fc94e335253929d6ab P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:54:55.309684 13886 ts_tablet_manager.cc:1397] T 796e01f6a36241fc94e335253929d6ab P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.058s user 0.006s sys 0.013s
W20250830 07:54:55.309811 13422 leader_election.cc:343] T 5fee48de90014f94b796e726a4d16b85 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:55.309958 13422 leader_election.cc:304] T 5fee48de90014f94b796e726a4d16b85 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba; no voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:54:55.310197 15115 raft_consensus.cc:2747] T 5fee48de90014f94b796e726a4d16b85 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:54:55.310420 13886 raft_consensus.cc:357] T 796e01f6a36241fc94e335253929d6ab P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:55.310616 13886 raft_consensus.cc:383] T 796e01f6a36241fc94e335253929d6ab P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:55.310694 13886 raft_consensus.cc:738] T 796e01f6a36241fc94e335253929d6ab P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:54:55.312028 13887 raft_consensus.cc:357] T 8c01157324ba45bda5b3a9a328bf319b P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:55.312259 13887 raft_consensus.cc:383] T 8c01157324ba45bda5b3a9a328bf319b P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:55.312388 13887 raft_consensus.cc:738] T 8c01157324ba45bda5b3a9a328bf319b P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:54:55.312629 13887 consensus_queue.cc:260] T 8c01157324ba45bda5b3a9a328bf319b P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:55.313230 13887 ts_tablet_manager.cc:1428] T 8c01157324ba45bda5b3a9a328bf319b P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.083s user 0.001s sys 0.001s
I20250830 07:54:55.318064 13886 consensus_queue.cc:260] T 796e01f6a36241fc94e335253929d6ab P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:55.318567 13886 ts_tablet_manager.cc:1428] T 796e01f6a36241fc94e335253929d6ab P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.009s user 0.001s sys 0.001s
I20250830 07:54:55.318876 13886 tablet_bootstrap.cc:492] T f5baa35307a1425c8d52666d130d6d8a P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:54:55.320729 13886 tablet_bootstrap.cc:654] T f5baa35307a1425c8d52666d130d6d8a P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:55.324061 13882 tablet_bootstrap.cc:492] T 5235e1a32f044f0cbf882e338c482003 P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:54:55.324203 13882 ts_tablet_manager.cc:1397] T 5235e1a32f044f0cbf882e338c482003 P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.055s user 0.007s sys 0.012s
W20250830 07:54:55.324208 13234 catalog_manager.cc:5415] Ignoring report from unknown tablet 852e353f6ee945628ddebdbdd1bd76fb
W20250830 07:54:55.324465 13234 catalog_manager.cc:5415] Ignoring report from unknown tablet 88bbd6b4c795433d9b6ad746353f3aa1
W20250830 07:54:55.324591 13234 catalog_manager.cc:5415] Ignoring report from unknown tablet db4077bf8e184ac5809ef629222f2cc5
W20250830 07:54:55.324697 13234 catalog_manager.cc:5415] Ignoring report from unknown tablet ee44ab24333742909f773889ad5c3e00
W20250830 07:54:55.324790 13234 catalog_manager.cc:5415] Ignoring report from unknown tablet ec47a59c22ff4370bd21bc2a18336049
W20250830 07:54:55.324887 13234 catalog_manager.cc:5415] Ignoring report from unknown tablet 62bc8168176e4678a77827c5b7cc0f3e
I20250830 07:54:55.324846 13882 raft_consensus.cc:357] T 5235e1a32f044f0cbf882e338c482003 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:55.325009 13882 raft_consensus.cc:383] T 5235e1a32f044f0cbf882e338c482003 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:55.325064 13882 raft_consensus.cc:738] T 5235e1a32f044f0cbf882e338c482003 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
W20250830 07:54:55.324988 13234 catalog_manager.cc:5415] Ignoring report from unknown tablet 1520d7257f864ea4ba4b9a5d0443f8a7
I20250830 07:54:55.325244 13882 consensus_queue.cc:260] T 5235e1a32f044f0cbf882e338c482003 P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
W20250830 07:54:55.325455 13234 catalog_manager.cc:5415] Ignoring report from unknown tablet d37fe59b4f964f30bb1ed4cb00868b75
I20250830 07:54:55.325858 13882 ts_tablet_manager.cc:1428] T 5235e1a32f044f0cbf882e338c482003 P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20250830 07:54:55.326097 13882 tablet_bootstrap.cc:492] T da5c7b084e1f4fda92fff35a9cb2c7fc P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
W20250830 07:54:55.326838 13234 catalog_manager.cc:5415] Ignoring report from unknown tablet b83dfc54383d4e7b96523568aea5c9f3
W20250830 07:54:55.327291 13234 catalog_manager.cc:5415] Ignoring report from unknown tablet f398e12cd9f543738d5163354f8a9d9d
I20250830 07:54:55.327548 13882 tablet_bootstrap.cc:654] T da5c7b084e1f4fda92fff35a9cb2c7fc P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:55.328404 15481 raft_consensus.cc:491] T 796e01f6a36241fc94e335253929d6ab P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:55.328550 15481 raft_consensus.cc:513] T 796e01f6a36241fc94e335253929d6ab P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:55.329336 15481 leader_election.cc:290] T 796e01f6a36241fc94e335253929d6ab P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
I20250830 07:54:55.329851 15582 consensus_queue.cc:1035] T 410b1e2d520c470eb4b9ab60104e0cd4 P 6b5e454d98894637b466ea27f1b647f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:54:55.329851 13629 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "796e01f6a36241fc94e335253929d6ab" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:55.330536 13230 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_1a76546ccb4c44a7a1f0aed8bb720cb5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:55.330814 13703 leader_election.cc:343] T 796e01f6a36241fc94e335253929d6ab P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
W20250830 07:54:55.331159 13230 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1a76546ccb4c44a7a1f0aed8bb720cb5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:55.331270 13225 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_4428c29c8358411282f00fd33a6badd4" } new_table_name: "default.Table_600be7252a144704b45d1971758d4c97" modify_external_catalogs: true
I20250830 07:54:55.332587 13226 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_581fd1e93c704213a1a8885de6299a4e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:55.333128 13226 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_581fd1e93c704213a1a8885de6299a4e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:55.334960 15582 raft_consensus.cc:491] T ca959e42c8764eeba0faee96caf8b39f P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:55.335091 15582 raft_consensus.cc:513] T ca959e42c8764eeba0faee96caf8b39f P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:55.335600 15582 leader_election.cc:290] T ca959e42c8764eeba0faee96caf8b39f P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:55.336179 13476 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "ca959e42c8764eeba0faee96caf8b39f" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:54:55.336392 13765 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "ca959e42c8764eeba0faee96caf8b39f" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:55.336874 13562 leader_election.cc:304] T ca959e42c8764eeba0faee96caf8b39f P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b5e454d98894637b466ea27f1b647f9; no voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:54:55.337216 15582 raft_consensus.cc:2747] T ca959e42c8764eeba0faee96caf8b39f P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:54:55.339502 13886 tablet_bootstrap.cc:492] T f5baa35307a1425c8d52666d130d6d8a P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:54:55.339620 13886 ts_tablet_manager.cc:1397] T f5baa35307a1425c8d52666d130d6d8a P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.021s user 0.000s sys 0.007s
I20250830 07:54:55.340282 13886 raft_consensus.cc:357] T f5baa35307a1425c8d52666d130d6d8a P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:55.340428 13886 raft_consensus.cc:383] T f5baa35307a1425c8d52666d130d6d8a P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:55.340504 13886 raft_consensus.cc:738] T f5baa35307a1425c8d52666d130d6d8a P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:54:55.340705 13886 consensus_queue.cc:260] T f5baa35307a1425c8d52666d130d6d8a P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:55.341277 13886 ts_tablet_manager.cc:1428] T f5baa35307a1425c8d52666d130d6d8a P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20250830 07:54:55.341523 13886 tablet_bootstrap.cc:492] T db7144b25ff34bed8c7b779ba9497ef4 P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
W20250830 07:54:55.355446 13703 consensus_peers.cc:489] T 042fd7ff08fc4695b87bb8f9d225ef12 P 9b057ade5dce45af9f8bf0bedf8b917f -> Peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Couldn't send request to peer 6b5e454d98894637b466ea27f1b647f9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20250830 07:54:55.358271 13234 catalog_manager.cc:5674] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743) does not have the latest schema for tablet c8bc6e07377a4ba99c39a909dae11402 (table default.Table_f9379201a5de4169a46eeb2ff2cc0ac7 [id=dce926f371dd4b4ba61511c14d245622]). Expected version 2 got 0
I20250830 07:54:55.361804 13887 tablet_bootstrap.cc:492] T 5e2da5434e95445aa4deafce7fde0c6c P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:54:55.364218 13882 tablet_bootstrap.cc:492] T da5c7b084e1f4fda92fff35a9cb2c7fc P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:54:55.364421 13882 ts_tablet_manager.cc:1397] T da5c7b084e1f4fda92fff35a9cb2c7fc P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.038s user 0.002s sys 0.006s
I20250830 07:54:55.365090 13882 raft_consensus.cc:357] T da5c7b084e1f4fda92fff35a9cb2c7fc P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:55.365355 13882 raft_consensus.cc:383] T da5c7b084e1f4fda92fff35a9cb2c7fc P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:55.365438 13882 raft_consensus.cc:738] T da5c7b084e1f4fda92fff35a9cb2c7fc P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:54:55.365635 13882 consensus_queue.cc:260] T da5c7b084e1f4fda92fff35a9cb2c7fc P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:55.366045 13624 raft_consensus.cc:3058] T 70703eb1d47841a1a227e277ed6a268d P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:55.366209 13882 ts_tablet_manager.cc:1428] T da5c7b084e1f4fda92fff35a9cb2c7fc P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20250830 07:54:55.366475 13882 tablet_bootstrap.cc:492] T 10ec97b8a82145479e0bb526c4cc7c05 P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:54:55.367854 13882 tablet_bootstrap.cc:654] T 10ec97b8a82145479e0bb526c4cc7c05 P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:55.383458 13614 raft_consensus.cc:3058] T ca959e42c8764eeba0faee96caf8b39f P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:55.394179 13629 raft_consensus.cc:3058] T 5235e1a32f044f0cbf882e338c482003 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:55.402216 15608 raft_consensus.cc:491] T 52e910677ae34630a919d1d3f21b7e83 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:55.402424 15608 raft_consensus.cc:513] T 52e910677ae34630a919d1d3f21b7e83 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:55.403985 13886 tablet_bootstrap.cc:654] T db7144b25ff34bed8c7b779ba9497ef4 P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:55.404681 13614 raft_consensus.cc:3058] T c1e0e774b86d4ef9a75e2635295f3e2a P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:55.361712 13234 catalog_manager.cc:5582] T 10ec97b8a82145479e0bb526c4cc7c05 P 9b057ade5dce45af9f8bf0bedf8b917f reported cstate change: term changed from 0 to 1, leader changed from <none> to 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3). New cstate: current_term: 1 leader_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } health_report { overall_health: HEALTHY } } }
I20250830 07:54:55.405586 15608 leader_election.cc:290] T 52e910677ae34630a919d1d3f21b7e83 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
I20250830 07:54:55.411396 15603 raft_consensus.cc:491] T 8cce7e5537794e9484f5a7c82b9e6e1d P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:55.411546 15608 consensus_queue.cc:1035] T c1e0e774b86d4ef9a75e2635295f3e2a P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:54:55.411659 13771 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "1cf23cf78eee46be953bd701aa6bef07" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:55.411545 15603 raft_consensus.cc:513] T 8cce7e5537794e9484f5a7c82b9e6e1d P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:55.417541 15603 leader_election.cc:290] T 8cce7e5537794e9484f5a7c82b9e6e1d P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967)
I20250830 07:54:55.418108 13617 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "8cce7e5537794e9484f5a7c82b9e6e1d" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
W20250830 07:54:55.418629 13703 leader_election.cc:343] T 8cce7e5537794e9484f5a7c82b9e6e1d P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:55.424043 13886 tablet_bootstrap.cc:492] T db7144b25ff34bed8c7b779ba9497ef4 P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:54:55.424191 13886 ts_tablet_manager.cc:1397] T db7144b25ff34bed8c7b779ba9497ef4 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.083s user 0.009s sys 0.005s
I20250830 07:54:55.424826 13886 raft_consensus.cc:357] T db7144b25ff34bed8c7b779ba9497ef4 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:55.424993 13886 raft_consensus.cc:383] T db7144b25ff34bed8c7b779ba9497ef4 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:55.425058 13886 raft_consensus.cc:738] T db7144b25ff34bed8c7b779ba9497ef4 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:54:55.425313 13614 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "52e910677ae34630a919d1d3f21b7e83" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:55.425331 13886 consensus_queue.cc:260] T db7144b25ff34bed8c7b779ba9497ef4 P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:55.425971 13886 ts_tablet_manager.cc:1428] T db7144b25ff34bed8c7b779ba9497ef4 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20250830 07:54:55.426321 13886 tablet_bootstrap.cc:492] T 1cf23cf78eee46be953bd701aa6bef07 P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
W20250830 07:54:55.428179 13703 leader_election.cc:343] T 52e910677ae34630a919d1d3f21b7e83 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:55.428541 13886 tablet_bootstrap.cc:654] T 1cf23cf78eee46be953bd701aa6bef07 P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:55.436735 13886 tablet_bootstrap.cc:492] T 1cf23cf78eee46be953bd701aa6bef07 P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:54:55.436859 13886 ts_tablet_manager.cc:1397] T 1cf23cf78eee46be953bd701aa6bef07 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.011s user 0.001s sys 0.005s
I20250830 07:54:55.437518 13886 raft_consensus.cc:357] T 1cf23cf78eee46be953bd701aa6bef07 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:55.437673 13886 raft_consensus.cc:383] T 1cf23cf78eee46be953bd701aa6bef07 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:55.437772 13886 raft_consensus.cc:738] T 1cf23cf78eee46be953bd701aa6bef07 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:54:55.437973 13886 consensus_queue.cc:260] T 1cf23cf78eee46be953bd701aa6bef07 P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:55.438310 15199 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3ea183a890b84f408b20b55e9eb7c7ed: Bootstrap replaying log segment 1/1 (141.8K/145.4K this segment, stats: ops{read=842 overwritten=0 applied=535 ignored=0} inserts{seen=449 ignored=0} mutations{seen=642 ignored=0} orphaned_commits=0)
I20250830 07:54:55.438537 13886 ts_tablet_manager.cc:1428] T 1cf23cf78eee46be953bd701aa6bef07 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20250830 07:54:55.441063 13887 tablet_bootstrap.cc:654] T 5e2da5434e95445aa4deafce7fde0c6c P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:55.438868 13886 tablet_bootstrap.cc:492] T f32ebc2605c34a68aed50379f028052c P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:54:55.442436 13486 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "0208de98277c4d6889fb0289b6013ae1" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba"
I20250830 07:54:55.444864 13886 tablet_bootstrap.cc:654] T f32ebc2605c34a68aed50379f028052c P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:55.445375 13486 raft_consensus.cc:3058] T 0208de98277c4d6889fb0289b6013ae1 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:55.449343 13486 raft_consensus.cc:2466] T 0208de98277c4d6889fb0289b6013ae1 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 1.
I20250830 07:54:55.451490 13886 tablet_bootstrap.cc:492] T f32ebc2605c34a68aed50379f028052c P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:54:55.451661 13886 ts_tablet_manager.cc:1397] T f32ebc2605c34a68aed50379f028052c P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.013s user 0.004s sys 0.000s
I20250830 07:54:55.452281 13886 raft_consensus.cc:357] T f32ebc2605c34a68aed50379f028052c P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:55.452445 13886 raft_consensus.cc:383] T f32ebc2605c34a68aed50379f028052c P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:55.452503 13886 raft_consensus.cc:738] T f32ebc2605c34a68aed50379f028052c P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:54:55.452718 13886 consensus_queue.cc:260] T f32ebc2605c34a68aed50379f028052c P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:55.453181 13886 ts_tablet_manager.cc:1428] T f32ebc2605c34a68aed50379f028052c P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20250830 07:54:55.455603 13765 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "3d9c884ac05e44ddb59f96588fdd6f4b" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:55.456326 13886 tablet_bootstrap.cc:492] T 14d4d2506e2a47ea906bfb81d5509829 P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:54:55.458109 13886 tablet_bootstrap.cc:654] T 14d4d2506e2a47ea906bfb81d5509829 P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:55.465379 13476 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "23d2c7013c9c4b4aacf47e6ac7ab5a0b" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba"
I20250830 07:54:55.467110 13886 tablet_bootstrap.cc:492] T 14d4d2506e2a47ea906bfb81d5509829 P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:54:55.467625 13886 ts_tablet_manager.cc:1397] T 14d4d2506e2a47ea906bfb81d5509829 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.011s user 0.002s sys 0.004s
I20250830 07:54:55.468729 13886 raft_consensus.cc:357] T 14d4d2506e2a47ea906bfb81d5509829 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:55.469672 13886 raft_consensus.cc:383] T 14d4d2506e2a47ea906bfb81d5509829 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:55.469926 13233 catalog_manager.cc:5864] Not sending DeleteTablet requests; no consensus state for tablet 7de3c7f4bc574fba932f63a39fc4ed4f
I20250830 07:54:55.470276 13233 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_23974e2d53fb40b2a3a9eb3c40342288" } new_table_name: "default.Table_3721cb36901942688890b046361e1a0e" modify_external_catalogs: true
I20250830 07:54:55.470467 13886 raft_consensus.cc:738] T 14d4d2506e2a47ea906bfb81d5509829 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:54:55.471436 13886 consensus_queue.cc:260] T 14d4d2506e2a47ea906bfb81d5509829 P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:55.471907 13886 ts_tablet_manager.cc:1428] T 14d4d2506e2a47ea906bfb81d5509829 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.004s user 0.000s sys 0.002s
I20250830 07:54:55.472163 13886 tablet_bootstrap.cc:492] T e72402ca3cdf452fa8f4534c67226253 P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:54:55.474846 13886 tablet_bootstrap.cc:654] T e72402ca3cdf452fa8f4534c67226253 P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:55.476274 13765 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "d171ad1667fa44c993ec5fd7d701d8e0" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:55.478118 13764 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "66432e73deea433d9df565d5fcace647" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:55.478664 13764 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "509e08290f3842cfbde8b74ff9f4f70f" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:55.482812 13775 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "c56e3a30c18640e68c8b0c4ff4251d96" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:55.485080 13886 tablet_bootstrap.cc:492] T e72402ca3cdf452fa8f4534c67226253 P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:54:55.485680 13886 ts_tablet_manager.cc:1397] T e72402ca3cdf452fa8f4534c67226253 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.013s user 0.003s sys 0.001s
I20250830 07:54:55.487550 13229 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet d94215b0b1f142178f0b791518d1baf2
I20250830 07:54:55.488288 13229 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_9a1329f574214cfaa5ce5758346462fb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:55.488807 13229 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9a1329f574214cfaa5ce5758346462fb in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:55.489920 13232 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet 1fee3e58f31b4befa42ffbb8d7bd6f4e
I20250830 07:54:55.490165 13231 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_986f81cfa4f54f808c7ff629ab4c211c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250830 07:54:55.490572 13232 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_22d6e3f66a074cc9a30b3dcce4d07060"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:55.490670 13231 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_986f81cfa4f54f808c7ff629ab4c211c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250830 07:54:55.491050 13232 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_22d6e3f66a074cc9a30b3dcce4d07060 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:55.492013 13228 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_f1f1ad708be1412c9fa7ad74ac223ec0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250830 07:54:55.492172 13230 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_cd8e40951aea4b65bfb67ac183f399de" } new_table_name: "default.Table_bd7664612c724a1eb01c3047b5945a00" modify_external_catalogs: true
I20250830 07:54:55.492327 15582 raft_consensus.cc:491] T 3c3c798b2b7b460b98a30605464763e6 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20250830 07:54:55.492450 13228 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f1f1ad708be1412c9fa7ad74ac223ec0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:55.492508 15582 raft_consensus.cc:513] T 3c3c798b2b7b460b98a30605464763e6 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:55.493187 15582 leader_election.cc:290] T 3c3c798b2b7b460b98a30605464763e6 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:55.493702 13226 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_39ee3984c7f14096ba80b43f5baa4339" } new_table_name: "default.Table_0e28e82f88dd4e09b9af979cee9771c9" modify_external_catalogs: true
I20250830 07:54:55.494297 13602 tablet_service.cc:1515] Processing DeleteTablet for tablet d94215b0b1f142178f0b791518d1baf2 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:55 UTC) from {username='slave'} at 127.0.0.1:45306
I20250830 07:54:55.494534 13593 tablet_service.cc:1515] Processing DeleteTablet for tablet 1fee3e58f31b4befa42ffbb8d7bd6f4e with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:55 UTC) from {username='slave'} at 127.0.0.1:45306
W20250830 07:54:55.499220 13220 catalog_manager.cc:4908] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet d94215b0b1f142178f0b791518d1baf2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d94215b0b1f142178f0b791518d1baf2 already in progress: creating tablet
W20250830 07:54:55.499454 13220 catalog_manager.cc:4908] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet 1fee3e58f31b4befa42ffbb8d7bd6f4e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1fee3e58f31b4befa42ffbb8d7bd6f4e already in progress: creating tablet
I20250830 07:54:55.500236 13225 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_121a01abce2f47d4a41ce33b35c8f89b" } modify_external_catalogs: true
I20250830 07:54:55.500376 13225 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_121a01abce2f47d4a41ce33b35c8f89b" } modify_external_catalogs: true
I20250830 07:54:55.503290 13227 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_056a3568c0844814a6c7afd463359b81" } new_table_name: "default.Table_42b4a102252746e19602fe4b43a313de" modify_external_catalogs: true
I20250830 07:54:55.546245 13234 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_eb6e62f793a74c34befadd2243d33718"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:55.546902 13234 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_eb6e62f793a74c34befadd2243d33718 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:55.548928 13229 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_711aaf9b9ba04df6b8a5fc206b66808e" } modify_external_catalogs: true
W20250830 07:54:55.551445 13230 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 8817f936c8df42f093a43dcd6f19d699 has no consensus state
W20250830 07:54:55.552435 13233 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a679bee498ff4b9eb1409c33fab2ae54 has no consensus state
I20250830 07:54:55.565069 13231 master_service.cc:948] ReplaceTablet: received request to replace tablet 957bd8a761cf484cad4fa68b50dcac10 from {username='slave'} at 127.0.0.1:42126
I20250830 07:54:55.567204 13882 tablet_bootstrap.cc:492] T 10ec97b8a82145479e0bb526c4cc7c05 P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:54:55.567409 13882 ts_tablet_manager.cc:1397] T 10ec97b8a82145479e0bb526c4cc7c05 P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.201s user 0.054s sys 0.086s
I20250830 07:54:55.568094 13882 raft_consensus.cc:357] T 10ec97b8a82145479e0bb526c4cc7c05 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:55.568313 13882 raft_consensus.cc:383] T 10ec97b8a82145479e0bb526c4cc7c05 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:55.568388 13882 raft_consensus.cc:738] T 10ec97b8a82145479e0bb526c4cc7c05 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:54:55.568593 13882 consensus_queue.cc:260] T 10ec97b8a82145479e0bb526c4cc7c05 P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:55.569104 13882 ts_tablet_manager.cc:1428] T 10ec97b8a82145479e0bb526c4cc7c05 P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20250830 07:54:55.569370 13882 tablet_bootstrap.cc:492] T db4077bf8e184ac5809ef629222f2cc5 P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:54:55.570883 13882 tablet_bootstrap.cc:654] T db4077bf8e184ac5809ef629222f2cc5 P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:55.573820 13225 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet b6717031830f4c57967e87ce077ddb21
W20250830 07:54:55.574436 13227 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 32d73a0c2ce04f25942974f8caa16c49 has no consensus state
I20250830 07:54:55.575105 13593 tablet_service.cc:1515] Processing DeleteTablet for tablet b6717031830f4c57967e87ce077ddb21 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:55 UTC) from {username='slave'} at 127.0.0.1:45306
W20250830 07:54:55.575739 13220 catalog_manager.cc:4908] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet b6717031830f4c57967e87ce077ddb21 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b6717031830f4c57967e87ce077ddb21 already in progress: creating tablet
W20250830 07:54:55.576143 13226 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ab667e34aab14233ad1755c45e6828a6 has no consensus state
I20250830 07:54:55.578716 13882 tablet_bootstrap.cc:492] T db4077bf8e184ac5809ef629222f2cc5 P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:54:55.578864 13882 ts_tablet_manager.cc:1397] T db4077bf8e184ac5809ef629222f2cc5 P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.010s user 0.004s sys 0.005s
I20250830 07:54:55.579535 13882 raft_consensus.cc:357] T db4077bf8e184ac5809ef629222f2cc5 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:55.579715 13882 raft_consensus.cc:383] T db4077bf8e184ac5809ef629222f2cc5 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:55.579788 13882 raft_consensus.cc:738] T db4077bf8e184ac5809ef629222f2cc5 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:54:55.580042 13882 consensus_queue.cc:260] T db4077bf8e184ac5809ef629222f2cc5 P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:55.580600 13882 ts_tablet_manager.cc:1428] T db4077bf8e184ac5809ef629222f2cc5 P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20250830 07:54:55.580857 13882 tablet_bootstrap.cc:492] T 713c12e1efec4e6f9895c65dc8a9c4b9 P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:54:55.582392 13882 tablet_bootstrap.cc:654] T 713c12e1efec4e6f9895c65dc8a9c4b9 P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:55.588245 15481 raft_consensus.cc:491] T 76ab56c469cf4675a4e21acbe0a8085d P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:55.591382 15481 raft_consensus.cc:513] T 76ab56c469cf4675a4e21acbe0a8085d P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:55.592129 13771 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "3c3c798b2b7b460b98a30605464763e6" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:55.600427 13886 raft_consensus.cc:357] T e72402ca3cdf452fa8f4534c67226253 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:55.601178 15481 leader_election.cc:290] T 76ab56c469cf4675a4e21acbe0a8085d P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
I20250830 07:54:55.602916 13234 master_service.cc:948] ReplaceTablet: received request to replace tablet 66499e87e3d7422ca7a449cc2e89e709 from {username='slave'} at 127.0.0.1:42126
I20250830 07:54:55.604597 13882 tablet_bootstrap.cc:492] T 713c12e1efec4e6f9895c65dc8a9c4b9 P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:54:55.604702 13882 ts_tablet_manager.cc:1397] T 713c12e1efec4e6f9895c65dc8a9c4b9 P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.024s user 0.002s sys 0.006s
I20250830 07:54:55.605307 13882 raft_consensus.cc:357] T 713c12e1efec4e6f9895c65dc8a9c4b9 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:55.605461 13882 raft_consensus.cc:383] T 713c12e1efec4e6f9895c65dc8a9c4b9 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:55.605505 13882 raft_consensus.cc:738] T 713c12e1efec4e6f9895c65dc8a9c4b9 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:54:55.605682 13882 consensus_queue.cc:260] T 713c12e1efec4e6f9895c65dc8a9c4b9 P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:55.606014 13231 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet 957bd8a761cf484cad4fa68b50dcac10
I20250830 07:54:55.606238 13882 ts_tablet_manager.cc:1428] T 713c12e1efec4e6f9895c65dc8a9c4b9 P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.001s user 0.001s sys 0.001s
I20250830 07:54:55.606428 13231 catalog_manager.cc:6652] ReplaceTablet: tablet 957bd8a761cf484cad4fa68b50dcac10 deleted and replaced by tablet 2dc819e9c50b48948003c31ab50e680a
I20250830 07:54:55.606453 13882 tablet_bootstrap.cc:492] T 924403105a6a40f28aad60647a2a8987 P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:54:55.606767 13629 raft_consensus.cc:3058] T 519b3e58b63b402d84e234f5e180b98c P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:55.606877 13593 tablet_service.cc:1515] Processing DeleteTablet for tablet 957bd8a761cf484cad4fa68b50dcac10 with delete_type TABLET_DATA_DELETED (replaced by tablet 2dc819e9c50b48948003c31ab50e680a) from {username='slave'} at 127.0.0.1:45306
W20250830 07:54:55.607389 13220 catalog_manager.cc:4908] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet 957bd8a761cf484cad4fa68b50dcac10 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 957bd8a761cf484cad4fa68b50dcac10 already in progress: creating tablet
I20250830 07:54:55.607843 13882 tablet_bootstrap.cc:654] T 924403105a6a40f28aad60647a2a8987 P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:55.620461 13234 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet 66499e87e3d7422ca7a449cc2e89e709
I20250830 07:54:55.621243 13593 tablet_service.cc:1515] Processing DeleteTablet for tablet 66499e87e3d7422ca7a449cc2e89e709 with delete_type TABLET_DATA_DELETED (replaced by tablet e2fbedcdee9541ee97996d8ee91a4d66) from {username='slave'} at 127.0.0.1:45306
I20250830 07:54:55.621295 13476 raft_consensus.cc:3058] T 23d2c7013c9c4b4aacf47e6ac7ab5a0b P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:55.621455 15047 tablet_replica.cc:331] T 66499e87e3d7422ca7a449cc2e89e709 P 6b5e454d98894637b466ea27f1b647f9: stopping tablet replica
I20250830 07:54:55.621613 15047 raft_consensus.cc:2241] T 66499e87e3d7422ca7a449cc2e89e709 P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250830 07:54:55.621743 15047 raft_consensus.cc:2270] T 66499e87e3d7422ca7a449cc2e89e709 P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250830 07:54:55.622236 15047 ts_tablet_manager.cc:1905] T 66499e87e3d7422ca7a449cc2e89e709 P 6b5e454d98894637b466ea27f1b647f9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250830 07:54:55.623468 13611 raft_consensus.cc:3058] T 057bcce2860345da860acc262dc4d339 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:55.627666 15115 raft_consensus.cc:491] T e74a3e4b3b234c41aca30f772525652e P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:55.627831 15115 raft_consensus.cc:513] T e74a3e4b3b234c41aca30f772525652e P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:55.628415 15115 leader_election.cc:290] T e74a3e4b3b234c41aca30f772525652e P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:55.628553 15470 raft_consensus.cc:491] T 8c01157324ba45bda5b3a9a328bf319b P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:55.628652 15470 raft_consensus.cc:513] T 8c01157324ba45bda5b3a9a328bf319b P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:55.629027 15047 ts_tablet_manager.cc:1918] T 66499e87e3d7422ca7a449cc2e89e709 P 6b5e454d98894637b466ea27f1b647f9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250830 07:54:55.629091 15470 leader_election.cc:290] T 8c01157324ba45bda5b3a9a328bf319b P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:55.629115 15047 log.cc:1199] T 66499e87e3d7422ca7a449cc2e89e709 P 6b5e454d98894637b466ea27f1b647f9: Deleting WAL directory at /tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/ts-1/wal/wals/66499e87e3d7422ca7a449cc2e89e709
I20250830 07:54:55.629235 15514 raft_consensus.cc:491] T a8660a6ff9254d4f9f0ef047b8682ed1 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:55.629285 15687 raft_consensus.cc:491] T 7aed56dba39e40518e9c3325bcccd74a P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:55.629357 15514 raft_consensus.cc:513] T a8660a6ff9254d4f9f0ef047b8682ed1 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:55.629431 15687 raft_consensus.cc:513] T 7aed56dba39e40518e9c3325bcccd74a P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:55.629885 15514 leader_election.cc:290] T a8660a6ff9254d4f9f0ef047b8682ed1 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:55.629984 15687 leader_election.cc:290] T 7aed56dba39e40518e9c3325bcccd74a P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:55.630275 13234 catalog_manager.cc:6652] ReplaceTablet: tablet 66499e87e3d7422ca7a449cc2e89e709 deleted and replaced by tablet e2fbedcdee9541ee97996d8ee91a4d66
I20250830 07:54:55.631124 15047 ts_tablet_manager.cc:1939] T 66499e87e3d7422ca7a449cc2e89e709 P 6b5e454d98894637b466ea27f1b647f9: Deleting consensus metadata
I20250830 07:54:55.631510 13624 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "8c01157324ba45bda5b3a9a328bf319b" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:55.631705 13220 catalog_manager.cc:4928] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): tablet 66499e87e3d7422ca7a449cc2e89e709 (table default.Table_fc37190c24f34b8e86db55435a3b658e [id=4ec4d0c45603406c91e6b3618418d556]) successfully deleted
I20250830 07:54:55.631718 13619 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "e74a3e4b3b234c41aca30f772525652e" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:55.632058 13614 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "a8660a6ff9254d4f9f0ef047b8682ed1" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:55.632360 13617 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "7aed56dba39e40518e9c3325bcccd74a" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:55.632426 13882 tablet_bootstrap.cc:492] T 924403105a6a40f28aad60647a2a8987 P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:54:55.632530 13882 ts_tablet_manager.cc:1397] T 924403105a6a40f28aad60647a2a8987 P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.026s user 0.003s sys 0.010s
I20250830 07:54:55.633507 13882 raft_consensus.cc:357] T 924403105a6a40f28aad60647a2a8987 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:55.633646 13882 raft_consensus.cc:383] T 924403105a6a40f28aad60647a2a8987 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:55.634050 13882 raft_consensus.cc:738] T 924403105a6a40f28aad60647a2a8987 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:54:55.634232 13882 consensus_queue.cc:260] T 924403105a6a40f28aad60647a2a8987 P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:55.634738 13882 ts_tablet_manager.cc:1428] T 924403105a6a40f28aad60647a2a8987 P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20250830 07:54:55.635035 13882 tablet_bootstrap.cc:492] T 7c5e50cb605c4a40b47984f328eedd93 P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:54:55.636160 13481 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f66e1d07039841088a444ee0203a4eb0" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba"
I20250830 07:54:55.636550 13882 tablet_bootstrap.cc:654] T 7c5e50cb605c4a40b47984f328eedd93 P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
W20250830 07:54:55.638361 13423 leader_election.cc:343] T 8c01157324ba45bda5b3a9a328bf319b P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
W20250830 07:54:55.638566 13423 leader_election.cc:343] T e74a3e4b3b234c41aca30f772525652e P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
W20250830 07:54:55.638731 13423 leader_election.cc:343] T a8660a6ff9254d4f9f0ef047b8682ed1 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
W20250830 07:54:55.638882 13423 leader_election.cc:343] T 7aed56dba39e40518e9c3325bcccd74a P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:55.639160 13486 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "689b4fee1dd04b3d9ccdea334b0f6b59" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba"
I20250830 07:54:55.639310 13486 raft_consensus.cc:3058] T 689b4fee1dd04b3d9ccdea334b0f6b59 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:55.641973 13486 raft_consensus.cc:2466] T 689b4fee1dd04b3d9ccdea334b0f6b59 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 1.
I20250830 07:54:55.643339 15602 raft_consensus.cc:491] T 1db4109dc43b489d89c5de9eeb64a771 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:55.644887 13481 raft_consensus.cc:3058] T f66e1d07039841088a444ee0203a4eb0 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:55.657403 15602 raft_consensus.cc:513] T 1db4109dc43b489d89c5de9eeb64a771 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:55.658013 15602 leader_election.cc:290] T 1db4109dc43b489d89c5de9eeb64a771 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:55.658588 13887 tablet_bootstrap.cc:492] T 5e2da5434e95445aa4deafce7fde0c6c P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:54:55.659109 13887 ts_tablet_manager.cc:1397] T 5e2da5434e95445aa4deafce7fde0c6c P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.297s user 0.007s sys 0.003s
I20250830 07:54:55.658418 13229 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_711aaf9b9ba04df6b8a5fc206b66808e" } modify_external_catalogs: true
I20250830 07:54:55.659854 13887 raft_consensus.cc:357] T 5e2da5434e95445aa4deafce7fde0c6c P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:55.661415 13887 raft_consensus.cc:383] T 5e2da5434e95445aa4deafce7fde0c6c P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:55.661514 13887 raft_consensus.cc:738] T 5e2da5434e95445aa4deafce7fde0c6c P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:54:55.661967 13887 consensus_queue.cc:260] T 5e2da5434e95445aa4deafce7fde0c6c P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:55.662504 13887 ts_tablet_manager.cc:1428] T 5e2da5434e95445aa4deafce7fde0c6c P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20250830 07:54:55.666112 13614 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "1db4109dc43b489d89c5de9eeb64a771" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:55.673214 13234 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_2a8177fee3884fbdb1278f21d791987f" } modify_external_catalogs: true
I20250830 07:54:55.673410 13234 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_2a8177fee3884fbdb1278f21d791987f" } modify_external_catalogs: true
I20250830 07:54:55.682070 13234 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet e498b17956514a9d93807598f8dfb351
I20250830 07:54:55.682898 13593 tablet_service.cc:1515] Processing DeleteTablet for tablet e498b17956514a9d93807598f8dfb351 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:55 UTC) from {username='slave'} at 127.0.0.1:45306
W20250830 07:54:55.683490 13220 catalog_manager.cc:4908] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet e498b17956514a9d93807598f8dfb351 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e498b17956514a9d93807598f8dfb351 already in progress: creating tablet
I20250830 07:54:55.671479 13487 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "62bc8168176e4678a77827c5b7cc0f3e" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:54:55.685097 13487 raft_consensus.cc:2466] T 62bc8168176e4678a77827c5b7cc0f3e P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 0.
I20250830 07:54:55.671437 13887 tablet_bootstrap.cc:492] T 2c4c3c61cddf42668d3a09f4fbc5f641 P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:54:55.685510 13229 catalog_manager.cc:5864] Not sending DeleteTablet requests; no consensus state for tablet 23a26561c8cf45d0b6efb8e84520df1b
I20250830 07:54:55.687027 13887 tablet_bootstrap.cc:654] T 2c4c3c61cddf42668d3a09f4fbc5f641 P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:55.674111 13481 raft_consensus.cc:2466] T f66e1d07039841088a444ee0203a4eb0 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 1.
I20250830 07:54:55.679311 13480 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "52e910677ae34630a919d1d3f21b7e83" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:54:55.690479 13480 raft_consensus.cc:2466] T 52e910677ae34630a919d1d3f21b7e83 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 0.
W20250830 07:54:55.679386 13423 leader_election.cc:343] T 1db4109dc43b489d89c5de9eeb64a771 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:55.679466 13488 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "8cce7e5537794e9484f5a7c82b9e6e1d" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:54:55.691182 13488 raft_consensus.cc:2466] T 8cce7e5537794e9484f5a7c82b9e6e1d P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 0.
I20250830 07:54:55.679477 13476 raft_consensus.cc:2466] T 23d2c7013c9c4b4aacf47e6ac7ab5a0b P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 1.
I20250830 07:54:55.684628 13486 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "796e01f6a36241fc94e335253929d6ab" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:54:55.691694 13486 raft_consensus.cc:2466] T 796e01f6a36241fc94e335253929d6ab P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 0.
W20250830 07:54:55.700281 13422 leader_election.cc:343] T 1cf23cf78eee46be953bd701aa6bef07 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:55.700417 13422 leader_election.cc:304] T 1cf23cf78eee46be953bd701aa6bef07 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba; no voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:54:55.700706 15602 raft_consensus.cc:2747] T 1cf23cf78eee46be953bd701aa6bef07 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:54:55.701858 13882 tablet_bootstrap.cc:492] T 7c5e50cb605c4a40b47984f328eedd93 P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
W20250830 07:54:55.701889 13422 leader_election.cc:343] T 3d9c884ac05e44ddb59f96588fdd6f4b P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:55.702100 13882 ts_tablet_manager.cc:1397] T 7c5e50cb605c4a40b47984f328eedd93 P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.067s user 0.018s sys 0.037s
I20250830 07:54:55.702131 13422 leader_election.cc:304] T 3d9c884ac05e44ddb59f96588fdd6f4b P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba; no voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:54:55.702445 15602 raft_consensus.cc:2747] T 3d9c884ac05e44ddb59f96588fdd6f4b P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:54:55.703068 15199 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3ea183a890b84f408b20b55e9eb7c7ed: Bootstrap replayed 1/1 log segments. Stats: ops{read=856 overwritten=0 applied=540 ignored=0} inserts{seen=453 ignored=0} mutations{seen=647 ignored=0} orphaned_commits=0. Pending: 316 replicates
W20250830 07:54:55.703706 13422 leader_election.cc:343] T d171ad1667fa44c993ec5fd7d701d8e0 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:55.703613 13882 raft_consensus.cc:357] T 7c5e50cb605c4a40b47984f328eedd93 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:55.703935 13422 leader_election.cc:304] T d171ad1667fa44c993ec5fd7d701d8e0 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba; no voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:54:55.704260 15691 raft_consensus.cc:2747] T d171ad1667fa44c993ec5fd7d701d8e0 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:54:55.703884 13882 raft_consensus.cc:383] T 7c5e50cb605c4a40b47984f328eedd93 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:55.705291 13882 raft_consensus.cc:738] T 7c5e50cb605c4a40b47984f328eedd93 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:54:55.705682 13882 consensus_queue.cc:260] T 7c5e50cb605c4a40b47984f328eedd93 P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
W20250830 07:54:55.706492 13422 leader_election.cc:343] T 66432e73deea433d9df565d5fcace647 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:55.706562 13234 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_525d900516e748b1ad533d8a38492d5a" } modify_external_catalogs: true
I20250830 07:54:55.706624 13882 ts_tablet_manager.cc:1428] T 7c5e50cb605c4a40b47984f328eedd93 P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20250830 07:54:55.706658 13422 leader_election.cc:304] T 66432e73deea433d9df565d5fcace647 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba; no voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:54:55.706732 13234 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_525d900516e748b1ad533d8a38492d5a" } modify_external_catalogs: true
I20250830 07:54:55.707082 13882 tablet_bootstrap.cc:492] T 3bb48fce24074a8e8ec99d3172a655d8 P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:54:55.707378 15691 raft_consensus.cc:2747] T 66432e73deea433d9df565d5fcace647 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:54:55.707973 13231 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_86fde52726544125aec7da61ebd81e08" } modify_external_catalogs: true
I20250830 07:54:55.708114 13231 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_86fde52726544125aec7da61ebd81e08" } modify_external_catalogs: true
W20250830 07:54:55.709019 13422 leader_election.cc:343] T 509e08290f3842cfbde8b74ff9f4f70f P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:55.709161 13422 leader_election.cc:304] T 509e08290f3842cfbde8b74ff9f4f70f P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba; no voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:54:55.709177 13226 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_34c519a5607a416b931dc4e0cca0db3b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250830 07:54:55.709385 15687 raft_consensus.cc:2747] T 509e08290f3842cfbde8b74ff9f4f70f P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20250830 07:54:55.709693 13226 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_34c519a5607a416b931dc4e0cca0db3b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:55.710665 15691 raft_consensus.cc:491] T ed364f03bdad42b88e181b7d0e1e4011 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:55.710790 15691 raft_consensus.cc:513] T ed364f03bdad42b88e181b7d0e1e4011 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:55.710965 13227 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_c508704cda244039bf5c419ef626ed1d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:55.711405 13227 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c508704cda244039bf5c419ef626ed1d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:55.711462 15691 leader_election.cc:290] T ed364f03bdad42b88e181b7d0e1e4011 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:55.712466 13225 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_533ca346412145cb85ee8f4726bb8a4b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:55.712927 13225 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_533ca346412145cb85ee8f4726bb8a4b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:55.714082 13228 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_b53032ff88434d2f9a1fbf5a6fdc546f" } new_table_name: "default.Table_1865f2739754463b97b55f37c4b0aaaa" modify_external_catalogs: true
I20250830 07:54:55.714596 13887 tablet_bootstrap.cc:492] T 2c4c3c61cddf42668d3a09f4fbc5f641 P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:54:55.714726 13887 ts_tablet_manager.cc:1397] T 2c4c3c61cddf42668d3a09f4fbc5f641 P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.052s user 0.000s sys 0.003s
I20250830 07:54:55.715217 13233 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_55453fb8fd9d4e6b8091ed37e1885c1d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250830 07:54:55.715443 13887 raft_consensus.cc:357] T 2c4c3c61cddf42668d3a09f4fbc5f641 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:55.715596 13887 raft_consensus.cc:383] T 2c4c3c61cddf42668d3a09f4fbc5f641 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20250830 07:54:55.715636 13233 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_55453fb8fd9d4e6b8091ed37e1885c1d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:55.715698 13887 raft_consensus.cc:738] T 2c4c3c61cddf42668d3a09f4fbc5f641 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:54:55.715895 13887 consensus_queue.cc:260] T 2c4c3c61cddf42668d3a09f4fbc5f641 P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:55.716465 13887 ts_tablet_manager.cc:1428] T 2c4c3c61cddf42668d3a09f4fbc5f641 P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20250830 07:54:55.716722 13887 tablet_bootstrap.cc:492] T 1fee3e58f31b4befa42ffbb8d7bd6f4e P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:54:55.718322 13887 tablet_bootstrap.cc:654] T 1fee3e58f31b4befa42ffbb8d7bd6f4e P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:55.730257 13231 catalog_manager.cc:5864] Not sending DeleteTablet requests; no consensus state for tablet 1caa0979e43d402983c56d20c47b4518
I20250830 07:54:55.731642 13234 catalog_manager.cc:5864] Not sending DeleteTablet requests; no consensus state for tablet eb910d4e1fe5472fa766160d8d308b94
W20250830 07:54:55.733367 13423 consensus_peers.cc:489] T 6251a06d1efe44e38d35d962c468f8b2 P 2065c332f15a4739899af79f3669c3ba -> Peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Couldn't send request to peer 6b5e454d98894637b466ea27f1b647f9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20250830 07:54:55.734552 13619 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "76ab56c469cf4675a4e21acbe0a8085d" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:55.734629 13882 tablet_bootstrap.cc:654] T 3bb48fce24074a8e8ec99d3172a655d8 P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:55.740139 13775 raft_consensus.cc:1273] T 43e93d3038f7496ebb18319420ab67e0 P 9b057ade5dce45af9f8bf0bedf8b917f [term 2 FOLLOWER]: Refusing update from remote peer 6b5e454d98894637b466ea27f1b647f9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 1. (term mismatch)
I20250830 07:54:55.742973 13886 raft_consensus.cc:383] T e72402ca3cdf452fa8f4534c67226253 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:55.743104 13886 raft_consensus.cc:738] T e72402ca3cdf452fa8f4534c67226253 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:54:55.744303 13886 consensus_queue.cc:260] T e72402ca3cdf452fa8f4534c67226253 P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:55.744448 13629 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "ed364f03bdad42b88e181b7d0e1e4011" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:55.744817 15481 consensus_queue.cc:1035] T 3c9dd258e6be47f68e039e4cdcd899b2 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.143s
W20250830 07:54:55.744889 13423 leader_election.cc:343] T ed364f03bdad42b88e181b7d0e1e4011 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:55.745457 13775 pending_rounds.cc:85] T 43e93d3038f7496ebb18319420ab67e0 P 9b057ade5dce45af9f8bf0bedf8b917f: Aborting all ops after (but not including) 0
I20250830 07:54:55.745566 13775 pending_rounds.cc:107] T 43e93d3038f7496ebb18319420ab67e0 P 9b057ade5dce45af9f8bf0bedf8b917f: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20250830 07:54:55.746181 13775 raft_consensus.cc:2887] T 43e93d3038f7496ebb18319420ab67e0 P 9b057ade5dce45af9f8bf0bedf8b917f [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20250830 07:54:55.754096 13703 leader_election.cc:343] T 76ab56c469cf4675a4e21acbe0a8085d P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:55.762465 14748 consensus_queue.cc:1035] T 43e93d3038f7496ebb18319420ab67e0 P 6b5e454d98894637b466ea27f1b647f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20250830 07:54:55.766610 13703 consensus_peers.cc:489] T 74f2fcc22fd545fb8ca7c20619843023 P 9b057ade5dce45af9f8bf0bedf8b917f -> Peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Couldn't send request to peer 6b5e454d98894637b466ea27f1b647f9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20250830 07:54:55.771607 13886 ts_tablet_manager.cc:1428] T e72402ca3cdf452fa8f4534c67226253 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.286s user 0.001s sys 0.001s
I20250830 07:54:55.771930 13886 tablet_bootstrap.cc:492] T a0cf1de8485941eb8a557a6e2f783047 P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:54:55.773939 13886 tablet_bootstrap.cc:654] T a0cf1de8485941eb8a557a6e2f783047 P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:55.779775 15701 raft_consensus.cc:491] T ee44ab24333742909f773889ad5c3e00 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:55.780246 15701 raft_consensus.cc:513] T ee44ab24333742909f773889ad5c3e00 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:55.788097 15701 leader_election.cc:290] T ee44ab24333742909f773889ad5c3e00 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967)
I20250830 07:54:55.790755 13619 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "ee44ab24333742909f773889ad5c3e00" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
W20250830 07:54:55.791743 13703 leader_election.cc:343] T ee44ab24333742909f773889ad5c3e00 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:55.807211 13619 raft_consensus.cc:3058] T 3c3c798b2b7b460b98a30605464763e6 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Advancing to term 1
W20250830 07:54:55.824507 13701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.209.1:45325, user_credentials={real_user=slave}} blocked reactor thread for 73445us
I20250830 07:54:55.824810 13701 leader_election.cc:304] T 97d49a1f600f4c13a4aafca99cedabe8 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:54:55.825151 15701 raft_consensus.cc:2802] T 97d49a1f600f4c13a4aafca99cedabe8 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:54:55.825261 15701 raft_consensus.cc:491] T 97d49a1f600f4c13a4aafca99cedabe8 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:54:55.825322 15701 raft_consensus.cc:3058] T 97d49a1f600f4c13a4aafca99cedabe8 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:55.828830 13701 leader_election.cc:304] T a7dc529c40544bafbc9e7f0ab34086bd P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:54:55.829186 15481 raft_consensus.cc:2802] T a7dc529c40544bafbc9e7f0ab34086bd P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election won for term 1
I20250830 07:54:55.829301 15481 raft_consensus.cc:695] T a7dc529c40544bafbc9e7f0ab34086bd P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 LEADER]: Becoming Leader. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Running, Role: LEADER
I20250830 07:54:55.829509 15481 consensus_queue.cc:237] T a7dc529c40544bafbc9e7f0ab34086bd P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
W20250830 07:54:55.830966 13423 consensus_peers.cc:489] T 2048c04578104c78aa6504fd9d5953a3 P 2065c332f15a4739899af79f3669c3ba -> Peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Couldn't send request to peer 6b5e454d98894637b466ea27f1b647f9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20250830 07:54:55.831630 15701 raft_consensus.cc:513] T 97d49a1f600f4c13a4aafca99cedabe8 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:55.832947 13611 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "97d49a1f600f4c13a4aafca99cedabe8" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9"
I20250830 07:54:55.833074 15701 leader_election.cc:290] T 97d49a1f600f4c13a4aafca99cedabe8 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Requested vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
W20250830 07:54:55.833511 13703 leader_election.cc:343] T 97d49a1f600f4c13a4aafca99cedabe8 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:55.849982 15701 raft_consensus.cc:491] T 1cf23cf78eee46be953bd701aa6bef07 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:55.851325 15582 raft_consensus.cc:491] T db4077bf8e184ac5809ef629222f2cc5 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:55.851450 15582 raft_consensus.cc:513] T db4077bf8e184ac5809ef629222f2cc5 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:55.851749 15701 raft_consensus.cc:513] T 1cf23cf78eee46be953bd701aa6bef07 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:55.852077 15582 leader_election.cc:290] T db4077bf8e184ac5809ef629222f2cc5 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:55.852758 13775 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "db4077bf8e184ac5809ef629222f2cc5" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:55.854210 13611 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "1cf23cf78eee46be953bd701aa6bef07" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
W20250830 07:54:55.854645 13703 leader_election.cc:343] T 1cf23cf78eee46be953bd701aa6bef07 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:55.854424 15701 leader_election.cc:290] T 1cf23cf78eee46be953bd701aa6bef07 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
W20250830 07:54:55.871188 13477 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.589s user 0.008s sys 0.017s
W20250830 07:54:55.871331 13477 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.589s user 0.008s sys 0.017s
I20250830 07:54:55.875095 15582 raft_consensus.cc:491] T 95b6f084eb5240ea94c125eaa154ac9f P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:55.875226 15582 raft_consensus.cc:513] T 95b6f084eb5240ea94c125eaa154ac9f P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:55.875756 15582 leader_election.cc:290] T 95b6f084eb5240ea94c125eaa154ac9f P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:55.875880 15199 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3ea183a890b84f408b20b55e9eb7c7ed: Bootstrap complete.
I20250830 07:54:55.879160 13775 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "95b6f084eb5240ea94c125eaa154ac9f" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:55.879647 15691 raft_consensus.cc:491] T 6ccbaf109e36453ea6645dfd090f5a1a P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:55.879822 15691 raft_consensus.cc:513] T 6ccbaf109e36453ea6645dfd090f5a1a P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
W20250830 07:54:55.880162 13701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.209.1:45325, user_credentials={real_user=slave}} blocked reactor thread for 51354us
I20250830 07:54:55.880401 15691 leader_election.cc:290] T 6ccbaf109e36453ea6645dfd090f5a1a P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:55.881461 13611 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "6ccbaf109e36453ea6645dfd090f5a1a" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:55.881861 13701 leader_election.cc:304] T 0208de98277c4d6889fb0289b6013ae1 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:54:55.882195 15601 raft_consensus.cc:2802] T 0208de98277c4d6889fb0289b6013ae1 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election won for term 1
I20250830 07:54:55.882324 15601 raft_consensus.cc:695] T 0208de98277c4d6889fb0289b6013ae1 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 LEADER]: Becoming Leader. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Running, Role: LEADER
I20250830 07:54:55.882527 15601 consensus_queue.cc:237] T 0208de98277c4d6889fb0289b6013ae1 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
W20250830 07:54:55.885722 13423 leader_election.cc:343] T 6ccbaf109e36453ea6645dfd090f5a1a P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:55.903103 15701 raft_consensus.cc:491] T db7144b25ff34bed8c7b779ba9497ef4 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:55.903680 15701 raft_consensus.cc:513] T db7144b25ff34bed8c7b779ba9497ef4 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:55.908151 13614 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "db7144b25ff34bed8c7b779ba9497ef4" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
W20250830 07:54:55.908574 13703 leader_election.cc:343] T db7144b25ff34bed8c7b779ba9497ef4 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:55.910435 15701 leader_election.cc:290] T db7144b25ff34bed8c7b779ba9497ef4 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
I20250830 07:54:55.924440 13232 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_2df1b7cb58c74ce588a64efe63e1c44e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:55.925072 13232 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2df1b7cb58c74ce588a64efe63e1c44e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:55.925412 13771 raft_consensus.cc:1273] T 087bb1e80d2d44bf8619b0341ff99527 P 9b057ade5dce45af9f8bf0bedf8b917f [term 2 FOLLOWER]: Refusing update from remote peer 6b5e454d98894637b466ea27f1b647f9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 1. (term mismatch)
I20250830 07:54:55.925472 13771 pending_rounds.cc:85] T 087bb1e80d2d44bf8619b0341ff99527 P 9b057ade5dce45af9f8bf0bedf8b917f: Aborting all ops after (but not including) 0
I20250830 07:54:55.925506 13771 pending_rounds.cc:107] T 087bb1e80d2d44bf8619b0341ff99527 P 9b057ade5dce45af9f8bf0bedf8b917f: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20250830 07:54:55.925542 13771 raft_consensus.cc:2887] T 087bb1e80d2d44bf8619b0341ff99527 P 9b057ade5dce45af9f8bf0bedf8b917f [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20250830 07:54:55.925899 13614 raft_consensus.cc:3058] T 95b6f084eb5240ea94c125eaa154ac9f P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:55.926388 13230 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_4c73315dcf504065a66df131136ca17a" } new_table_name: "default.Table_6ab6aa6405364082aef643efca661d75" modify_external_catalogs: true
I20250830 07:54:55.925686 13886 tablet_bootstrap.cc:492] T a0cf1de8485941eb8a557a6e2f783047 P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:54:55.927424 13886 ts_tablet_manager.cc:1397] T a0cf1de8485941eb8a557a6e2f783047 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.156s user 0.005s sys 0.006s
I20250830 07:54:55.927465 13486 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "3c3c798b2b7b460b98a30605464763e6" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:54:55.928045 13886 raft_consensus.cc:357] T a0cf1de8485941eb8a557a6e2f783047 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:55.928246 13886 raft_consensus.cc:383] T a0cf1de8485941eb8a557a6e2f783047 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:55.928304 13886 raft_consensus.cc:738] T a0cf1de8485941eb8a557a6e2f783047 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:54:55.928498 13886 consensus_queue.cc:260] T a0cf1de8485941eb8a557a6e2f783047 P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:55.929028 13886 ts_tablet_manager.cc:1428] T a0cf1de8485941eb8a557a6e2f783047 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
W20250830 07:54:55.931661 13226 catalog_manager.cc:5415] Ignoring report from unknown tablet 1fa571e9490e499792225d7b786e8658
W20250830 07:54:55.931878 13226 catalog_manager.cc:5415] Ignoring report from unknown tablet db7144b25ff34bed8c7b779ba9497ef4
I20250830 07:54:55.932523 13229 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_0b9112e1992b40798ff5fecfdb39fde4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250830 07:54:55.932699 13234 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_9df32d19b8ea4d578ade90b619a8f330"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:55.932984 13234 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9df32d19b8ea4d578ade90b619a8f330 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:55.932543 13227 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_4bf93f9b2cf540b791f0a9238c899a88"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:55.936910 13227 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4bf93f9b2cf540b791f0a9238c899a88 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:55.937711 13887 tablet_bootstrap.cc:492] T 1fee3e58f31b4befa42ffbb8d7bd6f4e P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:54:55.937845 13887 ts_tablet_manager.cc:1397] T 1fee3e58f31b4befa42ffbb8d7bd6f4e P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.221s user 0.008s sys 0.008s
I20250830 07:54:55.938393 13231 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_73a88c901a864dc68f6bb834b4f49236" } new_table_name: "default.Table_b286d12691394c22abaec261fa83844d" modify_external_catalogs: true
I20250830 07:54:55.938477 13887 raft_consensus.cc:357] T 1fee3e58f31b4befa42ffbb8d7bd6f4e P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:55.938613 13887 raft_consensus.cc:383] T 1fee3e58f31b4befa42ffbb8d7bd6f4e P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:55.938659 13887 raft_consensus.cc:738] T 1fee3e58f31b4befa42ffbb8d7bd6f4e P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:54:55.938804 13887 consensus_queue.cc:260] T 1fee3e58f31b4befa42ffbb8d7bd6f4e P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:55.939334 13887 ts_tablet_manager.cc:1428] T 1fee3e58f31b4befa42ffbb8d7bd6f4e P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
W20250830 07:54:55.932994 13229 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0b9112e1992b40798ff5fecfdb39fde4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:55.941576 14748 consensus_queue.cc:1035] T 087bb1e80d2d44bf8619b0341ff99527 P 6b5e454d98894637b466ea27f1b647f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:54:55.945353 13226 catalog_manager.cc:5582] T 410b1e2d520c470eb4b9ab60104e0cd4 P 9b057ade5dce45af9f8bf0bedf8b917f reported cstate change: term changed from 0 to 1, leader changed from <none> to 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2). New cstate: current_term: 1 leader_uuid: "6b5e454d98894637b466ea27f1b647f9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } }
I20250830 07:54:55.945634 13226 catalog_manager.cc:5674] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743) does not have the latest schema for tablet 410b1e2d520c470eb4b9ab60104e0cd4 (table default.Table_98c8314f6ad34324b9f857226d762d7d [id=6a8f7192d53441c383824fb67bed40df]). Expected version 1 got 0
I20250830 07:54:55.945925 13226 catalog_manager.cc:5674] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743) does not have the latest schema for tablet f5baa35307a1425c8d52666d130d6d8a (table default.Table_2f6c360f9bbc48e880665078710bf673 [id=6a35c4abd132478caba0152786455169]). Expected version 3 got 0
W20250830 07:54:55.926718 13701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.209.1:45325, user_credentials={real_user=slave}} blocked reactor thread for 44879us
I20250830 07:54:55.954751 13701 leader_election.cc:304] T 689b4fee1dd04b3d9ccdea334b0f6b59 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:54:55.955559 15601 raft_consensus.cc:2802] T 689b4fee1dd04b3d9ccdea334b0f6b59 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election won for term 1
I20250830 07:54:55.955893 15601 raft_consensus.cc:695] T 689b4fee1dd04b3d9ccdea334b0f6b59 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 LEADER]: Becoming Leader. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Running, Role: LEADER
I20250830 07:54:55.956287 15601 consensus_queue.cc:237] T 689b4fee1dd04b3d9ccdea334b0f6b59 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:55.967510 13886 tablet_bootstrap.cc:492] T 15f8fd7d9e6242c6b6c51251d618ef09 P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:54:55.969237 13886 tablet_bootstrap.cc:654] T 15f8fd7d9e6242c6b6c51251d618ef09 P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
W20250830 07:54:55.977715 13228 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet b294445c38544232b0ff7e730a9fcdce consensus state has no leader
I20250830 07:54:55.978063 13228 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_3b219c861a8640de9051a33019c20f29"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:55.978504 13228 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3b219c861a8640de9051a33019c20f29 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:55.980708 13232 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_e615ab9a87834e418ebf3407a8c1a207" } modify_external_catalogs: true
I20250830 07:54:55.980845 13232 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_e615ab9a87834e418ebf3407a8c1a207" } modify_external_catalogs: true
I20250830 07:54:55.982854 13225 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_0e0efb79fc16404bae9fc0544ef6aa04" } new_table_name: "default.Table_f88f668ca762440d8896c47135e154ba" modify_external_catalogs: true
I20250830 07:54:55.964143 13476 raft_consensus.cc:1273] T 087bb1e80d2d44bf8619b0341ff99527 P 2065c332f15a4739899af79f3669c3ba [term 2 FOLLOWER]: Refusing update from remote peer 6b5e454d98894637b466ea27f1b647f9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20250830 07:54:55.964469 13488 raft_consensus.cc:1273] T 43e93d3038f7496ebb18319420ab67e0 P 2065c332f15a4739899af79f3669c3ba [term 2 FOLLOWER]: Refusing update from remote peer 6b5e454d98894637b466ea27f1b647f9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20250830 07:54:55.987756 13882 tablet_bootstrap.cc:492] T 3bb48fce24074a8e8ec99d3172a655d8 P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:54:55.987905 13882 ts_tablet_manager.cc:1397] T 3bb48fce24074a8e8ec99d3172a655d8 P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.281s user 0.003s sys 0.024s
I20250830 07:54:55.992348 13882 raft_consensus.cc:357] T 3bb48fce24074a8e8ec99d3172a655d8 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:55.992581 13882 raft_consensus.cc:383] T 3bb48fce24074a8e8ec99d3172a655d8 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:55.992671 13882 raft_consensus.cc:738] T 3bb48fce24074a8e8ec99d3172a655d8 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:54:55.992910 13882 consensus_queue.cc:260] T 3bb48fce24074a8e8ec99d3172a655d8 P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:55.993512 13882 ts_tablet_manager.cc:1428] T 3bb48fce24074a8e8ec99d3172a655d8 P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20250830 07:54:55.993785 13882 tablet_bootstrap.cc:492] T 49165f0001044d72b68263a60ef56457 P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:54:55.995047 13882 tablet_bootstrap.cc:654] T 49165f0001044d72b68263a60ef56457 P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
W20250830 07:54:55.997395 13230 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 0f407e2121c84500a2b78131699b540d has no consensus state
I20250830 07:54:55.997710 13230 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_150ed68c3f1649b0b86fa3be5d799676" } new_table_name: "default.Table_72a17193f65e4e78a2ee269332a367a6" modify_external_catalogs: true
I20250830 07:54:56.002208 15365 raft_consensus.cc:491] T 852e353f6ee945628ddebdbdd1bd76fb P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:56.002399 15365 raft_consensus.cc:513] T 852e353f6ee945628ddebdbdd1bd76fb P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:56.000314 15711 tablet.cc:1722] T 14ed24577c8f49f49c83242a26877614 P 6b5e454d98894637b466ea27f1b647f9: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20250830 07:54:56.009500 15365 leader_election.cc:290] T 852e353f6ee945628ddebdbdd1bd76fb P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967)
I20250830 07:54:56.010120 13619 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "852e353f6ee945628ddebdbdd1bd76fb" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
W20250830 07:54:56.010623 13703 leader_election.cc:343] T 852e353f6ee945628ddebdbdd1bd76fb P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:56.011183 13476 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "db4077bf8e184ac5809ef629222f2cc5" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:54:56.011379 13476 raft_consensus.cc:2391] T db4077bf8e184ac5809ef629222f2cc5 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b5e454d98894637b466ea27f1b647f9 in current term 1: Already voted for candidate 9b057ade5dce45af9f8bf0bedf8b917f in this term.
I20250830 07:54:56.011760 13476 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "95b6f084eb5240ea94c125eaa154ac9f" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:54:56.012820 13234 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_224452e066d04d03b1d6a3549726bae9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:56.013275 13234 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_224452e066d04d03b1d6a3549726bae9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:56.019160 13887 tablet_bootstrap.cc:492] T 0ac39adafe144280b39f5c3fe5804087 P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
W20250830 07:54:56.022960 13220 catalog_manager.cc:4726] Async tablet task AlterTable RPC for tablet b294445c38544232b0ff7e730a9fcdce (table default.Table_1865f2739754463b97b55f37c4b0aaaa [id=58c4cfc99086408b9c208b84a73cc4d5], current schema version=2) failed: Not found: failed to reset TS proxy: No leader found: Tablet b294445c38544232b0ff7e730a9fcdce consensus state has no leader
I20250830 07:54:56.029148 15712 tablet.cc:1722] T 14ed24577c8f49f49c83242a26877614 P 9b057ade5dce45af9f8bf0bedf8b917f: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20250830 07:54:56.031729 13227 master_service.cc:948] ReplaceTablet: received request to replace tablet 752727eef0734ff3b7b35b1d5f66aea6 from {username='slave'} at 127.0.0.1:42126
I20250830 07:54:56.032085 13227 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_57d9ce41d0254969ae072b4c6936f7f2" } modify_external_catalogs: true
I20250830 07:54:56.032209 13227 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_57d9ce41d0254969ae072b4c6936f7f2" } modify_external_catalogs: true
I20250830 07:54:56.040112 15582 consensus_queue.cc:1035] T d206f6b6e7524a27a9f95787bcd5de77 P 6b5e454d98894637b466ea27f1b647f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20250830 07:54:56.040643 13701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.209.1:45325, user_credentials={real_user=slave}} blocked reactor thread for 82324.8us
W20250830 07:54:56.044967 13231 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 819888ceeb384766947a2fb60294ecbb has no consensus state
I20250830 07:54:56.047489 13561 leader_election.cc:304] T 3c3c798b2b7b460b98a30605464763e6 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b5e454d98894637b466ea27f1b647f9; no voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:54:56.047803 15580 raft_consensus.cc:2747] T 3c3c798b2b7b460b98a30605464763e6 P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:54:56.062306 13231 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_c7cb5b003eff4489bc9f763787a7f7d5" } modify_external_catalogs: true
I20250830 07:54:56.062548 13231 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_c7cb5b003eff4489bc9f763787a7f7d5" } modify_external_catalogs: true
I20250830 07:54:56.064469 13701 leader_election.cc:304] T 62bc8168176e4678a77827c5b7cc0f3e P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:54:56.065476 15365 raft_consensus.cc:2802] T 62bc8168176e4678a77827c5b7cc0f3e P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:54:56.065609 15365 raft_consensus.cc:491] T 62bc8168176e4678a77827c5b7cc0f3e P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:54:56.065724 15365 raft_consensus.cc:3058] T 62bc8168176e4678a77827c5b7cc0f3e P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:56.068714 15365 raft_consensus.cc:513] T 62bc8168176e4678a77827c5b7cc0f3e P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:56.069353 15365 leader_election.cc:290] T 62bc8168176e4678a77827c5b7cc0f3e P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Requested vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
I20250830 07:54:56.069739 13617 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "62bc8168176e4678a77827c5b7cc0f3e" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9"
W20250830 07:54:56.070209 13703 leader_election.cc:343] T 62bc8168176e4678a77827c5b7cc0f3e P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:56.070981 13229 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_eb6e62f793a74c34befadd2243d33718" } modify_external_catalogs: true
I20250830 07:54:56.071171 13229 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_eb6e62f793a74c34befadd2243d33718" } modify_external_catalogs: true
I20250830 07:54:56.072337 13882 tablet_bootstrap.cc:492] T 49165f0001044d72b68263a60ef56457 P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:54:56.078855 13882 ts_tablet_manager.cc:1397] T 49165f0001044d72b68263a60ef56457 P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.085s user 0.000s sys 0.004s
I20250830 07:54:56.077093 15582 raft_consensus.cc:491] T 924403105a6a40f28aad60647a2a8987 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:56.079818 13233 catalog_manager.cc:5674] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325) does not have the latest schema for tablet 410b1e2d520c470eb4b9ab60104e0cd4 (table default.Table_98c8314f6ad34324b9f857226d762d7d [id=6a8f7192d53441c383824fb67bed40df]). Expected version 1 got 0
I20250830 07:54:56.081589 13887 tablet_bootstrap.cc:654] T 0ac39adafe144280b39f5c3fe5804087 P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:56.081689 15582 raft_consensus.cc:513] T 924403105a6a40f28aad60647a2a8987 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:56.082929 15582 leader_election.cc:290] T 924403105a6a40f28aad60647a2a8987 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:56.083686 13775 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "924403105a6a40f28aad60647a2a8987" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:56.084604 15199 raft_consensus.cc:357] T 00000000000000000000000000000000 P 3ea183a890b84f408b20b55e9eb7c7ed [term 2 FOLLOWER]: Replica starting. Triggering 316 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fea6152429cc4e79a25b18e02aafae57" member_type: VOTER last_known_addr { host: "127.12.209.62" port: 39725 } } peers { permanent_uuid: "5e9d6449ae824acab24c459a72075e88" member_type: VOTER last_known_addr { host: "127.12.209.61" port: 44241 } } peers { permanent_uuid: "3ea183a890b84f408b20b55e9eb7c7ed" member_type: VOTER last_known_addr { host: "127.12.209.60" port: 43889 } }
I20250830 07:54:56.086752 13882 raft_consensus.cc:357] T 49165f0001044d72b68263a60ef56457 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:56.090261 13233 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_1617f2641ae145e0a110b39e243b7c19"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:56.090798 13233 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1617f2641ae145e0a110b39e243b7c19 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:56.094413 13701 leader_election.cc:304] T f66e1d07039841088a444ee0203a4eb0 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:54:56.096518 13701 leader_election.cc:304] T 52e910677ae34630a919d1d3f21b7e83 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:54:56.097072 13226 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_66d3622748cd4a58a4559b525344ab29" } modify_external_catalogs: true
I20250830 07:54:56.097229 13226 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_66d3622748cd4a58a4559b525344ab29" } modify_external_catalogs: true
I20250830 07:54:56.095784 13614 raft_consensus.cc:3058] T 3bb48fce24074a8e8ec99d3172a655d8 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:56.099148 15601 raft_consensus.cc:2802] T f66e1d07039841088a444ee0203a4eb0 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election won for term 1
I20250830 07:54:56.099407 15601 raft_consensus.cc:695] T f66e1d07039841088a444ee0203a4eb0 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 LEADER]: Becoming Leader. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Running, Role: LEADER
I20250830 07:54:56.099467 15720 raft_consensus.cc:491] T f32ebc2605c34a68aed50379f028052c P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:56.099664 15720 raft_consensus.cc:513] T f32ebc2605c34a68aed50379f028052c P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:56.100381 15720 leader_election.cc:290] T f32ebc2605c34a68aed50379f028052c P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
I20250830 07:54:56.100844 15601 consensus_queue.cc:237] T f66e1d07039841088a444ee0203a4eb0 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:56.101482 13617 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f32ebc2605c34a68aed50379f028052c" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
W20250830 07:54:56.101702 13228 catalog_manager.cc:5415] Ignoring report from unknown tablet d33a5d107c6849aca6eb48ffdf8a5463
W20250830 07:54:56.101788 13228 catalog_manager.cc:5415] Ignoring report from unknown tablet ef1ab62a5b7845e58d50f34206eaaa27
I20250830 07:54:56.102459 15582 raft_consensus.cc:491] T ec47a59c22ff4370bd21bc2a18336049 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:56.102640 15582 raft_consensus.cc:513] T ec47a59c22ff4370bd21bc2a18336049 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:56.102973 13228 catalog_manager.cc:5674] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325) does not have the latest schema for tablet 2c4c3c61cddf42668d3a09f4fbc5f641 (table default.Table_0130f2afc22a48e39d534d4fd584b1c2 [id=da55ca35442546899b18ebd8a52e8d0c]). Expected version 2 got 0
I20250830 07:54:56.103243 15582 leader_election.cc:290] T ec47a59c22ff4370bd21bc2a18336049 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
W20250830 07:54:56.104346 13703 leader_election.cc:343] T f32ebc2605c34a68aed50379f028052c P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
W20250830 07:54:56.104590 13703 consensus_peers.cc:489] T 91705fc35a1b4977b89bac1765c886c0 P 9b057ade5dce45af9f8bf0bedf8b917f -> Peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Couldn't send request to peer 6b5e454d98894637b466ea27f1b647f9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20250830 07:54:56.105635 13228 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_7c57b6d1af2d4775ace4ee9462ec792b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:56.106165 13228 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7c57b6d1af2d4775ace4ee9462ec792b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:56.108103 13775 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "ec47a59c22ff4370bd21bc2a18336049" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:56.110195 13882 raft_consensus.cc:383] T 49165f0001044d72b68263a60ef56457 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:56.110328 13882 raft_consensus.cc:738] T 49165f0001044d72b68263a60ef56457 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:54:56.110548 13882 consensus_queue.cc:260] T 49165f0001044d72b68263a60ef56457 P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:56.111434 13882 ts_tablet_manager.cc:1428] T 49165f0001044d72b68263a60ef56457 P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.025s user 0.002s sys 0.000s
W20250830 07:54:56.116210 13561 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.209.1:45325, user_credentials={real_user=slave}} blocked reactor thread for 64300.8us
I20250830 07:54:56.116442 15601 raft_consensus.cc:491] T f5baa35307a1425c8d52666d130d6d8a P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20250830 07:54:56.116605 13561 consensus_peers.cc:489] T d206f6b6e7524a27a9f95787bcd5de77 P 6b5e454d98894637b466ea27f1b647f9 -> Peer 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): Couldn't send request to peer 2065c332f15a4739899af79f3669c3ba. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d206f6b6e7524a27a9f95787bcd5de77. This is attempt 1: this message will repeat every 5th retry.
I20250830 07:54:56.116617 15601 raft_consensus.cc:513] T f5baa35307a1425c8d52666d130d6d8a P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:56.117357 13561 leader_election.cc:304] T db4077bf8e184ac5809ef629222f2cc5 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b5e454d98894637b466ea27f1b647f9; no voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:54:56.117514 15601 leader_election.cc:290] T f5baa35307a1425c8d52666d130d6d8a P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
I20250830 07:54:56.117717 13561 leader_election.cc:304] T 95b6f084eb5240ea94c125eaa154ac9f P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b5e454d98894637b466ea27f1b647f9; no voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:54:56.118068 15580 consensus_queue.cc:1035] T 087bb1e80d2d44bf8619b0341ff99527 P 6b5e454d98894637b466ea27f1b647f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:54:56.118382 15580 consensus_queue.cc:1035] T 43e93d3038f7496ebb18319420ab67e0 P 6b5e454d98894637b466ea27f1b647f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:54:56.118650 15580 raft_consensus.cc:3058] T db4077bf8e184ac5809ef629222f2cc5 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:56.119174 15601 raft_consensus.cc:2802] T 52e910677ae34630a919d1d3f21b7e83 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:54:56.119197 13232 catalog_manager.cc:5864] Not sending DeleteTablet requests; no consensus state for tablet 3fe51b0bda51437487a909a7ede120fa
I20250830 07:54:56.119246 15601 raft_consensus.cc:491] T 52e910677ae34630a919d1d3f21b7e83 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:54:56.119304 15601 raft_consensus.cc:3058] T 52e910677ae34630a919d1d3f21b7e83 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:56.121134 15580 raft_consensus.cc:2747] T db4077bf8e184ac5809ef629222f2cc5 P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:54:56.121490 14748 raft_consensus.cc:2747] T 95b6f084eb5240ea94c125eaa154ac9f P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:54:56.121739 15601 raft_consensus.cc:513] T 52e910677ae34630a919d1d3f21b7e83 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:56.127615 13887 tablet_bootstrap.cc:492] T 0ac39adafe144280b39f5c3fe5804087 P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:54:56.127794 13887 ts_tablet_manager.cc:1397] T 0ac39adafe144280b39f5c3fe5804087 P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.109s user 0.007s sys 0.002s
I20250830 07:54:56.128885 13887 raft_consensus.cc:357] T 0ac39adafe144280b39f5c3fe5804087 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:56.129184 13887 raft_consensus.cc:383] T 0ac39adafe144280b39f5c3fe5804087 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:56.129303 13887 raft_consensus.cc:738] T 0ac39adafe144280b39f5c3fe5804087 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:54:56.129531 13887 consensus_queue.cc:260] T 0ac39adafe144280b39f5c3fe5804087 P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:56.130324 13887 ts_tablet_manager.cc:1428] T 0ac39adafe144280b39f5c3fe5804087 P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20250830 07:54:56.130752 13887 tablet_bootstrap.cc:492] T bdeb89bbb3ad4e67bbc74b78454eeb7e P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:54:56.132170 15692 raft_consensus.cc:491] T d1153d8cd2994377ac0dcbfeeda1fd52 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:56.132424 13887 tablet_bootstrap.cc:654] T bdeb89bbb3ad4e67bbc74b78454eeb7e P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:56.132334 15692 raft_consensus.cc:513] T d1153d8cd2994377ac0dcbfeeda1fd52 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:56.132884 15692 leader_election.cc:290] T d1153d8cd2994377ac0dcbfeeda1fd52 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:56.133874 13617 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "d1153d8cd2994377ac0dcbfeeda1fd52" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:56.134042 13617 raft_consensus.cc:2466] T d1153d8cd2994377ac0dcbfeeda1fd52 P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2065c332f15a4739899af79f3669c3ba in term 1.
I20250830 07:54:56.134413 13423 leader_election.cc:304] T d1153d8cd2994377ac0dcbfeeda1fd52 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 6b5e454d98894637b466ea27f1b647f9; no voters:
I20250830 07:54:56.134402 13614 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f5baa35307a1425c8d52666d130d6d8a" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:56.134760 15692 raft_consensus.cc:2802] T d1153d8cd2994377ac0dcbfeeda1fd52 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader pre-election won for term 2
I20250830 07:54:56.134833 15692 raft_consensus.cc:491] T d1153d8cd2994377ac0dcbfeeda1fd52 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:54:56.134902 15692 raft_consensus.cc:3058] T d1153d8cd2994377ac0dcbfeeda1fd52 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Advancing to term 2
I20250830 07:54:56.136686 15580 raft_consensus.cc:491] T 10ec97b8a82145479e0bb526c4cc7c05 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:56.136785 15580 raft_consensus.cc:513] T 10ec97b8a82145479e0bb526c4cc7c05 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:56.137213 15580 leader_election.cc:290] T 10ec97b8a82145479e0bb526c4cc7c05 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:56.138043 13477 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "10ec97b8a82145479e0bb526c4cc7c05" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:54:56.138211 13477 raft_consensus.cc:2391] T 10ec97b8a82145479e0bb526c4cc7c05 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b5e454d98894637b466ea27f1b647f9 in current term 1: Already voted for candidate 9b057ade5dce45af9f8bf0bedf8b917f in this term.
I20250830 07:54:56.140425 13481 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "ec47a59c22ff4370bd21bc2a18336049" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:54:56.140606 13481 raft_consensus.cc:2391] T ec47a59c22ff4370bd21bc2a18336049 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b5e454d98894637b466ea27f1b647f9 in current term 1: Already voted for candidate 9b057ade5dce45af9f8bf0bedf8b917f in this term.
I20250830 07:54:56.142153 15692 raft_consensus.cc:513] T d1153d8cd2994377ac0dcbfeeda1fd52 P 2065c332f15a4739899af79f3669c3ba [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:56.143092 15692 leader_election.cc:290] T d1153d8cd2994377ac0dcbfeeda1fd52 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 2 election: Requested vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:56.145774 13614 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "d1153d8cd2994377ac0dcbfeeda1fd52" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9"
I20250830 07:54:56.145921 13614 raft_consensus.cc:3058] T d1153d8cd2994377ac0dcbfeeda1fd52 P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Advancing to term 2
I20250830 07:54:56.147621 13476 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "924403105a6a40f28aad60647a2a8987" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:54:56.148393 13614 raft_consensus.cc:2466] T d1153d8cd2994377ac0dcbfeeda1fd52 P 6b5e454d98894637b466ea27f1b647f9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2065c332f15a4739899af79f3669c3ba in term 2.
I20250830 07:54:56.148912 13423 leader_election.cc:304] T d1153d8cd2994377ac0dcbfeeda1fd52 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 6b5e454d98894637b466ea27f1b647f9; no voters:
I20250830 07:54:56.149173 15692 raft_consensus.cc:2802] T d1153d8cd2994377ac0dcbfeeda1fd52 P 2065c332f15a4739899af79f3669c3ba [term 2 FOLLOWER]: Leader election won for term 2
I20250830 07:54:56.149319 15692 raft_consensus.cc:695] T d1153d8cd2994377ac0dcbfeeda1fd52 P 2065c332f15a4739899af79f3669c3ba [term 2 LEADER]: Becoming Leader. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Running, Role: LEADER
I20250830 07:54:56.149827 15692 consensus_queue.cc:237] T d1153d8cd2994377ac0dcbfeeda1fd52 P 2065c332f15a4739899af79f3669c3ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
W20250830 07:54:56.151448 13232 catalog_manager.cc:5415] Ignoring report from unknown tablet b4ab964a64a64e00a78ffd2b220aef46
I20250830 07:54:56.151780 13232 catalog_manager.cc:5674] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325) does not have the latest schema for tablet 410b1e2d520c470eb4b9ab60104e0cd4 (table default.Table_98c8314f6ad34324b9f857226d762d7d [id=6a8f7192d53441c383824fb67bed40df]). Expected version 1 got 0
I20250830 07:54:56.115752 13882 tablet_bootstrap.cc:492] T 88bbd6b4c795433d9b6ad746353f3aa1 P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:54:56.153700 15601 leader_election.cc:290] T 52e910677ae34630a919d1d3f21b7e83 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Requested vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
I20250830 07:54:56.154587 13882 tablet_bootstrap.cc:654] T 88bbd6b4c795433d9b6ad746353f3aa1 P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
W20250830 07:54:56.157686 13232 catalog_manager.cc:5415] Ignoring report from unknown tablet d206f6b6e7524a27a9f95787bcd5de77
I20250830 07:54:56.122220 13886 tablet_bootstrap.cc:492] T 15f8fd7d9e6242c6b6c51251d618ef09 P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:54:56.157946 13886 ts_tablet_manager.cc:1397] T 15f8fd7d9e6242c6b6c51251d618ef09 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.191s user 0.001s sys 0.002s
I20250830 07:54:56.158830 13886 raft_consensus.cc:357] T 15f8fd7d9e6242c6b6c51251d618ef09 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:56.159130 13886 raft_consensus.cc:383] T 15f8fd7d9e6242c6b6c51251d618ef09 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:56.159264 13886 raft_consensus.cc:738] T 15f8fd7d9e6242c6b6c51251d618ef09 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:54:56.159556 13886 consensus_queue.cc:260] T 15f8fd7d9e6242c6b6c51251d618ef09 P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:56.160486 13886 ts_tablet_manager.cc:1428] T 15f8fd7d9e6242c6b6c51251d618ef09 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20250830 07:54:56.160845 13886 tablet_bootstrap.cc:492] T 240a6bfad8fa478598a67a27c2dedf62 P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:54:56.161093 13561 leader_election.cc:304] T ec47a59c22ff4370bd21bc2a18336049 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b5e454d98894637b466ea27f1b647f9; no voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:54:56.161365 15580 raft_consensus.cc:3058] T ec47a59c22ff4370bd21bc2a18336049 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:56.163941 15580 raft_consensus.cc:2747] T ec47a59c22ff4370bd21bc2a18336049 P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:54:56.165212 15742 tablet.cc:1722] T 14ed24577c8f49f49c83242a26877614 P 2065c332f15a4739899af79f3669c3ba: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20250830 07:54:56.167214 13561 leader_election.cc:304] T 924403105a6a40f28aad60647a2a8987 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b5e454d98894637b466ea27f1b647f9; no voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:54:56.167441 15580 raft_consensus.cc:2747] T 924403105a6a40f28aad60647a2a8987 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:54:56.168390 13886 tablet_bootstrap.cc:654] T 240a6bfad8fa478598a67a27c2dedf62 P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:56.122352 13701 leader_election.cc:304] T 8cce7e5537794e9484f5a7c82b9e6e1d P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:54:56.139329 13765 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "10ec97b8a82145479e0bb526c4cc7c05" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
W20250830 07:54:56.139602 13703 leader_election.cc:343] T f5baa35307a1425c8d52666d130d6d8a P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:56.169350 15601 raft_consensus.cc:2802] T 8cce7e5537794e9484f5a7c82b9e6e1d P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:54:56.147341 15608 raft_consensus.cc:491] T c8bc6e07377a4ba99c39a909dae11402 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:56.169441 15601 raft_consensus.cc:491] T 8cce7e5537794e9484f5a7c82b9e6e1d P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:54:56.169509 15601 raft_consensus.cc:3058] T 8cce7e5537794e9484f5a7c82b9e6e1d P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:56.169543 15608 raft_consensus.cc:513] T c8bc6e07377a4ba99c39a909dae11402 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
W20250830 07:54:56.169996 13701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.209.1:45325, user_credentials={real_user=slave}} blocked reactor thread for 47658.7us
I20250830 07:54:56.170181 13701 leader_election.cc:304] T 23d2c7013c9c4b4aacf47e6ac7ab5a0b P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:54:56.170465 15608 leader_election.cc:290] T c8bc6e07377a4ba99c39a909dae11402 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967)
I20250830 07:54:56.170503 13701 leader_election.cc:304] T 796e01f6a36241fc94e335253929d6ab P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:54:56.170694 15720 raft_consensus.cc:2802] T 796e01f6a36241fc94e335253929d6ab P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:54:56.170768 15720 raft_consensus.cc:491] T 796e01f6a36241fc94e335253929d6ab P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:54:56.170828 15720 raft_consensus.cc:3058] T 796e01f6a36241fc94e335253929d6ab P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:56.170783 13617 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "52e910677ae34630a919d1d3f21b7e83" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9"
I20250830 07:54:56.171393 13562 leader_election.cc:304] T 10ec97b8a82145479e0bb526c4cc7c05 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b5e454d98894637b466ea27f1b647f9; no voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:54:56.171613 15706 raft_consensus.cc:3058] T 10ec97b8a82145479e0bb526c4cc7c05 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:56.171600 15608 raft_consensus.cc:2802] T 23d2c7013c9c4b4aacf47e6ac7ab5a0b P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election won for term 1
W20250830 07:54:56.171633 13422 leader_election.cc:343] T c56e3a30c18640e68c8b0c4ff4251d96 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:56.171738 15608 raft_consensus.cc:695] T 23d2c7013c9c4b4aacf47e6ac7ab5a0b P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 LEADER]: Becoming Leader. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Running, Role: LEADER
I20250830 07:54:56.171746 13422 leader_election.cc:304] T c56e3a30c18640e68c8b0c4ff4251d96 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba; no voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:54:56.171941 15608 consensus_queue.cc:237] T 23d2c7013c9c4b4aacf47e6ac7ab5a0b P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:56.172886 13480 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "76ab56c469cf4675a4e21acbe0a8085d" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:54:56.173048 13480 raft_consensus.cc:2466] T 76ab56c469cf4675a4e21acbe0a8085d P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 0.
I20250830 07:54:56.173799 15706 raft_consensus.cc:2747] T 10ec97b8a82145479e0bb526c4cc7c05 P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:54:56.173056 15691 raft_consensus.cc:2747] T c56e3a30c18640e68c8b0c4ff4251d96 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20250830 07:54:56.175616 13703 leader_election.cc:343] T 52e910677ae34630a919d1d3f21b7e83 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:56.176041 13619 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "c8bc6e07377a4ba99c39a909dae11402" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
W20250830 07:54:56.176420 13703 leader_election.cc:343] T c8bc6e07377a4ba99c39a909dae11402 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:56.176704 13617 raft_consensus.cc:3058] T 7c5e50cb605c4a40b47984f328eedd93 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:56.186033 15720 raft_consensus.cc:513] T 796e01f6a36241fc94e335253929d6ab P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:56.186300 15601 raft_consensus.cc:513] T 8cce7e5537794e9484f5a7c82b9e6e1d P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:56.186398 13487 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "ee44ab24333742909f773889ad5c3e00" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:54:56.186532 13487 raft_consensus.cc:2466] T ee44ab24333742909f773889ad5c3e00 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 0.
I20250830 07:54:56.186590 15720 leader_election.cc:290] T 796e01f6a36241fc94e335253929d6ab P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Requested vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
I20250830 07:54:56.186807 15601 leader_election.cc:290] T 8cce7e5537794e9484f5a7c82b9e6e1d P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Requested vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967)
I20250830 07:54:56.188086 13476 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "1cf23cf78eee46be953bd701aa6bef07" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:54:56.188339 13476 raft_consensus.cc:2466] T 1cf23cf78eee46be953bd701aa6bef07 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 0.
I20250830 07:54:56.188455 13475 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "97d49a1f600f4c13a4aafca99cedabe8" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba"
I20250830 07:54:56.188513 13619 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "8cce7e5537794e9484f5a7c82b9e6e1d" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9"
I20250830 07:54:56.188547 13614 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "796e01f6a36241fc94e335253929d6ab" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9"
I20250830 07:54:56.188650 13475 raft_consensus.cc:3058] T 97d49a1f600f4c13a4aafca99cedabe8 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
W20250830 07:54:56.189024 13703 leader_election.cc:343] T 8cce7e5537794e9484f5a7c82b9e6e1d P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:56.189327 13887 tablet_bootstrap.cc:492] T bdeb89bbb3ad4e67bbc74b78454eeb7e P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
W20250830 07:54:56.189389 13703 leader_election.cc:343] T 796e01f6a36241fc94e335253929d6ab P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:56.189443 13887 ts_tablet_manager.cc:1397] T bdeb89bbb3ad4e67bbc74b78454eeb7e P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.059s user 0.002s sys 0.000s
I20250830 07:54:56.190233 13887 raft_consensus.cc:357] T bdeb89bbb3ad4e67bbc74b78454eeb7e P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:56.190407 13887 raft_consensus.cc:383] T bdeb89bbb3ad4e67bbc74b78454eeb7e P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:56.190461 13887 raft_consensus.cc:738] T bdeb89bbb3ad4e67bbc74b78454eeb7e P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:54:56.192728 13475 raft_consensus.cc:2466] T 97d49a1f600f4c13a4aafca99cedabe8 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 1.
I20250830 07:54:56.202586 13477 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "db7144b25ff34bed8c7b779ba9497ef4" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:54:56.204408 15601 raft_consensus.cc:491] T a8660a6ff9254d4f9f0ef047b8682ed1 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:56.204488 13882 tablet_bootstrap.cc:492] T 88bbd6b4c795433d9b6ad746353f3aa1 P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:54:56.204524 15601 raft_consensus.cc:513] T a8660a6ff9254d4f9f0ef047b8682ed1 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:56.204596 13882 ts_tablet_manager.cc:1397] T 88bbd6b4c795433d9b6ad746353f3aa1 P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.093s user 0.003s sys 0.001s
I20250830 07:54:56.205313 15601 leader_election.cc:290] T a8660a6ff9254d4f9f0ef047b8682ed1 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
I20250830 07:54:56.205358 15365 raft_consensus.cc:491] T 1520d7257f864ea4ba4b9a5d0443f8a7 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:56.205484 15365 raft_consensus.cc:513] T 1520d7257f864ea4ba4b9a5d0443f8a7 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
W20250830 07:54:56.206463 13232 catalog_manager.cc:5415] Ignoring report from unknown tablet b83dfc54383d4e7b96523568aea5c9f3
W20250830 07:54:56.206588 13232 catalog_manager.cc:5415] Ignoring report from unknown tablet 70703eb1d47841a1a227e277ed6a268d
W20250830 07:54:56.206665 13232 catalog_manager.cc:5415] Ignoring report from unknown tablet 042fd7ff08fc4695b87bb8f9d225ef12
W20250830 07:54:56.206797 13232 catalog_manager.cc:5415] Ignoring report from unknown tablet 74f2fcc22fd545fb8ca7c20619843023
W20250830 07:54:56.206910 13232 catalog_manager.cc:5415] Ignoring report from unknown tablet 5235e1a32f044f0cbf882e338c482003
W20250830 07:54:56.207068 13232 catalog_manager.cc:5415] Ignoring report from unknown tablet d37fe59b4f964f30bb1ed4cb00868b75
I20250830 07:54:56.207127 15365 leader_election.cc:290] T 1520d7257f864ea4ba4b9a5d0443f8a7 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967)
W20250830 07:54:56.207183 13232 catalog_manager.cc:5415] Ignoring report from unknown tablet 8ae468b43b4c450ca7591b543c2539d9
W20250830 07:54:56.207263 13232 catalog_manager.cc:5415] Ignoring report from unknown tablet da5c7b084e1f4fda92fff35a9cb2c7fc
I20250830 07:54:56.205572 15720 raft_consensus.cc:491] T 7aed56dba39e40518e9c3325bcccd74a P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20250830 07:54:56.207348 13232 catalog_manager.cc:5415] Ignoring report from unknown tablet de3a52a8e08a45808373902a0185e6f0
W20250830 07:54:56.207381 13232 catalog_manager.cc:5415] Ignoring report from unknown tablet 28c2f7a3a6dd444585f0f5d337b985e9
W20250830 07:54:56.207406 13232 catalog_manager.cc:5415] Ignoring report from unknown tablet 95b6f084eb5240ea94c125eaa154ac9f
I20250830 07:54:56.207340 15720 raft_consensus.cc:513] T 7aed56dba39e40518e9c3325bcccd74a P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
W20250830 07:54:56.207429 13232 catalog_manager.cc:5415] Ignoring report from unknown tablet 7c5e50cb605c4a40b47984f328eedd93
W20250830 07:54:56.207492 13232 catalog_manager.cc:5415] Ignoring report from unknown tablet e6060a3dc6444483b8fb2944b8090cb6
W20250830 07:54:56.207522 13232 catalog_manager.cc:5415] Ignoring report from unknown tablet 88bbd6b4c795433d9b6ad746353f3aa1
W20250830 07:54:56.207547 13232 catalog_manager.cc:5415] Ignoring report from unknown tablet 689b4fee1dd04b3d9ccdea334b0f6b59
W20250830 07:54:56.207638 13232 catalog_manager.cc:5415] Ignoring report from unknown tablet e6b7646588fe4134b2db62ff84ca4791
W20250830 07:54:56.207674 13232 catalog_manager.cc:5415] Ignoring report from unknown tablet a8baad9c419e436b9659d8d5582d4066
W20250830 07:54:56.207719 13232 catalog_manager.cc:5415] Ignoring report from unknown tablet 0208de98277c4d6889fb0289b6013ae1
I20250830 07:54:56.207711 15720 leader_election.cc:290] T 7aed56dba39e40518e9c3325bcccd74a P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
W20250830 07:54:56.207753 13232 catalog_manager.cc:5415] Ignoring report from unknown tablet 43e93d3038f7496ebb18319420ab67e0
W20250830 07:54:56.207834 13232 catalog_manager.cc:5415] Ignoring report from unknown tablet f398e12cd9f543738d5163354f8a9d9d
W20250830 07:54:56.207939 13232 catalog_manager.cc:5415] Ignoring report from unknown tablet ca959e42c8764eeba0faee96caf8b39f
W20250830 07:54:56.208016 13232 catalog_manager.cc:5415] Ignoring report from unknown tablet 04eadf45b82e4c319eb7b316a402d81a
W20250830 07:54:56.208061 13232 catalog_manager.cc:5415] Ignoring report from unknown tablet db4077bf8e184ac5809ef629222f2cc5
W20250830 07:54:56.208103 13232 catalog_manager.cc:5415] Ignoring report from unknown tablet ef1ab62a5b7845e58d50f34206eaaa27
W20250830 07:54:56.208139 13232 catalog_manager.cc:5415] Ignoring report from unknown tablet ec47a59c22ff4370bd21bc2a18336049
I20250830 07:54:56.209264 13882 raft_consensus.cc:357] T 88bbd6b4c795433d9b6ad746353f3aa1 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:56.209487 13882 raft_consensus.cc:383] T 88bbd6b4c795433d9b6ad746353f3aa1 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:56.209583 13882 raft_consensus.cc:738] T 88bbd6b4c795433d9b6ad746353f3aa1 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:54:56.209862 13882 consensus_queue.cc:260] T 88bbd6b4c795433d9b6ad746353f3aa1 P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:56.210623 13882 ts_tablet_manager.cc:1428] T 88bbd6b4c795433d9b6ad746353f3aa1 P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.006s user 0.001s sys 0.001s
I20250830 07:54:56.211153 13882 tablet_bootstrap.cc:492] T 23d2c7013c9c4b4aacf47e6ac7ab5a0b P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:54:56.211284 13232 catalog_manager.cc:5674] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743) does not have the latest schema for tablet 0ceccc5f18294356894695fe08d73e30 (table default.Table_32d032fe8fba47348e797c68bb7ea866 [id=0e99ba575a7a4f8dae74a98627249018]). Expected version 1 got 0
W20250830 07:54:56.211522 13129 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerService.ListTablets -> {remote=127.12.209.2:38967, user_credentials={real_user=slave}} blocked reactor thread for 87038.8us
I20250830 07:54:56.205753 13481 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "852e353f6ee945628ddebdbdd1bd76fb" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:54:56.211993 13481 raft_consensus.cc:2466] T 852e353f6ee945628ddebdbdd1bd76fb P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 0.
I20250830 07:54:56.208164 13487 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "62bc8168176e4678a77827c5b7cc0f3e" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba"
I20250830 07:54:56.212263 13487 raft_consensus.cc:3058] T 62bc8168176e4678a77827c5b7cc0f3e P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:56.213337 13882 tablet_bootstrap.cc:654] T 23d2c7013c9c4b4aacf47e6ac7ab5a0b P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:56.214243 13611 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "a8660a6ff9254d4f9f0ef047b8682ed1" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:56.208794 13480 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f32ebc2605c34a68aed50379f028052c" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:54:56.215003 13480 raft_consensus.cc:2466] T f32ebc2605c34a68aed50379f028052c P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 0.
I20250830 07:54:56.214886 13487 raft_consensus.cc:2466] T 62bc8168176e4678a77827c5b7cc0f3e P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 1.
I20250830 07:54:56.209354 13476 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f5baa35307a1425c8d52666d130d6d8a" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:54:56.215430 13611 raft_consensus.cc:3058] T da5c7b084e1f4fda92fff35a9cb2c7fc P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:56.215546 13476 raft_consensus.cc:2466] T f5baa35307a1425c8d52666d130d6d8a P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 0.
I20250830 07:54:56.215742 13477 raft_consensus.cc:2466] T db7144b25ff34bed8c7b779ba9497ef4 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 0.
I20250830 07:54:56.209549 13887 consensus_queue.cc:260] T bdeb89bbb3ad4e67bbc74b78454eeb7e P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:56.210460 13486 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "52e910677ae34630a919d1d3f21b7e83" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba"
I20250830 07:54:56.216022 13486 raft_consensus.cc:3058] T 52e910677ae34630a919d1d3f21b7e83 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:56.216323 13887 ts_tablet_manager.cc:1428] T bdeb89bbb3ad4e67bbc74b78454eeb7e P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.027s user 0.002s sys 0.000s
I20250830 07:54:56.218412 13486 raft_consensus.cc:2466] T 52e910677ae34630a919d1d3f21b7e83 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 1.
I20250830 07:54:56.210865 13488 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "c8bc6e07377a4ba99c39a909dae11402" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:54:56.218619 13488 raft_consensus.cc:2466] T c8bc6e07377a4ba99c39a909dae11402 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 0.
I20250830 07:54:56.223670 13619 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "7aed56dba39e40518e9c3325bcccd74a" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:56.224049 13887 tablet_bootstrap.cc:492] T 439fc51afa6b435e81bc38b9e88d4041 P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:54:56.224220 13617 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "1520d7257f864ea4ba4b9a5d0443f8a7" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:56.225296 13886 tablet_bootstrap.cc:492] T 240a6bfad8fa478598a67a27c2dedf62 P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:54:56.225481 13886 ts_tablet_manager.cc:1397] T 240a6bfad8fa478598a67a27c2dedf62 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.065s user 0.002s sys 0.000s
I20250830 07:54:56.226112 13887 tablet_bootstrap.cc:654] T 439fc51afa6b435e81bc38b9e88d4041 P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:56.226154 13886 raft_consensus.cc:357] T 240a6bfad8fa478598a67a27c2dedf62 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:56.226594 13886 raft_consensus.cc:383] T 240a6bfad8fa478598a67a27c2dedf62 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:56.226693 13886 raft_consensus.cc:738] T 240a6bfad8fa478598a67a27c2dedf62 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:54:56.226933 13886 consensus_queue.cc:260] T 240a6bfad8fa478598a67a27c2dedf62 P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:56.227540 13886 ts_tablet_manager.cc:1428] T 240a6bfad8fa478598a67a27c2dedf62 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20250830 07:54:56.229096 15748 raft_consensus.cc:491] T 6ccbaf109e36453ea6645dfd090f5a1a P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:56.229221 15748 raft_consensus.cc:513] T 6ccbaf109e36453ea6645dfd090f5a1a P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:56.229787 15748 leader_election.cc:290] T 6ccbaf109e36453ea6645dfd090f5a1a P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
I20250830 07:54:56.232019 13764 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "e74a3e4b3b234c41aca30f772525652e" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:56.232476 13764 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "8c01157324ba45bda5b3a9a328bf319b" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:56.233984 13774 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "ed364f03bdad42b88e181b7d0e1e4011" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:56.234136 13764 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "a8660a6ff9254d4f9f0ef047b8682ed1" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:56.234289 13764 raft_consensus.cc:2466] T a8660a6ff9254d4f9f0ef047b8682ed1 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2065c332f15a4739899af79f3669c3ba in term 0.
I20250830 07:54:56.234364 13886 tablet_bootstrap.cc:492] T 2b4103f07e96490488913059a95af0c3 P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:54:56.235031 13766 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "1db4109dc43b489d89c5de9eeb64a771" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:56.235276 13765 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "7aed56dba39e40518e9c3325bcccd74a" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:56.235410 13765 raft_consensus.cc:2466] T 7aed56dba39e40518e9c3325bcccd74a P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2065c332f15a4739899af79f3669c3ba in term 0.
I20250830 07:54:56.235527 13764 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "6ccbaf109e36453ea6645dfd090f5a1a" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:56.235677 13764 raft_consensus.cc:2466] T 6ccbaf109e36453ea6645dfd090f5a1a P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2065c332f15a4739899af79f3669c3ba in term 0.
I20250830 07:54:56.239831 13886 tablet_bootstrap.cc:654] T 2b4103f07e96490488913059a95af0c3 P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
W20250830 07:54:56.241191 13703 leader_election.cc:343] T a8660a6ff9254d4f9f0ef047b8682ed1 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:56.246075 13610 raft_consensus.cc:3058] T 713c12e1efec4e6f9895c65dc8a9c4b9 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:56.246717 13619 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "6ccbaf109e36453ea6645dfd090f5a1a" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
W20250830 07:54:56.246767 13703 leader_election.cc:343] T 7aed56dba39e40518e9c3325bcccd74a P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
W20250830 07:54:56.247491 13703 leader_election.cc:343] T 1520d7257f864ea4ba4b9a5d0443f8a7 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
W20250830 07:54:56.240257 13225 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet e2e92957ca6b498c9fd76a97225492d5 has no consensus state
I20250830 07:54:56.250123 13232 catalog_manager.cc:5674] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743) does not have the latest schema for tablet ff72a0fd9a0e46a6bd54a15e4ad783b4 (table default.Table_85e7f0b13c094fd7841dcabce61fd911 [id=de7b214458f247ef831f43727543afc5]). Expected version 1 got 0
I20250830 07:54:56.250344 13225 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_3b532afd77de4511896c012c2ac35fd0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250830 07:54:56.250454 13232 catalog_manager.cc:5674] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743) does not have the latest schema for tablet 91705fc35a1b4977b89bac1765c886c0 (table default.Table_4f53e333521540848fc99c0bf37c1639 [id=48089766c3514336991a5ada71b03dd0]). Expected version 1 got 0
I20250830 07:54:56.250619 13232 catalog_manager.cc:5674] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743) does not have the latest schema for tablet 924403105a6a40f28aad60647a2a8987 (table default.Table_f62c15a884574e3ebe9ce39aa18d1e00 [id=46ec9117fe9146cb807dd092284616fc]). Expected version 2 got 0
W20250830 07:54:56.250813 13225 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3b532afd77de4511896c012c2ac35fd0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250830 07:54:56.240691 13230 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 6623ea933c0a4f64a91dcd3d4c3483c9 has no consensus state
I20250830 07:54:56.252168 13230 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_49f6fee6df5f48f782916427f02eb72d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:56.252586 13230 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_49f6fee6df5f48f782916427f02eb72d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:56.241501 13234 master_service.cc:948] ReplaceTablet: received request to replace tablet 8d685e1a2d474463b9f98282fd4d2090 from {username='slave'} at 127.0.0.1:42126
I20250830 07:54:56.242098 13229 catalog_manager.cc:5864] Not sending DeleteTablet requests; no consensus state for tablet 6693b1d70b5b4e53a6591d40e8e1cd51
I20250830 07:54:56.255086 13229 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_a1408cb2875640438258e1ee153b6b3a" } new_table_name: "default.Table_42d7b604234d474794281395f5afa4a5" modify_external_catalogs: true
I20250830 07:54:56.243108 13226 catalog_manager.cc:5864] Not sending DeleteTablet requests; no consensus state for tablet 9f75ae59439a4994ac260901ca5f95c6
I20250830 07:54:56.256736 13226 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_7e1aa3ed101845e5931c80bba38a4d44" } new_table_name: "default.Table_012d82c539bf4e94b6008b19143a2790" modify_external_catalogs: true
I20250830 07:54:56.245409 13227 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet ada52626bbc94105a8b9428b0bbdfb5e
W20250830 07:54:56.262483 13227 catalog_manager.cc:5415] Ignoring report from unknown tablet d1153d8cd2994377ac0dcbfeeda1fd52
W20250830 07:54:56.262553 13227 catalog_manager.cc:5415] Ignoring report from unknown tablet 43e93d3038f7496ebb18319420ab67e0
I20250830 07:54:56.245576 13231 catalog_manager.cc:5864] Not sending DeleteTablet requests; no consensus state for tablet c2dcae39ce0c4890872ebebef2e1054f
I20250830 07:54:56.263592 13593 tablet_service.cc:1515] Processing DeleteTablet for tablet ada52626bbc94105a8b9428b0bbdfb5e with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:56 UTC) from {username='slave'} at 127.0.0.1:45306
I20250830 07:54:56.246018 13233 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_ee1e9bdb403d4dcea41808a0c0bd7923"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:56.264333 13233 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ee1e9bdb403d4dcea41808a0c0bd7923 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:56.265362 15687 raft_consensus.cc:491] T 5e2da5434e95445aa4deafce7fde0c6c P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:56.265483 15687 raft_consensus.cc:513] T 5e2da5434e95445aa4deafce7fde0c6c P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:56.265996 15687 leader_election.cc:290] T 5e2da5434e95445aa4deafce7fde0c6c P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:56.268307 13764 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "d1153d8cd2994377ac0dcbfeeda1fd52" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:56.268486 13764 raft_consensus.cc:2466] T d1153d8cd2994377ac0dcbfeeda1fd52 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2065c332f15a4739899af79f3669c3ba in term 1.
I20250830 07:54:56.269834 13764 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "d1153d8cd2994377ac0dcbfeeda1fd52" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f"
I20250830 07:54:56.269995 13764 raft_consensus.cc:3058] T d1153d8cd2994377ac0dcbfeeda1fd52 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Advancing to term 2
I20250830 07:54:56.272861 13764 raft_consensus.cc:2466] T d1153d8cd2994377ac0dcbfeeda1fd52 P 9b057ade5dce45af9f8bf0bedf8b917f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2065c332f15a4739899af79f3669c3ba in term 2.
I20250830 07:54:56.274788 13231 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_b54e1d73d27c446eb5f406b5ce0a2a31"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:56.275317 13231 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b54e1d73d27c446eb5f406b5ce0a2a31 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:56.276082 13228 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_2c3d98e1b934440cb04c8887c22cdb2b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:56.276482 13228 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2c3d98e1b934440cb04c8887c22cdb2b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:56.278046 13234 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet 8d685e1a2d474463b9f98282fd4d2090
I20250830 07:54:56.278463 13234 catalog_manager.cc:6652] ReplaceTablet: tablet 8d685e1a2d474463b9f98282fd4d2090 deleted and replaced by tablet 564f4df511d14789a66dfcd0e4f62d4a
I20250830 07:54:56.279589 13602 tablet_service.cc:1515] Processing DeleteTablet for tablet 8d685e1a2d474463b9f98282fd4d2090 with delete_type TABLET_DATA_DELETED (replaced by tablet 564f4df511d14789a66dfcd0e4f62d4a) from {username='slave'} at 127.0.0.1:45306
I20250830 07:54:56.280153 13234 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_8c3ddc82e5b542269bfdd5f828bed3a7" } new_table_name: "default.Table_5268dd29691148cdbf79051a81cdc3de" modify_external_catalogs: true
I20250830 07:54:56.280212 13230 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_8cb79840e8bb4120a4d0d23480217a08"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:56.280579 13230 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8cb79840e8bb4120a4d0d23480217a08 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:56.283210 13767 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "5e2da5434e95445aa4deafce7fde0c6c" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:56.283730 13488 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "796e01f6a36241fc94e335253929d6ab" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba"
I20250830 07:54:56.283941 13488 raft_consensus.cc:3058] T 796e01f6a36241fc94e335253929d6ab P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
W20250830 07:54:56.284934 13703 leader_election.cc:343] T 6ccbaf109e36453ea6645dfd090f5a1a P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:56.286114 15500 consensus_queue.cc:1035] T 713c12e1efec4e6f9895c65dc8a9c4b9 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:54:56.286298 15608 consensus_queue.cc:1035] T db4077bf8e184ac5809ef629222f2cc5 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:54:56.290880 13486 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "8cce7e5537794e9484f5a7c82b9e6e1d" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba"
I20250830 07:54:56.291069 13486 raft_consensus.cc:3058] T 8cce7e5537794e9484f5a7c82b9e6e1d P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:56.286855 13488 raft_consensus.cc:2466] T 796e01f6a36241fc94e335253929d6ab P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 1.
I20250830 07:54:56.293826 13486 raft_consensus.cc:2466] T 8cce7e5537794e9484f5a7c82b9e6e1d P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 1.
I20250830 07:54:56.296241 13611 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "5e2da5434e95445aa4deafce7fde0c6c" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:56.297078 13486 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "a8660a6ff9254d4f9f0ef047b8682ed1" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:54:56.297298 13486 raft_consensus.cc:2466] T a8660a6ff9254d4f9f0ef047b8682ed1 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 0.
I20250830 07:54:56.297346 13882 tablet_bootstrap.cc:492] T 23d2c7013c9c4b4aacf47e6ac7ab5a0b P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:54:56.297488 13882 ts_tablet_manager.cc:1397] T 23d2c7013c9c4b4aacf47e6ac7ab5a0b P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.086s user 0.003s sys 0.000s
I20250830 07:54:56.298240 13882 raft_consensus.cc:357] T 23d2c7013c9c4b4aacf47e6ac7ab5a0b P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:56.298391 13882 raft_consensus.cc:383] T 23d2c7013c9c4b4aacf47e6ac7ab5a0b P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:56.298457 13882 raft_consensus.cc:738] T 23d2c7013c9c4b4aacf47e6ac7ab5a0b P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:54:56.298628 13882 consensus_queue.cc:260] T 23d2c7013c9c4b4aacf47e6ac7ab5a0b P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:56.299403 13225 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_3d6b83dc92d5422094930022f7eaf0cd"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:56.299909 13225 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3d6b83dc92d5422094930022f7eaf0cd in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:56.300213 13887 tablet_bootstrap.cc:492] T 439fc51afa6b435e81bc38b9e88d4041 P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:54:56.300341 13887 ts_tablet_manager.cc:1397] T 439fc51afa6b435e81bc38b9e88d4041 P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.076s user 0.001s sys 0.009s
I20250830 07:54:56.301026 13887 raft_consensus.cc:357] T 439fc51afa6b435e81bc38b9e88d4041 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:56.301262 13887 raft_consensus.cc:383] T 439fc51afa6b435e81bc38b9e88d4041 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:56.301379 13887 raft_consensus.cc:738] T 439fc51afa6b435e81bc38b9e88d4041 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:54:56.301473 13611 raft_consensus.cc:3058] T 88bbd6b4c795433d9b6ad746353f3aa1 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:56.301688 13887 consensus_queue.cc:260] T 439fc51afa6b435e81bc38b9e88d4041 P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:56.302345 13887 ts_tablet_manager.cc:1428] T 439fc51afa6b435e81bc38b9e88d4041 P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20250830 07:54:56.302701 13887 tablet_bootstrap.cc:492] T 52df62f7f1aa4b38be89f6198cf01f24 P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:54:56.305642 13882 ts_tablet_manager.cc:1428] T 23d2c7013c9c4b4aacf47e6ac7ab5a0b P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.008s user 0.002s sys 0.000s
I20250830 07:54:56.305928 13882 tablet_bootstrap.cc:492] T 042fd7ff08fc4695b87bb8f9d225ef12 P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:54:56.306576 13887 tablet_bootstrap.cc:654] T 52df62f7f1aa4b38be89f6198cf01f24 P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:56.307869 13882 tablet_bootstrap.cc:654] T 042fd7ff08fc4695b87bb8f9d225ef12 P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:56.306618 13486 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "1520d7257f864ea4ba4b9a5d0443f8a7" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:54:56.307236 13488 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "7aed56dba39e40518e9c3325bcccd74a" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:54:56.308671 13486 raft_consensus.cc:2466] T 1520d7257f864ea4ba4b9a5d0443f8a7 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 0.
I20250830 07:54:56.308799 13488 raft_consensus.cc:2466] T 7aed56dba39e40518e9c3325bcccd74a P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 0.
I20250830 07:54:56.327376 13486 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "6ccbaf109e36453ea6645dfd090f5a1a" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:54:56.327582 13486 raft_consensus.cc:2466] T 6ccbaf109e36453ea6645dfd090f5a1a P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 0.
W20250830 07:54:56.329751 13423 leader_election.cc:343] T 5e2da5434e95445aa4deafce7fde0c6c P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:56.329895 15748 consensus_queue.cc:1035] T ec47a59c22ff4370bd21bc2a18336049 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:54:56.331338 15748 raft_consensus.cc:491] T 14d4d2506e2a47ea906bfb81d5509829 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:56.331483 15748 raft_consensus.cc:513] T 14d4d2506e2a47ea906bfb81d5509829 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:56.332063 15748 leader_election.cc:290] T 14d4d2506e2a47ea906bfb81d5509829 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
W20250830 07:54:56.339300 13422 leader_election.cc:343] T e74a3e4b3b234c41aca30f772525652e P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:56.339419 13422 leader_election.cc:304] T e74a3e4b3b234c41aca30f772525652e P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba; no voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:54:56.339749 15687 raft_consensus.cc:2747] T e74a3e4b3b234c41aca30f772525652e P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:54:56.342710 15365 consensus_queue.cc:1035] T 88bbd6b4c795433d9b6ad746353f3aa1 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:54:56.343197 15687 raft_consensus.cc:491] T 1fee3e58f31b4befa42ffbb8d7bd6f4e P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20250830 07:54:56.343374 13422 leader_election.cc:343] T 8c01157324ba45bda5b3a9a328bf319b P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:56.343333 15687 raft_consensus.cc:513] T 1fee3e58f31b4befa42ffbb8d7bd6f4e P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:56.343541 13422 leader_election.cc:304] T 8c01157324ba45bda5b3a9a328bf319b P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba; no voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:54:56.343830 15691 raft_consensus.cc:2747] T 8c01157324ba45bda5b3a9a328bf319b P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:54:56.343935 15687 leader_election.cc:290] T 1fee3e58f31b4befa42ffbb8d7bd6f4e P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
W20250830 07:54:56.345054 13422 leader_election.cc:343] T ed364f03bdad42b88e181b7d0e1e4011 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:56.345211 13422 leader_election.cc:304] T ed364f03bdad42b88e181b7d0e1e4011 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba; no voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:54:56.345454 15692 raft_consensus.cc:2747] T ed364f03bdad42b88e181b7d0e1e4011 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:54:56.345805 13422 leader_election.cc:304] T a8660a6ff9254d4f9f0ef047b8682ed1 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:54:56.346170 15692 raft_consensus.cc:2802] T a8660a6ff9254d4f9f0ef047b8682ed1 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:54:56.346239 15692 raft_consensus.cc:491] T a8660a6ff9254d4f9f0ef047b8682ed1 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:54:56.346328 15692 raft_consensus.cc:3058] T a8660a6ff9254d4f9f0ef047b8682ed1 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:56.349205 15692 raft_consensus.cc:513] T a8660a6ff9254d4f9f0ef047b8682ed1 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:56.350040 15692 leader_election.cc:290] T a8660a6ff9254d4f9f0ef047b8682ed1 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 election: Requested vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
W20250830 07:54:56.351207 13422 leader_election.cc:343] T 1db4109dc43b489d89c5de9eeb64a771 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:56.351356 13422 leader_election.cc:304] T 1db4109dc43b489d89c5de9eeb64a771 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba; no voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:54:56.351600 15692 raft_consensus.cc:2747] T 1db4109dc43b489d89c5de9eeb64a771 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:54:56.352358 13422 leader_election.cc:304] T 7aed56dba39e40518e9c3325bcccd74a P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:54:56.352627 15692 raft_consensus.cc:2802] T 7aed56dba39e40518e9c3325bcccd74a P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:54:56.352370 15753 tablet_replica.cc:331] T ada52626bbc94105a8b9428b0bbdfb5e P 6b5e454d98894637b466ea27f1b647f9: stopping tablet replica
I20250830 07:54:56.352738 15692 raft_consensus.cc:491] T 7aed56dba39e40518e9c3325bcccd74a P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:54:56.352926 15692 raft_consensus.cc:3058] T 7aed56dba39e40518e9c3325bcccd74a P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:56.355427 15692 raft_consensus.cc:513] T 7aed56dba39e40518e9c3325bcccd74a P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:56.355337 15753 raft_consensus.cc:2241] T ada52626bbc94105a8b9428b0bbdfb5e P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250830 07:54:56.356187 15692 leader_election.cc:290] T 7aed56dba39e40518e9c3325bcccd74a P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 election: Requested vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:56.356338 13886 tablet_bootstrap.cc:492] T 2b4103f07e96490488913059a95af0c3 P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:54:56.356426 15753 raft_consensus.cc:2270] T ada52626bbc94105a8b9428b0bbdfb5e P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250830 07:54:56.356837 13886 ts_tablet_manager.cc:1397] T 2b4103f07e96490488913059a95af0c3 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.123s user 0.004s sys 0.003s
I20250830 07:54:56.357995 13617 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "a8660a6ff9254d4f9f0ef047b8682ed1" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9"
I20250830 07:54:56.358093 13610 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "1fee3e58f31b4befa42ffbb8d7bd6f4e" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:56.358306 13619 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "7aed56dba39e40518e9c3325bcccd74a" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9"
I20250830 07:54:56.358415 15753 ts_tablet_manager.cc:1905] T ada52626bbc94105a8b9428b0bbdfb5e P 6b5e454d98894637b466ea27f1b647f9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250830 07:54:56.359550 13886 raft_consensus.cc:357] T 2b4103f07e96490488913059a95af0c3 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:56.360155 13886 raft_consensus.cc:383] T 2b4103f07e96490488913059a95af0c3 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:56.360553 13886 raft_consensus.cc:738] T 2b4103f07e96490488913059a95af0c3 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
W20250830 07:54:56.361809 13423 consensus_peers.cc:489] T 66499e87e3d7422ca7a449cc2e89e709 P 2065c332f15a4739899af79f3669c3ba -> Peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Couldn't send request to peer 6b5e454d98894637b466ea27f1b647f9. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 66499e87e3d7422ca7a449cc2e89e709. This is attempt 1: this message will repeat every 5th retry.
I20250830 07:54:56.361326 13886 consensus_queue.cc:260] T 2b4103f07e96490488913059a95af0c3 P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:56.363350 13422 leader_election.cc:304] T 6ccbaf109e36453ea6645dfd090f5a1a P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:54:56.363921 15602 raft_consensus.cc:2802] T 6ccbaf109e36453ea6645dfd090f5a1a P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:54:56.364042 15602 raft_consensus.cc:491] T 6ccbaf109e36453ea6645dfd090f5a1a P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:54:56.364112 15602 raft_consensus.cc:3058] T 6ccbaf109e36453ea6645dfd090f5a1a P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
W20250830 07:54:56.366318 13229 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 5796f5684cd74ed28eb95b60754b3410 has no consensus state
I20250830 07:54:56.366556 15602 raft_consensus.cc:513] T 6ccbaf109e36453ea6645dfd090f5a1a P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:56.366670 13229 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_85af6852b3b948dbbb9d49294dc2ee25" } modify_external_catalogs: true
I20250830 07:54:56.366808 13229 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_85af6852b3b948dbbb9d49294dc2ee25" } modify_external_catalogs: true
I20250830 07:54:56.367259 15602 leader_election.cc:290] T 6ccbaf109e36453ea6645dfd090f5a1a P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 election: Requested vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:56.367589 13614 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "14d4d2506e2a47ea906bfb81d5509829" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:56.368490 13887 tablet_bootstrap.cc:492] T 52df62f7f1aa4b38be89f6198cf01f24 P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:54:56.372560 13882 tablet_bootstrap.cc:492] T 042fd7ff08fc4695b87bb8f9d225ef12 P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:54:56.373715 13882 ts_tablet_manager.cc:1397] T 042fd7ff08fc4695b87bb8f9d225ef12 P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.068s user 0.008s sys 0.007s
I20250830 07:54:56.374157 13701 leader_election.cc:304] T 76ab56c469cf4675a4e21acbe0a8085d P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:54:56.374963 13882 raft_consensus.cc:357] T 042fd7ff08fc4695b87bb8f9d225ef12 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
W20250830 07:54:56.375203 13234 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet cb62e3129fab4919993e9da13443dcdb has no consensus state
I20250830 07:54:56.375434 13887 ts_tablet_manager.cc:1397] T 52df62f7f1aa4b38be89f6198cf01f24 P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.073s user 0.002s sys 0.015s
I20250830 07:54:56.375434 13234 master_service.cc:948] ReplaceTablet: received request to replace tablet 31244b74c01a4c0d816867286a39cd4d from {username='slave'} at 127.0.0.1:42126
W20250830 07:54:56.376066 13226 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a4a4fc69f68643c1acf6471cee80b581 consensus state has no leader
I20250830 07:54:56.375309 15701 raft_consensus.cc:491] T a0cf1de8485941eb8a557a6e2f783047 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:56.376364 15701 raft_consensus.cc:513] T a0cf1de8485941eb8a557a6e2f783047 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:56.377020 15701 leader_election.cc:290] T a0cf1de8485941eb8a557a6e2f783047 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
I20250830 07:54:56.377243 15701 raft_consensus.cc:2802] T 76ab56c469cf4675a4e21acbe0a8085d P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:54:56.377306 15701 raft_consensus.cc:491] T 76ab56c469cf4675a4e21acbe0a8085d P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:54:56.377367 15701 raft_consensus.cc:3058] T 76ab56c469cf4675a4e21acbe0a8085d P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:56.382339 15602 consensus_queue.cc:1035] T 2048c04578104c78aa6504fd9d5953a3 P 2065c332f15a4739899af79f3669c3ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:54:56.383180 15701 raft_consensus.cc:513] T 76ab56c469cf4675a4e21acbe0a8085d P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:56.384188 15701 leader_election.cc:290] T 76ab56c469cf4675a4e21acbe0a8085d P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Requested vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
I20250830 07:54:56.384229 15602 consensus_queue.cc:1035] T 6251a06d1efe44e38d35d962c468f8b2 P 2065c332f15a4739899af79f3669c3ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:54:56.388306 13232 catalog_manager.cc:6127] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: default.Table_600be7252a144704b45d1971758d4c97 [id=bcee72f9b1c6407f98435a1494b42407] alter complete (version 2)
I20250830 07:54:56.397830 13886 ts_tablet_manager.cc:1428] T 2b4103f07e96490488913059a95af0c3 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.041s user 0.001s sys 0.001s
I20250830 07:54:56.399840 13886 tablet_bootstrap.cc:492] T 509e08290f3842cfbde8b74ff9f4f70f P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
W20250830 07:54:56.408897 13232 catalog_manager.cc:5415] Ignoring report from unknown tablet 2b4103f07e96490488913059a95af0c3
W20250830 07:54:56.425588 13232 catalog_manager.cc:5415] Ignoring report from unknown tablet 1fa571e9490e499792225d7b786e8658
W20250830 07:54:56.425849 13232 catalog_manager.cc:5415] Ignoring report from unknown tablet 23d2c7013c9c4b4aacf47e6ac7ab5a0b
W20250830 07:54:56.428395 13701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.209.1:45325, user_credentials={real_user=slave}} blocked reactor thread for 54064.1us
I20250830 07:54:56.419342 13624 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "a0cf1de8485941eb8a557a6e2f783047" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:56.419600 13614 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "76ab56c469cf4675a4e21acbe0a8085d" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9"
W20250830 07:54:56.430546 13423 leader_election.cc:343] T a8660a6ff9254d4f9f0ef047b8682ed1 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
W20250830 07:54:56.430747 13423 leader_election.cc:343] T 1fee3e58f31b4befa42ffbb8d7bd6f4e P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
W20250830 07:54:56.430995 13423 leader_election.cc:343] T 7aed56dba39e40518e9c3325bcccd74a P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:56.430075 13882 raft_consensus.cc:383] T 042fd7ff08fc4695b87bb8f9d225ef12 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20250830 07:54:56.431206 13703 leader_election.cc:343] T 14d4d2506e2a47ea906bfb81d5509829 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:56.431557 13882 raft_consensus.cc:738] T 042fd7ff08fc4695b87bb8f9d225ef12 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:54:56.431124 13887 raft_consensus.cc:357] T 52df62f7f1aa4b38be89f6198cf01f24 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:56.433951 13887 raft_consensus.cc:383] T 52df62f7f1aa4b38be89f6198cf01f24 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20250830 07:54:56.435065 13232 catalog_manager.cc:5415] Ignoring report from unknown tablet f66e1d07039841088a444ee0203a4eb0
W20250830 07:54:56.435177 13232 catalog_manager.cc:5415] Ignoring report from unknown tablet d206f6b6e7524a27a9f95787bcd5de77
W20250830 07:54:56.435279 13232 catalog_manager.cc:5415] Ignoring report from unknown tablet 70703eb1d47841a1a227e277ed6a268d
W20250830 07:54:56.435483 13232 catalog_manager.cc:5415] Ignoring report from unknown tablet 5235e1a32f044f0cbf882e338c482003
W20250830 07:54:56.435927 13232 catalog_manager.cc:5415] Ignoring report from unknown tablet ff0f9cccc8ed43b1a8cd38de0e9d4097
W20250830 07:54:56.436061 13232 catalog_manager.cc:5415] Ignoring report from unknown tablet e6060a3dc6444483b8fb2944b8090cb6
W20250830 07:54:56.436183 13232 catalog_manager.cc:5415] Ignoring report from unknown tablet f398e12cd9f543738d5163354f8a9d9d
I20250830 07:54:56.435146 13887 raft_consensus.cc:738] T 52df62f7f1aa4b38be89f6198cf01f24 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
W20250830 07:54:56.436287 13232 catalog_manager.cc:5415] Ignoring report from unknown tablet ca959e42c8764eeba0faee96caf8b39f
W20250830 07:54:56.436403 13232 catalog_manager.cc:5415] Ignoring report from unknown tablet ef1ab62a5b7845e58d50f34206eaaa27
W20250830 07:54:56.436658 13227 catalog_manager.cc:5415] Ignoring report from unknown tablet ef16b9e2d444489699f4db1ac26d5f6c
I20250830 07:54:56.436730 13229 catalog_manager.cc:5864] Not sending DeleteTablet requests; no consensus state for tablet d1eb84fefb7a4205adef275a34a449ba
W20250830 07:54:56.436861 13227 catalog_manager.cc:5415] Ignoring report from unknown tablet ef1ab62a5b7845e58d50f34206eaaa27
I20250830 07:54:56.437405 13234 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet 31244b74c01a4c0d816867286a39cd4d
I20250830 07:54:56.437800 13234 catalog_manager.cc:6652] ReplaceTablet: tablet 31244b74c01a4c0d816867286a39cd4d deleted and replaced by tablet dcf142b6a9a847cb9f34d10cbf611d15
I20250830 07:54:56.438089 13593 tablet_service.cc:1515] Processing DeleteTablet for tablet 31244b74c01a4c0d816867286a39cd4d with delete_type TABLET_DATA_DELETED (replaced by tablet dcf142b6a9a847cb9f34d10cbf611d15) from {username='slave'} at 127.0.0.1:45306
I20250830 07:54:56.434474 13882 consensus_queue.cc:260] T 042fd7ff08fc4695b87bb8f9d225ef12 P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:56.438668 15748 raft_consensus.cc:491] T 4d4b00bdadb24ec892d87c9be2ed7dd9 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:56.438791 15748 raft_consensus.cc:513] T 4d4b00bdadb24ec892d87c9be2ed7dd9 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:56.439356 15748 leader_election.cc:290] T 4d4b00bdadb24ec892d87c9be2ed7dd9 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967)
I20250830 07:54:56.440238 15365 consensus_queue.cc:1035] T 042fd7ff08fc4695b87bb8f9d225ef12 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:54:56.441903 13882 ts_tablet_manager.cc:1428] T 042fd7ff08fc4695b87bb8f9d225ef12 P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.068s user 0.002s sys 0.000s
I20250830 07:54:56.443156 13701 leader_election.cc:304] T ee44ab24333742909f773889ad5c3e00 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:54:56.443439 13227 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_d27f0b8130714af9bd399f246ad2c7d4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:56.444312 13227 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d27f0b8130714af9bd399f246ad2c7d4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:56.444602 15701 raft_consensus.cc:2802] T ee44ab24333742909f773889ad5c3e00 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:54:56.444756 15701 raft_consensus.cc:491] T ee44ab24333742909f773889ad5c3e00 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:54:56.444839 15701 raft_consensus.cc:3058] T ee44ab24333742909f773889ad5c3e00 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:56.447211 13234 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_32cf494e806f4d30ab02925af4ceb292"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250830 07:54:56.447367 15608 consensus_queue.cc:1035] T c1e0e774b86d4ef9a75e2635295f3e2a P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20250830 07:54:56.447690 13234 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_32cf494e806f4d30ab02925af4ceb292 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:56.448072 13886 tablet_bootstrap.cc:654] T 509e08290f3842cfbde8b74ff9f4f70f P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:56.451439 13229 master_service.cc:948] ReplaceTablet: received request to replace tablet 7d78e67e74f84c3197e944a21de49407 from {username='slave'} at 127.0.0.1:42126
I20250830 07:54:56.451509 13225 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_91331ba452404d0f896d7397534d9e65" } new_table_name: "default.Table_60e9fde283aa4984b86e7b7954f247f9" modify_external_catalogs: true
I20250830 07:54:56.453306 15701 raft_consensus.cc:513] T ee44ab24333742909f773889ad5c3e00 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:56.454026 15701 leader_election.cc:290] T ee44ab24333742909f773889ad5c3e00 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Requested vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967)
I20250830 07:54:56.455173 13227 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_1617f2641ae145e0a110b39e243b7c19" } new_table_name: "default.Table_9000475f1cb74899ac1fb69b521a6554" modify_external_catalogs: true
I20250830 07:54:56.456948 15753 ts_tablet_manager.cc:1918] T ada52626bbc94105a8b9428b0bbdfb5e P 6b5e454d98894637b466ea27f1b647f9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250830 07:54:56.457098 15753 log.cc:1199] T ada52626bbc94105a8b9428b0bbdfb5e P 6b5e454d98894637b466ea27f1b647f9: Deleting WAL directory at /tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/ts-1/wal/wals/ada52626bbc94105a8b9428b0bbdfb5e
I20250830 07:54:56.457499 15753 ts_tablet_manager.cc:1939] T ada52626bbc94105a8b9428b0bbdfb5e P 6b5e454d98894637b466ea27f1b647f9: Deleting consensus metadata
I20250830 07:54:56.458570 13886 tablet_bootstrap.cc:492] T 509e08290f3842cfbde8b74ff9f4f70f P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:54:56.458755 13886 ts_tablet_manager.cc:1397] T 509e08290f3842cfbde8b74ff9f4f70f P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.059s user 0.003s sys 0.000s
I20250830 07:54:56.459738 13229 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet 7d78e67e74f84c3197e944a21de49407
I20250830 07:54:56.460182 13229 catalog_manager.cc:6652] ReplaceTablet: tablet 7d78e67e74f84c3197e944a21de49407 deleted and replaced by tablet 385f439e554f4dc1a0d05a41e6d84688
I20250830 07:54:56.460474 13593 tablet_service.cc:1515] Processing DeleteTablet for tablet 7d78e67e74f84c3197e944a21de49407 with delete_type TABLET_DATA_DELETED (replaced by tablet 385f439e554f4dc1a0d05a41e6d84688) from {username='slave'} at 127.0.0.1:45306
W20250830 07:54:56.460530 13225 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet e3a0c24f409e43da9c18655f67e2a8c6 has no consensus state
I20250830 07:54:56.465794 13614 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "6ccbaf109e36453ea6645dfd090f5a1a" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9"
W20250830 07:54:56.466298 13227 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet b3bbd51de79648eab454aca063652ac2 has no consensus state
W20250830 07:54:56.466276 13423 leader_election.cc:343] T 6ccbaf109e36453ea6645dfd090f5a1a P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:56.466847 13882 tablet_bootstrap.cc:492] T 91705fc35a1b4977b89bac1765c886c0 P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:54:56.467859 13614 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "ee44ab24333742909f773889ad5c3e00" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9"
I20250830 07:54:56.468119 13882 tablet_bootstrap.cc:654] T 91705fc35a1b4977b89bac1765c886c0 P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:56.468878 13887 consensus_queue.cc:260] T 52df62f7f1aa4b38be89f6198cf01f24 P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:56.469419 13887 ts_tablet_manager.cc:1428] T 52df62f7f1aa4b38be89f6198cf01f24 P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.094s user 0.000s sys 0.001s
I20250830 07:54:56.469707 13887 tablet_bootstrap.cc:492] T d1d5e0d40a91457da65a0e925289309e P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:54:56.470901 13701 leader_election.cc:304] T 1cf23cf78eee46be953bd701aa6bef07 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:54:56.471190 15365 raft_consensus.cc:2802] T 1cf23cf78eee46be953bd701aa6bef07 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:54:56.471269 15365 raft_consensus.cc:491] T 1cf23cf78eee46be953bd701aa6bef07 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:54:56.471326 15365 raft_consensus.cc:3058] T 1cf23cf78eee46be953bd701aa6bef07 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:56.473727 15365 raft_consensus.cc:513] T 1cf23cf78eee46be953bd701aa6bef07 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:56.474570 15365 leader_election.cc:290] T 1cf23cf78eee46be953bd701aa6bef07 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Requested vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
I20250830 07:54:56.476413 13701 leader_election.cc:304] T 97d49a1f600f4c13a4aafca99cedabe8 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:54:56.476761 13227 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_1ee848207f8a41f8b2571a976cf26389" } modify_external_catalogs: true
I20250830 07:54:56.476899 13227 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_1ee848207f8a41f8b2571a976cf26389" } modify_external_catalogs: true
I20250830 07:54:56.477036 15500 raft_consensus.cc:2802] T 97d49a1f600f4c13a4aafca99cedabe8 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election won for term 1
I20250830 07:54:56.477059 13229 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_012d82c539bf4e94b6008b19143a2790" } modify_external_catalogs: true
I20250830 07:54:56.477156 15500 raft_consensus.cc:695] T 97d49a1f600f4c13a4aafca99cedabe8 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 LEADER]: Becoming Leader. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Running, Role: LEADER
I20250830 07:54:56.477190 13229 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_012d82c539bf4e94b6008b19143a2790" } modify_external_catalogs: true
I20250830 07:54:56.477362 15500 consensus_queue.cc:237] T 97d49a1f600f4c13a4aafca99cedabe8 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:56.478312 13234 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_f99558cee54143bdac50cbc8940edf4b" } modify_external_catalogs: true
I20250830 07:54:56.478435 13234 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_f99558cee54143bdac50cbc8940edf4b" } modify_external_catalogs: true
I20250830 07:54:56.479050 13230 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_b6b768ead0f540ddb0f99bc8a562d646" } modify_external_catalogs: true
I20250830 07:54:56.479171 13230 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_b6b768ead0f540ddb0f99bc8a562d646" } modify_external_catalogs: true
W20250830 07:54:56.479354 13703 leader_election.cc:343] T a0cf1de8485941eb8a557a6e2f783047 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
W20250830 07:54:56.479511 13703 leader_election.cc:343] T 76ab56c469cf4675a4e21acbe0a8085d P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
W20250830 07:54:56.479779 13703 leader_election.cc:343] T 4d4b00bdadb24ec892d87c9be2ed7dd9 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Not found: Tablet not found: 4d4b00bdadb24ec892d87c9be2ed7dd9
W20250830 07:54:56.480008 13703 leader_election.cc:343] T ee44ab24333742909f773889ad5c3e00 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:56.487794 13228 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_c977daebc0634f22b8544b603504798c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250830 07:54:56.488463 13233 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_4c72c7b924164ba78c0e4db59256197c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250830 07:54:56.489081 13229 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet a4a4fc69f68643c1acf6471cee80b581
I20250830 07:54:56.489689 13593 tablet_service.cc:1515] Processing DeleteTablet for tablet a4a4fc69f68643c1acf6471cee80b581 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:56 UTC) from {username='slave'} at 127.0.0.1:45306
I20250830 07:54:56.492928 15602 raft_consensus.cc:491] T 0ac39adafe144280b39f5c3fe5804087 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:56.493057 15602 raft_consensus.cc:513] T 0ac39adafe144280b39f5c3fe5804087 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:56.493571 15602 leader_election.cc:290] T 0ac39adafe144280b39f5c3fe5804087 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:56.494665 13231 catalog_manager.cc:5674] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325) does not have the latest schema for tablet 52df62f7f1aa4b38be89f6198cf01f24 (table default.Table_c58784366d3c49dda4c9d4afc16520a3 [id=0345f468e2de4e38814123f678c2da1c]). Expected version 1 got 0
I20250830 07:54:56.499195 13230 catalog_manager.cc:5864] Not sending DeleteTablet requests; no consensus state for tablet 891c6dbd50e54f6ba24229d8c2bc137a
I20250830 07:54:56.501871 13614 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "1cf23cf78eee46be953bd701aa6bef07" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9"
W20250830 07:54:56.503062 13225 catalog_manager.cc:5415] Ignoring report from unknown tablet db4077bf8e184ac5809ef629222f2cc5
W20250830 07:54:56.503113 13225 catalog_manager.cc:5415] Ignoring report from unknown tablet 2b4103f07e96490488913059a95af0c3
W20250830 07:54:56.503923 13233 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4c72c7b924164ba78c0e4db59256197c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250830 07:54:56.505110 13228 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c977daebc0634f22b8544b603504798c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:56.506464 15608 consensus_queue.cc:1035] T 91705fc35a1b4977b89bac1765c886c0 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:54:56.506703 13887 tablet_bootstrap.cc:654] T d1d5e0d40a91457da65a0e925289309e P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:56.510457 15608 consensus_queue.cc:1035] T 3c9dd258e6be47f68e039e4cdcd899b2 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:54:56.513921 15608 consensus_queue.cc:1035] T 88bbd6b4c795433d9b6ad746353f3aa1 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:54:56.516726 13234 catalog_manager.cc:5864] Not sending DeleteTablet requests; no consensus state for tablet e38a3a08b88d48fbb94f2e732991a37b
I20250830 07:54:56.518512 13701 leader_election.cc:304] T 852e353f6ee945628ddebdbdd1bd76fb P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:54:56.519259 13614 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "0ac39adafe144280b39f5c3fe5804087" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:56.520700 13882 tablet_bootstrap.cc:492] T 91705fc35a1b4977b89bac1765c886c0 P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:54:56.520869 13882 ts_tablet_manager.cc:1397] T 91705fc35a1b4977b89bac1765c886c0 P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.054s user 0.004s sys 0.000s
I20250830 07:54:56.521567 13882 raft_consensus.cc:357] T 91705fc35a1b4977b89bac1765c886c0 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:56.521770 13882 raft_consensus.cc:383] T 91705fc35a1b4977b89bac1765c886c0 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:56.521854 13882 raft_consensus.cc:738] T 91705fc35a1b4977b89bac1765c886c0 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:54:56.522069 13882 consensus_queue.cc:260] T 91705fc35a1b4977b89bac1765c886c0 P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:56.522570 13882 ts_tablet_manager.cc:1428] T 91705fc35a1b4977b89bac1765c886c0 P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20250830 07:54:56.522835 13882 tablet_bootstrap.cc:492] T 74f2fcc22fd545fb8ca7c20619843023 P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:54:56.525851 13882 tablet_bootstrap.cc:654] T 74f2fcc22fd545fb8ca7c20619843023 P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:56.527290 13227 catalog_manager.cc:5864] Not sending DeleteTablet requests; no consensus state for tablet df914f525b5143a7a2f255f5a88ade48
W20250830 07:54:56.527311 13703 leader_election.cc:343] T 1cf23cf78eee46be953bd701aa6bef07 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:56.531986 15602 raft_consensus.cc:491] T 52df62f7f1aa4b38be89f6198cf01f24 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:56.532110 15602 raft_consensus.cc:513] T 52df62f7f1aa4b38be89f6198cf01f24 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:56.532655 15602 leader_election.cc:290] T 52df62f7f1aa4b38be89f6198cf01f24 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
W20250830 07:54:56.532960 13423 consensus_peers.cc:489] T ada52626bbc94105a8b9428b0bbdfb5e P 2065c332f15a4739899af79f3669c3ba -> Peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Couldn't send request to peer 6b5e454d98894637b466ea27f1b647f9. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
W20250830 07:54:56.533111 13423 leader_election.cc:343] T 0ac39adafe144280b39f5c3fe5804087 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:56.535069 15608 raft_consensus.cc:2802] T 852e353f6ee945628ddebdbdd1bd76fb P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:54:56.535178 15608 raft_consensus.cc:491] T 852e353f6ee945628ddebdbdd1bd76fb P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:54:56.535331 15608 raft_consensus.cc:3058] T 852e353f6ee945628ddebdbdd1bd76fb P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:56.538347 15608 raft_consensus.cc:513] T 852e353f6ee945628ddebdbdd1bd76fb P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:56.538834 15608 leader_election.cc:290] T 852e353f6ee945628ddebdbdd1bd76fb P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Requested vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967)
I20250830 07:54:56.539196 13701 leader_election.cc:304] T f32ebc2605c34a68aed50379f028052c P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:54:56.543000 13701 leader_election.cc:304] T 62bc8168176e4678a77827c5b7cc0f3e P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:54:56.543637 13701 leader_election.cc:304] T f5baa35307a1425c8d52666d130d6d8a P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
W20250830 07:54:56.543776 13231 catalog_manager.cc:5415] Ignoring report from unknown tablet 97d49a1f600f4c13a4aafca99cedabe8
I20250830 07:54:56.543869 15701 raft_consensus.cc:2802] T 62bc8168176e4678a77827c5b7cc0f3e P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election won for term 1
I20250830 07:54:56.544049 15701 raft_consensus.cc:695] T 62bc8168176e4678a77827c5b7cc0f3e P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 LEADER]: Becoming Leader. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Running, Role: LEADER
I20250830 07:54:56.544281 15701 consensus_queue.cc:237] T 62bc8168176e4678a77827c5b7cc0f3e P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:56.545063 15608 raft_consensus.cc:2802] T f5baa35307a1425c8d52666d130d6d8a P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:54:56.545182 15608 raft_consensus.cc:491] T f5baa35307a1425c8d52666d130d6d8a P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:54:56.545274 15608 raft_consensus.cc:3058] T f5baa35307a1425c8d52666d130d6d8a P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:56.548923 13232 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_c1d0a2f1b6d6422598cbb30dc9ab0768"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:56.549518 13232 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c1d0a2f1b6d6422598cbb30dc9ab0768 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:56.550832 13886 raft_consensus.cc:357] T 509e08290f3842cfbde8b74ff9f4f70f P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:56.551033 13886 raft_consensus.cc:383] T 509e08290f3842cfbde8b74ff9f4f70f P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:56.551108 13886 raft_consensus.cc:738] T 509e08290f3842cfbde8b74ff9f4f70f P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:54:56.551267 13886 consensus_queue.cc:260] T 509e08290f3842cfbde8b74ff9f4f70f P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:56.551710 13886 ts_tablet_manager.cc:1428] T 509e08290f3842cfbde8b74ff9f4f70f P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.093s user 0.001s sys 0.000s
I20250830 07:54:56.543179 15721 raft_consensus.cc:2802] T f32ebc2605c34a68aed50379f028052c P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:54:56.551870 15721 raft_consensus.cc:491] T f32ebc2605c34a68aed50379f028052c P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:54:56.551990 13886 tablet_bootstrap.cc:492] T 5fee48de90014f94b796e726a4d16b85 P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:54:56.552006 15721 raft_consensus.cc:3058] T f32ebc2605c34a68aed50379f028052c P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:56.553371 13886 tablet_bootstrap.cc:654] T 5fee48de90014f94b796e726a4d16b85 P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:56.554631 15721 raft_consensus.cc:513] T f32ebc2605c34a68aed50379f028052c P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:56.555428 13614 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "852e353f6ee945628ddebdbdd1bd76fb" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9"
I20250830 07:54:56.556591 15728 raft_consensus.cc:491] T 49165f0001044d72b68263a60ef56457 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:56.556739 15728 raft_consensus.cc:513] T 49165f0001044d72b68263a60ef56457 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:56.556895 13614 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "52df62f7f1aa4b38be89f6198cf01f24" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:56.557317 15728 leader_election.cc:290] T 49165f0001044d72b68263a60ef56457 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
W20250830 07:54:56.557929 13423 leader_election.cc:343] T 52df62f7f1aa4b38be89f6198cf01f24 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:56.558295 13488 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "49165f0001044d72b68263a60ef56457" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:54:56.558516 13488 raft_consensus.cc:2391] T 49165f0001044d72b68263a60ef56457 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b5e454d98894637b466ea27f1b647f9 in current term 1: Already voted for candidate 2065c332f15a4739899af79f3669c3ba in this term.
I20250830 07:54:56.564992 13231 master_service.cc:948] ReplaceTablet: received request to replace tablet e7ac2e088ad94f64aa52cd9c5038a0c2 from {username='slave'} at 127.0.0.1:42126
I20250830 07:54:56.569329 13220 catalog_manager.cc:4928] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): tablet ada52626bbc94105a8b9428b0bbdfb5e (table default.Table_57d9ce41d0254969ae072b4c6936f7f2 [id=a219b2ce56d0408c936d6f2462cc6935]) successfully deleted
W20250830 07:54:56.569543 13220 catalog_manager.cc:4908] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet 8d685e1a2d474463b9f98282fd4d2090 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8d685e1a2d474463b9f98282fd4d2090 already in progress: creating tablet
W20250830 07:54:56.569717 13220 catalog_manager.cc:4908] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet 31244b74c01a4c0d816867286a39cd4d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 31244b74c01a4c0d816867286a39cd4d already in progress: creating tablet
W20250830 07:54:56.571635 13220 catalog_manager.cc:4908] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet 7d78e67e74f84c3197e944a21de49407 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7d78e67e74f84c3197e944a21de49407 already in progress: creating tablet
W20250830 07:54:56.571810 13220 catalog_manager.cc:4908] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet a4a4fc69f68643c1acf6471cee80b581 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a4a4fc69f68643c1acf6471cee80b581 already in progress: creating tablet
I20250830 07:54:56.572240 15721 leader_election.cc:290] T f32ebc2605c34a68aed50379f028052c P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Requested vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
W20250830 07:54:56.557374 13703 leader_election.cc:343] T 852e353f6ee945628ddebdbdd1bd76fb P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:56.559546 15608 raft_consensus.cc:513] T f5baa35307a1425c8d52666d130d6d8a P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:56.572842 15608 leader_election.cc:290] T f5baa35307a1425c8d52666d130d6d8a P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Requested vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
I20250830 07:54:56.572995 15701 raft_consensus.cc:491] T e72402ca3cdf452fa8f4534c67226253 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:56.573203 15701 raft_consensus.cc:513] T e72402ca3cdf452fa8f4534c67226253 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:56.573872 13614 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f32ebc2605c34a68aed50379f028052c" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9"
I20250830 07:54:56.574396 15701 leader_election.cc:290] T e72402ca3cdf452fa8f4534c67226253 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
I20250830 07:54:56.556697 13701 leader_election.cc:304] T db7144b25ff34bed8c7b779ba9497ef4 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:54:56.572971 13764 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "49165f0001044d72b68263a60ef56457" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:56.574512 13614 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f5baa35307a1425c8d52666d130d6d8a" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9"
I20250830 07:54:56.574631 13764 raft_consensus.cc:2391] T 49165f0001044d72b68263a60ef56457 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b5e454d98894637b466ea27f1b647f9 in current term 1: Already voted for candidate 9b057ade5dce45af9f8bf0bedf8b917f in this term.
I20250830 07:54:56.574781 13701 leader_election.cc:304] T 52e910677ae34630a919d1d3f21b7e83 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
W20250830 07:54:56.575070 13703 leader_election.cc:343] T f32ebc2605c34a68aed50379f028052c P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:56.575124 13701 leader_election.cc:304] T c8bc6e07377a4ba99c39a909dae11402 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:54:56.575342 15500 raft_consensus.cc:2802] T db7144b25ff34bed8c7b779ba9497ef4 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:54:56.575412 15500 raft_consensus.cc:491] T db7144b25ff34bed8c7b779ba9497ef4 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20250830 07:54:56.575424 13703 leader_election.cc:343] T f5baa35307a1425c8d52666d130d6d8a P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:56.575512 15500 raft_consensus.cc:3058] T db7144b25ff34bed8c7b779ba9497ef4 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:56.575744 13562 leader_election.cc:304] T 49165f0001044d72b68263a60ef56457 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b5e454d98894637b466ea27f1b647f9; no voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:54:56.575990 15728 raft_consensus.cc:3058] T 49165f0001044d72b68263a60ef56457 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Advancing to term 1
W20250830 07:54:56.574512 13231 catalog_manager.cc:5415] Ignoring report from unknown tablet 057bcce2860345da860acc262dc4d339
I20250830 07:54:56.577157 15601 raft_consensus.cc:2802] T 52e910677ae34630a919d1d3f21b7e83 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election won for term 1
I20250830 07:54:56.577243 13887 tablet_bootstrap.cc:492] T d1d5e0d40a91457da65a0e925289309e P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:54:56.577282 15601 raft_consensus.cc:695] T 52e910677ae34630a919d1d3f21b7e83 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 LEADER]: Becoming Leader. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Running, Role: LEADER
I20250830 07:54:56.577374 13887 ts_tablet_manager.cc:1397] T d1d5e0d40a91457da65a0e925289309e P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.108s user 0.000s sys 0.003s
I20250830 07:54:56.577484 15601 consensus_queue.cc:237] T 52e910677ae34630a919d1d3f21b7e83 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:56.577898 15500 raft_consensus.cc:513] T db7144b25ff34bed8c7b779ba9497ef4 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:56.578122 13887 raft_consensus.cc:357] T d1d5e0d40a91457da65a0e925289309e P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:56.578305 13887 raft_consensus.cc:383] T d1d5e0d40a91457da65a0e925289309e P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:56.578394 13887 raft_consensus.cc:738] T d1d5e0d40a91457da65a0e925289309e P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:54:56.578401 15500 leader_election.cc:290] T db7144b25ff34bed8c7b779ba9497ef4 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Requested vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
I20250830 07:54:56.578434 15365 raft_consensus.cc:2802] T c8bc6e07377a4ba99c39a909dae11402 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:54:56.578496 15365 raft_consensus.cc:491] T c8bc6e07377a4ba99c39a909dae11402 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:54:56.578552 15365 raft_consensus.cc:3058] T c8bc6e07377a4ba99c39a909dae11402 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:56.578606 13887 consensus_queue.cc:260] T d1d5e0d40a91457da65a0e925289309e P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:56.578781 15728 raft_consensus.cc:2747] T 49165f0001044d72b68263a60ef56457 P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:54:56.579378 13614 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "e72402ca3cdf452fa8f4534c67226253" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:56.579533 13887 ts_tablet_manager.cc:1428] T d1d5e0d40a91457da65a0e925289309e P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20250830 07:54:56.579790 13887 tablet_bootstrap.cc:492] T 3bca390f6d4343cba7a9fb07f0d4d72b P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:54:56.579759 13701 leader_election.cc:304] T 796e01f6a36241fc94e335253929d6ab P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:54:56.579813 13614 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "db7144b25ff34bed8c7b779ba9497ef4" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9"
I20250830 07:54:56.580132 13701 leader_election.cc:304] T 8cce7e5537794e9484f5a7c82b9e6e1d P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
W20250830 07:54:56.580127 13703 leader_election.cc:343] T e72402ca3cdf452fa8f4534c67226253 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
W20250830 07:54:56.580853 13703 leader_election.cc:343] T db7144b25ff34bed8c7b779ba9497ef4 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:56.580636 15748 raft_consensus.cc:2802] T 796e01f6a36241fc94e335253929d6ab P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election won for term 1
I20250830 07:54:56.580976 15365 raft_consensus.cc:513] T c8bc6e07377a4ba99c39a909dae11402 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:56.581127 15748 raft_consensus.cc:695] T 796e01f6a36241fc94e335253929d6ab P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 LEADER]: Becoming Leader. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Running, Role: LEADER
I20250830 07:54:56.581132 13227 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_c0acbcd4b8904af691a95ce13736d116"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250830 07:54:56.581261 13233 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_32211a88470c456982fd873c3dbe7972"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250830 07:54:56.581542 15365 leader_election.cc:290] T c8bc6e07377a4ba99c39a909dae11402 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Requested vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967)
W20250830 07:54:56.581702 13227 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c0acbcd4b8904af691a95ce13736d116 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:56.581722 15365 raft_consensus.cc:2802] T 8cce7e5537794e9484f5a7c82b9e6e1d P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election won for term 1
W20250830 07:54:56.581784 13233 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_32211a88470c456982fd873c3dbe7972 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:56.581794 15748 consensus_queue.cc:237] T 796e01f6a36241fc94e335253929d6ab P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:56.582930 13614 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "c8bc6e07377a4ba99c39a909dae11402" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9"
W20250830 07:54:56.583292 13703 leader_election.cc:343] T c8bc6e07377a4ba99c39a909dae11402 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:56.583456 13228 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_419fdcf91b934420b06078d6a526e9c1" } new_table_name: "default.Table_6a912b90b0e24756911cb4b94a3b65a1" modify_external_catalogs: true
I20250830 07:54:56.583701 13882 tablet_bootstrap.cc:492] T 74f2fcc22fd545fb8ca7c20619843023 P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:54:56.583715 13234 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_5a48429e0b894a6ea2c01b3ce40de1e9" } new_table_name: "default.Table_d50436fb8a85449d86133dcf6dab1801" modify_external_catalogs: true
I20250830 07:54:56.583799 13882 ts_tablet_manager.cc:1397] T 74f2fcc22fd545fb8ca7c20619843023 P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.061s user 0.003s sys 0.000s
I20250830 07:54:56.584496 13882 raft_consensus.cc:357] T 74f2fcc22fd545fb8ca7c20619843023 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:56.584640 13882 raft_consensus.cc:383] T 74f2fcc22fd545fb8ca7c20619843023 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:56.584682 13882 raft_consensus.cc:738] T 74f2fcc22fd545fb8ca7c20619843023 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:54:56.584749 13229 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_fd8bb575e20442a9923c165ddce0de7d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:56.585219 13229 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fd8bb575e20442a9923c165ddce0de7d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:56.585584 15365 raft_consensus.cc:695] T 8cce7e5537794e9484f5a7c82b9e6e1d P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 LEADER]: Becoming Leader. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Running, Role: LEADER
I20250830 07:54:56.585530 13882 consensus_queue.cc:260] T 74f2fcc22fd545fb8ca7c20619843023 P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:56.585829 15365 consensus_queue.cc:237] T 8cce7e5537794e9484f5a7c82b9e6e1d P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:56.585942 13882 ts_tablet_manager.cc:1428] T 74f2fcc22fd545fb8ca7c20619843023 P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20250830 07:54:56.586259 13882 tablet_bootstrap.cc:492] T 8cce7e5537794e9484f5a7c82b9e6e1d P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:54:56.586848 13225 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_85d9b1d715184aa1b102f4b37eda2a7d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:56.587260 13225 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_85d9b1d715184aa1b102f4b37eda2a7d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:56.588017 13882 tablet_bootstrap.cc:654] T 8cce7e5537794e9484f5a7c82b9e6e1d P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:56.588620 13701 leader_election.cc:304] T a8660a6ff9254d4f9f0ef047b8682ed1 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:54:56.588985 15481 raft_consensus.cc:2802] T a8660a6ff9254d4f9f0ef047b8682ed1 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:54:56.589071 15481 raft_consensus.cc:491] T a8660a6ff9254d4f9f0ef047b8682ed1 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:54:56.589119 15481 raft_consensus.cc:3058] T a8660a6ff9254d4f9f0ef047b8682ed1 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:56.591409 15481 raft_consensus.cc:513] T a8660a6ff9254d4f9f0ef047b8682ed1 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:56.591902 15481 leader_election.cc:290] T a8660a6ff9254d4f9f0ef047b8682ed1 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Requested vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
I20250830 07:54:56.593044 15601 consensus_queue.cc:1035] T 74f2fcc22fd545fb8ca7c20619843023 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:54:56.593237 13701 leader_election.cc:304] T 1520d7257f864ea4ba4b9a5d0443f8a7 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:54:56.593466 15603 raft_consensus.cc:2802] T 1520d7257f864ea4ba4b9a5d0443f8a7 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:54:56.593528 15603 raft_consensus.cc:491] T 1520d7257f864ea4ba4b9a5d0443f8a7 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:54:56.593595 15603 raft_consensus.cc:3058] T 1520d7257f864ea4ba4b9a5d0443f8a7 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:56.593572 13701 leader_election.cc:304] T 7aed56dba39e40518e9c3325bcccd74a P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:54:56.593786 15720 raft_consensus.cc:2802] T 7aed56dba39e40518e9c3325bcccd74a P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:54:56.593864 15720 raft_consensus.cc:491] T 7aed56dba39e40518e9c3325bcccd74a P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:54:56.593919 15720 raft_consensus.cc:3058] T 7aed56dba39e40518e9c3325bcccd74a P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:56.595845 15603 raft_consensus.cc:513] T 1520d7257f864ea4ba4b9a5d0443f8a7 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:56.596199 15720 raft_consensus.cc:513] T 7aed56dba39e40518e9c3325bcccd74a P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:56.596324 15603 leader_election.cc:290] T 1520d7257f864ea4ba4b9a5d0443f8a7 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Requested vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967)
I20250830 07:54:56.596619 15720 leader_election.cc:290] T 7aed56dba39e40518e9c3325bcccd74a P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Requested vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
W20250830 07:54:56.599162 13228 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 7f7ea24fbf6e479fa54ad66cc569aa4d has no consensus state
I20250830 07:54:56.599525 13701 leader_election.cc:304] T 6ccbaf109e36453ea6645dfd090f5a1a P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:54:56.599759 15601 raft_consensus.cc:2802] T 6ccbaf109e36453ea6645dfd090f5a1a P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:54:56.599825 15601 raft_consensus.cc:491] T 6ccbaf109e36453ea6645dfd090f5a1a P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:54:56.599875 15601 raft_consensus.cc:3058] T 6ccbaf109e36453ea6645dfd090f5a1a P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:56.603229 15601 raft_consensus.cc:513] T 6ccbaf109e36453ea6645dfd090f5a1a P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:56.604072 15601 leader_election.cc:290] T 6ccbaf109e36453ea6645dfd090f5a1a P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Requested vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
I20250830 07:54:56.604544 15601 consensus_queue.cc:1035] T 713c12e1efec4e6f9895c65dc8a9c4b9 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:54:56.580482 13231 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_3b25430bc44b45959d0db3e2f570407f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250830 07:54:56.606302 15601 consensus_queue.cc:1035] T 10ec97b8a82145479e0bb526c4cc7c05 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20250830 07:54:56.606877 13234 catalog_manager.cc:5415] Ignoring report from unknown tablet 88bbd6b4c795433d9b6ad746353f3aa1
W20250830 07:54:56.607082 13234 catalog_manager.cc:5415] Ignoring report from unknown tablet 62bc8168176e4678a77827c5b7cc0f3e
W20250830 07:54:56.607161 13234 catalog_manager.cc:5415] Ignoring report from unknown tablet ec47a59c22ff4370bd21bc2a18336049
W20250830 07:54:56.607136 13422 leader_election.cc:343] T 5e2da5434e95445aa4deafce7fde0c6c P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:56.607307 13422 leader_election.cc:304] T 5e2da5434e95445aa4deafce7fde0c6c P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba; no voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:54:56.607709 15692 raft_consensus.cc:2747] T 5e2da5434e95445aa4deafce7fde0c6c P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:54:56.608531 13882 tablet_bootstrap.cc:492] T 8cce7e5537794e9484f5a7c82b9e6e1d P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:54:56.608646 13882 ts_tablet_manager.cc:1397] T 8cce7e5537794e9484f5a7c82b9e6e1d P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.022s user 0.003s sys 0.003s
I20250830 07:54:56.608243 13232 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_11cc7b1953e742b583ccd68b50f2b02c" } new_table_name: "default.Table_aad38fa5508e49eba813dc7658a0b410" modify_external_catalogs: true
I20250830 07:54:56.609261 13882 raft_consensus.cc:357] T 8cce7e5537794e9484f5a7c82b9e6e1d P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:56.609423 13882 raft_consensus.cc:383] T 8cce7e5537794e9484f5a7c82b9e6e1d P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:56.609474 13882 raft_consensus.cc:738] T 8cce7e5537794e9484f5a7c82b9e6e1d P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
W20250830 07:54:56.606865 13231 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3b25430bc44b45959d0db3e2f570407f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:56.609637 13882 consensus_queue.cc:260] T 8cce7e5537794e9484f5a7c82b9e6e1d P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:56.610967 13488 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "14d4d2506e2a47ea906bfb81d5509829" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:54:56.611169 13488 raft_consensus.cc:2466] T 14d4d2506e2a47ea906bfb81d5509829 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 0.
I20250830 07:54:56.611323 13882 ts_tablet_manager.cc:1428] T 8cce7e5537794e9484f5a7c82b9e6e1d P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20250830 07:54:56.611581 13882 tablet_bootstrap.cc:492] T 33701eeb12fc451d90ae0b1c4dd7d134 P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:54:56.613107 13882 tablet_bootstrap.cc:654] T 33701eeb12fc451d90ae0b1c4dd7d134 P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:56.614984 13614 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "a8660a6ff9254d4f9f0ef047b8682ed1" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9"
I20250830 07:54:56.615343 13475 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "a0cf1de8485941eb8a557a6e2f783047" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:54:56.615492 13614 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "1520d7257f864ea4ba4b9a5d0443f8a7" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9"
I20250830 07:54:56.615521 13475 raft_consensus.cc:2466] T a0cf1de8485941eb8a557a6e2f783047 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 0.
I20250830 07:54:56.615836 13614 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "7aed56dba39e40518e9c3325bcccd74a" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9"
I20250830 07:54:56.616479 13614 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "6ccbaf109e36453ea6645dfd090f5a1a" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9"
I20250830 07:54:56.616776 13481 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "76ab56c469cf4675a4e21acbe0a8085d" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba"
I20250830 07:54:56.616922 13481 raft_consensus.cc:3058] T 76ab56c469cf4675a4e21acbe0a8085d P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
W20250830 07:54:56.616925 13703 leader_election.cc:343] T a8660a6ff9254d4f9f0ef047b8682ed1 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
W20250830 07:54:56.617286 13703 leader_election.cc:343] T 1520d7257f864ea4ba4b9a5d0443f8a7 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
W20250830 07:54:56.617589 13703 leader_election.cc:343] T 7aed56dba39e40518e9c3325bcccd74a P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
W20250830 07:54:56.617965 13703 leader_election.cc:343] T 6ccbaf109e36453ea6645dfd090f5a1a P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:56.622112 13481 raft_consensus.cc:2466] T 76ab56c469cf4675a4e21acbe0a8085d P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 1.
I20250830 07:54:56.624743 13475 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "ee44ab24333742909f773889ad5c3e00" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba"
I20250830 07:54:56.624907 13475 raft_consensus.cc:3058] T ee44ab24333742909f773889ad5c3e00 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:56.625572 15748 consensus_queue.cc:1035] T 10ec97b8a82145479e0bb526c4cc7c05 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:54:56.629447 13475 raft_consensus.cc:2466] T ee44ab24333742909f773889ad5c3e00 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 1.
I20250830 07:54:56.629951 13487 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "1cf23cf78eee46be953bd701aa6bef07" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba"
I20250830 07:54:56.630149 13487 raft_consensus.cc:3058] T 1cf23cf78eee46be953bd701aa6bef07 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:56.632827 13764 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "a8660a6ff9254d4f9f0ef047b8682ed1" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f"
I20250830 07:54:56.632871 13766 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "1fee3e58f31b4befa42ffbb8d7bd6f4e" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:56.633008 13764 raft_consensus.cc:2391] T a8660a6ff9254d4f9f0ef047b8682ed1 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 2065c332f15a4739899af79f3669c3ba in current term 1: Already voted for candidate 9b057ade5dce45af9f8bf0bedf8b917f in this term.
I20250830 07:54:56.633179 13765 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "7aed56dba39e40518e9c3325bcccd74a" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f"
I20250830 07:54:56.633375 13765 raft_consensus.cc:2391] T 7aed56dba39e40518e9c3325bcccd74a P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 2065c332f15a4739899af79f3669c3ba in current term 1: Already voted for candidate 9b057ade5dce45af9f8bf0bedf8b917f in this term.
I20250830 07:54:56.633661 13487 raft_consensus.cc:2466] T 1cf23cf78eee46be953bd701aa6bef07 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 1.
I20250830 07:54:56.633960 13767 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "6ccbaf109e36453ea6645dfd090f5a1a" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f"
I20250830 07:54:56.634119 13767 raft_consensus.cc:2391] T 6ccbaf109e36453ea6645dfd090f5a1a P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 2065c332f15a4739899af79f3669c3ba in current term 1: Already voted for candidate 9b057ade5dce45af9f8bf0bedf8b917f in this term.
I20250830 07:54:56.638051 13234 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_72a17193f65e4e78a2ee269332a367a6" } modify_external_catalogs: true
I20250830 07:54:56.638259 13234 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_72a17193f65e4e78a2ee269332a367a6" } modify_external_catalogs: true
I20250830 07:54:56.643182 13882 tablet_bootstrap.cc:492] T 33701eeb12fc451d90ae0b1c4dd7d134 P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:54:56.643326 13882 ts_tablet_manager.cc:1397] T 33701eeb12fc451d90ae0b1c4dd7d134 P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.032s user 0.004s sys 0.005s
I20250830 07:54:56.644054 13882 raft_consensus.cc:357] T 33701eeb12fc451d90ae0b1c4dd7d134 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:56.644259 13882 raft_consensus.cc:383] T 33701eeb12fc451d90ae0b1c4dd7d134 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:56.644317 13882 raft_consensus.cc:738] T 33701eeb12fc451d90ae0b1c4dd7d134 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:54:56.644784 13882 consensus_queue.cc:260] T 33701eeb12fc451d90ae0b1c4dd7d134 P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:56.645359 13882 ts_tablet_manager.cc:1428] T 33701eeb12fc451d90ae0b1c4dd7d134 P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20250830 07:54:56.645666 13882 tablet_bootstrap.cc:492] T a7dc529c40544bafbc9e7f0ab34086bd P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
W20250830 07:54:56.651700 13703 consensus_peers.cc:489] T 0208de98277c4d6889fb0289b6013ae1 P 9b057ade5dce45af9f8bf0bedf8b917f -> Peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Couldn't send request to peer 6b5e454d98894637b466ea27f1b647f9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20250830 07:54:56.654693 13225 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_210a83c2790248a8a053d247d9c3aa65"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:56.655313 13225 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_210a83c2790248a8a053d247d9c3aa65 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:56.658962 13229 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_1bfca2f27a7149549305cc0d011ced0c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:56.659509 13229 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1bfca2f27a7149549305cc0d011ced0c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:56.662689 13228 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_a7fa8986aeef48c8853824d6a9d7444c" } new_table_name: "default.Table_8b5fb6aa121c499284d0108a23793dd4" modify_external_catalogs: true
I20250830 07:54:56.663336 15692 raft_consensus.cc:491] T d1d5e0d40a91457da65a0e925289309e P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:56.663465 15692 raft_consensus.cc:513] T d1d5e0d40a91457da65a0e925289309e P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:56.664052 15692 leader_election.cc:290] T d1d5e0d40a91457da65a0e925289309e P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:56.665650 13624 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "d1d5e0d40a91457da65a0e925289309e" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:56.666164 13764 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "0ac39adafe144280b39f5c3fe5804087" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:56.666419 13766 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "52df62f7f1aa4b38be89f6198cf01f24" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
W20250830 07:54:56.667518 13423 leader_election.cc:343] T d1d5e0d40a91457da65a0e925289309e P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:56.667520 13227 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_0bd285757a6146eabc2053757f950a0f" } new_table_name: "default.Table_20614f14cf6f4a60be8b268909984762" modify_external_catalogs: true
I20250830 07:54:56.678639 15748 consensus_queue.cc:1035] T ec47a59c22ff4370bd21bc2a18336049 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:54:56.680244 13701 leader_election.cc:304] T 14d4d2506e2a47ea906bfb81d5509829 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:54:56.680410 13234 catalog_manager.cc:5864] Not sending DeleteTablet requests; no consensus state for tablet 6623ea933c0a4f64a91dcd3d4c3483c9
I20250830 07:54:56.681680 15748 raft_consensus.cc:2802] T 14d4d2506e2a47ea906bfb81d5509829 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:54:56.681795 15748 raft_consensus.cc:491] T 14d4d2506e2a47ea906bfb81d5509829 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:54:56.681898 15748 raft_consensus.cc:3058] T 14d4d2506e2a47ea906bfb81d5509829 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:56.685810 15748 raft_consensus.cc:513] T 14d4d2506e2a47ea906bfb81d5509829 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:56.686537 15748 leader_election.cc:290] T 14d4d2506e2a47ea906bfb81d5509829 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Requested vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
I20250830 07:54:56.687192 13624 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "14d4d2506e2a47ea906bfb81d5509829" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9"
W20250830 07:54:56.688176 13703 leader_election.cc:343] T 14d4d2506e2a47ea906bfb81d5509829 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:56.700655 13225 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_9448db42e6794109b73536d8a0dd8264" } modify_external_catalogs: true
I20250830 07:54:56.700816 13225 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_9448db42e6794109b73536d8a0dd8264" } modify_external_catalogs: true
I20250830 07:54:56.702504 13486 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "852e353f6ee945628ddebdbdd1bd76fb" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba"
I20250830 07:54:56.702701 13486 raft_consensus.cc:3058] T 852e353f6ee945628ddebdbdd1bd76fb P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:56.706221 13486 raft_consensus.cc:2466] T 852e353f6ee945628ddebdbdd1bd76fb P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 1.
I20250830 07:54:56.707309 13234 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_210a83c2790248a8a053d247d9c3aa65" } modify_external_catalogs: true
I20250830 07:54:56.707479 13234 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_210a83c2790248a8a053d247d9c3aa65" } modify_external_catalogs: true
I20250830 07:54:56.718425 13231 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_9e79664b7b3a40c395755c0ff1ea6322" } modify_external_catalogs: true
I20250830 07:54:56.718605 13231 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_9e79664b7b3a40c395755c0ff1ea6322" } modify_external_catalogs: true
I20250830 07:54:56.724162 13233 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_c767906d4d3e4ac9857ef10eb4ca6fbb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250830 07:54:56.724365 13230 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_9f4d7e7e81254e7d8ebdf958fcdd54d6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:56.724740 13233 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c767906d4d3e4ac9857ef10eb4ca6fbb in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250830 07:54:56.724946 13230 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9f4d7e7e81254e7d8ebdf958fcdd54d6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:56.727689 13477 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f32ebc2605c34a68aed50379f028052c" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba"
I20250830 07:54:56.727901 13477 raft_consensus.cc:3058] T f32ebc2605c34a68aed50379f028052c P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:56.731142 13226 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_f898ce75325a436ca3a63a3c9e46fb68" } modify_external_catalogs: true
I20250830 07:54:56.731329 13226 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_f898ce75325a436ca3a63a3c9e46fb68" } modify_external_catalogs: true
I20250830 07:54:56.733852 13477 raft_consensus.cc:2466] T f32ebc2605c34a68aed50379f028052c P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 1.
I20250830 07:54:56.739717 13882 tablet_bootstrap.cc:654] T a7dc529c40544bafbc9e7f0ab34086bd P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:56.739853 13477 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f5baa35307a1425c8d52666d130d6d8a" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba"
I20250830 07:54:56.740087 13477 raft_consensus.cc:3058] T f5baa35307a1425c8d52666d130d6d8a P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:56.741328 13882 tablet_bootstrap.cc:492] T a7dc529c40544bafbc9e7f0ab34086bd P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:54:56.741444 13882 ts_tablet_manager.cc:1397] T a7dc529c40544bafbc9e7f0ab34086bd P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.096s user 0.004s sys 0.001s
I20250830 07:54:56.742110 13882 raft_consensus.cc:357] T a7dc529c40544bafbc9e7f0ab34086bd P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:56.742270 13882 raft_consensus.cc:383] T a7dc529c40544bafbc9e7f0ab34086bd P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:56.742311 13882 raft_consensus.cc:738] T a7dc529c40544bafbc9e7f0ab34086bd P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:54:56.742471 13882 consensus_queue.cc:260] T a7dc529c40544bafbc9e7f0ab34086bd P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:56.742861 13477 raft_consensus.cc:2466] T f5baa35307a1425c8d52666d130d6d8a P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 1.
I20250830 07:54:56.743032 13882 ts_tablet_manager.cc:1428] T a7dc529c40544bafbc9e7f0ab34086bd P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20250830 07:54:56.743364 13882 tablet_bootstrap.cc:492] T ef1ab62a5b7845e58d50f34206eaaa27 P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:54:56.744535 13487 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "db7144b25ff34bed8c7b779ba9497ef4" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba"
I20250830 07:54:56.744719 13487 raft_consensus.cc:3058] T db7144b25ff34bed8c7b779ba9497ef4 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:56.745083 13882 tablet_bootstrap.cc:654] T ef1ab62a5b7845e58d50f34206eaaa27 P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:56.745083 13482 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "c8bc6e07377a4ba99c39a909dae11402" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba"
I20250830 07:54:56.745231 13482 raft_consensus.cc:3058] T c8bc6e07377a4ba99c39a909dae11402 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:56.746997 13487 raft_consensus.cc:2466] T db7144b25ff34bed8c7b779ba9497ef4 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 1.
I20250830 07:54:56.747610 13486 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "e72402ca3cdf452fa8f4534c67226253" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:54:56.747794 13486 raft_consensus.cc:2466] T e72402ca3cdf452fa8f4534c67226253 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 0.
I20250830 07:54:56.748059 13482 raft_consensus.cc:2466] T c8bc6e07377a4ba99c39a909dae11402 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 1.
I20250830 07:54:56.748777 13482 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "a8660a6ff9254d4f9f0ef047b8682ed1" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba"
I20250830 07:54:56.749050 13482 raft_consensus.cc:2391] T a8660a6ff9254d4f9f0ef047b8682ed1 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 9b057ade5dce45af9f8bf0bedf8b917f in current term 1: Already voted for candidate 2065c332f15a4739899af79f3669c3ba in this term.
I20250830 07:54:56.750978 13674 heartbeater.cc:344] Connected to a master server at 127.12.209.60:43889
I20250830 07:54:56.755380 13611 raft_consensus.cc:3058] T 924403105a6a40f28aad60647a2a8987 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:56.758293 15692 raft_consensus.cc:491] T 33701eeb12fc451d90ae0b1c4dd7d134 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:56.758452 15692 raft_consensus.cc:513] T 33701eeb12fc451d90ae0b1c4dd7d134 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:56.759234 15692 leader_election.cc:290] T 33701eeb12fc451d90ae0b1c4dd7d134 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:56.760047 13614 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "33701eeb12fc451d90ae0b1c4dd7d134" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:56.760310 13614 raft_consensus.cc:2466] T 33701eeb12fc451d90ae0b1c4dd7d134 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2065c332f15a4739899af79f3669c3ba in term 0.
I20250830 07:54:56.760344 13229 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_705d1371b7fd40a689957a23b3c46363"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:56.760870 13229 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_705d1371b7fd40a689957a23b3c46363 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:56.760864 13423 leader_election.cc:304] T 33701eeb12fc451d90ae0b1c4dd7d134 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 6b5e454d98894637b466ea27f1b647f9; no voters:
I20250830 07:54:56.761159 15602 raft_consensus.cc:2802] T 33701eeb12fc451d90ae0b1c4dd7d134 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader pre-election won for term 2
I20250830 07:54:56.761250 15602 raft_consensus.cc:491] T 33701eeb12fc451d90ae0b1c4dd7d134 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:54:56.761332 15602 raft_consensus.cc:3058] T 33701eeb12fc451d90ae0b1c4dd7d134 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Advancing to term 2
I20250830 07:54:56.764406 15602 raft_consensus.cc:513] T 33701eeb12fc451d90ae0b1c4dd7d134 P 2065c332f15a4739899af79f3669c3ba [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:56.765213 15602 leader_election.cc:290] T 33701eeb12fc451d90ae0b1c4dd7d134 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 2 election: Requested vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:56.765807 13614 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "33701eeb12fc451d90ae0b1c4dd7d134" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9"
I20250830 07:54:56.766047 13614 raft_consensus.cc:3058] T 33701eeb12fc451d90ae0b1c4dd7d134 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Advancing to term 2
I20250830 07:54:56.768554 13482 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "1520d7257f864ea4ba4b9a5d0443f8a7" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba"
I20250830 07:54:56.768846 13482 raft_consensus.cc:3058] T 1520d7257f864ea4ba4b9a5d0443f8a7 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:56.769346 13614 raft_consensus.cc:2466] T 33701eeb12fc451d90ae0b1c4dd7d134 P 6b5e454d98894637b466ea27f1b647f9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2065c332f15a4739899af79f3669c3ba in term 2.
I20250830 07:54:56.771139 13423 leader_election.cc:304] T 33701eeb12fc451d90ae0b1c4dd7d134 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 6b5e454d98894637b466ea27f1b647f9; no voters:
I20250830 07:54:56.771482 15602 raft_consensus.cc:2802] T 33701eeb12fc451d90ae0b1c4dd7d134 P 2065c332f15a4739899af79f3669c3ba [term 2 FOLLOWER]: Leader election won for term 2
I20250830 07:54:56.771754 15602 raft_consensus.cc:695] T 33701eeb12fc451d90ae0b1c4dd7d134 P 2065c332f15a4739899af79f3669c3ba [term 2 LEADER]: Becoming Leader. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Running, Role: LEADER
I20250830 07:54:56.772078 15602 consensus_queue.cc:237] T 33701eeb12fc451d90ae0b1c4dd7d134 P 2065c332f15a4739899af79f3669c3ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:56.773723 13482 raft_consensus.cc:2466] T 1520d7257f864ea4ba4b9a5d0443f8a7 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 1.
I20250830 07:54:56.777093 13486 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "6ccbaf109e36453ea6645dfd090f5a1a" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba"
I20250830 07:54:56.777310 13486 raft_consensus.cc:2391] T 6ccbaf109e36453ea6645dfd090f5a1a P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 9b057ade5dce45af9f8bf0bedf8b917f in current term 1: Already voted for candidate 2065c332f15a4739899af79f3669c3ba in this term.
I20250830 07:54:56.777804 13482 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "7aed56dba39e40518e9c3325bcccd74a" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba"
I20250830 07:54:56.778054 13482 raft_consensus.cc:2391] T 7aed56dba39e40518e9c3325bcccd74a P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 9b057ade5dce45af9f8bf0bedf8b917f in current term 1: Already voted for candidate 2065c332f15a4739899af79f3669c3ba in this term.
W20250830 07:54:56.787233 13228 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet abac856cdaa747f7a162d57c607a359c has no consensus state
I20250830 07:54:56.792325 13225 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet 73692fe73235422dbbb342caabfb0927
W20250830 07:54:56.792577 13129 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerService.ListTablets -> {remote=127.12.209.2:38967, user_credentials={real_user=slave}} blocked reactor thread for 261981us
W20250830 07:54:56.793356 13227 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 53b439ae9c434041a65420391df79d6b has no consensus state
I20250830 07:54:56.793627 15580 raft_consensus.cc:491] T 23d2c7013c9c4b4aacf47e6ac7ab5a0b P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:56.793771 15580 raft_consensus.cc:513] T 23d2c7013c9c4b4aacf47e6ac7ab5a0b P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:56.794466 15580 leader_election.cc:290] T 23d2c7013c9c4b4aacf47e6ac7ab5a0b P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:56.798007 13593 tablet_service.cc:1515] Processing DeleteTablet for tablet 73692fe73235422dbbb342caabfb0927 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:56 UTC) from {username='slave'} at 127.0.0.1:45306
W20250830 07:54:56.800469 13220 catalog_manager.cc:4908] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet 73692fe73235422dbbb342caabfb0927 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 73692fe73235422dbbb342caabfb0927 already in progress: creating tablet
I20250830 07:54:56.801132 13227 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_dbdb8dfe975a4b7ca9a3710c02518cc9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250830 07:54:56.801204 13225 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_8da130847b584d7aa7b07f7c3b6dcf88"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:56.801638 13227 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_dbdb8dfe975a4b7ca9a3710c02518cc9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250830 07:54:56.801640 13225 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8da130847b584d7aa7b07f7c3b6dcf88 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:56.805109 13228 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_92300192de164f969afb0aeaebfd701f" } new_table_name: "default.Table_ffc2a253a4db48708e1f05a732742751" modify_external_catalogs: true
I20250830 07:54:56.808095 13482 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "23d2c7013c9c4b4aacf47e6ac7ab5a0b" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:54:56.808369 13482 raft_consensus.cc:2391] T 23d2c7013c9c4b4aacf47e6ac7ab5a0b P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b5e454d98894637b466ea27f1b647f9 in current term 1: Already voted for candidate 9b057ade5dce45af9f8bf0bedf8b917f in this term.
I20250830 07:54:56.815035 13774 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "23d2c7013c9c4b4aacf47e6ac7ab5a0b" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:56.819473 13886 tablet_bootstrap.cc:492] T 5fee48de90014f94b796e726a4d16b85 P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:54:56.822033 13886 ts_tablet_manager.cc:1397] T 5fee48de90014f94b796e726a4d16b85 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.270s user 0.052s sys 0.066s
I20250830 07:54:56.824455 13886 raft_consensus.cc:357] T 5fee48de90014f94b796e726a4d16b85 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:56.825455 13479 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "14d4d2506e2a47ea906bfb81d5509829" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba"
I20250830 07:54:56.825646 13479 raft_consensus.cc:3058] T 14d4d2506e2a47ea906bfb81d5509829 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:56.827186 13562 leader_election.cc:304] T 23d2c7013c9c4b4aacf47e6ac7ab5a0b P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b5e454d98894637b466ea27f1b647f9; no voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:54:56.827644 15580 raft_consensus.cc:3058] T 23d2c7013c9c4b4aacf47e6ac7ab5a0b P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:56.828694 13479 raft_consensus.cc:2466] T 14d4d2506e2a47ea906bfb81d5509829 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 1.
I20250830 07:54:56.829015 13886 raft_consensus.cc:383] T 5fee48de90014f94b796e726a4d16b85 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:56.829094 13886 raft_consensus.cc:738] T 5fee48de90014f94b796e726a4d16b85 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:54:56.829322 13886 consensus_queue.cc:260] T 5fee48de90014f94b796e726a4d16b85 P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:56.829982 15580 raft_consensus.cc:2747] T 23d2c7013c9c4b4aacf47e6ac7ab5a0b P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:54:56.831440 13886 ts_tablet_manager.cc:1428] T 5fee48de90014f94b796e726a4d16b85 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.008s user 0.000s sys 0.002s
I20250830 07:54:56.832551 13886 tablet_bootstrap.cc:492] T 579324e1f6474d398db10da3093650dd P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:54:56.842252 15721 raft_consensus.cc:491] T 240a6bfad8fa478598a67a27c2dedf62 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:56.842424 15721 raft_consensus.cc:513] T 240a6bfad8fa478598a67a27c2dedf62 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:56.843060 15721 leader_election.cc:290] T 240a6bfad8fa478598a67a27c2dedf62 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
I20250830 07:54:56.843295 13611 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "240a6bfad8fa478598a67a27c2dedf62" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
W20250830 07:54:56.843703 13703 leader_election.cc:343] T 240a6bfad8fa478598a67a27c2dedf62 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:56.851634 13479 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "240a6bfad8fa478598a67a27c2dedf62" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:54:56.851809 13479 raft_consensus.cc:2466] T 240a6bfad8fa478598a67a27c2dedf62 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 0.
I20250830 07:54:56.852545 15721 consensus_queue.cc:1035] T db4077bf8e184ac5809ef629222f2cc5 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:54:56.872476 13234 catalog_manager.cc:5864] Not sending DeleteTablet requests; no consensus state for tablet fe147fdf37d648dba5cd819835527958
I20250830 07:54:56.890484 13886 tablet_bootstrap.cc:654] T 579324e1f6474d398db10da3093650dd P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:56.901944 13701 leader_election.cc:304] T a0cf1de8485941eb8a557a6e2f783047 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:54:56.902341 15721 raft_consensus.cc:2802] T a0cf1de8485941eb8a557a6e2f783047 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:54:56.902455 15721 raft_consensus.cc:491] T a0cf1de8485941eb8a557a6e2f783047 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:54:56.902560 15721 raft_consensus.cc:3058] T a0cf1de8485941eb8a557a6e2f783047 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
W20250830 07:54:56.904641 13701 leader_election.cc:343] T 4d4b00bdadb24ec892d87c9be2ed7dd9 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): Not found: Tablet not found: 4d4b00bdadb24ec892d87c9be2ed7dd9
W20250830 07:54:56.907511 13234 catalog_manager.cc:5415] Ignoring report from unknown tablet 8cce7e5537794e9484f5a7c82b9e6e1d
I20250830 07:54:56.908378 13701 leader_election.cc:304] T 4d4b00bdadb24ec892d87c9be2ed7dd9 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 2065c332f15a4739899af79f3669c3ba, 6b5e454d98894637b466ea27f1b647f9
I20250830 07:54:56.908262 13234 catalog_manager.cc:5582] T 52e910677ae34630a919d1d3f21b7e83 P 9b057ade5dce45af9f8bf0bedf8b917f reported cstate change: term changed from 0 to 1, leader changed from <none> to 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3). New cstate: current_term: 1 leader_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } health_report { overall_health: HEALTHY } } }
I20250830 07:54:56.908723 15748 raft_consensus.cc:2747] T 4d4b00bdadb24ec892d87c9be2ed7dd9 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:54:56.908929 13701 leader_election.cc:304] T 76ab56c469cf4675a4e21acbe0a8085d P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:54:56.908926 13234 catalog_manager.cc:5674] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743) does not have the latest schema for tablet 52e910677ae34630a919d1d3f21b7e83 (table default.Table_96df3a05fc564aba9ae2d0e0f1e94abb [id=b3fced981b2a4b44a8eab43675699ba5]). Expected version 1 got 0
I20250830 07:54:56.909147 15601 raft_consensus.cc:2802] T 76ab56c469cf4675a4e21acbe0a8085d P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election won for term 1
I20250830 07:54:56.909313 15601 raft_consensus.cc:695] T 76ab56c469cf4675a4e21acbe0a8085d P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 LEADER]: Becoming Leader. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Running, Role: LEADER
I20250830 07:54:56.909314 15721 raft_consensus.cc:513] T a0cf1de8485941eb8a557a6e2f783047 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:56.909641 15601 consensus_queue.cc:237] T 76ab56c469cf4675a4e21acbe0a8085d P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:56.909933 15721 leader_election.cc:290] T a0cf1de8485941eb8a557a6e2f783047 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Requested vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
I20250830 07:54:56.907534 13886 tablet_bootstrap.cc:492] T 579324e1f6474d398db10da3093650dd P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:54:56.910473 13886 ts_tablet_manager.cc:1397] T 579324e1f6474d398db10da3093650dd P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.078s user 0.010s sys 0.002s
I20250830 07:54:56.911207 13624 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "a0cf1de8485941eb8a557a6e2f783047" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9"
W20250830 07:54:56.911846 13703 leader_election.cc:343] T a0cf1de8485941eb8a557a6e2f783047 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:56.911923 13886 raft_consensus.cc:357] T 579324e1f6474d398db10da3093650dd P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:56.912268 13886 raft_consensus.cc:383] T 579324e1f6474d398db10da3093650dd P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:56.912416 13886 raft_consensus.cc:738] T 579324e1f6474d398db10da3093650dd P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:54:56.912698 13886 consensus_queue.cc:260] T 579324e1f6474d398db10da3093650dd P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:56.913918 13886 ts_tablet_manager.cc:1428] T 579324e1f6474d398db10da3093650dd P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20250830 07:54:56.914376 13886 tablet_bootstrap.cc:492] T f332d1b56d924c91a79cf6572dea1cd2 P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:54:56.912392 13701 leader_election.cc:304] T ee44ab24333742909f773889ad5c3e00 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:54:56.914705 15481 raft_consensus.cc:2802] T ee44ab24333742909f773889ad5c3e00 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election won for term 1
I20250830 07:54:56.914872 15481 raft_consensus.cc:695] T ee44ab24333742909f773889ad5c3e00 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 LEADER]: Becoming Leader. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Running, Role: LEADER
I20250830 07:54:56.915127 15481 consensus_queue.cc:237] T ee44ab24333742909f773889ad5c3e00 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:56.916641 13701 leader_election.cc:304] T 1cf23cf78eee46be953bd701aa6bef07 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:54:56.918030 15720 raft_consensus.cc:2802] T 1cf23cf78eee46be953bd701aa6bef07 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election won for term 1
I20250830 07:54:56.918146 15720 raft_consensus.cc:695] T 1cf23cf78eee46be953bd701aa6bef07 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 LEADER]: Becoming Leader. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Running, Role: LEADER
I20250830 07:54:56.918380 15720 consensus_queue.cc:237] T 1cf23cf78eee46be953bd701aa6bef07 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:56.929337 13701 leader_election.cc:304] T 852e353f6ee945628ddebdbdd1bd76fb P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:54:56.929682 15603 raft_consensus.cc:2802] T 852e353f6ee945628ddebdbdd1bd76fb P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election won for term 1
I20250830 07:54:56.929818 15603 raft_consensus.cc:695] T 852e353f6ee945628ddebdbdd1bd76fb P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 LEADER]: Becoming Leader. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Running, Role: LEADER
I20250830 07:54:56.930065 15603 consensus_queue.cc:237] T 852e353f6ee945628ddebdbdd1bd76fb P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
W20250830 07:54:56.931278 13703 consensus_peers.cc:489] T f66e1d07039841088a444ee0203a4eb0 P 9b057ade5dce45af9f8bf0bedf8b917f -> Peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Couldn't send request to peer 6b5e454d98894637b466ea27f1b647f9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20250830 07:54:56.933734 13231 catalog_manager.cc:5864] Not sending DeleteTablet requests; no consensus state for tablet 9b311dd5dd9b462dbc3610735571ad97
W20250830 07:54:56.942639 13703 consensus_peers.cc:489] T 689b4fee1dd04b3d9ccdea334b0f6b59 P 9b057ade5dce45af9f8bf0bedf8b917f -> Peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Couldn't send request to peer 6b5e454d98894637b466ea27f1b647f9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20250830 07:54:56.943684 13701 leader_election.cc:304] T f32ebc2605c34a68aed50379f028052c P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:54:56.944314 15365 raft_consensus.cc:2802] T f32ebc2605c34a68aed50379f028052c P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election won for term 1
I20250830 07:54:56.944473 15365 raft_consensus.cc:695] T f32ebc2605c34a68aed50379f028052c P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 LEADER]: Becoming Leader. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Running, Role: LEADER
I20250830 07:54:56.944734 15365 consensus_queue.cc:237] T f32ebc2605c34a68aed50379f028052c P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:56.945801 13701 leader_election.cc:304] T f5baa35307a1425c8d52666d130d6d8a P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:54:56.946348 15721 raft_consensus.cc:2802] T f5baa35307a1425c8d52666d130d6d8a P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election won for term 1
I20250830 07:54:56.946601 15721 raft_consensus.cc:695] T f5baa35307a1425c8d52666d130d6d8a P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 LEADER]: Becoming Leader. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Running, Role: LEADER
I20250830 07:54:56.946983 15721 consensus_queue.cc:237] T f5baa35307a1425c8d52666d130d6d8a P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:56.948881 13231 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_28716897573f402b896cfe17e09e821e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:56.949654 13231 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_28716897573f402b896cfe17e09e821e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:56.951632 13624 raft_consensus.cc:3058] T 74f2fcc22fd545fb8ca7c20619843023 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:56.946333 13701 leader_election.cc:304] T db7144b25ff34bed8c7b779ba9497ef4 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:54:56.961575 13701 leader_election.cc:304] T e72402ca3cdf452fa8f4534c67226253 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:54:56.969395 13882 tablet_bootstrap.cc:492] T ef1ab62a5b7845e58d50f34206eaaa27 P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:54:56.969534 13882 ts_tablet_manager.cc:1397] T ef1ab62a5b7845e58d50f34206eaaa27 P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.226s user 0.059s sys 0.045s
I20250830 07:54:56.970005 13701 leader_election.cc:304] T c8bc6e07377a4ba99c39a909dae11402 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:54:56.970261 13882 raft_consensus.cc:357] T ef1ab62a5b7845e58d50f34206eaaa27 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:56.970440 13882 raft_consensus.cc:383] T ef1ab62a5b7845e58d50f34206eaaa27 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:56.970504 13882 raft_consensus.cc:738] T ef1ab62a5b7845e58d50f34206eaaa27 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:54:56.970686 13882 consensus_queue.cc:260] T ef1ab62a5b7845e58d50f34206eaaa27 P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:56.971230 13882 ts_tablet_manager.cc:1428] T ef1ab62a5b7845e58d50f34206eaaa27 P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20250830 07:54:56.974078 13233 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_e40b329adbd0475da2669620084f75f3" } new_table_name: "default.Table_9744ec4fb62e42fa958d8b7017e21638" modify_external_catalogs: true
I20250830 07:54:56.974442 13887 tablet_bootstrap.cc:654] T 3bca390f6d4343cba7a9fb07f0d4d72b P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:56.978924 15692 raft_consensus.cc:491] T bdeb89bbb3ad4e67bbc74b78454eeb7e P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:56.979092 15692 raft_consensus.cc:513] T bdeb89bbb3ad4e67bbc74b78454eeb7e P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:56.979658 15692 leader_election.cc:290] T bdeb89bbb3ad4e67bbc74b78454eeb7e P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:56.986315 15691 raft_consensus.cc:491] T 2c4c3c61cddf42668d3a09f4fbc5f641 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:56.986451 15691 raft_consensus.cc:513] T 2c4c3c61cddf42668d3a09f4fbc5f641 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:56.989079 15748 raft_consensus.cc:2802] T c8bc6e07377a4ba99c39a909dae11402 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election won for term 1
I20250830 07:54:56.989233 15748 raft_consensus.cc:695] T c8bc6e07377a4ba99c39a909dae11402 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 LEADER]: Becoming Leader. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Running, Role: LEADER
I20250830 07:54:56.989441 13617 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "bdeb89bbb3ad4e67bbc74b78454eeb7e" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:56.989441 15748 consensus_queue.cc:237] T c8bc6e07377a4ba99c39a909dae11402 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:56.989780 13612 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "2c4c3c61cddf42668d3a09f4fbc5f641" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:56.986901 15691 leader_election.cc:290] T 2c4c3c61cddf42668d3a09f4fbc5f641 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
W20250830 07:54:56.992693 13423 leader_election.cc:343] T bdeb89bbb3ad4e67bbc74b78454eeb7e P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
W20250830 07:54:56.995188 13423 leader_election.cc:343] T 2c4c3c61cddf42668d3a09f4fbc5f641 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:56.970260 15721 raft_consensus.cc:2802] T e72402ca3cdf452fa8f4534c67226253 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:54:56.998327 15721 raft_consensus.cc:491] T e72402ca3cdf452fa8f4534c67226253 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:54:56.998805 15721 raft_consensus.cc:3058] T e72402ca3cdf452fa8f4534c67226253 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:57.000553 13230 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_e03241b2fa63405c912bbcd72ca3f624"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:57.001246 13230 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e03241b2fa63405c912bbcd72ca3f624 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:57.003336 15721 raft_consensus.cc:513] T e72402ca3cdf452fa8f4534c67226253 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
W20250830 07:54:57.027608 13232 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a76bbbeca3204dab9c91196ffa4afe3f has no consensus state
I20250830 07:54:57.027770 13226 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet 74891b8103e144c486750f64ba2003f4
I20250830 07:54:57.028343 13232 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_cf79c854ef5e48af88e783ba77a7f44e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:57.028973 13232 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_cf79c854ef5e48af88e783ba77a7f44e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:57.029232 13229 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_4f24e897a6914b32949c3b35b80e7325"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250830 07:54:57.029407 13227 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_60a94b2ace9442dc9d84c0efd2d6133c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:57.029664 13229 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4f24e897a6914b32949c3b35b80e7325 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250830 07:54:57.029706 13227 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_60a94b2ace9442dc9d84c0efd2d6133c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:57.030309 13233 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_d63b9139d2864f4180dc5b7f59a0f5dc" } new_table_name: "default.Table_ff1179085e4741c98ed3ab753e79700e" modify_external_catalogs: true
I20250830 07:54:57.030978 13225 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_4846e70f774243ec9dc46669ac7b5981" } modify_external_catalogs: true
I20250830 07:54:57.031107 13225 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_4846e70f774243ec9dc46669ac7b5981" } modify_external_catalogs: true
W20250830 07:54:57.032071 13228 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d171ad1667fa44c993ec5fd7d701d8e0 consensus state has no leader
I20250830 07:54:57.032356 13228 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_2c3d98e1b934440cb04c8887c22cdb2b" } new_table_name: "default.Table_e5fe177b593d41d7907bfa9b80ea40bf" modify_external_catalogs: true
I20250830 07:54:57.028388 13226 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_55453fb8fd9d4e6b8091ed37e1885c1d" } modify_external_catalogs: true
I20250830 07:54:57.034793 13226 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_55453fb8fd9d4e6b8091ed37e1885c1d" } modify_external_catalogs: true
I20250830 07:54:57.037668 13593 tablet_service.cc:1515] Processing DeleteTablet for tablet 74891b8103e144c486750f64ba2003f4 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:56 UTC) from {username='slave'} at 127.0.0.1:45306
I20250830 07:54:57.037931 15721 leader_election.cc:290] T e72402ca3cdf452fa8f4534c67226253 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Requested vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
I20250830 07:54:57.037979 15753 tablet_replica.cc:331] T 74891b8103e144c486750f64ba2003f4 P 6b5e454d98894637b466ea27f1b647f9: stopping tablet replica
I20250830 07:54:56.961917 15481 raft_consensus.cc:2802] T db7144b25ff34bed8c7b779ba9497ef4 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election won for term 1
I20250830 07:54:57.038136 15481 raft_consensus.cc:695] T db7144b25ff34bed8c7b779ba9497ef4 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 LEADER]: Becoming Leader. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Running, Role: LEADER
I20250830 07:54:57.038177 15753 raft_consensus.cc:2241] T 74891b8103e144c486750f64ba2003f4 P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250830 07:54:57.038353 15753 raft_consensus.cc:2270] T 74891b8103e144c486750f64ba2003f4 P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250830 07:54:57.038429 15481 consensus_queue.cc:237] T db7144b25ff34bed8c7b779ba9497ef4 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:57.038836 15753 ts_tablet_manager.cc:1905] T 74891b8103e144c486750f64ba2003f4 P 6b5e454d98894637b466ea27f1b647f9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250830 07:54:57.038899 13629 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "e72402ca3cdf452fa8f4534c67226253" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9"
W20250830 07:54:57.039372 13703 leader_election.cc:343] T e72402ca3cdf452fa8f4534c67226253 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
W20250830 07:54:57.049427 13220 catalog_manager.cc:4726] Async tablet task AlterTable RPC for tablet 53b439ae9c434041a65420391df79d6b (table default.Table_20614f14cf6f4a60be8b268909984762 [id=5a4799be021845caa12248826e383540], current schema version=2) failed: Not found: failed to reset TS proxy: No leader found: Tablet 53b439ae9c434041a65420391df79d6b has no consensus state
I20250830 07:54:57.011623 13886 tablet_bootstrap.cc:654] T f332d1b56d924c91a79cf6572dea1cd2 P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:57.050379 15753 ts_tablet_manager.cc:1918] T 74891b8103e144c486750f64ba2003f4 P 6b5e454d98894637b466ea27f1b647f9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250830 07:54:57.059194 15753 log.cc:1199] T 74891b8103e144c486750f64ba2003f4 P 6b5e454d98894637b466ea27f1b647f9: Deleting WAL directory at /tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/ts-1/wal/wals/74891b8103e144c486750f64ba2003f4
I20250830 07:54:57.059600 15753 ts_tablet_manager.cc:1939] T 74891b8103e144c486750f64ba2003f4 P 6b5e454d98894637b466ea27f1b647f9: Deleting consensus metadata
I20250830 07:54:57.012086 13701 leader_election.cc:304] T a8660a6ff9254d4f9f0ef047b8682ed1 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 2065c332f15a4739899af79f3669c3ba, 6b5e454d98894637b466ea27f1b647f9
I20250830 07:54:57.060125 15720 raft_consensus.cc:2747] T a8660a6ff9254d4f9f0ef047b8682ed1 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20250830 07:54:57.060109 13220 catalog_manager.cc:4928] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): tablet 74891b8103e144c486750f64ba2003f4 (table default.Table_f898ce75325a436ca3a63a3c9e46fb68 [id=63f62da0ba61488791fcce76368d92a8]) successfully deleted
W20250830 07:54:57.060478 13701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.209.1:45325, user_credentials={real_user=slave}} blocked reactor thread for 48432.5us
I20250830 07:54:57.061051 13701 leader_election.cc:304] T 1520d7257f864ea4ba4b9a5d0443f8a7 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:54:57.061385 15603 raft_consensus.cc:2802] T 1520d7257f864ea4ba4b9a5d0443f8a7 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election won for term 1
I20250830 07:54:57.061540 13701 leader_election.cc:304] T 6ccbaf109e36453ea6645dfd090f5a1a P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 2065c332f15a4739899af79f3669c3ba, 6b5e454d98894637b466ea27f1b647f9
I20250830 07:54:57.061662 15603 raft_consensus.cc:695] T 1520d7257f864ea4ba4b9a5d0443f8a7 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 LEADER]: Becoming Leader. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Running, Role: LEADER
I20250830 07:54:57.061939 15603 consensus_queue.cc:237] T 1520d7257f864ea4ba4b9a5d0443f8a7 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:57.067957 13887 tablet_bootstrap.cc:492] T 3bca390f6d4343cba7a9fb07f0d4d72b P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:54:57.068239 13887 ts_tablet_manager.cc:1397] T 3bca390f6d4343cba7a9fb07f0d4d72b P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.488s user 0.005s sys 0.010s
I20250830 07:54:57.069409 13887 raft_consensus.cc:357] T 3bca390f6d4343cba7a9fb07f0d4d72b P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:57.069703 13887 raft_consensus.cc:383] T 3bca390f6d4343cba7a9fb07f0d4d72b P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:57.069875 13887 raft_consensus.cc:738] T 3bca390f6d4343cba7a9fb07f0d4d72b P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:54:57.070374 13887 consensus_queue.cc:260] T 3bca390f6d4343cba7a9fb07f0d4d72b P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:57.071414 13887 ts_tablet_manager.cc:1428] T 3bca390f6d4343cba7a9fb07f0d4d72b P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20250830 07:54:57.071993 13887 tablet_bootstrap.cc:492] T cd9903bdfaef4139a1a582c54689da4a P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:54:57.074113 15720 raft_consensus.cc:2747] T 6ccbaf109e36453ea6645dfd090f5a1a P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20250830 07:54:57.074919 15720 raft_consensus.cc:491] T 15f8fd7d9e6242c6b6c51251d618ef09 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:57.075126 15720 raft_consensus.cc:513] T 15f8fd7d9e6242c6b6c51251d618ef09 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:57.075613 15601 raft_consensus.cc:491] T 2b4103f07e96490488913059a95af0c3 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:57.075752 15601 raft_consensus.cc:513] T 2b4103f07e96490488913059a95af0c3 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:57.076292 15601 leader_election.cc:290] T 2b4103f07e96490488913059a95af0c3 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
I20250830 07:54:57.076511 15720 leader_election.cc:290] T 15f8fd7d9e6242c6b6c51251d618ef09 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
I20250830 07:54:57.076720 13611 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "2b4103f07e96490488913059a95af0c3" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:57.077148 13231 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_f88f668ca762440d8896c47135e154ba" } modify_external_catalogs: true
W20250830 07:54:57.077275 13703 leader_election.cc:343] T 2b4103f07e96490488913059a95af0c3 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:57.077355 13231 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_f88f668ca762440d8896c47135e154ba" } modify_external_catalogs: true
I20250830 07:54:57.077519 13622 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "15f8fd7d9e6242c6b6c51251d618ef09" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:57.077657 13887 tablet_bootstrap.cc:654] T cd9903bdfaef4139a1a582c54689da4a P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
W20250830 07:54:57.077988 13703 leader_election.cc:343] T 15f8fd7d9e6242c6b6c51251d618ef09 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:57.078321 13701 leader_election.cc:304] T 7aed56dba39e40518e9c3325bcccd74a P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 2065c332f15a4739899af79f3669c3ba, 6b5e454d98894637b466ea27f1b647f9
I20250830 07:54:57.078601 15608 raft_consensus.cc:2747] T 7aed56dba39e40518e9c3325bcccd74a P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20250830 07:54:57.098598 13882 tablet_bootstrap.cc:492] T 7aed56dba39e40518e9c3325bcccd74a P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
W20250830 07:54:57.101763 13233 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 082e7497e5bc419c807dd2f98d371d9c has no consensus state
I20250830 07:54:57.102208 15721 consensus_queue.cc:1035] T a7dc529c40544bafbc9e7f0ab34086bd P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:54:57.102944 13226 catalog_manager.cc:5864] Not sending DeleteTablet requests; no consensus state for tablet a3b823e6e9584bb8a896bf0ad6944201
I20250830 07:54:57.102231 13701 leader_election.cc:304] T 14d4d2506e2a47ea906bfb81d5509829 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:54:57.104759 15721 raft_consensus.cc:2802] T 14d4d2506e2a47ea906bfb81d5509829 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election won for term 1
W20250830 07:54:57.104806 13228 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 2a3387561c594c7ca2676ed1e307d3f4 has no consensus state
I20250830 07:54:57.104980 15721 raft_consensus.cc:695] T 14d4d2506e2a47ea906bfb81d5509829 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 LEADER]: Becoming Leader. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Running, Role: LEADER
I20250830 07:54:57.105188 13225 catalog_manager.cc:5864] Not sending DeleteTablet requests; no consensus state for tablet e9c7bb1931de4c1a84e0f9ffc22ae378
I20250830 07:54:57.105232 15721 consensus_queue.cc:237] T 14d4d2506e2a47ea906bfb81d5509829 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:57.108572 13231 catalog_manager.cc:5864] Not sending DeleteTablet requests; no consensus state for tablet e2e92957ca6b498c9fd76a97225492d5
I20250830 07:54:57.118245 13886 tablet_bootstrap.cc:492] T f332d1b56d924c91a79cf6572dea1cd2 P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:54:57.118777 13886 ts_tablet_manager.cc:1397] T f332d1b56d924c91a79cf6572dea1cd2 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.205s user 0.004s sys 0.000s
I20250830 07:54:57.119715 13886 raft_consensus.cc:357] T f332d1b56d924c91a79cf6572dea1cd2 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:57.120059 13886 raft_consensus.cc:383] T f332d1b56d924c91a79cf6572dea1cd2 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:57.120203 13886 raft_consensus.cc:738] T f332d1b56d924c91a79cf6572dea1cd2 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:54:57.120582 13886 consensus_queue.cc:260] T f332d1b56d924c91a79cf6572dea1cd2 P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:57.121479 13886 ts_tablet_manager.cc:1428] T f332d1b56d924c91a79cf6572dea1cd2 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20250830 07:54:57.121879 13886 tablet_bootstrap.cc:492] T 208995abd6d44dbea3b5ebbea27d6a39 P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
W20250830 07:54:57.123059 13703 consensus_peers.cc:489] T 74891b8103e144c486750f64ba2003f4 P 9b057ade5dce45af9f8bf0bedf8b917f -> Peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Couldn't send request to peer 6b5e454d98894637b466ea27f1b647f9. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 74891b8103e144c486750f64ba2003f4. This is attempt 1: this message will repeat every 5th retry.
I20250830 07:54:57.124640 13886 tablet_bootstrap.cc:654] T 208995abd6d44dbea3b5ebbea27d6a39 P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:57.127562 13882 tablet_bootstrap.cc:654] T 7aed56dba39e40518e9c3325bcccd74a P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:57.131490 15728 raft_consensus.cc:491] T ef1ab62a5b7845e58d50f34206eaaa27 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:57.131635 15728 raft_consensus.cc:513] T ef1ab62a5b7845e58d50f34206eaaa27 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:57.133430 13774 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "ef1ab62a5b7845e58d50f34206eaaa27" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:57.134016 15728 leader_election.cc:290] T ef1ab62a5b7845e58d50f34206eaaa27 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
W20250830 07:54:57.136096 13234 catalog_manager.cc:5415] Ignoring report from unknown tablet 852e353f6ee945628ddebdbdd1bd76fb
W20250830 07:54:57.136201 13234 catalog_manager.cc:5415] Ignoring report from unknown tablet ee44ab24333742909f773889ad5c3e00
W20250830 07:54:57.136372 13234 catalog_manager.cc:5415] Ignoring report from unknown tablet 95b6f084eb5240ea94c125eaa154ac9f
W20250830 07:54:57.136528 13234 catalog_manager.cc:5415] Ignoring report from unknown tablet f398e12cd9f543738d5163354f8a9d9d
I20250830 07:54:57.138186 13231 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_c977daebc0634f22b8544b603504798c" } modify_external_catalogs: true
I20250830 07:54:57.138391 13231 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_c977daebc0634f22b8544b603504798c" } modify_external_catalogs: true
I20250830 07:54:57.138319 13234 catalog_manager.cc:5582] T c8bc6e07377a4ba99c39a909dae11402 P 9b057ade5dce45af9f8bf0bedf8b917f reported cstate change: term changed from 0 to 1, leader changed from <none> to 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3). New cstate: current_term: 1 leader_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } health_report { overall_health: HEALTHY } } }
I20250830 07:54:57.148810 13611 raft_consensus.cc:3058] T 042fd7ff08fc4695b87bb8f9d225ef12 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:57.149240 13701 leader_election.cc:304] T 240a6bfad8fa478598a67a27c2dedf62 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:54:57.150336 15721 raft_consensus.cc:2802] T 240a6bfad8fa478598a67a27c2dedf62 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:54:57.150496 15721 raft_consensus.cc:491] T 240a6bfad8fa478598a67a27c2dedf62 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:54:57.150696 15721 raft_consensus.cc:3058] T 240a6bfad8fa478598a67a27c2dedf62 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:57.162281 13622 raft_consensus.cc:3058] T a7dc529c40544bafbc9e7f0ab34086bd P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:57.163125 15608 raft_consensus.cc:491] T 33701eeb12fc451d90ae0b1c4dd7d134 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:57.163288 15608 raft_consensus.cc:513] T 33701eeb12fc451d90ae0b1c4dd7d134 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:57.164352 13882 tablet_bootstrap.cc:492] T 7aed56dba39e40518e9c3325bcccd74a P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:54:57.164605 13882 ts_tablet_manager.cc:1397] T 7aed56dba39e40518e9c3325bcccd74a P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.066s user 0.003s sys 0.008s
I20250830 07:54:57.164903 15608 leader_election.cc:290] T 33701eeb12fc451d90ae0b1c4dd7d134 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967)
I20250830 07:54:57.164919 13629 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "33701eeb12fc451d90ae0b1c4dd7d134" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:57.165104 13629 raft_consensus.cc:2391] T 33701eeb12fc451d90ae0b1c4dd7d134 P 6b5e454d98894637b466ea27f1b647f9 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b057ade5dce45af9f8bf0bedf8b917f in current term 2: Already voted for candidate 2065c332f15a4739899af79f3669c3ba in this term.
I20250830 07:54:57.165709 15582 raft_consensus.cc:491] T 8cce7e5537794e9484f5a7c82b9e6e1d P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:57.165846 15582 raft_consensus.cc:513] T 8cce7e5537794e9484f5a7c82b9e6e1d P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:57.166342 15582 leader_election.cc:290] T 8cce7e5537794e9484f5a7c82b9e6e1d P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:57.166392 13882 raft_consensus.cc:357] T 7aed56dba39e40518e9c3325bcccd74a P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:57.166615 13882 raft_consensus.cc:383] T 7aed56dba39e40518e9c3325bcccd74a P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:57.166752 13882 raft_consensus.cc:738] T 7aed56dba39e40518e9c3325bcccd74a P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:54:57.167002 13774 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "8cce7e5537794e9484f5a7c82b9e6e1d" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:57.167172 13882 consensus_queue.cc:260] T 7aed56dba39e40518e9c3325bcccd74a P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:57.154693 13231 catalog_manager.cc:5864] Not sending DeleteTablet requests; no consensus state for tablet 2024d04768854bc58f5332ba443f1291
I20250830 07:54:57.168007 15608 consensus_queue.cc:1035] T a7dc529c40544bafbc9e7f0ab34086bd P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:54:57.163904 13229 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_d2a737b08e4449ebb4a047a57e5260a4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:57.168655 13229 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d2a737b08e4449ebb4a047a57e5260a4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:57.171947 13234 catalog_manager.cc:5674] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743) does not have the latest schema for tablet c8bc6e07377a4ba99c39a909dae11402 (table default.Table_f9379201a5de4169a46eeb2ff2cc0ac7 [id=dce926f371dd4b4ba61511c14d245622]). Expected version 2 got 0
I20250830 07:54:57.172334 13234 catalog_manager.cc:5582] T f5baa35307a1425c8d52666d130d6d8a P 9b057ade5dce45af9f8bf0bedf8b917f reported cstate change: term changed from 0 to 1, leader changed from <none> to 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3). New cstate: current_term: 1 leader_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } health_report { overall_health: HEALTHY } } }
I20250830 07:54:57.172771 13234 catalog_manager.cc:5674] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743) does not have the latest schema for tablet f5baa35307a1425c8d52666d130d6d8a (table default.Table_2f6c360f9bbc48e880665078710bf673 [id=6a35c4abd132478caba0152786455169]). Expected version 3 got 0
I20250830 07:54:57.173225 13234 catalog_manager.cc:5582] T 1cf23cf78eee46be953bd701aa6bef07 P 9b057ade5dce45af9f8bf0bedf8b917f reported cstate change: term changed from 0 to 1, leader changed from <none> to 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3). New cstate: current_term: 1 leader_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } health_report { overall_health: HEALTHY } } }
I20250830 07:54:57.182476 13229 master_service.cc:948] ReplaceTablet: received request to replace tablet 4b403cadfb7b42f8896b2ee16b50ecb1 from {username='slave'} at 127.0.0.1:42126
I20250830 07:54:57.184818 13882 ts_tablet_manager.cc:1428] T 7aed56dba39e40518e9c3325bcccd74a P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.020s user 0.002s sys 0.000s
I20250830 07:54:57.194029 13882 tablet_bootstrap.cc:492] T 6251a06d1efe44e38d35d962c468f8b2 P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:54:57.205510 13229 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_d6668644cb1f4d5a966f3834795544f9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:57.206054 13229 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d6668644cb1f4d5a966f3834795544f9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:57.206305 13882 tablet_bootstrap.cc:654] T 6251a06d1efe44e38d35d962c468f8b2 P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:57.215055 13774 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "d1d5e0d40a91457da65a0e925289309e" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:57.208851 13767 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "33701eeb12fc451d90ae0b1c4dd7d134" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:57.219895 13475 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "ef1ab62a5b7845e58d50f34206eaaa27" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:54:57.222525 13475 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "8cce7e5537794e9484f5a7c82b9e6e1d" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:54:57.222734 13475 raft_consensus.cc:2391] T 8cce7e5537794e9484f5a7c82b9e6e1d P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b5e454d98894637b466ea27f1b647f9 in current term 1: Already voted for candidate 9b057ade5dce45af9f8bf0bedf8b917f in this term.
I20250830 07:54:57.223033 13774 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "33701eeb12fc451d90ae0b1c4dd7d134" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f"
I20250830 07:54:57.223479 13767 raft_consensus.cc:2466] T 33701eeb12fc451d90ae0b1c4dd7d134 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2065c332f15a4739899af79f3669c3ba in term 1.
I20250830 07:54:57.225741 13561 leader_election.cc:304] T ef1ab62a5b7845e58d50f34206eaaa27 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b5e454d98894637b466ea27f1b647f9; no voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:54:57.226153 15706 raft_consensus.cc:2747] T ef1ab62a5b7845e58d50f34206eaaa27 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:54:57.223690 13886 tablet_bootstrap.cc:492] T 208995abd6d44dbea3b5ebbea27d6a39 P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
W20250830 07:54:57.227144 13422 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.209.3:38743, user_credentials={real_user=slave}} blocked reactor thread for 235605us
I20250830 07:54:57.227300 13886 ts_tablet_manager.cc:1397] T 208995abd6d44dbea3b5ebbea27d6a39 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.106s user 0.004s sys 0.000s
W20250830 07:54:57.228030 13422 leader_election.cc:343] T 1fee3e58f31b4befa42ffbb8d7bd6f4e P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:57.228159 13422 leader_election.cc:304] T 1fee3e58f31b4befa42ffbb8d7bd6f4e P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba; no voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:54:57.228421 15814 raft_consensus.cc:2747] T 1fee3e58f31b4befa42ffbb8d7bd6f4e P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:54:57.228505 13561 leader_election.cc:304] T 8cce7e5537794e9484f5a7c82b9e6e1d P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b5e454d98894637b466ea27f1b647f9; no voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:54:57.228832 13422 leader_election.cc:304] T a8660a6ff9254d4f9f0ef047b8682ed1 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba; no voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:54:57.228904 15706 raft_consensus.cc:3058] T 8cce7e5537794e9484f5a7c82b9e6e1d P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:57.229056 15814 raft_consensus.cc:2747] T a8660a6ff9254d4f9f0ef047b8682ed1 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20250830 07:54:57.229390 13422 leader_election.cc:304] T 7aed56dba39e40518e9c3325bcccd74a P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba; no voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:54:57.229590 15814 raft_consensus.cc:2747] T 7aed56dba39e40518e9c3325bcccd74a P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20250830 07:54:57.229885 13422 leader_election.cc:304] T 6ccbaf109e36453ea6645dfd090f5a1a P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba; no voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:54:57.230110 15814 raft_consensus.cc:2747] T 6ccbaf109e36453ea6645dfd090f5a1a P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20250830 07:54:57.230868 15608 raft_consensus.cc:491] T 579324e1f6474d398db10da3093650dd P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:57.231118 13886 raft_consensus.cc:357] T 208995abd6d44dbea3b5ebbea27d6a39 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:57.231293 13886 raft_consensus.cc:383] T 208995abd6d44dbea3b5ebbea27d6a39 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:57.231416 15706 raft_consensus.cc:2747] T 8cce7e5537794e9484f5a7c82b9e6e1d P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20250830 07:54:57.231436 13422 leader_election.cc:343] T 0ac39adafe144280b39f5c3fe5804087 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:57.231559 13422 leader_election.cc:304] T 0ac39adafe144280b39f5c3fe5804087 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba; no voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:54:57.231423 13886 raft_consensus.cc:738] T 208995abd6d44dbea3b5ebbea27d6a39 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:54:57.231751 15814 raft_consensus.cc:2747] T 0ac39adafe144280b39f5c3fe5804087 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:54:57.231892 13886 consensus_queue.cc:260] T 208995abd6d44dbea3b5ebbea27d6a39 P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
W20250830 07:54:57.232048 13422 leader_election.cc:343] T 52df62f7f1aa4b38be89f6198cf01f24 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:57.232168 13422 leader_election.cc:304] T 52df62f7f1aa4b38be89f6198cf01f24 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba; no voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:54:57.232718 15814 raft_consensus.cc:2747] T 52df62f7f1aa4b38be89f6198cf01f24 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:54:57.235237 13882 tablet_bootstrap.cc:492] T 6251a06d1efe44e38d35d962c468f8b2 P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:54:57.238970 13882 ts_tablet_manager.cc:1397] T 6251a06d1efe44e38d35d962c468f8b2 P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.046s user 0.004s sys 0.000s
I20250830 07:54:57.238835 13229 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_38bcb488b80749a08f424a6ce8d0d5f1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:57.239509 13229 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_38bcb488b80749a08f424a6ce8d0d5f1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:57.239590 13882 raft_consensus.cc:357] T 6251a06d1efe44e38d35d962c468f8b2 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:57.239727 13882 raft_consensus.cc:383] T 6251a06d1efe44e38d35d962c468f8b2 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:57.239770 13882 raft_consensus.cc:738] T 6251a06d1efe44e38d35d962c468f8b2 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:54:57.239912 13882 consensus_queue.cc:260] T 6251a06d1efe44e38d35d962c468f8b2 P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:57.240828 13231 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_9858a33636c946de9cdf25871b5f5c5d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:57.241322 13231 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9858a33636c946de9cdf25871b5f5c5d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:57.241921 13882 ts_tablet_manager.cc:1428] T 6251a06d1efe44e38d35d962c468f8b2 P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20250830 07:54:57.242156 13882 tablet_bootstrap.cc:492] T 97d49a1f600f4c13a4aafca99cedabe8 P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:54:57.242367 13225 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_03076dae875940b2aad15111ce4c671b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:57.242815 13225 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_03076dae875940b2aad15111ce4c671b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:57.243032 15706 raft_consensus.cc:491] T f1fe024f0de048a5a0931ee38752d5a1 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:57.243148 15706 raft_consensus.cc:513] T f1fe024f0de048a5a0931ee38752d5a1 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:57.243616 15706 leader_election.cc:290] T f1fe024f0de048a5a0931ee38752d5a1 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:57.245592 13886 ts_tablet_manager.cc:1428] T 208995abd6d44dbea3b5ebbea27d6a39 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20250830 07:54:57.247731 13882 tablet_bootstrap.cc:654] T 97d49a1f600f4c13a4aafca99cedabe8 P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:57.249681 13233 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_6a912b90b0e24756911cb4b94a3b65a1" } new_table_name: "default.Table_681e59453447469cb8e34bc3c4789fa2" modify_external_catalogs: true
I20250830 07:54:57.249732 13228 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_654a7f85db4149ab81cf988af807fe0b" } new_table_name: "default.Table_9a9e5d4dcbfc49b29ff69d299441ed82" modify_external_catalogs: true
I20250830 07:54:57.250402 13226 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_096dfd73ca964fb68fcfac3eafbf487e" } modify_external_catalogs: true
I20250830 07:54:57.250524 13226 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_096dfd73ca964fb68fcfac3eafbf487e" } modify_external_catalogs: true
I20250830 07:54:57.251087 13227 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_cf79c854ef5e48af88e783ba77a7f44e" } new_table_name: "default.Table_9ec97daee5ce4df99be33487a84f2238" modify_external_catalogs: true
I20250830 07:54:57.252312 13232 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_889214173479418287d537ef71256abb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:57.252682 13232 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_889214173479418287d537ef71256abb in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:57.253697 15691 raft_consensus.cc:491] T 439fc51afa6b435e81bc38b9e88d4041 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:57.253822 15691 raft_consensus.cc:513] T 439fc51afa6b435e81bc38b9e88d4041 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:57.254262 15691 leader_election.cc:290] T 439fc51afa6b435e81bc38b9e88d4041 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:57.254371 13886 tablet_bootstrap.cc:492] T ddedd1f141c147c69f178c6cd2b287da P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:54:57.255715 13886 tablet_bootstrap.cc:654] T ddedd1f141c147c69f178c6cd2b287da P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:57.256415 15608 raft_consensus.cc:513] T 579324e1f6474d398db10da3093650dd P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:57.256901 15608 leader_election.cc:290] T 579324e1f6474d398db10da3093650dd P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
I20250830 07:54:57.262267 15721 raft_consensus.cc:513] T 240a6bfad8fa478598a67a27c2dedf62 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:57.262887 15721 leader_election.cc:290] T 240a6bfad8fa478598a67a27c2dedf62 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Requested vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
I20250830 07:54:57.264153 13887 tablet_bootstrap.cc:492] T cd9903bdfaef4139a1a582c54689da4a P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:54:57.265034 13887 ts_tablet_manager.cc:1397] T cd9903bdfaef4139a1a582c54689da4a P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.193s user 0.010s sys 0.007s
I20250830 07:54:57.266531 13887 raft_consensus.cc:357] T cd9903bdfaef4139a1a582c54689da4a P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:57.287814 13887 raft_consensus.cc:383] T cd9903bdfaef4139a1a582c54689da4a P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:57.288069 13887 raft_consensus.cc:738] T cd9903bdfaef4139a1a582c54689da4a P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:54:57.288275 13767 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "bdeb89bbb3ad4e67bbc74b78454eeb7e" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:57.289964 13767 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "2c4c3c61cddf42668d3a09f4fbc5f641" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:57.290086 13488 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "a0cf1de8485941eb8a557a6e2f783047" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba"
I20250830 07:54:57.290288 13488 raft_consensus.cc:3058] T a0cf1de8485941eb8a557a6e2f783047 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:57.291462 13234 master_service.cc:948] ReplaceTablet: received request to replace tablet 208995abd6d44dbea3b5ebbea27d6a39 from {username='slave'} at 127.0.0.1:42126
I20250830 07:54:57.293210 13882 tablet_bootstrap.cc:492] T 97d49a1f600f4c13a4aafca99cedabe8 P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:54:57.293320 13882 ts_tablet_manager.cc:1397] T 97d49a1f600f4c13a4aafca99cedabe8 P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.051s user 0.002s sys 0.000s
I20250830 07:54:57.293907 13882 raft_consensus.cc:357] T 97d49a1f600f4c13a4aafca99cedabe8 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:57.294054 13882 raft_consensus.cc:383] T 97d49a1f600f4c13a4aafca99cedabe8 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:57.294093 13882 raft_consensus.cc:738] T 97d49a1f600f4c13a4aafca99cedabe8 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:54:57.294257 13882 consensus_queue.cc:260] T 97d49a1f600f4c13a4aafca99cedabe8 P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:57.294468 13229 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_141f84fb4bff4602ae74089d96952977"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250830 07:54:57.294742 13882 ts_tablet_manager.cc:1428] T 97d49a1f600f4c13a4aafca99cedabe8 P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
W20250830 07:54:57.294941 13229 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_141f84fb4bff4602ae74089d96952977 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250830 07:54:57.300051 13233 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 7f7ea24fbf6e479fa54ad66cc569aa4d has no consensus state
I20250830 07:54:57.300374 15365 raft_consensus.cc:491] T f332d1b56d924c91a79cf6572dea1cd2 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:57.300520 15365 raft_consensus.cc:513] T f332d1b56d924c91a79cf6572dea1cd2 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:57.301080 15365 leader_election.cc:290] T f332d1b56d924c91a79cf6572dea1cd2 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967)
W20250830 07:54:57.303577 13227 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 05deff9ea2b04247907d200c8e70888d has no consensus state
W20250830 07:54:57.307700 13233 catalog_manager.cc:5415] Ignoring report from unknown tablet 7c5e50cb605c4a40b47984f328eedd93
W20250830 07:54:57.308218 13233 catalog_manager.cc:5415] Ignoring report from unknown tablet ff0f9cccc8ed43b1a8cd38de0e9d4097
W20250830 07:54:57.308671 13233 catalog_manager.cc:5415] Ignoring report from unknown tablet da5c7b084e1f4fda92fff35a9cb2c7fc
W20250830 07:54:57.308787 13233 catalog_manager.cc:5415] Ignoring report from unknown tablet 74f2fcc22fd545fb8ca7c20619843023
W20250830 07:54:57.308864 13233 catalog_manager.cc:5415] Ignoring report from unknown tablet 042fd7ff08fc4695b87bb8f9d225ef12
W20250830 07:54:57.308981 13233 catalog_manager.cc:5415] Ignoring report from unknown tablet 1520d7257f864ea4ba4b9a5d0443f8a7
W20250830 07:54:57.309085 13233 catalog_manager.cc:5415] Ignoring report from unknown tablet e6b7646588fe4134b2db62ff84ca4791
W20250830 07:54:57.309195 13233 catalog_manager.cc:5415] Ignoring report from unknown tablet db7144b25ff34bed8c7b779ba9497ef4
W20250830 07:54:57.309315 13233 catalog_manager.cc:5415] Ignoring report from unknown tablet f398e12cd9f543738d5163354f8a9d9d
I20250830 07:54:57.313367 13233 catalog_manager.cc:5674] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743) does not have the latest schema for tablet 91705fc35a1b4977b89bac1765c886c0 (table default.Table_4f53e333521540848fc99c0bf37c1639 [id=48089766c3514336991a5ada71b03dd0]). Expected version 1 got 0
I20250830 07:54:57.314721 13233 catalog_manager.cc:5582] T 14d4d2506e2a47ea906bfb81d5509829 P 9b057ade5dce45af9f8bf0bedf8b917f reported cstate change: term changed from 0 to 1, leader changed from <none> to 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3). New cstate: current_term: 1 leader_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } health_report { overall_health: HEALTHY } } }
I20250830 07:54:57.316524 13232 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_6e7ee348565441bfa80b183490ba3d79"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:57.326138 13232 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6e7ee348565441bfa80b183490ba3d79 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:57.316891 13227 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_30040170a6764fa3bd3c662703ea909f" } new_table_name: "default.Table_872afc03c861474abea11445f74d645c" modify_external_catalogs: true
I20250830 07:54:57.317202 13225 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_95a7d7b57bd74fd6bd42fa2c9b71c268"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250830 07:54:57.317536 13231 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_48b6a290ffab4d2097d3d57e03bfc676"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250830 07:54:57.317847 13230 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_8cb79840e8bb4120a4d0d23480217a08" } modify_external_catalogs: true
W20250830 07:54:57.328042 13225 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_95a7d7b57bd74fd6bd42fa2c9b71c268 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:57.328094 13230 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_8cb79840e8bb4120a4d0d23480217a08" } modify_external_catalogs: true
I20250830 07:54:57.321854 13228 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_36f755e85752462e9779bb889bcabce7" } new_table_name: "default.Table_803bc94202e04e3ebc0e5de82a4da961" modify_external_catalogs: true
W20250830 07:54:57.328042 13231 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_48b6a290ffab4d2097d3d57e03bfc676 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:57.333319 13611 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "439fc51afa6b435e81bc38b9e88d4041" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:57.338423 13882 tablet_bootstrap.cc:492] T 62bc8168176e4678a77827c5b7cc0f3e P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:54:57.344290 13886 tablet_bootstrap.cc:492] T ddedd1f141c147c69f178c6cd2b287da P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:54:57.345029 13886 ts_tablet_manager.cc:1397] T ddedd1f141c147c69f178c6cd2b287da P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.090s user 0.000s sys 0.009s
I20250830 07:54:57.345795 13886 raft_consensus.cc:357] T ddedd1f141c147c69f178c6cd2b287da P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:57.346056 13886 raft_consensus.cc:383] T ddedd1f141c147c69f178c6cd2b287da P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:57.346189 13886 raft_consensus.cc:738] T ddedd1f141c147c69f178c6cd2b287da P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:54:57.346468 13886 consensus_queue.cc:260] T ddedd1f141c147c69f178c6cd2b287da P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:57.347271 13886 ts_tablet_manager.cc:1428] T ddedd1f141c147c69f178c6cd2b287da P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20250830 07:54:57.348793 13886 tablet_bootstrap.cc:492] T 2f3bec2c98574a9393e0fae77e228ce0 P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:54:57.353449 13488 raft_consensus.cc:2466] T a0cf1de8485941eb8a557a6e2f783047 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 1.
I20250830 07:54:57.354050 13887 consensus_queue.cc:260] T cd9903bdfaef4139a1a582c54689da4a P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
W20250830 07:54:57.354990 13561 leader_election.cc:343] T f1fe024f0de048a5a0931ee38752d5a1 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): Not found: Tablet not found: f1fe024f0de048a5a0931ee38752d5a1
I20250830 07:54:57.355386 13481 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "e72402ca3cdf452fa8f4534c67226253" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba"
I20250830 07:54:57.356050 13481 raft_consensus.cc:3058] T e72402ca3cdf452fa8f4534c67226253 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:57.360132 13226 catalog_manager.cc:5864] Not sending DeleteTablet requests; no consensus state for tablet 35f0eff139be404392084877df54d564
I20250830 07:54:57.360409 13226 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_e60b3afef41a4393bd214404c744eaef" } modify_external_catalogs: true
I20250830 07:54:57.360548 13226 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_e60b3afef41a4393bd214404c744eaef" } modify_external_catalogs: true
I20250830 07:54:57.361706 13232 master_service.cc:948] ReplaceTablet: received request to replace tablet ff72a0fd9a0e46a6bd54a15e4ad783b4 from {username='slave'} at 127.0.0.1:42126
W20250830 07:54:57.363130 13227 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 9892c2dced9e42dfa5ef5e61409af0c1 has no consensus state
I20250830 07:54:57.363359 13230 catalog_manager.cc:5864] Not sending DeleteTablet requests; no consensus state for tablet 066fb3e099a949bba96996a1b1b75331
I20250830 07:54:57.364217 13481 raft_consensus.cc:2466] T e72402ca3cdf452fa8f4534c67226253 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 1.
I20250830 07:54:57.364269 15199 raft_consensus.cc:738] T 00000000000000000000000000000000 P 3ea183a890b84f408b20b55e9eb7c7ed [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea183a890b84f408b20b55e9eb7c7ed, State: Initialized, Role: FOLLOWER
I20250830 07:54:57.364852 13234 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_005af599605e4bd090ba828f70a19003" } modify_external_catalogs: true
I20250830 07:54:57.365058 13234 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_005af599605e4bd090ba828f70a19003" } modify_external_catalogs: true
I20250830 07:54:57.365393 15199 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3ea183a890b84f408b20b55e9eb7c7ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 543, Last appended: 2.856, Last appended by leader: 856, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fea6152429cc4e79a25b18e02aafae57" member_type: VOTER last_known_addr { host: "127.12.209.62" port: 39725 } } peers { permanent_uuid: "5e9d6449ae824acab24c459a72075e88" member_type: VOTER last_known_addr { host: "127.12.209.61" port: 44241 } } peers { permanent_uuid: "3ea183a890b84f408b20b55e9eb7c7ed" member_type: VOTER last_known_addr { host: "127.12.209.60" port: 43889 } }
I20250830 07:54:57.367866 15843 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3ea183a890b84f408b20b55e9eb7c7ed [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fea6152429cc4e79a25b18e02aafae57" member_type: VOTER last_known_addr { host: "127.12.209.62" port: 39725 } } peers { permanent_uuid: "5e9d6449ae824acab24c459a72075e88" member_type: VOTER last_known_addr { host: "127.12.209.61" port: 44241 } } peers { permanent_uuid: "3ea183a890b84f408b20b55e9eb7c7ed" member_type: VOTER last_known_addr { host: "127.12.209.60" port: 43889 } } }
I20250830 07:54:57.368069 13886 tablet_bootstrap.cc:654] T 2f3bec2c98574a9393e0fae77e228ce0 P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:57.368419 15843 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3ea183a890b84f408b20b55e9eb7c7ed [sys.catalog]: This master's current role is: FOLLOWER
I20250830 07:54:57.370231 13227 master_service.cc:948] ReplaceTablet: received request to replace tablet 3bca390f6d4343cba7a9fb07f0d4d72b from {username='slave'} at 127.0.0.1:42126
I20250830 07:54:57.372411 13227 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_9a1329f574214cfaa5ce5758346462fb" } modify_external_catalogs: true
I20250830 07:54:57.372534 13227 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_9a1329f574214cfaa5ce5758346462fb" } modify_external_catalogs: true
I20250830 07:54:57.374279 13882 tablet_bootstrap.cc:654] T 62bc8168176e4678a77827c5b7cc0f3e P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:57.376716 13882 tablet_bootstrap.cc:492] T 62bc8168176e4678a77827c5b7cc0f3e P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:54:57.376857 13882 ts_tablet_manager.cc:1397] T 62bc8168176e4678a77827c5b7cc0f3e P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.039s user 0.003s sys 0.000s
I20250830 07:54:57.377606 13882 raft_consensus.cc:357] T 62bc8168176e4678a77827c5b7cc0f3e P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:57.377763 13882 raft_consensus.cc:383] T 62bc8168176e4678a77827c5b7cc0f3e P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:57.377815 13882 raft_consensus.cc:738] T 62bc8168176e4678a77827c5b7cc0f3e P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:54:57.378006 13882 consensus_queue.cc:260] T 62bc8168176e4678a77827c5b7cc0f3e P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:57.378686 13882 ts_tablet_manager.cc:1428] T 62bc8168176e4678a77827c5b7cc0f3e P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20250830 07:54:57.379220 13882 tablet_bootstrap.cc:492] T 2048c04578104c78aa6504fd9d5953a3 P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:54:57.379299 13230 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_40a108cef13443eca0b5fd40cdf626f7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:57.379710 13230 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_40a108cef13443eca0b5fd40cdf626f7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:57.380894 13882 tablet_bootstrap.cc:654] T 2048c04578104c78aa6504fd9d5953a3 P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:57.381302 13611 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "579324e1f6474d398db10da3093650dd" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:57.382058 15199 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3ea183a890b84f408b20b55e9eb7c7ed [sys.catalog]: configured and running, proceeding with master startup.
I20250830 07:54:57.382074 13488 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "15f8fd7d9e6242c6b6c51251d618ef09" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:54:57.382128 13611 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "240a6bfad8fa478598a67a27c2dedf62" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9"
I20250830 07:54:57.382337 13481 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "2b4103f07e96490488913059a95af0c3" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:54:57.383163 13481 raft_consensus.cc:2466] T 2b4103f07e96490488913059a95af0c3 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 0.
I20250830 07:54:57.383867 13488 raft_consensus.cc:2466] T 15f8fd7d9e6242c6b6c51251d618ef09 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 0.
I20250830 07:54:57.384135 13887 ts_tablet_manager.cc:1428] T cd9903bdfaef4139a1a582c54689da4a P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.090s user 0.001s sys 0.001s
I20250830 07:54:57.384114 13611 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f332d1b56d924c91a79cf6572dea1cd2" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:57.384482 13887 tablet_bootstrap.cc:492] T 34199145292d4ddb8c603e5c581f1d15 P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:54:57.386363 13611 raft_consensus.cc:3058] T 91705fc35a1b4977b89bac1765c886c0 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:57.387513 13887 tablet_bootstrap.cc:654] T 34199145292d4ddb8c603e5c581f1d15 P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
W20250830 07:54:57.391546 13228 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 297ba8c59b0c416c9744bba214521b4a has no consensus state
W20250830 07:54:57.394829 13423 leader_election.cc:343] T 439fc51afa6b435e81bc38b9e88d4041 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:57.403755 13882 tablet_bootstrap.cc:492] T 2048c04578104c78aa6504fd9d5953a3 P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:54:57.403892 13882 ts_tablet_manager.cc:1397] T 2048c04578104c78aa6504fd9d5953a3 P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.025s user 0.004s sys 0.000s
I20250830 07:54:57.404480 13882 raft_consensus.cc:357] T 2048c04578104c78aa6504fd9d5953a3 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:57.404633 13882 raft_consensus.cc:383] T 2048c04578104c78aa6504fd9d5953a3 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:57.404687 13882 raft_consensus.cc:738] T 2048c04578104c78aa6504fd9d5953a3 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:54:57.404842 13882 consensus_queue.cc:260] T 2048c04578104c78aa6504fd9d5953a3 P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:57.405455 13882 ts_tablet_manager.cc:1428] T 2048c04578104c78aa6504fd9d5953a3 P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20250830 07:54:57.405680 13882 tablet_bootstrap.cc:492] T a8660a6ff9254d4f9f0ef047b8682ed1 P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:54:57.408150 13882 tablet_bootstrap.cc:654] T a8660a6ff9254d4f9f0ef047b8682ed1 P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:57.416363 13488 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "33701eeb12fc451d90ae0b1c4dd7d134" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
W20250830 07:54:57.416852 15746 lock_manager.cc:585] Waited 1 seconds to obtain row lock on key '<redacted>' (key hash 4012713805250960239) tablet 00000000000000000000000000000000 cur holder 0x61700003a700
I20250830 07:54:57.418675 15706 raft_consensus.cc:491] T 6251a06d1efe44e38d35d962c468f8b2 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:57.418784 15706 raft_consensus.cc:513] T 6251a06d1efe44e38d35d962c468f8b2 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:57.419275 15706 leader_election.cc:290] T 6251a06d1efe44e38d35d962c468f8b2 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:57.419911 13228 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_246a8a97b0dc47138fc66a1b807a7355"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:57.420382 13228 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_246a8a97b0dc47138fc66a1b807a7355 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:57.421787 13476 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "6251a06d1efe44e38d35d962c468f8b2" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:54:57.424810 13887 tablet_bootstrap.cc:492] T 34199145292d4ddb8c603e5c581f1d15 P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:54:57.425114 13887 ts_tablet_manager.cc:1397] T 34199145292d4ddb8c603e5c581f1d15 P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.041s user 0.004s sys 0.000s
I20250830 07:54:57.426936 13887 raft_consensus.cc:357] T 34199145292d4ddb8c603e5c581f1d15 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:57.427371 13887 raft_consensus.cc:383] T 34199145292d4ddb8c603e5c581f1d15 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:57.427525 13887 raft_consensus.cc:738] T 34199145292d4ddb8c603e5c581f1d15 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:54:57.429337 15608 consensus_queue.cc:1035] T 23d2c7013c9c4b4aacf47e6ac7ab5a0b P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:54:57.434199 13226 catalog_manager.cc:5864] Not sending DeleteTablet requests; no consensus state for tablet 5d607021c88545578c0f5b32522f056d
W20250830 07:54:57.434672 13703 leader_election.cc:343] T 579324e1f6474d398db10da3093650dd P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
W20250830 07:54:57.435177 13703 leader_election.cc:343] T 240a6bfad8fa478598a67a27c2dedf62 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
W20250830 07:54:57.436480 13703 leader_election.cc:343] T f332d1b56d924c91a79cf6572dea1cd2 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
W20250830 07:54:57.437575 13703 consensus_peers.cc:489] T 796e01f6a36241fc94e335253929d6ab P 9b057ade5dce45af9f8bf0bedf8b917f -> Peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Couldn't send request to peer 6b5e454d98894637b466ea27f1b647f9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20250830 07:54:57.439356 13226 catalog_manager.cc:5415] Ignoring report from unknown tablet 1fa571e9490e499792225d7b786e8658
I20250830 07:54:57.443140 13232 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet ff72a0fd9a0e46a6bd54a15e4ad783b4
I20250830 07:54:57.443490 13232 catalog_manager.cc:6652] ReplaceTablet: tablet ff72a0fd9a0e46a6bd54a15e4ad783b4 deleted and replaced by tablet dc820ace82da46bbbedb9119dd3b070c
I20250830 07:54:57.443751 13593 tablet_service.cc:1515] Processing DeleteTablet for tablet ff72a0fd9a0e46a6bd54a15e4ad783b4 with delete_type TABLET_DATA_DELETED (replaced by tablet dc820ace82da46bbbedb9119dd3b070c) from {username='slave'} at 127.0.0.1:45306
I20250830 07:54:57.451184 13234 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet b4c345013ff04cf991989f456aa2d420
I20250830 07:54:57.451824 13593 tablet_service.cc:1515] Processing DeleteTablet for tablet b4c345013ff04cf991989f456aa2d420 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:57 UTC) from {username='slave'} at 127.0.0.1:45306
I20250830 07:54:57.453931 13488 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "579324e1f6474d398db10da3093650dd" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:54:57.454115 13488 raft_consensus.cc:2466] T 579324e1f6474d398db10da3093650dd P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 0.
I20250830 07:54:57.455098 15753 tablet_replica.cc:331] T ff72a0fd9a0e46a6bd54a15e4ad783b4 P 6b5e454d98894637b466ea27f1b647f9: stopping tablet replica
I20250830 07:54:57.455319 15753 raft_consensus.cc:2241] T ff72a0fd9a0e46a6bd54a15e4ad783b4 P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250830 07:54:57.455456 15753 raft_consensus.cc:2270] T ff72a0fd9a0e46a6bd54a15e4ad783b4 P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250830 07:54:57.455960 15753 ts_tablet_manager.cc:1905] T ff72a0fd9a0e46a6bd54a15e4ad783b4 P 6b5e454d98894637b466ea27f1b647f9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250830 07:54:57.460427 13227 catalog_manager.cc:5864] Not sending DeleteTablet requests; no consensus state for tablet 11ae49a229d245b0a1f7982ecb9fcc3f
I20250830 07:54:57.462116 15753 ts_tablet_manager.cc:1918] T ff72a0fd9a0e46a6bd54a15e4ad783b4 P 6b5e454d98894637b466ea27f1b647f9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250830 07:54:57.462190 13227 master_service.cc:948] ReplaceTablet: received request to replace tablet f2ebc809f1074db78720920286d9385b from {username='slave'} at 127.0.0.1:42126
I20250830 07:54:57.462281 15753 log.cc:1199] T ff72a0fd9a0e46a6bd54a15e4ad783b4 P 6b5e454d98894637b466ea27f1b647f9: Deleting WAL directory at /tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/ts-1/wal/wals/ff72a0fd9a0e46a6bd54a15e4ad783b4
I20250830 07:54:57.462611 15753 ts_tablet_manager.cc:1939] T ff72a0fd9a0e46a6bd54a15e4ad783b4 P 6b5e454d98894637b466ea27f1b647f9: Deleting consensus metadata
I20250830 07:54:57.455031 13488 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "240a6bfad8fa478598a67a27c2dedf62" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba"
I20250830 07:54:57.463155 13488 raft_consensus.cc:3058] T 240a6bfad8fa478598a67a27c2dedf62 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:57.427891 13887 consensus_queue.cc:260] T 34199145292d4ddb8c603e5c581f1d15 P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:57.464533 13886 tablet_bootstrap.cc:492] T 2f3bec2c98574a9393e0fae77e228ce0 P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:54:57.464666 13886 ts_tablet_manager.cc:1397] T 2f3bec2c98574a9393e0fae77e228ce0 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.116s user 0.006s sys 0.000s
I20250830 07:54:57.465341 13886 raft_consensus.cc:357] T 2f3bec2c98574a9393e0fae77e228ce0 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:57.465705 13886 raft_consensus.cc:383] T 2f3bec2c98574a9393e0fae77e228ce0 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:57.465764 13886 raft_consensus.cc:738] T 2f3bec2c98574a9393e0fae77e228ce0 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:54:57.465935 13488 raft_consensus.cc:2466] T 240a6bfad8fa478598a67a27c2dedf62 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 1.
I20250830 07:54:57.465955 13886 consensus_queue.cc:260] T 2f3bec2c98574a9393e0fae77e228ce0 P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:57.466511 13886 ts_tablet_manager.cc:1428] T 2f3bec2c98574a9393e0fae77e228ce0 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20250830 07:54:57.470652 15608 raft_consensus.cc:491] T 5aef6fd239ba43478cd978fa5d29b26e P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:57.470769 15608 raft_consensus.cc:513] T 5aef6fd239ba43478cd978fa5d29b26e P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:57.471426 15608 leader_election.cc:290] T 5aef6fd239ba43478cd978fa5d29b26e P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
I20250830 07:54:57.471557 13230 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_4ddc8807a42e44ca8fc5f0cdb31c723a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:57.465996 13562 leader_election.cc:343] T f1fe024f0de048a5a0931ee38752d5a1 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Not found: Tablet not found: f1fe024f0de048a5a0931ee38752d5a1
W20250830 07:54:57.471997 13230 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4ddc8807a42e44ca8fc5f0cdb31c723a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:57.471889 13562 leader_election.cc:304] T f1fe024f0de048a5a0931ee38752d5a1 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b5e454d98894637b466ea27f1b647f9; no voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:54:57.473176 13887 ts_tablet_manager.cc:1428] T 34199145292d4ddb8c603e5c581f1d15 P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.048s user 0.000s sys 0.003s
I20250830 07:54:57.473304 13227 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_42d3c74ab2a5460187ca98531f8e941b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:57.473709 13227 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_42d3c74ab2a5460187ca98531f8e941b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:57.473879 13887 tablet_bootstrap.cc:492] T 2aea1a69d22544899b0218be7e0f8799 P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:54:57.474912 13234 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_3fce496fc7ad4fdebb9a8cf5f5448403"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:57.475298 13234 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3fce496fc7ad4fdebb9a8cf5f5448403 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:57.475333 15582 raft_consensus.cc:2747] T f1fe024f0de048a5a0931ee38752d5a1 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:54:57.481313 13220 catalog_manager.cc:4928] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): tablet ff72a0fd9a0e46a6bd54a15e4ad783b4 (table default.Table_85e7f0b13c094fd7841dcabce61fd911 [id=de7b214458f247ef831f43727543afc5]) successfully deleted
W20250830 07:54:57.482121 13220 catalog_manager.cc:4908] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet b4c345013ff04cf991989f456aa2d420 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b4c345013ff04cf991989f456aa2d420 already in progress: creating tablet
I20250830 07:54:57.483294 13771 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "6251a06d1efe44e38d35d962c468f8b2" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:57.484457 13886 tablet_bootstrap.cc:492] T 66432e73deea433d9df565d5fcace647 P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:54:57.486119 13886 tablet_bootstrap.cc:654] T 66432e73deea433d9df565d5fcace647 P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:57.489565 13481 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f332d1b56d924c91a79cf6572dea1cd2" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:54:57.489807 13481 raft_consensus.cc:2466] T f332d1b56d924c91a79cf6572dea1cd2 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 0.
I20250830 07:54:57.492872 13228 catalog_manager.cc:5674] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743) does not have the latest schema for tablet 2f3bec2c98574a9393e0fae77e228ce0 (table default.Table_c8ae99834e3f4804aad49e8e527dbdcf [id=5fc49aaf98964a31a35fcc0405ac23ae]). Expected version 1 got 0
I20250830 07:54:57.496773 13887 tablet_bootstrap.cc:654] T 2aea1a69d22544899b0218be7e0f8799 P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:57.502040 13228 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_7339c154343f42daa3c5f078e4e8a7d0" } new_table_name: "default.Table_42221fce3fd4400dbabfa6238618fff8" modify_external_catalogs: true
I20250830 07:54:57.505812 13232 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_d50436fb8a85449d86133dcf6dab1801" } new_table_name: "default.Table_f555a9f30b1d46bcbf5baf4ebd83745f" modify_external_catalogs: true
I20250830 07:54:57.509652 13882 tablet_bootstrap.cc:492] T a8660a6ff9254d4f9f0ef047b8682ed1 P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:54:57.509778 13882 ts_tablet_manager.cc:1397] T a8660a6ff9254d4f9f0ef047b8682ed1 P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.104s user 0.006s sys 0.000s
I20250830 07:54:57.510526 13882 raft_consensus.cc:357] T a8660a6ff9254d4f9f0ef047b8682ed1 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:57.510687 13882 raft_consensus.cc:383] T a8660a6ff9254d4f9f0ef047b8682ed1 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:57.510740 13882 raft_consensus.cc:738] T a8660a6ff9254d4f9f0ef047b8682ed1 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:54:57.510931 13882 consensus_queue.cc:260] T a8660a6ff9254d4f9f0ef047b8682ed1 P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:57.511415 13882 ts_tablet_manager.cc:1428] T a8660a6ff9254d4f9f0ef047b8682ed1 P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20250830 07:54:57.511677 13882 tablet_bootstrap.cc:492] T 6ccbaf109e36453ea6645dfd090f5a1a P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:54:57.514307 13882 tablet_bootstrap.cc:654] T 6ccbaf109e36453ea6645dfd090f5a1a P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:57.517313 13227 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_bb23458fb1414e8999b9c0267aad8d7d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:57.517731 13227 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bb23458fb1414e8999b9c0267aad8d7d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:57.523640 13882 tablet_bootstrap.cc:492] T 6ccbaf109e36453ea6645dfd090f5a1a P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:54:57.524149 13882 ts_tablet_manager.cc:1397] T 6ccbaf109e36453ea6645dfd090f5a1a P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.012s user 0.003s sys 0.000s
I20250830 07:54:57.524863 13882 raft_consensus.cc:357] T 6ccbaf109e36453ea6645dfd090f5a1a P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:57.525020 13882 raft_consensus.cc:383] T 6ccbaf109e36453ea6645dfd090f5a1a P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:57.525081 13882 raft_consensus.cc:738] T 6ccbaf109e36453ea6645dfd090f5a1a P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:54:57.525799 13234 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_66ed26b353ce4c86ac9bf850149839a5" } new_table_name: "default.Table_36abe41a56f7415c8176b267a0dc1e1b" modify_external_catalogs: true
I20250830 07:54:57.525856 13882 consensus_queue.cc:260] T 6ccbaf109e36453ea6645dfd090f5a1a P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:57.526297 13882 ts_tablet_manager.cc:1428] T 6ccbaf109e36453ea6645dfd090f5a1a P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20250830 07:54:57.526521 13882 tablet_bootstrap.cc:492] T 1520d7257f864ea4ba4b9a5d0443f8a7 P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:54:57.528421 13882 tablet_bootstrap.cc:654] T 1520d7257f864ea4ba4b9a5d0443f8a7 P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:57.529883 13886 tablet_bootstrap.cc:492] T 66432e73deea433d9df565d5fcace647 P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:54:57.530053 13886 ts_tablet_manager.cc:1397] T 66432e73deea433d9df565d5fcace647 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.046s user 0.003s sys 0.001s
I20250830 07:54:57.531203 13886 raft_consensus.cc:357] T 66432e73deea433d9df565d5fcace647 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:57.531374 13886 raft_consensus.cc:383] T 66432e73deea433d9df565d5fcace647 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:57.531420 13886 raft_consensus.cc:738] T 66432e73deea433d9df565d5fcace647 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:54:57.531601 13886 consensus_queue.cc:260] T 66432e73deea433d9df565d5fcace647 P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:57.532017 13886 ts_tablet_manager.cc:1428] T 66432e73deea433d9df565d5fcace647 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20250830 07:54:57.532248 13886 tablet_bootstrap.cc:492] T d171ad1667fa44c993ec5fd7d701d8e0 P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:54:57.533800 13886 tablet_bootstrap.cc:654] T d171ad1667fa44c993ec5fd7d701d8e0 P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:57.536262 13230 catalog_manager.cc:5674] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743) does not have the latest schema for tablet 2f3bec2c98574a9393e0fae77e228ce0 (table default.Table_c8ae99834e3f4804aad49e8e527dbdcf [id=5fc49aaf98964a31a35fcc0405ac23ae]). Expected version 1 got 0
I20250830 07:54:57.543170 13882 tablet_bootstrap.cc:492] T 1520d7257f864ea4ba4b9a5d0443f8a7 P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:54:57.543301 13882 ts_tablet_manager.cc:1397] T 1520d7257f864ea4ba4b9a5d0443f8a7 P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.017s user 0.005s sys 0.001s
I20250830 07:54:57.545980 15721 raft_consensus.cc:491] T 509e08290f3842cfbde8b74ff9f4f70f P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20250830 07:54:57.546073 13703 leader_election.cc:343] T 5aef6fd239ba43478cd978fa5d29b26e P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Not found: Tablet not found: 5aef6fd239ba43478cd978fa5d29b26e
I20250830 07:54:57.546087 15721 raft_consensus.cc:513] T 509e08290f3842cfbde8b74ff9f4f70f P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:57.546604 15721 leader_election.cc:290] T 509e08290f3842cfbde8b74ff9f4f70f P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
W20250830 07:54:57.547935 13228 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 0233837297044a5f8bbd7cce37aada78 has no consensus state
I20250830 07:54:57.548339 13882 raft_consensus.cc:357] T 1520d7257f864ea4ba4b9a5d0443f8a7 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:57.548475 13882 raft_consensus.cc:383] T 1520d7257f864ea4ba4b9a5d0443f8a7 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:57.548523 13882 raft_consensus.cc:738] T 1520d7257f864ea4ba4b9a5d0443f8a7 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:54:57.549180 13882 consensus_queue.cc:260] T 1520d7257f864ea4ba4b9a5d0443f8a7 P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:57.549659 13882 ts_tablet_manager.cc:1428] T 1520d7257f864ea4ba4b9a5d0443f8a7 P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.006s user 0.001s sys 0.000s
I20250830 07:54:57.549911 13882 tablet_bootstrap.cc:492] T c8bc6e07377a4ba99c39a909dae11402 P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:54:57.556360 13701 leader_election.cc:304] T a0cf1de8485941eb8a557a6e2f783047 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:54:57.556797 15748 raft_consensus.cc:2802] T a0cf1de8485941eb8a557a6e2f783047 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election won for term 1
I20250830 07:54:57.556879 13701 leader_election.cc:304] T e72402ca3cdf452fa8f4534c67226253 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:54:57.556926 15748 raft_consensus.cc:695] T a0cf1de8485941eb8a557a6e2f783047 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 LEADER]: Becoming Leader. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Running, Role: LEADER
I20250830 07:54:57.557129 15603 raft_consensus.cc:2802] T e72402ca3cdf452fa8f4534c67226253 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election won for term 1
I20250830 07:54:57.557271 15603 raft_consensus.cc:695] T e72402ca3cdf452fa8f4534c67226253 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 LEADER]: Becoming Leader. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Running, Role: LEADER
I20250830 07:54:57.557288 13701 leader_election.cc:304] T 2b4103f07e96490488913059a95af0c3 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:54:57.557458 15603 consensus_queue.cc:237] T e72402ca3cdf452fa8f4534c67226253 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:57.557610 13701 leader_election.cc:304] T 15f8fd7d9e6242c6b6c51251d618ef09 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
W20250830 07:54:57.558383 13228 catalog_manager.cc:5415] Ignoring report from unknown tablet b4ab964a64a64e00a78ffd2b220aef46
W20250830 07:54:57.558454 13228 catalog_manager.cc:5415] Ignoring report from unknown tablet 3bca390f6d4343cba7a9fb07f0d4d72b
W20250830 07:54:57.558523 13228 catalog_manager.cc:5415] Ignoring report from unknown tablet d33a5d107c6849aca6eb48ffdf8a5463
W20250830 07:54:57.558557 13228 catalog_manager.cc:5415] Ignoring report from unknown tablet ec47a59c22ff4370bd21bc2a18336049
I20250830 07:54:57.558524 15608 raft_consensus.cc:2802] T 2b4103f07e96490488913059a95af0c3 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:54:57.558580 15481 raft_consensus.cc:2802] T 15f8fd7d9e6242c6b6c51251d618ef09 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election won for term 1
W20250830 07:54:57.558665 13228 catalog_manager.cc:5415] Ignoring report from unknown tablet 74f2fcc22fd545fb8ca7c20619843023
I20250830 07:54:57.558660 15481 raft_consensus.cc:491] T 15f8fd7d9e6242c6b6c51251d618ef09 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20250830 07:54:57.558722 13228 catalog_manager.cc:5415] Ignoring report from unknown tablet 88bbd6b4c795433d9b6ad746353f3aa1
I20250830 07:54:57.558722 15481 raft_consensus.cc:3058] T 15f8fd7d9e6242c6b6c51251d618ef09 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
W20250830 07:54:57.558805 13228 catalog_manager.cc:5415] Ignoring report from unknown tablet 042fd7ff08fc4695b87bb8f9d225ef12
I20250830 07:54:57.560372 13228 catalog_manager.cc:5674] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325) does not have the latest schema for tablet 91705fc35a1b4977b89bac1765c886c0 (table default.Table_4f53e333521540848fc99c0bf37c1639 [id=48089766c3514336991a5ada71b03dd0]). Expected version 1 got 0
I20250830 07:54:57.560890 13886 tablet_bootstrap.cc:492] T d171ad1667fa44c993ec5fd7d701d8e0 P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:54:57.561018 13886 ts_tablet_manager.cc:1397] T d171ad1667fa44c993ec5fd7d701d8e0 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.029s user 0.002s sys 0.004s
I20250830 07:54:57.561481 15481 raft_consensus.cc:513] T 15f8fd7d9e6242c6b6c51251d618ef09 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:57.561666 15863 consensus_queue.cc:1035] T 0208de98277c4d6889fb0289b6013ae1 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:54:57.561708 13701 leader_election.cc:304] T 33701eeb12fc451d90ae0b1c4dd7d134 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 2065c332f15a4739899af79f3669c3ba, 6b5e454d98894637b466ea27f1b647f9
I20250830 07:54:57.561905 15721 raft_consensus.cc:3058] T 33701eeb12fc451d90ae0b1c4dd7d134 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Advancing to term 2
I20250830 07:54:57.561934 15481 leader_election.cc:290] T 15f8fd7d9e6242c6b6c51251d618ef09 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Requested vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
I20250830 07:54:57.558591 15608 raft_consensus.cc:491] T 2b4103f07e96490488913059a95af0c3 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:54:57.562819 15608 raft_consensus.cc:3058] T 2b4103f07e96490488913059a95af0c3 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:57.562778 13487 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "509e08290f3842cfbde8b74ff9f4f70f" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:54:57.562968 13487 raft_consensus.cc:2466] T 509e08290f3842cfbde8b74ff9f4f70f P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 0.
I20250830 07:54:57.565083 15608 raft_consensus.cc:513] T 2b4103f07e96490488913059a95af0c3 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:57.565496 15721 raft_consensus.cc:2747] T 33701eeb12fc451d90ae0b1c4dd7d134 P 9b057ade5dce45af9f8bf0bedf8b917f [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20250830 07:54:57.565531 15608 leader_election.cc:290] T 2b4103f07e96490488913059a95af0c3 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Requested vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
I20250830 07:54:57.558732 15365 consensus_queue.cc:1035] T 23d2c7013c9c4b4aacf47e6ac7ab5a0b P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20250830 07:54:57.557142 15748 consensus_queue.cc:237] T a0cf1de8485941eb8a557a6e2f783047 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:57.567029 13230 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_246a8a97b0dc47138fc66a1b807a7355" } modify_external_catalogs: true
I20250830 07:54:57.567237 13230 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_246a8a97b0dc47138fc66a1b807a7355" } modify_external_catalogs: true
I20250830 07:54:57.567782 15603 consensus_queue.cc:1035] T f66e1d07039841088a444ee0203a4eb0 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:54:57.568058 13701 leader_election.cc:304] T 579324e1f6474d398db10da3093650dd P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:54:57.568300 15721 raft_consensus.cc:2802] T 579324e1f6474d398db10da3093650dd P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:54:57.568356 13701 leader_election.cc:304] T 240a6bfad8fa478598a67a27c2dedf62 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:54:57.568404 15721 raft_consensus.cc:491] T 579324e1f6474d398db10da3093650dd P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:54:57.568537 15608 raft_consensus.cc:2802] T 240a6bfad8fa478598a67a27c2dedf62 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election won for term 1
I20250830 07:54:57.568645 15608 raft_consensus.cc:695] T 240a6bfad8fa478598a67a27c2dedf62 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 LEADER]: Becoming Leader. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Running, Role: LEADER
I20250830 07:54:57.568817 15608 consensus_queue.cc:237] T 240a6bfad8fa478598a67a27c2dedf62 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:57.568893 13226 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_9b1b34a57b5d423f8f6c8296cd4b7cf6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250830 07:54:57.569089 13231 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_d7be913531b147488a9bd57ae542662b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:57.569407 13226 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9b1b34a57b5d423f8f6c8296cd4b7cf6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250830 07:54:57.569407 13231 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d7be913531b147488a9bd57ae542662b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:57.570851 13233 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_215b7f39935142a88ce385ee6fc0a5c6" } modify_external_catalogs: true
I20250830 07:54:57.571022 13233 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_215b7f39935142a88ce385ee6fc0a5c6" } modify_external_catalogs: true
I20250830 07:54:57.571306 13701 leader_election.cc:304] T f332d1b56d924c91a79cf6572dea1cd2 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:54:57.571498 15365 raft_consensus.cc:2802] T f332d1b56d924c91a79cf6572dea1cd2 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:54:57.571550 15365 raft_consensus.cc:491] T f332d1b56d924c91a79cf6572dea1cd2 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:54:57.571599 15365 raft_consensus.cc:3058] T f332d1b56d924c91a79cf6572dea1cd2 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:57.572419 13228 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_fbcb77b93b694961a6bf34e7dd764df9" } new_table_name: "default.Table_9f5155960e2f48849d472a923e931266" modify_external_catalogs: true
I20250830 07:54:57.573835 15365 raft_consensus.cc:513] T f332d1b56d924c91a79cf6572dea1cd2 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:57.574476 15728 raft_consensus.cc:491] T 69f2105c5eeb47e9a848ae7bf8779996 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:57.574608 15728 raft_consensus.cc:513] T 69f2105c5eeb47e9a848ae7bf8779996 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:57.576689 13225 master_service.cc:948] ReplaceTablet: received request to replace tablet 519b3e58b63b402d84e234f5e180b98c from {username='slave'} at 127.0.0.1:42126
I20250830 07:54:57.578440 15728 leader_election.cc:290] T 69f2105c5eeb47e9a848ae7bf8779996 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:57.574326 15365 leader_election.cc:290] T f332d1b56d924c91a79cf6572dea1cd2 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Requested vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967)
I20250830 07:54:57.568552 15721 raft_consensus.cc:3058] T 579324e1f6474d398db10da3093650dd P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:57.583678 15603 consensus_queue.cc:1035] T 97d49a1f600f4c13a4aafca99cedabe8 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:54:57.583945 15601 consensus_queue.cc:1035] T 689b4fee1dd04b3d9ccdea334b0f6b59 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:54:57.584263 13886 raft_consensus.cc:357] T d171ad1667fa44c993ec5fd7d701d8e0 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:57.584403 13886 raft_consensus.cc:383] T d171ad1667fa44c993ec5fd7d701d8e0 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:57.584503 13886 raft_consensus.cc:738] T d171ad1667fa44c993ec5fd7d701d8e0 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:54:57.584718 13886 consensus_queue.cc:260] T d171ad1667fa44c993ec5fd7d701d8e0 P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:57.585258 13886 ts_tablet_manager.cc:1428] T d171ad1667fa44c993ec5fd7d701d8e0 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.024s user 0.000s sys 0.002s
W20250830 07:54:57.586589 13561 leader_election.cc:343] T 69f2105c5eeb47e9a848ae7bf8779996 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): Not found: Tablet not found: 69f2105c5eeb47e9a848ae7bf8779996
W20250830 07:54:57.586763 13422 leader_election.cc:343] T d1d5e0d40a91457da65a0e925289309e P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:57.586975 13422 leader_election.cc:304] T d1d5e0d40a91457da65a0e925289309e P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba; no voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:54:57.586704 13887 tablet_bootstrap.cc:492] T 2aea1a69d22544899b0218be7e0f8799 P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:54:57.587270 15813 raft_consensus.cc:2747] T d1d5e0d40a91457da65a0e925289309e P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:54:57.587476 13887 ts_tablet_manager.cc:1397] T 2aea1a69d22544899b0218be7e0f8799 P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.114s user 0.001s sys 0.003s
W20250830 07:54:57.588865 13422 leader_election.cc:343] T bdeb89bbb3ad4e67bbc74b78454eeb7e P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:57.589077 13422 leader_election.cc:304] T bdeb89bbb3ad4e67bbc74b78454eeb7e P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba; no voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:54:57.589309 15813 raft_consensus.cc:2747] T bdeb89bbb3ad4e67bbc74b78454eeb7e P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:54:57.589712 13562 leader_election.cc:304] T 6251a06d1efe44e38d35d962c468f8b2 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b5e454d98894637b466ea27f1b647f9; no voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f
W20250830 07:54:57.589609 13422 leader_election.cc:343] T 2c4c3c61cddf42668d3a09f4fbc5f641 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:57.589936 13422 leader_election.cc:304] T 2c4c3c61cddf42668d3a09f4fbc5f641 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba; no voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:54:57.590226 15813 raft_consensus.cc:2747] T 2c4c3c61cddf42668d3a09f4fbc5f641 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20250830 07:54:57.598424 13234 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 475060040e684d10af4e913bb9aae024 has no consensus state
I20250830 07:54:57.598762 13232 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_749ff0ca78e14556a57a9fffc88b1dbb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:57.599196 13232 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_749ff0ca78e14556a57a9fffc88b1dbb in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:57.599215 13887 raft_consensus.cc:357] T 2aea1a69d22544899b0218be7e0f8799 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:57.599375 13887 raft_consensus.cc:383] T 2aea1a69d22544899b0218be7e0f8799 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:57.599524 13887 raft_consensus.cc:738] T 2aea1a69d22544899b0218be7e0f8799 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:54:57.599634 13886 tablet_bootstrap.cc:492] T 2c4c3c61cddf42668d3a09f4fbc5f641 P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:54:57.599730 13887 consensus_queue.cc:260] T 2aea1a69d22544899b0218be7e0f8799 P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:57.600364 13887 ts_tablet_manager.cc:1428] T 2aea1a69d22544899b0218be7e0f8799 P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.012s user 0.001s sys 0.001s
I20250830 07:54:57.600457 13229 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_f7fd7f508e974a608e35bb9433fc39ec" } new_table_name: "default.Table_7b45f486a16e41b793e8d69f15391614" modify_external_catalogs: true
I20250830 07:54:57.600631 13887 tablet_bootstrap.cc:492] T ba4e1fccb8f046d6b63afe67c1f9d538 P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:54:57.601348 13886 tablet_bootstrap.cc:654] T 2c4c3c61cddf42668d3a09f4fbc5f641 P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:57.602669 15721 raft_consensus.cc:513] T 579324e1f6474d398db10da3093650dd P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:57.603387 15721 leader_election.cc:290] T 579324e1f6474d398db10da3093650dd P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Requested vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
I20250830 07:54:57.604060 15582 raft_consensus.cc:2747] T 6251a06d1efe44e38d35d962c468f8b2 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:54:57.608038 13230 catalog_manager.cc:5864] Not sending DeleteTablet requests; no consensus state for tablet 0dab7c4f6ca94af9987a44ca5ef099fd
I20250830 07:54:57.609975 13882 tablet_bootstrap.cc:654] T c8bc6e07377a4ba99c39a909dae11402 P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:57.619027 13887 tablet_bootstrap.cc:654] T ba4e1fccb8f046d6b63afe67c1f9d538 P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:57.620898 15863 consensus_queue.cc:1035] T 52e910677ae34630a919d1d3f21b7e83 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20250830 07:54:57.622928 13701 leader_election.cc:343] T 5aef6fd239ba43478cd978fa5d29b26e P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): Not found: Tablet not found: 5aef6fd239ba43478cd978fa5d29b26e
I20250830 07:54:57.623070 13701 leader_election.cc:304] T 5aef6fd239ba43478cd978fa5d29b26e P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 2065c332f15a4739899af79f3669c3ba, 6b5e454d98894637b466ea27f1b647f9
I20250830 07:54:57.623291 15365 raft_consensus.cc:2747] T 5aef6fd239ba43478cd978fa5d29b26e P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:54:57.623672 15365 consensus_queue.cc:1035] T 62bc8168176e4678a77827c5b7cc0f3e P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:54:57.624136 13611 raft_consensus.cc:3058] T 2048c04578104c78aa6504fd9d5953a3 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:57.627296 13230 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_d7a9b163efce418a90fbd731668d2a67"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:57.627738 13230 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d7a9b163efce418a90fbd731668d2a67 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:57.628757 13701 leader_election.cc:304] T 509e08290f3842cfbde8b74ff9f4f70f P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters:
I20250830 07:54:57.629227 15863 raft_consensus.cc:2802] T 509e08290f3842cfbde8b74ff9f4f70f P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:54:57.629339 15863 raft_consensus.cc:491] T 509e08290f3842cfbde8b74ff9f4f70f P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:54:57.629470 15863 raft_consensus.cc:3058] T 509e08290f3842cfbde8b74ff9f4f70f P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:57.633354 13536 heartbeater.cc:344] Connected to a master server at 127.12.209.60:43889
I20250830 07:54:57.639684 13614 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "509e08290f3842cfbde8b74ff9f4f70f" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:57.640173 13614 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "15f8fd7d9e6242c6b6c51251d618ef09" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9"
I20250830 07:54:57.640656 13614 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "2b4103f07e96490488913059a95af0c3" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9"
I20250830 07:54:57.641193 13614 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f332d1b56d924c91a79cf6572dea1cd2" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9"
I20250830 07:54:57.642328 13614 raft_consensus.cc:3058] T 97d49a1f600f4c13a4aafca99cedabe8 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:57.645336 13614 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "579324e1f6474d398db10da3093650dd" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9"
I20250830 07:54:57.648115 13227 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_0a54b09130b8425f9f06c093345e6a29" } modify_external_catalogs: true
I20250830 07:54:57.648280 13227 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_0a54b09130b8425f9f06c093345e6a29" } modify_external_catalogs: true
I20250830 07:54:57.648312 15863 raft_consensus.cc:513] T 509e08290f3842cfbde8b74ff9f4f70f P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:57.649463 15863 leader_election.cc:290] T 509e08290f3842cfbde8b74ff9f4f70f P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Requested vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
I20250830 07:54:57.650424 13611 raft_consensus.cc:1273] T d1153d8cd2994377ac0dcbfeeda1fd52 P 6b5e454d98894637b466ea27f1b647f9 [term 2 FOLLOWER]: Refusing update from remote peer 2065c332f15a4739899af79f3669c3ba: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
W20250830 07:54:57.650820 13234 catalog_manager.cc:5415] Ignoring report from unknown tablet 2aea1a69d22544899b0218be7e0f8799
I20250830 07:54:57.651688 13882 tablet_bootstrap.cc:492] T c8bc6e07377a4ba99c39a909dae11402 P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:54:57.651798 13882 ts_tablet_manager.cc:1397] T c8bc6e07377a4ba99c39a909dae11402 P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.102s user 0.002s sys 0.001s
I20250830 07:54:57.655108 13882 raft_consensus.cc:357] T c8bc6e07377a4ba99c39a909dae11402 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:57.655257 13882 raft_consensus.cc:383] T c8bc6e07377a4ba99c39a909dae11402 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:57.655308 13882 raft_consensus.cc:738] T c8bc6e07377a4ba99c39a909dae11402 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:54:57.655462 13882 consensus_queue.cc:260] T c8bc6e07377a4ba99c39a909dae11402 P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
W20250830 07:54:57.655551 13234 catalog_manager.cc:5415] Ignoring report from unknown tablet db4077bf8e184ac5809ef629222f2cc5
W20250830 07:54:57.655728 13234 catalog_manager.cc:5415] Ignoring report from unknown tablet 74f2fcc22fd545fb8ca7c20619843023
W20250830 07:54:57.655810 13234 catalog_manager.cc:5415] Ignoring report from unknown tablet 042fd7ff08fc4695b87bb8f9d225ef12
I20250830 07:54:57.656739 13234 catalog_manager.cc:5674] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325) does not have the latest schema for tablet 91705fc35a1b4977b89bac1765c886c0 (table default.Table_4f53e333521540848fc99c0bf37c1639 [id=48089766c3514336991a5ada71b03dd0]). Expected version 1 got 0
I20250830 07:54:57.657394 13882 ts_tablet_manager.cc:1428] T c8bc6e07377a4ba99c39a909dae11402 P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.006s user 0.001s sys 0.001s
I20250830 07:54:57.657653 13882 tablet_bootstrap.cc:492] T 796e01f6a36241fc94e335253929d6ab P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:54:57.657653 13234 catalog_manager.cc:5674] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325) does not have the latest schema for tablet 34199145292d4ddb8c603e5c581f1d15 (table default.Table_7e0dd322b340488ba39ed8049eca0e73 [id=344b9d0cfa1e4ada84a648d6b0c4ab9d]). Expected version 1 got 0
I20250830 07:54:57.662621 13611 raft_consensus.cc:3058] T ef1ab62a5b7845e58d50f34206eaaa27 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:57.665064 13231 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_0beda1759cb64e91ba946fc884b58825" } modify_external_catalogs: true
I20250830 07:54:57.665233 13231 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_0beda1759cb64e91ba946fc884b58825" } modify_external_catalogs: true
I20250830 07:54:57.669976 15814 raft_consensus.cc:491] T fbb1cc8f8eea4a0795f6f8e213b8180f P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:57.670150 15814 raft_consensus.cc:513] T fbb1cc8f8eea4a0795f6f8e213b8180f P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:57.670439 13765 raft_consensus.cc:1273] T d1153d8cd2994377ac0dcbfeeda1fd52 P 9b057ade5dce45af9f8bf0bedf8b917f [term 2 FOLLOWER]: Refusing update from remote peer 2065c332f15a4739899af79f3669c3ba: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20250830 07:54:57.670724 13766 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "439fc51afa6b435e81bc38b9e88d4041" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:57.670773 15814 leader_election.cc:290] T fbb1cc8f8eea4a0795f6f8e213b8180f P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:57.672240 13886 tablet_bootstrap.cc:492] T 2c4c3c61cddf42668d3a09f4fbc5f641 P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:54:57.672444 13886 ts_tablet_manager.cc:1397] T 2c4c3c61cddf42668d3a09f4fbc5f641 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.073s user 0.001s sys 0.003s
I20250830 07:54:57.678742 13233 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet 9b9631c8038a4c6eb9fd0530511777ac
I20250830 07:54:57.679490 13886 raft_consensus.cc:357] T 2c4c3c61cddf42668d3a09f4fbc5f641 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:57.679569 13593 tablet_service.cc:1515] Processing DeleteTablet for tablet 9b9631c8038a4c6eb9fd0530511777ac with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:57 UTC) from {username='slave'} at 127.0.0.1:45306
I20250830 07:54:57.679697 13886 raft_consensus.cc:383] T 2c4c3c61cddf42668d3a09f4fbc5f641 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:57.679798 13886 raft_consensus.cc:738] T 2c4c3c61cddf42668d3a09f4fbc5f641 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:54:57.680032 13886 consensus_queue.cc:260] T 2c4c3c61cddf42668d3a09f4fbc5f641 P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
W20250830 07:54:57.680132 13220 catalog_manager.cc:4908] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet 9b9631c8038a4c6eb9fd0530511777ac because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9b9631c8038a4c6eb9fd0530511777ac already in progress: creating tablet
I20250830 07:54:57.680567 13886 ts_tablet_manager.cc:1428] T 2c4c3c61cddf42668d3a09f4fbc5f641 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.008s user 0.001s sys 0.001s
I20250830 07:54:57.683779 13233 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_2f6c360f9bbc48e880665078710bf673" } modify_external_catalogs: true
I20250830 07:54:57.683840 13886 tablet_bootstrap.cc:492] T bdeb89bbb3ad4e67bbc74b78454eeb7e P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:54:57.683912 13233 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_2f6c360f9bbc48e880665078710bf673" } modify_external_catalogs: true
I20250830 07:54:57.684815 13226 catalog_manager.cc:5674] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743) does not have the latest schema for tablet 924403105a6a40f28aad60647a2a8987 (table default.Table_f62c15a884574e3ebe9ce39aa18d1e00 [id=46ec9117fe9146cb807dd092284616fc]). Expected version 2 got 0
I20250830 07:54:57.684993 13226 catalog_manager.cc:5674] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743) does not have the latest schema for tablet d171ad1667fa44c993ec5fd7d701d8e0 (table default.Table_ffc2a253a4db48708e1f05a732742751 [id=8de51280a0014a9db6181db50fbf74f8]). Expected version 1 got 0
I20250830 07:54:57.685176 13226 catalog_manager.cc:5582] T e72402ca3cdf452fa8f4534c67226253 P 9b057ade5dce45af9f8bf0bedf8b917f reported cstate change: term changed from 0 to 1, leader changed from <none> to 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3). New cstate: current_term: 1 leader_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } health_report { overall_health: HEALTHY } } }
I20250830 07:54:57.686707 13614 raft_consensus.cc:3058] T 62bc8168176e4678a77827c5b7cc0f3e P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:57.692328 13225 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet 519b3e58b63b402d84e234f5e180b98c
I20250830 07:54:57.692711 13225 catalog_manager.cc:6652] ReplaceTablet: tablet 519b3e58b63b402d84e234f5e180b98c deleted and replaced by tablet d6653b50a62742ac8793bf4af5ed4de9
I20250830 07:54:57.692971 13225 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_bc69089ed2524bbdb963765c19f90f17"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:57.693354 13225 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bc69089ed2524bbdb963765c19f90f17 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:57.693547 13882 tablet_bootstrap.cc:654] T 796e01f6a36241fc94e335253929d6ab P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:57.694489 13614 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "509e08290f3842cfbde8b74ff9f4f70f" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9"
I20250830 07:54:57.694696 13593 tablet_service.cc:1515] Processing DeleteTablet for tablet 519b3e58b63b402d84e234f5e180b98c with delete_type TABLET_DATA_DELETED (replaced by tablet d6653b50a62742ac8793bf4af5ed4de9) from {username='slave'} at 127.0.0.1:45306
I20250830 07:54:57.695242 15753 tablet_replica.cc:331] T 519b3e58b63b402d84e234f5e180b98c P 6b5e454d98894637b466ea27f1b647f9: stopping tablet replica
I20250830 07:54:57.695470 15753 raft_consensus.cc:2241] T 519b3e58b63b402d84e234f5e180b98c P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Raft consensus shutting down.
W20250830 07:54:57.696879 13703 leader_election.cc:343] T 509e08290f3842cfbde8b74ff9f4f70f P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:57.697369 13882 tablet_bootstrap.cc:492] T 796e01f6a36241fc94e335253929d6ab P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:54:57.702096 13882 ts_tablet_manager.cc:1397] T 796e01f6a36241fc94e335253929d6ab P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.045s user 0.003s sys 0.002s
W20250830 07:54:57.704605 13228 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 166493c5f21843b8860fea147419ef5e has no consensus state
I20250830 07:54:57.704847 13228 master_service.cc:948] ReplaceTablet: received request to replace tablet 3c3c798b2b7b460b98a30605464763e6 from {username='slave'} at 127.0.0.1:42126
I20250830 07:54:57.705413 13228 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_2582c0a2c83349208884c8982711c53b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:57.705904 13228 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2582c0a2c83349208884c8982711c53b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:57.707753 13764 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "fbb1cc8f8eea4a0795f6f8e213b8180f" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:57.715046 13476 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "15f8fd7d9e6242c6b6c51251d618ef09" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba"
I20250830 07:54:57.715242 13476 raft_consensus.cc:3058] T 15f8fd7d9e6242c6b6c51251d618ef09 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:57.715269 13886 tablet_bootstrap.cc:654] T bdeb89bbb3ad4e67bbc74b78454eeb7e P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
W20250830 07:54:57.717154 13703 leader_election.cc:343] T 15f8fd7d9e6242c6b6c51251d618ef09 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
W20250830 07:54:57.717465 13703 leader_election.cc:343] T 2b4103f07e96490488913059a95af0c3 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:57.717770 13476 raft_consensus.cc:2466] T 15f8fd7d9e6242c6b6c51251d618ef09 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 1.
W20250830 07:54:57.717969 13703 leader_election.cc:343] T f332d1b56d924c91a79cf6572dea1cd2 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:57.718595 15608 consensus_queue.cc:1035] T 97d49a1f600f4c13a4aafca99cedabe8 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:54:57.719379 15753 raft_consensus.cc:2270] T 519b3e58b63b402d84e234f5e180b98c P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Raft consensus is shut down!
W20250830 07:54:57.720016 13703 leader_election.cc:343] T 579324e1f6474d398db10da3093650dd P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:57.720103 15753 ts_tablet_manager.cc:1905] T 519b3e58b63b402d84e234f5e180b98c P 6b5e454d98894637b466ea27f1b647f9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250830 07:54:57.720518 15814 consensus_queue.cc:1035] T d1153d8cd2994377ac0dcbfeeda1fd52 P 2065c332f15a4739899af79f3669c3ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:54:57.722769 15728 raft_consensus.cc:491] T 1520d7257f864ea4ba4b9a5d0443f8a7 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:57.722617 15608 consensus_queue.cc:1035] T 62bc8168176e4678a77827c5b7cc0f3e P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:54:57.722877 13882 raft_consensus.cc:357] T 796e01f6a36241fc94e335253929d6ab P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:57.722878 15728 raft_consensus.cc:513] T 1520d7257f864ea4ba4b9a5d0443f8a7 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:57.723795 13882 raft_consensus.cc:383] T 796e01f6a36241fc94e335253929d6ab P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:57.723841 13882 raft_consensus.cc:738] T 796e01f6a36241fc94e335253929d6ab P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:54:57.724042 13882 consensus_queue.cc:260] T 796e01f6a36241fc94e335253929d6ab P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:57.724372 15728 leader_election.cc:290] T 1520d7257f864ea4ba4b9a5d0443f8a7 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:57.724716 15879 catalog_manager.cc:797] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
I20250830 07:54:57.725064 13476 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "1520d7257f864ea4ba4b9a5d0443f8a7" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:54:57.725310 13476 raft_consensus.cc:2391] T 1520d7257f864ea4ba4b9a5d0443f8a7 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b5e454d98894637b466ea27f1b647f9 in current term 1: Already voted for candidate 9b057ade5dce45af9f8bf0bedf8b917f in this term.
I20250830 07:54:57.726459 15753 ts_tablet_manager.cc:1918] T 519b3e58b63b402d84e234f5e180b98c P 6b5e454d98894637b466ea27f1b647f9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250830 07:54:57.726579 15753 log.cc:1199] T 519b3e58b63b402d84e234f5e180b98c P 6b5e454d98894637b466ea27f1b647f9: Deleting WAL directory at /tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/ts-1/wal/wals/519b3e58b63b402d84e234f5e180b98c
I20250830 07:54:57.726759 13882 ts_tablet_manager.cc:1428] T 796e01f6a36241fc94e335253929d6ab P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.025s user 0.000s sys 0.001s
I20250830 07:54:57.727034 15753 ts_tablet_manager.cc:1939] T 519b3e58b63b402d84e234f5e180b98c P 6b5e454d98894637b466ea27f1b647f9: Deleting consensus metadata
I20250830 07:54:57.727672 13220 catalog_manager.cc:4928] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): tablet 519b3e58b63b402d84e234f5e180b98c (table default.Table_9a9e5d4dcbfc49b29ff69d299441ed82 [id=297cf31cb8d04fe3b40216565c923e5f]) successfully deleted
I20250830 07:54:57.728633 13476 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "2b4103f07e96490488913059a95af0c3" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba"
I20250830 07:54:57.728912 13476 raft_consensus.cc:3058] T 2b4103f07e96490488913059a95af0c3 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:57.730860 13232 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_b272a60cfdfb49fda18b9aaf3725d3e8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:57.731544 13232 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b272a60cfdfb49fda18b9aaf3725d3e8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:57.732836 13476 raft_consensus.cc:2466] T 2b4103f07e96490488913059a95af0c3 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 1.
W20250830 07:54:57.733995 13703 leader_election.cc:343] T 509e08290f3842cfbde8b74ff9f4f70f P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:57.735088 13487 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f332d1b56d924c91a79cf6572dea1cd2" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba"
I20250830 07:54:57.735255 13487 raft_consensus.cc:3058] T f332d1b56d924c91a79cf6572dea1cd2 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:57.735332 13614 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "fbb1cc8f8eea4a0795f6f8e213b8180f" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:57.736013 13614 raft_consensus.cc:1273] T 33701eeb12fc451d90ae0b1c4dd7d134 P 6b5e454d98894637b466ea27f1b647f9 [term 2 FOLLOWER]: Refusing update from remote peer 2065c332f15a4739899af79f3669c3ba: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20250830 07:54:57.737780 13487 raft_consensus.cc:2466] T f332d1b56d924c91a79cf6572dea1cd2 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 1.
W20250830 07:54:57.748363 13562 leader_election.cc:343] T 69f2105c5eeb47e9a848ae7bf8779996 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Not found: Tablet not found: 69f2105c5eeb47e9a848ae7bf8779996
I20250830 07:54:57.748474 13562 leader_election.cc:304] T 69f2105c5eeb47e9a848ae7bf8779996 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b5e454d98894637b466ea27f1b647f9; no voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:54:57.750309 15706 raft_consensus.cc:2747] T 69f2105c5eeb47e9a848ae7bf8779996 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:54:57.727048 13882 tablet_bootstrap.cc:492] T ee44ab24333742909f773889ad5c3e00 P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:54:57.761777 13882 tablet_bootstrap.cc:654] T ee44ab24333742909f773889ad5c3e00 P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:57.763625 15706 raft_consensus.cc:491] T 796e01f6a36241fc94e335253929d6ab P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:57.763739 15706 raft_consensus.cc:513] T 796e01f6a36241fc94e335253929d6ab P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:57.764343 15706 leader_election.cc:290] T 796e01f6a36241fc94e335253929d6ab P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:57.764878 13475 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "796e01f6a36241fc94e335253929d6ab" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:54:57.765193 13475 raft_consensus.cc:2391] T 796e01f6a36241fc94e335253929d6ab P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b5e454d98894637b466ea27f1b647f9 in current term 1: Already voted for candidate 9b057ade5dce45af9f8bf0bedf8b917f in this term.
I20250830 07:54:57.765596 13887 tablet_bootstrap.cc:492] T ba4e1fccb8f046d6b63afe67c1f9d538 P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:54:57.765772 13887 ts_tablet_manager.cc:1397] T ba4e1fccb8f046d6b63afe67c1f9d538 P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.165s user 0.002s sys 0.002s
I20250830 07:54:57.766660 13887 raft_consensus.cc:357] T ba4e1fccb8f046d6b63afe67c1f9d538 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:57.766897 13887 raft_consensus.cc:383] T ba4e1fccb8f046d6b63afe67c1f9d538 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:57.767009 13887 raft_consensus.cc:738] T ba4e1fccb8f046d6b63afe67c1f9d538 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:54:57.767264 13887 consensus_queue.cc:260] T ba4e1fccb8f046d6b63afe67c1f9d538 P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:57.767812 13887 ts_tablet_manager.cc:1428] T ba4e1fccb8f046d6b63afe67c1f9d538 P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20250830 07:54:57.768173 13887 tablet_bootstrap.cc:492] T 55bd3f378b854476a24f657f5e23843d P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
W20250830 07:54:57.769503 13703 consensus_peers.cc:489] T 76ab56c469cf4675a4e21acbe0a8085d P 9b057ade5dce45af9f8bf0bedf8b917f -> Peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Couldn't send request to peer 6b5e454d98894637b466ea27f1b647f9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20250830 07:54:57.770105 13887 tablet_bootstrap.cc:654] T 55bd3f378b854476a24f657f5e23843d P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
W20250830 07:54:57.771584 13423 leader_election.cc:343] T fbb1cc8f8eea4a0795f6f8e213b8180f P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:57.771911 15814 consensus_queue.cc:1035] T 33701eeb12fc451d90ae0b1c4dd7d134 P 2065c332f15a4739899af79f3669c3ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:54:57.772042 13764 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "1520d7257f864ea4ba4b9a5d0443f8a7" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:57.772447 15608 raft_consensus.cc:491] T 5fee48de90014f94b796e726a4d16b85 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:57.772605 15608 raft_consensus.cc:513] T 5fee48de90014f94b796e726a4d16b85 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:57.773291 15608 leader_election.cc:290] T 5fee48de90014f94b796e726a4d16b85 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
I20250830 07:54:57.775431 13475 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "579324e1f6474d398db10da3093650dd" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba"
I20250830 07:54:57.775604 13475 raft_consensus.cc:3058] T 579324e1f6474d398db10da3093650dd P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:57.778290 13475 raft_consensus.cc:2466] T 579324e1f6474d398db10da3093650dd P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 1.
I20250830 07:54:57.791594 13764 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "796e01f6a36241fc94e335253929d6ab" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:57.791924 13886 tablet_bootstrap.cc:492] T bdeb89bbb3ad4e67bbc74b78454eeb7e P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:54:57.792066 13886 ts_tablet_manager.cc:1397] T bdeb89bbb3ad4e67bbc74b78454eeb7e P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.108s user 0.001s sys 0.006s
I20250830 07:54:57.792984 13886 raft_consensus.cc:357] T bdeb89bbb3ad4e67bbc74b78454eeb7e P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:57.793176 13886 raft_consensus.cc:383] T bdeb89bbb3ad4e67bbc74b78454eeb7e P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:57.793222 13886 raft_consensus.cc:738] T bdeb89bbb3ad4e67bbc74b78454eeb7e P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:54:57.793409 13886 consensus_queue.cc:260] T bdeb89bbb3ad4e67bbc74b78454eeb7e P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:57.793917 13886 ts_tablet_manager.cc:1428] T bdeb89bbb3ad4e67bbc74b78454eeb7e P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20250830 07:54:57.794246 13886 tablet_bootstrap.cc:492] T 2c31d119743f49589703c434ac6c7548 P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:54:57.794981 13483 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "509e08290f3842cfbde8b74ff9f4f70f" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba"
I20250830 07:54:57.795194 13483 raft_consensus.cc:3058] T 509e08290f3842cfbde8b74ff9f4f70f P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:57.798568 13483 raft_consensus.cc:2466] T 509e08290f3842cfbde8b74ff9f4f70f P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 1.
I20250830 07:54:57.800447 15814 consensus_queue.cc:1035] T d1153d8cd2994377ac0dcbfeeda1fd52 P 2065c332f15a4739899af79f3669c3ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20250830 07:54:57.801218 13422 leader_election.cc:343] T 439fc51afa6b435e81bc38b9e88d4041 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:57.801427 13422 leader_election.cc:304] T 439fc51afa6b435e81bc38b9e88d4041 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba; no voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:54:57.801905 15814 raft_consensus.cc:2747] T 439fc51afa6b435e81bc38b9e88d4041 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20250830 07:54:57.813447 13422 leader_election.cc:343] T fbb1cc8f8eea4a0795f6f8e213b8180f P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:57.815140 13886 tablet_bootstrap.cc:654] T 2c31d119743f49589703c434ac6c7548 P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:57.820964 15814 raft_consensus.cc:491] T 2aea1a69d22544899b0218be7e0f8799 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:57.821100 15814 raft_consensus.cc:513] T 2aea1a69d22544899b0218be7e0f8799 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:57.821704 15814 leader_election.cc:290] T 2aea1a69d22544899b0218be7e0f8799 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
W20250830 07:54:57.836179 13229 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 6bd5f6b3e0a0420c8c4e6e2987d97db3 has no consensus state
I20250830 07:54:57.836525 13229 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_f961d521671c49a495316f4ae27861ea"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:57.837031 13229 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f961d521671c49a495316f4ae27861ea in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:57.837733 15608 raft_consensus.cc:491] T 208995abd6d44dbea3b5ebbea27d6a39 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:57.837875 15608 raft_consensus.cc:513] T 208995abd6d44dbea3b5ebbea27d6a39 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:57.838238 13234 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_33e2adea11d84d4ab06f5324807687ca"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:57.838629 13234 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_33e2adea11d84d4ab06f5324807687ca in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:57.838653 15608 leader_election.cc:290] T 208995abd6d44dbea3b5ebbea27d6a39 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
I20250830 07:54:57.840407 13887 tablet_bootstrap.cc:492] T 55bd3f378b854476a24f657f5e23843d P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:54:57.840557 13887 ts_tablet_manager.cc:1397] T 55bd3f378b854476a24f657f5e23843d P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.072s user 0.004s sys 0.005s
I20250830 07:54:57.841785 13887 raft_consensus.cc:357] T 55bd3f378b854476a24f657f5e23843d P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:57.842063 13887 raft_consensus.cc:383] T 55bd3f378b854476a24f657f5e23843d P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:57.842167 13887 raft_consensus.cc:738] T 55bd3f378b854476a24f657f5e23843d P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:54:57.842384 13887 consensus_queue.cc:260] T 55bd3f378b854476a24f657f5e23843d P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:57.843251 13887 ts_tablet_manager.cc:1428] T 55bd3f378b854476a24f657f5e23843d P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20250830 07:54:57.843528 13887 tablet_bootstrap.cc:492] T b2248b305c9f448a9e30661142ad10ea P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:54:57.845569 13882 tablet_bootstrap.cc:492] T ee44ab24333742909f773889ad5c3e00 P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:54:57.845791 13882 ts_tablet_manager.cc:1397] T ee44ab24333742909f773889ad5c3e00 P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.119s user 0.001s sys 0.003s
I20250830 07:54:57.846485 13882 raft_consensus.cc:357] T ee44ab24333742909f773889ad5c3e00 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:57.846659 13882 raft_consensus.cc:383] T ee44ab24333742909f773889ad5c3e00 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:57.846728 13882 raft_consensus.cc:738] T ee44ab24333742909f773889ad5c3e00 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:54:57.846658 15107 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" instance_seqno: 1756540470476645) as {username='slave'} at 127.12.209.3:47533; Asking this server to re-register.
I20250830 07:54:57.847005 13882 consensus_queue.cc:260] T ee44ab24333742909f773889ad5c3e00 P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:57.847292 13622 raft_consensus.cc:3058] T 1520d7257f864ea4ba4b9a5d0443f8a7 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:57.847642 13882 ts_tablet_manager.cc:1428] T ee44ab24333742909f773889ad5c3e00 P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20250830 07:54:57.847898 13882 tablet_bootstrap.cc:492] T f5baa35307a1425c8d52666d130d6d8a P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:54:57.849545 13882 tablet_bootstrap.cc:654] T f5baa35307a1425c8d52666d130d6d8a P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:57.851511 13622 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "208995abd6d44dbea3b5ebbea27d6a39" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:57.852759 13614 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "5fee48de90014f94b796e726a4d16b85" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:57.859427 13230 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_41f84caea9ad4a22ad498cf3e5de6242" } new_table_name: "default.Table_5a699d47d9ea42a5a218bfdabc7093e6" modify_external_catalogs: true
I20250830 07:54:57.860661 13227 catalog_manager.cc:5864] Not sending DeleteTablet requests; no consensus state for tablet c81e551f3b344efba26ef4fcfa4591e1
I20250830 07:54:57.860924 13227 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_daeb6945eeb54c8f8bb523267b6cc6f3" } new_table_name: "default.Table_8b44e4f248804beeb3c27df869d09f47" modify_external_catalogs: true
I20250830 07:54:57.861912 13231 catalog_manager.cc:5864] Not sending DeleteTablet requests; no consensus state for tablet a270d7188cae412c93feb78fd45180cd
I20250830 07:54:57.862087 13231 master_service.cc:948] ReplaceTablet: received request to replace tablet 2c31d119743f49589703c434ac6c7548 from {username='slave'} at 127.0.0.1:42126
I20250830 07:54:57.862401 13764 raft_consensus.cc:1273] T 33701eeb12fc451d90ae0b1c4dd7d134 P 9b057ade5dce45af9f8bf0bedf8b917f [term 2 FOLLOWER]: Refusing update from remote peer 2065c332f15a4739899af79f3669c3ba: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20250830 07:54:57.862459 13231 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_bea6be7ebdd84480b03c7f64840bb169"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:57.862851 13231 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bea6be7ebdd84480b03c7f64840bb169 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:57.864042 13233 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet f5baa35307a1425c8d52666d130d6d8a
I20250830 07:54:57.864785 13233 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_835f7ea40d0949f8befe28eccd0bc474" } new_table_name: "default.Table_5c9e71b2c5e44597922aff797fd2f700" modify_external_catalogs: true
I20250830 07:54:57.867545 13226 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_2e94171cf3db418ca01ed0269631f53c" } modify_external_catalogs: true
I20250830 07:54:57.867715 13226 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_2e94171cf3db418ca01ed0269631f53c" } modify_external_catalogs: true
I20250830 07:54:57.870741 15706 raft_consensus.cc:491] T ee44ab24333742909f773889ad5c3e00 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:57.870847 15706 raft_consensus.cc:513] T ee44ab24333742909f773889ad5c3e00 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:57.871358 15706 leader_election.cc:290] T ee44ab24333742909f773889ad5c3e00 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:57.872573 13593 tablet_service.cc:1515] Processing DeleteTablet for tablet f5baa35307a1425c8d52666d130d6d8a with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:57 UTC) from {username='slave'} at 127.0.0.1:45306
I20250830 07:54:57.873101 13225 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_74688d00c63b47e1a1bf1006fea718e2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:57.873488 13225 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_74688d00c63b47e1a1bf1006fea718e2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250830 07:54:57.874513 13220 catalog_manager.cc:4908] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet f5baa35307a1425c8d52666d130d6d8a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f5baa35307a1425c8d52666d130d6d8a already in progress: creating tablet
I20250830 07:54:57.875195 13820 heartbeater.cc:461] Registering TS with master...
I20250830 07:54:57.879500 15608 raft_consensus.cc:491] T d171ad1667fa44c993ec5fd7d701d8e0 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:57.879699 15608 raft_consensus.cc:513] T d171ad1667fa44c993ec5fd7d701d8e0 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:57.880393 15608 leader_election.cc:290] T d171ad1667fa44c993ec5fd7d701d8e0 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
I20250830 07:54:57.880963 13701 leader_election.cc:304] T 15f8fd7d9e6242c6b6c51251d618ef09 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:54:57.881266 15608 raft_consensus.cc:2802] T 15f8fd7d9e6242c6b6c51251d618ef09 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election won for term 1
I20250830 07:54:57.881474 15608 raft_consensus.cc:695] T 15f8fd7d9e6242c6b6c51251d618ef09 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 LEADER]: Becoming Leader. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Running, Role: LEADER
I20250830 07:54:57.881731 15608 consensus_queue.cc:237] T 15f8fd7d9e6242c6b6c51251d618ef09 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:57.883548 13228 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_8a2d7702361e4333bc6e9ec2f2e4464a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:57.884025 13228 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8a2d7702361e4333bc6e9ec2f2e4464a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:57.883462 13562 leader_election.cc:304] T 1520d7257f864ea4ba4b9a5d0443f8a7 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b5e454d98894637b466ea27f1b647f9; no voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:54:57.885623 15728 raft_consensus.cc:2747] T 1520d7257f864ea4ba4b9a5d0443f8a7 P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:54:57.887416 13232 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_40a108cef13443eca0b5fd40cdf626f7" } modify_external_catalogs: true
I20250830 07:54:57.887562 13232 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_40a108cef13443eca0b5fd40cdf626f7" } modify_external_catalogs: true
I20250830 07:54:57.887720 13886 tablet_bootstrap.cc:492] T 2c31d119743f49589703c434ac6c7548 P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:54:57.888231 13886 ts_tablet_manager.cc:1397] T 2c31d119743f49589703c434ac6c7548 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.094s user 0.005s sys 0.004s
I20250830 07:54:57.887964 13562 leader_election.cc:304] T 796e01f6a36241fc94e335253929d6ab P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b5e454d98894637b466ea27f1b647f9; no voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:54:57.889068 13886 raft_consensus.cc:357] T 2c31d119743f49589703c434ac6c7548 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:57.889288 13886 raft_consensus.cc:383] T 2c31d119743f49589703c434ac6c7548 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:57.889392 13886 raft_consensus.cc:738] T 2c31d119743f49589703c434ac6c7548 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:54:57.889642 13886 consensus_queue.cc:260] T 2c31d119743f49589703c434ac6c7548 P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:57.891904 15728 raft_consensus.cc:3058] T 796e01f6a36241fc94e335253929d6ab P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:57.893872 13612 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "2aea1a69d22544899b0218be7e0f8799" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:57.894526 15728 raft_consensus.cc:2747] T 796e01f6a36241fc94e335253929d6ab P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20250830 07:54:57.897877 13703 consensus_peers.cc:489] T 1cf23cf78eee46be953bd701aa6bef07 P 9b057ade5dce45af9f8bf0bedf8b917f -> Peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Couldn't send request to peer 6b5e454d98894637b466ea27f1b647f9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20250830 07:54:57.900880 13886 ts_tablet_manager.cc:1428] T 2c31d119743f49589703c434ac6c7548 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.013s user 0.001s sys 0.001s
I20250830 07:54:57.872258 13488 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "ee44ab24333742909f773889ad5c3e00" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:54:57.908138 13488 raft_consensus.cc:2391] T ee44ab24333742909f773889ad5c3e00 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b5e454d98894637b466ea27f1b647f9 in current term 1: Already voted for candidate 9b057ade5dce45af9f8bf0bedf8b917f in this term.
W20250830 07:54:57.910332 13423 leader_election.cc:343] T 2aea1a69d22544899b0218be7e0f8799 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:57.912892 13887 tablet_bootstrap.cc:654] T b2248b305c9f448a9e30661142ad10ea P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:57.913076 13612 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "d171ad1667fa44c993ec5fd7d701d8e0" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:57.913602 15107 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" instance_seqno: 1756540469993507) as {username='slave'} at 127.12.209.2:48429; Asking this server to re-register.
I20250830 07:54:57.919847 13674 heartbeater.cc:461] Registering TS with master...
I20250830 07:54:57.928370 13612 raft_consensus.cc:3058] T 6251a06d1efe44e38d35d962c468f8b2 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:57.930251 15813 raft_consensus.cc:491] T 3bca390f6d4343cba7a9fb07f0d4d72b P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:57.930370 15813 raft_consensus.cc:513] T 3bca390f6d4343cba7a9fb07f0d4d72b P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:57.930985 15813 leader_election.cc:290] T 3bca390f6d4343cba7a9fb07f0d4d72b P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:57.901093 15863 consensus_queue.cc:1035] T 8cce7e5537794e9484f5a7c82b9e6e1d P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20250830 07:54:57.901798 13703 consensus_peers.cc:489] T ff72a0fd9a0e46a6bd54a15e4ad783b4 P 9b057ade5dce45af9f8bf0bedf8b917f -> Peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Couldn't send request to peer 6b5e454d98894637b466ea27f1b647f9. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ff72a0fd9a0e46a6bd54a15e4ad783b4. This is attempt 1: this message will repeat every 5th retry.
I20250830 07:54:57.907656 13701 leader_election.cc:304] T 2b4103f07e96490488913059a95af0c3 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:54:57.935190 15868 raft_consensus.cc:2802] T 2b4103f07e96490488913059a95af0c3 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election won for term 1
I20250830 07:54:57.935307 15868 raft_consensus.cc:695] T 2b4103f07e96490488913059a95af0c3 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 LEADER]: Becoming Leader. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Running, Role: LEADER
I20250830 07:54:57.935405 15365 consensus_queue.cc:1035] T 8cce7e5537794e9484f5a7c82b9e6e1d P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:54:57.935561 15868 consensus_queue.cc:237] T 2b4103f07e96490488913059a95af0c3 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:57.937127 15365 consensus_queue.cc:1035] T 1520d7257f864ea4ba4b9a5d0443f8a7 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20250830 07:54:57.937228 13703 leader_election.cc:343] T 208995abd6d44dbea3b5ebbea27d6a39 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
W20250830 07:54:57.937388 13703 leader_election.cc:343] T 5fee48de90014f94b796e726a4d16b85 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
W20250830 07:54:57.937683 13703 consensus_peers.cc:489] T 52e910677ae34630a919d1d3f21b7e83 P 9b057ade5dce45af9f8bf0bedf8b917f -> Peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Couldn't send request to peer 6b5e454d98894637b466ea27f1b647f9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20250830 07:54:57.938021 13703 consensus_peers.cc:489] T f5baa35307a1425c8d52666d130d6d8a P 9b057ade5dce45af9f8bf0bedf8b917f -> Peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Couldn't send request to peer 6b5e454d98894637b466ea27f1b647f9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
W20250830 07:54:57.938184 13703 consensus_peers.cc:489] T f32ebc2605c34a68aed50379f028052c P 9b057ade5dce45af9f8bf0bedf8b917f -> Peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Couldn't send request to peer 6b5e454d98894637b466ea27f1b647f9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20250830 07:54:57.938597 13703 leader_election.cc:343] T d171ad1667fa44c993ec5fd7d701d8e0 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:57.939391 13766 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "ee44ab24333742909f773889ad5c3e00" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:57.941112 13614 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "3bca390f6d4343cba7a9fb07f0d4d72b" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:57.943060 15813 raft_consensus.cc:491] T cd9903bdfaef4139a1a582c54689da4a P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:57.943202 15813 raft_consensus.cc:513] T cd9903bdfaef4139a1a582c54689da4a P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:57.943837 15813 leader_election.cc:290] T cd9903bdfaef4139a1a582c54689da4a P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:57.944283 15863 raft_consensus.cc:491] T bdeb89bbb3ad4e67bbc74b78454eeb7e P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:57.944397 15863 raft_consensus.cc:513] T bdeb89bbb3ad4e67bbc74b78454eeb7e P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:57.944909 15863 leader_election.cc:290] T bdeb89bbb3ad4e67bbc74b78454eeb7e P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
I20250830 07:54:57.947037 15107 ts_manager.cc:194] Registered new tserver with Master: 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967)
I20250830 07:54:57.946870 13562 leader_election.cc:304] T ee44ab24333742909f773889ad5c3e00 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b5e454d98894637b466ea27f1b647f9; no voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:54:57.948058 15728 raft_consensus.cc:3058] T ee44ab24333742909f773889ad5c3e00 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:57.949992 13886 tablet_bootstrap.cc:492] T 2e63eac2579844ef83bf43f1e6d58634 P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:54:57.950496 15728 raft_consensus.cc:2747] T ee44ab24333742909f773889ad5c3e00 P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:54:57.956530 13886 tablet_bootstrap.cc:654] T 2e63eac2579844ef83bf43f1e6d58634 P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
W20250830 07:54:57.957017 13701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.209.1:45325, user_credentials={real_user=slave}} blocked reactor thread for 49380.2us
I20250830 07:54:57.957217 13701 leader_election.cc:304] T f332d1b56d924c91a79cf6572dea1cd2 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:54:57.958397 15863 raft_consensus.cc:2802] T f332d1b56d924c91a79cf6572dea1cd2 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election won for term 1
I20250830 07:54:57.958585 15863 raft_consensus.cc:695] T f332d1b56d924c91a79cf6572dea1cd2 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 LEADER]: Becoming Leader. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Running, Role: LEADER
I20250830 07:54:57.958869 15863 consensus_queue.cc:237] T f332d1b56d924c91a79cf6572dea1cd2 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:57.963003 15365 raft_consensus.cc:491] T 49165f0001044d72b68263a60ef56457 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:57.963143 15365 raft_consensus.cc:513] T 49165f0001044d72b68263a60ef56457 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:57.963640 15365 leader_election.cc:290] T 49165f0001044d72b68263a60ef56457 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967)
I20250830 07:54:57.973019 15728 raft_consensus.cc:491] T 6ccbaf109e36453ea6645dfd090f5a1a P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:57.973205 15728 raft_consensus.cc:513] T 6ccbaf109e36453ea6645dfd090f5a1a P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:57.973927 15728 leader_election.cc:290] T 6ccbaf109e36453ea6645dfd090f5a1a P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:57.975469 13234 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_83d1032daed546d9ac781ef43a37179b" } new_table_name: "default.Table_9031372b9c1c4fffa792263a57a4a2e1" modify_external_catalogs: true
I20250830 07:54:57.977300 13701 leader_election.cc:304] T 579324e1f6474d398db10da3093650dd P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:54:57.977511 15365 raft_consensus.cc:2802] T 579324e1f6474d398db10da3093650dd P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election won for term 1
I20250830 07:54:57.977692 15365 raft_consensus.cc:695] T 579324e1f6474d398db10da3093650dd P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 LEADER]: Becoming Leader. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Running, Role: LEADER
I20250830 07:54:57.977891 15365 consensus_queue.cc:237] T 579324e1f6474d398db10da3093650dd P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:57.987486 13701 leader_election.cc:304] T 509e08290f3842cfbde8b74ff9f4f70f P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:54:57.987685 15720 raft_consensus.cc:2802] T 509e08290f3842cfbde8b74ff9f4f70f P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election won for term 1
I20250830 07:54:57.987776 15720 raft_consensus.cc:695] T 509e08290f3842cfbde8b74ff9f4f70f P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 LEADER]: Becoming Leader. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Running, Role: LEADER
I20250830 07:54:57.987983 15720 consensus_queue.cc:237] T 509e08290f3842cfbde8b74ff9f4f70f P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
W20250830 07:54:57.988871 13230 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 7f452a38bf584637b7708a42b2a5a35f consensus state has no leader
I20250830 07:54:57.989133 13230 master_service.cc:948] ReplaceTablet: received request to replace tablet 94e28f0788664448b53edb5240a4a4b6 from {username='slave'} at 127.0.0.1:42126
I20250830 07:54:57.989727 13230 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_fa691019086344b789dd9070e0d992e3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:57.990326 13230 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fa691019086344b789dd9070e0d992e3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250830 07:54:57.991719 13227 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet bb8011db615c4ddc9fee0c2e002130d0 has no consensus state
W20250830 07:54:57.992408 13233 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ce68cb69909c42c4bb602338f73940d6 has no consensus state
I20250830 07:54:57.992712 13226 catalog_manager.cc:5864] Not sending DeleteTablet requests; no consensus state for tablet ffda6542953a42b79b3a4ab42438780f
I20250830 07:54:57.993472 13232 catalog_manager.cc:5864] Not sending DeleteTablet requests; no consensus state for tablet 062c54ec0b4845e29be44e734298ebc3
I20250830 07:54:58.001875 15706 raft_consensus.cc:491] T 7aed56dba39e40518e9c3325bcccd74a P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:58.002000 15706 raft_consensus.cc:513] T 7aed56dba39e40518e9c3325bcccd74a P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:58.002496 15706 leader_election.cc:290] T 7aed56dba39e40518e9c3325bcccd74a P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:58.008311 15914 raft_consensus.cc:491] T 00000000000000000000000000000000 P 3ea183a890b84f408b20b55e9eb7c7ed [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:58.009080 13481 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "6ccbaf109e36453ea6645dfd090f5a1a" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:54:58.009335 13481 raft_consensus.cc:2391] T 6ccbaf109e36453ea6645dfd090f5a1a P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b5e454d98894637b466ea27f1b647f9 in current term 1: Already voted for candidate 2065c332f15a4739899af79f3669c3ba in this term.
I20250830 07:54:58.010816 13481 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "7aed56dba39e40518e9c3325bcccd74a" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:54:58.011078 13481 raft_consensus.cc:2391] T 7aed56dba39e40518e9c3325bcccd74a P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b5e454d98894637b466ea27f1b647f9 in current term 1: Already voted for candidate 2065c332f15a4739899af79f3669c3ba in this term.
W20250830 07:54:58.017946 13229 catalog_manager.cc:5415] Ignoring report from unknown tablet ec47a59c22ff4370bd21bc2a18336049
W20250830 07:54:58.018085 13229 catalog_manager.cc:5415] Ignoring report from unknown tablet d1153d8cd2994377ac0dcbfeeda1fd52
W20250830 07:54:58.018504 13229 catalog_manager.cc:5415] Ignoring report from unknown tablet db4077bf8e184ac5809ef629222f2cc5
W20250830 07:54:58.018613 13229 catalog_manager.cc:5415] Ignoring report from unknown tablet 62bc8168176e4678a77827c5b7cc0f3e
W20250830 07:54:58.018692 13229 catalog_manager.cc:5415] Ignoring report from unknown tablet 97d49a1f600f4c13a4aafca99cedabe8
I20250830 07:54:58.018510 15914 raft_consensus.cc:513] T 00000000000000000000000000000000 P 3ea183a890b84f408b20b55e9eb7c7ed [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fea6152429cc4e79a25b18e02aafae57" member_type: VOTER last_known_addr { host: "127.12.209.62" port: 39725 } } peers { permanent_uuid: "5e9d6449ae824acab24c459a72075e88" member_type: VOTER last_known_addr { host: "127.12.209.61" port: 44241 } } peers { permanent_uuid: "3ea183a890b84f408b20b55e9eb7c7ed" member_type: VOTER last_known_addr { host: "127.12.209.60" port: 43889 } }
W20250830 07:54:58.018854 13229 catalog_manager.cc:5415] Ignoring report from unknown tablet 23d2c7013c9c4b4aacf47e6ac7ab5a0b
W20250830 07:54:58.019016 13229 catalog_manager.cc:5415] Ignoring report from unknown tablet 88bbd6b4c795433d9b6ad746353f3aa1
I20250830 07:54:58.012240 15879 catalog_manager.cc:1261] Loaded cluster ID: 90fa2c64725e4c7399db393bcf7c431d
I20250830 07:54:58.019347 13887 tablet_bootstrap.cc:492] T b2248b305c9f448a9e30661142ad10ea P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:54:58.019429 15879 catalog_manager.cc:1554] T 00000000000000000000000000000000 P 3ea183a890b84f408b20b55e9eb7c7ed: loading cluster ID for follower catalog manager: success
I20250830 07:54:58.019531 13887 ts_tablet_manager.cc:1397] T b2248b305c9f448a9e30661142ad10ea P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.176s user 0.002s sys 0.002s
I20250830 07:54:58.020262 15107 ts_manager.cc:194] Registered new tserver with Master: 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:58.020891 13887 raft_consensus.cc:357] T b2248b305c9f448a9e30661142ad10ea P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:58.021126 13887 raft_consensus.cc:383] T b2248b305c9f448a9e30661142ad10ea P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:58.021220 13887 raft_consensus.cc:738] T b2248b305c9f448a9e30661142ad10ea P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:54:58.021469 13887 consensus_queue.cc:260] T b2248b305c9f448a9e30661142ad10ea P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:58.022065 13887 ts_tablet_manager.cc:1428] T b2248b305c9f448a9e30661142ad10ea P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20250830 07:54:58.022375 13887 tablet_bootstrap.cc:492] T 50dfc24a0b9645e4860cd99b1df3bd61 P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:54:58.025017 13622 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "bdeb89bbb3ad4e67bbc74b78454eeb7e" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:58.026149 13622 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "49165f0001044d72b68263a60ef56457" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:58.026288 13622 raft_consensus.cc:2466] T 49165f0001044d72b68263a60ef56457 P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 1.
W20250830 07:54:58.028451 13423 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.209.2:38967, user_credentials={real_user=slave}} blocked reactor thread for 85585.7us
W20250830 07:54:58.028882 13423 leader_election.cc:343] T 3bca390f6d4343cba7a9fb07f0d4d72b P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:58.032713 13886 tablet_bootstrap.cc:492] T 2e63eac2579844ef83bf43f1e6d58634 P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:54:58.032874 13886 ts_tablet_manager.cc:1397] T 2e63eac2579844ef83bf43f1e6d58634 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.098s user 0.002s sys 0.003s
I20250830 07:54:58.032974 13170 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "3ea183a890b84f408b20b55e9eb7c7ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 856 } } ignore_live_leader: false dest_uuid: "fea6152429cc4e79a25b18e02aafae57" is_pre_election: true
I20250830 07:54:58.034081 13886 raft_consensus.cc:357] T 2e63eac2579844ef83bf43f1e6d58634 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:58.034286 13886 raft_consensus.cc:383] T 2e63eac2579844ef83bf43f1e6d58634 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:58.034422 13886 raft_consensus.cc:738] T 2e63eac2579844ef83bf43f1e6d58634 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:54:58.034701 13886 consensus_queue.cc:260] T 2e63eac2579844ef83bf43f1e6d58634 P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:58.035475 13886 ts_tablet_manager.cc:1428] T 2e63eac2579844ef83bf43f1e6d58634 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20250830 07:54:58.035774 13886 tablet_bootstrap.cc:492] T 846338e46b834ae0b5f4e74c7f1325d2 P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:54:58.039040 13886 tablet_bootstrap.cc:654] T 846338e46b834ae0b5f4e74c7f1325d2 P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:58.043339 13232 master_service.cc:948] ReplaceTablet: received request to replace tablet a8660a6ff9254d4f9f0ef047b8682ed1 from {username='slave'} at 127.0.0.1:42126
I20250830 07:54:58.044034 13622 raft_consensus.cc:3058] T c8bc6e07377a4ba99c39a909dae11402 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:58.045795 13229 catalog_manager.cc:5674] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743) does not have the latest schema for tablet 2c4c3c61cddf42668d3a09f4fbc5f641 (table default.Table_0130f2afc22a48e39d534d4fd584b1c2 [id=da55ca35442546899b18ebd8a52e8d0c]). Expected version 2 got 0
I20250830 07:54:58.047013 13232 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_797309d8a52a45d89660d9f9cbdf1810" } new_table_name: "default.Table_1a33d45ffd4d4935b5dfc6b83eb3fbb2" modify_external_catalogs: true
I20250830 07:54:58.046090 13229 catalog_manager.cc:5674] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743) does not have the latest schema for tablet d171ad1667fa44c993ec5fd7d701d8e0 (table default.Table_ffc2a253a4db48708e1f05a732742751 [id=8de51280a0014a9db6181db50fbf74f8]). Expected version 1 got 0
I20250830 07:54:58.050865 13766 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "6ccbaf109e36453ea6645dfd090f5a1a" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:58.051120 13766 raft_consensus.cc:2391] T 6ccbaf109e36453ea6645dfd090f5a1a P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b5e454d98894637b466ea27f1b647f9 in current term 1: Already voted for candidate 9b057ade5dce45af9f8bf0bedf8b917f in this term.
I20250830 07:54:58.051393 13882 tablet_bootstrap.cc:492] T f5baa35307a1425c8d52666d130d6d8a P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:54:58.051779 13882 ts_tablet_manager.cc:1397] T f5baa35307a1425c8d52666d130d6d8a P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.204s user 0.003s sys 0.001s
I20250830 07:54:58.053243 13882 raft_consensus.cc:357] T f5baa35307a1425c8d52666d130d6d8a P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:58.053609 13882 raft_consensus.cc:383] T f5baa35307a1425c8d52666d130d6d8a P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:58.052937 15914 leader_election.cc:290] T 00000000000000000000000000000000 P 3ea183a890b84f408b20b55e9eb7c7ed [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fea6152429cc4e79a25b18e02aafae57 (127.12.209.62:39725), 5e9d6449ae824acab24c459a72075e88 (127.12.209.61:44241)
I20250830 07:54:58.053761 13882 raft_consensus.cc:738] T f5baa35307a1425c8d52666d130d6d8a P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:54:58.054486 13764 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "7aed56dba39e40518e9c3325bcccd74a" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:58.054688 13764 raft_consensus.cc:2391] T 7aed56dba39e40518e9c3325bcccd74a P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b5e454d98894637b466ea27f1b647f9 in current term 1: Already voted for candidate 9b057ade5dce45af9f8bf0bedf8b917f in this term.
W20250830 07:54:58.056036 13221 catalog_manager.cc:4726] Async tablet task AlterTable RPC for tablet bb8011db615c4ddc9fee0c2e002130d0 (table default.Table_8b44e4f248804beeb3c27df869d09f47 [id=c55633df2aa8474ca6c6bb9bf8fea7d1], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet bb8011db615c4ddc9fee0c2e002130d0 has no consensus state
W20250830 07:54:58.057016 13703 leader_election.cc:343] T bdeb89bbb3ad4e67bbc74b78454eeb7e P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:58.059566 13703 leader_election.cc:304] T 49165f0001044d72b68263a60ef56457 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f; no voters:
I20250830 07:54:58.059620 13886 tablet_bootstrap.cc:492] T 846338e46b834ae0b5f4e74c7f1325d2 P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:54:58.059914 13886 ts_tablet_manager.cc:1397] T 846338e46b834ae0b5f4e74c7f1325d2 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.024s user 0.001s sys 0.002s
I20250830 07:54:58.060583 13886 raft_consensus.cc:357] T 846338e46b834ae0b5f4e74c7f1325d2 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:58.060772 13886 raft_consensus.cc:383] T 846338e46b834ae0b5f4e74c7f1325d2 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:58.060861 13886 raft_consensus.cc:738] T 846338e46b834ae0b5f4e74c7f1325d2 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:54:58.061110 13886 consensus_queue.cc:260] T 846338e46b834ae0b5f4e74c7f1325d2 P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:58.061167 13422 leader_election.cc:304] T fbb1cc8f8eea4a0795f6f8e213b8180f P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba; no voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:54:58.061435 15868 raft_consensus.cc:2802] T 49165f0001044d72b68263a60ef56457 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20250830 07:54:58.061507 15868 raft_consensus.cc:491] T 49165f0001044d72b68263a60ef56457 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:54:58.061570 15868 raft_consensus.cc:3058] T 49165f0001044d72b68263a60ef56457 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Advancing to term 2
I20250830 07:54:58.063239 15879 catalog_manager.cc:1576] T 00000000000000000000000000000000 P 3ea183a890b84f408b20b55e9eb7c7ed: acquiring CA information for follower catalog manager: success
I20250830 07:54:58.063728 15868 raft_consensus.cc:513] T 49165f0001044d72b68263a60ef56457 P 9b057ade5dce45af9f8bf0bedf8b917f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:58.064543 15868 leader_election.cc:290] T 49165f0001044d72b68263a60ef56457 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 2 election: Requested vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967)
I20250830 07:54:58.065258 13886 ts_tablet_manager.cc:1428] T 846338e46b834ae0b5f4e74c7f1325d2 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.005s user 0.000s sys 0.001s
I20250830 07:54:58.065565 13886 tablet_bootstrap.cc:492] T 5e2da5434e95445aa4deafce7fde0c6c P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
W20250830 07:54:58.065850 13422 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.209.3:38743, user_credentials={real_user=slave}} blocked reactor thread for 252412us
I20250830 07:54:58.066289 13882 consensus_queue.cc:260] T f5baa35307a1425c8d52666d130d6d8a P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:58.065393 13887 tablet_bootstrap.cc:654] T 50dfc24a0b9645e4860cd99b1df3bd61 P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:58.066036 15919 raft_consensus.cc:2747] T fbb1cc8f8eea4a0795f6f8e213b8180f P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:54:58.069940 13764 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "2aea1a69d22544899b0218be7e0f8799" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:58.076459 13228 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_691d516a93e54dbb86107eb67e932b8c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:58.077075 13228 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_691d516a93e54dbb86107eb67e932b8c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:58.078383 13225 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_8c984670d2954714b6d8c551c318e410"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:58.078774 13225 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8c984670d2954714b6d8c551c318e410 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:58.079267 13887 tablet_bootstrap.cc:492] T 50dfc24a0b9645e4860cd99b1df3bd61 P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:54:58.079386 13887 ts_tablet_manager.cc:1397] T 50dfc24a0b9645e4860cd99b1df3bd61 P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.057s user 0.003s sys 0.000s
I20250830 07:54:58.083053 13226 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_20a3756852a8404a9000ae7e154cfc5f" } modify_external_catalogs: true
I20250830 07:54:58.083228 13226 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_20a3756852a8404a9000ae7e154cfc5f" } modify_external_catalogs: true
I20250830 07:54:58.084630 13233 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_50cbbfc7bad042cba3685666e8d931f8" } modify_external_catalogs: true
I20250830 07:54:58.084807 13233 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_50cbbfc7bad042cba3685666e8d931f8" } modify_external_catalogs: true
I20250830 07:54:58.086045 13231 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_a86aa67f6fd64b1c9306f26e900a021c" } modify_external_catalogs: true
I20250830 07:54:58.086184 13231 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_a86aa67f6fd64b1c9306f26e900a021c" } modify_external_catalogs: true
I20250830 07:54:58.089511 15748 raft_consensus.cc:491] T 846338e46b834ae0b5f4e74c7f1325d2 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:58.089622 15748 raft_consensus.cc:513] T 846338e46b834ae0b5f4e74c7f1325d2 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:58.090111 13886 tablet_bootstrap.cc:654] T 5e2da5434e95445aa4deafce7fde0c6c P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:58.090154 15748 leader_election.cc:290] T 846338e46b834ae0b5f4e74c7f1325d2 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
I20250830 07:54:58.094604 13227 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_9fd1d04d41044b5eb454cba9e8205b39"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:58.095085 13227 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9fd1d04d41044b5eb454cba9e8205b39 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:58.095891 15365 consensus_queue.cc:1035] T c8bc6e07377a4ba99c39a909dae11402 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:54:58.097430 15879 catalog_manager.cc:1604] T 00000000000000000000000000000000 P 3ea183a890b84f408b20b55e9eb7c7ed: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20250830 07:54:58.102098 13622 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "cd9903bdfaef4139a1a582c54689da4a" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:58.105459 15706 raft_consensus.cc:491] T a8660a6ff9254d4f9f0ef047b8682ed1 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:58.105564 15706 raft_consensus.cc:513] T a8660a6ff9254d4f9f0ef047b8682ed1 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:58.106065 15706 leader_election.cc:290] T a8660a6ff9254d4f9f0ef047b8682ed1 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:58.107646 13882 ts_tablet_manager.cc:1428] T f5baa35307a1425c8d52666d130d6d8a P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.056s user 0.001s sys 0.001s
I20250830 07:54:58.109735 13481 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "a8660a6ff9254d4f9f0ef047b8682ed1" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:54:58.109931 13481 raft_consensus.cc:2391] T a8660a6ff9254d4f9f0ef047b8682ed1 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b5e454d98894637b466ea27f1b647f9 in current term 1: Already voted for candidate 2065c332f15a4739899af79f3669c3ba in this term.
I20250830 07:54:58.110316 13882 tablet_bootstrap.cc:492] T 689b4fee1dd04b3d9ccdea334b0f6b59 P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:54:58.109589 13229 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_c9defd904d274655b5220c57cd4e2ab9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:58.112329 13229 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c9defd904d274655b5220c57cd4e2ab9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250830 07:54:58.113734 13234 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d72ef294123b4bcdb8ff63af5de9c621 consensus state has no leader
I20250830 07:54:58.116495 13882 tablet_bootstrap.cc:654] T 689b4fee1dd04b3d9ccdea334b0f6b59 P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:58.120693 13764 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "3bca390f6d4343cba7a9fb07f0d4d72b" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:58.079932 13887 raft_consensus.cc:357] T 50dfc24a0b9645e4860cd99b1df3bd61 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:58.121403 13887 raft_consensus.cc:383] T 50dfc24a0b9645e4860cd99b1df3bd61 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:58.121479 13887 raft_consensus.cc:738] T 50dfc24a0b9645e4860cd99b1df3bd61 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:54:58.121702 13887 consensus_queue.cc:260] T 50dfc24a0b9645e4860cd99b1df3bd61 P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:58.123205 13764 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "cd9903bdfaef4139a1a582c54689da4a" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:58.129194 15814 raft_consensus.cc:491] T ba4e1fccb8f046d6b63afe67c1f9d538 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:58.129336 15814 raft_consensus.cc:513] T ba4e1fccb8f046d6b63afe67c1f9d538 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:58.129930 15814 leader_election.cc:290] T ba4e1fccb8f046d6b63afe67c1f9d538 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:58.130043 15814 raft_consensus.cc:491] T 208995abd6d44dbea3b5ebbea27d6a39 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:58.130160 15814 raft_consensus.cc:513] T 208995abd6d44dbea3b5ebbea27d6a39 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:58.131140 15814 leader_election.cc:290] T 208995abd6d44dbea3b5ebbea27d6a39 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:58.132025 15920 raft_consensus.cc:491] T 2c31d119743f49589703c434ac6c7548 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:58.132141 15920 raft_consensus.cc:513] T 2c31d119743f49589703c434ac6c7548 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:58.132830 15920 leader_election.cc:290] T 2c31d119743f49589703c434ac6c7548 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:58.133894 13887 ts_tablet_manager.cc:1428] T 50dfc24a0b9645e4860cd99b1df3bd61 P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.054s user 0.002s sys 0.000s
I20250830 07:54:58.134243 13887 tablet_bootstrap.cc:492] T 6720d2b945814305845beea0a2cb9912 P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:54:58.135610 13622 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "ba4e1fccb8f046d6b63afe67c1f9d538" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:58.139282 15706 raft_consensus.cc:491] T f5baa35307a1425c8d52666d130d6d8a P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:58.139326 13481 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "5fee48de90014f94b796e726a4d16b85" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:54:58.139389 15706 raft_consensus.cc:513] T f5baa35307a1425c8d52666d130d6d8a P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:58.139508 13481 raft_consensus.cc:2466] T 5fee48de90014f94b796e726a4d16b85 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 0.
I20250830 07:54:58.139695 13622 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "208995abd6d44dbea3b5ebbea27d6a39" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:58.139860 15706 leader_election.cc:290] T f5baa35307a1425c8d52666d130d6d8a P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:58.141136 13481 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "208995abd6d44dbea3b5ebbea27d6a39" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:54:58.141340 13481 raft_consensus.cc:2466] T 208995abd6d44dbea3b5ebbea27d6a39 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 0.
I20250830 07:54:58.141415 13622 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "2c31d119743f49589703c434ac6c7548" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
W20250830 07:54:58.145238 13234 catalog_manager.cc:5415] Ignoring report from unknown tablet 846338e46b834ae0b5f4e74c7f1325d2
W20250830 07:54:58.145308 13234 catalog_manager.cc:5415] Ignoring report from unknown tablet e6b7646588fe4134b2db62ff84ca4791
W20250830 07:54:58.145368 13423 leader_election.cc:343] T cd9903bdfaef4139a1a582c54689da4a P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:58.146062 13764 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "a8660a6ff9254d4f9f0ef047b8682ed1" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:58.146266 13764 raft_consensus.cc:2391] T a8660a6ff9254d4f9f0ef047b8682ed1 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b5e454d98894637b466ea27f1b647f9 in current term 1: Already voted for candidate 9b057ade5dce45af9f8bf0bedf8b917f in this term.
W20250830 07:54:58.148224 13234 catalog_manager.cc:5415] Ignoring report from unknown tablet 042fd7ff08fc4695b87bb8f9d225ef12
W20250830 07:54:58.148378 13234 catalog_manager.cc:5415] Ignoring report from unknown tablet 2b4103f07e96490488913059a95af0c3
W20250830 07:54:58.148427 13234 catalog_manager.cc:5415] Ignoring report from unknown tablet f398e12cd9f543738d5163354f8a9d9d
W20250830 07:54:58.148494 13234 catalog_manager.cc:5415] Ignoring report from unknown tablet 2c31d119743f49589703c434ac6c7548
W20250830 07:54:58.148547 13234 catalog_manager.cc:5415] Ignoring report from unknown tablet 689b4fee1dd04b3d9ccdea334b0f6b59
W20250830 07:54:58.148586 13234 catalog_manager.cc:5415] Ignoring report from unknown tablet 97d49a1f600f4c13a4aafca99cedabe8
W20250830 07:54:58.148609 13234 catalog_manager.cc:5415] Ignoring report from unknown tablet 23d2c7013c9c4b4aacf47e6ac7ab5a0b
W20250830 07:54:58.148641 13234 catalog_manager.cc:5415] Ignoring report from unknown tablet 1520d7257f864ea4ba4b9a5d0443f8a7
W20250830 07:54:58.149995 13423 leader_election.cc:343] T ba4e1fccb8f046d6b63afe67c1f9d538 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:58.151130 13764 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f5baa35307a1425c8d52666d130d6d8a" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
W20250830 07:54:58.151396 13423 leader_election.cc:343] T 208995abd6d44dbea3b5ebbea27d6a39 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:58.152285 13887 tablet_bootstrap.cc:654] T 6720d2b945814305845beea0a2cb9912 P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:58.155850 13886 tablet_bootstrap.cc:492] T 5e2da5434e95445aa4deafce7fde0c6c P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:54:58.156009 13886 ts_tablet_manager.cc:1397] T 5e2da5434e95445aa4deafce7fde0c6c P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.091s user 0.004s sys 0.000s
W20250830 07:54:58.153540 13423 leader_election.cc:343] T 2c31d119743f49589703c434ac6c7548 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:58.156747 13886 raft_consensus.cc:357] T 5e2da5434e95445aa4deafce7fde0c6c P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:58.156913 13886 raft_consensus.cc:383] T 5e2da5434e95445aa4deafce7fde0c6c P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:58.156970 13886 raft_consensus.cc:738] T 5e2da5434e95445aa4deafce7fde0c6c P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:54:58.157482 13886 consensus_queue.cc:260] T 5e2da5434e95445aa4deafce7fde0c6c P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:58.157652 13481 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "d171ad1667fa44c993ec5fd7d701d8e0" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:54:58.157868 13481 raft_consensus.cc:2466] T d171ad1667fa44c993ec5fd7d701d8e0 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 0.
I20250830 07:54:58.158150 13886 ts_tablet_manager.cc:1428] T 5e2da5434e95445aa4deafce7fde0c6c P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20250830 07:54:58.158738 15706 raft_consensus.cc:491] T c8bc6e07377a4ba99c39a909dae11402 P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:58.158856 15706 raft_consensus.cc:513] T c8bc6e07377a4ba99c39a909dae11402 P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:58.159376 15706 leader_election.cc:290] T c8bc6e07377a4ba99c39a909dae11402 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:58.160593 13622 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "49165f0001044d72b68263a60ef56457" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9"
I20250830 07:54:58.160738 13622 raft_consensus.cc:3058] T 49165f0001044d72b68263a60ef56457 P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Advancing to term 2
I20250830 07:54:58.163479 13622 raft_consensus.cc:2466] T 49165f0001044d72b68263a60ef56457 P 6b5e454d98894637b466ea27f1b647f9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 2.
I20250830 07:54:58.164427 13488 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f5baa35307a1425c8d52666d130d6d8a" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:54:58.164592 13488 raft_consensus.cc:2391] T f5baa35307a1425c8d52666d130d6d8a P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b5e454d98894637b466ea27f1b647f9 in current term 1: Already voted for candidate 9b057ade5dce45af9f8bf0bedf8b917f in this term.
I20250830 07:54:58.164776 13476 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "c8bc6e07377a4ba99c39a909dae11402" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:54:58.164883 13476 raft_consensus.cc:2466] T c8bc6e07377a4ba99c39a909dae11402 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b5e454d98894637b466ea27f1b647f9 in term 1.
I20250830 07:54:58.165375 13561 leader_election.cc:304] T c8bc6e07377a4ba99c39a909dae11402 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 6b5e454d98894637b466ea27f1b647f9; no voters:
I20250830 07:54:58.165658 15706 raft_consensus.cc:2802] T c8bc6e07377a4ba99c39a909dae11402 P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20250830 07:54:58.165736 15706 raft_consensus.cc:491] T c8bc6e07377a4ba99c39a909dae11402 P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:54:58.165802 15706 raft_consensus.cc:3058] T c8bc6e07377a4ba99c39a909dae11402 P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Advancing to term 2
I20250830 07:54:58.168700 15706 raft_consensus.cc:513] T c8bc6e07377a4ba99c39a909dae11402 P 6b5e454d98894637b466ea27f1b647f9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:58.169509 15706 leader_election.cc:290] T c8bc6e07377a4ba99c39a909dae11402 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 2 election: Requested vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:58.169986 13476 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "c8bc6e07377a4ba99c39a909dae11402" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba"
I20250830 07:54:58.170158 13476 raft_consensus.cc:3058] T c8bc6e07377a4ba99c39a909dae11402 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Advancing to term 2
I20250830 07:54:58.172403 13476 raft_consensus.cc:2466] T c8bc6e07377a4ba99c39a909dae11402 P 2065c332f15a4739899af79f3669c3ba [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b5e454d98894637b466ea27f1b647f9 in term 2.
I20250830 07:54:58.172883 13622 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "846338e46b834ae0b5f4e74c7f1325d2" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:58.172958 13561 leader_election.cc:304] T c8bc6e07377a4ba99c39a909dae11402 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 6b5e454d98894637b466ea27f1b647f9; no voters:
I20250830 07:54:58.173277 15706 raft_consensus.cc:2802] T c8bc6e07377a4ba99c39a909dae11402 P 6b5e454d98894637b466ea27f1b647f9 [term 2 FOLLOWER]: Leader election won for term 2
I20250830 07:54:58.173467 15706 raft_consensus.cc:695] T c8bc6e07377a4ba99c39a909dae11402 P 6b5e454d98894637b466ea27f1b647f9 [term 2 LEADER]: Becoming Leader. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Running, Role: LEADER
I20250830 07:54:58.173875 15706 consensus_queue.cc:237] T c8bc6e07377a4ba99c39a909dae11402 P 6b5e454d98894637b466ea27f1b647f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
W20250830 07:54:58.175155 13232 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 91de654a427c4371835bd6ce22cae54a has no consensus state
I20250830 07:54:58.175487 13886 tablet_bootstrap.cc:492] T ed364f03bdad42b88e181b7d0e1e4011 P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:54:58.175547 13226 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet 4b692717d4d34919af71cabb1a82bfd8
I20250830 07:54:58.176219 13233 catalog_manager.cc:5864] Not sending DeleteTablet requests; no consensus state for tablet fa8e77708bc04c5383234ca90fbf2e1b
I20250830 07:54:58.176518 13231 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet a06e0b53a11d46e2b1496216bab61356
I20250830 07:54:58.176968 13886 tablet_bootstrap.cc:654] T ed364f03bdad42b88e181b7d0e1e4011 P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:58.181124 13476 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "bdeb89bbb3ad4e67bbc74b78454eeb7e" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:54:58.181301 13476 raft_consensus.cc:2466] T bdeb89bbb3ad4e67bbc74b78454eeb7e P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 0.
I20250830 07:54:58.182425 13476 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "49165f0001044d72b68263a60ef56457" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:54:58.182548 13476 raft_consensus.cc:2466] T 49165f0001044d72b68263a60ef56457 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 1.
I20250830 07:54:58.183823 13593 tablet_service.cc:1515] Processing DeleteTablet for tablet 4b692717d4d34919af71cabb1a82bfd8 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:58 UTC) from {username='slave'} at 127.0.0.1:45306
I20250830 07:54:58.184420 13602 tablet_service.cc:1515] Processing DeleteTablet for tablet a06e0b53a11d46e2b1496216bab61356 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:58 UTC) from {username='slave'} at 127.0.0.1:45306
I20250830 07:54:58.185077 13225 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_ab1817f7b5084ba99a3cd30cfabd41a4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:58.185638 13225 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ab1817f7b5084ba99a3cd30cfabd41a4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:58.186776 13562 leader_election.cc:304] T 6ccbaf109e36453ea6645dfd090f5a1a P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b5e454d98894637b466ea27f1b647f9; no voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:54:58.187114 15728 raft_consensus.cc:3058] T 6ccbaf109e36453ea6645dfd090f5a1a P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:58.187973 13562 leader_election.cc:304] T 7aed56dba39e40518e9c3325bcccd74a P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b5e454d98894637b466ea27f1b647f9; no voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:54:58.188278 15582 raft_consensus.cc:3058] T 7aed56dba39e40518e9c3325bcccd74a P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:58.189584 15728 raft_consensus.cc:2747] T 6ccbaf109e36453ea6645dfd090f5a1a P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:54:58.190701 15582 raft_consensus.cc:2747] T 7aed56dba39e40518e9c3325bcccd74a P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:54:58.195487 13476 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "49165f0001044d72b68263a60ef56457" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba"
I20250830 07:54:58.195675 13476 raft_consensus.cc:3058] T 49165f0001044d72b68263a60ef56457 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Advancing to term 2
I20250830 07:54:58.198117 13476 raft_consensus.cc:2466] T 49165f0001044d72b68263a60ef56457 P 2065c332f15a4739899af79f3669c3ba [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 2.
I20250830 07:54:58.198922 13227 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_1303b408f47d46da9f797945e3bbb717"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:58.199379 13227 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1303b408f47d46da9f797945e3bbb717 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:58.200537 13233 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_c9cd695063014e7eb11e8aa6f932505c" } modify_external_catalogs: true
I20250830 07:54:58.200681 13233 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_c9cd695063014e7eb11e8aa6f932505c" } modify_external_catalogs: true
I20250830 07:54:58.201853 13229 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_aa9527e58f164273a017ed1690966739" } new_table_name: "default.Table_b942c9a3c9394047a626a537f3f2186c" modify_external_catalogs: true
I20250830 07:54:58.202920 13230 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_a135889224c7430a8456340fd646571f" } new_table_name: "default.Table_3cf97a9ecb834625b19fa21753d1875e" modify_external_catalogs: true
I20250830 07:54:58.203930 13232 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_287a1c2aa5874779a5b0856f956270b6" } modify_external_catalogs: true
I20250830 07:54:58.204114 13232 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_287a1c2aa5874779a5b0856f956270b6" } modify_external_catalogs: true
I20250830 07:54:58.204398 13488 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "846338e46b834ae0b5f4e74c7f1325d2" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:54:58.204552 13488 raft_consensus.cc:2466] T 846338e46b834ae0b5f4e74c7f1325d2 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 0.
I20250830 07:54:58.205127 13231 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_4ddc8807a42e44ca8fc5f0cdb31c723a" } new_table_name: "default.Table_6dfb547b0bba43cc8d888ac8b737a808" modify_external_catalogs: true
I20250830 07:54:58.205514 13886 tablet_bootstrap.cc:492] T ed364f03bdad42b88e181b7d0e1e4011 P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:54:58.205629 13886 ts_tablet_manager.cc:1397] T ed364f03bdad42b88e181b7d0e1e4011 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.030s user 0.000s sys 0.002s
I20250830 07:54:58.206686 13886 raft_consensus.cc:357] T ed364f03bdad42b88e181b7d0e1e4011 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:58.206833 13886 raft_consensus.cc:383] T ed364f03bdad42b88e181b7d0e1e4011 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:58.206884 13886 raft_consensus.cc:738] T ed364f03bdad42b88e181b7d0e1e4011 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:54:58.207194 13886 consensus_queue.cc:260] T ed364f03bdad42b88e181b7d0e1e4011 P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:58.208015 13886 ts_tablet_manager.cc:1428] T ed364f03bdad42b88e181b7d0e1e4011 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20250830 07:54:58.208950 13886 tablet_bootstrap.cc:492] T 3d9c884ac05e44ddb59f96588fdd6f4b P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:54:58.209810 13226 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_ec47f962687b4cfb9356be3540abb8b2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:58.210326 13226 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ec47f962687b4cfb9356be3540abb8b2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250830 07:54:58.212813 13220 catalog_manager.cc:4908] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet 4b692717d4d34919af71cabb1a82bfd8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4b692717d4d34919af71cabb1a82bfd8 already in progress: creating tablet
W20250830 07:54:58.213027 13220 catalog_manager.cc:4908] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet a06e0b53a11d46e2b1496216bab61356 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a06e0b53a11d46e2b1496216bab61356 already in progress: creating tablet
I20250830 07:54:58.213241 13562 leader_election.cc:304] T a8660a6ff9254d4f9f0ef047b8682ed1 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b5e454d98894637b466ea27f1b647f9; no voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:54:58.214563 13228 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_ba48b396b9e04ad98049a57e67cef512"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:58.215134 13228 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ba48b396b9e04ad98049a57e67cef512 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:58.216634 13488 raft_consensus.cc:1238] T c8bc6e07377a4ba99c39a909dae11402 P 2065c332f15a4739899af79f3669c3ba [term 2 FOLLOWER]: Rejecting Update request from peer 9b057ade5dce45af9f8bf0bedf8b917f for earlier term 1. Current term is 2. Ops: []
I20250830 07:54:58.217703 15582 raft_consensus.cc:3058] T a8660a6ff9254d4f9f0ef047b8682ed1 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:58.219933 15582 raft_consensus.cc:2747] T a8660a6ff9254d4f9f0ef047b8682ed1 P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:54:58.220295 13887 tablet_bootstrap.cc:492] T 6720d2b945814305845beea0a2cb9912 P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:54:58.221115 13887 ts_tablet_manager.cc:1397] T 6720d2b945814305845beea0a2cb9912 P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.087s user 0.003s sys 0.003s
I20250830 07:54:58.222307 13234 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_1e81444d271c48928500bdea79d89da9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:58.222761 13234 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1e81444d271c48928500bdea79d89da9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:58.223706 13887 raft_consensus.cc:357] T 6720d2b945814305845beea0a2cb9912 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:58.223850 13887 raft_consensus.cc:383] T 6720d2b945814305845beea0a2cb9912 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:58.223904 13887 raft_consensus.cc:738] T 6720d2b945814305845beea0a2cb9912 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:54:58.224103 13887 consensus_queue.cc:260] T 6720d2b945814305845beea0a2cb9912 P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:58.225526 13562 leader_election.cc:304] T f5baa35307a1425c8d52666d130d6d8a P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b5e454d98894637b466ea27f1b647f9; no voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:54:58.163919 15118 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "2065c332f15a4739899af79f3669c3ba" instance_seqno: 1756540469523715) as {username='slave'} at 127.12.209.1:41125; Asking this server to re-register.
W20250830 07:54:58.234225 13229 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 3641c65ce6114c649417cdc6ac66b4d6 has no consensus state
W20250830 07:54:58.234411 13230 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 44fdab831bab4f548e71f387fd0d069b has no consensus state
I20250830 07:54:58.234570 13233 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet 930081bb13454b85ae17bbc4b2b59053
I20250830 07:54:58.235467 13232 catalog_manager.cc:5864] Not sending DeleteTablet requests; no consensus state for tablet a0170d6430d248888ad83a959cc5418c
W20250830 07:54:58.234236 13231 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 0e65ecea1f3a408cb1cdc55ce7495ad0 has no consensus state
I20250830 07:54:58.236718 13887 ts_tablet_manager.cc:1428] T 6720d2b945814305845beea0a2cb9912 P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.015s user 0.001s sys 0.001s
I20250830 07:54:58.236965 13887 tablet_bootstrap.cc:492] T 4b9d9d4b65964fd49d8e25092a14d774 P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:54:58.238395 13887 tablet_bootstrap.cc:654] T 4b9d9d4b65964fd49d8e25092a14d774 P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:58.239372 15814 consensus_queue.cc:1035] T 33701eeb12fc451d90ae0b1c4dd7d134 P 2065c332f15a4739899af79f3669c3ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20250830 07:54:58.240670 13422 leader_election.cc:343] T 2aea1a69d22544899b0218be7e0f8799 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:58.240855 13422 leader_election.cc:304] T 2aea1a69d22544899b0218be7e0f8799 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba; no voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:54:58.245482 15720 raft_consensus.cc:491] T ddedd1f141c147c69f178c6cd2b287da P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:58.245599 15720 raft_consensus.cc:513] T ddedd1f141c147c69f178c6cd2b287da P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:58.246073 15720 leader_election.cc:290] T ddedd1f141c147c69f178c6cd2b287da P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
I20250830 07:54:58.246389 13886 tablet_bootstrap.cc:654] T 3d9c884ac05e44ddb59f96588fdd6f4b P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:58.247035 15814 raft_consensus.cc:2747] T 2aea1a69d22544899b0218be7e0f8799 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20250830 07:54:58.247556 13422 leader_election.cc:343] T 3bca390f6d4343cba7a9fb07f0d4d72b P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:58.247687 13422 leader_election.cc:304] T 3bca390f6d4343cba7a9fb07f0d4d72b P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba; no voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:54:58.247970 15814 raft_consensus.cc:2747] T 3bca390f6d4343cba7a9fb07f0d4d72b P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20250830 07:54:58.248293 13422 leader_election.cc:343] T cd9903bdfaef4139a1a582c54689da4a P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:58.248636 13422 leader_election.cc:304] T cd9903bdfaef4139a1a582c54689da4a P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba; no voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:54:58.249012 15919 raft_consensus.cc:2747] T cd9903bdfaef4139a1a582c54689da4a P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:54:58.249152 15728 raft_consensus.cc:3058] T f5baa35307a1425c8d52666d130d6d8a P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:58.251722 15728 raft_consensus.cc:2747] T f5baa35307a1425c8d52666d130d6d8a P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:54:58.251964 13764 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "ba4e1fccb8f046d6b63afe67c1f9d538" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:58.252677 13764 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "208995abd6d44dbea3b5ebbea27d6a39" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:58.252802 13764 raft_consensus.cc:2466] T 208995abd6d44dbea3b5ebbea27d6a39 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2065c332f15a4739899af79f3669c3ba in term 0.
I20250830 07:54:58.253563 13764 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "2c31d119743f49589703c434ac6c7548" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:58.253667 13703 leader_election.cc:304] T 49165f0001044d72b68263a60ef56457 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f; no voters:
I20250830 07:54:58.253685 13764 raft_consensus.cc:2466] T 2c31d119743f49589703c434ac6c7548 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2065c332f15a4739899af79f3669c3ba in term 0.
W20250830 07:54:58.254020 13703 consensus_peers.cc:489] T 14d4d2506e2a47ea906bfb81d5509829 P 9b057ade5dce45af9f8bf0bedf8b917f -> Peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Couldn't send request to peer 6b5e454d98894637b466ea27f1b647f9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20250830 07:54:58.254302 13703 leader_election.cc:343] T 846338e46b834ae0b5f4e74c7f1325d2 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:58.254547 15868 raft_consensus.cc:2802] T 49165f0001044d72b68263a60ef56457 P 9b057ade5dce45af9f8bf0bedf8b917f [term 2 FOLLOWER]: Leader election won for term 2
I20250830 07:54:58.254652 15868 raft_consensus.cc:695] T 49165f0001044d72b68263a60ef56457 P 9b057ade5dce45af9f8bf0bedf8b917f [term 2 LEADER]: Becoming Leader. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Running, Role: LEADER
I20250830 07:54:58.254848 15868 consensus_queue.cc:237] T 49165f0001044d72b68263a60ef56457 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
W20250830 07:54:58.254561 13703 consensus_peers.cc:489] T 852e353f6ee945628ddebdbdd1bd76fb P 9b057ade5dce45af9f8bf0bedf8b917f -> Peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Couldn't send request to peer 6b5e454d98894637b466ea27f1b647f9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20250830 07:54:58.257324 15601 consensus_queue.cc:1035] T ee44ab24333742909f773889ad5c3e00 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:54:58.258468 13764 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "c8bc6e07377a4ba99c39a909dae11402" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f"
I20250830 07:54:58.259923 13766 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "c8bc6e07377a4ba99c39a909dae11402" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:58.265429 13602 tablet_service.cc:1515] Processing DeleteTablet for tablet 930081bb13454b85ae17bbc4b2b59053 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:58 UTC) from {username='slave'} at 127.0.0.1:45306
W20250830 07:54:58.268410 13220 catalog_manager.cc:4908] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet 930081bb13454b85ae17bbc4b2b59053 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 930081bb13454b85ae17bbc4b2b59053 already in progress: creating tablet
I20250830 07:54:58.269850 13882 tablet_bootstrap.cc:492] T 689b4fee1dd04b3d9ccdea334b0f6b59 P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:54:58.269970 13882 ts_tablet_manager.cc:1397] T 689b4fee1dd04b3d9ccdea334b0f6b59 P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.160s user 0.018s sys 0.022s
I20250830 07:54:58.270756 13882 raft_consensus.cc:357] T 689b4fee1dd04b3d9ccdea334b0f6b59 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:58.270942 13882 raft_consensus.cc:383] T 689b4fee1dd04b3d9ccdea334b0f6b59 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:58.271003 13882 raft_consensus.cc:738] T 689b4fee1dd04b3d9ccdea334b0f6b59 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:54:58.271178 13882 consensus_queue.cc:260] T 689b4fee1dd04b3d9ccdea334b0f6b59 P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:58.273581 13882 ts_tablet_manager.cc:1428] T 689b4fee1dd04b3d9ccdea334b0f6b59 P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20250830 07:54:58.273849 13882 tablet_bootstrap.cc:492] T 52e910677ae34630a919d1d3f21b7e83 P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
W20250830 07:54:58.275086 13231 catalog_manager.cc:5415] Ignoring report from unknown tablet 8cce7e5537794e9484f5a7c82b9e6e1d
I20250830 07:54:58.275449 13882 tablet_bootstrap.cc:654] T 52e910677ae34630a919d1d3f21b7e83 P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:58.276209 13622 raft_consensus.cc:1238] T c8bc6e07377a4ba99c39a909dae11402 P 6b5e454d98894637b466ea27f1b647f9 [term 2 LEADER]: Rejecting Update request from peer 9b057ade5dce45af9f8bf0bedf8b917f for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20250830 07:54:58.277819 13886 tablet_bootstrap.cc:492] T 3d9c884ac05e44ddb59f96588fdd6f4b P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:54:58.277913 13886 ts_tablet_manager.cc:1397] T 3d9c884ac05e44ddb59f96588fdd6f4b P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.070s user 0.002s sys 0.001s
I20250830 07:54:58.278509 13886 raft_consensus.cc:357] T 3d9c884ac05e44ddb59f96588fdd6f4b P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:58.278642 13886 raft_consensus.cc:383] T 3d9c884ac05e44ddb59f96588fdd6f4b P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:58.278684 13886 raft_consensus.cc:738] T 3d9c884ac05e44ddb59f96588fdd6f4b P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:54:58.279819 13886 consensus_queue.cc:260] T 3d9c884ac05e44ddb59f96588fdd6f4b P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:58.281141 13701 leader_election.cc:304] T 5fee48de90014f94b796e726a4d16b85 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:54:58.281286 13886 ts_tablet_manager.cc:1428] T 3d9c884ac05e44ddb59f96588fdd6f4b P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20250830 07:54:58.281461 15868 raft_consensus.cc:2802] T 5fee48de90014f94b796e726a4d16b85 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:54:58.281555 15868 raft_consensus.cc:491] T 5fee48de90014f94b796e726a4d16b85 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:54:58.281661 15868 raft_consensus.cc:3058] T 5fee48de90014f94b796e726a4d16b85 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:58.282997 13701 leader_election.cc:304] T 208995abd6d44dbea3b5ebbea27d6a39 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:54:58.283411 15863 raft_consensus.cc:2802] T 208995abd6d44dbea3b5ebbea27d6a39 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:54:58.283512 15863 raft_consensus.cc:491] T 208995abd6d44dbea3b5ebbea27d6a39 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:54:58.283618 15863 raft_consensus.cc:3058] T 208995abd6d44dbea3b5ebbea27d6a39 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:58.286021 15863 raft_consensus.cc:513] T 208995abd6d44dbea3b5ebbea27d6a39 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:58.286660 15863 leader_election.cc:290] T 208995abd6d44dbea3b5ebbea27d6a39 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Requested vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
I20250830 07:54:58.286942 13882 tablet_bootstrap.cc:492] T 52e910677ae34630a919d1d3f21b7e83 P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:54:58.286038 15868 raft_consensus.cc:513] T 5fee48de90014f94b796e726a4d16b85 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:58.287143 13882 ts_tablet_manager.cc:1397] T 52e910677ae34630a919d1d3f21b7e83 P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.013s user 0.003s sys 0.000s
I20250830 07:54:58.289559 15863 consensus_queue.cc:1035] T 796e01f6a36241fc94e335253929d6ab P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:54:58.290062 15868 leader_election.cc:290] T 5fee48de90014f94b796e726a4d16b85 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Requested vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
I20250830 07:54:58.289932 13886 tablet_bootstrap.cc:492] T c56e3a30c18640e68c8b0c4ff4251d96 P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:54:58.290854 13622 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "ddedd1f141c147c69f178c6cd2b287da" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:58.295511 15863 consensus_queue.cc:1035] T 852e353f6ee945628ddebdbdd1bd76fb P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:54:58.295686 13882 raft_consensus.cc:357] T 52e910677ae34630a919d1d3f21b7e83 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:58.295996 13882 raft_consensus.cc:383] T 52e910677ae34630a919d1d3f21b7e83 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:58.296128 13882 raft_consensus.cc:738] T 52e910677ae34630a919d1d3f21b7e83 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:54:58.296149 13701 leader_election.cc:304] T d171ad1667fa44c993ec5fd7d701d8e0 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:54:58.296494 15868 raft_consensus.cc:2802] T d171ad1667fa44c993ec5fd7d701d8e0 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:54:58.296382 13882 consensus_queue.cc:260] T 52e910677ae34630a919d1d3f21b7e83 P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:58.296576 15868 raft_consensus.cc:491] T d171ad1667fa44c993ec5fd7d701d8e0 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:54:58.297120 15863 consensus_queue.cc:1035] T db7144b25ff34bed8c7b779ba9497ef4 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:54:58.297290 13882 ts_tablet_manager.cc:1428] T 52e910677ae34630a919d1d3f21b7e83 P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.010s user 0.002s sys 0.000s
I20250830 07:54:58.297708 13882 tablet_bootstrap.cc:492] T 0208de98277c4d6889fb0289b6013ae1 P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:54:58.297834 15863 consensus_queue.cc:1035] T f32ebc2605c34a68aed50379f028052c P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:54:58.298254 15868 raft_consensus.cc:3058] T d171ad1667fa44c993ec5fd7d701d8e0 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
W20250830 07:54:58.299521 13701 consensus_peers.cc:489] T f398e12cd9f543738d5163354f8a9d9d P 9b057ade5dce45af9f8bf0bedf8b917f -> Peer 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): Couldn't send request to peer 2065c332f15a4739899af79f3669c3ba. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f398e12cd9f543738d5163354f8a9d9d. This is attempt 11: this message will repeat every 5th retry.
I20250830 07:54:58.299830 15814 raft_consensus.cc:491] T 34199145292d4ddb8c603e5c581f1d15 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:58.299950 15814 raft_consensus.cc:513] T 34199145292d4ddb8c603e5c581f1d15 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:58.300267 13701 leader_election.cc:304] T bdeb89bbb3ad4e67bbc74b78454eeb7e P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:54:58.300478 15814 leader_election.cc:290] T 34199145292d4ddb8c603e5c581f1d15 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:58.300643 13882 tablet_bootstrap.cc:654] T 0208de98277c4d6889fb0289b6013ae1 P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:58.300782 15863 raft_consensus.cc:2802] T bdeb89bbb3ad4e67bbc74b78454eeb7e P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:54:58.300894 15863 raft_consensus.cc:491] T bdeb89bbb3ad4e67bbc74b78454eeb7e P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:54:58.301002 15863 raft_consensus.cc:3058] T bdeb89bbb3ad4e67bbc74b78454eeb7e P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:58.303666 15863 raft_consensus.cc:513] T bdeb89bbb3ad4e67bbc74b78454eeb7e P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:58.304634 15863 leader_election.cc:290] T bdeb89bbb3ad4e67bbc74b78454eeb7e P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Requested vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
I20250830 07:54:58.307471 15720 consensus_queue.cc:1035] T 76ab56c469cf4675a4e21acbe0a8085d P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:54:58.311731 15863 consensus_queue.cc:1035] T 1cf23cf78eee46be953bd701aa6bef07 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:54:58.312450 13612 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "208995abd6d44dbea3b5ebbea27d6a39" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9"
I20250830 07:54:58.313231 13612 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "5fee48de90014f94b796e726a4d16b85" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9"
I20250830 07:54:58.313195 15720 consensus_queue.cc:1035] T 14d4d2506e2a47ea906bfb81d5509829 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:54:58.314863 13886 tablet_bootstrap.cc:654] T c56e3a30c18640e68c8b0c4ff4251d96 P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:58.320232 13612 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "bdeb89bbb3ad4e67bbc74b78454eeb7e" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9"
W20250830 07:54:58.325302 13703 consensus_peers.cc:489] T db7144b25ff34bed8c7b779ba9497ef4 P 9b057ade5dce45af9f8bf0bedf8b917f -> Peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Couldn't send request to peer 6b5e454d98894637b466ea27f1b647f9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20250830 07:54:58.326326 15748 consensus_queue.cc:1046] T c8bc6e07377a4ba99c39a909dae11402 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:54:58.326499 15748 consensus_queue.cc:1230] T c8bc6e07377a4ba99c39a909dae11402 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Peer 6b5e454d98894637b466ea27f1b647f9 log is divergent from this leader: its last log entry 2.1 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 0
I20250830 07:54:58.326784 15365 raft_consensus.cc:3053] T c8bc6e07377a4ba99c39a909dae11402 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 LEADER]: Stepping down as leader of term 1
I20250830 07:54:58.326876 15365 raft_consensus.cc:738] T c8bc6e07377a4ba99c39a909dae11402 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Running, Role: LEADER
I20250830 07:54:58.327173 15365 consensus_queue.cc:260] T c8bc6e07377a4ba99c39a909dae11402 P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:58.327777 15365 raft_consensus.cc:3058] T c8bc6e07377a4ba99c39a909dae11402 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Advancing to term 2
I20250830 07:54:58.320902 13226 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_bc69089ed2524bbdb963765c19f90f17" } new_table_name: "default.Table_23bbc528c4404a61b566eea99ba648e9" modify_external_catalogs: true
W20250830 07:54:58.328154 13231 catalog_manager.cc:5415] Ignoring report from unknown tablet 62bc8168176e4678a77827c5b7cc0f3e
W20250830 07:54:58.328233 13231 catalog_manager.cc:5415] Ignoring report from unknown tablet 0208de98277c4d6889fb0289b6013ae1
W20250830 07:54:58.328291 13231 catalog_manager.cc:5415] Ignoring report from unknown tablet f66e1d07039841088a444ee0203a4eb0
I20250830 07:54:58.329190 13231 catalog_manager.cc:5674] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743) does not have the latest schema for tablet 52e910677ae34630a919d1d3f21b7e83 (table default.Table_96df3a05fc564aba9ae2d0e0f1e94abb [id=b3fced981b2a4b44a8eab43675699ba5]). Expected version 1 got 0
W20250830 07:54:58.330543 13703 leader_election.cc:343] T ddedd1f141c147c69f178c6cd2b287da P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:58.331005 15748 raft_consensus.cc:491] T 2c4c3c61cddf42668d3a09f4fbc5f641 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:58.331130 15748 raft_consensus.cc:513] T 2c4c3c61cddf42668d3a09f4fbc5f641 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:58.331636 15748 leader_election.cc:290] T 2c4c3c61cddf42668d3a09f4fbc5f641 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
W20250830 07:54:58.332197 13703 leader_election.cc:343] T 208995abd6d44dbea3b5ebbea27d6a39 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
W20250830 07:54:58.332454 13703 leader_election.cc:343] T 5fee48de90014f94b796e726a4d16b85 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
W20250830 07:54:58.333660 13703 leader_election.cc:343] T bdeb89bbb3ad4e67bbc74b78454eeb7e P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
W20250830 07:54:58.342386 13226 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 2f55b602de894b07a33a4c54c14caa90 has no consensus state
I20250830 07:54:58.348256 15365 raft_consensus.cc:491] T 66432e73deea433d9df565d5fcace647 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:58.348479 15365 raft_consensus.cc:513] T 66432e73deea433d9df565d5fcace647 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:58.349123 15365 leader_election.cc:290] T 66432e73deea433d9df565d5fcace647 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967)
I20250830 07:54:58.315362 15863 consensus_queue.cc:1035] T 1520d7257f864ea4ba4b9a5d0443f8a7 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.035s
I20250830 07:54:58.351311 13701 leader_election.cc:304] T 846338e46b834ae0b5f4e74c7f1325d2 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:54:58.352093 13622 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "34199145292d4ddb8c603e5c581f1d15" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:58.352905 15365 raft_consensus.cc:2802] T 846338e46b834ae0b5f4e74c7f1325d2 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:54:58.353013 15365 raft_consensus.cc:491] T 846338e46b834ae0b5f4e74c7f1325d2 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:54:58.353103 15365 raft_consensus.cc:3058] T 846338e46b834ae0b5f4e74c7f1325d2 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:58.355516 15365 raft_consensus.cc:513] T 846338e46b834ae0b5f4e74c7f1325d2 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:58.356079 15365 leader_election.cc:290] T 846338e46b834ae0b5f4e74c7f1325d2 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Requested vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
I20250830 07:54:58.357942 13887 tablet_bootstrap.cc:492] T 4b9d9d4b65964fd49d8e25092a14d774 P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:54:58.358425 13887 ts_tablet_manager.cc:1397] T 4b9d9d4b65964fd49d8e25092a14d774 P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.122s user 0.003s sys 0.000s
I20250830 07:54:58.358657 15751 consensus_queue.cc:1035] T ee44ab24333742909f773889ad5c3e00 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:54:58.359293 15751 consensus_queue.cc:1035] T f5baa35307a1425c8d52666d130d6d8a P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20250830 07:54:58.362455 13423 leader_election.cc:343] T 34199145292d4ddb8c603e5c581f1d15 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:58.362778 13622 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "2c4c3c61cddf42668d3a09f4fbc5f641" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:58.362964 13887 raft_consensus.cc:357] T 4b9d9d4b65964fd49d8e25092a14d774 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:58.364390 13887 raft_consensus.cc:383] T 4b9d9d4b65964fd49d8e25092a14d774 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:58.364923 13887 raft_consensus.cc:738] T 4b9d9d4b65964fd49d8e25092a14d774 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:54:58.365440 13886 tablet_bootstrap.cc:492] T c56e3a30c18640e68c8b0c4ff4251d96 P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:54:58.365741 13886 ts_tablet_manager.cc:1397] T c56e3a30c18640e68c8b0c4ff4251d96 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.084s user 0.003s sys 0.001s
I20250830 07:54:58.366273 13887 consensus_queue.cc:260] T 4b9d9d4b65964fd49d8e25092a14d774 P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:58.367100 13886 raft_consensus.cc:357] T c56e3a30c18640e68c8b0c4ff4251d96 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:58.367264 13886 raft_consensus.cc:383] T c56e3a30c18640e68c8b0c4ff4251d96 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:58.367344 13886 raft_consensus.cc:738] T c56e3a30c18640e68c8b0c4ff4251d96 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:54:58.367568 13886 consensus_queue.cc:260] T c56e3a30c18640e68c8b0c4ff4251d96 P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:58.368105 13886 ts_tablet_manager.cc:1428] T c56e3a30c18640e68c8b0c4ff4251d96 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20250830 07:54:58.368805 13886 tablet_bootstrap.cc:492] T 63168840534246b59a2fdbfdfeebff47 P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:54:58.370021 13887 ts_tablet_manager.cc:1428] T 4b9d9d4b65964fd49d8e25092a14d774 P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.011s user 0.002s sys 0.001s
I20250830 07:54:58.371929 13887 tablet_bootstrap.cc:492] T 0d16bc64dd6e43f7ba313b77c2bbb728 P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:54:58.374424 13611 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "66432e73deea433d9df565d5fcace647" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:58.374655 15919 raft_consensus.cc:491] T 2e63eac2579844ef83bf43f1e6d58634 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:58.374763 15919 raft_consensus.cc:513] T 2e63eac2579844ef83bf43f1e6d58634 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:58.375329 15919 leader_election.cc:290] T 2e63eac2579844ef83bf43f1e6d58634 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:58.376330 13611 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "846338e46b834ae0b5f4e74c7f1325d2" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9"
I20250830 07:54:58.376989 13234 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_9951eeefdce34bb2846a69b08084fbe4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:58.377672 13234 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9951eeefdce34bb2846a69b08084fbe4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:58.379678 13229 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_be854d521db44926811d0dee9cb0fa54" } modify_external_catalogs: true
I20250830 07:54:58.379820 13229 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_be854d521db44926811d0dee9cb0fa54" } modify_external_catalogs: true
I20250830 07:54:58.380798 13232 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_d6668644cb1f4d5a966f3834795544f9" } modify_external_catalogs: true
I20250830 07:54:58.380939 13232 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_d6668644cb1f4d5a966f3834795544f9" } modify_external_catalogs: true
I20250830 07:54:58.381871 13233 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_4d49950d674d4a00889be9a7b9e70805"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:58.382288 13233 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4d49950d674d4a00889be9a7b9e70805 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:58.383910 13228 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_a8b747811d784f818430f7ecb11b738c" } new_table_name: "default.Table_3110976d4c974c76b9368b1d3d859000" modify_external_catalogs: true
W20250830 07:54:58.384931 13703 leader_election.cc:343] T 2c4c3c61cddf42668d3a09f4fbc5f641 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:58.387661 15751 raft_consensus.cc:491] T c56e3a30c18640e68c8b0c4ff4251d96 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:58.387722 13230 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_106c5d91b7314b3398e48ac2c97aa95b" } modify_external_catalogs: true
I20250830 07:54:58.387791 15751 raft_consensus.cc:513] T c56e3a30c18640e68c8b0c4ff4251d96 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:58.387863 13230 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_106c5d91b7314b3398e48ac2c97aa95b" } modify_external_catalogs: true
I20250830 07:54:58.388469 15751 leader_election.cc:290] T c56e3a30c18640e68c8b0c4ff4251d96 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
I20250830 07:54:58.388970 13227 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_484e510131f4416f8684f293eb5bc0c0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:58.389374 13227 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_484e510131f4416f8684f293eb5bc0c0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:58.390861 13229 catalog_manager.cc:5864] Not sending DeleteTablet requests; no consensus state for tablet 0adb8886148c4bd1a6f4936fb858986a
I20250830 07:54:58.391062 13225 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_bc964a952188469bb7b0069168559eee"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:58.391486 13225 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bc964a952188469bb7b0069168559eee in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250830 07:54:58.391652 13703 leader_election.cc:343] T 66432e73deea433d9df565d5fcace647 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
W20250830 07:54:58.392807 13703 leader_election.cc:343] T 846338e46b834ae0b5f4e74c7f1325d2 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:58.393921 13229 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_24d22e52bfb04375a6559415328bed0f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:58.394347 13229 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_24d22e52bfb04375a6559415328bed0f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:58.394307 13886 tablet_bootstrap.cc:654] T 63168840534246b59a2fdbfdfeebff47 P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:58.396170 13611 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "2e63eac2579844ef83bf43f1e6d58634" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:58.401149 13232 catalog_manager.cc:5864] Not sending DeleteTablet requests; no consensus state for tablet 520cbc47c4f445f387aa779010f8b983
W20250830 07:54:58.401566 13228 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d88108b406f941079f8ecacf6b5b44f1 consensus state has no leader
I20250830 07:54:58.403784 15868 raft_consensus.cc:513] T d171ad1667fa44c993ec5fd7d701d8e0 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
W20250830 07:54:58.404291 13423 leader_election.cc:343] T 2e63eac2579844ef83bf43f1e6d58634 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:58.404947 15868 leader_election.cc:290] T d171ad1667fa44c993ec5fd7d701d8e0 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Requested vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
I20250830 07:54:58.405843 13611 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "c56e3a30c18640e68c8b0c4ff4251d96" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:58.408308 13611 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "d171ad1667fa44c993ec5fd7d701d8e0" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9"
W20250830 07:54:58.408754 13703 leader_election.cc:343] T c56e3a30c18640e68c8b0c4ff4251d96 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
W20250830 07:54:58.410271 13703 leader_election.cc:343] T d171ad1667fa44c993ec5fd7d701d8e0 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:58.411387 13230 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet 6f8b6f233e5c49b39b3ef6314508e9d9
I20250830 07:54:58.412324 13602 tablet_service.cc:1515] Processing DeleteTablet for tablet 6f8b6f233e5c49b39b3ef6314508e9d9 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:58 UTC) from {username='slave'} at 127.0.0.1:45306
W20250830 07:54:58.413065 13220 catalog_manager.cc:4908] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet 6f8b6f233e5c49b39b3ef6314508e9d9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6f8b6f233e5c49b39b3ef6314508e9d9 already in progress: creating tablet
I20250830 07:54:58.416080 13536 heartbeater.cc:461] Registering TS with master...
W20250830 07:54:58.417071 15746 lock_manager.cc:585] Waited 2 seconds to obtain row lock on key '<redacted>' (key hash 4012713805250960239) tablet 00000000000000000000000000000000 cur holder 0x61700003a700
I20250830 07:54:58.420434 13225 master_service.cc:948] ReplaceTablet: received request to replace tablet d88108b406f941079f8ecacf6b5b44f1 from {username='slave'} at 127.0.0.1:42126
I20250830 07:54:58.421715 13887 tablet_bootstrap.cc:654] T 0d16bc64dd6e43f7ba313b77c2bbb728 P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:58.424801 13230 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_32102d6ffa374c78aafc0fdc8f7f2064"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:58.425576 13230 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_32102d6ffa374c78aafc0fdc8f7f2064 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:58.427731 13225 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet d88108b406f941079f8ecacf6b5b44f1
I20250830 07:54:58.428148 13225 catalog_manager.cc:6652] ReplaceTablet: tablet d88108b406f941079f8ecacf6b5b44f1 deleted and replaced by tablet 6ecc0ae64cdc483fa82017e2adaa8e90
I20250830 07:54:58.428859 13481 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "ddedd1f141c147c69f178c6cd2b287da" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:54:58.429031 13481 raft_consensus.cc:2466] T ddedd1f141c147c69f178c6cd2b287da P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 0.
I20250830 07:54:58.429068 13602 tablet_service.cc:1515] Processing DeleteTablet for tablet d88108b406f941079f8ecacf6b5b44f1 with delete_type TABLET_DATA_DELETED (replaced by tablet 6ecc0ae64cdc483fa82017e2adaa8e90) from {username='slave'} at 127.0.0.1:45306
W20250830 07:54:58.429637 13220 catalog_manager.cc:4908] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet d88108b406f941079f8ecacf6b5b44f1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d88108b406f941079f8ecacf6b5b44f1 already in progress: creating tablet
I20250830 07:54:58.429986 13481 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "208995abd6d44dbea3b5ebbea27d6a39" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba"
I20250830 07:54:58.430141 13481 raft_consensus.cc:3058] T 208995abd6d44dbea3b5ebbea27d6a39 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
W20250830 07:54:58.431012 13226 catalog_manager.cc:5415] Ignoring report from unknown tablet ff0f9cccc8ed43b1a8cd38de0e9d4097
W20250830 07:54:58.431432 13226 catalog_manager.cc:5415] Ignoring report from unknown tablet 1fa571e9490e499792225d7b786e8658
W20250830 07:54:58.431766 13226 catalog_manager.cc:5415] Ignoring report from unknown tablet 49165f0001044d72b68263a60ef56457
I20250830 07:54:58.432945 13481 raft_consensus.cc:2466] T 208995abd6d44dbea3b5ebbea27d6a39 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 1.
I20250830 07:54:58.437244 13481 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "5fee48de90014f94b796e726a4d16b85" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba"
I20250830 07:54:58.437448 13481 raft_consensus.cc:3058] T 5fee48de90014f94b796e726a4d16b85 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:58.439258 13230 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_574d155fe491475c935442c2f2c82ed1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:58.439680 13230 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_574d155fe491475c935442c2f2c82ed1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:58.440054 13481 raft_consensus.cc:2466] T 5fee48de90014f94b796e726a4d16b85 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 1.
I20250830 07:54:58.441458 13225 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_ed0f95c774b3416ba6880f17a3b6a826" } modify_external_catalogs: true
I20250830 07:54:58.441591 13225 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_ed0f95c774b3416ba6880f17a3b6a826" } modify_external_catalogs: true
I20250830 07:54:58.443184 13227 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_ae95817d5867430aa1d3d0f213a0694b" } new_table_name: "default.Table_c8e9fec6f4c94200a05be91b13f4453e" modify_external_catalogs: true
I20250830 07:54:58.443234 13233 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_3fbed79aa89e46a380f08c35b61be998" } new_table_name: "default.Table_e9b35b1124584c46a8fea4c4a7ffaef4" modify_external_catalogs: true
I20250830 07:54:58.444334 13229 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_f7936c2b545c4e209a6a93aa2e6e6077" } modify_external_catalogs: true
I20250830 07:54:58.444459 13229 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_f7936c2b545c4e209a6a93aa2e6e6077" } modify_external_catalogs: true
I20250830 07:54:58.445075 13228 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_920a4ed1ed944c529ef02d77159dc1d6" } new_table_name: "default.Table_67ffb86cd2874bde85391239fae5d39d" modify_external_catalogs: true
I20250830 07:54:58.451406 15863 raft_consensus.cc:491] T 2f3bec2c98574a9393e0fae77e228ce0 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:58.451601 15863 raft_consensus.cc:513] T 2f3bec2c98574a9393e0fae77e228ce0 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:58.452298 15863 leader_election.cc:290] T 2f3bec2c98574a9393e0fae77e228ce0 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967)
I20250830 07:54:58.452706 13611 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "2f3bec2c98574a9393e0fae77e228ce0" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
W20250830 07:54:58.453344 13703 leader_election.cc:343] T 2f3bec2c98574a9393e0fae77e228ce0 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:58.456593 13488 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "bdeb89bbb3ad4e67bbc74b78454eeb7e" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba"
I20250830 07:54:58.456745 13488 raft_consensus.cc:3058] T bdeb89bbb3ad4e67bbc74b78454eeb7e P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:58.459519 13488 raft_consensus.cc:2466] T bdeb89bbb3ad4e67bbc74b78454eeb7e P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 1.
W20250830 07:54:58.463069 13227 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ee999f20b85e4dcdaef5b6c9fb904d7c has no consensus state
I20250830 07:54:58.463526 13229 catalog_manager.cc:5864] Not sending DeleteTablet requests; no consensus state for tablet f2968a31b8d546e39e92a8c7045d0ddc
I20250830 07:54:58.463997 13225 catalog_manager.cc:5864] Not sending DeleteTablet requests; no consensus state for tablet 8693df3ba0e243e38bf6adba51ddaa89
W20250830 07:54:58.464401 13228 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a6c52cc395814e528a5ee8758cf769b2 has no consensus state
W20250830 07:54:58.466339 13233 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 533f17f5a9104a6582d9682287c9f1f7 consensus state has no leader
I20250830 07:54:58.468233 13233 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_6b25aa072bfb46169408cca4da6ee6d2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:58.468712 13233 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6b25aa072bfb46169408cca4da6ee6d2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:58.475004 13228 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_05e33af7bea24bf78b6af221c2151905"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250830 07:54:58.476879 13476 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "2c4c3c61cddf42668d3a09f4fbc5f641" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:54:58.477039 13476 raft_consensus.cc:2466] T 2c4c3c61cddf42668d3a09f4fbc5f641 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 0.
W20250830 07:54:58.478511 13228 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_05e33af7bea24bf78b6af221c2151905 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250830 07:54:58.484760 13231 catalog_manager.cc:5415] Ignoring report from unknown tablet 8cce7e5537794e9484f5a7c82b9e6e1d
W20250830 07:54:58.485431 13231 catalog_manager.cc:5415] Ignoring report from unknown tablet b4ab964a64a64e00a78ffd2b220aef46
W20250830 07:54:58.486135 13231 catalog_manager.cc:5415] Ignoring report from unknown tablet 62bc8168176e4678a77827c5b7cc0f3e
W20250830 07:54:58.486774 13231 catalog_manager.cc:5415] Ignoring report from unknown tablet d1153d8cd2994377ac0dcbfeeda1fd52
W20250830 07:54:58.487210 13231 catalog_manager.cc:5415] Ignoring report from unknown tablet 689b4fee1dd04b3d9ccdea334b0f6b59
W20250830 07:54:58.487476 13231 catalog_manager.cc:5415] Ignoring report from unknown tablet 97d49a1f600f4c13a4aafca99cedabe8
W20250830 07:54:58.488020 13231 catalog_manager.cc:5415] Ignoring report from unknown tablet f66e1d07039841088a444ee0203a4eb0
W20250830 07:54:58.488201 13231 catalog_manager.cc:5415] Ignoring report from unknown tablet ef16b9e2d444489699f4db1ac26d5f6c
W20250830 07:54:58.488473 13231 catalog_manager.cc:5415] Ignoring report from unknown tablet 0208de98277c4d6889fb0289b6013ae1
W20250830 07:54:58.488780 13231 catalog_manager.cc:5415] Ignoring report from unknown tablet 23d2c7013c9c4b4aacf47e6ac7ab5a0b
I20250830 07:54:58.495045 13476 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "66432e73deea433d9df565d5fcace647" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:54:58.495226 13476 raft_consensus.cc:2466] T 66432e73deea433d9df565d5fcace647 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 0.
I20250830 07:54:58.497824 13886 tablet_bootstrap.cc:492] T 63168840534246b59a2fdbfdfeebff47 P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:54:58.497970 13886 ts_tablet_manager.cc:1397] T 63168840534246b59a2fdbfdfeebff47 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.129s user 0.006s sys 0.001s
I20250830 07:54:58.435352 13226 catalog_manager.cc:5674] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743) does not have the latest schema for tablet ed364f03bdad42b88e181b7d0e1e4011 (table default.Table_d72c9e458203404188b2329054b05d20 [id=41f959f5cad14060ae3f4bf1b0151b9f]). Expected version 1 got 0
I20250830 07:54:58.499214 13886 raft_consensus.cc:357] T 63168840534246b59a2fdbfdfeebff47 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:58.499397 13886 raft_consensus.cc:383] T 63168840534246b59a2fdbfdfeebff47 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:58.499473 13886 raft_consensus.cc:738] T 63168840534246b59a2fdbfdfeebff47 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:54:58.501614 13228 master_service.cc:948] ReplaceTablet: received request to replace tablet 4b692717d4d34919af71cabb1a82bfd8 from {username='slave'} at 127.0.0.1:42126
I20250830 07:54:58.501703 13886 consensus_queue.cc:260] T 63168840534246b59a2fdbfdfeebff47 P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:58.502455 13886 ts_tablet_manager.cc:1428] T 63168840534246b59a2fdbfdfeebff47 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.004s user 0.001s sys 0.002s
I20250830 07:54:58.506181 13475 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "846338e46b834ae0b5f4e74c7f1325d2" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba"
I20250830 07:54:58.506521 13475 raft_consensus.cc:3058] T 846338e46b834ae0b5f4e74c7f1325d2 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:58.508971 13475 raft_consensus.cc:2466] T 846338e46b834ae0b5f4e74c7f1325d2 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 1.
W20250830 07:54:58.513921 13228 catalog_manager.cc:5415] Ignoring report from unknown tablet ee44ab24333742909f773889ad5c3e00
W20250830 07:54:58.514117 13228 catalog_manager.cc:5415] Ignoring report from unknown tablet d1153d8cd2994377ac0dcbfeeda1fd52
W20250830 07:54:58.514226 13228 catalog_manager.cc:5415] Ignoring report from unknown tablet c56e3a30c18640e68c8b0c4ff4251d96
W20250830 07:54:58.514308 13228 catalog_manager.cc:5415] Ignoring report from unknown tablet 8cce7e5537794e9484f5a7c82b9e6e1d
I20250830 07:54:58.515239 13886 tablet_bootstrap.cc:492] T 52df62f7f1aa4b38be89f6198cf01f24 P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:54:58.516041 13231 catalog_manager.cc:5674] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325) does not have the latest schema for tablet 52e910677ae34630a919d1d3f21b7e83 (table default.Table_96df3a05fc564aba9ae2d0e0f1e94abb [id=b3fced981b2a4b44a8eab43675699ba5]). Expected version 1 got 0
I20250830 07:54:58.527544 13886 tablet_bootstrap.cc:654] T 52df62f7f1aa4b38be89f6198cf01f24 P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
W20250830 07:54:58.530946 13703 consensus_peers.cc:489] T a0cf1de8485941eb8a557a6e2f783047 P 9b057ade5dce45af9f8bf0bedf8b917f -> Peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Couldn't send request to peer 6b5e454d98894637b466ea27f1b647f9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20250830 07:54:58.535101 13228 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_d0acfc6baecf454d8680f6ef6e4c0b21"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:58.535776 13228 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d0acfc6baecf454d8680f6ef6e4c0b21 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:58.544072 13233 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_ab1817f7b5084ba99a3cd30cfabd41a4" } new_table_name: "default.Table_340cc5ce16c9492d942c82e7c29565cc" modify_external_catalogs: true
W20250830 07:54:58.549916 13233 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 96ebaac4302d4f5e9b1d831c1e324cba has no consensus state
I20250830 07:54:58.552166 13882 tablet_bootstrap.cc:492] T 0208de98277c4d6889fb0289b6013ae1 P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:54:58.552366 13882 ts_tablet_manager.cc:1397] T 0208de98277c4d6889fb0289b6013ae1 P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.255s user 0.012s sys 0.021s
I20250830 07:54:58.553155 13882 raft_consensus.cc:357] T 0208de98277c4d6889fb0289b6013ae1 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:58.553413 13882 raft_consensus.cc:383] T 0208de98277c4d6889fb0289b6013ae1 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:58.553522 13882 raft_consensus.cc:738] T 0208de98277c4d6889fb0289b6013ae1 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:54:58.553803 13882 consensus_queue.cc:260] T 0208de98277c4d6889fb0289b6013ae1 P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:58.558020 13882 ts_tablet_manager.cc:1428] T 0208de98277c4d6889fb0289b6013ae1 P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.006s user 0.001s sys 0.001s
I20250830 07:54:58.564975 13882 tablet_bootstrap.cc:492] T f66e1d07039841088a444ee0203a4eb0 P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:54:58.566531 13882 tablet_bootstrap.cc:654] T f66e1d07039841088a444ee0203a4eb0 P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
W20250830 07:54:58.566931 13703 consensus_peers.cc:489] T 240a6bfad8fa478598a67a27c2dedf62 P 9b057ade5dce45af9f8bf0bedf8b917f -> Peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Couldn't send request to peer 6b5e454d98894637b466ea27f1b647f9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20250830 07:54:58.527359 13488 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "c56e3a30c18640e68c8b0c4ff4251d96" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:54:58.571930 13488 raft_consensus.cc:2466] T c56e3a30c18640e68c8b0c4ff4251d96 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 0.
I20250830 07:54:58.528466 13479 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "d171ad1667fa44c993ec5fd7d701d8e0" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba"
I20250830 07:54:58.572191 13479 raft_consensus.cc:3058] T d171ad1667fa44c993ec5fd7d701d8e0 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:58.574771 13479 raft_consensus.cc:2466] T d171ad1667fa44c993ec5fd7d701d8e0 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 1.
I20250830 07:54:58.541801 13480 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "2f3bec2c98574a9393e0fae77e228ce0" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:54:58.575018 13480 raft_consensus.cc:2466] T 2f3bec2c98574a9393e0fae77e228ce0 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 0.
I20250830 07:54:58.571758 13887 tablet_bootstrap.cc:492] T 0d16bc64dd6e43f7ba313b77c2bbb728 P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:54:58.579108 13887 ts_tablet_manager.cc:1397] T 0d16bc64dd6e43f7ba313b77c2bbb728 P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.208s user 0.005s sys 0.001s
I20250830 07:54:58.579959 13887 raft_consensus.cc:357] T 0d16bc64dd6e43f7ba313b77c2bbb728 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:58.580192 13887 raft_consensus.cc:383] T 0d16bc64dd6e43f7ba313b77c2bbb728 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:58.580307 13887 raft_consensus.cc:738] T 0d16bc64dd6e43f7ba313b77c2bbb728 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:54:58.580614 13887 consensus_queue.cc:260] T 0d16bc64dd6e43f7ba313b77c2bbb728 P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:58.581241 13887 ts_tablet_manager.cc:1428] T 0d16bc64dd6e43f7ba313b77c2bbb728 P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20250830 07:54:58.581538 13887 tablet_bootstrap.cc:492] T f479eef0171c401bbd27beec4486a8b2 P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:54:58.592005 15720 raft_consensus.cc:491] T ed364f03bdad42b88e181b7d0e1e4011 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:58.592155 15720 raft_consensus.cc:513] T ed364f03bdad42b88e181b7d0e1e4011 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:58.592767 15720 leader_election.cc:290] T ed364f03bdad42b88e181b7d0e1e4011 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
I20250830 07:54:58.593400 13629 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "ed364f03bdad42b88e181b7d0e1e4011" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
W20250830 07:54:58.593834 13703 leader_election.cc:343] T ed364f03bdad42b88e181b7d0e1e4011 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:58.594267 13231 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_c54374b7c0284fde94ca6c2b597b9cb1" } modify_external_catalogs: true
I20250830 07:54:58.594425 13231 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_c54374b7c0284fde94ca6c2b597b9cb1" } modify_external_catalogs: true
I20250830 07:54:58.599669 13479 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "ed364f03bdad42b88e181b7d0e1e4011" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:54:58.599838 13479 raft_consensus.cc:2466] T ed364f03bdad42b88e181b7d0e1e4011 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 0.
I20250830 07:54:58.601059 13233 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_720ec70f42b140828551414f11ef42b2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250830 07:54:58.602558 13766 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "34199145292d4ddb8c603e5c581f1d15" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:58.604462 13228 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_7a848fe3810548fc8459b7a06517e874" } modify_external_catalogs: true
I20250830 07:54:58.604733 13229 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_9c69099e625a4f199780143a4281d793"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250830 07:54:58.604772 13225 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_b286d12691394c22abaec261fa83844d" } new_table_name: "default.Table_07ed5d9acb944e4cbaed0a4c47f3a3b6" modify_external_catalogs: true
I20250830 07:54:58.605688 13231 catalog_manager.cc:5864] Not sending DeleteTablet requests; no consensus state for tablet 4a59f68514ba41c5866d4c5e8b3d3b2d
I20250830 07:54:58.611124 13886 tablet_bootstrap.cc:492] T 52df62f7f1aa4b38be89f6198cf01f24 P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:54:58.611274 13886 ts_tablet_manager.cc:1397] T 52df62f7f1aa4b38be89f6198cf01f24 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.097s user 0.006s sys 0.006s
I20250830 07:54:58.611927 13886 raft_consensus.cc:357] T 52df62f7f1aa4b38be89f6198cf01f24 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:58.612108 13886 raft_consensus.cc:383] T 52df62f7f1aa4b38be89f6198cf01f24 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:58.612188 13886 raft_consensus.cc:738] T 52df62f7f1aa4b38be89f6198cf01f24 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:54:58.612231 13887 tablet_bootstrap.cc:654] T f479eef0171c401bbd27beec4486a8b2 P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:58.604792 13228 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_7a848fe3810548fc8459b7a06517e874" } modify_external_catalogs: true
W20250830 07:54:58.610100 13225 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 819888ceeb384766947a2fb60294ecbb has no consensus state
I20250830 07:54:58.613178 13886 consensus_queue.cc:260] T 52df62f7f1aa4b38be89f6198cf01f24 P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
W20250830 07:54:58.611770 13229 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9c69099e625a4f199780143a4281d793 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:58.614529 13886 ts_tablet_manager.cc:1428] T 52df62f7f1aa4b38be89f6198cf01f24 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
W20250830 07:54:58.614590 13233 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_720ec70f42b140828551414f11ef42b2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:58.615382 13886 tablet_bootstrap.cc:492] T 8c01157324ba45bda5b3a9a328bf319b P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:54:58.619143 13230 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_316c63560eb644948079c43316645440"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250830 07:54:58.619339 13227 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_895faedded184eac8021bf2ddef31017"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:58.619639 13230 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_316c63560eb644948079c43316645440 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250830 07:54:58.619717 13227 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_895faedded184eac8021bf2ddef31017 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:58.620785 13232 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_06b0abb255b04493b0d7e1f1d4624f8d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:58.621078 13703 consensus_peers.cc:489] T e72402ca3cdf452fa8f4534c67226253 P 9b057ade5dce45af9f8bf0bedf8b917f -> Peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Couldn't send request to peer 6b5e454d98894637b466ea27f1b647f9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20250830 07:54:58.621167 13232 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_06b0abb255b04493b0d7e1f1d4624f8d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:58.622602 13225 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_8b5fb6aa121c499284d0108a23793dd4" } modify_external_catalogs: true
I20250830 07:54:58.622728 13225 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_8b5fb6aa121c499284d0108a23793dd4" } modify_external_catalogs: true
I20250830 07:54:58.625703 13886 tablet_bootstrap.cc:654] T 8c01157324ba45bda5b3a9a328bf319b P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:58.629608 13228 catalog_manager.cc:5864] Not sending DeleteTablet requests; no consensus state for tablet 15031c6444f14384b77b595c145d8001
I20250830 07:54:58.635249 13231 master_service.cc:948] ReplaceTablet: received request to replace tablet 62bc8168176e4678a77827c5b7cc0f3e from {username='slave'} at 127.0.0.1:42126
I20250830 07:54:58.640551 13882 tablet_bootstrap.cc:492] T f66e1d07039841088a444ee0203a4eb0 P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:54:58.641024 13882 ts_tablet_manager.cc:1397] T f66e1d07039841088a444ee0203a4eb0 P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.076s user 0.003s sys 0.000s
I20250830 07:54:58.649331 13228 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_baaabd087e1245859663957887531298"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:58.649871 13228 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_baaabd087e1245859663957887531298 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:58.650882 13764 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "2e63eac2579844ef83bf43f1e6d58634" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:58.651101 13764 raft_consensus.cc:2466] T 2e63eac2579844ef83bf43f1e6d58634 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2065c332f15a4739899af79f3669c3ba in term 0.
I20250830 07:54:58.652179 13701 leader_election.cc:304] T ddedd1f141c147c69f178c6cd2b287da P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:54:58.652638 15720 raft_consensus.cc:2802] T ddedd1f141c147c69f178c6cd2b287da P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:54:58.652755 15720 raft_consensus.cc:491] T ddedd1f141c147c69f178c6cd2b287da P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:54:58.652833 15720 raft_consensus.cc:3058] T ddedd1f141c147c69f178c6cd2b287da P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:58.656221 15720 raft_consensus.cc:513] T ddedd1f141c147c69f178c6cd2b287da P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:58.657367 13610 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "ddedd1f141c147c69f178c6cd2b287da" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9"
W20250830 07:54:58.657953 13703 leader_election.cc:343] T ddedd1f141c147c69f178c6cd2b287da P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:58.660189 15720 leader_election.cc:290] T ddedd1f141c147c69f178c6cd2b287da P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Requested vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
I20250830 07:54:58.664673 13226 catalog_manager.cc:5674] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743) does not have the latest schema for tablet 63168840534246b59a2fdbfdfeebff47 (table default.Table_39a24b3df73845288264cd44ba598cf7 [id=fe274567d2a84f62b0c585f361464b6c]). Expected version 1 got 0
I20250830 07:54:58.674528 13231 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_ab57180a4a114c678ae19b2facb48335"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250830 07:54:58.675335 13233 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_b12f5a566e884916a19242caa716466a" } modify_external_catalogs: true
I20250830 07:54:58.675483 13233 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_b12f5a566e884916a19242caa716466a" } modify_external_catalogs: true
W20250830 07:54:58.676128 13231 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ab57180a4a114c678ae19b2facb48335 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:58.677078 13225 catalog_manager.cc:5864] Not sending DeleteTablet requests; no consensus state for tablet abac856cdaa747f7a162d57c607a359c
I20250830 07:54:58.679634 13229 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_f4bee48d427e4bc883ddcf06fc1d8fb0" } new_table_name: "default.Table_ff6346896570439a8d220e810691094f" modify_external_catalogs: true
I20250830 07:54:58.680681 13232 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_8b44e4f248804beeb3c27df869d09f47" } modify_external_catalogs: true
I20250830 07:54:58.680811 13232 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_8b44e4f248804beeb3c27df869d09f47" } modify_external_catalogs: true
I20250830 07:54:58.681759 13225 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_b272a60cfdfb49fda18b9aaf3725d3e8" } new_table_name: "default.Table_0ed9f1757527471aa759c57bf801c3f5" modify_external_catalogs: true
I20250830 07:54:58.682739 13227 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_cbe304346fbe42a8896b8f45deb07292" } new_table_name: "default.Table_5851db79967f435aa170a4c5ec0195f8" modify_external_catalogs: true
I20250830 07:54:58.686331 13234 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_c373daedc0f9402198072841853ee94c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:58.686725 13234 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c373daedc0f9402198072841853ee94c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:58.689173 13230 catalog_manager.cc:5674] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743) does not have the latest schema for tablet 91705fc35a1b4977b89bac1765c886c0 (table default.Table_4f53e333521540848fc99c0bf37c1639 [id=48089766c3514336991a5ada71b03dd0]). Expected version 1 got 0
I20250830 07:54:58.689431 13230 catalog_manager.cc:5674] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743) does not have the latest schema for tablet 52df62f7f1aa4b38be89f6198cf01f24 (table default.Table_c58784366d3c49dda4c9d4afc16520a3 [id=0345f468e2de4e38814123f678c2da1c]). Expected version 1 got 0
I20250830 07:54:58.694530 13233 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet 7cf69490c7944a0a9c0558d425cea37c
I20250830 07:54:58.695358 13602 tablet_service.cc:1515] Processing DeleteTablet for tablet 7cf69490c7944a0a9c0558d425cea37c with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:58 UTC) from {username='slave'} at 127.0.0.1:45306
I20250830 07:54:58.707495 13701 leader_election.cc:304] T 208995abd6d44dbea3b5ebbea27d6a39 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:54:58.708216 15720 raft_consensus.cc:2802] T 208995abd6d44dbea3b5ebbea27d6a39 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election won for term 1
I20250830 07:54:58.708405 15720 raft_consensus.cc:695] T 208995abd6d44dbea3b5ebbea27d6a39 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 LEADER]: Becoming Leader. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Running, Role: LEADER
I20250830 07:54:58.708401 13701 leader_election.cc:304] T 5fee48de90014f94b796e726a4d16b85 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:54:58.709187 15748 raft_consensus.cc:2802] T 5fee48de90014f94b796e726a4d16b85 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election won for term 1
I20250830 07:54:58.709879 13701 leader_election.cc:304] T bdeb89bbb3ad4e67bbc74b78454eeb7e P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:54:58.710176 15751 raft_consensus.cc:2802] T bdeb89bbb3ad4e67bbc74b78454eeb7e P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election won for term 1
I20250830 07:54:58.711483 15748 raft_consensus.cc:695] T 5fee48de90014f94b796e726a4d16b85 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 LEADER]: Becoming Leader. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Running, Role: LEADER
I20250830 07:54:58.711796 15748 consensus_queue.cc:237] T 5fee48de90014f94b796e726a4d16b85 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:58.712911 15751 raft_consensus.cc:695] T bdeb89bbb3ad4e67bbc74b78454eeb7e P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 LEADER]: Becoming Leader. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Running, Role: LEADER
I20250830 07:54:58.713251 15751 consensus_queue.cc:237] T bdeb89bbb3ad4e67bbc74b78454eeb7e P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:58.714593 15720 consensus_queue.cc:237] T 208995abd6d44dbea3b5ebbea27d6a39 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
W20250830 07:54:58.716343 13225 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 6e4310c8d285455db08323a874e3d8ad has no consensus state
W20250830 07:54:58.717850 13229 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 7302ac026e96428fb3f40b4122fc48d8 has no consensus state
I20250830 07:54:58.718214 13232 catalog_manager.cc:5864] Not sending DeleteTablet requests; no consensus state for tablet bb8011db615c4ddc9fee0c2e002130d0
W20250830 07:54:58.718533 13227 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 91da20bcd25341b5a0f6605b3ec58fb3 consensus state has no leader
I20250830 07:54:58.721349 13230 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_de7c97d0e97540429c6655d54fccdda8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:58.722429 13230 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_de7c97d0e97540429c6655d54fccdda8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:58.723837 13887 tablet_bootstrap.cc:492] T f479eef0171c401bbd27beec4486a8b2 P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:54:58.724170 13887 ts_tablet_manager.cc:1397] T f479eef0171c401bbd27beec4486a8b2 P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.143s user 0.004s sys 0.000s
I20250830 07:54:58.726963 15721 consensus_queue.cc:1035] T 240a6bfad8fa478598a67a27c2dedf62 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:54:58.727849 13701 leader_election.cc:304] T 2c4c3c61cddf42668d3a09f4fbc5f641 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:54:58.728080 15721 raft_consensus.cc:2802] T 2c4c3c61cddf42668d3a09f4fbc5f641 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:54:58.727885 13887 raft_consensus.cc:357] T f479eef0171c401bbd27beec4486a8b2 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:58.728143 15721 raft_consensus.cc:491] T 2c4c3c61cddf42668d3a09f4fbc5f641 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:54:58.728160 13887 raft_consensus.cc:383] T f479eef0171c401bbd27beec4486a8b2 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:58.728217 15721 raft_consensus.cc:3058] T 2c4c3c61cddf42668d3a09f4fbc5f641 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:58.728245 13887 raft_consensus.cc:738] T f479eef0171c401bbd27beec4486a8b2 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:54:58.728559 13887 consensus_queue.cc:260] T f479eef0171c401bbd27beec4486a8b2 P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:58.730652 15721 raft_consensus.cc:513] T 2c4c3c61cddf42668d3a09f4fbc5f641 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:58.731412 15124 ts_manager.cc:194] Registered new tserver with Master: 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
I20250830 07:54:58.732434 15721 leader_election.cc:290] T 2c4c3c61cddf42668d3a09f4fbc5f641 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Requested vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
I20250830 07:54:58.732971 13701 leader_election.cc:304] T 66432e73deea433d9df565d5fcace647 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:54:58.733378 15863 raft_consensus.cc:2802] T 66432e73deea433d9df565d5fcace647 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:54:58.733450 15863 raft_consensus.cc:491] T 66432e73deea433d9df565d5fcace647 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:54:58.733506 15863 raft_consensus.cc:3058] T 66432e73deea433d9df565d5fcace647 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:58.735792 15863 raft_consensus.cc:513] T 66432e73deea433d9df565d5fcace647 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:58.736392 15863 leader_election.cc:290] T 66432e73deea433d9df565d5fcace647 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Requested vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967)
I20250830 07:54:58.746739 13227 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_ca450727dc30417db84a00eb80a7b340"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:58.747395 13227 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ca450727dc30417db84a00eb80a7b340 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:58.750324 13226 master_service.cc:948] ReplaceTablet: received request to replace tablet 3167b609ed184decb4ccdb4945933ebb from {username='slave'} at 127.0.0.1:42126
I20250830 07:54:58.752149 13226 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_af843268c3fe41b696d143a2e807bdda" } new_table_name: "default.Table_3022c9498ca04b59baea59dc677a9b57" modify_external_catalogs: true
I20250830 07:54:58.768620 15721 raft_consensus.cc:491] T 3d9c884ac05e44ddb59f96588fdd6f4b P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:58.768764 15721 raft_consensus.cc:513] T 3d9c884ac05e44ddb59f96588fdd6f4b P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:58.769320 15721 leader_election.cc:290] T 3d9c884ac05e44ddb59f96588fdd6f4b P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
W20250830 07:54:58.780043 14988 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: connection negotiation to 127.12.209.61:44241 for RPC RequestConsensusVote timed out after 0.747s (ON_OUTBOUND_QUEUE)
I20250830 07:54:58.782336 13887 ts_tablet_manager.cc:1428] T f479eef0171c401bbd27beec4486a8b2 P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.058s user 0.001s sys 0.001s
I20250830 07:54:58.785676 13887 tablet_bootstrap.cc:492] T 0c70140d87d34bde919714f08a5c94d4 P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
W20250830 07:54:58.790439 13227 catalog_manager.cc:5415] Ignoring report from unknown tablet ef1ab62a5b7845e58d50f34206eaaa27
W20250830 07:54:58.799870 13701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.209.1:45325, user_credentials={real_user=slave}} blocked reactor thread for 64082.7us
I20250830 07:54:58.800719 15919 raft_consensus.cc:491] T 55bd3f378b854476a24f657f5e23843d P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:58.800865 15919 raft_consensus.cc:513] T 55bd3f378b854476a24f657f5e23843d P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:58.801476 15919 leader_election.cc:290] T 55bd3f378b854476a24f657f5e23843d P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
W20250830 07:54:58.802774 13226 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 7e9d6af1d7fc4d4b961583b44f2f962a consensus state has no leader
I20250830 07:54:58.803983 15603 raft_consensus.cc:491] T 63168840534246b59a2fdbfdfeebff47 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:58.804176 15603 raft_consensus.cc:513] T 63168840534246b59a2fdbfdfeebff47 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:58.804884 15603 leader_election.cc:290] T 63168840534246b59a2fdbfdfeebff47 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
I20250830 07:54:58.810843 13887 tablet_bootstrap.cc:654] T 0c70140d87d34bde919714f08a5c94d4 P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
W20250830 07:54:58.813815 13220 catalog_manager.cc:4908] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet 7cf69490c7944a0a9c0558d425cea37c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7cf69490c7944a0a9c0558d425cea37c already in progress: creating tablet
I20250830 07:54:58.813964 13882 raft_consensus.cc:357] T f66e1d07039841088a444ee0203a4eb0 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:58.814158 13882 raft_consensus.cc:383] T f66e1d07039841088a444ee0203a4eb0 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:58.814209 13882 raft_consensus.cc:738] T f66e1d07039841088a444ee0203a4eb0 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:54:58.814407 13882 consensus_queue.cc:260] T f66e1d07039841088a444ee0203a4eb0 P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:58.814847 13882 ts_tablet_manager.cc:1428] T f66e1d07039841088a444ee0203a4eb0 P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.174s user 0.001s sys 0.000s
I20250830 07:54:58.817152 15706 raft_consensus.cc:491] T 689b4fee1dd04b3d9ccdea334b0f6b59 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:58.818028 13701 leader_election.cc:304] T c56e3a30c18640e68c8b0c4ff4251d96 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:54:58.818384 13701 leader_election.cc:304] T d171ad1667fa44c993ec5fd7d701d8e0 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:54:58.818596 15935 raft_consensus.cc:491] T f66e1d07039841088a444ee0203a4eb0 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:58.818707 15935 raft_consensus.cc:513] T f66e1d07039841088a444ee0203a4eb0 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:58.818845 15603 raft_consensus.cc:2802] T c56e3a30c18640e68c8b0c4ff4251d96 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:54:58.818956 15603 raft_consensus.cc:491] T c56e3a30c18640e68c8b0c4ff4251d96 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:54:58.819031 15603 raft_consensus.cc:3058] T c56e3a30c18640e68c8b0c4ff4251d96 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:58.820148 13479 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f66e1d07039841088a444ee0203a4eb0" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:54:58.821820 13701 leader_election.cc:304] T 2f3bec2c98574a9393e0fae77e228ce0 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:54:58.822116 13701 leader_election.cc:304] T 846338e46b834ae0b5f4e74c7f1325d2 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:54:58.821858 13226 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_709433919e284efd85a8a10a052723bf" } new_table_name: "default.Table_4a9e658505d840d88be7c7a3cd51cb4d" modify_external_catalogs: true
I20250830 07:54:58.823648 13610 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "55bd3f378b854476a24f657f5e23843d" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:58.823763 15603 raft_consensus.cc:513] T c56e3a30c18640e68c8b0c4ff4251d96 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:58.824705 15603 leader_election.cc:290] T c56e3a30c18640e68c8b0c4ff4251d96 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Requested vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
I20250830 07:54:58.825280 15608 raft_consensus.cc:2802] T d171ad1667fa44c993ec5fd7d701d8e0 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election won for term 1
I20250830 07:54:58.825376 15608 raft_consensus.cc:695] T d171ad1667fa44c993ec5fd7d701d8e0 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 LEADER]: Becoming Leader. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Running, Role: LEADER
I20250830 07:54:58.825587 15608 consensus_queue.cc:237] T d171ad1667fa44c993ec5fd7d701d8e0 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:58.828078 15481 raft_consensus.cc:2802] T 846338e46b834ae0b5f4e74c7f1325d2 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election won for term 1
I20250830 07:54:58.828722 15748 consensus_queue.cc:1035] T a0cf1de8485941eb8a557a6e2f783047 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:54:58.832237 13232 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_2f82f02191364e37bd46856ff1e486cf"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:58.832870 13232 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2f82f02191364e37bd46856ff1e486cf in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:58.832927 13624 raft_consensus.cc:3058] T f66e1d07039841088a444ee0203a4eb0 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:58.834069 13229 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_406d183190bf4e01a97000963dd33d13" } modify_external_catalogs: true
I20250830 07:54:58.834240 13229 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_406d183190bf4e01a97000963dd33d13" } modify_external_catalogs: true
I20250830 07:54:58.834162 13230 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_f3e7b6dfb1fc4dc2be4da90c976b21dd" } modify_external_catalogs: true
I20250830 07:54:58.834443 13230 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_f3e7b6dfb1fc4dc2be4da90c976b21dd" } modify_external_catalogs: true
I20250830 07:54:58.835521 13614 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "66432e73deea433d9df565d5fcace647" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9"
I20250830 07:54:58.841156 13882 tablet_bootstrap.cc:492] T 852e353f6ee945628ddebdbdd1bd76fb P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:54:58.841306 15706 raft_consensus.cc:513] T 689b4fee1dd04b3d9ccdea334b0f6b59 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:58.841835 15706 leader_election.cc:290] T 689b4fee1dd04b3d9ccdea334b0f6b59 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:58.842007 13619 raft_consensus.cc:3058] T 689b4fee1dd04b3d9ccdea334b0f6b59 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:58.843200 15935 leader_election.cc:290] T f66e1d07039841088a444ee0203a4eb0 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:58.843868 13886 tablet_bootstrap.cc:492] T 8c01157324ba45bda5b3a9a328bf319b P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:54:58.844092 13886 ts_tablet_manager.cc:1397] T 8c01157324ba45bda5b3a9a328bf319b P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.229s user 0.021s sys 0.008s
I20250830 07:54:58.844453 13475 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "689b4fee1dd04b3d9ccdea334b0f6b59" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:54:58.844856 13227 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_01c93f7d1b5f4f7bb42200d9825376ba"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:58.845629 13227 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_01c93f7d1b5f4f7bb42200d9825376ba in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:58.828105 15868 raft_consensus.cc:2802] T 2f3bec2c98574a9393e0fae77e228ce0 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:54:58.845932 15868 raft_consensus.cc:491] T 2f3bec2c98574a9393e0fae77e228ce0 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:54:58.846772 15868 raft_consensus.cc:3058] T 2f3bec2c98574a9393e0fae77e228ce0 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:58.849093 13886 raft_consensus.cc:357] T 8c01157324ba45bda5b3a9a328bf319b P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:58.849892 13229 catalog_manager.cc:5864] Not sending DeleteTablet requests; no consensus state for tablet 39fa4ac0699546c99e181c8a187e128e
I20250830 07:54:58.850787 13230 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet 9f27983af2c84dd6a40e7e0b900a9dc6
I20250830 07:54:58.851431 13886 raft_consensus.cc:383] T 8c01157324ba45bda5b3a9a328bf319b P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:58.851513 13886 raft_consensus.cc:738] T 8c01157324ba45bda5b3a9a328bf319b P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:54:58.852177 13886 consensus_queue.cc:260] T 8c01157324ba45bda5b3a9a328bf319b P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:58.859465 13886 ts_tablet_manager.cc:1428] T 8c01157324ba45bda5b3a9a328bf319b P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.015s user 0.001s sys 0.001s
I20250830 07:54:58.861119 13886 tablet_bootstrap.cc:492] T 0ac39adafe144280b39f5c3fe5804087 P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
W20250830 07:54:58.864228 13226 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f8fab6e766a847c29da8573ad0b402d5 consensus state has no leader
I20250830 07:54:58.865739 13886 tablet_bootstrap.cc:654] T 0ac39adafe144280b39f5c3fe5804087 P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:58.867234 13611 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "2c4c3c61cddf42668d3a09f4fbc5f641" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9"
I20250830 07:54:58.868978 13602 tablet_service.cc:1515] Processing DeleteTablet for tablet 9f27983af2c84dd6a40e7e0b900a9dc6 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:58 UTC) from {username='slave'} at 127.0.0.1:45306
I20250830 07:54:58.869482 13622 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "63168840534246b59a2fdbfdfeebff47" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
W20250830 07:54:58.870630 13220 catalog_manager.cc:4908] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet 9f27983af2c84dd6a40e7e0b900a9dc6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9f27983af2c84dd6a40e7e0b900a9dc6 already in progress: creating tablet
I20250830 07:54:58.871487 13611 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "3d9c884ac05e44ddb59f96588fdd6f4b" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:58.873790 13611 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "c56e3a30c18640e68c8b0c4ff4251d96" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9"
I20250830 07:54:58.874244 13887 tablet_bootstrap.cc:492] T 0c70140d87d34bde919714f08a5c94d4 P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:54:58.874459 13887 ts_tablet_manager.cc:1397] T 0c70140d87d34bde919714f08a5c94d4 P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.090s user 0.006s sys 0.000s
I20250830 07:54:58.874770 15868 raft_consensus.cc:513] T 2f3bec2c98574a9393e0fae77e228ce0 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:58.875430 15868 leader_election.cc:290] T 2f3bec2c98574a9393e0fae77e228ce0 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Requested vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967)
W20250830 07:54:58.875738 14988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.209.61:44241, user_credentials={real_user=slave}} blocked reactor thread for 95721.8us
I20250830 07:54:58.876150 13882 tablet_bootstrap.cc:654] T 852e353f6ee945628ddebdbdd1bd76fb P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
W20250830 07:54:58.876725 13703 consensus_peers.cc:489] T 519b3e58b63b402d84e234f5e180b98c P 9b057ade5dce45af9f8bf0bedf8b917f -> Peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Couldn't send request to peer 6b5e454d98894637b466ea27f1b647f9. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 519b3e58b63b402d84e234f5e180b98c. This is attempt 1: this message will repeat every 5th retry.
W20250830 07:54:58.877166 13703 leader_election.cc:343] T 66432e73deea433d9df565d5fcace647 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
W20250830 07:54:58.877403 13703 leader_election.cc:343] T 2c4c3c61cddf42668d3a09f4fbc5f641 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
W20250830 07:54:58.877712 13703 leader_election.cc:343] T 63168840534246b59a2fdbfdfeebff47 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
W20250830 07:54:58.877859 13703 consensus_peers.cc:489] T 509e08290f3842cfbde8b74ff9f4f70f P 9b057ade5dce45af9f8bf0bedf8b917f -> Peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Couldn't send request to peer 6b5e454d98894637b466ea27f1b647f9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20250830 07:54:58.877970 13703 leader_election.cc:343] T 3d9c884ac05e44ddb59f96588fdd6f4b P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:58.875909 13887 raft_consensus.cc:357] T 0c70140d87d34bde919714f08a5c94d4 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
W20250830 07:54:58.878335 13703 leader_election.cc:343] T c56e3a30c18640e68c8b0c4ff4251d96 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:58.878333 13887 raft_consensus.cc:383] T 0c70140d87d34bde919714f08a5c94d4 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:58.878547 13887 raft_consensus.cc:738] T 0c70140d87d34bde919714f08a5c94d4 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:54:58.879410 13764 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "689b4fee1dd04b3d9ccdea334b0f6b59" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:58.879171 13887 consensus_queue.cc:260] T 0c70140d87d34bde919714f08a5c94d4 P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
W20250830 07:54:58.879978 13423 leader_election.cc:343] T 55bd3f378b854476a24f657f5e23843d P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:58.881433 13227 master_service.cc:948] ReplaceTablet: received request to replace tablet f5baa35307a1425c8d52666d130d6d8a from {username='slave'} at 127.0.0.1:42126
I20250830 07:54:58.882885 13615 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "2f3bec2c98574a9393e0fae77e228ce0" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9"
I20250830 07:54:58.882987 13764 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f66e1d07039841088a444ee0203a4eb0" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:58.882689 13887 ts_tablet_manager.cc:1428] T 0c70140d87d34bde919714f08a5c94d4 P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.008s user 0.003s sys 0.000s
I20250830 07:54:58.883824 13562 leader_election.cc:304] T 689b4fee1dd04b3d9ccdea334b0f6b59 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b5e454d98894637b466ea27f1b647f9; no voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f
W20250830 07:54:58.884409 13703 leader_election.cc:343] T 2f3bec2c98574a9393e0fae77e228ce0 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:58.884670 13562 leader_election.cc:304] T f66e1d07039841088a444ee0203a4eb0 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b5e454d98894637b466ea27f1b647f9; no voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:54:58.884609 13887 tablet_bootstrap.cc:492] T 135d754d83ad422eb05909d2daa19d34 P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:54:58.886436 13229 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_9dd1a7363f2b4ffcaa426abf348ea4f5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:58.886659 13703 consensus_peers.cc:489] T 579324e1f6474d398db10da3093650dd P 9b057ade5dce45af9f8bf0bedf8b917f -> Peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Couldn't send request to peer 6b5e454d98894637b466ea27f1b647f9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20250830 07:54:58.887079 13229 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9dd1a7363f2b4ffcaa426abf348ea4f5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:58.887465 13226 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_1cd34e92753e435c8f40cd5b8a3c191d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:58.888175 13226 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1cd34e92753e435c8f40cd5b8a3c191d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:58.886418 13230 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_87c4d4c8f9434a7887c620edd83eebaf" } modify_external_catalogs: true
I20250830 07:54:58.888609 13230 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_87c4d4c8f9434a7887c620edd83eebaf" } modify_external_catalogs: true
I20250830 07:54:58.886893 13227 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_b0f54d32329849c69d3854ea64a6b49a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250830 07:54:58.891870 13232 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_e2ed2186796549d9a9b9a956379c1599"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250830 07:54:58.892213 15481 raft_consensus.cc:695] T 846338e46b834ae0b5f4e74c7f1325d2 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 LEADER]: Becoming Leader. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Running, Role: LEADER
W20250830 07:54:58.892436 13232 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e2ed2186796549d9a9b9a956379c1599 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:58.892552 15481 consensus_queue.cc:237] T 846338e46b834ae0b5f4e74c7f1325d2 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:58.893762 13886 tablet_bootstrap.cc:492] T 0ac39adafe144280b39f5c3fe5804087 P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:54:58.893872 13886 ts_tablet_manager.cc:1397] T 0ac39adafe144280b39f5c3fe5804087 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.033s user 0.004s sys 0.001s
I20250830 07:54:58.894554 13886 raft_consensus.cc:357] T 0ac39adafe144280b39f5c3fe5804087 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:58.894697 13886 raft_consensus.cc:383] T 0ac39adafe144280b39f5c3fe5804087 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:58.894745 13886 raft_consensus.cc:738] T 0ac39adafe144280b39f5c3fe5804087 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:54:58.895825 13886 consensus_queue.cc:260] T 0ac39adafe144280b39f5c3fe5804087 P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:58.896332 13886 ts_tablet_manager.cc:1428] T 0ac39adafe144280b39f5c3fe5804087 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20250830 07:54:58.896587 13886 tablet_bootstrap.cc:492] T fbb1cc8f8eea4a0795f6f8e213b8180f P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:54:58.897768 15976 raft_consensus.cc:491] T b2248b305c9f448a9e30661142ad10ea P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:58.897934 13886 tablet_bootstrap.cc:654] T fbb1cc8f8eea4a0795f6f8e213b8180f P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:58.897900 15976 raft_consensus.cc:513] T b2248b305c9f448a9e30661142ad10ea P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:58.899068 15976 leader_election.cc:290] T b2248b305c9f448a9e30661142ad10ea P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:58.904647 13230 catalog_manager.cc:5864] Not sending DeleteTablet requests; no consensus state for tablet d8dcdd2bd68e4f7f8d40fe9b6d9c2df2
I20250830 07:54:58.908103 13229 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_16f5552491ef49a4a71e31ac7033bb0b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:58.908838 13229 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_16f5552491ef49a4a71e31ac7033bb0b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:58.909415 13886 tablet_bootstrap.cc:492] T fbb1cc8f8eea4a0795f6f8e213b8180f P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:54:58.910025 13886 ts_tablet_manager.cc:1397] T fbb1cc8f8eea4a0795f6f8e213b8180f P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.014s user 0.001s sys 0.002s
I20250830 07:54:58.910846 13886 raft_consensus.cc:357] T fbb1cc8f8eea4a0795f6f8e213b8180f P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:58.911989 13886 raft_consensus.cc:383] T fbb1cc8f8eea4a0795f6f8e213b8180f P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:58.914567 13886 raft_consensus.cc:738] T fbb1cc8f8eea4a0795f6f8e213b8180f P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:54:58.915017 13886 consensus_queue.cc:260] T fbb1cc8f8eea4a0795f6f8e213b8180f P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:58.916370 13886 ts_tablet_manager.cc:1428] T fbb1cc8f8eea4a0795f6f8e213b8180f P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.006s user 0.001s sys 0.000s
I20250830 07:54:58.917030 13886 tablet_bootstrap.cc:492] T 1fee3e58f31b4befa42ffbb8d7bd6f4e P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:54:58.918845 13886 tablet_bootstrap.cc:654] T 1fee3e58f31b4befa42ffbb8d7bd6f4e P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
W20250830 07:54:58.924631 13422 leader_election.cc:343] T ba4e1fccb8f046d6b63afe67c1f9d538 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:58.924760 13422 leader_election.cc:304] T ba4e1fccb8f046d6b63afe67c1f9d538 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba; no voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:54:58.925540 15976 raft_consensus.cc:2747] T ba4e1fccb8f046d6b63afe67c1f9d538 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:54:58.926631 13234 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_9cf9a577c6bb40d0847b00f66c9f9256" } modify_external_catalogs: true
I20250830 07:54:58.926764 13234 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_9cf9a577c6bb40d0847b00f66c9f9256" } modify_external_catalogs: true
I20250830 07:54:58.922761 13611 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "b2248b305c9f448a9e30661142ad10ea" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:58.927851 13225 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_6cf2cdc2d05c4b499e3ea116b3ac5108" } new_table_name: "default.Table_4ebbb579b0984c0a9d01897acbed2325" modify_external_catalogs: true
I20250830 07:54:58.929005 13231 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_450c8e4da4c940928589c450d6d5b693" } new_table_name: "default.Table_a5f407069c794275bb65ad4c58f94ea7" modify_external_catalogs: true
I20250830 07:54:58.930055 13233 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_499c8922a998424698432b35b19201ce" } new_table_name: "default.Table_543c7038879a49379182a3b2d4722b62" modify_external_catalogs: true
W20250830 07:54:58.931536 13423 leader_election.cc:343] T b2248b305c9f448a9e30661142ad10ea P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:58.931942 13230 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_977c3bb9ffa841dc945293231255711d" } modify_external_catalogs: true
I20250830 07:54:58.932088 13232 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_bcb110c3e7fc4c649478c1c5db235c43"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:58.932597 13232 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bcb110c3e7fc4c649478c1c5db235c43 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:58.932126 13230 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_977c3bb9ffa841dc945293231255711d" } modify_external_catalogs: true
I20250830 07:54:58.934088 13422 leader_election.cc:304] T 208995abd6d44dbea3b5ebbea27d6a39 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:54:58.944825 15976 raft_consensus.cc:2762] T 208995abd6d44dbea3b5ebbea27d6a39 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20250830 07:54:58.945670 13422 leader_election.cc:304] T 2c31d119743f49589703c434ac6c7548 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:54:58.949404 15976 raft_consensus.cc:2802] T 2c31d119743f49589703c434ac6c7548 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:54:58.949520 15976 raft_consensus.cc:491] T 2c31d119743f49589703c434ac6c7548 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:54:58.949656 15976 raft_consensus.cc:3058] T 2c31d119743f49589703c434ac6c7548 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:58.952603 15976 raft_consensus.cc:513] T 2c31d119743f49589703c434ac6c7548 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:58.953835 15976 leader_election.cc:290] T 2c31d119743f49589703c434ac6c7548 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 election: Requested vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:58.956480 13615 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "2c31d119743f49589703c434ac6c7548" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9"
W20250830 07:54:58.957701 13423 leader_election.cc:343] T 2c31d119743f49589703c434ac6c7548 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
W20250830 07:54:58.974597 13422 leader_election.cc:343] T 34199145292d4ddb8c603e5c581f1d15 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:58.974673 13229 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_fcd23993819b42b89c9fe3cde5be865e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:58.975212 13229 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fcd23993819b42b89c9fe3cde5be865e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:58.974772 13422 leader_election.cc:304] T 34199145292d4ddb8c603e5c581f1d15 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba; no voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:54:58.975956 15920 raft_consensus.cc:2747] T 34199145292d4ddb8c603e5c581f1d15 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20250830 07:54:58.976310 13701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.209.1:45325, user_credentials={real_user=slave}} blocked reactor thread for 153672us
I20250830 07:54:58.976874 13422 leader_election.cc:304] T 2e63eac2579844ef83bf43f1e6d58634 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:54:58.977181 15920 raft_consensus.cc:2802] T 2e63eac2579844ef83bf43f1e6d58634 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:54:58.977262 15920 raft_consensus.cc:491] T 2e63eac2579844ef83bf43f1e6d58634 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:54:58.977320 15920 raft_consensus.cc:3058] T 2e63eac2579844ef83bf43f1e6d58634 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:58.978989 13701 leader_election.cc:304] T ed364f03bdad42b88e181b7d0e1e4011 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:54:58.979188 15748 raft_consensus.cc:2802] T ed364f03bdad42b88e181b7d0e1e4011 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:54:58.979242 15748 raft_consensus.cc:491] T ed364f03bdad42b88e181b7d0e1e4011 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:54:58.979291 15748 raft_consensus.cc:3058] T ed364f03bdad42b88e181b7d0e1e4011 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:58.979734 15920 raft_consensus.cc:513] T 2e63eac2579844ef83bf43f1e6d58634 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:58.980232 15920 leader_election.cc:290] T 2e63eac2579844ef83bf43f1e6d58634 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 election: Requested vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:58.981763 15748 raft_consensus.cc:513] T ed364f03bdad42b88e181b7d0e1e4011 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:58.982508 15748 leader_election.cc:290] T ed364f03bdad42b88e181b7d0e1e4011 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Requested vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
W20250830 07:54:58.891891 13227 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b0f54d32329849c69d3854ea64a6b49a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250830 07:54:58.990290 13228 catalog_manager.cc:5415] Ignoring report from unknown tablet d33a5d107c6849aca6eb48ffdf8a5463
W20250830 07:54:58.990518 13228 catalog_manager.cc:5415] Ignoring report from unknown tablet ee44ab24333742909f773889ad5c3e00
W20250830 07:54:58.991110 13228 catalog_manager.cc:5415] Ignoring report from unknown tablet 1520d7257f864ea4ba4b9a5d0443f8a7
W20250830 07:54:58.991375 13228 catalog_manager.cc:5415] Ignoring report from unknown tablet 852e353f6ee945628ddebdbdd1bd76fb
W20250830 07:54:58.991461 13228 catalog_manager.cc:5415] Ignoring report from unknown tablet 4b9d9d4b65964fd49d8e25092a14d774
W20250830 07:54:58.991551 13228 catalog_manager.cc:5415] Ignoring report from unknown tablet 6720d2b945814305845beea0a2cb9912
W20250830 07:54:58.991639 13228 catalog_manager.cc:5415] Ignoring report from unknown tablet 8cce7e5537794e9484f5a7c82b9e6e1d
W20250830 07:54:58.991727 13228 catalog_manager.cc:5415] Ignoring report from unknown tablet d1153d8cd2994377ac0dcbfeeda1fd52
W20250830 07:54:58.991791 13228 catalog_manager.cc:5415] Ignoring report from unknown tablet ef16b9e2d444489699f4db1ac26d5f6c
W20250830 07:54:58.991874 13228 catalog_manager.cc:5415] Ignoring report from unknown tablet db7144b25ff34bed8c7b779ba9497ef4
I20250830 07:54:58.994323 15748 raft_consensus.cc:491] T 8c01157324ba45bda5b3a9a328bf319b P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:58.994498 15748 raft_consensus.cc:513] T 8c01157324ba45bda5b3a9a328bf319b P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:58.995800 13617 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "ed364f03bdad42b88e181b7d0e1e4011" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9"
I20250830 07:54:58.995978 15481 raft_consensus.cc:491] T 52df62f7f1aa4b38be89f6198cf01f24 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:58.996104 15481 raft_consensus.cc:513] T 52df62f7f1aa4b38be89f6198cf01f24 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:58.996598 15481 leader_election.cc:290] T 52df62f7f1aa4b38be89f6198cf01f24 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
I20250830 07:54:58.996726 13617 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "8c01157324ba45bda5b3a9a328bf319b" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
W20250830 07:54:58.997699 13703 leader_election.cc:343] T ed364f03bdad42b88e181b7d0e1e4011 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
W20250830 07:54:58.997946 13703 leader_election.cc:343] T 8c01157324ba45bda5b3a9a328bf319b P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:58.998466 13617 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "2e63eac2579844ef83bf43f1e6d58634" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9"
W20250830 07:54:59.000018 13423 leader_election.cc:343] T 2e63eac2579844ef83bf43f1e6d58634 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:59.001469 15582 raft_consensus.cc:2747] T f66e1d07039841088a444ee0203a4eb0 P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:54:59.002935 13617 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "52df62f7f1aa4b38be89f6198cf01f24" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:59.004261 13764 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "55bd3f378b854476a24f657f5e23843d" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
W20250830 07:54:59.004412 13703 leader_election.cc:343] T 52df62f7f1aa4b38be89f6198cf01f24 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:59.005321 15814 raft_consensus.cc:491] T 4b9d9d4b65964fd49d8e25092a14d774 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:59.005435 15814 raft_consensus.cc:513] T 4b9d9d4b65964fd49d8e25092a14d774 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:59.005960 15814 leader_election.cc:290] T 4b9d9d4b65964fd49d8e25092a14d774 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:59.017321 15748 leader_election.cc:290] T 8c01157324ba45bda5b3a9a328bf319b P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
I20250830 07:54:59.018132 13764 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "b2248b305c9f448a9e30661142ad10ea" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:59.024138 13228 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_6853936026f04f4ab0803a0716fee2e4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:59.024893 13228 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6853936026f04f4ab0803a0716fee2e4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:59.025208 13887 tablet_bootstrap.cc:654] T 135d754d83ad422eb05909d2daa19d34 P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:59.027364 15976 raft_consensus.cc:491] T 50dfc24a0b9645e4860cd99b1df3bd61 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:59.027573 15976 raft_consensus.cc:513] T 50dfc24a0b9645e4860cd99b1df3bd61 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:59.028244 15976 leader_election.cc:290] T 50dfc24a0b9645e4860cd99b1df3bd61 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:59.031745 15935 raft_consensus.cc:2747] T 689b4fee1dd04b3d9ccdea334b0f6b59 P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:54:59.037703 13764 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "2c31d119743f49589703c434ac6c7548" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f"
I20250830 07:54:59.037891 13764 raft_consensus.cc:3058] T 2c31d119743f49589703c434ac6c7548 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:59.040585 13764 raft_consensus.cc:2466] T 2c31d119743f49589703c434ac6c7548 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2065c332f15a4739899af79f3669c3ba in term 1.
I20250830 07:54:59.041097 13765 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "2e63eac2579844ef83bf43f1e6d58634" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f"
I20250830 07:54:59.041255 13765 raft_consensus.cc:3058] T 2e63eac2579844ef83bf43f1e6d58634 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:59.043821 13765 raft_consensus.cc:2466] T 2e63eac2579844ef83bf43f1e6d58634 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2065c332f15a4739899af79f3669c3ba in term 1.
I20250830 07:54:59.045718 13475 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "ddedd1f141c147c69f178c6cd2b287da" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba"
I20250830 07:54:59.045869 13475 raft_consensus.cc:3058] T ddedd1f141c147c69f178c6cd2b287da P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:59.048959 13475 raft_consensus.cc:2466] T ddedd1f141c147c69f178c6cd2b287da P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 1.
I20250830 07:54:59.059355 13882 tablet_bootstrap.cc:492] T 852e353f6ee945628ddebdbdd1bd76fb P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:54:59.059528 13882 ts_tablet_manager.cc:1397] T 852e353f6ee945628ddebdbdd1bd76fb P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.243s user 0.008s sys 0.008s
I20250830 07:54:59.060621 13882 raft_consensus.cc:357] T 852e353f6ee945628ddebdbdd1bd76fb P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:59.060835 13882 raft_consensus.cc:383] T 852e353f6ee945628ddebdbdd1bd76fb P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:59.060921 13882 raft_consensus.cc:738] T 852e353f6ee945628ddebdbdd1bd76fb P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:54:59.061177 13882 consensus_queue.cc:260] T 852e353f6ee945628ddebdbdd1bd76fb P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:59.061736 13882 ts_tablet_manager.cc:1428] T 852e353f6ee945628ddebdbdd1bd76fb P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20250830 07:54:59.062520 13882 tablet_bootstrap.cc:492] T db7144b25ff34bed8c7b779ba9497ef4 P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
W20250830 07:54:59.063470 13221 catalog_manager.cc:4726] Async tablet task AlterTable RPC for tablet f8fab6e766a847c29da8573ad0b402d5 (table default.Table_4a9e658505d840d88be7c7a3cd51cb4d [id=e950f4141a48492297f5e6c7f7731d68], current schema version=4) failed: Not found: failed to reset TS proxy: No leader found: Tablet f8fab6e766a847c29da8573ad0b402d5 consensus state has no leader
I20250830 07:54:59.067675 13882 tablet_bootstrap.cc:654] T db7144b25ff34bed8c7b779ba9497ef4 P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:59.075529 13231 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_b98c73d6c6324f4b89a004c99c84cdd7" } new_table_name: "default.Table_064e7ad387154787b9609d498db5bfcd" modify_external_catalogs: true
W20250830 07:54:59.077499 13225 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 4af4a03dc0cb452d8bbbc036287e337f has no consensus state
I20250830 07:54:59.077836 13225 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_e2f51fc47bf64ac2afcdccce8697ef09"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250830 07:54:59.079102 13234 catalog_manager.cc:5864] Not sending DeleteTablet requests; no consensus state for tablet dd795478a20d4258b09eab8eec8fbc91
I20250830 07:54:59.079360 13234 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_2f82f02191364e37bd46856ff1e486cf" } modify_external_catalogs: true
I20250830 07:54:59.079479 13234 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_2f82f02191364e37bd46856ff1e486cf" } modify_external_catalogs: true
W20250830 07:54:59.089886 13561 consensus_peers.cc:489] T d1ae3812d72b419798736328da64b53c P 6b5e454d98894637b466ea27f1b647f9 -> Peer 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): Couldn't send request to peer 2065c332f15a4739899af79f3669c3ba. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d1ae3812d72b419798736328da64b53c. This is attempt 11: this message will repeat every 5th retry.
I20250830 07:54:59.092121 15920 raft_consensus.cc:491] T 0d16bc64dd6e43f7ba313b77c2bbb728 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:59.092288 15920 raft_consensus.cc:513] T 0d16bc64dd6e43f7ba313b77c2bbb728 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:59.092829 15920 leader_election.cc:290] T 0d16bc64dd6e43f7ba313b77c2bbb728 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
W20250830 07:54:59.093907 13423 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.209.2:38967, user_credentials={real_user=slave}} blocked reactor thread for 93579us
W20250830 07:54:59.095520 13233 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ad7a45187569416bad6c71db9f8ab702 consensus state has no leader
I20250830 07:54:59.099061 13233 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_ab57180a4a114c678ae19b2facb48335" } modify_external_catalogs: true
I20250830 07:54:59.099206 13233 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_ab57180a4a114c678ae19b2facb48335" } modify_external_catalogs: true
W20250830 07:54:59.110545 13703 consensus_peers.cc:489] T 2b4103f07e96490488913059a95af0c3 P 9b057ade5dce45af9f8bf0bedf8b917f -> Peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Couldn't send request to peer 6b5e454d98894637b466ea27f1b647f9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20250830 07:54:59.113327 13230 catalog_manager.cc:5864] Not sending DeleteTablet requests; no consensus state for tablet 61d63072b184465c8d49c808ce055cbb
I20250830 07:54:59.113626 13230 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_986f81cfa4f54f808c7ff629ab4c211c" } new_table_name: "default.Table_32c8759770844aeca96eafc2ce6fd7ce" modify_external_catalogs: true
I20250830 07:54:59.118091 15977 raft_consensus.cc:491] T 5e2da5434e95445aa4deafce7fde0c6c P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:59.118233 15977 raft_consensus.cc:513] T 5e2da5434e95445aa4deafce7fde0c6c P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:59.118899 15977 leader_election.cc:290] T 5e2da5434e95445aa4deafce7fde0c6c P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967)
I20250830 07:54:59.129436 13481 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "2c4c3c61cddf42668d3a09f4fbc5f641" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba"
I20250830 07:54:59.129588 13481 raft_consensus.cc:3058] T 2c4c3c61cddf42668d3a09f4fbc5f641 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
W20250830 07:54:59.130308 13225 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e2f51fc47bf64ac2afcdccce8697ef09 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:59.132985 13488 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "66432e73deea433d9df565d5fcace647" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba"
I20250830 07:54:59.133190 13488 raft_consensus.cc:3058] T 66432e73deea433d9df565d5fcace647 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:59.135557 13619 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "4b9d9d4b65964fd49d8e25092a14d774" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:59.135881 13624 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "50dfc24a0b9645e4860cd99b1df3bd61" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:59.136351 13611 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "0d16bc64dd6e43f7ba313b77c2bbb728" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:59.142879 13476 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "3d9c884ac05e44ddb59f96588fdd6f4b" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:54:59.143179 13476 raft_consensus.cc:2466] T 3d9c884ac05e44ddb59f96588fdd6f4b P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 0.
W20250830 07:54:59.147507 13226 catalog_manager.cc:5415] Ignoring report from unknown tablet 852e353f6ee945628ddebdbdd1bd76fb
W20250830 07:54:59.147753 13226 catalog_manager.cc:5415] Ignoring report from unknown tablet db7144b25ff34bed8c7b779ba9497ef4
I20250830 07:54:59.150746 13481 raft_consensus.cc:2466] T 2c4c3c61cddf42668d3a09f4fbc5f641 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 1.
I20250830 07:54:59.153673 13476 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "63168840534246b59a2fdbfdfeebff47" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:54:59.153707 13488 raft_consensus.cc:2466] T 66432e73deea433d9df565d5fcace647 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 1.
I20250830 07:54:59.155257 13610 raft_consensus.cc:3058] T 52e910677ae34630a919d1d3f21b7e83 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:59.163601 13619 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "5e2da5434e95445aa4deafce7fde0c6c" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:59.172830 13882 tablet_bootstrap.cc:492] T db7144b25ff34bed8c7b779ba9497ef4 P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:54:59.173102 13882 ts_tablet_manager.cc:1397] T db7144b25ff34bed8c7b779ba9497ef4 P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.111s user 0.004s sys 0.000s
I20250830 07:54:59.175407 13882 raft_consensus.cc:357] T db7144b25ff34bed8c7b779ba9497ef4 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
W20250830 07:54:59.177431 13423 leader_election.cc:343] T 4b9d9d4b65964fd49d8e25092a14d774 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
W20250830 07:54:59.178368 13423 leader_election.cc:343] T 50dfc24a0b9645e4860cd99b1df3bd61 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:59.178568 13232 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_eab1ec5993724f5f91d9142cadf74eb8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:59.178742 13423 leader_election.cc:343] T 0d16bc64dd6e43f7ba313b77c2bbb728 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
W20250830 07:54:59.179235 13232 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_eab1ec5993724f5f91d9142cadf74eb8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:59.179418 13476 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "c56e3a30c18640e68c8b0c4ff4251d96" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba"
I20250830 07:54:59.179561 13476 raft_consensus.cc:3058] T c56e3a30c18640e68c8b0c4ff4251d96 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:59.182376 13476 raft_consensus.cc:2466] T c56e3a30c18640e68c8b0c4ff4251d96 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 1.
I20250830 07:54:59.191246 13488 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "2f3bec2c98574a9393e0fae77e228ce0" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba"
I20250830 07:54:59.191421 13488 raft_consensus.cc:3058] T 2f3bec2c98574a9393e0fae77e228ce0 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:59.194072 13488 raft_consensus.cc:2466] T 2f3bec2c98574a9393e0fae77e228ce0 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 1.
I20250830 07:54:59.195143 13229 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_49bd55e70bf04b10911684d27ea45407"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:59.195714 13229 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_49bd55e70bf04b10911684d27ea45407 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250830 07:54:59.199112 13703 consensus_peers.cc:489] T 15f8fd7d9e6242c6b6c51251d618ef09 P 9b057ade5dce45af9f8bf0bedf8b917f -> Peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Couldn't send request to peer 6b5e454d98894637b466ea27f1b647f9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20250830 07:54:59.200085 13886 tablet_bootstrap.cc:492] T 1fee3e58f31b4befa42ffbb8d7bd6f4e P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:54:59.200263 13886 ts_tablet_manager.cc:1397] T 1fee3e58f31b4befa42ffbb8d7bd6f4e P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.283s user 0.033s sys 0.039s
W20250830 07:54:59.200906 13703 leader_election.cc:343] T 5e2da5434e95445aa4deafce7fde0c6c P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:59.201067 13886 raft_consensus.cc:357] T 1fee3e58f31b4befa42ffbb8d7bd6f4e P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:59.201236 13886 raft_consensus.cc:383] T 1fee3e58f31b4befa42ffbb8d7bd6f4e P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:59.201308 13886 raft_consensus.cc:738] T 1fee3e58f31b4befa42ffbb8d7bd6f4e P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
W20250830 07:54:59.201256 13703 consensus_peers.cc:489] T f332d1b56d924c91a79cf6572dea1cd2 P 9b057ade5dce45af9f8bf0bedf8b917f -> Peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Couldn't send request to peer 6b5e454d98894637b466ea27f1b647f9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20250830 07:54:59.201609 13886 consensus_queue.cc:260] T 1fee3e58f31b4befa42ffbb8d7bd6f4e P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:59.203130 13886 ts_tablet_manager.cc:1428] T 1fee3e58f31b4befa42ffbb8d7bd6f4e P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20250830 07:54:59.203513 13886 tablet_bootstrap.cc:492] T 1db4109dc43b489d89c5de9eeb64a771 P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:54:59.206146 13886 tablet_bootstrap.cc:654] T 1db4109dc43b489d89c5de9eeb64a771 P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:59.210740 13226 catalog_manager.cc:5582] T 5fee48de90014f94b796e726a4d16b85 P 9b057ade5dce45af9f8bf0bedf8b917f reported cstate change: term changed from 0 to 1, leader changed from <none> to 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3). New cstate: current_term: 1 leader_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } health_report { overall_health: HEALTHY } } }
I20250830 07:54:59.211723 13480 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "52df62f7f1aa4b38be89f6198cf01f24" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:54:59.211966 13480 raft_consensus.cc:2466] T 52df62f7f1aa4b38be89f6198cf01f24 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 0.
I20250830 07:54:59.212240 13476 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "ed364f03bdad42b88e181b7d0e1e4011" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba"
I20250830 07:54:59.212426 13476 raft_consensus.cc:3058] T ed364f03bdad42b88e181b7d0e1e4011 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:59.212944 13887 tablet_bootstrap.cc:492] T 135d754d83ad422eb05909d2daa19d34 P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:54:59.213088 13887 ts_tablet_manager.cc:1397] T 135d754d83ad422eb05909d2daa19d34 P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.329s user 0.005s sys 0.000s
I20250830 07:54:59.213871 13887 raft_consensus.cc:357] T 135d754d83ad422eb05909d2daa19d34 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:59.214036 13887 raft_consensus.cc:383] T 135d754d83ad422eb05909d2daa19d34 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:59.214092 13887 raft_consensus.cc:738] T 135d754d83ad422eb05909d2daa19d34 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:54:59.214278 13887 consensus_queue.cc:260] T 135d754d83ad422eb05909d2daa19d34 P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:59.214745 13887 ts_tablet_manager.cc:1428] T 135d754d83ad422eb05909d2daa19d34 P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20250830 07:54:59.216739 13476 raft_consensus.cc:2466] T ed364f03bdad42b88e181b7d0e1e4011 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 1.
I20250830 07:54:59.223289 13227 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_33e2adea11d84d4ab06f5324807687ca" } modify_external_catalogs: true
I20250830 07:54:59.223479 13227 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_33e2adea11d84d4ab06f5324807687ca" } modify_external_catalogs: true
I20250830 07:54:59.227011 13480 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "8c01157324ba45bda5b3a9a328bf319b" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:54:59.227200 13480 raft_consensus.cc:2466] T 8c01157324ba45bda5b3a9a328bf319b P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 0.
I20250830 07:54:59.234755 13887 tablet_bootstrap.cc:492] T dcb8b326dbec4d40af26b4f143157468 P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:54:59.175916 13882 raft_consensus.cc:383] T db7144b25ff34bed8c7b779ba9497ef4 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:59.238845 13882 raft_consensus.cc:738] T db7144b25ff34bed8c7b779ba9497ef4 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:54:59.239312 13882 consensus_queue.cc:260] T db7144b25ff34bed8c7b779ba9497ef4 P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:59.240823 13882 ts_tablet_manager.cc:1428] T db7144b25ff34bed8c7b779ba9497ef4 P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.068s user 0.003s sys 0.000s
I20250830 07:54:59.242617 13886 tablet_bootstrap.cc:492] T 1db4109dc43b489d89c5de9eeb64a771 P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:54:59.242753 13886 ts_tablet_manager.cc:1397] T 1db4109dc43b489d89c5de9eeb64a771 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.039s user 0.004s sys 0.000s
I20250830 07:54:59.243521 13886 raft_consensus.cc:357] T 1db4109dc43b489d89c5de9eeb64a771 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:59.243685 13886 raft_consensus.cc:383] T 1db4109dc43b489d89c5de9eeb64a771 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:59.243758 13886 raft_consensus.cc:738] T 1db4109dc43b489d89c5de9eeb64a771 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:54:59.243969 13886 consensus_queue.cc:260] T 1db4109dc43b489d89c5de9eeb64a771 P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:59.244596 13886 ts_tablet_manager.cc:1428] T 1db4109dc43b489d89c5de9eeb64a771 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20250830 07:54:59.244838 13886 tablet_bootstrap.cc:492] T e74a3e4b3b234c41aca30f772525652e P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:54:59.246500 13886 tablet_bootstrap.cc:654] T e74a3e4b3b234c41aca30f772525652e P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:59.246755 13480 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "5e2da5434e95445aa4deafce7fde0c6c" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:54:59.247040 13480 raft_consensus.cc:2466] T 5e2da5434e95445aa4deafce7fde0c6c P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 0.
I20250830 07:54:59.267486 13475 raft_consensus.cc:1273] T 49165f0001044d72b68263a60ef56457 P 2065c332f15a4739899af79f3669c3ba [term 2 FOLLOWER]: Refusing update from remote peer 9b057ade5dce45af9f8bf0bedf8b917f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20250830 07:54:59.286335 13701 leader_election.cc:304] T ddedd1f141c147c69f178c6cd2b287da P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:54:59.286749 15608 raft_consensus.cc:2802] T ddedd1f141c147c69f178c6cd2b287da P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election won for term 1
I20250830 07:54:59.286870 15608 raft_consensus.cc:695] T ddedd1f141c147c69f178c6cd2b287da P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 LEADER]: Becoming Leader. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Running, Role: LEADER
I20250830 07:54:59.287111 15608 consensus_queue.cc:237] T ddedd1f141c147c69f178c6cd2b287da P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:59.290648 15919 raft_consensus.cc:491] T f479eef0171c401bbd27beec4486a8b2 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:59.290752 15977 consensus_queue.cc:1035] T f332d1b56d924c91a79cf6572dea1cd2 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:54:59.290812 15919 raft_consensus.cc:513] T f479eef0171c401bbd27beec4486a8b2 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:59.291476 15919 leader_election.cc:290] T f479eef0171c401bbd27beec4486a8b2 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:59.291982 13610 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f479eef0171c401bbd27beec4486a8b2" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
W20250830 07:54:59.292353 13423 leader_election.cc:343] T f479eef0171c401bbd27beec4486a8b2 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:59.292697 15919 raft_consensus.cc:491] T 6720d2b945814305845beea0a2cb9912 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:59.292798 15919 raft_consensus.cc:513] T 6720d2b945814305845beea0a2cb9912 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:59.293165 13228 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_8c40d8b3c1954af7bf6a42fdf4dbacf3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250830 07:54:59.293314 15919 leader_election.cc:290] T 6720d2b945814305845beea0a2cb9912 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
W20250830 07:54:59.293740 13228 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8c40d8b3c1954af7bf6a42fdf4dbacf3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:59.293807 13610 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "6720d2b945814305845beea0a2cb9912" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
W20250830 07:54:59.294145 13423 leader_election.cc:343] T 6720d2b945814305845beea0a2cb9912 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:59.296681 13610 raft_consensus.cc:3058] T 0208de98277c4d6889fb0289b6013ae1 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:59.298241 13701 leader_election.cc:304] T 3d9c884ac05e44ddb59f96588fdd6f4b P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:54:59.298810 15481 raft_consensus.cc:2802] T 3d9c884ac05e44ddb59f96588fdd6f4b P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:54:59.298882 15481 raft_consensus.cc:491] T 3d9c884ac05e44ddb59f96588fdd6f4b P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:54:59.298933 15481 raft_consensus.cc:3058] T 3d9c884ac05e44ddb59f96588fdd6f4b P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:59.299497 13701 leader_election.cc:304] T 2c4c3c61cddf42668d3a09f4fbc5f641 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:54:59.299923 15748 raft_consensus.cc:2802] T 2c4c3c61cddf42668d3a09f4fbc5f641 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election won for term 1
I20250830 07:54:59.300029 15748 raft_consensus.cc:695] T 2c4c3c61cddf42668d3a09f4fbc5f641 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 LEADER]: Becoming Leader. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Running, Role: LEADER
I20250830 07:54:59.300222 15748 consensus_queue.cc:237] T 2c4c3c61cddf42668d3a09f4fbc5f641 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
W20250830 07:54:59.300824 13231 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet c02c939d49f8401fadebec20d41110d1 has no consensus state
I20250830 07:54:59.301446 15481 raft_consensus.cc:513] T 3d9c884ac05e44ddb59f96588fdd6f4b P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:59.302234 15481 leader_election.cc:290] T 3d9c884ac05e44ddb59f96588fdd6f4b P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Requested vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
I20250830 07:54:59.304714 13624 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "3d9c884ac05e44ddb59f96588fdd6f4b" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9"
W20250830 07:54:59.305119 13703 leader_election.cc:343] T 3d9c884ac05e44ddb59f96588fdd6f4b P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:59.311209 13231 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_7d95a1573c0d43d4a49d3c0c53765ed5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:59.311831 13231 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7d95a1573c0d43d4a49d3c0c53765ed5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:59.313568 15981 consensus_queue.cc:1035] T e72402ca3cdf452fa8f4534c67226253 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20250830 07:54:59.314119 13701 leader_election.cc:343] T 63168840534246b59a2fdbfdfeebff47 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:59.318800 13234 catalog_manager.cc:5864] Not sending DeleteTablet requests; no consensus state for tablet e2b9fe3a4dc042e8b0c951a42c98dee6
W20250830 07:54:59.318785 13422 leader_election.cc:343] T 55bd3f378b854476a24f657f5e23843d P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:59.318878 13422 leader_election.cc:304] T 55bd3f378b854476a24f657f5e23843d P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba; no voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:54:59.319078 15919 raft_consensus.cc:2747] T 55bd3f378b854476a24f657f5e23843d P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20250830 07:54:59.320107 13422 leader_election.cc:343] T b2248b305c9f448a9e30661142ad10ea P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:59.320344 13422 leader_election.cc:304] T b2248b305c9f448a9e30661142ad10ea P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba; no voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:54:59.320611 15919 raft_consensus.cc:2747] T b2248b305c9f448a9e30661142ad10ea P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:54:59.321656 13882 tablet_bootstrap.cc:492] T 76ab56c469cf4675a4e21acbe0a8085d P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:54:59.322474 13422 leader_election.cc:304] T 2c31d119743f49589703c434ac6c7548 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:54:59.322980 15919 raft_consensus.cc:2802] T 2c31d119743f49589703c434ac6c7548 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election won for term 1
I20250830 07:54:59.323179 15919 raft_consensus.cc:695] T 2c31d119743f49589703c434ac6c7548 P 2065c332f15a4739899af79f3669c3ba [term 1 LEADER]: Becoming Leader. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Running, Role: LEADER
I20250830 07:54:59.323434 15919 consensus_queue.cc:237] T 2c31d119743f49589703c434ac6c7548 P 2065c332f15a4739899af79f3669c3ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:59.325111 13882 tablet_bootstrap.cc:654] T 76ab56c469cf4675a4e21acbe0a8085d P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:59.326705 13234 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_8ca7c45065074297b278827e54b4d888"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:59.327207 13234 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8ca7c45065074297b278827e54b4d888 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:59.329334 13629 raft_consensus.cc:1273] T 49165f0001044d72b68263a60ef56457 P 6b5e454d98894637b466ea27f1b647f9 [term 2 FOLLOWER]: Refusing update from remote peer 9b057ade5dce45af9f8bf0bedf8b917f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20250830 07:54:59.333422 13422 leader_election.cc:304] T 2e63eac2579844ef83bf43f1e6d58634 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:54:59.334237 15999 raft_consensus.cc:2802] T 2e63eac2579844ef83bf43f1e6d58634 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election won for term 1
I20250830 07:54:59.334334 15999 raft_consensus.cc:695] T 2e63eac2579844ef83bf43f1e6d58634 P 2065c332f15a4739899af79f3669c3ba [term 1 LEADER]: Becoming Leader. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Running, Role: LEADER
I20250830 07:54:59.334534 15999 consensus_queue.cc:237] T 2e63eac2579844ef83bf43f1e6d58634 P 2065c332f15a4739899af79f3669c3ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:59.322038 13766 raft_consensus.cc:1273] T c8bc6e07377a4ba99c39a909dae11402 P 9b057ade5dce45af9f8bf0bedf8b917f [term 2 FOLLOWER]: Refusing update from remote peer 6b5e454d98894637b466ea27f1b647f9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 1. (term mismatch)
I20250830 07:54:59.335685 13766 pending_rounds.cc:85] T c8bc6e07377a4ba99c39a909dae11402 P 9b057ade5dce45af9f8bf0bedf8b917f: Aborting all ops after (but not including) 0
I20250830 07:54:59.335749 13766 pending_rounds.cc:107] T c8bc6e07377a4ba99c39a909dae11402 P 9b057ade5dce45af9f8bf0bedf8b917f: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20250830 07:54:59.335714 13701 leader_election.cc:304] T 63168840534246b59a2fdbfdfeebff47 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 2065c332f15a4739899af79f3669c3ba, 6b5e454d98894637b466ea27f1b647f9
I20250830 07:54:59.335806 13766 raft_consensus.cc:2887] T c8bc6e07377a4ba99c39a909dae11402 P 9b057ade5dce45af9f8bf0bedf8b917f [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20250830 07:54:59.335942 15981 raft_consensus.cc:2747] T 63168840534246b59a2fdbfdfeebff47 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:54:59.336305 13701 leader_election.cc:304] T 66432e73deea433d9df565d5fcace647 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:54:59.336526 15981 raft_consensus.cc:2802] T 66432e73deea433d9df565d5fcace647 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election won for term 1
I20250830 07:54:59.336624 15981 raft_consensus.cc:695] T 66432e73deea433d9df565d5fcace647 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 LEADER]: Becoming Leader. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Running, Role: LEADER
I20250830 07:54:59.336831 15981 consensus_queue.cc:237] T 66432e73deea433d9df565d5fcace647 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:59.329701 15481 consensus_queue.cc:1035] T 49165f0001044d72b68263a60ef56457 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:54:59.341452 13233 catalog_manager.cc:5864] Not sending DeleteTablet requests; no consensus state for tablet c869ea25de1d41d3af0a5cb8afc56a1c
I20250830 07:54:59.341660 13233 master_service.cc:948] ReplaceTablet: received request to replace tablet ee44ab24333742909f773889ad5c3e00 from {username='slave'} at 127.0.0.1:42126
I20250830 07:54:59.344543 15995 consensus_queue.cc:1035] T c8bc6e07377a4ba99c39a909dae11402 P 6b5e454d98894637b466ea27f1b647f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:54:59.345032 13887 tablet_bootstrap.cc:700] T dcb8b326dbec4d40af26b4f143157468 P 2065c332f15a4739899af79f3669c3ba: Time spent opening tablet: real 0.107s user 0.000s sys 0.000s
I20250830 07:54:59.345690 15977 consensus_queue.cc:1035] T 15f8fd7d9e6242c6b6c51251d618ef09 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:54:59.345748 13887 tablet_bootstrap.cc:654] T dcb8b326dbec4d40af26b4f143157468 P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:59.346276 15977 consensus_queue.cc:1035] T 2b4103f07e96490488913059a95af0c3 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:54:59.347447 13701 leader_election.cc:304] T c56e3a30c18640e68c8b0c4ff4251d96 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:54:59.347663 15977 raft_consensus.cc:2802] T c56e3a30c18640e68c8b0c4ff4251d96 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election won for term 1
I20250830 07:54:59.347846 15977 raft_consensus.cc:695] T c56e3a30c18640e68c8b0c4ff4251d96 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 LEADER]: Becoming Leader. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Running, Role: LEADER
I20250830 07:54:59.347949 13233 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_6dfb547b0bba43cc8d888ac8b737a808" } new_table_name: "default.Table_3957e612bff14ea8a255033ea7e0c5ca" modify_external_catalogs: true
I20250830 07:54:59.348084 15977 consensus_queue.cc:237] T c56e3a30c18640e68c8b0c4ff4251d96 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:59.366557 13701 leader_election.cc:304] T 2f3bec2c98574a9393e0fae77e228ce0 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:54:59.367017 15720 raft_consensus.cc:2802] T 2f3bec2c98574a9393e0fae77e228ce0 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election won for term 1
I20250830 07:54:59.367132 15720 raft_consensus.cc:695] T 2f3bec2c98574a9393e0fae77e228ce0 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 LEADER]: Becoming Leader. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Running, Role: LEADER
I20250830 07:54:59.367333 15720 consensus_queue.cc:237] T 2f3bec2c98574a9393e0fae77e228ce0 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
W20250830 07:54:59.368553 13230 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ff49b6da031a4ad792a9f3af7680bee2 has no consensus state
I20250830 07:54:59.374811 13230 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_dc6cbe0df3e54f26a96f0b91dcec8d56" } modify_external_catalogs: true
I20250830 07:54:59.375037 13230 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_dc6cbe0df3e54f26a96f0b91dcec8d56" } modify_external_catalogs: true
I20250830 07:54:59.380106 13476 raft_consensus.cc:1273] T c8bc6e07377a4ba99c39a909dae11402 P 2065c332f15a4739899af79f3669c3ba [term 2 FOLLOWER]: Refusing update from remote peer 6b5e454d98894637b466ea27f1b647f9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20250830 07:54:59.380800 15995 consensus_queue.cc:1035] T c8bc6e07377a4ba99c39a909dae11402 P 6b5e454d98894637b466ea27f1b647f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:54:59.381539 13701 leader_election.cc:304] T 52df62f7f1aa4b38be89f6198cf01f24 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:54:59.381858 13701 leader_election.cc:304] T ed364f03bdad42b88e181b7d0e1e4011 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:54:59.382153 15863 raft_consensus.cc:2802] T 52df62f7f1aa4b38be89f6198cf01f24 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:54:59.382236 15863 raft_consensus.cc:491] T 52df62f7f1aa4b38be89f6198cf01f24 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:54:59.382299 15863 raft_consensus.cc:3058] T 52df62f7f1aa4b38be89f6198cf01f24 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:59.382472 13701 leader_election.cc:304] T 8c01157324ba45bda5b3a9a328bf319b P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:54:59.383205 15601 consensus_queue.cc:1035] T 579324e1f6474d398db10da3093650dd P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:54:59.383538 15601 raft_consensus.cc:2802] T 8c01157324ba45bda5b3a9a328bf319b P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:54:59.383605 15601 raft_consensus.cc:491] T 8c01157324ba45bda5b3a9a328bf319b P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:54:59.383661 15601 raft_consensus.cc:3058] T 8c01157324ba45bda5b3a9a328bf319b P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:59.384907 15863 raft_consensus.cc:513] T 52df62f7f1aa4b38be89f6198cf01f24 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:59.385524 15863 leader_election.cc:290] T 52df62f7f1aa4b38be89f6198cf01f24 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Requested vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
I20250830 07:54:59.385617 13225 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_3e502a4a3fdb4a9a853e5972df56090d" } new_table_name: "default.Table_aaad8e1de05c4437bf0c9b9fd46e0206" modify_external_catalogs: true
I20250830 07:54:59.386722 15601 raft_consensus.cc:513] T 8c01157324ba45bda5b3a9a328bf319b P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:59.387193 15601 leader_election.cc:290] T 8c01157324ba45bda5b3a9a328bf319b P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Requested vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
I20250830 07:54:59.387533 15481 raft_consensus.cc:2802] T ed364f03bdad42b88e181b7d0e1e4011 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election won for term 1
I20250830 07:54:59.387750 15481 raft_consensus.cc:695] T ed364f03bdad42b88e181b7d0e1e4011 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 LEADER]: Becoming Leader. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Running, Role: LEADER
I20250830 07:54:59.388031 15481 consensus_queue.cc:237] T ed364f03bdad42b88e181b7d0e1e4011 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:59.396059 15980 raft_consensus.cc:491] T 0ac39adafe144280b39f5c3fe5804087 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:59.396252 15980 raft_consensus.cc:513] T 0ac39adafe144280b39f5c3fe5804087 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:59.397239 15980 leader_election.cc:290] T 0ac39adafe144280b39f5c3fe5804087 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
I20250830 07:54:59.397639 13629 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "52df62f7f1aa4b38be89f6198cf01f24" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9"
I20250830 07:54:59.399062 13887 tablet_bootstrap.cc:492] T dcb8b326dbec4d40af26b4f143157468 P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:54:59.399216 13887 ts_tablet_manager.cc:1397] T dcb8b326dbec4d40af26b4f143157468 P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.165s user 0.005s sys 0.000s
I20250830 07:54:59.400087 13887 raft_consensus.cc:357] T dcb8b326dbec4d40af26b4f143157468 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:59.400283 13887 raft_consensus.cc:383] T dcb8b326dbec4d40af26b4f143157468 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:59.400348 13887 raft_consensus.cc:738] T dcb8b326dbec4d40af26b4f143157468 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:54:59.400568 13887 consensus_queue.cc:260] T dcb8b326dbec4d40af26b4f143157468 P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:59.406257 13232 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_c84716cd62b9446384ad71e0503211db" } new_table_name: "default.Table_4f90011601b14b80886efa9f076dd01b" modify_external_catalogs: true
W20250830 07:54:59.410123 13703 leader_election.cc:343] T 52df62f7f1aa4b38be89f6198cf01f24 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:59.415382 13624 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "8c01157324ba45bda5b3a9a328bf319b" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9"
W20250830 07:54:59.415922 13703 leader_election.cc:343] T 8c01157324ba45bda5b3a9a328bf319b P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:59.416251 13624 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "0ac39adafe144280b39f5c3fe5804087" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
W20250830 07:54:59.417273 15746 lock_manager.cc:585] Waited 3 seconds to obtain row lock on key '<redacted>' (key hash 4012713805250960239) tablet 00000000000000000000000000000000 cur holder 0x61700003a700
W20250830 07:54:59.418139 13703 leader_election.cc:343] T 0ac39adafe144280b39f5c3fe5804087 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
W20250830 07:54:59.428822 13229 catalog_manager.cc:5415] Ignoring report from unknown tablet b4ab964a64a64e00a78ffd2b220aef46
W20250830 07:54:59.429194 13229 catalog_manager.cc:5415] Ignoring report from unknown tablet ee44ab24333742909f773889ad5c3e00
W20250830 07:54:59.429415 13229 catalog_manager.cc:5415] Ignoring report from unknown tablet 852e353f6ee945628ddebdbdd1bd76fb
W20250830 07:54:59.429575 13229 catalog_manager.cc:5415] Ignoring report from unknown tablet db7144b25ff34bed8c7b779ba9497ef4
I20250830 07:54:59.441803 13229 catalog_manager.cc:5674] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325) does not have the latest schema for tablet 135d754d83ad422eb05909d2daa19d34 (table default.Table_37ef227a5b7f40adb4d95830ed70af2b [id=dc7b513bb4204424b5b292e5751f5fa6]). Expected version 3 got 0
W20250830 07:54:59.444152 13129 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerService.ListTablets -> {remote=127.12.209.2:38967, user_credentials={real_user=slave}} blocked reactor thread for 181945us
I20250830 07:54:59.455742 13226 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_456a93d36cbe4e58a192a0c6bc9518fa" } modify_external_catalogs: true
I20250830 07:54:59.456308 13226 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_456a93d36cbe4e58a192a0c6bc9518fa" } modify_external_catalogs: true
I20250830 07:54:59.461867 13887 ts_tablet_manager.cc:1428] T dcb8b326dbec4d40af26b4f143157468 P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.063s user 0.002s sys 0.000s
I20250830 07:54:59.462370 13887 tablet_bootstrap.cc:492] T af449cc407c046eeb5cdfdacffc617a4 P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:54:59.464869 13882 tablet_bootstrap.cc:492] T 76ab56c469cf4675a4e21acbe0a8085d P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:54:59.465065 13882 ts_tablet_manager.cc:1397] T 76ab56c469cf4675a4e21acbe0a8085d P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.224s user 0.004s sys 0.000s
I20250830 07:54:59.466035 13882 raft_consensus.cc:357] T 76ab56c469cf4675a4e21acbe0a8085d P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:59.466563 13882 raft_consensus.cc:383] T 76ab56c469cf4675a4e21acbe0a8085d P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:59.466691 13882 raft_consensus.cc:738] T 76ab56c469cf4675a4e21acbe0a8085d P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:54:59.467164 13882 consensus_queue.cc:260] T 76ab56c469cf4675a4e21acbe0a8085d P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:59.468876 13882 ts_tablet_manager.cc:1428] T 76ab56c469cf4675a4e21acbe0a8085d P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.004s user 0.000s sys 0.002s
I20250830 07:54:59.470441 13229 master_service.cc:948] ReplaceTablet: received request to replace tablet adbacbbb13d840a29d8d7d08ea04f6b1 from {username='slave'} at 127.0.0.1:42126
I20250830 07:54:59.475530 13227 catalog_manager.cc:5864] Not sending DeleteTablet requests; no consensus state for tablet f24a1f78c6b045fea186f02c84ef621b
I20250830 07:54:59.475834 13227 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_edc1c683d97e4ecfa7f524cdc05b14b3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:59.476428 13227 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_edc1c683d97e4ecfa7f524cdc05b14b3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:59.483587 13228 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_891301557487433ab5bdc769ebd1ce73"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:59.484118 13228 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_891301557487433ab5bdc769ebd1ce73 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:59.518389 13887 tablet_bootstrap.cc:654] T af449cc407c046eeb5cdfdacffc617a4 P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:59.525175 13882 tablet_bootstrap.cc:492] T 5e2da5434e95445aa4deafce7fde0c6c P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:54:59.527880 13882 tablet_bootstrap.cc:654] T 5e2da5434e95445aa4deafce7fde0c6c P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
W20250830 07:54:59.530133 16023 log.cc:927] Time spent T 2f3bec2c98574a9393e0fae77e228ce0 P 9b057ade5dce45af9f8bf0bedf8b917f: Append to log took a long time: real 0.052s user 0.000s sys 0.000s
I20250830 07:54:59.530609 13231 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_64516d91053b45a9a63f3ab3a61a5392"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:59.531236 13231 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_64516d91053b45a9a63f3ab3a61a5392 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:59.538733 13234 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_42511bf509944c79a3eb198bb38f5c87"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:59.539250 13234 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_42511bf509944c79a3eb198bb38f5c87 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:59.554056 15999 raft_consensus.cc:491] T 135d754d83ad422eb05909d2daa19d34 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:59.554335 15999 raft_consensus.cc:513] T 135d754d83ad422eb05909d2daa19d34 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:59.556288 13624 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "135d754d83ad422eb05909d2daa19d34" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:59.556339 15999 leader_election.cc:290] T 135d754d83ad422eb05909d2daa19d34 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
W20250830 07:54:59.556727 13423 leader_election.cc:343] T 135d754d83ad422eb05909d2daa19d34 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
W20250830 07:54:59.569512 13233 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 0e65ecea1f3a408cb1cdc55ce7495ad0 has no consensus state
W20250830 07:54:59.585059 13233 catalog_manager.cc:5415] Ignoring report from unknown tablet 2c31d119743f49589703c434ac6c7548
I20250830 07:54:59.585800 13233 catalog_manager.cc:5582] T c8bc6e07377a4ba99c39a909dae11402 P 2065c332f15a4739899af79f3669c3ba reported cstate change: term changed from 1 to 2, leader changed from 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3) to 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2). New cstate: current_term: 2 leader_uuid: "6b5e454d98894637b466ea27f1b647f9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } }
I20250830 07:54:59.586627 13233 catalog_manager.cc:5674] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325) does not have the latest schema for tablet c8bc6e07377a4ba99c39a909dae11402 (table default.Table_f9379201a5de4169a46eeb2ff2cc0ac7 [id=dce926f371dd4b4ba61511c14d245622]). Expected version 2 got 0
I20250830 07:54:59.586889 13233 catalog_manager.cc:5674] TS 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325) does not have the latest schema for tablet dcb8b326dbec4d40af26b4f143157468 (table default.Table_1e1d43a415824a4788e1de36139d2cfd [id=6af7c90adabf47c9a41d01c9d3f40642]). Expected version 1 got 0
I20250830 07:54:59.592041 13887 tablet_bootstrap.cc:492] T af449cc407c046eeb5cdfdacffc617a4 P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:54:59.593312 13887 ts_tablet_manager.cc:1397] T af449cc407c046eeb5cdfdacffc617a4 P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.131s user 0.003s sys 0.002s
I20250830 07:54:59.617532 15999 raft_consensus.cc:491] T 0c70140d87d34bde919714f08a5c94d4 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:59.617650 15999 raft_consensus.cc:513] T 0c70140d87d34bde919714f08a5c94d4 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:59.618230 15999 leader_election.cc:290] T 0c70140d87d34bde919714f08a5c94d4 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:59.610333 13887 raft_consensus.cc:357] T af449cc407c046eeb5cdfdacffc617a4 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
W20250830 07:54:59.619135 13701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.209.1:45325, user_credentials={real_user=slave}} blocked reactor thread for 236302us
I20250830 07:54:59.619881 13230 catalog_manager.cc:5864] Not sending DeleteTablet requests; no consensus state for tablet a1a275aa324f43cc9e362843d087e303
I20250830 07:54:59.620826 13701 leader_election.cc:304] T 5e2da5434e95445aa4deafce7fde0c6c P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:54:59.621505 13230 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_d27f0b8130714af9bd399f246ad2c7d4" } new_table_name: "default.Table_cb7e61ad3b5141c9967497b29c213e2d" modify_external_catalogs: true
I20250830 07:54:59.621272 13887 raft_consensus.cc:383] T af449cc407c046eeb5cdfdacffc617a4 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20250830 07:54:59.623133 13225 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 9b253abcf32748829795dffb16d13545 has no consensus state
I20250830 07:54:59.623193 13887 raft_consensus.cc:738] T af449cc407c046eeb5cdfdacffc617a4 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:54:59.623386 13887 consensus_queue.cc:260] T af449cc407c046eeb5cdfdacffc617a4 P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:59.623427 13225 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_6ab42a2c7c944a0097217325de9c9c56" } modify_external_catalogs: true
I20250830 07:54:59.623566 13225 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_6ab42a2c7c944a0097217325de9c9c56" } modify_external_catalogs: true
I20250830 07:54:59.623862 13887 ts_tablet_manager.cc:1428] T af449cc407c046eeb5cdfdacffc617a4 P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.029s user 0.001s sys 0.001s
I20250830 07:54:59.624138 13887 tablet_bootstrap.cc:492] T a36f38ada7314165a5e9d6ee7bbf69e3 P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
W20250830 07:54:59.624392 14988 leader_election.cc:336] T 00000000000000000000000000000000 P 3ea183a890b84f408b20b55e9eb7c7ed [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 5e9d6449ae824acab24c459a72075e88 (127.12.209.61:44241): Timed out: connection negotiation to 127.12.209.61:44241 for RPC RequestConsensusVote timed out after 0.747s (ON_OUTBOUND_QUEUE)
I20250830 07:54:59.624557 13624 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "0c70140d87d34bde919714f08a5c94d4" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:59.624607 14988 leader_election.cc:304] T 00000000000000000000000000000000 P 3ea183a890b84f408b20b55e9eb7c7ed [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ea183a890b84f408b20b55e9eb7c7ed; no voters: 5e9d6449ae824acab24c459a72075e88, fea6152429cc4e79a25b18e02aafae57
I20250830 07:54:59.627015 15601 raft_consensus.cc:2802] T 5e2da5434e95445aa4deafce7fde0c6c P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:54:59.627089 15601 raft_consensus.cc:491] T 5e2da5434e95445aa4deafce7fde0c6c P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:54:59.627144 15601 raft_consensus.cc:3058] T 5e2da5434e95445aa4deafce7fde0c6c P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:59.629586 15601 raft_consensus.cc:513] T 5e2da5434e95445aa4deafce7fde0c6c P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:59.630138 15601 leader_election.cc:290] T 5e2da5434e95445aa4deafce7fde0c6c P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Requested vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967)
W20250830 07:54:59.630154 13423 leader_election.cc:343] T 0c70140d87d34bde919714f08a5c94d4 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:59.630722 13610 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "5e2da5434e95445aa4deafce7fde0c6c" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9"
W20250830 07:54:59.631207 13703 leader_election.cc:343] T 5e2da5434e95445aa4deafce7fde0c6c P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
W20250830 07:54:59.631551 13703 consensus_peers.cc:489] T 208995abd6d44dbea3b5ebbea27d6a39 P 9b057ade5dce45af9f8bf0bedf8b917f -> Peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Couldn't send request to peer 6b5e454d98894637b466ea27f1b647f9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20250830 07:54:59.633302 16033 raft_consensus.cc:2747] T 00000000000000000000000000000000 P 3ea183a890b84f408b20b55e9eb7c7ed [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20250830 07:54:59.638113 13232 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet c08d370cd76c495ebc108a340f5e5be8 has no consensus state
I20250830 07:54:59.641897 15582 raft_consensus.cc:491] T 76ab56c469cf4675a4e21acbe0a8085d P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:59.641943 15748 raft_consensus.cc:491] T fbb1cc8f8eea4a0795f6f8e213b8180f P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:59.642010 15582 raft_consensus.cc:513] T 76ab56c469cf4675a4e21acbe0a8085d P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:59.642055 15748 raft_consensus.cc:513] T fbb1cc8f8eea4a0795f6f8e213b8180f P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:59.642607 15582 leader_election.cc:290] T 76ab56c469cf4675a4e21acbe0a8085d P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:59.642625 15748 leader_election.cc:290] T fbb1cc8f8eea4a0795f6f8e213b8180f P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
I20250830 07:54:59.642881 15601 consensus_queue.cc:1035] T 49165f0001044d72b68263a60ef56457 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:54:59.643493 13766 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "76ab56c469cf4675a4e21acbe0a8085d" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:59.643939 13624 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "fbb1cc8f8eea4a0795f6f8e213b8180f" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:59.644269 13765 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "4b9d9d4b65964fd49d8e25092a14d774" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:59.644461 13772 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "50dfc24a0b9645e4860cd99b1df3bd61" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
W20250830 07:54:59.644789 13703 leader_election.cc:343] T fbb1cc8f8eea4a0795f6f8e213b8180f P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:59.644784 13476 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "76ab56c469cf4675a4e21acbe0a8085d" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:54:59.645308 13766 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "0d16bc64dd6e43f7ba313b77c2bbb728" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:59.645677 13561 leader_election.cc:304] T 76ab56c469cf4675a4e21acbe0a8085d P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b5e454d98894637b466ea27f1b647f9; no voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:54:59.646188 15995 raft_consensus.cc:2747] T 76ab56c469cf4675a4e21acbe0a8085d P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:54:59.646281 13774 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f479eef0171c401bbd27beec4486a8b2" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:59.646654 13774 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "6720d2b945814305845beea0a2cb9912" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:59.650844 13226 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet ba4e1fccb8f046d6b63afe67c1f9d538
I20250830 07:54:59.651278 13774 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "135d754d83ad422eb05909d2daa19d34" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:59.651499 13226 master_service.cc:948] ReplaceTablet: received request to replace tablet 0507245aa8c74aeb9f3eafba0682590d from {username='slave'} at 127.0.0.1:42126
I20250830 07:54:59.651851 13226 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_281c6fe95ef0467092591e8fcb80ed46" } modify_external_catalogs: true
I20250830 07:54:59.651997 13226 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_281c6fe95ef0467092591e8fcb80ed46" } modify_external_catalogs: true
I20250830 07:54:59.652366 13774 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "0c70140d87d34bde919714f08a5c94d4" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:59.653380 13602 tablet_service.cc:1515] Processing DeleteTablet for tablet ba4e1fccb8f046d6b63afe67c1f9d538 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:59 UTC) from {username='slave'} at 127.0.0.1:45306
I20250830 07:54:59.654327 13478 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "52df62f7f1aa4b38be89f6198cf01f24" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba"
I20250830 07:54:59.654465 13478 raft_consensus.cc:3058] T 52df62f7f1aa4b38be89f6198cf01f24 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:59.654561 13483 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "8c01157324ba45bda5b3a9a328bf319b" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba"
I20250830 07:54:59.654695 13483 raft_consensus.cc:3058] T 8c01157324ba45bda5b3a9a328bf319b P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:59.654937 13480 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "3d9c884ac05e44ddb59f96588fdd6f4b" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba"
I20250830 07:54:59.655056 13480 raft_consensus.cc:3058] T 3d9c884ac05e44ddb59f96588fdd6f4b P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:59.657514 13483 raft_consensus.cc:2466] T 8c01157324ba45bda5b3a9a328bf319b P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 1.
I20250830 07:54:59.657793 13478 raft_consensus.cc:2466] T 52df62f7f1aa4b38be89f6198cf01f24 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 1.
I20250830 07:54:59.657871 13480 raft_consensus.cc:2466] T 3d9c884ac05e44ddb59f96588fdd6f4b P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 1.
W20250830 07:54:59.658819 13232 catalog_manager.cc:5415] Ignoring report from unknown tablet c56e3a30c18640e68c8b0c4ff4251d96
I20250830 07:54:59.659924 13485 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "0ac39adafe144280b39f5c3fe5804087" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:54:59.660059 13485 raft_consensus.cc:2466] T 0ac39adafe144280b39f5c3fe5804087 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 0.
W20250830 07:54:59.660960 13232 catalog_manager.cc:5415] Ignoring report from unknown tablet 1520d7257f864ea4ba4b9a5d0443f8a7
W20250830 07:54:59.661075 13232 catalog_manager.cc:5415] Ignoring report from unknown tablet e6b7646588fe4134b2db62ff84ca4791
W20250830 07:54:59.661198 13232 catalog_manager.cc:5415] Ignoring report from unknown tablet f398e12cd9f543738d5163354f8a9d9d
W20250830 07:54:59.661283 13232 catalog_manager.cc:5415] Ignoring report from unknown tablet ee44ab24333742909f773889ad5c3e00
W20250830 07:54:59.666047 13232 catalog_manager.cc:5415] Ignoring report from unknown tablet 846338e46b834ae0b5f4e74c7f1325d2
W20250830 07:54:59.666316 13232 catalog_manager.cc:5415] Ignoring report from unknown tablet 1fa571e9490e499792225d7b786e8658
I20250830 07:54:59.671494 13882 tablet_bootstrap.cc:492] T 5e2da5434e95445aa4deafce7fde0c6c P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:54:59.671852 13882 ts_tablet_manager.cc:1397] T 5e2da5434e95445aa4deafce7fde0c6c P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.147s user 0.001s sys 0.003s
I20250830 07:54:59.673951 13882 raft_consensus.cc:357] T 5e2da5434e95445aa4deafce7fde0c6c P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:59.674455 13882 raft_consensus.cc:383] T 5e2da5434e95445aa4deafce7fde0c6c P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:59.674651 13882 raft_consensus.cc:738] T 5e2da5434e95445aa4deafce7fde0c6c P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:54:59.675030 13882 consensus_queue.cc:260] T 5e2da5434e95445aa4deafce7fde0c6c P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:59.675817 13886 tablet_bootstrap.cc:492] T e74a3e4b3b234c41aca30f772525652e P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:54:59.676040 13886 ts_tablet_manager.cc:1397] T e74a3e4b3b234c41aca30f772525652e P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.431s user 0.031s sys 0.044s
W20250830 07:54:59.676318 13220 catalog_manager.cc:4908] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet ba4e1fccb8f046d6b63afe67c1f9d538 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ba4e1fccb8f046d6b63afe67c1f9d538 already in progress: creating tablet
W20250830 07:54:59.683238 13422 leader_election.cc:343] T 4b9d9d4b65964fd49d8e25092a14d774 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:59.683439 13422 leader_election.cc:304] T 4b9d9d4b65964fd49d8e25092a14d774 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba; no voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:54:59.683704 15999 raft_consensus.cc:2747] T 4b9d9d4b65964fd49d8e25092a14d774 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:54:59.684363 13886 raft_consensus.cc:357] T e74a3e4b3b234c41aca30f772525652e P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:59.684535 13886 raft_consensus.cc:383] T e74a3e4b3b234c41aca30f772525652e P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:59.684597 13886 raft_consensus.cc:738] T e74a3e4b3b234c41aca30f772525652e P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
W20250830 07:54:59.684479 13422 leader_election.cc:343] T 50dfc24a0b9645e4860cd99b1df3bd61 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:59.684777 13422 leader_election.cc:304] T 50dfc24a0b9645e4860cd99b1df3bd61 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba; no voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:54:59.684818 13886 consensus_queue.cc:260] T e74a3e4b3b234c41aca30f772525652e P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:59.685022 15999 raft_consensus.cc:2747] T 50dfc24a0b9645e4860cd99b1df3bd61 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:54:59.685627 13886 ts_tablet_manager.cc:1428] T e74a3e4b3b234c41aca30f772525652e P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.009s user 0.001s sys 0.000s
I20250830 07:54:59.686133 13886 tablet_bootstrap.cc:492] T ba4e1fccb8f046d6b63afe67c1f9d538 P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
W20250830 07:54:59.687096 13422 leader_election.cc:343] T 0d16bc64dd6e43f7ba313b77c2bbb728 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:59.687196 13422 leader_election.cc:304] T 0d16bc64dd6e43f7ba313b77c2bbb728 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba; no voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:54:59.687428 15976 raft_consensus.cc:2747] T 0d16bc64dd6e43f7ba313b77c2bbb728 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:54:59.688613 13886 tablet_bootstrap.cc:654] T ba4e1fccb8f046d6b63afe67c1f9d538 P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:59.693369 13882 ts_tablet_manager.cc:1428] T 5e2da5434e95445aa4deafce7fde0c6c P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.021s user 0.002s sys 0.000s
I20250830 07:54:59.693665 13882 tablet_bootstrap.cc:492] T e72402ca3cdf452fa8f4534c67226253 P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:54:59.695812 13887 tablet_bootstrap.cc:654] T a36f38ada7314165a5e9d6ee7bbf69e3 P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:59.702435 15582 raft_consensus.cc:491] T db7144b25ff34bed8c7b779ba9497ef4 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:59.702570 15582 raft_consensus.cc:513] T db7144b25ff34bed8c7b779ba9497ef4 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:59.703171 15582 leader_election.cc:290] T db7144b25ff34bed8c7b779ba9497ef4 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:59.704385 13485 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "db7144b25ff34bed8c7b779ba9497ef4" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:54:59.704852 13886 tablet_bootstrap.cc:492] T ba4e1fccb8f046d6b63afe67c1f9d538 P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:54:59.705003 13886 ts_tablet_manager.cc:1397] T ba4e1fccb8f046d6b63afe67c1f9d538 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.019s user 0.003s sys 0.002s
I20250830 07:54:59.709407 13229 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet adbacbbb13d840a29d8d7d08ea04f6b1
I20250830 07:54:59.710297 13229 catalog_manager.cc:6652] ReplaceTablet: tablet adbacbbb13d840a29d8d7d08ea04f6b1 deleted and replaced by tablet f44d3077a6ff405f9dc9a7be7aae4752
I20250830 07:54:59.713655 13886 raft_consensus.cc:357] T ba4e1fccb8f046d6b63afe67c1f9d538 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:59.713817 13886 raft_consensus.cc:383] T ba4e1fccb8f046d6b63afe67c1f9d538 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:59.713863 13886 raft_consensus.cc:738] T ba4e1fccb8f046d6b63afe67c1f9d538 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:54:59.714030 13886 consensus_queue.cc:260] T ba4e1fccb8f046d6b63afe67c1f9d538 P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:59.714529 13886 ts_tablet_manager.cc:1428] T ba4e1fccb8f046d6b63afe67c1f9d538 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.009s user 0.001s sys 0.001s
I20250830 07:54:59.714782 13886 tablet_bootstrap.cc:492] T 0c70140d87d34bde919714f08a5c94d4 P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:54:59.716542 13886 tablet_bootstrap.cc:654] T 0c70140d87d34bde919714f08a5c94d4 P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:59.719030 13602 tablet_service.cc:1515] Processing DeleteTablet for tablet adbacbbb13d840a29d8d7d08ea04f6b1 with delete_type TABLET_DATA_DELETED (replaced by tablet f44d3077a6ff405f9dc9a7be7aae4752) from {username='slave'} at 127.0.0.1:45306
I20250830 07:54:59.719556 13764 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "db7144b25ff34bed8c7b779ba9497ef4" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
W20250830 07:54:59.721369 13220 catalog_manager.cc:4908] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet adbacbbb13d840a29d8d7d08ea04f6b1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet adbacbbb13d840a29d8d7d08ea04f6b1 already in progress: creating tablet
I20250830 07:54:59.728930 13562 leader_election.cc:304] T db7144b25ff34bed8c7b779ba9497ef4 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b5e454d98894637b466ea27f1b647f9; no voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:54:59.729193 15995 raft_consensus.cc:2747] T db7144b25ff34bed8c7b779ba9497ef4 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:54:59.731549 13229 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_75c990312c794354a26618c53fa44352" } new_table_name: "default.Table_e840489ab6df4581b107c0351defe717" modify_external_catalogs: true
W20250830 07:54:59.691174 13422 leader_election.cc:343] T f479eef0171c401bbd27beec4486a8b2 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:59.733170 13422 leader_election.cc:304] T f479eef0171c401bbd27beec4486a8b2 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba; no voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:54:59.733649 13886 tablet_bootstrap.cc:492] T 0c70140d87d34bde919714f08a5c94d4 P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
W20250830 07:54:59.733632 13422 leader_election.cc:343] T 6720d2b945814305845beea0a2cb9912 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:59.733723 13422 leader_election.cc:304] T 6720d2b945814305845beea0a2cb9912 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba; no voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:54:59.733848 13886 ts_tablet_manager.cc:1397] T 0c70140d87d34bde919714f08a5c94d4 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.019s user 0.004s sys 0.004s
I20250830 07:54:59.733989 15999 raft_consensus.cc:2747] T f479eef0171c401bbd27beec4486a8b2 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:54:59.734663 13886 raft_consensus.cc:357] T 0c70140d87d34bde919714f08a5c94d4 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:59.734896 13886 raft_consensus.cc:383] T 0c70140d87d34bde919714f08a5c94d4 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:59.735037 13886 raft_consensus.cc:738] T 0c70140d87d34bde919714f08a5c94d4 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:54:59.735329 13886 consensus_queue.cc:260] T 0c70140d87d34bde919714f08a5c94d4 P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:59.735855 13886 ts_tablet_manager.cc:1428] T 0c70140d87d34bde919714f08a5c94d4 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20250830 07:54:59.741917 13227 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_92a43add8b244b8b83d3d6af4ade8834"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:59.742522 13227 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_92a43add8b244b8b83d3d6af4ade8834 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:59.742712 15999 raft_consensus.cc:2747] T 6720d2b945814305845beea0a2cb9912 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:54:59.744460 15976 raft_consensus.cc:491] T 1db4109dc43b489d89c5de9eeb64a771 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:59.744592 15976 raft_consensus.cc:513] T 1db4109dc43b489d89c5de9eeb64a771 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:59.745114 15976 leader_election.cc:290] T 1db4109dc43b489d89c5de9eeb64a771 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:59.749831 13886 tablet_bootstrap.cc:492] T 34199145292d4ddb8c603e5c581f1d15 P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
W20250830 07:54:59.750540 13422 leader_election.cc:343] T 135d754d83ad422eb05909d2daa19d34 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:59.750727 13422 leader_election.cc:304] T 135d754d83ad422eb05909d2daa19d34 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba; no voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:54:59.751019 15976 raft_consensus.cc:2747] T 135d754d83ad422eb05909d2daa19d34 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:54:59.751585 13886 tablet_bootstrap.cc:654] T 34199145292d4ddb8c603e5c581f1d15 P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
W20250830 07:54:59.751752 13422 leader_election.cc:343] T 0c70140d87d34bde919714f08a5c94d4 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:59.751855 13422 leader_election.cc:304] T 0c70140d87d34bde919714f08a5c94d4 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba; no voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:54:59.752094 15976 raft_consensus.cc:2747] T 0c70140d87d34bde919714f08a5c94d4 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:54:59.755364 15481 raft_consensus.cc:491] T ba4e1fccb8f046d6b63afe67c1f9d538 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:59.755532 15481 raft_consensus.cc:513] T ba4e1fccb8f046d6b63afe67c1f9d538 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:59.756150 15481 leader_election.cc:290] T ba4e1fccb8f046d6b63afe67c1f9d538 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
I20250830 07:54:59.758509 13701 leader_election.cc:304] T 8c01157324ba45bda5b3a9a328bf319b P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:54:59.759615 15365 raft_consensus.cc:2802] T 8c01157324ba45bda5b3a9a328bf319b P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election won for term 1
I20250830 07:54:59.759810 15365 raft_consensus.cc:695] T 8c01157324ba45bda5b3a9a328bf319b P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 LEADER]: Becoming Leader. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Running, Role: LEADER
I20250830 07:54:59.760141 15365 consensus_queue.cc:237] T 8c01157324ba45bda5b3a9a328bf319b P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:59.761919 13610 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "1db4109dc43b489d89c5de9eeb64a771" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:59.765295 13610 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "ba4e1fccb8f046d6b63afe67c1f9d538" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:59.766436 13701 leader_election.cc:304] T 52df62f7f1aa4b38be89f6198cf01f24 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:54:59.771193 13701 leader_election.cc:304] T 3d9c884ac05e44ddb59f96588fdd6f4b P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:54:59.771348 15365 raft_consensus.cc:2802] T 52df62f7f1aa4b38be89f6198cf01f24 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election won for term 1
I20250830 07:54:59.773305 15481 raft_consensus.cc:2802] T 3d9c884ac05e44ddb59f96588fdd6f4b P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election won for term 1
I20250830 07:54:59.773617 15481 raft_consensus.cc:695] T 3d9c884ac05e44ddb59f96588fdd6f4b P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 LEADER]: Becoming Leader. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Running, Role: LEADER
I20250830 07:54:59.773963 15976 raft_consensus.cc:491] T af449cc407c046eeb5cdfdacffc617a4 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:59.773893 15481 consensus_queue.cc:237] T 3d9c884ac05e44ddb59f96588fdd6f4b P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:59.774091 15976 raft_consensus.cc:513] T af449cc407c046eeb5cdfdacffc617a4 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:59.774792 15365 raft_consensus.cc:695] T 52df62f7f1aa4b38be89f6198cf01f24 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 LEADER]: Becoming Leader. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Running, Role: LEADER
I20250830 07:54:59.775111 15365 consensus_queue.cc:237] T 52df62f7f1aa4b38be89f6198cf01f24 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:59.775298 15976 leader_election.cc:290] T af449cc407c046eeb5cdfdacffc617a4 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:59.761920 13882 tablet_bootstrap.cc:654] T e72402ca3cdf452fa8f4534c67226253 P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:59.778748 15999 raft_consensus.cc:491] T dcb8b326dbec4d40af26b4f143157468 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:59.778892 15999 raft_consensus.cc:513] T dcb8b326dbec4d40af26b4f143157468 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:59.778813 13228 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_3467cb50642345f6972e17990ccb8d9e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:59.779502 13228 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3467cb50642345f6972e17990ccb8d9e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:59.779688 15999 leader_election.cc:290] T dcb8b326dbec4d40af26b4f143157468 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:54:59.781016 13701 leader_election.cc:304] T 0ac39adafe144280b39f5c3fe5804087 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:54:59.781250 15601 raft_consensus.cc:2802] T 0ac39adafe144280b39f5c3fe5804087 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:54:59.781322 15601 raft_consensus.cc:491] T 0ac39adafe144280b39f5c3fe5804087 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:54:59.781404 15601 raft_consensus.cc:3058] T 0ac39adafe144280b39f5c3fe5804087 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
W20250830 07:54:59.783936 13423 leader_election.cc:343] T 1db4109dc43b489d89c5de9eeb64a771 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:59.784194 15601 raft_consensus.cc:513] T 0ac39adafe144280b39f5c3fe5804087 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
W20250830 07:54:59.784328 13703 consensus_peers.cc:489] T ff0f9cccc8ed43b1a8cd38de0e9d4097 P 9b057ade5dce45af9f8bf0bedf8b917f -> Peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Couldn't send request to peer 6b5e454d98894637b466ea27f1b647f9. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ff0f9cccc8ed43b1a8cd38de0e9d4097. This is attempt 11: this message will repeat every 5th retry.
W20250830 07:54:59.784933 13703 leader_election.cc:343] T ba4e1fccb8f046d6b63afe67c1f9d538 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:59.785300 15601 leader_election.cc:290] T 0ac39adafe144280b39f5c3fe5804087 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Requested vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
I20250830 07:54:59.785328 13610 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "af449cc407c046eeb5cdfdacffc617a4" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:59.791673 13887 tablet_bootstrap.cc:492] T a36f38ada7314165a5e9d6ee7bbf69e3 P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:54:59.791807 13887 ts_tablet_manager.cc:1397] T a36f38ada7314165a5e9d6ee7bbf69e3 P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.168s user 0.002s sys 0.000s
I20250830 07:54:59.798779 13231 master_service.cc:948] ReplaceTablet: received request to replace tablet e498b17956514a9d93807598f8dfb351 from {username='slave'} at 127.0.0.1:42126
I20250830 07:54:59.799712 13610 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "dcb8b326dbec4d40af26b4f143157468" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
W20250830 07:54:59.800705 13423 leader_election.cc:343] T af449cc407c046eeb5cdfdacffc617a4 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
W20250830 07:54:59.801203 13423 leader_election.cc:343] T dcb8b326dbec4d40af26b4f143157468 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:59.801677 13610 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "0ac39adafe144280b39f5c3fe5804087" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9"
I20250830 07:54:59.801986 13887 raft_consensus.cc:357] T a36f38ada7314165a5e9d6ee7bbf69e3 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
W20250830 07:54:59.802114 13703 leader_election.cc:343] T 0ac39adafe144280b39f5c3fe5804087 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:59.802275 13887 raft_consensus.cc:383] T a36f38ada7314165a5e9d6ee7bbf69e3 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:59.802379 13887 raft_consensus.cc:738] T a36f38ada7314165a5e9d6ee7bbf69e3 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:54:59.802641 13887 consensus_queue.cc:260] T a36f38ada7314165a5e9d6ee7bbf69e3 P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:59.803349 13887 ts_tablet_manager.cc:1428] T a36f38ada7314165a5e9d6ee7bbf69e3 P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.011s user 0.002s sys 0.000s
I20250830 07:54:59.803658 13887 tablet_bootstrap.cc:492] T 1ca83bbf848744f38206ceb4126271be P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:54:59.805166 13887 tablet_bootstrap.cc:654] T 1ca83bbf848744f38206ceb4126271be P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:59.806159 13231 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_3454cb4abcab4a5e81a01312919190f3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:59.806771 13231 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3454cb4abcab4a5e81a01312919190f3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:59.833333 13234 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_b65ac2e88cd54c05ba4cc54faa2c4954" } modify_external_catalogs: true
I20250830 07:54:59.833531 13234 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_b65ac2e88cd54c05ba4cc54faa2c4954" } modify_external_catalogs: true
I20250830 07:54:59.838101 15977 raft_consensus.cc:491] T 0c70140d87d34bde919714f08a5c94d4 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:59.838245 15977 raft_consensus.cc:513] T 0c70140d87d34bde919714f08a5c94d4 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:59.848482 13232 catalog_manager.cc:5582] T 2f3bec2c98574a9393e0fae77e228ce0 P 9b057ade5dce45af9f8bf0bedf8b917f reported cstate change: term changed from 0 to 1, leader changed from <none> to 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3). New cstate: current_term: 1 leader_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } health_report { overall_health: HEALTHY } } }
I20250830 07:54:59.849073 13232 catalog_manager.cc:5674] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743) does not have the latest schema for tablet 2f3bec2c98574a9393e0fae77e228ce0 (table default.Table_c8ae99834e3f4804aad49e8e527dbdcf [id=5fc49aaf98964a31a35fcc0405ac23ae]). Expected version 1 got 0
I20250830 07:54:59.849541 13232 catalog_manager.cc:5582] T ddedd1f141c147c69f178c6cd2b287da P 9b057ade5dce45af9f8bf0bedf8b917f reported cstate change: term changed from 0 to 1, leader changed from <none> to 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3). New cstate: current_term: 1 leader_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } health_report { overall_health: HEALTHY } } }
I20250830 07:54:59.850323 13232 catalog_manager.cc:5582] T 2c4c3c61cddf42668d3a09f4fbc5f641 P 9b057ade5dce45af9f8bf0bedf8b917f reported cstate change: term changed from 0 to 1, leader changed from <none> to 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3). New cstate: current_term: 1 leader_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } health_report { overall_health: HEALTHY } } }
I20250830 07:54:59.850943 13232 catalog_manager.cc:5674] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743) does not have the latest schema for tablet 2c4c3c61cddf42668d3a09f4fbc5f641 (table default.Table_0130f2afc22a48e39d534d4fd584b1c2 [id=da55ca35442546899b18ebd8a52e8d0c]). Expected version 2 got 0
I20250830 07:54:59.851195 13232 catalog_manager.cc:5582] T d171ad1667fa44c993ec5fd7d701d8e0 P 9b057ade5dce45af9f8bf0bedf8b917f reported cstate change: term changed from 0 to 1, leader changed from <none> to 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3). New cstate: current_term: 1 leader_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } health_report { overall_health: HEALTHY } } }
I20250830 07:54:59.851712 13232 catalog_manager.cc:5674] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743) does not have the latest schema for tablet d171ad1667fa44c993ec5fd7d701d8e0 (table default.Table_ffc2a253a4db48708e1f05a732742751 [id=8de51280a0014a9db6181db50fbf74f8]). Expected version 1 got 0
I20250830 07:54:59.851956 13232 catalog_manager.cc:5582] T ed364f03bdad42b88e181b7d0e1e4011 P 9b057ade5dce45af9f8bf0bedf8b917f reported cstate change: term changed from 0 to 1, leader changed from <none> to 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3). New cstate: current_term: 1 leader_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } health_report { overall_health: HEALTHY } } }
I20250830 07:54:59.852329 13232 catalog_manager.cc:5674] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743) does not have the latest schema for tablet ed364f03bdad42b88e181b7d0e1e4011 (table default.Table_d72c9e458203404188b2329054b05d20 [id=41f959f5cad14060ae3f4bf1b0151b9f]). Expected version 1 got 0
I20250830 07:54:59.852699 13232 catalog_manager.cc:5674] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743) does not have the latest schema for tablet c8bc6e07377a4ba99c39a909dae11402 (table default.Table_f9379201a5de4169a46eeb2ff2cc0ac7 [id=dce926f371dd4b4ba61511c14d245622]). Expected version 2 got 0
W20250830 07:54:59.864889 13703 consensus_peers.cc:489] T d171ad1667fa44c993ec5fd7d701d8e0 P 9b057ade5dce45af9f8bf0bedf8b917f -> Peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Couldn't send request to peer 6b5e454d98894637b466ea27f1b647f9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20250830 07:54:59.865547 13233 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_f953b1fecf61487188067ee06a99686a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:59.866248 13233 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f953b1fecf61487188067ee06a99686a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:59.867244 15977 leader_election.cc:290] T 0c70140d87d34bde919714f08a5c94d4 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
W20250830 07:54:59.871546 13230 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 6fe94553af384cbdbbde85dd285fc2f3 has no consensus state
I20250830 07:54:59.875900 13230 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_66830632639a4e57b55072c158179aa7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250830 07:54:59.876260 13610 raft_consensus.cc:3058] T 852e353f6ee945628ddebdbdd1bd76fb P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Advancing to term 1
W20250830 07:54:59.876399 13230 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_66830632639a4e57b55072c158179aa7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:59.880467 13624 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "0c70140d87d34bde919714f08a5c94d4" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:54:59.883244 13882 tablet_bootstrap.cc:492] T e72402ca3cdf452fa8f4534c67226253 P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:54:59.883415 13882 ts_tablet_manager.cc:1397] T e72402ca3cdf452fa8f4534c67226253 P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.190s user 0.003s sys 0.001s
I20250830 07:54:59.884253 13882 raft_consensus.cc:357] T e72402ca3cdf452fa8f4534c67226253 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:59.884459 13882 raft_consensus.cc:383] T e72402ca3cdf452fa8f4534c67226253 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:59.884564 13882 raft_consensus.cc:738] T e72402ca3cdf452fa8f4534c67226253 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:54:59.884786 13882 consensus_queue.cc:260] T e72402ca3cdf452fa8f4534c67226253 P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:59.885458 13882 ts_tablet_manager.cc:1428] T e72402ca3cdf452fa8f4534c67226253 P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20250830 07:54:59.885756 13882 tablet_bootstrap.cc:492] T 66432e73deea433d9df565d5fcace647 P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:54:59.887373 13882 tablet_bootstrap.cc:654] T 66432e73deea433d9df565d5fcace647 P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
W20250830 07:54:59.890545 13703 consensus_peers.cc:489] T 5fee48de90014f94b796e726a4d16b85 P 9b057ade5dce45af9f8bf0bedf8b917f -> Peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Couldn't send request to peer 6b5e454d98894637b466ea27f1b647f9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20250830 07:54:59.895524 13703 leader_election.cc:343] T 0c70140d87d34bde919714f08a5c94d4 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:54:59.814008 13471 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "fbb1cc8f8eea4a0795f6f8e213b8180f" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:54:59.815516 13485 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "5e2da5434e95445aa4deafce7fde0c6c" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba"
I20250830 07:54:59.904695 13471 raft_consensus.cc:2466] T fbb1cc8f8eea4a0795f6f8e213b8180f P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 0.
I20250830 07:54:59.904718 13485 raft_consensus.cc:3058] T 5e2da5434e95445aa4deafce7fde0c6c P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:59.885069 13482 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "ba4e1fccb8f046d6b63afe67c1f9d538" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:54:59.904975 13482 raft_consensus.cc:2466] T ba4e1fccb8f046d6b63afe67c1f9d538 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 0.
I20250830 07:54:59.896425 13477 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "0ac39adafe144280b39f5c3fe5804087" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba"
I20250830 07:54:59.905181 13477 raft_consensus.cc:3058] T 0ac39adafe144280b39f5c3fe5804087 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:54:59.907573 13485 raft_consensus.cc:2466] T 5e2da5434e95445aa4deafce7fde0c6c P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 1.
I20250830 07:54:59.908000 13477 raft_consensus.cc:2466] T 0ac39adafe144280b39f5c3fe5804087 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 1.
I20250830 07:54:59.912619 13225 catalog_manager.cc:5864] Not sending DeleteTablet requests; no consensus state for tablet d05b0e744947471a8b704d0fdbe729b3
I20250830 07:54:59.912806 13225 master_service.cc:948] ReplaceTablet: received request to replace tablet 05b403cedce64513b858b760d15a0e8f from {username='slave'} at 127.0.0.1:42126
I20250830 07:54:59.915509 13485 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "0c70140d87d34bde919714f08a5c94d4" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:54:59.915673 13485 raft_consensus.cc:2466] T 0c70140d87d34bde919714f08a5c94d4 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 0.
I20250830 07:54:59.952950 13226 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet 4fa6907089bd4c8ba92c7b54a3eb8dbe
I20250830 07:54:59.954455 13602 tablet_service.cc:1515] Processing DeleteTablet for tablet 4fa6907089bd4c8ba92c7b54a3eb8dbe with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:59 UTC) from {username='slave'} at 127.0.0.1:45306
W20250830 07:54:59.955433 13703 consensus_peers.cc:489] T bdeb89bbb3ad4e67bbc74b78454eeb7e P 9b057ade5dce45af9f8bf0bedf8b917f -> Peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Couldn't send request to peer 6b5e454d98894637b466ea27f1b647f9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20250830 07:54:59.967444 13226 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_09d21eed8dbd400f87967839c32011d4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:54:59.967983 13226 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_09d21eed8dbd400f87967839c32011d4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:54:59.978717 13887 tablet_bootstrap.cc:492] T 1ca83bbf848744f38206ceb4126271be P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:54:59.978868 13887 ts_tablet_manager.cc:1397] T 1ca83bbf848744f38206ceb4126271be P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.175s user 0.002s sys 0.000s
W20250830 07:54:59.979187 13229 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet c4f444c65afc4006a3747a5d7e2609c4 has no consensus state
I20250830 07:54:59.979570 13887 raft_consensus.cc:357] T 1ca83bbf848744f38206ceb4126271be P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:59.979724 13887 raft_consensus.cc:383] T 1ca83bbf848744f38206ceb4126271be P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:59.979772 13887 raft_consensus.cc:738] T 1ca83bbf848744f38206ceb4126271be P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:54:59.979980 13887 consensus_queue.cc:260] T 1ca83bbf848744f38206ceb4126271be P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:59.980454 13887 ts_tablet_manager.cc:1428] T 1ca83bbf848744f38206ceb4126271be P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250830 07:54:59.980727 13887 tablet_bootstrap.cc:492] T 3f70097c1b3a48dfbc1ad129fa7a3730 P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:54:59.982179 13887 tablet_bootstrap.cc:654] T 3f70097c1b3a48dfbc1ad129fa7a3730 P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:54:59.985306 13229 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_4a9e658505d840d88be7c7a3cd51cb4d" } new_table_name: "default.Table_fcc3930df56342c08de3748b1a89089e" modify_external_catalogs: true
I20250830 07:54:59.986526 13227 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_e9b35b1124584c46a8fea4c4a7ffaef4" } modify_external_catalogs: true
I20250830 07:54:59.986658 13227 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_e9b35b1124584c46a8fea4c4a7ffaef4" } modify_external_catalogs: true
I20250830 07:54:59.986833 13886 tablet_bootstrap.cc:492] T 34199145292d4ddb8c603e5c581f1d15 P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:54:59.987007 13886 ts_tablet_manager.cc:1397] T 34199145292d4ddb8c603e5c581f1d15 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.237s user 0.053s sys 0.054s
I20250830 07:54:59.987694 13886 raft_consensus.cc:357] T 34199145292d4ddb8c603e5c581f1d15 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:59.987931 13886 raft_consensus.cc:383] T 34199145292d4ddb8c603e5c581f1d15 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:54:59.988032 13886 raft_consensus.cc:738] T 34199145292d4ddb8c603e5c581f1d15 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:54:59.988236 13886 consensus_queue.cc:260] T 34199145292d4ddb8c603e5c581f1d15 P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:59.988880 13886 ts_tablet_manager.cc:1428] T 34199145292d4ddb8c603e5c581f1d15 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20250830 07:54:59.989391 13886 tablet_bootstrap.cc:492] T b6717031830f4c57967e87ce077ddb21 P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:54:59.992275 13764 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "1db4109dc43b489d89c5de9eeb64a771" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:59.993393 15980 raft_consensus.cc:491] T 1db4109dc43b489d89c5de9eeb64a771 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:54:59.993970 15980 raft_consensus.cc:513] T 1db4109dc43b489d89c5de9eeb64a771 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:54:59.994524 15980 leader_election.cc:290] T 1db4109dc43b489d89c5de9eeb64a771 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
I20250830 07:54:59.995199 13765 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "af449cc407c046eeb5cdfdacffc617a4" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:59.996438 13766 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "dcb8b326dbec4d40af26b4f143157468" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:54:59.997498 13764 raft_consensus.cc:2466] T 1db4109dc43b489d89c5de9eeb64a771 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2065c332f15a4739899af79f3669c3ba in term 0.
I20250830 07:54:59.998168 13234 catalog_manager.cc:5864] Not sending DeleteTablet requests; no consensus state for tablet 7c3dfbd95766404bb880e2400ae6871a
I20250830 07:55:00.003603 15748 consensus_queue.cc:1035] T 509e08290f3842cfbde8b74ff9f4f70f P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:55:00.005645 13886 tablet_bootstrap.cc:654] T b6717031830f4c57967e87ce077ddb21 P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:55:00.008145 15981 raft_consensus.cc:491] T 34199145292d4ddb8c603e5c581f1d15 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:55:00.008252 15981 raft_consensus.cc:513] T 34199145292d4ddb8c603e5c581f1d15 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:00.008746 15981 leader_election.cc:290] T 34199145292d4ddb8c603e5c581f1d15 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
I20250830 07:55:00.010602 15365 consensus_queue.cc:1035] T 846338e46b834ae0b5f4e74c7f1325d2 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:55:00.011039 15365 consensus_queue.cc:1035] T bdeb89bbb3ad4e67bbc74b78454eeb7e P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:55:00.016088 15481 consensus_queue.cc:1035] T 5fee48de90014f94b796e726a4d16b85 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:55:00.018560 13887 tablet_bootstrap.cc:492] T 3f70097c1b3a48dfbc1ad129fa7a3730 P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:55:00.018682 13887 ts_tablet_manager.cc:1397] T 3f70097c1b3a48dfbc1ad129fa7a3730 P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.038s user 0.002s sys 0.000s
I20250830 07:55:00.021066 13233 master_service.cc:948] ReplaceTablet: received request to replace tablet bcdac588f7c24d9d8572949e09b80a23 from {username='slave'} at 127.0.0.1:42126
I20250830 07:55:00.026482 13234 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_32d032fe8fba47348e797c68bb7ea866" } modify_external_catalogs: true
I20250830 07:55:00.026667 13234 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_32d032fe8fba47348e797c68bb7ea866" } modify_external_catalogs: true
I20250830 07:55:00.028601 13233 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_9b08f030695f4330b0c34a5280f12c7b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:55:00.029240 13233 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9b08f030695f4330b0c34a5280f12c7b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:55:00.030535 13228 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_f2854f37a49f4c0db82c12fabdfacc03" } new_table_name: "default.Table_4f0beb1023c24d3da981f36a0356e0d3" modify_external_catalogs: true
I20250830 07:55:00.032747 13231 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_1865f2739754463b97b55f37c4b0aaaa" } new_table_name: "default.Table_5e2394cd25b142beadf9888198592d2c" modify_external_catalogs: true
I20250830 07:55:00.034281 13232 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_f3d68437b1e94d4e95785ddf3e0a8dc2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:55:00.036885 13232 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f3d68437b1e94d4e95785ddf3e0a8dc2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:55:00.041554 15720 consensus_queue.cc:1035] T d171ad1667fa44c993ec5fd7d701d8e0 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:55:00.041994 13701 leader_election.cc:304] T fbb1cc8f8eea4a0795f6f8e213b8180f P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:55:00.042402 15981 raft_consensus.cc:2802] T fbb1cc8f8eea4a0795f6f8e213b8180f P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:55:00.042495 15981 raft_consensus.cc:491] T fbb1cc8f8eea4a0795f6f8e213b8180f P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:55:00.042568 15981 raft_consensus.cc:3058] T fbb1cc8f8eea4a0795f6f8e213b8180f P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:55:00.045825 15981 raft_consensus.cc:513] T fbb1cc8f8eea4a0795f6f8e213b8180f P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:00.046589 13701 leader_election.cc:304] T ba4e1fccb8f046d6b63afe67c1f9d538 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:55:00.046839 15720 raft_consensus.cc:2802] T ba4e1fccb8f046d6b63afe67c1f9d538 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:55:00.046938 15720 raft_consensus.cc:491] T ba4e1fccb8f046d6b63afe67c1f9d538 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:55:00.046989 13701 leader_election.cc:304] T 5e2da5434e95445aa4deafce7fde0c6c P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:55:00.047009 15720 raft_consensus.cc:3058] T ba4e1fccb8f046d6b63afe67c1f9d538 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:55:00.047426 15481 raft_consensus.cc:2802] T 5e2da5434e95445aa4deafce7fde0c6c P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election won for term 1
I20250830 07:55:00.047529 15481 raft_consensus.cc:695] T 5e2da5434e95445aa4deafce7fde0c6c P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 LEADER]: Becoming Leader. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Running, Role: LEADER
I20250830 07:55:00.047756 15481 consensus_queue.cc:237] T 5e2da5434e95445aa4deafce7fde0c6c P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:00.048813 13701 leader_election.cc:304] T 0ac39adafe144280b39f5c3fe5804087 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:55:00.049225 15748 raft_consensus.cc:2802] T 0ac39adafe144280b39f5c3fe5804087 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election won for term 1
I20250830 07:55:00.049315 15748 raft_consensus.cc:695] T 0ac39adafe144280b39f5c3fe5804087 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 LEADER]: Becoming Leader. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Running, Role: LEADER
I20250830 07:55:00.049547 15748 consensus_queue.cc:237] T 0ac39adafe144280b39f5c3fe5804087 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:00.049791 15720 raft_consensus.cc:513] T ba4e1fccb8f046d6b63afe67c1f9d538 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:00.050837 15720 leader_election.cc:290] T ba4e1fccb8f046d6b63afe67c1f9d538 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Requested vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
I20250830 07:55:00.052524 15720 raft_consensus.cc:491] T a04bf79de30a42a98e71f622efc90c22 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:55:00.052686 15720 raft_consensus.cc:513] T a04bf79de30a42a98e71f622efc90c22 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:00.053215 15720 leader_election.cc:290] T a04bf79de30a42a98e71f622efc90c22 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
I20250830 07:55:00.054112 13887 raft_consensus.cc:357] T 3f70097c1b3a48dfbc1ad129fa7a3730 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:00.054330 13887 raft_consensus.cc:383] T 3f70097c1b3a48dfbc1ad129fa7a3730 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:55:00.054391 13887 raft_consensus.cc:738] T 3f70097c1b3a48dfbc1ad129fa7a3730 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:55:00.047235 15981 leader_election.cc:290] T fbb1cc8f8eea4a0795f6f8e213b8180f P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Requested vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
I20250830 07:55:00.057106 15981 raft_consensus.cc:491] T e74a3e4b3b234c41aca30f772525652e P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:55:00.057211 15981 raft_consensus.cc:513] T e74a3e4b3b234c41aca30f772525652e P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:00.058604 15981 leader_election.cc:290] T e74a3e4b3b234c41aca30f772525652e P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
I20250830 07:55:00.059020 13477 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "1db4109dc43b489d89c5de9eeb64a771" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:55:00.059237 13477 raft_consensus.cc:2466] T 1db4109dc43b489d89c5de9eeb64a771 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 0.
I20250830 07:55:00.059337 16039 raft_consensus.cc:491] T e74a3e4b3b234c41aca30f772525652e P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:55:00.059446 13701 leader_election.cc:304] T 0c70140d87d34bde919714f08a5c94d4 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:55:00.059454 16039 raft_consensus.cc:513] T e74a3e4b3b234c41aca30f772525652e P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:00.059989 16039 leader_election.cc:290] T e74a3e4b3b234c41aca30f772525652e P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:55:00.060695 15977 raft_consensus.cc:2802] T 0c70140d87d34bde919714f08a5c94d4 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:55:00.060765 15977 raft_consensus.cc:491] T 0c70140d87d34bde919714f08a5c94d4 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:55:00.060832 15977 raft_consensus.cc:3058] T 0c70140d87d34bde919714f08a5c94d4 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:55:00.063468 15977 raft_consensus.cc:513] T 0c70140d87d34bde919714f08a5c94d4 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
W20250830 07:55:00.063759 13422 leader_election.cc:343] T af449cc407c046eeb5cdfdacffc617a4 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:55:00.063853 13422 leader_election.cc:304] T af449cc407c046eeb5cdfdacffc617a4 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba; no voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:55:00.063993 15977 leader_election.cc:290] T 0c70140d87d34bde919714f08a5c94d4 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Requested vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
I20250830 07:55:00.064059 15976 raft_consensus.cc:2747] T af449cc407c046eeb5cdfdacffc617a4 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20250830 07:55:00.064746 13422 leader_election.cc:343] T dcb8b326dbec4d40af26b4f143157468 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Illegal state: must be running to vote when last-logged opid is not known
W20250830 07:55:00.064774 13220 catalog_manager.cc:4726] Async tablet task AlterTable RPC for tablet 420a0d55b9d1484d81b97581f459ba5a (table default.Table_5a06577c7cb44c0891fea3118230a083 [id=b78a6de5b9ce4be7a1367a81f7e79b9d], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 420a0d55b9d1484d81b97581f459ba5a has no consensus state
I20250830 07:55:00.064910 13422 leader_election.cc:304] T dcb8b326dbec4d40af26b4f143157468 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba; no voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:55:00.054600 13887 consensus_queue.cc:260] T 3f70097c1b3a48dfbc1ad129fa7a3730 P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
W20250830 07:55:00.066044 13220 catalog_manager.cc:4908] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet 4fa6907089bd4c8ba92c7b54a3eb8dbe because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4fa6907089bd4c8ba92c7b54a3eb8dbe already in progress: creating tablet
I20250830 07:55:00.067289 15976 raft_consensus.cc:2747] T dcb8b326dbec4d40af26b4f143157468 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:55:00.068244 13887 ts_tablet_manager.cc:1428] T 3f70097c1b3a48dfbc1ad129fa7a3730 P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.050s user 0.002s sys 0.000s
I20250830 07:55:00.068738 13887 tablet_bootstrap.cc:492] T 122bec4220c74dfaa8228f6d153cd50e P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:55:00.070978 15751 consensus_queue.cc:1035] T 208995abd6d44dbea3b5ebbea27d6a39 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:55:00.078387 13629 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "e74a3e4b3b234c41aca30f772525652e" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
W20250830 07:55:00.078675 13230 catalog_manager.cc:5415] Ignoring report from unknown tablet 689b4fee1dd04b3d9ccdea334b0f6b59
W20250830 07:55:00.078792 13230 catalog_manager.cc:5415] Ignoring report from unknown tablet 49165f0001044d72b68263a60ef56457
W20250830 07:55:00.078868 13230 catalog_manager.cc:5415] Ignoring report from unknown tablet f66e1d07039841088a444ee0203a4eb0
W20250830 07:55:00.079239 13230 catalog_manager.cc:5415] Ignoring report from unknown tablet f398e12cd9f543738d5163354f8a9d9d
W20250830 07:55:00.079298 13230 catalog_manager.cc:5415] Ignoring report from unknown tablet ff0f9cccc8ed43b1a8cd38de0e9d4097
I20250830 07:55:00.082593 13629 raft_consensus.cc:3058] T db7144b25ff34bed8c7b779ba9497ef4 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:55:00.087599 13624 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "1db4109dc43b489d89c5de9eeb64a771" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:55:00.088572 13624 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "34199145292d4ddb8c603e5c581f1d15" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:55:00.089497 13624 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "fbb1cc8f8eea4a0795f6f8e213b8180f" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9"
I20250830 07:55:00.089936 13624 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "ba4e1fccb8f046d6b63afe67c1f9d538" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9"
I20250830 07:55:00.090946 13624 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "e74a3e4b3b234c41aca30f772525652e" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:55:00.091739 13624 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "0c70140d87d34bde919714f08a5c94d4" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9"
I20250830 07:55:00.091770 13230 catalog_manager.cc:5582] T 52df62f7f1aa4b38be89f6198cf01f24 P 9b057ade5dce45af9f8bf0bedf8b917f reported cstate change: term changed from 0 to 1, leader changed from <none> to 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3). New cstate: current_term: 1 leader_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } health_report { overall_health: HEALTHY } } }
I20250830 07:55:00.092209 13230 catalog_manager.cc:5674] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743) does not have the latest schema for tablet 52df62f7f1aa4b38be89f6198cf01f24 (table default.Table_c58784366d3c49dda4c9d4afc16520a3 [id=0345f468e2de4e38814123f678c2da1c]). Expected version 1 got 0
I20250830 07:55:00.092527 13230 catalog_manager.cc:5674] TS 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743) does not have the latest schema for tablet 34199145292d4ddb8c603e5c581f1d15 (table default.Table_7e0dd322b340488ba39ed8049eca0e73 [id=344b9d0cfa1e4ada84a648d6b0c4ab9d]). Expected version 1 got 0
I20250830 07:55:00.093951 13886 tablet_bootstrap.cc:492] T b6717031830f4c57967e87ce077ddb21 P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:55:00.094130 13886 ts_tablet_manager.cc:1397] T b6717031830f4c57967e87ce077ddb21 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.105s user 0.003s sys 0.006s
I20250830 07:55:00.094949 13886 raft_consensus.cc:357] T b6717031830f4c57967e87ce077ddb21 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:00.095175 13886 raft_consensus.cc:383] T b6717031830f4c57967e87ce077ddb21 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:55:00.095249 13886 raft_consensus.cc:738] T b6717031830f4c57967e87ce077ddb21 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:55:00.095494 13886 consensus_queue.cc:260] T b6717031830f4c57967e87ce077ddb21 P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:00.096197 13886 ts_tablet_manager.cc:1428] T b6717031830f4c57967e87ce077ddb21 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20250830 07:55:00.096495 13886 tablet_bootstrap.cc:492] T 4b9d9d4b65964fd49d8e25092a14d774 P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
W20250830 07:55:00.097236 13423 consensus_peers.cc:489] T 99f307a8cbb34addaafab82b3ed18241 P 2065c332f15a4739899af79f3669c3ba -> Peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Couldn't send request to peer 6b5e454d98894637b466ea27f1b647f9. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 99f307a8cbb34addaafab82b3ed18241. This is attempt 6: this message will repeat every 5th retry.
W20250830 07:55:00.097400 13423 consensus_peers.cc:489] T d33a5d107c6849aca6eb48ffdf8a5463 P 2065c332f15a4739899af79f3669c3ba -> Peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Couldn't send request to peer 6b5e454d98894637b466ea27f1b647f9. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d33a5d107c6849aca6eb48ffdf8a5463. This is attempt 11: this message will repeat every 5th retry.
I20250830 07:55:00.098070 13886 tablet_bootstrap.cc:654] T 4b9d9d4b65964fd49d8e25092a14d774 P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:55:00.098315 13225 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet 05b403cedce64513b858b760d15a0e8f
I20250830 07:55:00.098788 13225 catalog_manager.cc:6652] ReplaceTablet: tablet 05b403cedce64513b858b760d15a0e8f deleted and replaced by tablet d1d9ca3af9374dc6ae375466c2ec0305
I20250830 07:55:00.101397 13602 tablet_service.cc:1515] Processing DeleteTablet for tablet 05b403cedce64513b858b760d15a0e8f with delete_type TABLET_DATA_DELETED (replaced by tablet d1d9ca3af9374dc6ae375466c2ec0305) from {username='slave'} at 127.0.0.1:45306
W20250830 07:55:00.102032 13220 catalog_manager.cc:4908] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet 05b403cedce64513b858b760d15a0e8f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 05b403cedce64513b858b760d15a0e8f already in progress: creating tablet
I20250830 07:55:00.108109 13422 leader_election.cc:304] T 1db4109dc43b489d89c5de9eeb64a771 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
W20250830 07:55:00.108677 13225 catalog_manager.cc:5415] Ignoring report from unknown tablet d1153d8cd2994377ac0dcbfeeda1fd52
W20250830 07:55:00.108803 13225 catalog_manager.cc:5415] Ignoring report from unknown tablet d33a5d107c6849aca6eb48ffdf8a5463
W20250830 07:55:00.108901 13225 catalog_manager.cc:5415] Ignoring report from unknown tablet 49165f0001044d72b68263a60ef56457
W20250830 07:55:00.108938 13225 catalog_manager.cc:5415] Ignoring report from unknown tablet a36f38ada7314165a5e9d6ee7bbf69e3
W20250830 07:55:00.109025 13225 catalog_manager.cc:5415] Ignoring report from unknown tablet 2b4103f07e96490488913059a95af0c3
W20250830 07:55:00.109163 13225 catalog_manager.cc:5415] Ignoring report from unknown tablet 2c31d119743f49589703c434ac6c7548
W20250830 07:55:00.109205 13225 catalog_manager.cc:5415] Ignoring report from unknown tablet ef16b9e2d444489699f4db1ac26d5f6c
I20250830 07:55:00.110495 15976 raft_consensus.cc:2802] T 1db4109dc43b489d89c5de9eeb64a771 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:55:00.110589 15976 raft_consensus.cc:491] T 1db4109dc43b489d89c5de9eeb64a771 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:55:00.110662 15976 raft_consensus.cc:3058] T 1db4109dc43b489d89c5de9eeb64a771 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:55:00.113298 15976 raft_consensus.cc:513] T 1db4109dc43b489d89c5de9eeb64a771 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:00.113749 15976 leader_election.cc:290] T 1db4109dc43b489d89c5de9eeb64a771 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 election: Requested vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:55:00.114624 13887 tablet_bootstrap.cc:654] T 122bec4220c74dfaa8228f6d153cd50e P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
W20250830 07:55:00.116400 13229 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f8fab6e766a847c29da8573ad0b402d5 consensus state has no leader
I20250830 07:55:00.119403 13229 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_a0e29d03dc0f441697d39dbb1e0a7323"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:55:00.119911 13229 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a0e29d03dc0f441697d39dbb1e0a7323 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250830 07:55:00.122282 13422 consensus_peers.cc:489] T ef16b9e2d444489699f4db1ac26d5f6c P 2065c332f15a4739899af79f3669c3ba -> Peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Couldn't send request to peer 9b057ade5dce45af9f8bf0bedf8b917f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ef16b9e2d444489699f4db1ac26d5f6c. This is attempt 11: this message will repeat every 5th retry.
I20250830 07:55:00.127050 13701 leader_election.cc:304] T 1db4109dc43b489d89c5de9eeb64a771 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters:
I20250830 07:55:00.127764 13774 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "1db4109dc43b489d89c5de9eeb64a771" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f"
I20250830 07:55:00.127833 15481 raft_consensus.cc:2802] T 1db4109dc43b489d89c5de9eeb64a771 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:55:00.127928 13774 raft_consensus.cc:3058] T 1db4109dc43b489d89c5de9eeb64a771 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:55:00.128077 13477 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "34199145292d4ddb8c603e5c581f1d15" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:55:00.128240 13477 raft_consensus.cc:2466] T 34199145292d4ddb8c603e5c581f1d15 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 0.
I20250830 07:55:00.130584 13774 raft_consensus.cc:2466] T 1db4109dc43b489d89c5de9eeb64a771 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2065c332f15a4739899af79f3669c3ba in term 1.
I20250830 07:55:00.130723 15481 raft_consensus.cc:491] T 1db4109dc43b489d89c5de9eeb64a771 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:55:00.127779 13766 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "e74a3e4b3b234c41aca30f772525652e" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:55:00.130847 15481 raft_consensus.cc:3058] T 1db4109dc43b489d89c5de9eeb64a771 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Advancing to term 2
I20250830 07:55:00.130916 13766 raft_consensus.cc:2466] T e74a3e4b3b234c41aca30f772525652e P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2065c332f15a4739899af79f3669c3ba in term 0.
I20250830 07:55:00.133915 15481 raft_consensus.cc:513] T 1db4109dc43b489d89c5de9eeb64a771 P 9b057ade5dce45af9f8bf0bedf8b917f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:00.135385 15481 leader_election.cc:290] T 1db4109dc43b489d89c5de9eeb64a771 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 2 election: Requested vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
I20250830 07:55:00.140250 13227 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet 533f17f5a9104a6582d9682287c9f1f7
I20250830 07:55:00.141543 13602 tablet_service.cc:1515] Processing DeleteTablet for tablet 533f17f5a9104a6582d9682287c9f1f7 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:54:59 UTC) from {username='slave'} at 127.0.0.1:45306
W20250830 07:55:00.142515 13220 catalog_manager.cc:4908] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): delete failed for tablet 533f17f5a9104a6582d9682287c9f1f7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 533f17f5a9104a6582d9682287c9f1f7 already in progress: creating tablet
I20250830 07:55:00.144964 13227 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42126:
name: "default.Table_acc07f12529747e3a643add9150c1507"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250830 07:55:00.145666 13227 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_acc07f12529747e3a643add9150c1507 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250830 07:55:00.148401 13882 tablet_bootstrap.cc:492] T 66432e73deea433d9df565d5fcace647 P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:55:00.148558 13882 ts_tablet_manager.cc:1397] T 66432e73deea433d9df565d5fcace647 P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.263s user 0.003s sys 0.000s
I20250830 07:55:00.149344 13882 raft_consensus.cc:357] T 66432e73deea433d9df565d5fcace647 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:00.149573 13882 raft_consensus.cc:383] T 66432e73deea433d9df565d5fcace647 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:55:00.149683 13882 raft_consensus.cc:738] T 66432e73deea433d9df565d5fcace647 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:55:00.149956 13882 consensus_queue.cc:260] T 66432e73deea433d9df565d5fcace647 P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:00.150547 13882 ts_tablet_manager.cc:1428] T 66432e73deea433d9df565d5fcace647 P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20250830 07:55:00.150853 13882 tablet_bootstrap.cc:492] T 2b4103f07e96490488913059a95af0c3 P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
W20250830 07:55:00.151831 13423 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.209.2:38967, user_credentials={real_user=slave}} blocked reactor thread for 54319.4us
I20250830 07:55:00.152547 13882 tablet_bootstrap.cc:654] T 2b4103f07e96490488913059a95af0c3 P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
W20250830 07:55:00.152717 13423 leader_election.cc:343] T e74a3e4b3b234c41aca30f772525652e P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:55:00.157588 13887 tablet_bootstrap.cc:492] T 122bec4220c74dfaa8228f6d153cd50e P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:55:00.157719 13887 ts_tablet_manager.cc:1397] T 122bec4220c74dfaa8228f6d153cd50e P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.089s user 0.001s sys 0.002s
I20250830 07:55:00.158619 13887 raft_consensus.cc:357] T 122bec4220c74dfaa8228f6d153cd50e P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:00.158775 13887 raft_consensus.cc:383] T 122bec4220c74dfaa8228f6d153cd50e P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:55:00.158823 13887 raft_consensus.cc:738] T 122bec4220c74dfaa8228f6d153cd50e P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:55:00.159145 13887 consensus_queue.cc:260] T 122bec4220c74dfaa8228f6d153cd50e P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:00.159507 13887 ts_tablet_manager.cc:1428] T 122bec4220c74dfaa8228f6d153cd50e P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20250830 07:55:00.159741 13887 tablet_bootstrap.cc:492] T ccc9091018cb48ffb2affd98e8bbfa05 P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:55:00.161024 13887 tablet_bootstrap.cc:654] T ccc9091018cb48ffb2affd98e8bbfa05 P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:55:00.171141 13476 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "fbb1cc8f8eea4a0795f6f8e213b8180f" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba"
I20250830 07:55:00.171370 13476 raft_consensus.cc:3058] T fbb1cc8f8eea4a0795f6f8e213b8180f P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:55:00.172488 15365 raft_consensus.cc:491] T 1fee3e58f31b4befa42ffbb8d7bd6f4e P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:55:00.172495 16078 raft_consensus.cc:491] T 1ca83bbf848744f38206ceb4126271be P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:55:00.172633 15365 raft_consensus.cc:513] T 1fee3e58f31b4befa42ffbb8d7bd6f4e P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:00.172704 16078 raft_consensus.cc:513] T 1ca83bbf848744f38206ceb4126271be P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:00.173257 15365 leader_election.cc:290] T 1fee3e58f31b4befa42ffbb8d7bd6f4e P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
I20250830 07:55:00.174141 13476 raft_consensus.cc:2466] T fbb1cc8f8eea4a0795f6f8e213b8180f P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 1.
I20250830 07:55:00.175609 16078 leader_election.cc:290] T 1ca83bbf848744f38206ceb4126271be P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
W20250830 07:55:00.177038 13703 leader_election.cc:343] T 1db4109dc43b489d89c5de9eeb64a771 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
W20250830 07:55:00.178081 13703 leader_election.cc:343] T 34199145292d4ddb8c603e5c581f1d15 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
W20250830 07:55:00.178900 13703 leader_election.cc:343] T fbb1cc8f8eea4a0795f6f8e213b8180f P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
W20250830 07:55:00.179488 13703 leader_election.cc:343] T ba4e1fccb8f046d6b63afe67c1f9d538 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
W20250830 07:55:00.179808 13703 leader_election.cc:343] T a04bf79de30a42a98e71f622efc90c22 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Not found: Tablet not found: a04bf79de30a42a98e71f622efc90c22
W20250830 07:55:00.180578 13703 leader_election.cc:343] T e74a3e4b3b234c41aca30f772525652e P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
W20250830 07:55:00.181447 13703 leader_election.cc:343] T 0c70140d87d34bde919714f08a5c94d4 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:55:00.183909 13226 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_9000475f1cb74899ac1fb69b521a6554" } new_table_name: "default.Table_2cd2a446841344aea99cf2aaa01a6760" modify_external_catalogs: true
I20250830 07:55:00.203099 13476 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "ba4e1fccb8f046d6b63afe67c1f9d538" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba"
I20250830 07:55:00.203398 13476 raft_consensus.cc:3058] T ba4e1fccb8f046d6b63afe67c1f9d538 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:55:00.206638 13476 raft_consensus.cc:2466] T ba4e1fccb8f046d6b63afe67c1f9d538 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 1.
I20250830 07:55:00.206707 13488 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "e74a3e4b3b234c41aca30f772525652e" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:55:00.207202 13488 raft_consensus.cc:2466] T e74a3e4b3b234c41aca30f772525652e P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 0.
I20250830 07:55:00.209672 13488 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "0c70140d87d34bde919714f08a5c94d4" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba"
I20250830 07:55:00.209818 13488 raft_consensus.cc:3058] T 0c70140d87d34bde919714f08a5c94d4 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:55:00.212670 13488 raft_consensus.cc:2466] T 0c70140d87d34bde919714f08a5c94d4 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 1.
I20250830 07:55:00.212806 16074 raft_consensus.cc:491] T e72402ca3cdf452fa8f4534c67226253 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:55:00.212935 16074 raft_consensus.cc:513] T e72402ca3cdf452fa8f4534c67226253 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:00.215271 16074 leader_election.cc:290] T e72402ca3cdf452fa8f4534c67226253 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:55:00.215502 13488 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "e72402ca3cdf452fa8f4534c67226253" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:55:00.216770 13124 external_mini_cluster.cc:1699] Attempting to check leaks for /tmp/dist-test-taskbivBUj/build/asan/bin/kudu pid 13132
I20250830 07:55:00.218109 13193 generic_service.cc:196] Checking for leaks (request via RPC)
I20250830 07:55:00.231277 13233 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_938062c755124244958f72a0f1e26569" } modify_external_catalogs: true
I20250830 07:55:00.231489 13233 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_938062c755124244958f72a0f1e26569" } modify_external_catalogs: true
I20250830 07:55:00.231694 13234 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88: Sending DeleteTablet for 3 replicas of tablet 0ceccc5f18294356894695fe08d73e30
I20250830 07:55:00.232393 13234 master_service.cc:948] ReplaceTablet: received request to replace tablet 4b7eff24965f4f3ebfbf70dc82b7cce3 from {username='slave'} at 127.0.0.1:42126
I20250830 07:55:00.232868 13234 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_c58784366d3c49dda4c9d4afc16520a3" } modify_external_catalogs: true
I20250830 07:55:00.233019 13234 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_c58784366d3c49dda4c9d4afc16520a3" } modify_external_catalogs: true
W20250830 07:55:00.233090 13228 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 7e5c24ecafb04287bc51bbfb68f294ee has no consensus state
I20250830 07:55:00.233438 13228 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42126:
table { table_name: "default.Table_099bcc62239543ad8c7992faebeecb32" } new_table_name: "default.Table_2ffff37fc0bc4de8b72479bb2a1403af" modify_external_catalogs: true
I20250830 07:55:00.233882 13882 tablet_bootstrap.cc:492] T 2b4103f07e96490488913059a95af0c3 P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:55:00.237529 13882 ts_tablet_manager.cc:1397] T 2b4103f07e96490488913059a95af0c3 P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.087s user 0.007s sys 0.004s
I20250830 07:55:00.238227 13602 tablet_service.cc:1515] Processing DeleteTablet for tablet 0ceccc5f18294356894695fe08d73e30 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-08-30 07:55:00 UTC) from {username='slave'} at 127.0.0.1:45306
I20250830 07:55:00.238276 13882 raft_consensus.cc:357] T 2b4103f07e96490488913059a95af0c3 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:00.238442 13882 raft_consensus.cc:383] T 2b4103f07e96490488913059a95af0c3 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:55:00.238503 13882 raft_consensus.cc:738] T 2b4103f07e96490488913059a95af0c3 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:55:00.238565 16034 tablet_replica.cc:331] T 0ceccc5f18294356894695fe08d73e30 P 6b5e454d98894637b466ea27f1b647f9: stopping tablet replica
I20250830 07:55:00.238665 13882 consensus_queue.cc:260] T 2b4103f07e96490488913059a95af0c3 P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:00.238765 16034 raft_consensus.cc:2241] T 0ceccc5f18294356894695fe08d73e30 P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250830 07:55:00.253726 16034 raft_consensus.cc:2270] T 0ceccc5f18294356894695fe08d73e30 P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250830 07:55:00.254364 16034 ts_tablet_manager.cc:1905] T 0ceccc5f18294356894695fe08d73e30 P 6b5e454d98894637b466ea27f1b647f9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250830 07:55:00.254707 13886 tablet_bootstrap.cc:492] T 4b9d9d4b65964fd49d8e25092a14d774 P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:55:00.254709 13882 ts_tablet_manager.cc:1428] T 2b4103f07e96490488913059a95af0c3 P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.017s user 0.001s sys 0.001s
I20250830 07:55:00.254968 13886 ts_tablet_manager.cc:1397] T 4b9d9d4b65964fd49d8e25092a14d774 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.159s user 0.024s sys 0.038s
W20250830 07:55:00.255985 13703 consensus_peers.cc:489] T ddedd1f141c147c69f178c6cd2b287da P 9b057ade5dce45af9f8bf0bedf8b917f -> Peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Couldn't send request to peer 6b5e454d98894637b466ea27f1b647f9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20250830 07:55:00.255903 13886 raft_consensus.cc:357] T 4b9d9d4b65964fd49d8e25092a14d774 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:00.256215 13886 raft_consensus.cc:383] T 4b9d9d4b65964fd49d8e25092a14d774 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:55:00.256321 13886 raft_consensus.cc:738] T 4b9d9d4b65964fd49d8e25092a14d774 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
W20250830 07:55:00.256542 13703 consensus_peers.cc:489] T 846338e46b834ae0b5f4e74c7f1325d2 P 9b057ade5dce45af9f8bf0bedf8b917f -> Peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Couldn't send request to peer 6b5e454d98894637b466ea27f1b647f9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20250830 07:55:00.256567 13886 consensus_queue.cc:260] T 4b9d9d4b65964fd49d8e25092a14d774 P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:00.257316 13886 ts_tablet_manager.cc:1428] T 4b9d9d4b65964fd49d8e25092a14d774 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20250830 07:55:00.257617 13886 tablet_bootstrap.cc:492] T 6720d2b945814305845beea0a2cb9912 P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:55:00.259407 13886 tablet_bootstrap.cc:654] T 6720d2b945814305845beea0a2cb9912 P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:55:00.268368 13766 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "e72402ca3cdf452fa8f4534c67226253" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:55:00.271368 13473 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "1db4109dc43b489d89c5de9eeb64a771" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba"
I20250830 07:55:00.271603 13473 raft_consensus.cc:3058] T 1db4109dc43b489d89c5de9eeb64a771 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Advancing to term 2
I20250830 07:55:00.255311 13882 tablet_bootstrap.cc:492] T 208995abd6d44dbea3b5ebbea27d6a39 P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:55:00.275345 13473 raft_consensus.cc:2466] T 1db4109dc43b489d89c5de9eeb64a771 P 2065c332f15a4739899af79f3669c3ba [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 2.
I20250830 07:55:00.259431 13624 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "1ca83bbf848744f38206ceb4126271be" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:55:00.258963 13629 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "1db4109dc43b489d89c5de9eeb64a771" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9"
I20250830 07:55:00.293310 13476 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "1fee3e58f31b4befa42ffbb8d7bd6f4e" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:55:00.293613 13476 raft_consensus.cc:2466] T 1fee3e58f31b4befa42ffbb8d7bd6f4e P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 0.
I20250830 07:55:00.263046 13610 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "1db4109dc43b489d89c5de9eeb64a771" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9"
I20250830 07:55:00.264474 13615 raft_consensus.cc:3058] T 76ab56c469cf4675a4e21acbe0a8085d P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:55:00.264812 13612 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "1fee3e58f31b4befa42ffbb8d7bd6f4e" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:55:00.262845 16034 ts_tablet_manager.cc:1918] T 0ceccc5f18294356894695fe08d73e30 P 6b5e454d98894637b466ea27f1b647f9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250830 07:55:00.298198 13701 leader_election.cc:304] T 34199145292d4ddb8c603e5c581f1d15 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:55:00.298406 16034 log.cc:1199] T 0ceccc5f18294356894695fe08d73e30 P 6b5e454d98894637b466ea27f1b647f9: Deleting WAL directory at /tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/ts-1/wal/wals/0ceccc5f18294356894695fe08d73e30
I20250830 07:55:00.298434 15603 raft_consensus.cc:2802] T 34199145292d4ddb8c603e5c581f1d15 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:55:00.298507 15603 raft_consensus.cc:491] T 34199145292d4ddb8c603e5c581f1d15 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:55:00.298569 15603 raft_consensus.cc:3058] T 34199145292d4ddb8c603e5c581f1d15 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:55:00.300058 13701 leader_election.cc:304] T fbb1cc8f8eea4a0795f6f8e213b8180f P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:55:00.300393 15481 raft_consensus.cc:2802] T fbb1cc8f8eea4a0795f6f8e213b8180f P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election won for term 1
I20250830 07:55:00.300487 15481 raft_consensus.cc:695] T fbb1cc8f8eea4a0795f6f8e213b8180f P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 LEADER]: Becoming Leader. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Running, Role: LEADER
I20250830 07:55:00.300704 15481 consensus_queue.cc:237] T fbb1cc8f8eea4a0795f6f8e213b8180f P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:00.301131 15603 raft_consensus.cc:513] T 34199145292d4ddb8c603e5c581f1d15 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:00.301674 15603 leader_election.cc:290] T 34199145292d4ddb8c603e5c581f1d15 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Requested vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
I20250830 07:55:00.319325 13882 tablet_bootstrap.cc:654] T 208995abd6d44dbea3b5ebbea27d6a39 P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
I20250830 07:55:00.319926 13887 tablet_bootstrap.cc:492] T ccc9091018cb48ffb2affd98e8bbfa05 P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:55:00.320070 13887 ts_tablet_manager.cc:1397] T ccc9091018cb48ffb2affd98e8bbfa05 P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.160s user 0.002s sys 0.002s
I20250830 07:55:00.318900 16092 raft_consensus.cc:491] T 00000000000000000000000000000000 P 3ea183a890b84f408b20b55e9eb7c7ed [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:55:00.321686 13766 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "1ca83bbf848744f38206ceb4126271be" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
W20250830 07:55:00.322439 13701 leader_election.cc:343] T a04bf79de30a42a98e71f622efc90c22 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): Not found: Tablet not found: a04bf79de30a42a98e71f622efc90c22
I20250830 07:55:00.322544 13701 leader_election.cc:304] T a04bf79de30a42a98e71f622efc90c22 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 2065c332f15a4739899af79f3669c3ba, 6b5e454d98894637b466ea27f1b647f9
I20250830 07:55:00.322824 15481 raft_consensus.cc:2747] T a04bf79de30a42a98e71f622efc90c22 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20250830 07:55:00.323225 13703 consensus_peers.cc:489] T c56e3a30c18640e68c8b0c4ff4251d96 P 9b057ade5dce45af9f8bf0bedf8b917f -> Peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Couldn't send request to peer 6b5e454d98894637b466ea27f1b647f9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20250830 07:55:00.323575 13701 leader_election.cc:304] T ba4e1fccb8f046d6b63afe67c1f9d538 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:55:00.323915 15481 raft_consensus.cc:2802] T ba4e1fccb8f046d6b63afe67c1f9d538 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election won for term 1
I20250830 07:55:00.324066 15481 raft_consensus.cc:695] T ba4e1fccb8f046d6b63afe67c1f9d538 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 LEADER]: Becoming Leader. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Running, Role: LEADER
I20250830 07:55:00.324255 15481 consensus_queue.cc:237] T ba4e1fccb8f046d6b63afe67c1f9d538 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:00.327795 13886 tablet_bootstrap.cc:492] T 6720d2b945814305845beea0a2cb9912 P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:55:00.327934 13886 ts_tablet_manager.cc:1397] T 6720d2b945814305845beea0a2cb9912 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.070s user 0.010s sys 0.009s
I20250830 07:55:00.328842 13886 raft_consensus.cc:357] T 6720d2b945814305845beea0a2cb9912 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:00.329032 13886 raft_consensus.cc:383] T 6720d2b945814305845beea0a2cb9912 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:55:00.329088 13886 raft_consensus.cc:738] T 6720d2b945814305845beea0a2cb9912 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
W20250830 07:55:00.330615 13703 consensus_peers.cc:489] T ed364f03bdad42b88e181b7d0e1e4011 P 9b057ade5dce45af9f8bf0bedf8b917f -> Peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Couldn't send request to peer 6b5e454d98894637b466ea27f1b647f9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20250830 07:55:00.330962 13701 leader_election.cc:304] T e74a3e4b3b234c41aca30f772525652e P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:55:00.321806 16092 raft_consensus.cc:513] T 00000000000000000000000000000000 P 3ea183a890b84f408b20b55e9eb7c7ed [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fea6152429cc4e79a25b18e02aafae57" member_type: VOTER last_known_addr { host: "127.12.209.62" port: 39725 } } peers { permanent_uuid: "5e9d6449ae824acab24c459a72075e88" member_type: VOTER last_known_addr { host: "127.12.209.61" port: 44241 } } peers { permanent_uuid: "3ea183a890b84f408b20b55e9eb7c7ed" member_type: VOTER last_known_addr { host: "127.12.209.60" port: 43889 } }
I20250830 07:55:00.331377 16026 raft_consensus.cc:2802] T e74a3e4b3b234c41aca30f772525652e P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:55:00.331460 16026 raft_consensus.cc:491] T e74a3e4b3b234c41aca30f772525652e P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:55:00.331522 16026 raft_consensus.cc:3058] T e74a3e4b3b234c41aca30f772525652e P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:55:00.331840 13701 leader_election.cc:304] T 0c70140d87d34bde919714f08a5c94d4 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:55:00.332165 15720 raft_consensus.cc:2802] T 0c70140d87d34bde919714f08a5c94d4 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election won for term 1
I20250830 07:55:00.332260 15720 raft_consensus.cc:695] T 0c70140d87d34bde919714f08a5c94d4 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 LEADER]: Becoming Leader. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Running, Role: LEADER
I20250830 07:55:00.332433 15720 consensus_queue.cc:237] T 0c70140d87d34bde919714f08a5c94d4 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:00.332628 16034 ts_tablet_manager.cc:1939] T 0ceccc5f18294356894695fe08d73e30 P 6b5e454d98894637b466ea27f1b647f9: Deleting consensus metadata
I20250830 07:55:00.333153 13220 catalog_manager.cc:4928] TS 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): tablet 0ceccc5f18294356894695fe08d73e30 (table default.Table_32d032fe8fba47348e797c68bb7ea866 [id=0e99ba575a7a4f8dae74a98627249018]) successfully deleted
I20250830 07:55:00.334036 16026 raft_consensus.cc:513] T e74a3e4b3b234c41aca30f772525652e P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:00.335484 16026 leader_election.cc:290] T e74a3e4b3b234c41aca30f772525652e P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Requested vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
I20250830 07:55:00.335767 13886 consensus_queue.cc:260] T 6720d2b945814305845beea0a2cb9912 P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:00.342240 13886 ts_tablet_manager.cc:1428] T 6720d2b945814305845beea0a2cb9912 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.014s user 0.001s sys 0.001s
I20250830 07:55:00.342540 13886 tablet_bootstrap.cc:492] T 135d754d83ad422eb05909d2daa19d34 P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:55:00.343984 13886 tablet_bootstrap.cc:654] T 135d754d83ad422eb05909d2daa19d34 P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:55:00.344411 13887 raft_consensus.cc:357] T ccc9091018cb48ffb2affd98e8bbfa05 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:00.344597 13887 raft_consensus.cc:383] T ccc9091018cb48ffb2affd98e8bbfa05 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:55:00.344666 13887 raft_consensus.cc:738] T ccc9091018cb48ffb2affd98e8bbfa05 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:55:00.344846 13887 consensus_queue.cc:260] T ccc9091018cb48ffb2affd98e8bbfa05 P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:00.345309 13887 ts_tablet_manager.cc:1428] T ccc9091018cb48ffb2affd98e8bbfa05 P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.025s user 0.000s sys 0.001s
I20250830 07:55:00.345541 15481 raft_consensus.cc:491] T b6717031830f4c57967e87ce077ddb21 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:55:00.345592 13887 tablet_bootstrap.cc:492] T d94215b0b1f142178f0b791518d1baf2 P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:55:00.345705 15481 raft_consensus.cc:513] T b6717031830f4c57967e87ce077ddb21 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:00.346622 15481 leader_election.cc:290] T b6717031830f4c57967e87ce077ddb21 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
I20250830 07:55:00.349905 13886 tablet_bootstrap.cc:492] T 135d754d83ad422eb05909d2daa19d34 P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:55:00.350036 13886 ts_tablet_manager.cc:1397] T 135d754d83ad422eb05909d2daa19d34 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.008s user 0.004s sys 0.000s
I20250830 07:55:00.350617 13886 raft_consensus.cc:357] T 135d754d83ad422eb05909d2daa19d34 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:00.350766 13886 raft_consensus.cc:383] T 135d754d83ad422eb05909d2daa19d34 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:55:00.350812 13886 raft_consensus.cc:738] T 135d754d83ad422eb05909d2daa19d34 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:55:00.351016 13886 consensus_queue.cc:260] T 135d754d83ad422eb05909d2daa19d34 P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:00.351440 13886 ts_tablet_manager.cc:1428] T 135d754d83ad422eb05909d2daa19d34 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.001s user 0.000s sys 0.002s
I20250830 07:55:00.351701 13886 tablet_bootstrap.cc:492] T b2248b305c9f448a9e30661142ad10ea P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:55:00.353356 13886 tablet_bootstrap.cc:654] T b2248b305c9f448a9e30661142ad10ea P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:55:00.361563 16092 leader_election.cc:290] T 00000000000000000000000000000000 P 3ea183a890b84f408b20b55e9eb7c7ed [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fea6152429cc4e79a25b18e02aafae57 (127.12.209.62:39725), 5e9d6449ae824acab24c459a72075e88 (127.12.209.61:44241)
I20250830 07:55:00.364795 13562 leader_election.cc:304] T e72402ca3cdf452fa8f4534c67226253 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b5e454d98894637b466ea27f1b647f9; no voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:55:00.365171 13701 leader_election.cc:304] T 1db4109dc43b489d89c5de9eeb64a771 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters:
I20250830 07:55:00.365559 15481 raft_consensus.cc:2802] T 1db4109dc43b489d89c5de9eeb64a771 P 9b057ade5dce45af9f8bf0bedf8b917f [term 2 FOLLOWER]: Leader election won for term 2
I20250830 07:55:00.365718 15481 raft_consensus.cc:695] T 1db4109dc43b489d89c5de9eeb64a771 P 9b057ade5dce45af9f8bf0bedf8b917f [term 2 LEADER]: Becoming Leader. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Running, Role: LEADER
I20250830 07:55:00.365975 15481 consensus_queue.cc:237] T 1db4109dc43b489d89c5de9eeb64a771 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:00.374411 13701 leader_election.cc:304] T 1fee3e58f31b4befa42ffbb8d7bd6f4e P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters:
W20250830 07:55:00.374727 13701 consensus_peers.cc:489] T e6b7646588fe4134b2db62ff84ca4791 P 9b057ade5dce45af9f8bf0bedf8b917f -> Peer 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): Couldn't send request to peer 2065c332f15a4739899af79f3669c3ba. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e6b7646588fe4134b2db62ff84ca4791. This is attempt 6: this message will repeat every 5th retry.
I20250830 07:55:00.375468 16026 raft_consensus.cc:2802] T 1fee3e58f31b4befa42ffbb8d7bd6f4e P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:55:00.375536 16026 raft_consensus.cc:491] T 1fee3e58f31b4befa42ffbb8d7bd6f4e P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:55:00.375587 16026 raft_consensus.cc:3058] T 1fee3e58f31b4befa42ffbb8d7bd6f4e P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:55:00.377924 16026 raft_consensus.cc:513] T 1fee3e58f31b4befa42ffbb8d7bd6f4e P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:00.378384 16026 leader_election.cc:290] T 1fee3e58f31b4befa42ffbb8d7bd6f4e P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Requested vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
I20250830 07:55:00.386317 16074 raft_consensus.cc:2747] T e72402ca3cdf452fa8f4534c67226253 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20250830 07:55:00.388103 13703 consensus_peers.cc:489] T 2f3bec2c98574a9393e0fae77e228ce0 P 9b057ade5dce45af9f8bf0bedf8b917f -> Peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Couldn't send request to peer 6b5e454d98894637b466ea27f1b647f9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20250830 07:55:00.388146 13423 leader_election.cc:343] T 1ca83bbf848744f38206ceb4126271be P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
W20250830 07:55:00.388329 13703 leader_election.cc:343] T 1db4109dc43b489d89c5de9eeb64a771 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
W20250830 07:55:00.388342 13423 leader_election.cc:343] T 1db4109dc43b489d89c5de9eeb64a771 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
W20250830 07:55:00.388618 13703 leader_election.cc:343] T 1fee3e58f31b4befa42ffbb8d7bd6f4e P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:55:00.414299 13422 leader_election.cc:304] T 1db4109dc43b489d89c5de9eeb64a771 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:55:00.414615 16081 raft_consensus.cc:2762] T 1db4109dc43b489d89c5de9eeb64a771 P 2065c332f15a4739899af79f3669c3ba [term 2 FOLLOWER]: Leader election decision vote started in defunct term 1: won
I20250830 07:55:00.414762 13422 leader_election.cc:304] T e74a3e4b3b234c41aca30f772525652e P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
W20250830 07:55:00.415141 13422 leader_election.cc:343] T 1ca83bbf848744f38206ceb4126271be P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:55:00.415171 16081 raft_consensus.cc:2802] T e74a3e4b3b234c41aca30f772525652e P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:55:00.415364 16081 raft_consensus.cc:491] T e74a3e4b3b234c41aca30f772525652e P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:55:00.415454 16081 raft_consensus.cc:3058] T e74a3e4b3b234c41aca30f772525652e P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:55:00.415500 13887 tablet_bootstrap.cc:654] T d94215b0b1f142178f0b791518d1baf2 P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:55:00.415259 13422 leader_election.cc:304] T 1ca83bbf848744f38206ceb4126271be P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba; no voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:55:00.417194 16078 raft_consensus.cc:2747] T 1ca83bbf848744f38206ceb4126271be P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20250830 07:55:00.417459 15746 lock_manager.cc:585] Waited 4 seconds to obtain row lock on key '<redacted>' (key hash 4012713805250960239) tablet 00000000000000000000000000000000 cur holder 0x61700003a700
I20250830 07:55:00.418300 16081 raft_consensus.cc:513] T e74a3e4b3b234c41aca30f772525652e P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:00.419533 16081 leader_election.cc:290] T e74a3e4b3b234c41aca30f772525652e P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 election: Requested vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:55:00.427210 13882 tablet_bootstrap.cc:492] T 208995abd6d44dbea3b5ebbea27d6a39 P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:55:00.427343 13882 ts_tablet_manager.cc:1397] T 208995abd6d44dbea3b5ebbea27d6a39 P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.172s user 0.006s sys 0.002s
W20250830 07:55:00.427449 13701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.209.1:45325, user_credentials={real_user=slave}} blocked reactor thread for 52572.5us
I20250830 07:55:00.428213 13882 raft_consensus.cc:357] T 208995abd6d44dbea3b5ebbea27d6a39 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:00.428401 13882 raft_consensus.cc:383] T 208995abd6d44dbea3b5ebbea27d6a39 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:55:00.428475 13882 raft_consensus.cc:738] T 208995abd6d44dbea3b5ebbea27d6a39 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:55:00.428696 13882 consensus_queue.cc:260] T 208995abd6d44dbea3b5ebbea27d6a39 P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:00.429392 13882 ts_tablet_manager.cc:1428] T 208995abd6d44dbea3b5ebbea27d6a39 P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20250830 07:55:00.429704 13882 tablet_bootstrap.cc:492] T 579324e1f6474d398db10da3093650dd P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:55:00.430178 15603 consensus_queue.cc:1035] T 2c4c3c61cddf42668d3a09f4fbc5f641 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:55:00.431808 13484 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "34199145292d4ddb8c603e5c581f1d15" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba"
I20250830 07:55:00.432032 13484 raft_consensus.cc:3058] T 34199145292d4ddb8c603e5c581f1d15 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:55:00.435009 13484 raft_consensus.cc:2466] T 34199145292d4ddb8c603e5c581f1d15 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 1.
I20250830 07:55:00.435810 13629 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "34199145292d4ddb8c603e5c581f1d15" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9"
I20250830 07:55:00.437252 13629 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "e74a3e4b3b234c41aca30f772525652e" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9"
I20250830 07:55:00.442996 13488 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "e74a3e4b3b234c41aca30f772525652e" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba"
I20250830 07:55:00.443290 13488 raft_consensus.cc:2391] T e74a3e4b3b234c41aca30f772525652e P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 9b057ade5dce45af9f8bf0bedf8b917f in current term 1: Already voted for candidate 2065c332f15a4739899af79f3669c3ba in this term.
I20250830 07:55:00.444087 13488 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "b6717031830f4c57967e87ce077ddb21" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:55:00.445590 13629 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "b6717031830f4c57967e87ce077ddb21" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:55:00.450811 13887 tablet_bootstrap.cc:492] T d94215b0b1f142178f0b791518d1baf2 P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:55:00.451054 13887 ts_tablet_manager.cc:1397] T d94215b0b1f142178f0b791518d1baf2 P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.106s user 0.002s sys 0.001s
I20250830 07:55:00.452010 13887 raft_consensus.cc:357] T d94215b0b1f142178f0b791518d1baf2 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:00.452291 13887 raft_consensus.cc:383] T d94215b0b1f142178f0b791518d1baf2 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:55:00.452394 13887 raft_consensus.cc:738] T d94215b0b1f142178f0b791518d1baf2 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:55:00.452682 13887 consensus_queue.cc:260] T d94215b0b1f142178f0b791518d1baf2 P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:00.453336 13887 ts_tablet_manager.cc:1428] T d94215b0b1f142178f0b791518d1baf2 P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20250830 07:55:00.453712 13887 tablet_bootstrap.cc:492] T adbacbbb13d840a29d8d7d08ea04f6b1 P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:55:00.455204 13887 tablet_bootstrap.cc:654] T adbacbbb13d840a29d8d7d08ea04f6b1 P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:55:00.456900 13629 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "1fee3e58f31b4befa42ffbb8d7bd6f4e" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9"
I20250830 07:55:00.460019 13629 raft_consensus.cc:3058] T 66432e73deea433d9df565d5fcace647 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:55:00.463460 13882 tablet_bootstrap.cc:654] T 579324e1f6474d398db10da3093650dd P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
I20250830 07:55:00.464936 13488 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "1fee3e58f31b4befa42ffbb8d7bd6f4e" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba"
I20250830 07:55:00.465322 13488 raft_consensus.cc:3058] T 1fee3e58f31b4befa42ffbb8d7bd6f4e P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:55:00.469595 13488 raft_consensus.cc:2466] T 1fee3e58f31b4befa42ffbb8d7bd6f4e P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 1.
I20250830 07:55:00.484136 13624 raft_consensus.cc:3058] T 208995abd6d44dbea3b5ebbea27d6a39 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:55:00.488090 13886 tablet_bootstrap.cc:492] T b2248b305c9f448a9e30661142ad10ea P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:55:00.489202 13886 ts_tablet_manager.cc:1397] T b2248b305c9f448a9e30661142ad10ea P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.138s user 0.020s sys 0.032s
I20250830 07:55:00.496892 13886 raft_consensus.cc:357] T b2248b305c9f448a9e30661142ad10ea P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:00.500020 13886 raft_consensus.cc:383] T b2248b305c9f448a9e30661142ad10ea P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:55:00.500824 13886 raft_consensus.cc:738] T b2248b305c9f448a9e30661142ad10ea P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
W20250830 07:55:00.502897 13423 consensus_peers.cc:489] T 2e63eac2579844ef83bf43f1e6d58634 P 2065c332f15a4739899af79f3669c3ba -> Peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Couldn't send request to peer 6b5e454d98894637b466ea27f1b647f9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20250830 07:55:00.505053 13766 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "e74a3e4b3b234c41aca30f772525652e" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f"
I20250830 07:55:00.503163 13886 consensus_queue.cc:260] T b2248b305c9f448a9e30661142ad10ea P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:00.505259 13766 raft_consensus.cc:2391] T e74a3e4b3b234c41aca30f772525652e P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 2065c332f15a4739899af79f3669c3ba in current term 1: Already voted for candidate 9b057ade5dce45af9f8bf0bedf8b917f in this term.
I20250830 07:55:00.506717 13701 leader_election.cc:304] T 34199145292d4ddb8c603e5c581f1d15 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters:
I20250830 07:55:00.506979 16100 raft_consensus.cc:2802] T 34199145292d4ddb8c603e5c581f1d15 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election won for term 1
I20250830 07:55:00.507093 16100 raft_consensus.cc:695] T 34199145292d4ddb8c603e5c581f1d15 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 LEADER]: Becoming Leader. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Running, Role: LEADER
I20250830 07:55:00.507337 16100 consensus_queue.cc:237] T 34199145292d4ddb8c603e5c581f1d15 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:00.510399 13886 ts_tablet_manager.cc:1428] T b2248b305c9f448a9e30661142ad10ea P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.020s user 0.003s sys 0.000s
I20250830 07:55:00.513484 13886 tablet_bootstrap.cc:492] T 50dfc24a0b9645e4860cd99b1df3bd61 P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
W20250830 07:55:00.515609 13703 leader_election.cc:343] T 34199145292d4ddb8c603e5c581f1d15 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
W20250830 07:55:00.515916 13703 consensus_peers.cc:489] T 2c4c3c61cddf42668d3a09f4fbc5f641 P 9b057ade5dce45af9f8bf0bedf8b917f -> Peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Couldn't send request to peer 6b5e454d98894637b466ea27f1b647f9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20250830 07:55:00.516189 13703 leader_election.cc:343] T e74a3e4b3b234c41aca30f772525652e P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
W20250830 07:55:00.516356 13703 leader_election.cc:343] T b6717031830f4c57967e87ce077ddb21 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
W20250830 07:55:00.516551 13703 leader_election.cc:343] T 1fee3e58f31b4befa42ffbb8d7bd6f4e P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:55:00.517396 15608 consensus_queue.cc:1035] T 66432e73deea433d9df565d5fcace647 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:55:00.520506 13701 leader_election.cc:304] T e74a3e4b3b234c41aca30f772525652e P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 2065c332f15a4739899af79f3669c3ba, 6b5e454d98894637b466ea27f1b647f9
I20250830 07:55:00.520720 15720 raft_consensus.cc:2747] T e74a3e4b3b234c41aca30f772525652e P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20250830 07:55:00.521400 13887 tablet_bootstrap.cc:492] T adbacbbb13d840a29d8d7d08ea04f6b1 P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:55:00.521534 13887 ts_tablet_manager.cc:1397] T adbacbbb13d840a29d8d7d08ea04f6b1 P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.068s user 0.002s sys 0.000s
W20250830 07:55:00.523123 13701 leader_election.cc:343] T b6717031830f4c57967e87ce077ddb21 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:55:00.523223 13701 leader_election.cc:304] T b6717031830f4c57967e87ce077ddb21 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 2065c332f15a4739899af79f3669c3ba, 6b5e454d98894637b466ea27f1b647f9
I20250830 07:55:00.523430 15720 raft_consensus.cc:2747] T b6717031830f4c57967e87ce077ddb21 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:55:00.523926 15720 consensus_queue.cc:1035] T 2f3bec2c98574a9393e0fae77e228ce0 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:55:00.526408 13701 leader_election.cc:304] T 1fee3e58f31b4befa42ffbb8d7bd6f4e P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:55:00.526769 16100 raft_consensus.cc:2802] T 1fee3e58f31b4befa42ffbb8d7bd6f4e P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election won for term 1
I20250830 07:55:00.526993 16100 raft_consensus.cc:695] T 1fee3e58f31b4befa42ffbb8d7bd6f4e P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 LEADER]: Becoming Leader. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Running, Role: LEADER
I20250830 07:55:00.527211 16100 consensus_queue.cc:237] T 1fee3e58f31b4befa42ffbb8d7bd6f4e P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:00.529318 15603 consensus_queue.cc:1035] T 66432e73deea433d9df565d5fcace647 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:55:00.532521 13886 tablet_bootstrap.cc:654] T 50dfc24a0b9645e4860cd99b1df3bd61 P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:55:00.541205 13887 raft_consensus.cc:357] T adbacbbb13d840a29d8d7d08ea04f6b1 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:00.541509 13887 raft_consensus.cc:383] T adbacbbb13d840a29d8d7d08ea04f6b1 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:55:00.543491 13887 raft_consensus.cc:738] T adbacbbb13d840a29d8d7d08ea04f6b1 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:55:00.544468 13887 consensus_queue.cc:260] T adbacbbb13d840a29d8d7d08ea04f6b1 P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:00.548863 15603 consensus_queue.cc:1035] T ddedd1f141c147c69f178c6cd2b287da P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:55:00.550136 13624 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "e74a3e4b3b234c41aca30f772525652e" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9"
I20250830 07:55:00.553771 15976 consensus_queue.cc:1035] T 2c31d119743f49589703c434ac6c7548 P 2065c332f15a4739899af79f3669c3ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:55:00.562697 13882 tablet_bootstrap.cc:492] T 579324e1f6474d398db10da3093650dd P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:55:00.562822 13882 ts_tablet_manager.cc:1397] T 579324e1f6474d398db10da3093650dd P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.133s user 0.016s sys 0.000s
I20250830 07:55:00.563067 13887 ts_tablet_manager.cc:1428] T adbacbbb13d840a29d8d7d08ea04f6b1 P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.041s user 0.002s sys 0.000s
I20250830 07:55:00.563337 13887 tablet_bootstrap.cc:492] T e7e9d2e9b1ca4ddfb0c6a7bced613c35 P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:55:00.563571 13882 raft_consensus.cc:357] T 579324e1f6474d398db10da3093650dd P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:00.563758 13882 raft_consensus.cc:383] T 579324e1f6474d398db10da3093650dd P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:55:00.563814 13882 raft_consensus.cc:738] T 579324e1f6474d398db10da3093650dd P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:55:00.564100 13882 consensus_queue.cc:260] T 579324e1f6474d398db10da3093650dd P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:00.564778 13882 ts_tablet_manager.cc:1428] T 579324e1f6474d398db10da3093650dd P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20250830 07:55:00.565042 13882 tablet_bootstrap.cc:492] T 509e08290f3842cfbde8b74ff9f4f70f P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
W20250830 07:55:00.565678 13423 leader_election.cc:343] T e74a3e4b3b234c41aca30f772525652e P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:55:00.565785 13423 leader_election.cc:304] T e74a3e4b3b234c41aca30f772525652e P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba; no voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:55:00.567847 13882 tablet_bootstrap.cc:654] T 509e08290f3842cfbde8b74ff9f4f70f P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
I20250830 07:55:00.568218 16079 consensus_queue.cc:1035] T 2e63eac2579844ef83bf43f1e6d58634 P 2065c332f15a4739899af79f3669c3ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:55:00.568588 15919 raft_consensus.cc:2747] T e74a3e4b3b234c41aca30f772525652e P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
W20250830 07:55:00.568778 13423 consensus_peers.cc:489] T 2c31d119743f49589703c434ac6c7548 P 2065c332f15a4739899af79f3669c3ba -> Peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Couldn't send request to peer 6b5e454d98894637b466ea27f1b647f9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20250830 07:55:00.574875 13886 tablet_bootstrap.cc:492] T 50dfc24a0b9645e4860cd99b1df3bd61 P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:55:00.575101 13886 ts_tablet_manager.cc:1397] T 50dfc24a0b9645e4860cd99b1df3bd61 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.062s user 0.003s sys 0.004s
I20250830 07:55:00.576293 13886 raft_consensus.cc:357] T 50dfc24a0b9645e4860cd99b1df3bd61 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:00.576570 13886 raft_consensus.cc:383] T 50dfc24a0b9645e4860cd99b1df3bd61 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:55:00.576694 13886 raft_consensus.cc:738] T 50dfc24a0b9645e4860cd99b1df3bd61 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:55:00.577059 13886 consensus_queue.cc:260] T 50dfc24a0b9645e4860cd99b1df3bd61 P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:00.577314 16079 raft_consensus.cc:491] T a36f38ada7314165a5e9d6ee7bbf69e3 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:55:00.577426 16079 raft_consensus.cc:513] T a36f38ada7314165a5e9d6ee7bbf69e3 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:00.577912 13886 ts_tablet_manager.cc:1428] T 50dfc24a0b9645e4860cd99b1df3bd61 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20250830 07:55:00.577925 16079 leader_election.cc:290] T a36f38ada7314165a5e9d6ee7bbf69e3 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:55:00.578389 13886 tablet_bootstrap.cc:492] T adbacbbb13d840a29d8d7d08ea04f6b1 P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:55:00.584821 13887 tablet_bootstrap.cc:654] T e7e9d2e9b1ca4ddfb0c6a7bced613c35 P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:55:00.585985 13774 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "a36f38ada7314165a5e9d6ee7bbf69e3" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:55:00.591477 16079 raft_consensus.cc:491] T 122bec4220c74dfaa8228f6d153cd50e P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:55:00.591610 16079 raft_consensus.cc:513] T 122bec4220c74dfaa8228f6d153cd50e P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:00.592118 16079 leader_election.cc:290] T 122bec4220c74dfaa8228f6d153cd50e P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:55:00.594605 13886 tablet_bootstrap.cc:654] T adbacbbb13d840a29d8d7d08ea04f6b1 P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:55:00.617884 13887 tablet_bootstrap.cc:492] T e7e9d2e9b1ca4ddfb0c6a7bced613c35 P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:55:00.618031 13887 ts_tablet_manager.cc:1397] T e7e9d2e9b1ca4ddfb0c6a7bced613c35 P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.055s user 0.000s sys 0.003s
I20250830 07:55:00.618857 13887 raft_consensus.cc:357] T e7e9d2e9b1ca4ddfb0c6a7bced613c35 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:00.619040 13887 raft_consensus.cc:383] T e7e9d2e9b1ca4ddfb0c6a7bced613c35 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:55:00.619110 13887 raft_consensus.cc:738] T e7e9d2e9b1ca4ddfb0c6a7bced613c35 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:55:00.619372 13887 consensus_queue.cc:260] T e7e9d2e9b1ca4ddfb0c6a7bced613c35 P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:00.619971 13887 ts_tablet_manager.cc:1428] T e7e9d2e9b1ca4ddfb0c6a7bced613c35 P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20250830 07:55:00.620277 13887 tablet_bootstrap.cc:492] T 7e9d6af1d7fc4d4b961583b44f2f962a P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:55:00.621965 13887 tablet_bootstrap.cc:654] T 7e9d6af1d7fc4d4b961583b44f2f962a P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:55:00.627100 13615 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "a36f38ada7314165a5e9d6ee7bbf69e3" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:55:00.627583 15992 raft_consensus.cc:491] T 5e2da5434e95445aa4deafce7fde0c6c P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20250830 07:55:00.626904 13703 consensus_peers.cc:489] T 52df62f7f1aa4b38be89f6198cf01f24 P 9b057ade5dce45af9f8bf0bedf8b917f -> Peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Couldn't send request to peer 6b5e454d98894637b466ea27f1b647f9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20250830 07:55:00.627691 15992 raft_consensus.cc:513] T 5e2da5434e95445aa4deafce7fde0c6c P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
W20250830 07:55:00.627862 13703 consensus_peers.cc:489] T 0ceccc5f18294356894695fe08d73e30 P 9b057ade5dce45af9f8bf0bedf8b917f -> Peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Couldn't send request to peer 6b5e454d98894637b466ea27f1b647f9. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0ceccc5f18294356894695fe08d73e30. This is attempt 1: this message will repeat every 5th retry.
I20250830 07:55:00.628159 15992 leader_election.cc:290] T 5e2da5434e95445aa4deafce7fde0c6c P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
W20250830 07:55:00.628252 13703 consensus_peers.cc:489] T 8c01157324ba45bda5b3a9a328bf319b P 9b057ade5dce45af9f8bf0bedf8b917f -> Peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Couldn't send request to peer 6b5e454d98894637b466ea27f1b647f9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20250830 07:55:00.628501 13703 consensus_peers.cc:489] T 3d9c884ac05e44ddb59f96588fdd6f4b P 9b057ade5dce45af9f8bf0bedf8b917f -> Peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Couldn't send request to peer 6b5e454d98894637b466ea27f1b647f9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20250830 07:55:00.629501 13423 leader_election.cc:343] T a36f38ada7314165a5e9d6ee7bbf69e3 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:55:00.629577 13772 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "5e2da5434e95445aa4deafce7fde0c6c" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:55:00.629896 15582 raft_consensus.cc:491] T 579324e1f6474d398db10da3093650dd P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:55:00.630034 15582 raft_consensus.cc:513] T 579324e1f6474d398db10da3093650dd P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:00.630669 15582 leader_election.cc:290] T 579324e1f6474d398db10da3093650dd P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:55:00.631500 13611 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "122bec4220c74dfaa8228f6d153cd50e" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
W20250830 07:55:00.631918 13423 leader_election.cc:343] T 122bec4220c74dfaa8228f6d153cd50e P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:55:00.635054 13772 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "579324e1f6474d398db10da3093650dd" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:55:00.639787 13882 tablet_bootstrap.cc:492] T 509e08290f3842cfbde8b74ff9f4f70f P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:55:00.639962 13882 ts_tablet_manager.cc:1397] T 509e08290f3842cfbde8b74ff9f4f70f P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.075s user 0.006s sys 0.000s
I20250830 07:55:00.641027 13882 raft_consensus.cc:357] T 509e08290f3842cfbde8b74ff9f4f70f P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:00.641121 13886 tablet_bootstrap.cc:492] T adbacbbb13d840a29d8d7d08ea04f6b1 P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:55:00.641207 13882 raft_consensus.cc:383] T 509e08290f3842cfbde8b74ff9f4f70f P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:55:00.641270 13882 raft_consensus.cc:738] T 509e08290f3842cfbde8b74ff9f4f70f P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:55:00.641345 13886 ts_tablet_manager.cc:1397] T adbacbbb13d840a29d8d7d08ea04f6b1 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.063s user 0.005s sys 0.002s
I20250830 07:55:00.641489 13882 consensus_queue.cc:260] T 509e08290f3842cfbde8b74ff9f4f70f P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:00.642092 13882 ts_tablet_manager.cc:1428] T 509e08290f3842cfbde8b74ff9f4f70f P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20250830 07:55:00.642367 13882 tablet_bootstrap.cc:492] T f332d1b56d924c91a79cf6572dea1cd2 P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:55:00.642722 13886 raft_consensus.cc:357] T adbacbbb13d840a29d8d7d08ea04f6b1 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:00.643152 13886 raft_consensus.cc:383] T adbacbbb13d840a29d8d7d08ea04f6b1 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:55:00.643203 16100 raft_consensus.cc:491] T 135d754d83ad422eb05909d2daa19d34 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:55:00.643290 13886 raft_consensus.cc:738] T adbacbbb13d840a29d8d7d08ea04f6b1 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:55:00.644021 13882 tablet_bootstrap.cc:654] T f332d1b56d924c91a79cf6572dea1cd2 P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
I20250830 07:55:00.644155 13886 consensus_queue.cc:260] T adbacbbb13d840a29d8d7d08ea04f6b1 P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:00.643400 16100 raft_consensus.cc:513] T 135d754d83ad422eb05909d2daa19d34 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:00.645872 13624 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "135d754d83ad422eb05909d2daa19d34" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:55:00.646481 16100 leader_election.cc:290] T 135d754d83ad422eb05909d2daa19d34 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
I20250830 07:55:00.646781 13886 ts_tablet_manager.cc:1428] T adbacbbb13d840a29d8d7d08ea04f6b1 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
W20250830 07:55:00.646793 13703 leader_election.cc:343] T 135d754d83ad422eb05909d2daa19d34 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:55:00.647495 13886 tablet_bootstrap.cc:492] T d1d5e0d40a91457da65a0e925289309e P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:55:00.666553 13886 tablet_bootstrap.cc:654] T d1d5e0d40a91457da65a0e925289309e P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:55:00.668670 13471 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "579324e1f6474d398db10da3093650dd" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:55:00.669420 13561 leader_election.cc:304] T 579324e1f6474d398db10da3093650dd P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b5e454d98894637b466ea27f1b647f9; no voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:55:00.669776 16074 raft_consensus.cc:2747] T 579324e1f6474d398db10da3093650dd P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:55:00.669883 13482 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "5e2da5434e95445aa4deafce7fde0c6c" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:55:00.670090 13482 raft_consensus.cc:2391] T 5e2da5434e95445aa4deafce7fde0c6c P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b5e454d98894637b466ea27f1b647f9 in current term 1: Already voted for candidate 9b057ade5dce45af9f8bf0bedf8b917f in this term.
I20250830 07:55:00.670554 13561 leader_election.cc:304] T 5e2da5434e95445aa4deafce7fde0c6c P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b5e454d98894637b466ea27f1b647f9; no voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:55:00.670747 16074 raft_consensus.cc:3058] T 5e2da5434e95445aa4deafce7fde0c6c P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:55:00.672076 13887 tablet_bootstrap.cc:492] T 7e9d6af1d7fc4d4b961583b44f2f962a P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:55:00.672250 13887 ts_tablet_manager.cc:1397] T 7e9d6af1d7fc4d4b961583b44f2f962a P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.052s user 0.002s sys 0.002s
I20250830 07:55:00.673053 13887 raft_consensus.cc:357] T 7e9d6af1d7fc4d4b961583b44f2f962a P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:00.673193 16074 raft_consensus.cc:2747] T 5e2da5434e95445aa4deafce7fde0c6c P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:55:00.673306 13887 raft_consensus.cc:383] T 7e9d6af1d7fc4d4b961583b44f2f962a P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:55:00.673411 13887 raft_consensus.cc:738] T 7e9d6af1d7fc4d4b961583b44f2f962a P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:55:00.673671 13887 consensus_queue.cc:260] T 7e9d6af1d7fc4d4b961583b44f2f962a P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:00.674296 13887 ts_tablet_manager.cc:1428] T 7e9d6af1d7fc4d4b961583b44f2f962a P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20250830 07:55:00.674562 13887 tablet_bootstrap.cc:492] T ad7a45187569416bad6c71db9f8ab702 P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:55:00.676136 13887 tablet_bootstrap.cc:654] T ad7a45187569416bad6c71db9f8ab702 P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:55:00.683710 13882 tablet_bootstrap.cc:492] T f332d1b56d924c91a79cf6572dea1cd2 P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:55:00.683840 13882 ts_tablet_manager.cc:1397] T f332d1b56d924c91a79cf6572dea1cd2 P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.042s user 0.003s sys 0.000s
I20250830 07:55:00.685252 13882 raft_consensus.cc:357] T f332d1b56d924c91a79cf6572dea1cd2 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:00.685426 13882 raft_consensus.cc:383] T f332d1b56d924c91a79cf6572dea1cd2 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:55:00.685489 13882 raft_consensus.cc:738] T f332d1b56d924c91a79cf6572dea1cd2 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:55:00.685716 13882 consensus_queue.cc:260] T f332d1b56d924c91a79cf6572dea1cd2 P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:00.686347 13882 ts_tablet_manager.cc:1428] T f332d1b56d924c91a79cf6572dea1cd2 P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.002s user 0.002s sys 0.001s
I20250830 07:55:00.691179 13471 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "135d754d83ad422eb05909d2daa19d34" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:55:00.691381 13471 raft_consensus.cc:2466] T 135d754d83ad422eb05909d2daa19d34 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 0.
I20250830 07:55:00.693962 13882 tablet_bootstrap.cc:492] T 15f8fd7d9e6242c6b6c51251d618ef09 P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:55:00.696148 13772 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "122bec4220c74dfaa8228f6d153cd50e" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:55:00.700590 16100 consensus_queue.cc:1035] T c56e3a30c18640e68c8b0c4ff4251d96 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:55:00.695539 13882 tablet_bootstrap.cc:654] T 15f8fd7d9e6242c6b6c51251d618ef09 P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
I20250830 07:55:00.706959 15720 consensus_queue.cc:1035] T ed364f03bdad42b88e181b7d0e1e4011 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:55:00.707639 13701 leader_election.cc:304] T 135d754d83ad422eb05909d2daa19d34 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:55:00.707893 16100 raft_consensus.cc:2802] T 135d754d83ad422eb05909d2daa19d34 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:55:00.707971 16100 raft_consensus.cc:491] T 135d754d83ad422eb05909d2daa19d34 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:55:00.708038 16100 raft_consensus.cc:3058] T 135d754d83ad422eb05909d2daa19d34 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:55:00.710455 16100 raft_consensus.cc:513] T 135d754d83ad422eb05909d2daa19d34 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:00.711707 13624 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "135d754d83ad422eb05909d2daa19d34" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9"
W20250830 07:55:00.712205 13703 leader_election.cc:343] T 135d754d83ad422eb05909d2daa19d34 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:55:00.712785 16100 leader_election.cc:290] T 135d754d83ad422eb05909d2daa19d34 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Requested vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
W20250830 07:55:00.717582 13422 leader_election.cc:343] T a36f38ada7314165a5e9d6ee7bbf69e3 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:55:00.717716 13422 leader_election.cc:304] T a36f38ada7314165a5e9d6ee7bbf69e3 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba; no voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:55:00.717943 16079 raft_consensus.cc:2747] T a36f38ada7314165a5e9d6ee7bbf69e3 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:55:00.720993 13887 tablet_bootstrap.cc:492] T ad7a45187569416bad6c71db9f8ab702 P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:55:00.721235 13887 ts_tablet_manager.cc:1397] T ad7a45187569416bad6c71db9f8ab702 P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.047s user 0.006s sys 0.000s
I20250830 07:55:00.727641 13882 tablet_bootstrap.cc:492] T 15f8fd7d9e6242c6b6c51251d618ef09 P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:55:00.727767 13882 ts_tablet_manager.cc:1397] T 15f8fd7d9e6242c6b6c51251d618ef09 P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.034s user 0.000s sys 0.004s
I20250830 07:55:00.727831 13886 tablet_bootstrap.cc:492] T d1d5e0d40a91457da65a0e925289309e P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:55:00.728044 13886 ts_tablet_manager.cc:1397] T d1d5e0d40a91457da65a0e925289309e P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.081s user 0.002s sys 0.005s
I20250830 07:55:00.728686 13882 raft_consensus.cc:357] T 15f8fd7d9e6242c6b6c51251d618ef09 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:00.728849 13882 raft_consensus.cc:383] T 15f8fd7d9e6242c6b6c51251d618ef09 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:55:00.728911 13882 raft_consensus.cc:738] T 15f8fd7d9e6242c6b6c51251d618ef09 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:55:00.729125 13882 consensus_queue.cc:260] T 15f8fd7d9e6242c6b6c51251d618ef09 P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:00.726449 13887 raft_consensus.cc:357] T ad7a45187569416bad6c71db9f8ab702 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:00.729620 13882 ts_tablet_manager.cc:1428] T 15f8fd7d9e6242c6b6c51251d618ef09 P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20250830 07:55:00.729593 13887 raft_consensus.cc:383] T ad7a45187569416bad6c71db9f8ab702 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:55:00.729877 13887 raft_consensus.cc:738] T ad7a45187569416bad6c71db9f8ab702 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:55:00.729547 13886 raft_consensus.cc:357] T d1d5e0d40a91457da65a0e925289309e P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:00.731608 13886 raft_consensus.cc:383] T d1d5e0d40a91457da65a0e925289309e P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:55:00.731940 13886 raft_consensus.cc:738] T d1d5e0d40a91457da65a0e925289309e P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:55:00.732002 13887 consensus_queue.cc:260] T ad7a45187569416bad6c71db9f8ab702 P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:00.732494 13886 consensus_queue.cc:260] T d1d5e0d40a91457da65a0e925289309e P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:00.734468 13887 ts_tablet_manager.cc:1428] T ad7a45187569416bad6c71db9f8ab702 P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.013s user 0.002s sys 0.000s
I20250830 07:55:00.735738 13886 ts_tablet_manager.cc:1428] T d1d5e0d40a91457da65a0e925289309e P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.008s user 0.000s sys 0.002s
I20250830 07:55:00.738392 13886 tablet_bootstrap.cc:492] T cd9903bdfaef4139a1a582c54689da4a P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:55:00.737931 13887 tablet_bootstrap.cc:492] T 8ee98b748d0245bc8bf9eeac727b495e P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:55:00.738941 13882 tablet_bootstrap.cc:492] T ddedd1f141c147c69f178c6cd2b287da P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:55:00.741747 13882 tablet_bootstrap.cc:654] T ddedd1f141c147c69f178c6cd2b287da P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
I20250830 07:55:00.756057 13887 tablet_bootstrap.cc:654] T 8ee98b748d0245bc8bf9eeac727b495e P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:55:00.758800 13886 tablet_bootstrap.cc:654] T cd9903bdfaef4139a1a582c54689da4a P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
W20250830 07:55:00.759222 13422 leader_election.cc:343] T 122bec4220c74dfaa8228f6d153cd50e P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:55:00.759377 13422 leader_election.cc:304] T 122bec4220c74dfaa8228f6d153cd50e P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba; no voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:55:00.759619 16072 raft_consensus.cc:2747] T 122bec4220c74dfaa8228f6d153cd50e P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:55:00.761111 13481 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "135d754d83ad422eb05909d2daa19d34" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba"
I20250830 07:55:00.761265 13481 raft_consensus.cc:3058] T 135d754d83ad422eb05909d2daa19d34 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:55:00.763756 13882 tablet_bootstrap.cc:492] T ddedd1f141c147c69f178c6cd2b287da P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:55:00.763871 13882 ts_tablet_manager.cc:1397] T ddedd1f141c147c69f178c6cd2b287da P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.025s user 0.005s sys 0.000s
I20250830 07:55:00.764111 13481 raft_consensus.cc:2466] T 135d754d83ad422eb05909d2daa19d34 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 1.
I20250830 07:55:00.764588 13882 raft_consensus.cc:357] T ddedd1f141c147c69f178c6cd2b287da P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:00.764779 13882 raft_consensus.cc:383] T ddedd1f141c147c69f178c6cd2b287da P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:55:00.764833 13882 raft_consensus.cc:738] T ddedd1f141c147c69f178c6cd2b287da P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:55:00.765045 13882 consensus_queue.cc:260] T ddedd1f141c147c69f178c6cd2b287da P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:00.765610 13882 ts_tablet_manager.cc:1428] T ddedd1f141c147c69f178c6cd2b287da P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20250830 07:55:00.765864 13882 tablet_bootstrap.cc:492] T 1cf23cf78eee46be953bd701aa6bef07 P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:55:00.773386 13624 raft_consensus.cc:3058] T 579324e1f6474d398db10da3093650dd P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:55:00.778318 15980 raft_consensus.cc:491] T adbacbbb13d840a29d8d7d08ea04f6b1 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:55:00.778426 15980 raft_consensus.cc:513] T adbacbbb13d840a29d8d7d08ea04f6b1 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:00.778959 15980 leader_election.cc:290] T adbacbbb13d840a29d8d7d08ea04f6b1 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
I20250830 07:55:00.781488 13615 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "adbacbbb13d840a29d8d7d08ea04f6b1" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:55:00.782138 15919 raft_consensus.cc:491] T ccc9091018cb48ffb2affd98e8bbfa05 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:55:00.782286 15919 raft_consensus.cc:513] T ccc9091018cb48ffb2affd98e8bbfa05 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:00.782801 15919 leader_election.cc:290] T ccc9091018cb48ffb2affd98e8bbfa05 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:55:00.783051 13882 tablet_bootstrap.cc:654] T 1cf23cf78eee46be953bd701aa6bef07 P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
I20250830 07:55:00.784828 13701 leader_election.cc:304] T 135d754d83ad422eb05909d2daa19d34 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:55:00.785185 15603 raft_consensus.cc:2802] T 135d754d83ad422eb05909d2daa19d34 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election won for term 1
I20250830 07:55:00.785308 15603 raft_consensus.cc:695] T 135d754d83ad422eb05909d2daa19d34 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 LEADER]: Becoming Leader. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Running, Role: LEADER
I20250830 07:55:00.785516 15603 consensus_queue.cc:237] T 135d754d83ad422eb05909d2daa19d34 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
W20250830 07:55:00.785657 13703 leader_election.cc:343] T adbacbbb13d840a29d8d7d08ea04f6b1 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:55:00.785676 13615 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "ccc9091018cb48ffb2affd98e8bbfa05" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
W20250830 07:55:00.790062 13423 leader_election.cc:343] T ccc9091018cb48ffb2affd98e8bbfa05 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:55:00.792816 16101 raft_consensus.cc:491] T 6720d2b945814305845beea0a2cb9912 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:55:00.792912 16101 raft_consensus.cc:513] T 6720d2b945814305845beea0a2cb9912 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:00.793323 16101 leader_election.cc:290] T 6720d2b945814305845beea0a2cb9912 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
I20250830 07:55:00.797729 13615 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "6720d2b945814305845beea0a2cb9912" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
W20250830 07:55:00.800318 13703 leader_election.cc:343] T 6720d2b945814305845beea0a2cb9912 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:55:00.805794 13488 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "adbacbbb13d840a29d8d7d08ea04f6b1" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:55:00.806013 13488 raft_consensus.cc:2466] T adbacbbb13d840a29d8d7d08ea04f6b1 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 0.
I20250830 07:55:00.806456 13886 tablet_bootstrap.cc:492] T cd9903bdfaef4139a1a582c54689da4a P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:55:00.807327 13886 ts_tablet_manager.cc:1397] T cd9903bdfaef4139a1a582c54689da4a P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.070s user 0.006s sys 0.003s
I20250830 07:55:00.809163 13882 tablet_bootstrap.cc:492] T 1cf23cf78eee46be953bd701aa6bef07 P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:55:00.809278 13882 ts_tablet_manager.cc:1397] T 1cf23cf78eee46be953bd701aa6bef07 P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.043s user 0.001s sys 0.001s
I20250830 07:55:00.809506 16101 raft_consensus.cc:491] T a8660a6ff9254d4f9f0ef047b8682ed1 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:55:00.809607 16101 raft_consensus.cc:513] T a8660a6ff9254d4f9f0ef047b8682ed1 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:00.809971 13882 raft_consensus.cc:357] T 1cf23cf78eee46be953bd701aa6bef07 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:00.810078 16101 leader_election.cc:290] T a8660a6ff9254d4f9f0ef047b8682ed1 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
I20250830 07:55:00.810115 13882 raft_consensus.cc:383] T 1cf23cf78eee46be953bd701aa6bef07 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:55:00.810178 13882 raft_consensus.cc:738] T 1cf23cf78eee46be953bd701aa6bef07 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:55:00.810351 13882 consensus_queue.cc:260] T 1cf23cf78eee46be953bd701aa6bef07 P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:00.810809 13882 ts_tablet_manager.cc:1428] T 1cf23cf78eee46be953bd701aa6bef07 P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20250830 07:55:00.811089 13882 tablet_bootstrap.cc:492] T a0cf1de8485941eb8a557a6e2f783047 P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:55:00.812312 13615 raft_consensus.cc:3058] T 2b4103f07e96490488913059a95af0c3 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:55:00.812407 13886 raft_consensus.cc:357] T cd9903bdfaef4139a1a582c54689da4a P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:00.813206 13886 raft_consensus.cc:383] T cd9903bdfaef4139a1a582c54689da4a P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:55:00.813556 13886 raft_consensus.cc:738] T cd9903bdfaef4139a1a582c54689da4a P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:55:00.814356 13482 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "6720d2b945814305845beea0a2cb9912" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:55:00.814535 13482 raft_consensus.cc:2466] T 6720d2b945814305845beea0a2cb9912 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 0.
I20250830 07:55:00.815022 13611 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "a8660a6ff9254d4f9f0ef047b8682ed1" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:55:00.815169 13611 raft_consensus.cc:2466] T a8660a6ff9254d4f9f0ef047b8682ed1 P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 1.
I20250830 07:55:00.815498 13703 leader_election.cc:304] T a8660a6ff9254d4f9f0ef047b8682ed1 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f; no voters:
I20250830 07:55:00.815711 15608 raft_consensus.cc:2802] T a8660a6ff9254d4f9f0ef047b8682ed1 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20250830 07:55:00.815769 15608 raft_consensus.cc:491] T a8660a6ff9254d4f9f0ef047b8682ed1 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:55:00.815825 15608 raft_consensus.cc:3058] T a8660a6ff9254d4f9f0ef047b8682ed1 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Advancing to term 2
I20250830 07:55:00.817361 13887 tablet_bootstrap.cc:492] T 8ee98b748d0245bc8bf9eeac727b495e P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:55:00.817577 13482 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "a8660a6ff9254d4f9f0ef047b8682ed1" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:55:00.818176 13482 raft_consensus.cc:2466] T a8660a6ff9254d4f9f0ef047b8682ed1 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 1.
I20250830 07:55:00.818307 13887 ts_tablet_manager.cc:1397] T 8ee98b748d0245bc8bf9eeac727b495e P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.081s user 0.002s sys 0.006s
I20250830 07:55:00.818336 15608 raft_consensus.cc:513] T a8660a6ff9254d4f9f0ef047b8682ed1 P 9b057ade5dce45af9f8bf0bedf8b917f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:00.818900 15608 leader_election.cc:290] T a8660a6ff9254d4f9f0ef047b8682ed1 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 2 election: Requested vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
I20250830 07:55:00.819046 13766 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "ccc9091018cb48ffb2affd98e8bbfa05" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:55:00.819370 16100 consensus_queue.cc:1035] T 52df62f7f1aa4b38be89f6198cf01f24 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:55:00.819801 13882 tablet_bootstrap.cc:654] T a0cf1de8485941eb8a557a6e2f783047 P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
I20250830 07:55:00.819729 15980 consensus_queue.cc:1035] T 3d9c884ac05e44ddb59f96588fdd6f4b P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:55:00.819864 13887 raft_consensus.cc:357] T 8ee98b748d0245bc8bf9eeac727b495e P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:00.820210 13887 raft_consensus.cc:383] T 8ee98b748d0245bc8bf9eeac727b495e P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:55:00.820391 13887 raft_consensus.cc:738] T 8ee98b748d0245bc8bf9eeac727b495e P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:55:00.815243 13886 consensus_queue.cc:260] T cd9903bdfaef4139a1a582c54689da4a P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:00.820824 13887 consensus_queue.cc:260] T 8ee98b748d0245bc8bf9eeac727b495e P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:00.822247 13701 leader_election.cc:304] T adbacbbb13d840a29d8d7d08ea04f6b1 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:55:00.822497 15980 raft_consensus.cc:2802] T adbacbbb13d840a29d8d7d08ea04f6b1 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:55:00.822561 15980 raft_consensus.cc:491] T adbacbbb13d840a29d8d7d08ea04f6b1 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:55:00.822613 15980 raft_consensus.cc:3058] T adbacbbb13d840a29d8d7d08ea04f6b1 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:55:00.822775 13701 leader_election.cc:304] T 6720d2b945814305845beea0a2cb9912 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:55:00.822978 15863 raft_consensus.cc:2802] T 6720d2b945814305845beea0a2cb9912 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:55:00.823053 15863 raft_consensus.cc:491] T 6720d2b945814305845beea0a2cb9912 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:55:00.823129 15863 raft_consensus.cc:3058] T 6720d2b945814305845beea0a2cb9912 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:55:00.825073 13622 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "a8660a6ff9254d4f9f0ef047b8682ed1" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9"
I20250830 07:55:00.825215 13622 raft_consensus.cc:3058] T a8660a6ff9254d4f9f0ef047b8682ed1 P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Advancing to term 2
I20250830 07:55:00.826104 15980 raft_consensus.cc:513] T adbacbbb13d840a29d8d7d08ea04f6b1 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:00.825830 13886 ts_tablet_manager.cc:1428] T cd9903bdfaef4139a1a582c54689da4a P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.018s user 0.003s sys 0.000s
I20250830 07:55:00.826825 15980 leader_election.cc:290] T adbacbbb13d840a29d8d7d08ea04f6b1 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Requested vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
I20250830 07:55:00.826689 13887 ts_tablet_manager.cc:1428] T 8ee98b748d0245bc8bf9eeac727b495e P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.008s user 0.003s sys 0.000s
I20250830 07:55:00.827584 13622 raft_consensus.cc:2466] T a8660a6ff9254d4f9f0ef047b8682ed1 P 6b5e454d98894637b466ea27f1b647f9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 2.
I20250830 07:55:00.827768 13629 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "adbacbbb13d840a29d8d7d08ea04f6b1" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9"
I20250830 07:55:00.828786 15863 raft_consensus.cc:513] T 6720d2b945814305845beea0a2cb9912 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:00.829039 13887 tablet_bootstrap.cc:492] T 76dd9dd481fc427fb20f5091e4a3b738 P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:55:00.829313 13886 tablet_bootstrap.cc:492] T 2aea1a69d22544899b0218be7e0f8799 P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:55:00.829897 15863 leader_election.cc:290] T 6720d2b945814305845beea0a2cb9912 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Requested vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
I20250830 07:55:00.830404 13703 leader_election.cc:304] T a8660a6ff9254d4f9f0ef047b8682ed1 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f; no voters:
W20250830 07:55:00.830732 13703 leader_election.cc:343] T adbacbbb13d840a29d8d7d08ea04f6b1 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:55:00.830919 15863 raft_consensus.cc:2802] T a8660a6ff9254d4f9f0ef047b8682ed1 P 9b057ade5dce45af9f8bf0bedf8b917f [term 2 FOLLOWER]: Leader election won for term 2
I20250830 07:55:00.831096 15863 raft_consensus.cc:695] T a8660a6ff9254d4f9f0ef047b8682ed1 P 9b057ade5dce45af9f8bf0bedf8b917f [term 2 LEADER]: Becoming Leader. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Running, Role: LEADER
I20250830 07:55:00.831521 15863 consensus_queue.cc:237] T a8660a6ff9254d4f9f0ef047b8682ed1 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
W20250830 07:55:00.832453 13422 leader_election.cc:343] T ccc9091018cb48ffb2affd98e8bbfa05 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:55:00.832564 13422 leader_election.cc:304] T ccc9091018cb48ffb2affd98e8bbfa05 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba; no voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:55:00.832752 13615 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "6720d2b945814305845beea0a2cb9912" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9"
I20250830 07:55:00.835044 16072 raft_consensus.cc:2747] T ccc9091018cb48ffb2affd98e8bbfa05 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20250830 07:55:00.835748 13703 leader_election.cc:343] T 6720d2b945814305845beea0a2cb9912 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:55:00.836441 13482 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "a8660a6ff9254d4f9f0ef047b8682ed1" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba"
I20250830 07:55:00.836585 13482 raft_consensus.cc:3058] T a8660a6ff9254d4f9f0ef047b8682ed1 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Advancing to term 2
I20250830 07:55:00.839632 15992 raft_consensus.cc:491] T ddedd1f141c147c69f178c6cd2b287da P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:55:00.839777 15992 raft_consensus.cc:513] T ddedd1f141c147c69f178c6cd2b287da P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:00.840188 13482 raft_consensus.cc:2466] T a8660a6ff9254d4f9f0ef047b8682ed1 P 2065c332f15a4739899af79f3669c3ba [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 2.
I20250830 07:55:00.840346 15992 leader_election.cc:290] T ddedd1f141c147c69f178c6cd2b287da P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:55:00.841046 13488 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "ddedd1f141c147c69f178c6cd2b287da" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:55:00.843117 13766 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "ddedd1f141c147c69f178c6cd2b287da" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:55:00.844986 13562 leader_election.cc:304] T ddedd1f141c147c69f178c6cd2b287da P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b5e454d98894637b466ea27f1b647f9; no voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:55:00.845239 15992 raft_consensus.cc:2747] T ddedd1f141c147c69f178c6cd2b287da P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:55:00.846560 13887 tablet_bootstrap.cc:654] T 76dd9dd481fc427fb20f5091e4a3b738 P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:55:00.847086 13886 tablet_bootstrap.cc:654] T 2aea1a69d22544899b0218be7e0f8799 P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:55:00.854084 13882 tablet_bootstrap.cc:492] T a0cf1de8485941eb8a557a6e2f783047 P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:55:00.854465 13476 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "6720d2b945814305845beea0a2cb9912" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba"
I20250830 07:55:00.854631 13476 raft_consensus.cc:3058] T 6720d2b945814305845beea0a2cb9912 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:55:00.855468 13484 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "adbacbbb13d840a29d8d7d08ea04f6b1" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba"
I20250830 07:55:00.855657 13484 raft_consensus.cc:3058] T adbacbbb13d840a29d8d7d08ea04f6b1 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:55:00.855329 13882 ts_tablet_manager.cc:1397] T a0cf1de8485941eb8a557a6e2f783047 P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.044s user 0.004s sys 0.000s
I20250830 07:55:00.857600 13476 raft_consensus.cc:2466] T 6720d2b945814305845beea0a2cb9912 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 1.
I20250830 07:55:00.858537 13484 raft_consensus.cc:2466] T adbacbbb13d840a29d8d7d08ea04f6b1 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 1.
I20250830 07:55:00.859704 13887 tablet_bootstrap.cc:492] T 76dd9dd481fc427fb20f5091e4a3b738 P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:55:00.859833 13887 ts_tablet_manager.cc:1397] T 76dd9dd481fc427fb20f5091e4a3b738 P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.031s user 0.003s sys 0.002s
I20250830 07:55:00.860548 13887 raft_consensus.cc:357] T 76dd9dd481fc427fb20f5091e4a3b738 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:00.860700 13887 raft_consensus.cc:383] T 76dd9dd481fc427fb20f5091e4a3b738 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:55:00.860759 13887 raft_consensus.cc:738] T 76dd9dd481fc427fb20f5091e4a3b738 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:55:00.860931 13887 consensus_queue.cc:260] T 76dd9dd481fc427fb20f5091e4a3b738 P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:00.861552 13887 ts_tablet_manager.cc:1428] T 76dd9dd481fc427fb20f5091e4a3b738 P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20250830 07:55:00.861845 13887 tablet_bootstrap.cc:492] T 838616d8274648fc9ea4f1583bdb97f9 P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:55:00.861783 13882 raft_consensus.cc:357] T a0cf1de8485941eb8a557a6e2f783047 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:00.862895 13882 raft_consensus.cc:383] T a0cf1de8485941eb8a557a6e2f783047 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:55:00.863404 13887 tablet_bootstrap.cc:654] T 838616d8274648fc9ea4f1583bdb97f9 P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:55:00.863507 13882 raft_consensus.cc:738] T a0cf1de8485941eb8a557a6e2f783047 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:55:00.865337 13882 consensus_queue.cc:260] T a0cf1de8485941eb8a557a6e2f783047 P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:00.868923 13882 ts_tablet_manager.cc:1428] T a0cf1de8485941eb8a557a6e2f783047 P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.013s user 0.003s sys 0.000s
I20250830 07:55:00.870563 13701 leader_election.cc:304] T 6720d2b945814305845beea0a2cb9912 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:55:00.870898 13615 raft_consensus.cc:3058] T 1cf23cf78eee46be953bd701aa6bef07 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:55:00.870986 15365 raft_consensus.cc:2802] T 6720d2b945814305845beea0a2cb9912 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election won for term 1
I20250830 07:55:00.871115 15365 raft_consensus.cc:695] T 6720d2b945814305845beea0a2cb9912 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 LEADER]: Becoming Leader. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Running, Role: LEADER
I20250830 07:55:00.871325 15365 consensus_queue.cc:237] T 6720d2b945814305845beea0a2cb9912 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:00.871896 13701 leader_election.cc:304] T adbacbbb13d840a29d8d7d08ea04f6b1 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:55:00.872105 16101 raft_consensus.cc:2802] T adbacbbb13d840a29d8d7d08ea04f6b1 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election won for term 1
I20250830 07:55:00.872246 16101 raft_consensus.cc:695] T adbacbbb13d840a29d8d7d08ea04f6b1 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 LEADER]: Becoming Leader. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Running, Role: LEADER
I20250830 07:55:00.872566 16101 consensus_queue.cc:237] T adbacbbb13d840a29d8d7d08ea04f6b1 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:00.887140 13886 tablet_bootstrap.cc:492] T 2aea1a69d22544899b0218be7e0f8799 P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:55:00.887415 13886 ts_tablet_manager.cc:1397] T 2aea1a69d22544899b0218be7e0f8799 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.059s user 0.002s sys 0.004s
I20250830 07:55:00.889264 13886 raft_consensus.cc:357] T 2aea1a69d22544899b0218be7e0f8799 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:00.889604 13886 raft_consensus.cc:383] T 2aea1a69d22544899b0218be7e0f8799 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:55:00.889698 13886 raft_consensus.cc:738] T 2aea1a69d22544899b0218be7e0f8799 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:55:00.889991 15919 raft_consensus.cc:491] T 3f70097c1b3a48dfbc1ad129fa7a3730 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:55:00.890108 15919 raft_consensus.cc:513] T 3f70097c1b3a48dfbc1ad129fa7a3730 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:00.890069 13886 consensus_queue.cc:260] T 2aea1a69d22544899b0218be7e0f8799 P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:00.890640 15919 leader_election.cc:290] T 3f70097c1b3a48dfbc1ad129fa7a3730 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:55:00.885780 13882 tablet_bootstrap.cc:492] T d171ad1667fa44c993ec5fd7d701d8e0 P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:55:00.892481 15919 raft_consensus.cc:491] T 7e9d6af1d7fc4d4b961583b44f2f962a P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:55:00.892589 15919 raft_consensus.cc:513] T 7e9d6af1d7fc4d4b961583b44f2f962a P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:00.893116 15919 leader_election.cc:290] T 7e9d6af1d7fc4d4b961583b44f2f962a P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:55:00.894102 13772 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "3f70097c1b3a48dfbc1ad129fa7a3730" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:55:00.894120 13775 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "7e9d6af1d7fc4d4b961583b44f2f962a" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:55:00.894625 13886 ts_tablet_manager.cc:1428] T 2aea1a69d22544899b0218be7e0f8799 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.007s user 0.003s sys 0.000s
I20250830 07:55:00.896505 13629 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "3f70097c1b3a48dfbc1ad129fa7a3730" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:55:00.897629 16072 raft_consensus.cc:491] T ad7a45187569416bad6c71db9f8ab702 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:55:00.897769 16072 raft_consensus.cc:513] T ad7a45187569416bad6c71db9f8ab702 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:00.898114 13886 tablet_bootstrap.cc:492] T 439fc51afa6b435e81bc38b9e88d4041 P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:55:00.898434 16072 leader_election.cc:290] T ad7a45187569416bad6c71db9f8ab702 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:55:00.899127 13629 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "7e9d6af1d7fc4d4b961583b44f2f962a" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
W20250830 07:55:00.900594 13423 leader_election.cc:343] T 3f70097c1b3a48dfbc1ad129fa7a3730 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:55:00.901105 13629 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "ad7a45187569416bad6c71db9f8ab702" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
W20250830 07:55:00.901556 13423 leader_election.cc:343] T 7e9d6af1d7fc4d4b961583b44f2f962a P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
W20250830 07:55:00.901918 13423 leader_election.cc:343] T ad7a45187569416bad6c71db9f8ab702 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:55:00.910091 13882 tablet_bootstrap.cc:654] T d171ad1667fa44c993ec5fd7d701d8e0 P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
I20250830 07:55:00.913321 16072 raft_consensus.cc:491] T d94215b0b1f142178f0b791518d1baf2 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:55:00.913460 16072 raft_consensus.cc:513] T d94215b0b1f142178f0b791518d1baf2 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:00.914047 16072 leader_election.cc:290] T d94215b0b1f142178f0b791518d1baf2 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:55:00.915450 13886 tablet_bootstrap.cc:654] T 439fc51afa6b435e81bc38b9e88d4041 P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:55:00.919642 13624 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "d94215b0b1f142178f0b791518d1baf2" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
W20250830 07:55:00.928498 13423 leader_election.cc:343] T d94215b0b1f142178f0b791518d1baf2 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:55:00.930366 13629 raft_consensus.cc:3058] T e72402ca3cdf452fa8f4534c67226253 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:55:00.931869 13887 tablet_bootstrap.cc:492] T 838616d8274648fc9ea4f1583bdb97f9 P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:55:00.931990 13887 ts_tablet_manager.cc:1397] T 838616d8274648fc9ea4f1583bdb97f9 P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.070s user 0.005s sys 0.003s
I20250830 07:55:00.932747 13887 raft_consensus.cc:357] T 838616d8274648fc9ea4f1583bdb97f9 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:00.932904 13887 raft_consensus.cc:383] T 838616d8274648fc9ea4f1583bdb97f9 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:55:00.932958 13887 raft_consensus.cc:738] T 838616d8274648fc9ea4f1583bdb97f9 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:55:00.933132 13887 consensus_queue.cc:260] T 838616d8274648fc9ea4f1583bdb97f9 P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:00.933682 13887 ts_tablet_manager.cc:1428] T 838616d8274648fc9ea4f1583bdb97f9 P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20250830 07:55:00.933940 13887 tablet_bootstrap.cc:492] T a3ac09a6d8604297aa8736d1f60484e2 P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:55:00.937976 13882 tablet_bootstrap.cc:492] T d171ad1667fa44c993ec5fd7d701d8e0 P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:55:00.938190 13882 ts_tablet_manager.cc:1397] T d171ad1667fa44c993ec5fd7d701d8e0 P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.068s user 0.005s sys 0.001s
I20250830 07:55:00.938580 13772 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "ad7a45187569416bad6c71db9f8ab702" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:55:00.938952 13766 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "d94215b0b1f142178f0b791518d1baf2" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:55:00.939572 13882 raft_consensus.cc:357] T d171ad1667fa44c993ec5fd7d701d8e0 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:00.939886 13882 raft_consensus.cc:383] T d171ad1667fa44c993ec5fd7d701d8e0 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:55:00.940017 13882 raft_consensus.cc:738] T d171ad1667fa44c993ec5fd7d701d8e0 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:55:00.940420 13882 consensus_queue.cc:260] T d171ad1667fa44c993ec5fd7d701d8e0 P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:00.942849 13887 tablet_bootstrap.cc:654] T a3ac09a6d8604297aa8736d1f60484e2 P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:55:00.942696 13882 ts_tablet_manager.cc:1428] T d171ad1667fa44c993ec5fd7d701d8e0 P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20250830 07:55:00.944895 13886 tablet_bootstrap.cc:492] T 439fc51afa6b435e81bc38b9e88d4041 P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:55:00.945168 13886 ts_tablet_manager.cc:1397] T 439fc51afa6b435e81bc38b9e88d4041 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.048s user 0.002s sys 0.005s
I20250830 07:55:00.946779 13886 raft_consensus.cc:357] T 439fc51afa6b435e81bc38b9e88d4041 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:00.947150 13886 raft_consensus.cc:383] T 439fc51afa6b435e81bc38b9e88d4041 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:55:00.947240 13886 raft_consensus.cc:738] T 439fc51afa6b435e81bc38b9e88d4041 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:55:00.948449 13882 tablet_bootstrap.cc:492] T fbb1cc8f8eea4a0795f6f8e213b8180f P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:55:00.948113 13886 consensus_queue.cc:260] T 439fc51afa6b435e81bc38b9e88d4041 P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:00.949719 13615 raft_consensus.cc:3058] T ddedd1f141c147c69f178c6cd2b287da P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Advancing to term 1
W20250830 07:55:00.952342 13422 leader_election.cc:343] T 3f70097c1b3a48dfbc1ad129fa7a3730 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:55:00.952915 13422 leader_election.cc:304] T 3f70097c1b3a48dfbc1ad129fa7a3730 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba; no voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:55:00.953540 16079 raft_consensus.cc:2747] T 3f70097c1b3a48dfbc1ad129fa7a3730 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20250830 07:55:00.953987 13422 leader_election.cc:343] T 7e9d6af1d7fc4d4b961583b44f2f962a P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:55:00.956722 13882 tablet_bootstrap.cc:654] T fbb1cc8f8eea4a0795f6f8e213b8180f P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
I20250830 07:55:00.957777 13886 ts_tablet_manager.cc:1428] T 439fc51afa6b435e81bc38b9e88d4041 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.012s user 0.002s sys 0.000s
I20250830 07:55:00.962333 16074 raft_consensus.cc:491] T d171ad1667fa44c993ec5fd7d701d8e0 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:55:00.962455 16074 raft_consensus.cc:513] T d171ad1667fa44c993ec5fd7d701d8e0 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:00.963042 16074 leader_election.cc:290] T d171ad1667fa44c993ec5fd7d701d8e0 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:55:00.963611 13476 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "d171ad1667fa44c993ec5fd7d701d8e0" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:55:00.965082 13766 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "d171ad1667fa44c993ec5fd7d701d8e0" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:55:00.966091 13887 tablet_bootstrap.cc:492] T a3ac09a6d8604297aa8736d1f60484e2 P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:55:00.966284 13887 ts_tablet_manager.cc:1397] T a3ac09a6d8604297aa8736d1f60484e2 P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.032s user 0.002s sys 0.002s
I20250830 07:55:00.967133 13887 raft_consensus.cc:357] T a3ac09a6d8604297aa8736d1f60484e2 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:00.967356 13887 raft_consensus.cc:383] T a3ac09a6d8604297aa8736d1f60484e2 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:55:00.967460 13887 raft_consensus.cc:738] T a3ac09a6d8604297aa8736d1f60484e2 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:55:00.967679 13887 consensus_queue.cc:260] T a3ac09a6d8604297aa8736d1f60484e2 P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:00.968225 13887 ts_tablet_manager.cc:1428] T a3ac09a6d8604297aa8736d1f60484e2 P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20250830 07:55:00.968546 13887 tablet_bootstrap.cc:492] T c6355878115a4907ae1f0a45fb2c6492 P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:55:00.969905 13887 tablet_bootstrap.cc:654] T c6355878115a4907ae1f0a45fb2c6492 P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:55:00.971396 13886 tablet_bootstrap.cc:492] T dcb8b326dbec4d40af26b4f143157468 P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:55:00.972832 13886 tablet_bootstrap.cc:654] T dcb8b326dbec4d40af26b4f143157468 P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:55:00.977252 13882 tablet_bootstrap.cc:492] T fbb1cc8f8eea4a0795f6f8e213b8180f P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:55:00.977370 13882 ts_tablet_manager.cc:1397] T fbb1cc8f8eea4a0795f6f8e213b8180f P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.030s user 0.003s sys 0.000s
I20250830 07:55:00.978075 13882 raft_consensus.cc:357] T fbb1cc8f8eea4a0795f6f8e213b8180f P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:00.978217 13882 raft_consensus.cc:383] T fbb1cc8f8eea4a0795f6f8e213b8180f P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:55:00.978274 13882 raft_consensus.cc:738] T fbb1cc8f8eea4a0795f6f8e213b8180f P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:55:00.978451 13882 consensus_queue.cc:260] T fbb1cc8f8eea4a0795f6f8e213b8180f P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:00.979082 13882 ts_tablet_manager.cc:1428] T fbb1cc8f8eea4a0795f6f8e213b8180f P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20250830 07:55:00.979316 13882 tablet_bootstrap.cc:492] T 3d9c884ac05e44ddb59f96588fdd6f4b P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:55:00.980090 13562 leader_election.cc:304] T d171ad1667fa44c993ec5fd7d701d8e0 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b5e454d98894637b466ea27f1b647f9; no voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:55:00.980765 13882 tablet_bootstrap.cc:654] T 3d9c884ac05e44ddb59f96588fdd6f4b P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
I20250830 07:55:00.980918 16074 raft_consensus.cc:2747] T d171ad1667fa44c993ec5fd7d701d8e0 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:55:00.983798 13886 tablet_bootstrap.cc:492] T dcb8b326dbec4d40af26b4f143157468 P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:55:00.983978 13886 ts_tablet_manager.cc:1397] T dcb8b326dbec4d40af26b4f143157468 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.013s user 0.002s sys 0.001s
I20250830 07:55:00.984678 13886 raft_consensus.cc:357] T dcb8b326dbec4d40af26b4f143157468 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:00.984861 13886 raft_consensus.cc:383] T dcb8b326dbec4d40af26b4f143157468 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:55:00.984980 13886 raft_consensus.cc:738] T dcb8b326dbec4d40af26b4f143157468 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:55:00.984812 15720 consensus_queue.cc:1035] T 5e2da5434e95445aa4deafce7fde0c6c P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:55:00.985180 13886 consensus_queue.cc:260] T dcb8b326dbec4d40af26b4f143157468 P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:00.985603 13886 ts_tablet_manager.cc:1428] T dcb8b326dbec4d40af26b4f143157468 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20250830 07:55:00.985824 13886 tablet_bootstrap.cc:492] T f479eef0171c401bbd27beec4486a8b2 P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:55:00.987159 13886 tablet_bootstrap.cc:654] T f479eef0171c401bbd27beec4486a8b2 P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:55:00.988360 16079 raft_consensus.cc:491] T 439fc51afa6b435e81bc38b9e88d4041 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:55:00.988474 16079 raft_consensus.cc:513] T 439fc51afa6b435e81bc38b9e88d4041 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:00.989037 16079 leader_election.cc:290] T 439fc51afa6b435e81bc38b9e88d4041 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:55:00.991663 13629 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "439fc51afa6b435e81bc38b9e88d4041" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:55:00.992290 13886 tablet_bootstrap.cc:492] T f479eef0171c401bbd27beec4486a8b2 P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:55:00.992430 13886 ts_tablet_manager.cc:1397] T f479eef0171c401bbd27beec4486a8b2 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.007s user 0.004s sys 0.000s
W20250830 07:55:00.992949 13423 leader_election.cc:343] T 439fc51afa6b435e81bc38b9e88d4041 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:55:00.993257 13886 raft_consensus.cc:357] T f479eef0171c401bbd27beec4486a8b2 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:00.993448 13886 raft_consensus.cc:383] T f479eef0171c401bbd27beec4486a8b2 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:55:00.993516 13886 raft_consensus.cc:738] T f479eef0171c401bbd27beec4486a8b2 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:55:00.993737 13886 consensus_queue.cc:260] T f479eef0171c401bbd27beec4486a8b2 P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:00.994343 13886 ts_tablet_manager.cc:1428] T f479eef0171c401bbd27beec4486a8b2 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20250830 07:55:01.004163 13887 tablet_bootstrap.cc:492] T c6355878115a4907ae1f0a45fb2c6492 P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:55:01.004329 13887 ts_tablet_manager.cc:1397] T c6355878115a4907ae1f0a45fb2c6492 P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.036s user 0.002s sys 0.002s
I20250830 07:55:01.005084 13887 raft_consensus.cc:357] T c6355878115a4907ae1f0a45fb2c6492 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:01.005235 13887 raft_consensus.cc:383] T c6355878115a4907ae1f0a45fb2c6492 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:55:01.005286 13887 raft_consensus.cc:738] T c6355878115a4907ae1f0a45fb2c6492 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:55:01.005448 13887 consensus_queue.cc:260] T c6355878115a4907ae1f0a45fb2c6492 P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:01.005868 13887 ts_tablet_manager.cc:1428] T c6355878115a4907ae1f0a45fb2c6492 P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20250830 07:55:01.006131 13887 tablet_bootstrap.cc:492] T 986878a23a0b47ee865e09277b027bb0 P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:55:01.008399 13886 tablet_bootstrap.cc:492] T a36f38ada7314165a5e9d6ee7bbf69e3 P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:55:01.012315 13886 tablet_bootstrap.cc:654] T a36f38ada7314165a5e9d6ee7bbf69e3 P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:55:01.013903 13887 tablet_bootstrap.cc:654] T 986878a23a0b47ee865e09277b027bb0 P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:55:01.018311 13886 tablet_bootstrap.cc:492] T a36f38ada7314165a5e9d6ee7bbf69e3 P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:55:01.018589 13886 ts_tablet_manager.cc:1397] T a36f38ada7314165a5e9d6ee7bbf69e3 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.010s user 0.002s sys 0.001s
I20250830 07:55:01.020030 13886 raft_consensus.cc:357] T a36f38ada7314165a5e9d6ee7bbf69e3 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:01.021334 13886 raft_consensus.cc:383] T a36f38ada7314165a5e9d6ee7bbf69e3 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:55:01.021534 13886 raft_consensus.cc:738] T a36f38ada7314165a5e9d6ee7bbf69e3 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:55:01.022533 13886 consensus_queue.cc:260] T a36f38ada7314165a5e9d6ee7bbf69e3 P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:01.024166 13886 ts_tablet_manager.cc:1428] T a36f38ada7314165a5e9d6ee7bbf69e3 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20250830 07:55:01.024502 13887 tablet_bootstrap.cc:492] T 986878a23a0b47ee865e09277b027bb0 P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:55:01.024638 13887 ts_tablet_manager.cc:1397] T 986878a23a0b47ee865e09277b027bb0 P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.019s user 0.000s sys 0.003s
I20250830 07:55:01.024853 13886 tablet_bootstrap.cc:492] T d94215b0b1f142178f0b791518d1baf2 P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:55:01.025286 13882 tablet_bootstrap.cc:492] T 3d9c884ac05e44ddb59f96588fdd6f4b P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:55:01.025424 13882 ts_tablet_manager.cc:1397] T 3d9c884ac05e44ddb59f96588fdd6f4b P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.046s user 0.003s sys 0.007s
I20250830 07:55:01.025385 13887 raft_consensus.cc:357] T 986878a23a0b47ee865e09277b027bb0 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:01.025528 13887 raft_consensus.cc:383] T 986878a23a0b47ee865e09277b027bb0 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:55:01.025597 13887 raft_consensus.cc:738] T 986878a23a0b47ee865e09277b027bb0 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:55:01.025767 13887 consensus_queue.cc:260] T 986878a23a0b47ee865e09277b027bb0 P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:01.026101 13882 raft_consensus.cc:357] T 3d9c884ac05e44ddb59f96588fdd6f4b P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:01.026206 13887 ts_tablet_manager.cc:1428] T 986878a23a0b47ee865e09277b027bb0 P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20250830 07:55:01.026253 13882 raft_consensus.cc:383] T 3d9c884ac05e44ddb59f96588fdd6f4b P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:55:01.026301 13882 raft_consensus.cc:738] T 3d9c884ac05e44ddb59f96588fdd6f4b P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:55:01.026454 13887 tablet_bootstrap.cc:492] T 690cf258639a4c1ea5a0ac4f2fd39f88 P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:55:01.028259 13882 consensus_queue.cc:260] T 3d9c884ac05e44ddb59f96588fdd6f4b P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:01.028509 13887 tablet_bootstrap.cc:654] T 690cf258639a4c1ea5a0ac4f2fd39f88 P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:55:01.029575 13882 ts_tablet_manager.cc:1428] T 3d9c884ac05e44ddb59f96588fdd6f4b P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20250830 07:55:01.029815 13882 tablet_bootstrap.cc:492] T 5fee48de90014f94b796e726a4d16b85 P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:55:01.031230 13882 tablet_bootstrap.cc:654] T 5fee48de90014f94b796e726a4d16b85 P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
I20250830 07:55:01.034436 13882 tablet_bootstrap.cc:492] T 5fee48de90014f94b796e726a4d16b85 P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:55:01.034603 13882 ts_tablet_manager.cc:1397] T 5fee48de90014f94b796e726a4d16b85 P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20250830 07:55:01.035899 13882 raft_consensus.cc:357] T 5fee48de90014f94b796e726a4d16b85 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:01.036043 13882 raft_consensus.cc:383] T 5fee48de90014f94b796e726a4d16b85 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:55:01.036084 13882 raft_consensus.cc:738] T 5fee48de90014f94b796e726a4d16b85 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:55:01.036257 13882 consensus_queue.cc:260] T 5fee48de90014f94b796e726a4d16b85 P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:01.037889 13882 ts_tablet_manager.cc:1428] T 5fee48de90014f94b796e726a4d16b85 P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20250830 07:55:01.038117 13882 tablet_bootstrap.cc:492] T 846338e46b834ae0b5f4e74c7f1325d2 P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:55:01.039542 13882 tablet_bootstrap.cc:654] T 846338e46b834ae0b5f4e74c7f1325d2 P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
I20250830 07:55:01.040880 13422 leader_election.cc:304] T 7e9d6af1d7fc4d4b961583b44f2f962a P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba; no voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:55:01.041106 13887 tablet_bootstrap.cc:492] T 690cf258639a4c1ea5a0ac4f2fd39f88 P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:55:01.041194 16079 raft_consensus.cc:2747] T 7e9d6af1d7fc4d4b961583b44f2f962a P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20250830 07:55:01.041474 13422 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.209.3:38743, user_credentials={real_user=slave}} blocked reactor thread for 87487.4us
W20250830 07:55:01.044425 13422 leader_election.cc:343] T ad7a45187569416bad6c71db9f8ab702 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:55:01.041222 13887 ts_tablet_manager.cc:1397] T 690cf258639a4c1ea5a0ac4f2fd39f88 P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.015s user 0.003s sys 0.000s
I20250830 07:55:01.045258 13887 raft_consensus.cc:357] T 690cf258639a4c1ea5a0ac4f2fd39f88 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:01.045415 13887 raft_consensus.cc:383] T 690cf258639a4c1ea5a0ac4f2fd39f88 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:55:01.045467 13887 raft_consensus.cc:738] T 690cf258639a4c1ea5a0ac4f2fd39f88 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:55:01.045631 13887 consensus_queue.cc:260] T 690cf258639a4c1ea5a0ac4f2fd39f88 P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:01.044539 13422 leader_election.cc:304] T ad7a45187569416bad6c71db9f8ab702 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba; no voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:55:01.045984 13887 ts_tablet_manager.cc:1428] T 690cf258639a4c1ea5a0ac4f2fd39f88 P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20250830 07:55:01.046116 16079 raft_consensus.cc:2747] T ad7a45187569416bad6c71db9f8ab702 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:55:01.046348 13887 tablet_bootstrap.cc:492] T 283aa82b808e49528ceb19133748ffc8 P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
W20250830 07:55:01.046568 13422 leader_election.cc:343] T d94215b0b1f142178f0b791518d1baf2 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:55:01.046725 13422 leader_election.cc:304] T d94215b0b1f142178f0b791518d1baf2 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba; no voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:55:01.046972 16079 raft_consensus.cc:2747] T d94215b0b1f142178f0b791518d1baf2 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:55:01.048216 13887 tablet_bootstrap.cc:654] T 283aa82b808e49528ceb19133748ffc8 P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:55:01.063607 13887 tablet_bootstrap.cc:492] T 283aa82b808e49528ceb19133748ffc8 P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:55:01.063726 13887 ts_tablet_manager.cc:1397] T 283aa82b808e49528ceb19133748ffc8 P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.017s user 0.001s sys 0.001s
I20250830 07:55:01.063966 13882 tablet_bootstrap.cc:492] T 846338e46b834ae0b5f4e74c7f1325d2 P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:55:01.064096 13882 ts_tablet_manager.cc:1397] T 846338e46b834ae0b5f4e74c7f1325d2 P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.026s user 0.004s sys 0.000s
I20250830 07:55:01.064514 13887 raft_consensus.cc:357] T 283aa82b808e49528ceb19133748ffc8 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:01.064680 13887 raft_consensus.cc:383] T 283aa82b808e49528ceb19133748ffc8 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:55:01.064741 13887 raft_consensus.cc:738] T 283aa82b808e49528ceb19133748ffc8 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:55:01.064909 13887 consensus_queue.cc:260] T 283aa82b808e49528ceb19133748ffc8 P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:01.065148 13882 raft_consensus.cc:357] T 846338e46b834ae0b5f4e74c7f1325d2 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:01.065315 13882 raft_consensus.cc:383] T 846338e46b834ae0b5f4e74c7f1325d2 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:55:01.065376 13887 ts_tablet_manager.cc:1428] T 283aa82b808e49528ceb19133748ffc8 P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20250830 07:55:01.065369 13882 raft_consensus.cc:738] T 846338e46b834ae0b5f4e74c7f1325d2 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:55:01.065663 13887 tablet_bootstrap.cc:492] T 7676b4d6a75c4c6aacced1f2a1beb555 P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:55:01.065570 13882 consensus_queue.cc:260] T 846338e46b834ae0b5f4e74c7f1325d2 P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:01.066120 13882 ts_tablet_manager.cc:1428] T 846338e46b834ae0b5f4e74c7f1325d2 P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20250830 07:55:01.067194 13887 tablet_bootstrap.cc:654] T 7676b4d6a75c4c6aacced1f2a1beb555 P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:55:01.068220 13882 tablet_bootstrap.cc:492] T 240a6bfad8fa478598a67a27c2dedf62 P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:55:01.068758 13615 raft_consensus.cc:3058] T 509e08290f3842cfbde8b74ff9f4f70f P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:55:01.069799 13882 tablet_bootstrap.cc:654] T 240a6bfad8fa478598a67a27c2dedf62 P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
I20250830 07:55:01.072008 13629 raft_consensus.cc:3058] T 15f8fd7d9e6242c6b6c51251d618ef09 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:55:01.072202 15365 raft_consensus.cc:491] T 7aed56dba39e40518e9c3325bcccd74a P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:55:01.072366 15365 raft_consensus.cc:513] T 7aed56dba39e40518e9c3325bcccd74a P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:01.073055 15365 leader_election.cc:290] T 7aed56dba39e40518e9c3325bcccd74a P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
I20250830 07:55:01.073669 13624 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "7aed56dba39e40518e9c3325bcccd74a" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:55:01.073814 13624 raft_consensus.cc:2466] T 7aed56dba39e40518e9c3325bcccd74a P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 1.
I20250830 07:55:01.074127 13703 leader_election.cc:304] T 7aed56dba39e40518e9c3325bcccd74a P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f; no voters:
I20250830 07:55:01.074481 15603 raft_consensus.cc:2802] T 7aed56dba39e40518e9c3325bcccd74a P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20250830 07:55:01.074550 15603 raft_consensus.cc:491] T 7aed56dba39e40518e9c3325bcccd74a P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:55:01.074605 15603 raft_consensus.cc:3058] T 7aed56dba39e40518e9c3325bcccd74a P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Advancing to term 2
W20250830 07:55:01.074752 13221 catalog_manager.cc:4726] Async tablet task AlterTable RPC for tablet f8fab6e766a847c29da8573ad0b402d5 (table default.Table_fcc3930df56342c08de3748b1a89089e [id=e950f4141a48492297f5e6c7f7731d68], current schema version=5) failed: Not found: failed to reset TS proxy: No leader found: Tablet f8fab6e766a847c29da8573ad0b402d5 consensus state has no leader
I20250830 07:55:01.077112 15603 raft_consensus.cc:513] T 7aed56dba39e40518e9c3325bcccd74a P 9b057ade5dce45af9f8bf0bedf8b917f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:01.077629 15603 leader_election.cc:290] T 7aed56dba39e40518e9c3325bcccd74a P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 2 election: Requested vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
I20250830 07:55:01.078413 13611 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "7aed56dba39e40518e9c3325bcccd74a" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9"
I20250830 07:55:01.078580 13611 raft_consensus.cc:3058] T 7aed56dba39e40518e9c3325bcccd74a P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Advancing to term 2
I20250830 07:55:01.081498 13611 raft_consensus.cc:2466] T 7aed56dba39e40518e9c3325bcccd74a P 6b5e454d98894637b466ea27f1b647f9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 2.
I20250830 07:55:01.081903 13703 leader_election.cc:304] T 7aed56dba39e40518e9c3325bcccd74a P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f; no voters:
I20250830 07:55:01.082649 15603 raft_consensus.cc:2802] T 7aed56dba39e40518e9c3325bcccd74a P 9b057ade5dce45af9f8bf0bedf8b917f [term 2 FOLLOWER]: Leader election won for term 2
I20250830 07:55:01.082764 15603 raft_consensus.cc:695] T 7aed56dba39e40518e9c3325bcccd74a P 9b057ade5dce45af9f8bf0bedf8b917f [term 2 LEADER]: Becoming Leader. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Running, Role: LEADER
I20250830 07:55:01.083271 15603 consensus_queue.cc:237] T 7aed56dba39e40518e9c3325bcccd74a P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:01.085975 13887 tablet_bootstrap.cc:492] T 7676b4d6a75c4c6aacced1f2a1beb555 P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:55:01.086119 13887 ts_tablet_manager.cc:1397] T 7676b4d6a75c4c6aacced1f2a1beb555 P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.021s user 0.002s sys 0.002s
I20250830 07:55:01.086978 13887 raft_consensus.cc:357] T 7676b4d6a75c4c6aacced1f2a1beb555 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:01.087158 13887 raft_consensus.cc:383] T 7676b4d6a75c4c6aacced1f2a1beb555 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:55:01.087218 13887 raft_consensus.cc:738] T 7676b4d6a75c4c6aacced1f2a1beb555 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:55:01.087432 13887 consensus_queue.cc:260] T 7676b4d6a75c4c6aacced1f2a1beb555 P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:01.087859 13887 ts_tablet_manager.cc:1428] T 7676b4d6a75c4c6aacced1f2a1beb555 P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20250830 07:55:01.088128 13887 tablet_bootstrap.cc:492] T f192693039a24e3cb0bec646c8d11056 P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:55:01.089599 13887 tablet_bootstrap.cc:654] T f192693039a24e3cb0bec646c8d11056 P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:55:01.090703 16074 raft_consensus.cc:491] T 5fee48de90014f94b796e726a4d16b85 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:55:01.090819 16074 raft_consensus.cc:513] T 5fee48de90014f94b796e726a4d16b85 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:01.091367 16074 leader_election.cc:290] T 5fee48de90014f94b796e726a4d16b85 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:55:01.091851 13886 tablet_bootstrap.cc:654] T d94215b0b1f142178f0b791518d1baf2 P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:55:01.092198 13476 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "5fee48de90014f94b796e726a4d16b85" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:55:01.095781 13772 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "439fc51afa6b435e81bc38b9e88d4041" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:55:01.095963 13772 raft_consensus.cc:2466] T 439fc51afa6b435e81bc38b9e88d4041 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2065c332f15a4739899af79f3669c3ba in term 0.
I20250830 07:55:01.098734 13772 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "5fee48de90014f94b796e726a4d16b85" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:55:01.100379 13562 leader_election.cc:304] T 5fee48de90014f94b796e726a4d16b85 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b5e454d98894637b466ea27f1b647f9; no voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:55:01.100456 13886 tablet_bootstrap.cc:492] T d94215b0b1f142178f0b791518d1baf2 P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:55:01.100561 13886 ts_tablet_manager.cc:1397] T d94215b0b1f142178f0b791518d1baf2 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.076s user 0.004s sys 0.000s
I20250830 07:55:01.100728 16074 raft_consensus.cc:2747] T 5fee48de90014f94b796e726a4d16b85 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:55:01.106616 13882 tablet_bootstrap.cc:492] T 240a6bfad8fa478598a67a27c2dedf62 P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:55:01.106884 13882 ts_tablet_manager.cc:1397] T 240a6bfad8fa478598a67a27c2dedf62 P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.039s user 0.002s sys 0.002s
I20250830 07:55:01.107338 13886 raft_consensus.cc:357] T d94215b0b1f142178f0b791518d1baf2 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:01.107472 13886 raft_consensus.cc:383] T d94215b0b1f142178f0b791518d1baf2 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:55:01.107517 13886 raft_consensus.cc:738] T d94215b0b1f142178f0b791518d1baf2 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:55:01.108645 13882 raft_consensus.cc:357] T 240a6bfad8fa478598a67a27c2dedf62 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:01.108942 13882 raft_consensus.cc:383] T 240a6bfad8fa478598a67a27c2dedf62 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:55:01.109159 13882 raft_consensus.cc:738] T 240a6bfad8fa478598a67a27c2dedf62 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:55:01.109655 13882 consensus_queue.cc:260] T 240a6bfad8fa478598a67a27c2dedf62 P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:01.110723 13882 ts_tablet_manager.cc:1428] T 240a6bfad8fa478598a67a27c2dedf62 P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20250830 07:55:01.111429 13882 tablet_bootstrap.cc:492] T 2c4c3c61cddf42668d3a09f4fbc5f641 P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:55:01.112598 13887 tablet_bootstrap.cc:492] T f192693039a24e3cb0bec646c8d11056 P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:55:01.112694 13887 ts_tablet_manager.cc:1397] T f192693039a24e3cb0bec646c8d11056 P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.025s user 0.002s sys 0.002s
W20250830 07:55:01.112993 13703 consensus_peers.cc:489] T ba4e1fccb8f046d6b63afe67c1f9d538 P 9b057ade5dce45af9f8bf0bedf8b917f -> Peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Couldn't send request to peer 6b5e454d98894637b466ea27f1b647f9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20250830 07:55:01.113065 13886 consensus_queue.cc:260] T d94215b0b1f142178f0b791518d1baf2 P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:01.113421 13887 raft_consensus.cc:357] T f192693039a24e3cb0bec646c8d11056 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:01.113557 13887 raft_consensus.cc:383] T f192693039a24e3cb0bec646c8d11056 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:55:01.113672 13887 raft_consensus.cc:738] T f192693039a24e3cb0bec646c8d11056 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:55:01.113855 13887 consensus_queue.cc:260] T f192693039a24e3cb0bec646c8d11056 P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:01.114262 13887 ts_tablet_manager.cc:1428] T f192693039a24e3cb0bec646c8d11056 P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20250830 07:55:01.114473 13887 tablet_bootstrap.cc:492] T bac72b4ba9ba4ca69f93e799dccb0e93 P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:55:01.115721 13887 tablet_bootstrap.cc:654] T bac72b4ba9ba4ca69f93e799dccb0e93 P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:55:01.116451 13886 ts_tablet_manager.cc:1428] T d94215b0b1f142178f0b791518d1baf2 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.016s user 0.002s sys 0.001s
I20250830 07:55:01.119094 13886 tablet_bootstrap.cc:492] T af449cc407c046eeb5cdfdacffc617a4 P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:55:01.120539 13886 tablet_bootstrap.cc:654] T af449cc407c046eeb5cdfdacffc617a4 P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:55:01.127831 15748 raft_consensus.cc:491] T 50dfc24a0b9645e4860cd99b1df3bd61 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:55:01.127997 15748 raft_consensus.cc:513] T 50dfc24a0b9645e4860cd99b1df3bd61 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:01.128892 13882 tablet_bootstrap.cc:654] T 2c4c3c61cddf42668d3a09f4fbc5f641 P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
I20250830 07:55:01.131270 13615 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "50dfc24a0b9645e4860cd99b1df3bd61" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
W20250830 07:55:01.131713 13703 leader_election.cc:343] T 50dfc24a0b9645e4860cd99b1df3bd61 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:55:01.133961 13476 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "7aed56dba39e40518e9c3325bcccd74a" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:55:01.134125 13476 raft_consensus.cc:2466] T 7aed56dba39e40518e9c3325bcccd74a P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 1.
I20250830 07:55:01.134514 13887 tablet_bootstrap.cc:492] T bac72b4ba9ba4ca69f93e799dccb0e93 P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:55:01.134613 13476 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "7aed56dba39e40518e9c3325bcccd74a" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba"
I20250830 07:55:01.134760 13476 raft_consensus.cc:3058] T 7aed56dba39e40518e9c3325bcccd74a P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Advancing to term 2
I20250830 07:55:01.134613 13887 ts_tablet_manager.cc:1397] T bac72b4ba9ba4ca69f93e799dccb0e93 P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.020s user 0.002s sys 0.000s
I20250830 07:55:01.136641 13887 raft_consensus.cc:357] T bac72b4ba9ba4ca69f93e799dccb0e93 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:01.136757 13887 raft_consensus.cc:383] T bac72b4ba9ba4ca69f93e799dccb0e93 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:55:01.136801 13887 raft_consensus.cc:738] T bac72b4ba9ba4ca69f93e799dccb0e93 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:55:01.136936 13887 consensus_queue.cc:260] T bac72b4ba9ba4ca69f93e799dccb0e93 P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:01.137369 13887 ts_tablet_manager.cc:1428] T bac72b4ba9ba4ca69f93e799dccb0e93 P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250830 07:55:01.137581 13887 tablet_bootstrap.cc:492] T 0f34ed0fe6e9400fae5c0edebb615ebd P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:55:01.137931 13476 raft_consensus.cc:2466] T 7aed56dba39e40518e9c3325bcccd74a P 2065c332f15a4739899af79f3669c3ba [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 2.
I20250830 07:55:01.138183 15748 leader_election.cc:290] T 50dfc24a0b9645e4860cd99b1df3bd61 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
I20250830 07:55:01.138962 13887 tablet_bootstrap.cc:654] T 0f34ed0fe6e9400fae5c0edebb615ebd P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:55:01.141247 15603 raft_consensus.cc:491] T dcb8b326dbec4d40af26b4f143157468 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:55:01.141644 15603 raft_consensus.cc:513] T dcb8b326dbec4d40af26b4f143157468 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:01.142459 15365 raft_consensus.cc:491] T cd9903bdfaef4139a1a582c54689da4a P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:55:01.142558 15365 raft_consensus.cc:513] T cd9903bdfaef4139a1a582c54689da4a P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:01.143082 15365 leader_election.cc:290] T cd9903bdfaef4139a1a582c54689da4a P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
I20250830 07:55:01.143113 15603 leader_election.cc:290] T dcb8b326dbec4d40af26b4f143157468 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
I20250830 07:55:01.143548 13615 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "dcb8b326dbec4d40af26b4f143157468" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
W20250830 07:55:01.143958 13703 leader_election.cc:343] T dcb8b326dbec4d40af26b4f143157468 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:55:01.144016 13629 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "cd9903bdfaef4139a1a582c54689da4a" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
W20250830 07:55:01.145102 13703 leader_election.cc:343] T cd9903bdfaef4139a1a582c54689da4a P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:55:01.145397 13476 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "50dfc24a0b9645e4860cd99b1df3bd61" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:55:01.145591 13476 raft_consensus.cc:2466] T 50dfc24a0b9645e4860cd99b1df3bd61 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 0.
I20250830 07:55:01.150694 13882 tablet_bootstrap.cc:492] T 2c4c3c61cddf42668d3a09f4fbc5f641 P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:55:01.151621 13882 ts_tablet_manager.cc:1397] T 2c4c3c61cddf42668d3a09f4fbc5f641 P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.040s user 0.006s sys 0.000s
W20250830 07:55:01.152065 15882 negotiation.cc:337] Failed RPC negotiation. Trace:
0830 07:54:58.032025 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.209.61:44241 (local address 127.0.0.1:40254)
0830 07:54:58.032186 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0830 07:54:58.032213 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0830 07:54:58.032313 (+ 100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0830 07:55:01.151190 (+3118877us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.12.209.61:44241: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":33}
I20250830 07:55:01.153132 13886 tablet_bootstrap.cc:492] T af449cc407c046eeb5cdfdacffc617a4 P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:55:01.153332 13886 ts_tablet_manager.cc:1397] T af449cc407c046eeb5cdfdacffc617a4 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.034s user 0.003s sys 0.007s
I20250830 07:55:01.154520 13476 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "cd9903bdfaef4139a1a582c54689da4a" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:55:01.154709 13476 raft_consensus.cc:2466] T cd9903bdfaef4139a1a582c54689da4a P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 0.
I20250830 07:55:01.155213 13886 raft_consensus.cc:357] T af449cc407c046eeb5cdfdacffc617a4 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:01.155467 13886 raft_consensus.cc:383] T af449cc407c046eeb5cdfdacffc617a4 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:55:01.155550 13886 raft_consensus.cc:738] T af449cc407c046eeb5cdfdacffc617a4 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:55:01.155736 13476 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "dcb8b326dbec4d40af26b4f143157468" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:55:01.155951 13476 raft_consensus.cc:2466] T dcb8b326dbec4d40af26b4f143157468 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 0.
I20250830 07:55:01.156157 13886 consensus_queue.cc:260] T af449cc407c046eeb5cdfdacffc617a4 P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:01.157160 13886 ts_tablet_manager.cc:1428] T af449cc407c046eeb5cdfdacffc617a4 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20250830 07:55:01.157550 15603 consensus_queue.cc:1035] T 8c01157324ba45bda5b3a9a328bf319b P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:55:01.158262 13886 tablet_bootstrap.cc:492] T 0d16bc64dd6e43f7ba313b77c2bbb728 P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:55:01.162405 13882 raft_consensus.cc:357] T 2c4c3c61cddf42668d3a09f4fbc5f641 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:01.163591 15603 consensus_queue.cc:1035] T 5e2da5434e95445aa4deafce7fde0c6c P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:55:01.163753 13882 raft_consensus.cc:383] T 2c4c3c61cddf42668d3a09f4fbc5f641 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:55:01.164285 13882 raft_consensus.cc:738] T 2c4c3c61cddf42668d3a09f4fbc5f641 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:55:01.165433 13882 consensus_queue.cc:260] T 2c4c3c61cddf42668d3a09f4fbc5f641 P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:01.168679 13882 ts_tablet_manager.cc:1428] T 2c4c3c61cddf42668d3a09f4fbc5f641 P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.011s user 0.002s sys 0.000s
I20250830 07:55:01.170600 13882 tablet_bootstrap.cc:492] T 14d4d2506e2a47ea906bfb81d5509829 P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:55:01.171459 13701 leader_election.cc:304] T 50dfc24a0b9645e4860cd99b1df3bd61 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:55:01.170938 13886 tablet_bootstrap.cc:654] T 0d16bc64dd6e43f7ba313b77c2bbb728 P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:55:01.172542 15603 raft_consensus.cc:2802] T 50dfc24a0b9645e4860cd99b1df3bd61 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:55:01.172673 15603 raft_consensus.cc:491] T 50dfc24a0b9645e4860cd99b1df3bd61 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:55:01.172788 15603 raft_consensus.cc:3058] T 50dfc24a0b9645e4860cd99b1df3bd61 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:55:01.176954 13615 raft_consensus.cc:3058] T f332d1b56d924c91a79cf6572dea1cd2 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:55:01.177294 15603 raft_consensus.cc:513] T 50dfc24a0b9645e4860cd99b1df3bd61 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:01.177677 13887 tablet_bootstrap.cc:492] T 0f34ed0fe6e9400fae5c0edebb615ebd P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:55:01.177772 13887 ts_tablet_manager.cc:1397] T 0f34ed0fe6e9400fae5c0edebb615ebd P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.040s user 0.003s sys 0.000s
I20250830 07:55:01.178381 15603 leader_election.cc:290] T 50dfc24a0b9645e4860cd99b1df3bd61 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Requested vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
I20250830 07:55:01.178364 13887 raft_consensus.cc:357] T 0f34ed0fe6e9400fae5c0edebb615ebd P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:01.178499 13887 raft_consensus.cc:383] T 0f34ed0fe6e9400fae5c0edebb615ebd P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:55:01.178550 13887 raft_consensus.cc:738] T 0f34ed0fe6e9400fae5c0edebb615ebd P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:55:01.178695 13887 consensus_queue.cc:260] T 0f34ed0fe6e9400fae5c0edebb615ebd P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:01.179093 13887 ts_tablet_manager.cc:1428] T 0f34ed0fe6e9400fae5c0edebb615ebd P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250830 07:55:01.179337 13887 tablet_bootstrap.cc:492] T a5eea1950d1945f1b755fd34597b2fb4 P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:55:01.179739 13629 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "50dfc24a0b9645e4860cd99b1df3bd61" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9"
W20250830 07:55:01.180114 13703 leader_election.cc:343] T 50dfc24a0b9645e4860cd99b1df3bd61 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:55:01.181613 13701 leader_election.cc:304] T cd9903bdfaef4139a1a582c54689da4a P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:55:01.181809 13882 tablet_bootstrap.cc:654] T 14d4d2506e2a47ea906bfb81d5509829 P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
I20250830 07:55:01.181988 15603 raft_consensus.cc:2802] T cd9903bdfaef4139a1a582c54689da4a P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:55:01.182106 15603 raft_consensus.cc:491] T cd9903bdfaef4139a1a582c54689da4a P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:55:01.182222 15603 raft_consensus.cc:3058] T cd9903bdfaef4139a1a582c54689da4a P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:55:01.184381 13701 leader_election.cc:304] T dcb8b326dbec4d40af26b4f143157468 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:55:01.184782 15365 raft_consensus.cc:2802] T dcb8b326dbec4d40af26b4f143157468 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:55:01.184855 15365 raft_consensus.cc:491] T dcb8b326dbec4d40af26b4f143157468 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:55:01.184921 15365 raft_consensus.cc:3058] T dcb8b326dbec4d40af26b4f143157468 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:55:01.187485 15365 raft_consensus.cc:513] T dcb8b326dbec4d40af26b4f143157468 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:01.188048 15365 leader_election.cc:290] T dcb8b326dbec4d40af26b4f143157468 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Requested vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
I20250830 07:55:01.191322 13629 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "dcb8b326dbec4d40af26b4f143157468" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9"
W20250830 07:55:01.197144 13703 leader_election.cc:343] T dcb8b326dbec4d40af26b4f143157468 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:55:01.203680 13887 tablet_bootstrap.cc:654] T a5eea1950d1945f1b755fd34597b2fb4 P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
W20250830 07:55:01.206034 14988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.209.61:44241, user_credentials={real_user=slave}} blocked reactor thread for 53765.3us
I20250830 07:55:01.209348 13422 leader_election.cc:304] T 439fc51afa6b435e81bc38b9e88d4041 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:55:01.210502 16072 raft_consensus.cc:2802] T 439fc51afa6b435e81bc38b9e88d4041 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:55:01.210579 16072 raft_consensus.cc:491] T 439fc51afa6b435e81bc38b9e88d4041 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:55:01.210641 16072 raft_consensus.cc:3058] T 439fc51afa6b435e81bc38b9e88d4041 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:55:01.206269 14745 master_runner.cc:186] Error getting master registration for 127.12.209.61:44241: Timed out: Client connection negotiation failed: client connection to 127.12.209.61:44241: received 0 of 4 requested bytes,
I20250830 07:55:01.211887 14745 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20250830 07:55:01.213156 16072 raft_consensus.cc:513] T 439fc51afa6b435e81bc38b9e88d4041 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:01.213775 16072 leader_election.cc:290] T 439fc51afa6b435e81bc38b9e88d4041 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 election: Requested vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:55:01.214970 13624 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "439fc51afa6b435e81bc38b9e88d4041" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9"
W20250830 07:55:01.215809 13423 leader_election.cc:343] T 439fc51afa6b435e81bc38b9e88d4041 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:55:01.215235 13887 tablet_bootstrap.cc:492] T a5eea1950d1945f1b755fd34597b2fb4 P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:55:01.216156 13887 ts_tablet_manager.cc:1397] T a5eea1950d1945f1b755fd34597b2fb4 P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.037s user 0.003s sys 0.000s
I20250830 07:55:01.217279 13887 raft_consensus.cc:357] T a5eea1950d1945f1b755fd34597b2fb4 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:01.217754 13887 raft_consensus.cc:383] T a5eea1950d1945f1b755fd34597b2fb4 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:55:01.217861 13887 raft_consensus.cc:738] T a5eea1950d1945f1b755fd34597b2fb4 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
W20250830 07:55:01.218420 13124 external_mini_cluster.cc:1715] Unable to check leaks on /tmp/dist-test-taskbivBUj/build/asan/bin/kudu pid 13132: Timed out: CheckLeaks RPC to 127.12.209.62:39725 timed out after 1.000s (SENT)
I20250830 07:55:01.218292 13887 consensus_queue.cc:260] T a5eea1950d1945f1b755fd34597b2fb4 P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:01.218569 13124 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskbivBUj/build/asan/bin/kudu with pid 13132
I20250830 07:55:01.219501 13887 ts_tablet_manager.cc:1428] T a5eea1950d1945f1b755fd34597b2fb4 P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20250830 07:55:01.219925 13887 tablet_bootstrap.cc:492] T 63168840534246b59a2fdbfdfeebff47 P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:55:01.219952 13764 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "439fc51afa6b435e81bc38b9e88d4041" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f"
I20250830 07:55:01.220093 13764 raft_consensus.cc:3058] T 439fc51afa6b435e81bc38b9e88d4041 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:55:01.222723 13887 tablet_bootstrap.cc:654] T 63168840534246b59a2fdbfdfeebff47 P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:55:01.222808 13764 raft_consensus.cc:2466] T 439fc51afa6b435e81bc38b9e88d4041 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2065c332f15a4739899af79f3669c3ba in term 1.
I20250830 07:55:01.225222 13886 tablet_bootstrap.cc:492] T 0d16bc64dd6e43f7ba313b77c2bbb728 P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:55:01.225433 13886 ts_tablet_manager.cc:1397] T 0d16bc64dd6e43f7ba313b77c2bbb728 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.068s user 0.005s sys 0.006s
I20250830 07:55:01.226595 13886 raft_consensus.cc:357] T 0d16bc64dd6e43f7ba313b77c2bbb728 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:01.226797 13886 raft_consensus.cc:383] T 0d16bc64dd6e43f7ba313b77c2bbb728 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:55:01.226876 13886 raft_consensus.cc:738] T 0d16bc64dd6e43f7ba313b77c2bbb728 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:55:01.227231 13886 consensus_queue.cc:260] T 0d16bc64dd6e43f7ba313b77c2bbb728 P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:01.228224 13886 ts_tablet_manager.cc:1428] T 0d16bc64dd6e43f7ba313b77c2bbb728 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20250830 07:55:01.229117 13886 tablet_bootstrap.cc:492] T ad7a45187569416bad6c71db9f8ab702 P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:55:01.229384 13882 tablet_bootstrap.cc:492] T 14d4d2506e2a47ea906bfb81d5509829 P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:55:01.229979 13882 ts_tablet_manager.cc:1397] T 14d4d2506e2a47ea906bfb81d5509829 P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.060s user 0.002s sys 0.008s
I20250830 07:55:01.232295 16101 raft_consensus.cc:491] T 4b9d9d4b65964fd49d8e25092a14d774 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:55:01.232398 16101 raft_consensus.cc:513] T 4b9d9d4b65964fd49d8e25092a14d774 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:01.232877 16101 leader_election.cc:290] T 4b9d9d4b65964fd49d8e25092a14d774 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
I20250830 07:55:01.234565 13624 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "4b9d9d4b65964fd49d8e25092a14d774" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
W20250830 07:55:01.235258 13703 consensus_peers.cc:489] T 0ac39adafe144280b39f5c3fe5804087 P 9b057ade5dce45af9f8bf0bedf8b917f -> Peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Couldn't send request to peer 6b5e454d98894637b466ea27f1b647f9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20250830 07:55:01.235492 13703 leader_election.cc:343] T 4b9d9d4b65964fd49d8e25092a14d774 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:55:01.234685 13882 raft_consensus.cc:357] T 14d4d2506e2a47ea906bfb81d5509829 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:01.235908 13882 raft_consensus.cc:383] T 14d4d2506e2a47ea906bfb81d5509829 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:55:01.236289 13882 raft_consensus.cc:738] T 14d4d2506e2a47ea906bfb81d5509829 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:55:01.238102 13882 consensus_queue.cc:260] T 14d4d2506e2a47ea906bfb81d5509829 P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:01.239512 13886 tablet_bootstrap.cc:654] T ad7a45187569416bad6c71db9f8ab702 P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:55:01.240900 13882 ts_tablet_manager.cc:1428] T 14d4d2506e2a47ea906bfb81d5509829 P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.010s user 0.003s sys 0.000s
I20250830 07:55:01.242849 13882 tablet_bootstrap.cc:492] T 2f3bec2c98574a9393e0fae77e228ce0 P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:55:01.247088 13624 raft_consensus.cc:3058] T 2c4c3c61cddf42668d3a09f4fbc5f641 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:55:01.252177 13882 tablet_bootstrap.cc:654] T 2f3bec2c98574a9393e0fae77e228ce0 P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
I20250830 07:55:01.255522 13886 tablet_bootstrap.cc:492] T ad7a45187569416bad6c71db9f8ab702 P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:55:01.255650 13886 ts_tablet_manager.cc:1397] T ad7a45187569416bad6c71db9f8ab702 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.027s user 0.005s sys 0.001s
I20250830 07:55:01.239552 15603 raft_consensus.cc:513] T cd9903bdfaef4139a1a582c54689da4a P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:01.255997 13477 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "50dfc24a0b9645e4860cd99b1df3bd61" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba"
I20250830 07:55:01.256137 13477 raft_consensus.cc:3058] T 50dfc24a0b9645e4860cd99b1df3bd61 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:55:01.258785 13882 tablet_bootstrap.cc:492] T 2f3bec2c98574a9393e0fae77e228ce0 P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:55:01.258898 13882 ts_tablet_manager.cc:1397] T 2f3bec2c98574a9393e0fae77e228ce0 P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.017s user 0.004s sys 0.000s
I20250830 07:55:01.259172 13477 raft_consensus.cc:2466] T 50dfc24a0b9645e4860cd99b1df3bd61 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 1.
I20250830 07:55:01.259675 13882 raft_consensus.cc:357] T 2f3bec2c98574a9393e0fae77e228ce0 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:01.259858 13882 raft_consensus.cc:383] T 2f3bec2c98574a9393e0fae77e228ce0 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:55:01.259905 13882 raft_consensus.cc:738] T 2f3bec2c98574a9393e0fae77e228ce0 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:55:01.260118 13882 consensus_queue.cc:260] T 2f3bec2c98574a9393e0fae77e228ce0 P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:01.260917 13882 ts_tablet_manager.cc:1428] T 2f3bec2c98574a9393e0fae77e228ce0 P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20250830 07:55:01.262073 13624 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "cd9903bdfaef4139a1a582c54689da4a" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9"
W20250830 07:55:01.262821 13703 leader_election.cc:343] T cd9903bdfaef4139a1a582c54689da4a P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:55:01.256354 13886 raft_consensus.cc:357] T ad7a45187569416bad6c71db9f8ab702 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:01.263363 13886 raft_consensus.cc:383] T ad7a45187569416bad6c71db9f8ab702 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:55:01.263486 13886 raft_consensus.cc:738] T ad7a45187569416bad6c71db9f8ab702 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:55:01.264086 13488 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "dcb8b326dbec4d40af26b4f143157468" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba"
I20250830 07:55:01.264060 13886 consensus_queue.cc:260] T ad7a45187569416bad6c71db9f8ab702 P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:01.264216 13488 raft_consensus.cc:3058] T dcb8b326dbec4d40af26b4f143157468 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:55:01.264590 13886 ts_tablet_manager.cc:1428] T ad7a45187569416bad6c71db9f8ab702 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.009s user 0.001s sys 0.001s
I20250830 07:55:01.264861 13886 tablet_bootstrap.cc:492] T 3bca390f6d4343cba7a9fb07f0d4d72b P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:55:01.266273 13886 tablet_bootstrap.cc:654] T 3bca390f6d4343cba7a9fb07f0d4d72b P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:55:01.266368 13882 tablet_bootstrap.cc:492] T c56e3a30c18640e68c8b0c4ff4251d96 P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:55:01.266505 13488 raft_consensus.cc:2466] T dcb8b326dbec4d40af26b4f143157468 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 1.
I20250830 07:55:01.267128 15603 leader_election.cc:290] T cd9903bdfaef4139a1a582c54689da4a P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Requested vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
I20250830 07:55:01.269089 13488 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "4b9d9d4b65964fd49d8e25092a14d774" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:55:01.269311 13488 raft_consensus.cc:2466] T 4b9d9d4b65964fd49d8e25092a14d774 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 0.
I20250830 07:55:01.269698 13882 tablet_bootstrap.cc:654] T c56e3a30c18640e68c8b0c4ff4251d96 P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
W20250830 07:55:01.276670 13703 consensus_peers.cc:489] T 1db4109dc43b489d89c5de9eeb64a771 P 9b057ade5dce45af9f8bf0bedf8b917f -> Peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Couldn't send request to peer 6b5e454d98894637b466ea27f1b647f9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20250830 07:55:01.276823 13488 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "cd9903bdfaef4139a1a582c54689da4a" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba"
I20250830 07:55:01.277007 13488 raft_consensus.cc:3058] T cd9903bdfaef4139a1a582c54689da4a P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:55:01.277469 13882 tablet_bootstrap.cc:492] T c56e3a30c18640e68c8b0c4ff4251d96 P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:55:01.277586 13882 ts_tablet_manager.cc:1397] T c56e3a30c18640e68c8b0c4ff4251d96 P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.016s user 0.005s sys 0.000s
I20250830 07:55:01.278357 13882 raft_consensus.cc:357] T c56e3a30c18640e68c8b0c4ff4251d96 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:01.278507 13882 raft_consensus.cc:383] T c56e3a30c18640e68c8b0c4ff4251d96 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:55:01.278563 13882 raft_consensus.cc:738] T c56e3a30c18640e68c8b0c4ff4251d96 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:55:01.278759 13882 consensus_queue.cc:260] T c56e3a30c18640e68c8b0c4ff4251d96 P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:01.279868 13488 raft_consensus.cc:2466] T cd9903bdfaef4139a1a582c54689da4a P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 1.
I20250830 07:55:01.279964 16074 raft_consensus.cc:491] T fbb1cc8f8eea4a0795f6f8e213b8180f P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:55:01.280095 16074 raft_consensus.cc:513] T fbb1cc8f8eea4a0795f6f8e213b8180f P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:01.280735 16074 leader_election.cc:290] T fbb1cc8f8eea4a0795f6f8e213b8180f P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:55:01.281255 13772 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "fbb1cc8f8eea4a0795f6f8e213b8180f" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:55:01.281903 13477 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "fbb1cc8f8eea4a0795f6f8e213b8180f" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:55:01.282089 13477 raft_consensus.cc:2391] T fbb1cc8f8eea4a0795f6f8e213b8180f P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b5e454d98894637b466ea27f1b647f9 in current term 1: Already voted for candidate 9b057ade5dce45af9f8bf0bedf8b917f in this term.
W20250830 07:55:01.282263 13703 consensus_peers.cc:489] T 34199145292d4ddb8c603e5c581f1d15 P 9b057ade5dce45af9f8bf0bedf8b917f -> Peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Couldn't send request to peer 6b5e454d98894637b466ea27f1b647f9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20250830 07:55:01.282541 13561 leader_election.cc:304] T fbb1cc8f8eea4a0795f6f8e213b8180f P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b5e454d98894637b466ea27f1b647f9; no voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:55:01.282887 15582 raft_consensus.cc:3058] T fbb1cc8f8eea4a0795f6f8e213b8180f P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:55:01.283171 13886 tablet_bootstrap.cc:492] T 3bca390f6d4343cba7a9fb07f0d4d72b P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:55:01.283283 13886 ts_tablet_manager.cc:1397] T 3bca390f6d4343cba7a9fb07f0d4d72b P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.018s user 0.001s sys 0.004s
I20250830 07:55:01.284592 13886 raft_consensus.cc:357] T 3bca390f6d4343cba7a9fb07f0d4d72b P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:01.284731 13886 raft_consensus.cc:383] T 3bca390f6d4343cba7a9fb07f0d4d72b P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:55:01.284780 13886 raft_consensus.cc:738] T 3bca390f6d4343cba7a9fb07f0d4d72b P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:55:01.284952 13886 consensus_queue.cc:260] T 3bca390f6d4343cba7a9fb07f0d4d72b P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:01.285418 13886 ts_tablet_manager.cc:1428] T 3bca390f6d4343cba7a9fb07f0d4d72b P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250830 07:55:01.285662 13886 tablet_bootstrap.cc:492] T 1ca83bbf848744f38206ceb4126271be P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:55:01.285902 15582 raft_consensus.cc:2747] T fbb1cc8f8eea4a0795f6f8e213b8180f P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:55:01.287674 13886 tablet_bootstrap.cc:654] T 1ca83bbf848744f38206ceb4126271be P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:55:01.289011 13701 leader_election.cc:304] T 50dfc24a0b9645e4860cd99b1df3bd61 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:55:01.289630 15748 raft_consensus.cc:2802] T 50dfc24a0b9645e4860cd99b1df3bd61 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election won for term 1
I20250830 07:55:01.289794 15748 raft_consensus.cc:695] T 50dfc24a0b9645e4860cd99b1df3bd61 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 LEADER]: Becoming Leader. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Running, Role: LEADER
I20250830 07:55:01.290046 15748 consensus_queue.cc:237] T 50dfc24a0b9645e4860cd99b1df3bd61 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:01.289604 13701 leader_election.cc:304] T dcb8b326dbec4d40af26b4f143157468 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:55:01.290357 16100 raft_consensus.cc:2802] T dcb8b326dbec4d40af26b4f143157468 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election won for term 1
I20250830 07:55:01.290500 16100 raft_consensus.cc:695] T dcb8b326dbec4d40af26b4f143157468 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 LEADER]: Becoming Leader. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Running, Role: LEADER
I20250830 07:55:01.290628 13701 leader_election.cc:304] T 4b9d9d4b65964fd49d8e25092a14d774 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:55:01.290679 16100 consensus_queue.cc:237] T dcb8b326dbec4d40af26b4f143157468 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:01.291062 13701 leader_election.cc:304] T cd9903bdfaef4139a1a582c54689da4a P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:55:01.291154 15720 raft_consensus.cc:2802] T 4b9d9d4b65964fd49d8e25092a14d774 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:55:01.291232 15720 raft_consensus.cc:491] T 4b9d9d4b65964fd49d8e25092a14d774 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:55:01.291301 15720 raft_consensus.cc:3058] T 4b9d9d4b65964fd49d8e25092a14d774 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:55:01.291471 15980 consensus_queue.cc:1035] T 0ac39adafe144280b39f5c3fe5804087 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:55:01.291923 15980 raft_consensus.cc:2802] T cd9903bdfaef4139a1a582c54689da4a P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election won for term 1
I20250830 07:55:01.292022 15980 raft_consensus.cc:695] T cd9903bdfaef4139a1a582c54689da4a P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 LEADER]: Becoming Leader. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Running, Role: LEADER
I20250830 07:55:01.292229 15980 consensus_queue.cc:237] T cd9903bdfaef4139a1a582c54689da4a P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:01.293901 15720 raft_consensus.cc:513] T 4b9d9d4b65964fd49d8e25092a14d774 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:01.294536 15720 leader_election.cc:290] T 4b9d9d4b65964fd49d8e25092a14d774 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Requested vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
I20250830 07:55:01.295885 13624 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "4b9d9d4b65964fd49d8e25092a14d774" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9"
W20250830 07:55:01.296470 13703 leader_election.cc:343] T 4b9d9d4b65964fd49d8e25092a14d774 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
W20250830 07:55:01.301069 13539 tablet.cc:2378] T 0f34ed0fe6e9400fae5c0edebb615ebd P 2065c332f15a4739899af79f3669c3ba: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20250830 07:55:01.309309 15603 raft_consensus.cc:491] T d94215b0b1f142178f0b791518d1baf2 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:55:01.309541 15603 raft_consensus.cc:513] T d94215b0b1f142178f0b791518d1baf2 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:01.310555 15603 leader_election.cc:290] T d94215b0b1f142178f0b791518d1baf2 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
I20250830 07:55:01.311730 13624 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "d94215b0b1f142178f0b791518d1baf2" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
W20250830 07:55:01.312320 13703 leader_election.cc:343] T d94215b0b1f142178f0b791518d1baf2 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:55:01.315804 15582 raft_consensus.cc:491] T 3d9c884ac05e44ddb59f96588fdd6f4b P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:55:01.315932 15582 raft_consensus.cc:513] T 3d9c884ac05e44ddb59f96588fdd6f4b P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:01.316490 15582 leader_election.cc:290] T 3d9c884ac05e44ddb59f96588fdd6f4b P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:55:01.279685 13882 ts_tablet_manager.cc:1428] T c56e3a30c18640e68c8b0c4ff4251d96 P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20250830 07:55:01.323801 13476 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "3d9c884ac05e44ddb59f96588fdd6f4b" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:55:01.327809 16079 raft_consensus.cc:491] T 7676b4d6a75c4c6aacced1f2a1beb555 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:55:01.327960 16079 raft_consensus.cc:513] T 7676b4d6a75c4c6aacced1f2a1beb555 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:01.328610 16079 leader_election.cc:290] T 7676b4d6a75c4c6aacced1f2a1beb555 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:55:01.329263 13624 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "7676b4d6a75c4c6aacced1f2a1beb555" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
W20250830 07:55:01.329865 13423 leader_election.cc:343] T 7676b4d6a75c4c6aacced1f2a1beb555 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:55:01.351052 13422 leader_election.cc:304] T 439fc51afa6b435e81bc38b9e88d4041 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:55:01.351378 16072 raft_consensus.cc:2802] T 439fc51afa6b435e81bc38b9e88d4041 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election won for term 1
I20250830 07:55:01.351516 16072 raft_consensus.cc:695] T 439fc51afa6b435e81bc38b9e88d4041 P 2065c332f15a4739899af79f3669c3ba [term 1 LEADER]: Becoming Leader. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Running, Role: LEADER
I20250830 07:55:01.351821 16072 consensus_queue.cc:237] T 439fc51afa6b435e81bc38b9e88d4041 P 2065c332f15a4739899af79f3669c3ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:01.358450 13882 tablet_bootstrap.cc:492] T e74a3e4b3b234c41aca30f772525652e P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:55:01.360024 13887 tablet_bootstrap.cc:492] T 63168840534246b59a2fdbfdfeebff47 P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:55:01.360224 13882 tablet_bootstrap.cc:654] T e74a3e4b3b234c41aca30f772525652e P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
I20250830 07:55:01.368281 13887 ts_tablet_manager.cc:1397] T 63168840534246b59a2fdbfdfeebff47 P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.148s user 0.003s sys 0.008s
I20250830 07:55:01.368613 13886 tablet_bootstrap.cc:492] T 1ca83bbf848744f38206ceb4126271be P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:55:01.368723 13886 ts_tablet_manager.cc:1397] T 1ca83bbf848744f38206ceb4126271be P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.083s user 0.015s sys 0.008s
I20250830 07:55:01.369939 13887 raft_consensus.cc:357] T 63168840534246b59a2fdbfdfeebff47 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:01.370644 13886 raft_consensus.cc:357] T 1ca83bbf848744f38206ceb4126271be P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:01.370810 13886 raft_consensus.cc:383] T 1ca83bbf848744f38206ceb4126271be P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:55:01.370864 13886 raft_consensus.cc:738] T 1ca83bbf848744f38206ceb4126271be P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:55:01.371085 13886 consensus_queue.cc:260] T 1ca83bbf848744f38206ceb4126271be P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:01.371472 13772 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "7676b4d6a75c4c6aacced1f2a1beb555" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:55:01.372581 13886 ts_tablet_manager.cc:1428] T 1ca83bbf848744f38206ceb4126271be P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20250830 07:55:01.374436 13882 tablet_bootstrap.cc:492] T e74a3e4b3b234c41aca30f772525652e P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:55:01.374547 13882 ts_tablet_manager.cc:1397] T e74a3e4b3b234c41aca30f772525652e P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.016s user 0.001s sys 0.009s
I20250830 07:55:01.375218 13882 raft_consensus.cc:357] T e74a3e4b3b234c41aca30f772525652e P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:01.375367 13882 raft_consensus.cc:383] T e74a3e4b3b234c41aca30f772525652e P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:55:01.375424 13882 raft_consensus.cc:738] T e74a3e4b3b234c41aca30f772525652e P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:55:01.375597 13882 consensus_queue.cc:260] T e74a3e4b3b234c41aca30f772525652e P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:01.376081 13882 ts_tablet_manager.cc:1428] T e74a3e4b3b234c41aca30f772525652e P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250830 07:55:01.376346 13882 tablet_bootstrap.cc:492] T 2c31d119743f49589703c434ac6c7548 P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:55:01.377884 13882 tablet_bootstrap.cc:654] T 2c31d119743f49589703c434ac6c7548 P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
I20250830 07:55:01.378239 13887 raft_consensus.cc:383] T 63168840534246b59a2fdbfdfeebff47 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:55:01.378975 13887 raft_consensus.cc:738] T 63168840534246b59a2fdbfdfeebff47 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:55:01.379902 13887 consensus_queue.cc:260] T 63168840534246b59a2fdbfdfeebff47 P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:01.385689 13882 tablet_bootstrap.cc:492] T 2c31d119743f49589703c434ac6c7548 P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:55:01.385805 13882 ts_tablet_manager.cc:1397] T 2c31d119743f49589703c434ac6c7548 P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.010s user 0.001s sys 0.007s
I20250830 07:55:01.386385 13882 raft_consensus.cc:357] T 2c31d119743f49589703c434ac6c7548 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:01.386525 13882 raft_consensus.cc:383] T 2c31d119743f49589703c434ac6c7548 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:55:01.386577 13882 raft_consensus.cc:738] T 2c31d119743f49589703c434ac6c7548 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:55:01.387064 13886 tablet_bootstrap.cc:492] T 3f70097c1b3a48dfbc1ad129fa7a3730 P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:55:01.388486 13886 tablet_bootstrap.cc:654] T 3f70097c1b3a48dfbc1ad129fa7a3730 P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:55:01.386744 13882 consensus_queue.cc:260] T 2c31d119743f49589703c434ac6c7548 P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:01.392611 15992 raft_consensus.cc:491] T 14d4d2506e2a47ea906bfb81d5509829 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:55:01.392658 13882 ts_tablet_manager.cc:1428] T 2c31d119743f49589703c434ac6c7548 P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.007s user 0.001s sys 0.001s
I20250830 07:55:01.392714 15992 raft_consensus.cc:513] T 14d4d2506e2a47ea906bfb81d5509829 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:01.392880 13882 tablet_bootstrap.cc:492] T 0ac39adafe144280b39f5c3fe5804087 P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:55:01.393080 13887 ts_tablet_manager.cc:1428] T 63168840534246b59a2fdbfdfeebff47 P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.024s user 0.001s sys 0.001s
I20250830 07:55:01.393234 15992 leader_election.cc:290] T 14d4d2506e2a47ea906bfb81d5509829 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:55:01.393750 13477 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "14d4d2506e2a47ea906bfb81d5509829" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:55:01.394265 13882 tablet_bootstrap.cc:654] T 0ac39adafe144280b39f5c3fe5804087 P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
W20250830 07:55:01.396454 13704 connection.cc:537] client connection to 127.12.209.62:39725 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20250830 07:55:01.396425 13476 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "4b9d9d4b65964fd49d8e25092a14d774" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba"
I20250830 07:55:01.396582 13476 raft_consensus.cc:3058] T 4b9d9d4b65964fd49d8e25092a14d774 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:55:01.399824 13476 raft_consensus.cc:2466] T 4b9d9d4b65964fd49d8e25092a14d774 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 1.
I20250830 07:55:01.402385 13476 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "d94215b0b1f142178f0b791518d1baf2" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:55:01.402603 13476 raft_consensus.cc:2466] T d94215b0b1f142178f0b791518d1baf2 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 0.
I20250830 07:55:01.403159 13887 tablet_bootstrap.cc:492] T 508d21af038c4801a9680ce275eb504c P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
W20250830 07:55:01.406306 13564 connection.cc:537] client connection to 127.12.209.62:39725 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20250830 07:55:01.406677 13424 connection.cc:537] client connection to 127.12.209.62:39725 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20250830 07:55:01.406716 14992 connection.cc:537] client connection to 127.12.209.62:39725 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20250830 07:55:01.406893 14992 leader_election.cc:336] T 00000000000000000000000000000000 P 3ea183a890b84f408b20b55e9eb7c7ed [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer fea6152429cc4e79a25b18e02aafae57 (127.12.209.62:39725): Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20250830 07:55:01.407402 13882 tablet_bootstrap.cc:492] T 0ac39adafe144280b39f5c3fe5804087 P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:55:01.407493 13882 ts_tablet_manager.cc:1397] T 0ac39adafe144280b39f5c3fe5804087 P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.015s user 0.001s sys 0.005s
I20250830 07:55:01.408089 13882 raft_consensus.cc:357] T 0ac39adafe144280b39f5c3fe5804087 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:01.408221 13882 raft_consensus.cc:383] T 0ac39adafe144280b39f5c3fe5804087 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:55:01.408260 13882 raft_consensus.cc:738] T 0ac39adafe144280b39f5c3fe5804087 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:55:01.408408 13882 consensus_queue.cc:260] T 0ac39adafe144280b39f5c3fe5804087 P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:01.408735 13882 ts_tablet_manager.cc:1428] T 0ac39adafe144280b39f5c3fe5804087 P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20250830 07:55:01.408916 13882 tablet_bootstrap.cc:492] T bdeb89bbb3ad4e67bbc74b78454eeb7e P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:55:01.409576 15582 raft_consensus.cc:491] T 2c31d119743f49589703c434ac6c7548 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:55:01.409736 15582 raft_consensus.cc:513] T 2c31d119743f49589703c434ac6c7548 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:01.410058 13886 tablet_bootstrap.cc:492] T 3f70097c1b3a48dfbc1ad129fa7a3730 P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:55:01.410167 13886 ts_tablet_manager.cc:1397] T 3f70097c1b3a48dfbc1ad129fa7a3730 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.023s user 0.008s sys 0.002s
I20250830 07:55:01.410753 13886 raft_consensus.cc:357] T 3f70097c1b3a48dfbc1ad129fa7a3730 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:01.410892 13886 raft_consensus.cc:383] T 3f70097c1b3a48dfbc1ad129fa7a3730 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:55:01.410984 13886 raft_consensus.cc:738] T 3f70097c1b3a48dfbc1ad129fa7a3730 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:55:01.411144 13886 consensus_queue.cc:260] T 3f70097c1b3a48dfbc1ad129fa7a3730 P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:01.411743 13886 ts_tablet_manager.cc:1428] T 3f70097c1b3a48dfbc1ad129fa7a3730 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20250830 07:55:01.412029 13886 tablet_bootstrap.cc:492] T 55bd3f378b854476a24f657f5e23843d P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:55:01.413872 13886 tablet_bootstrap.cc:654] T 55bd3f378b854476a24f657f5e23843d P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:55:01.413962 13701 leader_election.cc:304] T 4b9d9d4b65964fd49d8e25092a14d774 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:55:01.414350 16100 raft_consensus.cc:2802] T 4b9d9d4b65964fd49d8e25092a14d774 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election won for term 1
I20250830 07:55:01.414454 16100 raft_consensus.cc:695] T 4b9d9d4b65964fd49d8e25092a14d774 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 LEADER]: Becoming Leader. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Running, Role: LEADER
I20250830 07:55:01.414671 16100 consensus_queue.cc:237] T 4b9d9d4b65964fd49d8e25092a14d774 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
W20250830 07:55:01.417666 15746 lock_manager.cc:585] Waited 5 seconds to obtain row lock on key '<redacted>' (key hash 4012713805250960239) tablet 00000000000000000000000000000000 cur holder 0x61700003a700
W20250830 07:55:01.420373 13221 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.12.209.62:39725 (error 108)
W20250830 07:55:01.427415 13677 tablet.cc:2378] T 0ac39adafe144280b39f5c3fe5804087 P 6b5e454d98894637b466ea27f1b647f9: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20250830 07:55:01.427619 15582 leader_election.cc:290] T 2c31d119743f49589703c434ac6c7548 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:55:01.428635 13887 tablet_bootstrap.cc:654] T 508d21af038c4801a9680ce275eb504c P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:55:01.430230 15748 consensus_queue.cc:1035] T fbb1cc8f8eea4a0795f6f8e213b8180f P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:55:01.431108 16072 raft_consensus.cc:491] T 2aea1a69d22544899b0218be7e0f8799 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:55:01.431231 16072 raft_consensus.cc:513] T 2aea1a69d22544899b0218be7e0f8799 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:01.431772 16072 leader_election.cc:290] T 2aea1a69d22544899b0218be7e0f8799 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:55:01.432665 13624 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "2aea1a69d22544899b0218be7e0f8799" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
W20250830 07:55:01.433357 13423 leader_election.cc:343] T 2aea1a69d22544899b0218be7e0f8799 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
W20250830 07:55:01.439203 13422 leader_election.cc:343] T 7676b4d6a75c4c6aacced1f2a1beb555 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:55:01.439330 13422 leader_election.cc:304] T 7676b4d6a75c4c6aacced1f2a1beb555 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba; no voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:55:01.439546 15919 raft_consensus.cc:2747] T 7676b4d6a75c4c6aacced1f2a1beb555 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:55:01.444965 15919 raft_consensus.cc:491] T c6355878115a4907ae1f0a45fb2c6492 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:55:01.445075 15919 raft_consensus.cc:513] T c6355878115a4907ae1f0a45fb2c6492 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:01.445528 15919 leader_election.cc:290] T c6355878115a4907ae1f0a45fb2c6492 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:55:01.446017 13624 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "c6355878115a4907ae1f0a45fb2c6492" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
W20250830 07:55:01.446484 13423 leader_election.cc:343] T c6355878115a4907ae1f0a45fb2c6492 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
W20250830 07:55:01.448925 13823 tablet.cc:2378] T 0d16bc64dd6e43f7ba313b77c2bbb728 P 9b057ade5dce45af9f8bf0bedf8b917f: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20250830 07:55:01.455358 13882 tablet_bootstrap.cc:654] T bdeb89bbb3ad4e67bbc74b78454eeb7e P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
I20250830 07:55:01.456384 13887 tablet_bootstrap.cc:492] T 508d21af038c4801a9680ce275eb504c P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:55:01.456547 13887 ts_tablet_manager.cc:1397] T 508d21af038c4801a9680ce275eb504c P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.053s user 0.001s sys 0.002s
I20250830 07:55:01.457576 13887 raft_consensus.cc:357] T 508d21af038c4801a9680ce275eb504c P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:01.457770 13887 raft_consensus.cc:383] T 508d21af038c4801a9680ce275eb504c P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:55:01.457818 13887 raft_consensus.cc:738] T 508d21af038c4801a9680ce275eb504c P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:55:01.458012 13887 consensus_queue.cc:260] T 508d21af038c4801a9680ce275eb504c P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:01.458608 13887 ts_tablet_manager.cc:1428] T 508d21af038c4801a9680ce275eb504c P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
W20250830 07:55:01.463872 16213 negotiation.cc:337] Failed RPC negotiation. Trace:
0830 07:55:01.409013 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.209.62:39725 (local address 127.12.209.2:51721)
0830 07:55:01.463494 (+ 54481us) negotiation.cc:107] Waiting for socket to connect
0830 07:55:01.463603 (+ 109us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.209.62:39725: connect: Connection reset by peer (error 104)
Metrics: {"client-negotiator.queue_time_us":54369,"threads_started":1}
W20250830 07:55:01.465107 13221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.209.62:39725, user_credentials={real_user=slave}} blocked reactor thread for 44754.7us
W20250830 07:55:01.468101 16212 negotiation.cc:337] Failed RPC negotiation. Trace:
0830 07:55:01.399925 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.209.62:39725 (local address 127.12.209.3:42009)
0830 07:55:01.467494 (+ 67569us) negotiation.cc:107] Waiting for socket to connect
0830 07:55:01.467579 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.209.62:39725: connect: Connection reset by peer (error 104)
Metrics: {"client-negotiator.queue_time_us":67478,"threads_started":1}
I20250830 07:55:01.468706 16100 raft_consensus.cc:491] T a36f38ada7314165a5e9d6ee7bbf69e3 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:55:01.468812 16100 raft_consensus.cc:513] T a36f38ada7314165a5e9d6ee7bbf69e3 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:01.469260 16100 leader_election.cc:290] T a36f38ada7314165a5e9d6ee7bbf69e3 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
W20250830 07:55:01.469266 13221 consensus_peers.cc:489] T 00000000000000000000000000000000 P 5e9d6449ae824acab24c459a72075e88 -> Peer fea6152429cc4e79a25b18e02aafae57 (127.12.209.62:39725): Couldn't send request to peer fea6152429cc4e79a25b18e02aafae57. Status: Network error: Client connection negotiation failed: client connection to 127.12.209.62:39725: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20250830 07:55:01.469354 16100 raft_consensus.cc:491] T d1d5e0d40a91457da65a0e925289309e P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:55:01.469429 16100 raft_consensus.cc:513] T d1d5e0d40a91457da65a0e925289309e P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:01.469798 16100 leader_election.cc:290] T d1d5e0d40a91457da65a0e925289309e P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
I20250830 07:55:01.458880 13887 tablet_bootstrap.cc:492] T fac764a2d269411c86b85ceeaec0b014 P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:55:01.479594 13886 tablet_bootstrap.cc:492] T 55bd3f378b854476a24f657f5e23843d P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:55:01.479761 13886 ts_tablet_manager.cc:1397] T 55bd3f378b854476a24f657f5e23843d P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.068s user 0.011s sys 0.045s
I20250830 07:55:01.480871 13887 tablet_bootstrap.cc:654] T fac764a2d269411c86b85ceeaec0b014 P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:55:01.480809 13886 raft_consensus.cc:357] T 55bd3f378b854476a24f657f5e23843d P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:01.481096 13886 raft_consensus.cc:383] T 55bd3f378b854476a24f657f5e23843d P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:55:01.481254 13886 raft_consensus.cc:738] T 55bd3f378b854476a24f657f5e23843d P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:55:01.481518 13886 consensus_queue.cc:260] T 55bd3f378b854476a24f657f5e23843d P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:01.465874 15919 raft_consensus.cc:491] T e7e9d2e9b1ca4ddfb0c6a7bced613c35 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20250830 07:55:01.481973 16214 negotiation.cc:337] Failed RPC negotiation. Trace:
0830 07:55:01.409383 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.209.62:39725 (local address 127.12.209.1:36777)
0830 07:55:01.464263 (+ 54880us) negotiation.cc:107] Waiting for socket to connect
0830 07:55:01.464370 (+ 107us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.209.62:39725: connect: Connection reset by peer (error 104)
Metrics: {"client-negotiator.queue_time_us":54779,"thread_start_us":56241,"threads_started":1}
I20250830 07:55:01.482007 15919 raft_consensus.cc:513] T e7e9d2e9b1ca4ddfb0c6a7bced613c35 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:01.482538 15919 leader_election.cc:290] T e7e9d2e9b1ca4ddfb0c6a7bced613c35 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:55:01.467046 13488 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "2c31d119743f49589703c434ac6c7548" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:55:01.483418 13624 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "e7e9d2e9b1ca4ddfb0c6a7bced613c35" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
W20250830 07:55:01.483866 13423 leader_election.cc:343] T e7e9d2e9b1ca4ddfb0c6a7bced613c35 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:55:01.485010 13886 ts_tablet_manager.cc:1428] T 55bd3f378b854476a24f657f5e23843d P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20250830 07:55:01.485816 13882 tablet_bootstrap.cc:492] T bdeb89bbb3ad4e67bbc74b78454eeb7e P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:55:01.486052 13886 tablet_bootstrap.cc:492] T ccc9091018cb48ffb2affd98e8bbfa05 P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:55:01.486099 13882 ts_tablet_manager.cc:1397] T bdeb89bbb3ad4e67bbc74b78454eeb7e P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.077s user 0.002s sys 0.003s
I20250830 07:55:01.487471 13882 raft_consensus.cc:357] T bdeb89bbb3ad4e67bbc74b78454eeb7e P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:01.487735 13882 raft_consensus.cc:383] T bdeb89bbb3ad4e67bbc74b78454eeb7e P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:55:01.487812 13882 raft_consensus.cc:738] T bdeb89bbb3ad4e67bbc74b78454eeb7e P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:55:01.488152 13886 tablet_bootstrap.cc:654] T ccc9091018cb48ffb2affd98e8bbfa05 P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:55:01.488289 13882 consensus_queue.cc:260] T bdeb89bbb3ad4e67bbc74b78454eeb7e P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:01.489650 13882 ts_tablet_manager.cc:1428] T bdeb89bbb3ad4e67bbc74b78454eeb7e P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20250830 07:55:01.492385 13882 tablet_bootstrap.cc:492] T f32ebc2605c34a68aed50379f028052c P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:55:01.496127 15919 raft_consensus.cc:491] T 8ee98b748d0245bc8bf9eeac727b495e P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:55:01.496256 15919 raft_consensus.cc:513] T 8ee98b748d0245bc8bf9eeac727b495e P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:01.496815 15919 leader_election.cc:290] T 8ee98b748d0245bc8bf9eeac727b495e P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:55:01.497318 15919 raft_consensus.cc:491] T 690cf258639a4c1ea5a0ac4f2fd39f88 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:55:01.497433 15919 raft_consensus.cc:513] T 690cf258639a4c1ea5a0ac4f2fd39f88 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:01.497599 13624 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "8ee98b748d0245bc8bf9eeac727b495e" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:55:01.497946 15919 leader_election.cc:290] T 690cf258639a4c1ea5a0ac4f2fd39f88 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
W20250830 07:55:01.498343 13423 leader_election.cc:343] T 8ee98b748d0245bc8bf9eeac727b495e P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:55:01.498492 13624 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "690cf258639a4c1ea5a0ac4f2fd39f88" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
W20250830 07:55:01.498952 13423 leader_election.cc:343] T 690cf258639a4c1ea5a0ac4f2fd39f88 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:55:01.507315 13882 tablet_bootstrap.cc:654] T f32ebc2605c34a68aed50379f028052c P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
I20250830 07:55:01.519650 16074 raft_consensus.cc:491] T 846338e46b834ae0b5f4e74c7f1325d2 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:55:01.519780 16074 raft_consensus.cc:513] T 846338e46b834ae0b5f4e74c7f1325d2 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:01.520478 16074 leader_election.cc:290] T 846338e46b834ae0b5f4e74c7f1325d2 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:55:01.520642 13701 leader_election.cc:304] T d94215b0b1f142178f0b791518d1baf2 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
W20250830 07:55:01.520841 13701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.209.1:45325, user_credentials={real_user=slave}} blocked reactor thread for 90366.3us
I20250830 07:55:01.521286 15748 raft_consensus.cc:2802] T d94215b0b1f142178f0b791518d1baf2 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:55:01.521363 15748 raft_consensus.cc:491] T d94215b0b1f142178f0b791518d1baf2 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:55:01.521426 15748 raft_consensus.cc:3058] T d94215b0b1f142178f0b791518d1baf2 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:55:01.522809 15980 raft_consensus.cc:491] T 3f70097c1b3a48dfbc1ad129fa7a3730 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:55:01.523895 15748 raft_consensus.cc:513] T d94215b0b1f142178f0b791518d1baf2 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:01.523293 13772 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "2aea1a69d22544899b0218be7e0f8799" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:55:01.524230 13775 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "e7e9d2e9b1ca4ddfb0c6a7bced613c35" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:55:01.522922 15980 raft_consensus.cc:513] T 3f70097c1b3a48dfbc1ad129fa7a3730 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
W20250830 07:55:01.527180 13561 consensus_peers.cc:489] T 8eb010d7955d47a89ff1d01be1b5b01e P 6b5e454d98894637b466ea27f1b647f9 -> Peer 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): Couldn't send request to peer 2065c332f15a4739899af79f3669c3ba. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8eb010d7955d47a89ff1d01be1b5b01e. This is attempt 6: this message will repeat every 5th retry.
I20250830 07:55:01.527549 15980 leader_election.cc:290] T 3f70097c1b3a48dfbc1ad129fa7a3730 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
I20250830 07:55:01.524528 13772 raft_consensus.cc:2466] T 2aea1a69d22544899b0218be7e0f8799 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2065c332f15a4739899af79f3669c3ba in term 0.
I20250830 07:55:01.524544 13765 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "8ee98b748d0245bc8bf9eeac727b495e" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:55:01.524436 15748 leader_election.cc:290] T d94215b0b1f142178f0b791518d1baf2 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Requested vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
I20250830 07:55:01.525131 13764 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "c6355878115a4907ae1f0a45fb2c6492" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:55:01.525159 13771 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "690cf258639a4c1ea5a0ac4f2fd39f88" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:55:01.530524 13488 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "846338e46b834ae0b5f4e74c7f1325d2" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:55:01.537632 16079 raft_consensus.cc:491] T 838616d8274648fc9ea4f1583bdb97f9 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:55:01.537752 16079 raft_consensus.cc:513] T 838616d8274648fc9ea4f1583bdb97f9 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:01.538324 16079 leader_election.cc:290] T 838616d8274648fc9ea4f1583bdb97f9 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:55:01.538702 13624 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "838616d8274648fc9ea4f1583bdb97f9" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
W20250830 07:55:01.539144 13423 leader_election.cc:343] T 838616d8274648fc9ea4f1583bdb97f9 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:55:01.539871 13488 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "a36f38ada7314165a5e9d6ee7bbf69e3" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:55:01.540043 13488 raft_consensus.cc:2466] T a36f38ada7314165a5e9d6ee7bbf69e3 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 0.
I20250830 07:55:01.541023 13488 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "d1d5e0d40a91457da65a0e925289309e" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:55:01.541181 13488 raft_consensus.cc:2466] T d1d5e0d40a91457da65a0e925289309e P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 0.
I20250830 07:55:01.545426 13488 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "d94215b0b1f142178f0b791518d1baf2" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba"
I20250830 07:55:01.545593 13488 raft_consensus.cc:3058] T d94215b0b1f142178f0b791518d1baf2 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:55:01.545373 13882 tablet_bootstrap.cc:492] T f32ebc2605c34a68aed50379f028052c P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:55:01.545830 13882 ts_tablet_manager.cc:1397] T f32ebc2605c34a68aed50379f028052c P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.055s user 0.004s sys 0.001s
I20250830 07:55:01.547094 13882 raft_consensus.cc:357] T f32ebc2605c34a68aed50379f028052c P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:01.547405 13882 raft_consensus.cc:383] T f32ebc2605c34a68aed50379f028052c P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:55:01.547497 13882 raft_consensus.cc:738] T f32ebc2605c34a68aed50379f028052c P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:55:01.547859 13882 consensus_queue.cc:260] T f32ebc2605c34a68aed50379f028052c P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:01.548681 13882 ts_tablet_manager.cc:1428] T f32ebc2605c34a68aed50379f028052c P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20250830 07:55:01.549104 13882 tablet_bootstrap.cc:492] T 6720d2b945814305845beea0a2cb9912 P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:55:01.550473 13488 raft_consensus.cc:2466] T d94215b0b1f142178f0b791518d1baf2 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 1.
I20250830 07:55:01.552083 13476 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "3f70097c1b3a48dfbc1ad129fa7a3730" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:55:01.552297 13476 raft_consensus.cc:2466] T 3f70097c1b3a48dfbc1ad129fa7a3730 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 0.
W20250830 07:55:01.553505 13703 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.209.2:38967, user_credentials={real_user=slave}} blocked reactor thread for 241180us
I20250830 07:55:01.557485 13701 leader_election.cc:304] T a36f38ada7314165a5e9d6ee7bbf69e3 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters:
I20250830 07:55:01.557716 15365 raft_consensus.cc:2802] T a36f38ada7314165a5e9d6ee7bbf69e3 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:55:01.557788 15365 raft_consensus.cc:491] T a36f38ada7314165a5e9d6ee7bbf69e3 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:55:01.557843 15365 raft_consensus.cc:3058] T a36f38ada7314165a5e9d6ee7bbf69e3 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:55:01.560395 15365 raft_consensus.cc:513] T a36f38ada7314165a5e9d6ee7bbf69e3 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:01.560959 15365 leader_election.cc:290] T a36f38ada7314165a5e9d6ee7bbf69e3 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Requested vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
I20250830 07:55:01.555024 13771 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "838616d8274648fc9ea4f1583bdb97f9" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:55:01.562407 13701 leader_election.cc:304] T d1d5e0d40a91457da65a0e925289309e P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters:
I20250830 07:55:01.562695 15365 raft_consensus.cc:2802] T d1d5e0d40a91457da65a0e925289309e P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:55:01.562808 15365 raft_consensus.cc:491] T d1d5e0d40a91457da65a0e925289309e P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:55:01.562917 15365 raft_consensus.cc:3058] T d1d5e0d40a91457da65a0e925289309e P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:55:01.565526 13882 tablet_bootstrap.cc:654] T 6720d2b945814305845beea0a2cb9912 P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
I20250830 07:55:01.566098 15365 raft_consensus.cc:513] T d1d5e0d40a91457da65a0e925289309e P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:01.566615 15365 leader_election.cc:290] T d1d5e0d40a91457da65a0e925289309e P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Requested vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
I20250830 07:55:01.572348 15980 consensus_queue.cc:1035] T 34199145292d4ddb8c603e5c581f1d15 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:55:01.572937 16100 consensus_queue.cc:1035] T 0c70140d87d34bde919714f08a5c94d4 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:55:01.573251 13701 leader_election.cc:304] T d94215b0b1f142178f0b791518d1baf2 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters:
I20250830 07:55:01.573434 15748 raft_consensus.cc:2802] T d94215b0b1f142178f0b791518d1baf2 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election won for term 1
I20250830 07:55:01.573535 15748 raft_consensus.cc:695] T d94215b0b1f142178f0b791518d1baf2 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 LEADER]: Becoming Leader. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Running, Role: LEADER
I20250830 07:55:01.573745 15748 consensus_queue.cc:237] T d94215b0b1f142178f0b791518d1baf2 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:01.574378 13701 leader_election.cc:304] T 3f70097c1b3a48dfbc1ad129fa7a3730 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters:
I20250830 07:55:01.575136 15365 raft_consensus.cc:2802] T 3f70097c1b3a48dfbc1ad129fa7a3730 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:55:01.575196 15365 raft_consensus.cc:491] T 3f70097c1b3a48dfbc1ad129fa7a3730 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:55:01.575246 15365 raft_consensus.cc:3058] T 3f70097c1b3a48dfbc1ad129fa7a3730 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:55:01.577732 15365 raft_consensus.cc:513] T 3f70097c1b3a48dfbc1ad129fa7a3730 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:01.578243 15365 leader_election.cc:290] T 3f70097c1b3a48dfbc1ad129fa7a3730 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Requested vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
W20250830 07:55:01.581591 13422 leader_election.cc:343] T e7e9d2e9b1ca4ddfb0c6a7bced613c35 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:55:01.581722 13422 leader_election.cc:304] T e7e9d2e9b1ca4ddfb0c6a7bced613c35 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba; no voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:55:01.582378 16079 raft_consensus.cc:2747] T e7e9d2e9b1ca4ddfb0c6a7bced613c35 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:55:01.582860 13422 leader_election.cc:304] T 2aea1a69d22544899b0218be7e0f8799 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:55:01.583287 16079 raft_consensus.cc:2802] T 2aea1a69d22544899b0218be7e0f8799 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:55:01.583364 16079 raft_consensus.cc:491] T 2aea1a69d22544899b0218be7e0f8799 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:55:01.583431 16079 raft_consensus.cc:3058] T 2aea1a69d22544899b0218be7e0f8799 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:55:01.586477 16079 raft_consensus.cc:513] T 2aea1a69d22544899b0218be7e0f8799 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:01.587481 16079 leader_election.cc:290] T 2aea1a69d22544899b0218be7e0f8799 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 election: Requested vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:55:01.587564 13624 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "2aea1a69d22544899b0218be7e0f8799" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9"
W20250830 07:55:01.587951 13423 leader_election.cc:343] T 2aea1a69d22544899b0218be7e0f8799 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:55:01.591670 13882 tablet_bootstrap.cc:492] T 6720d2b945814305845beea0a2cb9912 P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:55:01.591948 13882 ts_tablet_manager.cc:1397] T 6720d2b945814305845beea0a2cb9912 P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.043s user 0.002s sys 0.003s
W20250830 07:55:01.592485 13422 leader_election.cc:343] T 8ee98b748d0245bc8bf9eeac727b495e P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:55:01.592638 13422 leader_election.cc:304] T 8ee98b748d0245bc8bf9eeac727b495e P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba; no voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:55:01.592880 16079 raft_consensus.cc:2747] T 8ee98b748d0245bc8bf9eeac727b495e P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:55:01.593395 13882 raft_consensus.cc:357] T 6720d2b945814305845beea0a2cb9912 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:01.593701 13882 raft_consensus.cc:383] T 6720d2b945814305845beea0a2cb9912 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:55:01.593818 13882 raft_consensus.cc:738] T 6720d2b945814305845beea0a2cb9912 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:55:01.594214 13882 consensus_queue.cc:260] T 6720d2b945814305845beea0a2cb9912 P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
W20250830 07:55:01.594600 13422 leader_election.cc:343] T c6355878115a4907ae1f0a45fb2c6492 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:55:01.594786 13422 leader_election.cc:304] T c6355878115a4907ae1f0a45fb2c6492 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba; no voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:55:01.596063 16079 raft_consensus.cc:2747] T c6355878115a4907ae1f0a45fb2c6492 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:55:01.596792 13882 ts_tablet_manager.cc:1428] T 6720d2b945814305845beea0a2cb9912 P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20250830 07:55:01.598295 13882 tablet_bootstrap.cc:492] T d1d5e0d40a91457da65a0e925289309e P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:55:01.598747 16074 raft_consensus.cc:491] T f32ebc2605c34a68aed50379f028052c P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:55:01.598860 16074 raft_consensus.cc:513] T f32ebc2605c34a68aed50379f028052c P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:01.599130 16100 raft_consensus.cc:491] T 6ccbaf109e36453ea6645dfd090f5a1a P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:55:01.599243 16100 raft_consensus.cc:513] T 6ccbaf109e36453ea6645dfd090f5a1a P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:01.599447 16074 leader_election.cc:290] T f32ebc2605c34a68aed50379f028052c P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:55:01.599726 16100 leader_election.cc:290] T 6ccbaf109e36453ea6645dfd090f5a1a P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
I20250830 07:55:01.600675 13488 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f32ebc2605c34a68aed50379f028052c" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:55:01.601384 16100 raft_consensus.cc:491] T 3bca390f6d4343cba7a9fb07f0d4d72b P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:55:01.601521 16100 raft_consensus.cc:513] T 3bca390f6d4343cba7a9fb07f0d4d72b P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:01.601923 13887 tablet_bootstrap.cc:492] T fac764a2d269411c86b85ceeaec0b014 P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:55:01.602032 13887 ts_tablet_manager.cc:1397] T fac764a2d269411c86b85ceeaec0b014 P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.143s user 0.000s sys 0.003s
I20250830 07:55:01.602051 16100 leader_election.cc:290] T 3bca390f6d4343cba7a9fb07f0d4d72b P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
W20250830 07:55:01.603077 13422 leader_election.cc:343] T 690cf258639a4c1ea5a0ac4f2fd39f88 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:55:01.603211 13422 leader_election.cc:304] T 690cf258639a4c1ea5a0ac4f2fd39f88 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba; no voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:55:01.603514 16079 raft_consensus.cc:2747] T 690cf258639a4c1ea5a0ac4f2fd39f88 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:55:01.603777 13624 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "a36f38ada7314165a5e9d6ee7bbf69e3" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:55:01.604822 13624 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "d1d5e0d40a91457da65a0e925289309e" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:55:01.606943 13624 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "d94215b0b1f142178f0b791518d1baf2" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9"
I20250830 07:55:01.607973 13882 tablet_bootstrap.cc:654] T d1d5e0d40a91457da65a0e925289309e P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
I20250830 07:55:01.613963 13624 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "3f70097c1b3a48dfbc1ad129fa7a3730" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:55:01.614625 13887 raft_consensus.cc:357] T fac764a2d269411c86b85ceeaec0b014 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:01.614831 13887 raft_consensus.cc:383] T fac764a2d269411c86b85ceeaec0b014 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:55:01.614950 13887 raft_consensus.cc:738] T fac764a2d269411c86b85ceeaec0b014 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:55:01.615175 13887 consensus_queue.cc:260] T fac764a2d269411c86b85ceeaec0b014 P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:01.615556 13886 tablet_bootstrap.cc:492] T ccc9091018cb48ffb2affd98e8bbfa05 P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:55:01.615691 13886 ts_tablet_manager.cc:1397] T ccc9091018cb48ffb2affd98e8bbfa05 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.130s user 0.003s sys 0.019s
I20250830 07:55:01.616427 13886 raft_consensus.cc:357] T ccc9091018cb48ffb2affd98e8bbfa05 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:01.616575 13886 raft_consensus.cc:383] T ccc9091018cb48ffb2affd98e8bbfa05 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:55:01.616633 13886 raft_consensus.cc:738] T ccc9091018cb48ffb2affd98e8bbfa05 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
W20250830 07:55:01.617111 13422 leader_election.cc:343] T 838616d8274648fc9ea4f1583bdb97f9 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:55:01.617224 13422 leader_election.cc:304] T 838616d8274648fc9ea4f1583bdb97f9 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba; no voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:55:01.617431 16079 raft_consensus.cc:2747] T 838616d8274648fc9ea4f1583bdb97f9 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:55:01.618386 13488 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "a36f38ada7314165a5e9d6ee7bbf69e3" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba"
I20250830 07:55:01.619771 16100 raft_consensus.cc:491] T b2248b305c9f448a9e30661142ad10ea P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:55:01.619925 16100 raft_consensus.cc:513] T b2248b305c9f448a9e30661142ad10ea P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
W20250830 07:55:01.620321 13561 consensus_peers.cc:489] T e4ca3110247640fbae4241448e8d5ef7 P 6b5e454d98894637b466ea27f1b647f9 -> Peer 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): Couldn't send request to peer 2065c332f15a4739899af79f3669c3ba. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e4ca3110247640fbae4241448e8d5ef7. This is attempt 6: this message will repeat every 5th retry.
I20250830 07:55:01.620479 16100 leader_election.cc:290] T b2248b305c9f448a9e30661142ad10ea P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
I20250830 07:55:01.620657 13488 raft_consensus.cc:3058] T a36f38ada7314165a5e9d6ee7bbf69e3 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:55:01.621291 13887 ts_tablet_manager.cc:1428] T fac764a2d269411c86b85ceeaec0b014 P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.019s user 0.002s sys 0.000s
I20250830 07:55:01.625603 13488 raft_consensus.cc:2466] T a36f38ada7314165a5e9d6ee7bbf69e3 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 1.
I20250830 07:55:01.626893 13477 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "d1d5e0d40a91457da65a0e925289309e" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba"
I20250830 07:55:01.627055 13477 raft_consensus.cc:3058] T d1d5e0d40a91457da65a0e925289309e P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:55:01.629449 13477 raft_consensus.cc:2466] T d1d5e0d40a91457da65a0e925289309e P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 1.
I20250830 07:55:01.629865 13887 tablet_bootstrap.cc:492] T 9bc54e40f9eb4271aa3132986c249e51 P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:55:01.631220 13771 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "3d9c884ac05e44ddb59f96588fdd6f4b" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:55:01.631853 13772 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "14d4d2506e2a47ea906bfb81d5509829" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:55:01.633504 13772 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "2c31d119743f49589703c434ac6c7548" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:55:01.633517 13887 tablet_bootstrap.cc:654] T 9bc54e40f9eb4271aa3132986c249e51 P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:55:01.635003 16100 raft_consensus.cc:491] T ad7a45187569416bad6c71db9f8ab702 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:55:01.635167 16100 raft_consensus.cc:513] T ad7a45187569416bad6c71db9f8ab702 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:01.635788 16100 leader_election.cc:290] T ad7a45187569416bad6c71db9f8ab702 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
I20250830 07:55:01.641758 13886 consensus_queue.cc:260] T ccc9091018cb48ffb2affd98e8bbfa05 P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:01.643486 13624 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "a36f38ada7314165a5e9d6ee7bbf69e3" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9"
I20250830 07:55:01.642485 13772 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "846338e46b834ae0b5f4e74c7f1325d2" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:55:01.644263 13624 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "d1d5e0d40a91457da65a0e925289309e" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9"
I20250830 07:55:01.645510 13886 ts_tablet_manager.cc:1428] T ccc9091018cb48ffb2affd98e8bbfa05 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.030s user 0.001s sys 0.001s
I20250830 07:55:01.647327 13764 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f32ebc2605c34a68aed50379f028052c" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:55:01.647864 13882 tablet_bootstrap.cc:492] T d1d5e0d40a91457da65a0e925289309e P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:55:01.648018 13882 ts_tablet_manager.cc:1397] T d1d5e0d40a91457da65a0e925289309e P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.050s user 0.004s sys 0.007s
I20250830 07:55:01.648022 13624 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "3f70097c1b3a48dfbc1ad129fa7a3730" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9"
I20250830 07:55:01.649336 13886 tablet_bootstrap.cc:492] T 0f34ed0fe6e9400fae5c0edebb615ebd P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:55:01.649236 13882 raft_consensus.cc:357] T d1d5e0d40a91457da65a0e925289309e P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:01.649461 13882 raft_consensus.cc:383] T d1d5e0d40a91457da65a0e925289309e P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:55:01.649569 13882 raft_consensus.cc:738] T d1d5e0d40a91457da65a0e925289309e P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:55:01.649888 13882 consensus_queue.cc:260] T d1d5e0d40a91457da65a0e925289309e P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:01.650673 13882 ts_tablet_manager.cc:1428] T d1d5e0d40a91457da65a0e925289309e P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20250830 07:55:01.650714 13886 tablet_bootstrap.cc:654] T 0f34ed0fe6e9400fae5c0edebb615ebd P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:55:01.651657 13882 tablet_bootstrap.cc:492] T 2aea1a69d22544899b0218be7e0f8799 P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:55:01.659240 13624 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "6ccbaf109e36453ea6645dfd090f5a1a" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:55:01.659432 13624 raft_consensus.cc:2466] T 6ccbaf109e36453ea6645dfd090f5a1a P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 1.
I20250830 07:55:01.659699 13882 tablet_bootstrap.cc:654] T 2aea1a69d22544899b0218be7e0f8799 P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
I20250830 07:55:01.660166 13624 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "3bca390f6d4343cba7a9fb07f0d4d72b" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:55:01.660934 13624 raft_consensus.cc:3058] T 5fee48de90014f94b796e726a4d16b85 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:55:01.662218 13476 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "3f70097c1b3a48dfbc1ad129fa7a3730" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba"
I20250830 07:55:01.662359 13476 raft_consensus.cc:3058] T 3f70097c1b3a48dfbc1ad129fa7a3730 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:55:01.663748 13887 tablet_bootstrap.cc:492] T 9bc54e40f9eb4271aa3132986c249e51 P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:55:01.663972 13887 ts_tablet_manager.cc:1397] T 9bc54e40f9eb4271aa3132986c249e51 P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.034s user 0.004s sys 0.001s
I20250830 07:55:01.665011 13476 raft_consensus.cc:2466] T 3f70097c1b3a48dfbc1ad129fa7a3730 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 1.
I20250830 07:55:01.665540 13611 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "b2248b305c9f448a9e30661142ad10ea" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:55:01.667107 13611 raft_consensus.cc:3058] T 3d9c884ac05e44ddb59f96588fdd6f4b P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:55:01.670696 13562 leader_election.cc:304] T 3d9c884ac05e44ddb59f96588fdd6f4b P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b5e454d98894637b466ea27f1b647f9; no voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:55:01.671697 13476 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "6ccbaf109e36453ea6645dfd090f5a1a" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:55:01.671842 13476 raft_consensus.cc:2466] T 6ccbaf109e36453ea6645dfd090f5a1a P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 1.
I20250830 07:55:01.672170 13619 raft_consensus.cc:3058] T 2f3bec2c98574a9393e0fae77e228ce0 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:55:01.672420 13476 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "3bca390f6d4343cba7a9fb07f0d4d72b" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:55:01.672575 13476 raft_consensus.cc:2466] T 3bca390f6d4343cba7a9fb07f0d4d72b P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 0.
I20250830 07:55:01.676957 13562 leader_election.cc:304] T 14d4d2506e2a47ea906bfb81d5509829 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b5e454d98894637b466ea27f1b647f9; no voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:55:01.677166 16074 raft_consensus.cc:2747] T 14d4d2506e2a47ea906bfb81d5509829 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:55:01.677166 13615 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "ad7a45187569416bad6c71db9f8ab702" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:55:01.677976 13562 leader_election.cc:304] T 2c31d119743f49589703c434ac6c7548 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b5e454d98894637b466ea27f1b647f9; no voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:55:01.678752 15582 raft_consensus.cc:2747] T 3d9c884ac05e44ddb59f96588fdd6f4b P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:55:01.678831 16074 raft_consensus.cc:2747] T 2c31d119743f49589703c434ac6c7548 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:55:01.666783 13887 raft_consensus.cc:357] T 9bc54e40f9eb4271aa3132986c249e51 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:01.679662 13887 raft_consensus.cc:383] T 9bc54e40f9eb4271aa3132986c249e51 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:55:01.679860 13887 raft_consensus.cc:738] T 9bc54e40f9eb4271aa3132986c249e51 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:55:01.680212 13887 consensus_queue.cc:260] T 9bc54e40f9eb4271aa3132986c249e51 P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:01.681841 13887 ts_tablet_manager.cc:1428] T 9bc54e40f9eb4271aa3132986c249e51 P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.018s user 0.002s sys 0.000s
I20250830 07:55:01.683369 13887 tablet_bootstrap.cc:492] T b85843ab0e3a40e1b453cfdd71bbae5e P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
W20250830 07:55:01.684226 13703 consensus_peers.cc:489] T 1fee3e58f31b4befa42ffbb8d7bd6f4e P 9b057ade5dce45af9f8bf0bedf8b917f -> Peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Couldn't send request to peer 6b5e454d98894637b466ea27f1b647f9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20250830 07:55:01.688066 16100 consensus_queue.cc:1035] T fbb1cc8f8eea4a0795f6f8e213b8180f P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20250830 07:55:01.690706 13703 leader_election.cc:343] T a36f38ada7314165a5e9d6ee7bbf69e3 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
W20250830 07:55:01.692423 13703 leader_election.cc:343] T d1d5e0d40a91457da65a0e925289309e P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
W20250830 07:55:01.693627 13703 consensus_peers.cc:489] T 0c70140d87d34bde919714f08a5c94d4 P 9b057ade5dce45af9f8bf0bedf8b917f -> Peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Couldn't send request to peer 6b5e454d98894637b466ea27f1b647f9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20250830 07:55:01.693857 13703 leader_election.cc:343] T d94215b0b1f142178f0b791518d1baf2 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:55:01.694084 13476 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "b2248b305c9f448a9e30661142ad10ea" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:55:01.694242 13476 raft_consensus.cc:2466] T b2248b305c9f448a9e30661142ad10ea P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 0.
I20250830 07:55:01.694633 13887 tablet_bootstrap.cc:654] T b85843ab0e3a40e1b453cfdd71bbae5e P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
W20250830 07:55:01.697155 13703 leader_election.cc:343] T 3f70097c1b3a48dfbc1ad129fa7a3730 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:55:01.698077 13886 tablet_bootstrap.cc:492] T 0f34ed0fe6e9400fae5c0edebb615ebd P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:55:01.698309 13886 ts_tablet_manager.cc:1397] T 0f34ed0fe6e9400fae5c0edebb615ebd P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.049s user 0.003s sys 0.000s
I20250830 07:55:01.698721 13882 tablet_bootstrap.cc:492] T 2aea1a69d22544899b0218be7e0f8799 P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:55:01.698781 15992 raft_consensus.cc:491] T a0cf1de8485941eb8a557a6e2f783047 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:55:01.698936 13882 ts_tablet_manager.cc:1397] T 2aea1a69d22544899b0218be7e0f8799 P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.048s user 0.005s sys 0.004s
I20250830 07:55:01.698899 15992 raft_consensus.cc:513] T a0cf1de8485941eb8a557a6e2f783047 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:01.699437 15992 leader_election.cc:290] T a0cf1de8485941eb8a557a6e2f783047 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:55:01.699438 13886 raft_consensus.cc:357] T 0f34ed0fe6e9400fae5c0edebb615ebd P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:01.699601 13886 raft_consensus.cc:383] T 0f34ed0fe6e9400fae5c0edebb615ebd P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:55:01.699657 13886 raft_consensus.cc:738] T 0f34ed0fe6e9400fae5c0edebb615ebd P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:55:01.700042 13886 consensus_queue.cc:260] T 0f34ed0fe6e9400fae5c0edebb615ebd P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:01.700014 13882 raft_consensus.cc:357] T 2aea1a69d22544899b0218be7e0f8799 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:01.700305 13882 raft_consensus.cc:383] T 2aea1a69d22544899b0218be7e0f8799 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:55:01.700400 13882 raft_consensus.cc:738] T 2aea1a69d22544899b0218be7e0f8799 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:55:01.700697 13882 consensus_queue.cc:260] T 2aea1a69d22544899b0218be7e0f8799 P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:01.701220 13882 ts_tablet_manager.cc:1428] T 2aea1a69d22544899b0218be7e0f8799 P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20250830 07:55:01.701457 13882 tablet_bootstrap.cc:492] T 2e63eac2579844ef83bf43f1e6d58634 P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:55:01.701622 13886 ts_tablet_manager.cc:1428] T 0f34ed0fe6e9400fae5c0edebb615ebd P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20250830 07:55:01.702790 13886 tablet_bootstrap.cc:492] T f192693039a24e3cb0bec646c8d11056 P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:55:01.704119 13886 tablet_bootstrap.cc:654] T f192693039a24e3cb0bec646c8d11056 P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
W20250830 07:55:01.710269 13703 leader_election.cc:343] T a36f38ada7314165a5e9d6ee7bbf69e3 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
W20250830 07:55:01.710595 13703 leader_election.cc:343] T d1d5e0d40a91457da65a0e925289309e P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:55:01.711470 13476 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "a0cf1de8485941eb8a557a6e2f783047" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:55:01.714643 13476 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "ad7a45187569416bad6c71db9f8ab702" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:55:01.714954 13476 raft_consensus.cc:2466] T ad7a45187569416bad6c71db9f8ab702 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 0.
I20250830 07:55:01.717998 16079 raft_consensus.cc:491] T a5eea1950d1945f1b755fd34597b2fb4 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:55:01.718106 16079 raft_consensus.cc:513] T a5eea1950d1945f1b755fd34597b2fb4 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:01.718583 16079 leader_election.cc:290] T a5eea1950d1945f1b755fd34597b2fb4 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:55:01.719960 13624 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "a5eea1950d1945f1b755fd34597b2fb4" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
W20250830 07:55:01.720366 13423 leader_election.cc:343] T a5eea1950d1945f1b755fd34597b2fb4 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
W20250830 07:55:01.720676 13703 leader_election.cc:343] T 3f70097c1b3a48dfbc1ad129fa7a3730 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:55:01.721010 13477 raft_consensus.cc:1273] T 1db4109dc43b489d89c5de9eeb64a771 P 2065c332f15a4739899af79f3669c3ba [term 2 FOLLOWER]: Refusing update from remote peer 9b057ade5dce45af9f8bf0bedf8b917f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20250830 07:55:01.723134 13882 tablet_bootstrap.cc:654] T 2e63eac2579844ef83bf43f1e6d58634 P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
I20250830 07:55:01.727262 13703 leader_election.cc:304] T 6ccbaf109e36453ea6645dfd090f5a1a P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f; no voters:
I20250830 07:55:01.727468 16224 raft_consensus.cc:2802] T 6ccbaf109e36453ea6645dfd090f5a1a P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20250830 07:55:01.727535 16224 raft_consensus.cc:491] T 6ccbaf109e36453ea6645dfd090f5a1a P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:55:01.727598 16224 raft_consensus.cc:3058] T 6ccbaf109e36453ea6645dfd090f5a1a P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Advancing to term 2
I20250830 07:55:01.730115 16224 raft_consensus.cc:513] T 6ccbaf109e36453ea6645dfd090f5a1a P 9b057ade5dce45af9f8bf0bedf8b917f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:01.730677 16224 leader_election.cc:290] T 6ccbaf109e36453ea6645dfd090f5a1a P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 2 election: Requested vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
W20250830 07:55:01.730890 13703 leader_election.cc:343] T 3bca390f6d4343cba7a9fb07f0d4d72b P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
W20250830 07:55:01.731564 13703 leader_election.cc:343] T b2248b305c9f448a9e30661142ad10ea P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:55:01.731709 13882 tablet_bootstrap.cc:492] T 2e63eac2579844ef83bf43f1e6d58634 P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
W20250830 07:55:01.731745 13703 consensus_peers.cc:489] T 51cee993ce4249c0830b29cb1808fe80 P 9b057ade5dce45af9f8bf0bedf8b917f -> Peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Couldn't send request to peer 6b5e454d98894637b466ea27f1b647f9. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 51cee993ce4249c0830b29cb1808fe80. This is attempt 6: this message will repeat every 5th retry.
I20250830 07:55:01.731843 13882 ts_tablet_manager.cc:1397] T 2e63eac2579844ef83bf43f1e6d58634 P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.030s user 0.000s sys 0.003s
I20250830 07:55:01.732481 13882 raft_consensus.cc:357] T 2e63eac2579844ef83bf43f1e6d58634 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:01.732627 13882 raft_consensus.cc:383] T 2e63eac2579844ef83bf43f1e6d58634 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:55:01.732672 13882 raft_consensus.cc:738] T 2e63eac2579844ef83bf43f1e6d58634 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:55:01.732860 13882 consensus_queue.cc:260] T 2e63eac2579844ef83bf43f1e6d58634 P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:01.733294 13882 ts_tablet_manager.cc:1428] T 2e63eac2579844ef83bf43f1e6d58634 P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.001s user 0.001s sys 0.001s
I20250830 07:55:01.733529 13882 tablet_bootstrap.cc:492] T 0c70140d87d34bde919714f08a5c94d4 P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:55:01.735250 13882 tablet_bootstrap.cc:654] T 0c70140d87d34bde919714f08a5c94d4 P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
I20250830 07:55:01.736531 13886 tablet_bootstrap.cc:492] T f192693039a24e3cb0bec646c8d11056 P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:55:01.736651 13886 ts_tablet_manager.cc:1397] T f192693039a24e3cb0bec646c8d11056 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.034s user 0.002s sys 0.000s
W20250830 07:55:01.737251 13703 leader_election.cc:343] T ad7a45187569416bad6c71db9f8ab702 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:55:01.738603 13562 leader_election.cc:304] T 846338e46b834ae0b5f4e74c7f1325d2 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b5e454d98894637b466ea27f1b647f9; no voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:55:01.738958 15992 raft_consensus.cc:2747] T 846338e46b834ae0b5f4e74c7f1325d2 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:55:01.739962 13562 leader_election.cc:304] T f32ebc2605c34a68aed50379f028052c P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b5e454d98894637b466ea27f1b647f9; no voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:55:01.740499 15992 raft_consensus.cc:2747] T f32ebc2605c34a68aed50379f028052c P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:55:01.737311 13886 raft_consensus.cc:357] T f192693039a24e3cb0bec646c8d11056 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:01.741710 13886 raft_consensus.cc:383] T f192693039a24e3cb0bec646c8d11056 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:55:01.741775 13886 raft_consensus.cc:738] T f192693039a24e3cb0bec646c8d11056 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:55:01.741942 13886 consensus_queue.cc:260] T f192693039a24e3cb0bec646c8d11056 P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:01.742391 13886 ts_tablet_manager.cc:1428] T f192693039a24e3cb0bec646c8d11056 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.006s user 0.001s sys 0.000s
I20250830 07:55:01.742614 13886 tablet_bootstrap.cc:492] T 8ee98b748d0245bc8bf9eeac727b495e P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:55:01.743831 13477 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "6ccbaf109e36453ea6645dfd090f5a1a" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba"
I20250830 07:55:01.744071 13886 tablet_bootstrap.cc:654] T 8ee98b748d0245bc8bf9eeac727b495e P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:55:01.744297 13477 raft_consensus.cc:3058] T 6ccbaf109e36453ea6645dfd090f5a1a P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Advancing to term 2
I20250830 07:55:01.745246 13771 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "2aea1a69d22544899b0218be7e0f8799" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f"
I20250830 07:55:01.745286 13701 leader_election.cc:304] T a36f38ada7314165a5e9d6ee7bbf69e3 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:55:01.745425 13882 tablet_bootstrap.cc:492] T 0c70140d87d34bde919714f08a5c94d4 P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:55:01.745419 13771 raft_consensus.cc:3058] T 2aea1a69d22544899b0218be7e0f8799 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:55:01.745515 13882 ts_tablet_manager.cc:1397] T 0c70140d87d34bde919714f08a5c94d4 P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.012s user 0.002s sys 0.002s
I20250830 07:55:01.745532 16224 consensus_queue.cc:1035] T 1fee3e58f31b4befa42ffbb8d7bd6f4e P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:55:01.745921 16224 raft_consensus.cc:2802] T a36f38ada7314165a5e9d6ee7bbf69e3 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election won for term 1
I20250830 07:55:01.746068 16224 raft_consensus.cc:695] T a36f38ada7314165a5e9d6ee7bbf69e3 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 LEADER]: Becoming Leader. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Running, Role: LEADER
I20250830 07:55:01.746097 13882 raft_consensus.cc:357] T 0c70140d87d34bde919714f08a5c94d4 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:01.746248 13882 raft_consensus.cc:383] T 0c70140d87d34bde919714f08a5c94d4 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:55:01.746300 13882 raft_consensus.cc:738] T 0c70140d87d34bde919714f08a5c94d4 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:55:01.746528 15748 consensus_queue.cc:1035] T 135d754d83ad422eb05909d2daa19d34 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:55:01.746488 13882 consensus_queue.cc:260] T 0c70140d87d34bde919714f08a5c94d4 P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:01.746923 13882 ts_tablet_manager.cc:1428] T 0c70140d87d34bde919714f08a5c94d4 P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.001s user 0.001s sys 0.001s
I20250830 07:55:01.746413 16224 consensus_queue.cc:237] T a36f38ada7314165a5e9d6ee7bbf69e3 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:01.747160 13882 tablet_bootstrap.cc:492] T 1fee3e58f31b4befa42ffbb8d7bd6f4e P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:55:01.747695 13771 raft_consensus.cc:2466] T 2aea1a69d22544899b0218be7e0f8799 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2065c332f15a4739899af79f3669c3ba in term 1.
I20250830 07:55:01.748838 13882 tablet_bootstrap.cc:654] T 1fee3e58f31b4befa42ffbb8d7bd6f4e P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
I20250830 07:55:01.750039 13701 leader_election.cc:304] T d1d5e0d40a91457da65a0e925289309e P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:55:01.750409 15863 raft_consensus.cc:2802] T d1d5e0d40a91457da65a0e925289309e P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election won for term 1
I20250830 07:55:01.750598 15863 raft_consensus.cc:695] T d1d5e0d40a91457da65a0e925289309e P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 LEADER]: Becoming Leader. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Running, Role: LEADER
I20250830 07:55:01.750850 15863 consensus_queue.cc:237] T d1d5e0d40a91457da65a0e925289309e P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:01.754987 15992 raft_consensus.cc:491] T bdeb89bbb3ad4e67bbc74b78454eeb7e P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:55:01.755139 15992 raft_consensus.cc:513] T bdeb89bbb3ad4e67bbc74b78454eeb7e P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:01.755764 15992 leader_election.cc:290] T bdeb89bbb3ad4e67bbc74b78454eeb7e P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:55:01.759089 13488 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "bdeb89bbb3ad4e67bbc74b78454eeb7e" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:55:01.759560 13701 leader_election.cc:304] T 3f70097c1b3a48dfbc1ad129fa7a3730 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:55:01.759863 16100 raft_consensus.cc:2802] T 3f70097c1b3a48dfbc1ad129fa7a3730 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election won for term 1
I20250830 07:55:01.759969 16100 raft_consensus.cc:695] T 3f70097c1b3a48dfbc1ad129fa7a3730 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 LEADER]: Becoming Leader. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Running, Role: LEADER
I20250830 07:55:01.760149 16100 consensus_queue.cc:237] T 3f70097c1b3a48dfbc1ad129fa7a3730 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:01.763010 15365 raft_consensus.cc:491] T 0f34ed0fe6e9400fae5c0edebb615ebd P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:55:01.763170 15365 raft_consensus.cc:513] T 0f34ed0fe6e9400fae5c0edebb615ebd P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:01.763671 15365 leader_election.cc:290] T 0f34ed0fe6e9400fae5c0edebb615ebd P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
I20250830 07:55:01.769448 13887 tablet_bootstrap.cc:492] T b85843ab0e3a40e1b453cfdd71bbae5e P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:55:01.769711 13887 ts_tablet_manager.cc:1397] T b85843ab0e3a40e1b453cfdd71bbae5e P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.087s user 0.008s sys 0.003s
I20250830 07:55:01.770094 13624 raft_consensus.cc:3058] T a0cf1de8485941eb8a557a6e2f783047 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:55:01.774129 13887 raft_consensus.cc:357] T b85843ab0e3a40e1b453cfdd71bbae5e P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:01.775101 13887 raft_consensus.cc:383] T b85843ab0e3a40e1b453cfdd71bbae5e P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:55:01.775601 13887 raft_consensus.cc:738] T b85843ab0e3a40e1b453cfdd71bbae5e P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:55:01.776809 13887 consensus_queue.cc:260] T b85843ab0e3a40e1b453cfdd71bbae5e P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:01.778491 13701 leader_election.cc:304] T 3bca390f6d4343cba7a9fb07f0d4d72b P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:55:01.778796 16101 raft_consensus.cc:2802] T 3bca390f6d4343cba7a9fb07f0d4d72b P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:55:01.778884 16101 raft_consensus.cc:491] T 3bca390f6d4343cba7a9fb07f0d4d72b P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:55:01.778983 16101 raft_consensus.cc:3058] T 3bca390f6d4343cba7a9fb07f0d4d72b P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:55:01.781965 16101 raft_consensus.cc:513] T 3bca390f6d4343cba7a9fb07f0d4d72b P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:01.781970 13887 ts_tablet_manager.cc:1428] T b85843ab0e3a40e1b453cfdd71bbae5e P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.012s user 0.002s sys 0.000s
I20250830 07:55:01.782824 16101 leader_election.cc:290] T 3bca390f6d4343cba7a9fb07f0d4d72b P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Requested vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
I20250830 07:55:01.783522 13882 tablet_bootstrap.cc:492] T 1fee3e58f31b4befa42ffbb8d7bd6f4e P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:55:01.783703 13882 ts_tablet_manager.cc:1397] T 1fee3e58f31b4befa42ffbb8d7bd6f4e P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.037s user 0.006s sys 0.003s
I20250830 07:55:01.784134 13611 raft_consensus.cc:3058] T 240a6bfad8fa478598a67a27c2dedf62 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:55:01.784515 13610 raft_consensus.cc:1273] T a8660a6ff9254d4f9f0ef047b8682ed1 P 6b5e454d98894637b466ea27f1b647f9 [term 2 FOLLOWER]: Refusing update from remote peer 9b057ade5dce45af9f8bf0bedf8b917f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20250830 07:55:01.785095 13629 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "6ccbaf109e36453ea6645dfd090f5a1a" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9"
I20250830 07:55:01.785233 13629 raft_consensus.cc:3058] T 6ccbaf109e36453ea6645dfd090f5a1a P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Advancing to term 2
I20250830 07:55:01.786556 13764 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "a0cf1de8485941eb8a557a6e2f783047" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:55:01.786783 13619 raft_consensus.cc:3058] T 6720d2b945814305845beea0a2cb9912 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:55:01.787155 13772 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "bdeb89bbb3ad4e67bbc74b78454eeb7e" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:55:01.787562 13629 raft_consensus.cc:2466] T 6ccbaf109e36453ea6645dfd090f5a1a P 6b5e454d98894637b466ea27f1b647f9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 2.
I20250830 07:55:01.787890 13882 raft_consensus.cc:357] T 1fee3e58f31b4befa42ffbb8d7bd6f4e P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:01.788092 13882 raft_consensus.cc:383] T 1fee3e58f31b4befa42ffbb8d7bd6f4e P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:55:01.788190 13882 raft_consensus.cc:738] T 1fee3e58f31b4befa42ffbb8d7bd6f4e P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:55:01.788386 13882 consensus_queue.cc:260] T 1fee3e58f31b4befa42ffbb8d7bd6f4e P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:01.788806 13882 ts_tablet_manager.cc:1428] T 1fee3e58f31b4befa42ffbb8d7bd6f4e P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20250830 07:55:01.789184 13882 tablet_bootstrap.cc:492] T 439fc51afa6b435e81bc38b9e88d4041 P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:55:01.790005 15720 consensus_queue.cc:1035] T a8660a6ff9254d4f9f0ef047b8682ed1 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:55:01.791072 13882 tablet_bootstrap.cc:654] T 439fc51afa6b435e81bc38b9e88d4041 P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
I20250830 07:55:01.793658 13562 leader_election.cc:304] T a0cf1de8485941eb8a557a6e2f783047 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b5e454d98894637b466ea27f1b647f9; no voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:55:01.797268 13887 tablet_bootstrap.cc:492] T 7dc061ebaa334c109d1e457e2dc860df P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:55:01.797853 13882 tablet_bootstrap.cc:492] T 439fc51afa6b435e81bc38b9e88d4041 P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:55:01.797958 13882 ts_tablet_manager.cc:1397] T 439fc51afa6b435e81bc38b9e88d4041 P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.009s user 0.001s sys 0.002s
I20250830 07:55:01.798563 13882 raft_consensus.cc:357] T 439fc51afa6b435e81bc38b9e88d4041 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:01.798702 13882 raft_consensus.cc:383] T 439fc51afa6b435e81bc38b9e88d4041 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:55:01.798753 13882 raft_consensus.cc:738] T 439fc51afa6b435e81bc38b9e88d4041 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:55:01.798470 13477 raft_consensus.cc:2466] T 6ccbaf109e36453ea6645dfd090f5a1a P 2065c332f15a4739899af79f3669c3ba [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 2.
I20250830 07:55:01.798902 13882 consensus_queue.cc:260] T 439fc51afa6b435e81bc38b9e88d4041 P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:01.799366 13882 ts_tablet_manager.cc:1428] T 439fc51afa6b435e81bc38b9e88d4041 P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20250830 07:55:01.799602 13882 tablet_bootstrap.cc:492] T 52df62f7f1aa4b38be89f6198cf01f24 P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:55:01.801093 13882 tablet_bootstrap.cc:654] T 52df62f7f1aa4b38be89f6198cf01f24 P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
I20250830 07:55:01.806170 16079 raft_consensus.cc:491] T bac72b4ba9ba4ca69f93e799dccb0e93 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:55:01.806273 16079 raft_consensus.cc:513] T bac72b4ba9ba4ca69f93e799dccb0e93 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:01.806718 16079 leader_election.cc:290] T bac72b4ba9ba4ca69f93e799dccb0e93 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:55:01.809294 13886 tablet_bootstrap.cc:492] T 8ee98b748d0245bc8bf9eeac727b495e P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:55:01.809417 13886 ts_tablet_manager.cc:1397] T 8ee98b748d0245bc8bf9eeac727b495e P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.067s user 0.005s sys 0.000s
I20250830 07:55:01.810096 13886 raft_consensus.cc:357] T 8ee98b748d0245bc8bf9eeac727b495e P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:01.810235 13886 raft_consensus.cc:383] T 8ee98b748d0245bc8bf9eeac727b495e P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:55:01.810283 13886 raft_consensus.cc:738] T 8ee98b748d0245bc8bf9eeac727b495e P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:55:01.810356 13701 leader_election.cc:304] T b2248b305c9f448a9e30661142ad10ea P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:55:01.810432 13886 consensus_queue.cc:260] T 8ee98b748d0245bc8bf9eeac727b495e P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:01.810884 13886 ts_tablet_manager.cc:1428] T 8ee98b748d0245bc8bf9eeac727b495e P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20250830 07:55:01.811137 13886 tablet_bootstrap.cc:492] T 76dd9dd481fc427fb20f5091e4a3b738 P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:55:01.811368 13701 leader_election.cc:304] T ad7a45187569416bad6c71db9f8ab702 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:55:01.812553 15751 raft_consensus.cc:2802] T ad7a45187569416bad6c71db9f8ab702 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:55:01.812614 15751 raft_consensus.cc:491] T ad7a45187569416bad6c71db9f8ab702 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:55:01.812666 15751 raft_consensus.cc:3058] T ad7a45187569416bad6c71db9f8ab702 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:55:01.812677 15863 consensus_queue.cc:1035] T ba4e1fccb8f046d6b63afe67c1f9d538 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:55:01.813868 13422 leader_election.cc:304] T 2aea1a69d22544899b0218be7e0f8799 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:55:01.814690 13887 tablet_bootstrap.cc:654] T 7dc061ebaa334c109d1e457e2dc860df P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:55:01.815145 15751 raft_consensus.cc:513] T ad7a45187569416bad6c71db9f8ab702 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:01.815578 15751 leader_election.cc:290] T ad7a45187569416bad6c71db9f8ab702 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Requested vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
I20250830 07:55:01.811137 15603 raft_consensus.cc:2802] T b2248b305c9f448a9e30661142ad10ea P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:55:01.815833 15603 raft_consensus.cc:491] T b2248b305c9f448a9e30661142ad10ea P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:55:01.815879 15603 raft_consensus.cc:3058] T b2248b305c9f448a9e30661142ad10ea P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:55:01.817688 15919 raft_consensus.cc:2802] T 2aea1a69d22544899b0218be7e0f8799 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election won for term 1
I20250830 07:55:01.817803 15919 raft_consensus.cc:695] T 2aea1a69d22544899b0218be7e0f8799 P 2065c332f15a4739899af79f3669c3ba [term 1 LEADER]: Becoming Leader. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Running, Role: LEADER
I20250830 07:55:01.817942 15603 raft_consensus.cc:513] T b2248b305c9f448a9e30661142ad10ea P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:01.818024 15919 consensus_queue.cc:237] T 2aea1a69d22544899b0218be7e0f8799 P 2065c332f15a4739899af79f3669c3ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:01.818580 15603 leader_election.cc:290] T b2248b305c9f448a9e30661142ad10ea P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Requested vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
I20250830 07:55:01.837333 13886 tablet_bootstrap.cc:654] T 76dd9dd481fc427fb20f5091e4a3b738 P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:55:01.840749 15582 raft_consensus.cc:2747] T a0cf1de8485941eb8a557a6e2f783047 P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:55:01.844837 13476 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "0f34ed0fe6e9400fae5c0edebb615ebd" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:55:01.845000 13476 raft_consensus.cc:2466] T 0f34ed0fe6e9400fae5c0edebb615ebd P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 0.
I20250830 07:55:01.847075 15863 consensus_queue.cc:1035] T 1db4109dc43b489d89c5de9eeb64a771 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20250830 07:55:01.850210 13703 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.209.2:38967, user_credentials={real_user=slave}} blocked reactor thread for 61503.8us
I20250830 07:55:01.850562 13703 leader_election.cc:304] T 6ccbaf109e36453ea6645dfd090f5a1a P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f; no voters:
I20250830 07:55:01.851032 16101 raft_consensus.cc:2802] T 6ccbaf109e36453ea6645dfd090f5a1a P 9b057ade5dce45af9f8bf0bedf8b917f [term 2 FOLLOWER]: Leader election won for term 2
I20250830 07:55:01.851047 15608 consensus_queue.cc:1035] T 6720d2b945814305845beea0a2cb9912 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20250830 07:55:01.849804 13562 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.209.3:38743, user_credentials={real_user=slave}} blocked reactor thread for 56164.2us
I20250830 07:55:01.851886 16101 raft_consensus.cc:695] T 6ccbaf109e36453ea6645dfd090f5a1a P 9b057ade5dce45af9f8bf0bedf8b917f [term 2 LEADER]: Becoming Leader. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Running, Role: LEADER
I20250830 07:55:01.852108 16101 consensus_queue.cc:237] T 6ccbaf109e36453ea6645dfd090f5a1a P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:01.851892 13562 leader_election.cc:304] T bdeb89bbb3ad4e67bbc74b78454eeb7e P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b5e454d98894637b466ea27f1b647f9; no voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:55:01.854050 15582 raft_consensus.cc:2747] T bdeb89bbb3ad4e67bbc74b78454eeb7e P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:55:01.856451 13624 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "0f34ed0fe6e9400fae5c0edebb615ebd" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:55:01.859165 15863 raft_consensus.cc:491] T f479eef0171c401bbd27beec4486a8b2 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:55:01.859398 15863 raft_consensus.cc:513] T f479eef0171c401bbd27beec4486a8b2 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:01.859987 15863 leader_election.cc:290] T f479eef0171c401bbd27beec4486a8b2 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
I20250830 07:55:01.860359 13624 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "3bca390f6d4343cba7a9fb07f0d4d72b" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9"
I20250830 07:55:01.861351 13886 tablet_bootstrap.cc:492] T 76dd9dd481fc427fb20f5091e4a3b738 P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:55:01.863969 16081 raft_consensus.cc:491] T 76dd9dd481fc427fb20f5091e4a3b738 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:55:01.864137 16081 raft_consensus.cc:513] T 76dd9dd481fc427fb20f5091e4a3b738 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:01.864727 16081 leader_election.cc:290] T 76dd9dd481fc427fb20f5091e4a3b738 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:55:01.865470 13701 leader_election.cc:304] T 0f34ed0fe6e9400fae5c0edebb615ebd P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters:
I20250830 07:55:01.865723 15608 raft_consensus.cc:2802] T 0f34ed0fe6e9400fae5c0edebb615ebd P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:55:01.865808 15608 raft_consensus.cc:491] T 0f34ed0fe6e9400fae5c0edebb615ebd P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:55:01.865864 15608 raft_consensus.cc:3058] T 0f34ed0fe6e9400fae5c0edebb615ebd P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:55:01.868628 15608 raft_consensus.cc:513] T 0f34ed0fe6e9400fae5c0edebb615ebd P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:01.868594 13624 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "ad7a45187569416bad6c71db9f8ab702" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9"
I20250830 07:55:01.869022 13615 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "b2248b305c9f448a9e30661142ad10ea" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9"
I20250830 07:55:01.869174 15608 leader_election.cc:290] T 0f34ed0fe6e9400fae5c0edebb615ebd P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Requested vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
I20250830 07:55:01.871974 13886 ts_tablet_manager.cc:1397] T 76dd9dd481fc427fb20f5091e4a3b738 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.061s user 0.004s sys 0.000s
I20250830 07:55:01.873988 13882 tablet_bootstrap.cc:492] T 52df62f7f1aa4b38be89f6198cf01f24 P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:55:01.874131 13882 ts_tablet_manager.cc:1397] T 52df62f7f1aa4b38be89f6198cf01f24 P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.075s user 0.002s sys 0.014s
I20250830 07:55:01.875804 13615 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "bac72b4ba9ba4ca69f93e799dccb0e93" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:55:01.876554 13615 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "76dd9dd481fc427fb20f5091e4a3b738" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
W20250830 07:55:01.877055 13423 leader_election.cc:343] T bac72b4ba9ba4ca69f93e799dccb0e93 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:55:01.877393 13615 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f479eef0171c401bbd27beec4486a8b2" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:55:01.877892 13882 raft_consensus.cc:357] T 52df62f7f1aa4b38be89f6198cf01f24 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:01.878021 13882 raft_consensus.cc:383] T 52df62f7f1aa4b38be89f6198cf01f24 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:55:01.878072 13882 raft_consensus.cc:738] T 52df62f7f1aa4b38be89f6198cf01f24 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:55:01.879050 13882 consensus_queue.cc:260] T 52df62f7f1aa4b38be89f6198cf01f24 P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:01.880026 13615 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "0f34ed0fe6e9400fae5c0edebb615ebd" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9"
W20250830 07:55:01.881306 13423 leader_election.cc:343] T 76dd9dd481fc427fb20f5091e4a3b738 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
W20250830 07:55:01.881532 13703 leader_election.cc:343] T 0f34ed0fe6e9400fae5c0edebb615ebd P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:55:01.881704 13882 ts_tablet_manager.cc:1428] T 52df62f7f1aa4b38be89f6198cf01f24 P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.007s user 0.001s sys 0.001s
I20250830 07:55:01.882884 15608 raft_consensus.cc:491] T 1ca83bbf848744f38206ceb4126271be P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:55:01.883155 13882 tablet_bootstrap.cc:492] T 1db4109dc43b489d89c5de9eeb64a771 P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:55:01.883101 15608 raft_consensus.cc:513] T 1ca83bbf848744f38206ceb4126271be P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:01.883766 15608 leader_election.cc:290] T 1ca83bbf848744f38206ceb4126271be P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
I20250830 07:55:01.884606 13882 tablet_bootstrap.cc:654] T 1db4109dc43b489d89c5de9eeb64a771 P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
W20250830 07:55:01.886270 13703 consensus_peers.cc:489] T 135d754d83ad422eb05909d2daa19d34 P 9b057ade5dce45af9f8bf0bedf8b917f -> Peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Couldn't send request to peer 6b5e454d98894637b466ea27f1b647f9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20250830 07:55:01.887537 16081 raft_consensus.cc:491] T a3ac09a6d8604297aa8736d1f60484e2 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:55:01.887653 16081 raft_consensus.cc:513] T a3ac09a6d8604297aa8736d1f60484e2 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:01.888101 16081 leader_election.cc:290] T a3ac09a6d8604297aa8736d1f60484e2 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:55:01.888890 13624 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "a3ac09a6d8604297aa8736d1f60484e2" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:55:01.889304 13476 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "3bca390f6d4343cba7a9fb07f0d4d72b" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba"
I20250830 07:55:01.889441 13476 raft_consensus.cc:3058] T 3bca390f6d4343cba7a9fb07f0d4d72b P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
W20250830 07:55:01.889688 13703 leader_election.cc:343] T 3bca390f6d4343cba7a9fb07f0d4d72b P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
W20250830 07:55:01.890635 13423 leader_election.cc:343] T a3ac09a6d8604297aa8736d1f60484e2 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:55:01.892741 13476 raft_consensus.cc:2466] T 3bca390f6d4343cba7a9fb07f0d4d72b P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 1.
I20250830 07:55:01.893945 13886 raft_consensus.cc:357] T 76dd9dd481fc427fb20f5091e4a3b738 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:01.894083 13886 raft_consensus.cc:383] T 76dd9dd481fc427fb20f5091e4a3b738 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:55:01.894122 13886 raft_consensus.cc:738] T 76dd9dd481fc427fb20f5091e4a3b738 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:55:01.894276 13886 consensus_queue.cc:260] T 76dd9dd481fc427fb20f5091e4a3b738 P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:01.894408 13882 tablet_bootstrap.cc:492] T 1db4109dc43b489d89c5de9eeb64a771 P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:55:01.894526 13882 ts_tablet_manager.cc:1397] T 1db4109dc43b489d89c5de9eeb64a771 P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.011s user 0.001s sys 0.001s
I20250830 07:55:01.894840 13886 ts_tablet_manager.cc:1428] T 76dd9dd481fc427fb20f5091e4a3b738 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.020s user 0.001s sys 0.000s
I20250830 07:55:01.895133 13886 tablet_bootstrap.cc:492] T c6355878115a4907ae1f0a45fb2c6492 P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:55:01.895187 13882 raft_consensus.cc:357] T 1db4109dc43b489d89c5de9eeb64a771 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:01.895314 16255 raft_consensus.cc:491] T 0c70140d87d34bde919714f08a5c94d4 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:55:01.895553 16255 raft_consensus.cc:513] T 0c70140d87d34bde919714f08a5c94d4 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:01.896878 16081 raft_consensus.cc:491] T 283aa82b808e49528ceb19133748ffc8 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:55:01.896883 13771 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "a5eea1950d1945f1b755fd34597b2fb4" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:55:01.896984 16081 raft_consensus.cc:513] T 283aa82b808e49528ceb19133748ffc8 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:01.897270 13476 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "0c70140d87d34bde919714f08a5c94d4" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:55:01.897435 16081 leader_election.cc:290] T 283aa82b808e49528ceb19133748ffc8 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:55:01.897990 16255 leader_election.cc:290] T 0c70140d87d34bde919714f08a5c94d4 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:55:01.898689 13624 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "283aa82b808e49528ceb19133748ffc8" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:55:01.895354 13882 raft_consensus.cc:383] T 1db4109dc43b489d89c5de9eeb64a771 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20250830 07:55:01.899323 13423 leader_election.cc:343] T 283aa82b808e49528ceb19133748ffc8 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:55:01.899384 13882 raft_consensus.cc:738] T 1db4109dc43b489d89c5de9eeb64a771 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:55:01.899557 13882 consensus_queue.cc:260] T 1db4109dc43b489d89c5de9eeb64a771 P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:01.901170 13886 tablet_bootstrap.cc:654] T c6355878115a4907ae1f0a45fb2c6492 P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:55:01.901167 13488 raft_consensus.cc:1273] T a8660a6ff9254d4f9f0ef047b8682ed1 P 2065c332f15a4739899af79f3669c3ba [term 2 FOLLOWER]: Refusing update from remote peer 9b057ade5dce45af9f8bf0bedf8b917f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20250830 07:55:01.901253 13882 ts_tablet_manager.cc:1428] T 1db4109dc43b489d89c5de9eeb64a771 P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.007s user 0.002s sys 0.000s
I20250830 07:55:01.902108 13887 tablet_bootstrap.cc:492] T 7dc061ebaa334c109d1e457e2dc860df P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:55:01.902237 13887 ts_tablet_manager.cc:1397] T 7dc061ebaa334c109d1e457e2dc860df P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.106s user 0.003s sys 0.002s
I20250830 07:55:01.902616 13882 tablet_bootstrap.cc:492] T ba4e1fccb8f046d6b63afe67c1f9d538 P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:55:01.903254 13886 tablet_bootstrap.cc:492] T c6355878115a4907ae1f0a45fb2c6492 P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:55:01.903275 13887 raft_consensus.cc:357] T 7dc061ebaa334c109d1e457e2dc860df P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:01.903450 13887 raft_consensus.cc:383] T 7dc061ebaa334c109d1e457e2dc860df P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:55:01.903499 13887 raft_consensus.cc:738] T 7dc061ebaa334c109d1e457e2dc860df P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:55:01.903725 13886 ts_tablet_manager.cc:1397] T c6355878115a4907ae1f0a45fb2c6492 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.009s user 0.003s sys 0.001s
I20250830 07:55:01.903774 13887 consensus_queue.cc:260] T 7dc061ebaa334c109d1e457e2dc860df P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:01.904129 13772 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "bac72b4ba9ba4ca69f93e799dccb0e93" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:55:01.904670 13882 tablet_bootstrap.cc:654] T ba4e1fccb8f046d6b63afe67c1f9d538 P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
I20250830 07:55:01.905005 13772 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "76dd9dd481fc427fb20f5091e4a3b738" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:55:01.905005 13886 raft_consensus.cc:357] T c6355878115a4907ae1f0a45fb2c6492 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:01.905157 13772 raft_consensus.cc:2466] T 76dd9dd481fc427fb20f5091e4a3b738 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2065c332f15a4739899af79f3669c3ba in term 0.
I20250830 07:55:01.905272 13886 raft_consensus.cc:383] T c6355878115a4907ae1f0a45fb2c6492 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:55:01.905344 13886 raft_consensus.cc:738] T c6355878115a4907ae1f0a45fb2c6492 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:55:01.905434 13887 ts_tablet_manager.cc:1428] T 7dc061ebaa334c109d1e457e2dc860df P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20250830 07:55:01.905611 13886 consensus_queue.cc:260] T c6355878115a4907ae1f0a45fb2c6492 P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:01.906378 13886 ts_tablet_manager.cc:1428] T c6355878115a4907ae1f0a45fb2c6492 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20250830 07:55:01.906447 13887 tablet_bootstrap.cc:492] T b6717031830f4c57967e87ce077ddb21 P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:55:01.906703 13886 tablet_bootstrap.cc:492] T a3ac09a6d8604297aa8736d1f60484e2 P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
W20250830 07:55:01.908591 13703 leader_election.cc:343] T b2248b305c9f448a9e30661142ad10ea P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
W20250830 07:55:01.909734 13703 leader_election.cc:343] T ad7a45187569416bad6c71db9f8ab702 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:55:01.912590 13886 tablet_bootstrap.cc:654] T a3ac09a6d8604297aa8736d1f60484e2 P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
W20250830 07:55:01.913554 13703 leader_election.cc:343] T f479eef0171c401bbd27beec4486a8b2 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:55:01.916236 13882 tablet_bootstrap.cc:492] T ba4e1fccb8f046d6b63afe67c1f9d538 P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:55:01.916345 13882 ts_tablet_manager.cc:1397] T ba4e1fccb8f046d6b63afe67c1f9d538 P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.014s user 0.002s sys 0.000s
I20250830 07:55:01.916882 13882 raft_consensus.cc:357] T ba4e1fccb8f046d6b63afe67c1f9d538 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:01.917021 13882 raft_consensus.cc:383] T ba4e1fccb8f046d6b63afe67c1f9d538 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:55:01.917086 13882 raft_consensus.cc:738] T ba4e1fccb8f046d6b63afe67c1f9d538 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
W20250830 07:55:01.916344 13703 leader_election.cc:343] T 0f34ed0fe6e9400fae5c0edebb615ebd P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:55:01.917290 13882 consensus_queue.cc:260] T ba4e1fccb8f046d6b63afe67c1f9d538 P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:01.918691 13477 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "ad7a45187569416bad6c71db9f8ab702" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba"
I20250830 07:55:01.918838 13477 raft_consensus.cc:3058] T ad7a45187569416bad6c71db9f8ab702 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:55:01.921756 13477 raft_consensus.cc:2466] T ad7a45187569416bad6c71db9f8ab702 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 1.
I20250830 07:55:01.924440 13615 raft_consensus.cc:3058] T d171ad1667fa44c993ec5fd7d701d8e0 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:55:01.926533 13624 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "1ca83bbf848744f38206ceb4126271be" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:55:01.926574 13882 ts_tablet_manager.cc:1428] T ba4e1fccb8f046d6b63afe67c1f9d538 P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.010s user 0.002s sys 0.000s
I20250830 07:55:01.933346 13882 tablet_bootstrap.cc:492] T 8c01157324ba45bda5b3a9a328bf319b P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:55:01.936724 13772 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "0c70140d87d34bde919714f08a5c94d4" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:55:01.940830 13882 tablet_bootstrap.cc:654] T 8c01157324ba45bda5b3a9a328bf319b P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
I20250830 07:55:01.944996 13562 leader_election.cc:304] T 0c70140d87d34bde919714f08a5c94d4 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b5e454d98894637b466ea27f1b647f9; no voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:55:01.945240 16074 raft_consensus.cc:2747] T 0c70140d87d34bde919714f08a5c94d4 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:55:01.923056 13488 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "b2248b305c9f448a9e30661142ad10ea" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba"
I20250830 07:55:01.944675 13484 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f479eef0171c401bbd27beec4486a8b2" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:55:01.960695 13484 raft_consensus.cc:2466] T f479eef0171c401bbd27beec4486a8b2 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 0.
I20250830 07:55:01.955067 13481 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "0f34ed0fe6e9400fae5c0edebb615ebd" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba"
I20250830 07:55:01.960916 13481 raft_consensus.cc:3058] T 0f34ed0fe6e9400fae5c0edebb615ebd P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:55:01.963285 13481 raft_consensus.cc:2466] T 0f34ed0fe6e9400fae5c0edebb615ebd P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 1.
I20250830 07:55:01.963613 13488 raft_consensus.cc:3058] T b2248b305c9f448a9e30661142ad10ea P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:55:01.963583 13701 leader_election.cc:304] T 3bca390f6d4343cba7a9fb07f0d4d72b P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:55:01.964437 16101 raft_consensus.cc:2802] T 3bca390f6d4343cba7a9fb07f0d4d72b P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election won for term 1
I20250830 07:55:01.964629 16101 raft_consensus.cc:695] T 3bca390f6d4343cba7a9fb07f0d4d72b P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 LEADER]: Becoming Leader. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Running, Role: LEADER
I20250830 07:55:01.964887 16101 consensus_queue.cc:237] T 3bca390f6d4343cba7a9fb07f0d4d72b P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:01.966264 13772 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "a3ac09a6d8604297aa8736d1f60484e2" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:55:01.956003 13482 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "1ca83bbf848744f38206ceb4126271be" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:55:01.966692 13482 raft_consensus.cc:2466] T 1ca83bbf848744f38206ceb4126271be P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 0.
I20250830 07:55:01.967470 13488 raft_consensus.cc:2466] T b2248b305c9f448a9e30661142ad10ea P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 1.
I20250830 07:55:01.967550 13615 raft_consensus.cc:3058] T 2e63eac2579844ef83bf43f1e6d58634 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:55:01.960326 13887 tablet_bootstrap.cc:654] T b6717031830f4c57967e87ce077ddb21 P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
W20250830 07:55:01.968950 13703 leader_election.cc:343] T 1ca83bbf848744f38206ceb4126271be P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:55:01.970183 13887 tablet_bootstrap.cc:492] T b6717031830f4c57967e87ce077ddb21 P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:55:01.970314 13887 ts_tablet_manager.cc:1397] T b6717031830f4c57967e87ce077ddb21 P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.064s user 0.003s sys 0.000s
I20250830 07:55:01.971060 13887 raft_consensus.cc:357] T b6717031830f4c57967e87ce077ddb21 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:01.971225 13887 raft_consensus.cc:383] T b6717031830f4c57967e87ce077ddb21 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:55:01.971284 13887 raft_consensus.cc:738] T b6717031830f4c57967e87ce077ddb21 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:55:01.971457 13887 consensus_queue.cc:260] T b6717031830f4c57967e87ce077ddb21 P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:01.971935 13887 ts_tablet_manager.cc:1428] T b6717031830f4c57967e87ce077ddb21 P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20250830 07:55:01.972180 13887 tablet_bootstrap.cc:492] T 6fb5cd3618584dd3a0ee43a10f7a2660 P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:55:01.973796 13887 tablet_bootstrap.cc:654] T 6fb5cd3618584dd3a0ee43a10f7a2660 P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:55:01.975148 13882 tablet_bootstrap.cc:492] T 8c01157324ba45bda5b3a9a328bf319b P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:55:01.975273 13882 ts_tablet_manager.cc:1397] T 8c01157324ba45bda5b3a9a328bf319b P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.042s user 0.004s sys 0.000s
I20250830 07:55:01.975752 13771 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "283aa82b808e49528ceb19133748ffc8" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:55:01.975960 13882 raft_consensus.cc:357] T 8c01157324ba45bda5b3a9a328bf319b P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:01.976094 13882 raft_consensus.cc:383] T 8c01157324ba45bda5b3a9a328bf319b P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:55:01.976138 13882 raft_consensus.cc:738] T 8c01157324ba45bda5b3a9a328bf319b P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:55:01.976301 13882 consensus_queue.cc:260] T 8c01157324ba45bda5b3a9a328bf319b P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:01.976701 13882 ts_tablet_manager.cc:1428] T 8c01157324ba45bda5b3a9a328bf319b P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20250830 07:55:01.976938 13882 tablet_bootstrap.cc:492] T 63168840534246b59a2fdbfdfeebff47 P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:55:01.978425 13882 tablet_bootstrap.cc:654] T 63168840534246b59a2fdbfdfeebff47 P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
I20250830 07:55:01.979048 15980 consensus_queue.cc:1035] T a8660a6ff9254d4f9f0ef047b8682ed1 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:55:01.988018 13887 tablet_bootstrap.cc:492] T 6fb5cd3618584dd3a0ee43a10f7a2660 P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:55:01.988124 13887 ts_tablet_manager.cc:1397] T 6fb5cd3618584dd3a0ee43a10f7a2660 P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.016s user 0.003s sys 0.000s
I20250830 07:55:01.988747 13887 raft_consensus.cc:357] T 6fb5cd3618584dd3a0ee43a10f7a2660 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:01.988879 13887 raft_consensus.cc:383] T 6fb5cd3618584dd3a0ee43a10f7a2660 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:55:01.988922 13887 raft_consensus.cc:738] T 6fb5cd3618584dd3a0ee43a10f7a2660 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:55:01.989076 13887 consensus_queue.cc:260] T 6fb5cd3618584dd3a0ee43a10f7a2660 P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:01.991384 13882 tablet_bootstrap.cc:492] T 63168840534246b59a2fdbfdfeebff47 P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:55:01.991494 13882 ts_tablet_manager.cc:1397] T 63168840534246b59a2fdbfdfeebff47 P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.015s user 0.003s sys 0.000s
I20250830 07:55:01.992153 13882 raft_consensus.cc:357] T 63168840534246b59a2fdbfdfeebff47 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:01.992336 13882 raft_consensus.cc:383] T 63168840534246b59a2fdbfdfeebff47 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:55:01.992399 13882 raft_consensus.cc:738] T 63168840534246b59a2fdbfdfeebff47 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:55:01.992583 13882 consensus_queue.cc:260] T 63168840534246b59a2fdbfdfeebff47 P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:01.992997 13882 ts_tablet_manager.cc:1428] T 63168840534246b59a2fdbfdfeebff47 P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20250830 07:55:01.995127 13882 tablet_bootstrap.cc:492] T dcb8b326dbec4d40af26b4f143157468 P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:55:01.996621 13882 tablet_bootstrap.cc:654] T dcb8b326dbec4d40af26b4f143157468 P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
I20250830 07:55:01.997627 13887 ts_tablet_manager.cc:1428] T 6fb5cd3618584dd3a0ee43a10f7a2660 P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.009s user 0.001s sys 0.000s
W20250830 07:55:02.002490 13422 leader_election.cc:343] T a5eea1950d1945f1b755fd34597b2fb4 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:55:02.003830 13887 tablet_bootstrap.cc:492] T 78fe9f6325c243a490f361aa79295c36 P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:55:02.004905 13612 raft_consensus.cc:3058] T f32ebc2605c34a68aed50379f028052c P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:55:02.005793 13887 tablet_bootstrap.cc:654] T 78fe9f6325c243a490f361aa79295c36 P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:55:02.003163 13422 leader_election.cc:304] T a5eea1950d1945f1b755fd34597b2fb4 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba; no voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:55:02.016394 15919 raft_consensus.cc:2747] T a5eea1950d1945f1b755fd34597b2fb4 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:55:02.019492 16074 raft_consensus.cc:491] T d1d5e0d40a91457da65a0e925289309e P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:55:02.019618 16074 raft_consensus.cc:513] T d1d5e0d40a91457da65a0e925289309e P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:02.020131 16074 leader_election.cc:290] T d1d5e0d40a91457da65a0e925289309e P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:55:02.020449 13476 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "d1d5e0d40a91457da65a0e925289309e" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:55:02.020737 13476 raft_consensus.cc:2391] T d1d5e0d40a91457da65a0e925289309e P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b5e454d98894637b466ea27f1b647f9 in current term 1: Already voted for candidate 9b057ade5dce45af9f8bf0bedf8b917f in this term.
I20250830 07:55:02.020699 13772 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "d1d5e0d40a91457da65a0e925289309e" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:55:02.021229 13886 tablet_bootstrap.cc:492] T a3ac09a6d8604297aa8736d1f60484e2 P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:55:02.021430 13886 ts_tablet_manager.cc:1397] T a3ac09a6d8604297aa8736d1f60484e2 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.115s user 0.003s sys 0.029s
I20250830 07:55:02.021970 13562 leader_election.cc:304] T d1d5e0d40a91457da65a0e925289309e P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b5e454d98894637b466ea27f1b647f9; no voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:55:02.022269 16074 raft_consensus.cc:3058] T d1d5e0d40a91457da65a0e925289309e P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:55:02.022712 13886 raft_consensus.cc:357] T a3ac09a6d8604297aa8736d1f60484e2 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:02.022949 13886 raft_consensus.cc:383] T a3ac09a6d8604297aa8736d1f60484e2 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:55:02.023033 13886 raft_consensus.cc:738] T a3ac09a6d8604297aa8736d1f60484e2 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:55:02.023296 13886 consensus_queue.cc:260] T a3ac09a6d8604297aa8736d1f60484e2 P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:02.023869 13886 ts_tablet_manager.cc:1428] T a3ac09a6d8604297aa8736d1f60484e2 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20250830 07:55:02.024775 16074 raft_consensus.cc:2747] T d1d5e0d40a91457da65a0e925289309e P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:55:02.024703 13886 tablet_bootstrap.cc:492] T 7e9d6af1d7fc4d4b961583b44f2f962a P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
W20250830 07:55:02.027431 13422 leader_election.cc:343] T bac72b4ba9ba4ca69f93e799dccb0e93 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:55:02.028620 13422 leader_election.cc:304] T bac72b4ba9ba4ca69f93e799dccb0e93 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba; no voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:55:02.032979 13886 tablet_bootstrap.cc:654] T 7e9d6af1d7fc4d4b961583b44f2f962a P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:55:02.035167 15919 raft_consensus.cc:2747] T bac72b4ba9ba4ca69f93e799dccb0e93 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:55:02.037775 15608 raft_consensus.cc:491] T f192693039a24e3cb0bec646c8d11056 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:55:02.038014 15608 raft_consensus.cc:513] T f192693039a24e3cb0bec646c8d11056 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:02.037488 13422 leader_election.cc:304] T 76dd9dd481fc427fb20f5091e4a3b738 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:55:02.038623 15919 raft_consensus.cc:2802] T 76dd9dd481fc427fb20f5091e4a3b738 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:55:02.038697 15919 raft_consensus.cc:491] T 76dd9dd481fc427fb20f5091e4a3b738 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:55:02.038754 15919 raft_consensus.cc:3058] T 76dd9dd481fc427fb20f5091e4a3b738 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:55:02.039105 15608 leader_election.cc:290] T f192693039a24e3cb0bec646c8d11056 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
I20250830 07:55:02.041477 15919 raft_consensus.cc:513] T 76dd9dd481fc427fb20f5091e4a3b738 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:02.042241 15919 leader_election.cc:290] T 76dd9dd481fc427fb20f5091e4a3b738 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 election: Requested vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:55:02.042443 16081 raft_consensus.cc:491] T f192693039a24e3cb0bec646c8d11056 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:55:02.042572 16081 raft_consensus.cc:513] T f192693039a24e3cb0bec646c8d11056 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:02.043084 16081 leader_election.cc:290] T f192693039a24e3cb0bec646c8d11056 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:55:02.047523 13624 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f192693039a24e3cb0bec646c8d11056" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:55:02.047746 13611 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "76dd9dd481fc427fb20f5091e4a3b738" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9"
I20250830 07:55:02.047940 13615 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f192693039a24e3cb0bec646c8d11056" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
W20250830 07:55:02.048406 13423 leader_election.cc:343] T 76dd9dd481fc427fb20f5091e4a3b738 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
W20250830 07:55:02.048502 13703 leader_election.cc:343] T f192693039a24e3cb0bec646c8d11056 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
W20250830 07:55:02.048583 13423 leader_election.cc:343] T f192693039a24e3cb0bec646c8d11056 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
W20250830 07:55:02.049518 13422 leader_election.cc:343] T a3ac09a6d8604297aa8736d1f60484e2 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:55:02.049654 13422 leader_election.cc:304] T a3ac09a6d8604297aa8736d1f60484e2 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba; no voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:55:02.049858 15919 raft_consensus.cc:2747] T a3ac09a6d8604297aa8736d1f60484e2 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:55:02.050113 16074 raft_consensus.cc:491] T 2aea1a69d22544899b0218be7e0f8799 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:55:02.050225 16074 raft_consensus.cc:513] T 2aea1a69d22544899b0218be7e0f8799 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:02.050720 16074 leader_election.cc:290] T 2aea1a69d22544899b0218be7e0f8799 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:55:02.051115 13476 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "2aea1a69d22544899b0218be7e0f8799" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:55:02.051342 13772 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "2aea1a69d22544899b0218be7e0f8799" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:55:02.051584 13772 raft_consensus.cc:2391] T 2aea1a69d22544899b0218be7e0f8799 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b5e454d98894637b466ea27f1b647f9 in current term 1: Already voted for candidate 2065c332f15a4739899af79f3669c3ba in this term.
I20250830 07:55:02.052001 13562 leader_election.cc:304] T 2aea1a69d22544899b0218be7e0f8799 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b5e454d98894637b466ea27f1b647f9; no voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:55:02.052381 16074 raft_consensus.cc:3058] T 2aea1a69d22544899b0218be7e0f8799 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Advancing to term 1
W20250830 07:55:02.052505 13422 leader_election.cc:343] T 283aa82b808e49528ceb19133748ffc8 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:55:02.052785 13422 leader_election.cc:304] T 283aa82b808e49528ceb19133748ffc8 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba; no voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:55:02.053352 16255 raft_consensus.cc:491] T 0ac39adafe144280b39f5c3fe5804087 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:55:02.053449 16255 raft_consensus.cc:513] T 0ac39adafe144280b39f5c3fe5804087 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:02.053891 16255 leader_election.cc:290] T 0ac39adafe144280b39f5c3fe5804087 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:55:02.054360 13476 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "0ac39adafe144280b39f5c3fe5804087" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:55:02.055394 13882 tablet_bootstrap.cc:492] T dcb8b326dbec4d40af26b4f143157468 P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:55:02.055523 13882 ts_tablet_manager.cc:1397] T dcb8b326dbec4d40af26b4f143157468 P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.060s user 0.004s sys 0.007s
I20250830 07:55:02.055557 13772 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "0ac39adafe144280b39f5c3fe5804087" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:55:02.056308 13562 leader_election.cc:304] T 0ac39adafe144280b39f5c3fe5804087 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b5e454d98894637b466ea27f1b647f9; no voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:55:02.056282 13882 raft_consensus.cc:357] T dcb8b326dbec4d40af26b4f143157468 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:02.056423 13882 raft_consensus.cc:383] T dcb8b326dbec4d40af26b4f143157468 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:55:02.056469 13882 raft_consensus.cc:738] T dcb8b326dbec4d40af26b4f143157468 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:55:02.056618 13882 consensus_queue.cc:260] T dcb8b326dbec4d40af26b4f143157468 P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:02.056700 15582 raft_consensus.cc:2747] T 0ac39adafe144280b39f5c3fe5804087 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:55:02.057103 16074 raft_consensus.cc:2747] T 2aea1a69d22544899b0218be7e0f8799 P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:55:02.058182 15919 raft_consensus.cc:2747] T 283aa82b808e49528ceb19133748ffc8 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:55:02.060606 13882 ts_tablet_manager.cc:1428] T dcb8b326dbec4d40af26b4f143157468 P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20250830 07:55:02.061606 13701 leader_election.cc:304] T ad7a45187569416bad6c71db9f8ab702 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:55:02.061698 13882 tablet_bootstrap.cc:492] T 34199145292d4ddb8c603e5c581f1d15 P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:55:02.062000 13701 leader_election.cc:304] T f479eef0171c401bbd27beec4486a8b2 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:55:02.062315 13701 leader_election.cc:304] T 0f34ed0fe6e9400fae5c0edebb615ebd P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:55:02.062654 13701 leader_election.cc:304] T 1ca83bbf848744f38206ceb4126271be P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:55:02.062773 16252 raft_consensus.cc:2802] T ad7a45187569416bad6c71db9f8ab702 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election won for term 1
I20250830 07:55:02.062865 16252 raft_consensus.cc:695] T ad7a45187569416bad6c71db9f8ab702 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 LEADER]: Becoming Leader. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Running, Role: LEADER
I20250830 07:55:02.063000 13701 leader_election.cc:304] T b2248b305c9f448a9e30661142ad10ea P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:55:02.063140 16252 consensus_queue.cc:237] T ad7a45187569416bad6c71db9f8ab702 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:02.063838 16101 raft_consensus.cc:2802] T f479eef0171c401bbd27beec4486a8b2 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:55:02.063910 16101 raft_consensus.cc:491] T f479eef0171c401bbd27beec4486a8b2 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:55:02.064013 16101 raft_consensus.cc:3058] T f479eef0171c401bbd27beec4486a8b2 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:55:02.064353 15980 raft_consensus.cc:2802] T 0f34ed0fe6e9400fae5c0edebb615ebd P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election won for term 1
I20250830 07:55:02.064460 15980 raft_consensus.cc:695] T 0f34ed0fe6e9400fae5c0edebb615ebd P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 LEADER]: Becoming Leader. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Running, Role: LEADER
I20250830 07:55:02.064641 15980 consensus_queue.cc:237] T 0f34ed0fe6e9400fae5c0edebb615ebd P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:02.065100 15919 raft_consensus.cc:491] T 986878a23a0b47ee865e09277b027bb0 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:55:02.065218 15919 raft_consensus.cc:513] T 986878a23a0b47ee865e09277b027bb0 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:02.065598 16224 raft_consensus.cc:2802] T 1ca83bbf848744f38206ceb4126271be P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:55:02.065668 16224 raft_consensus.cc:491] T 1ca83bbf848744f38206ceb4126271be P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:55:02.065727 16224 raft_consensus.cc:3058] T 1ca83bbf848744f38206ceb4126271be P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:55:02.065883 15919 leader_election.cc:290] T 986878a23a0b47ee865e09277b027bb0 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:55:02.066737 13612 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "986878a23a0b47ee865e09277b027bb0" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
W20250830 07:55:02.067143 13423 leader_election.cc:343] T 986878a23a0b47ee865e09277b027bb0 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:55:02.067291 16259 raft_consensus.cc:2802] T b2248b305c9f448a9e30661142ad10ea P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election won for term 1
I20250830 07:55:02.067404 16259 raft_consensus.cc:695] T b2248b305c9f448a9e30661142ad10ea P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 LEADER]: Becoming Leader. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Running, Role: LEADER
I20250830 07:55:02.067613 16259 consensus_queue.cc:237] T b2248b305c9f448a9e30661142ad10ea P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:02.068256 16224 raft_consensus.cc:513] T 1ca83bbf848744f38206ceb4126271be P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:02.068727 16224 leader_election.cc:290] T 1ca83bbf848744f38206ceb4126271be P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Requested vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
I20250830 07:55:02.066763 16101 raft_consensus.cc:513] T f479eef0171c401bbd27beec4486a8b2 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:02.070817 16101 leader_election.cc:290] T f479eef0171c401bbd27beec4486a8b2 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Requested vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
W20250830 07:55:02.073536 14988 leader_election.cc:336] T 00000000000000000000000000000000 P 3ea183a890b84f408b20b55e9eb7c7ed [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 5e9d6449ae824acab24c459a72075e88 (127.12.209.61:44241): Timed out: connection negotiation to 127.12.209.61:44241 for RPC RequestConsensusVote timed out after 0.860s (ON_OUTBOUND_QUEUE)
I20250830 07:55:02.073738 14988 leader_election.cc:304] T 00000000000000000000000000000000 P 3ea183a890b84f408b20b55e9eb7c7ed [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ea183a890b84f408b20b55e9eb7c7ed; no voters: 5e9d6449ae824acab24c459a72075e88, fea6152429cc4e79a25b18e02aafae57
I20250830 07:55:02.075048 13615 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "1ca83bbf848744f38206ceb4126271be" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9"
I20250830 07:55:02.075278 13611 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f479eef0171c401bbd27beec4486a8b2" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9"
W20250830 07:55:02.075641 13703 leader_election.cc:343] T 1ca83bbf848744f38206ceb4126271be P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
W20250830 07:55:02.077415 13703 leader_election.cc:343] T f479eef0171c401bbd27beec4486a8b2 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:55:02.079617 13771 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "76dd9dd481fc427fb20f5091e4a3b738" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f"
I20250830 07:55:02.079787 13771 raft_consensus.cc:3058] T 76dd9dd481fc427fb20f5091e4a3b738 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
W20250830 07:55:02.083261 13221 catalog_manager.cc:4726] Async tablet task AlterTable RPC for tablet 6fe94553af384cbdbbde85dd285fc2f3 (table default.Table_cb7e61ad3b5141c9967497b29c213e2d [id=58c192ac19924218a9657d9b89cd398c], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 6fe94553af384cbdbbde85dd285fc2f3 has no consensus state
I20250830 07:55:02.083956 13612 raft_consensus.cc:3058] T c56e3a30c18640e68c8b0c4ff4251d96 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:55:02.084194 13615 raft_consensus.cc:3058] T 846338e46b834ae0b5f4e74c7f1325d2 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:55:02.082774 13771 raft_consensus.cc:2466] T 76dd9dd481fc427fb20f5091e4a3b738 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2065c332f15a4739899af79f3669c3ba in term 1.
I20250830 07:55:02.087750 13882 tablet_bootstrap.cc:654] T 34199145292d4ddb8c603e5c581f1d15 P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
I20250830 07:55:02.090392 13771 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f192693039a24e3cb0bec646c8d11056" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:55:02.090597 13771 raft_consensus.cc:2466] T f192693039a24e3cb0bec646c8d11056 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2065c332f15a4739899af79f3669c3ba in term 0.
I20250830 07:55:02.096616 16074 raft_consensus.cc:491] T 52df62f7f1aa4b38be89f6198cf01f24 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:55:02.096771 16074 raft_consensus.cc:513] T 52df62f7f1aa4b38be89f6198cf01f24 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:02.097430 16074 leader_election.cc:290] T 52df62f7f1aa4b38be89f6198cf01f24 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:55:02.097992 13476 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "52df62f7f1aa4b38be89f6198cf01f24" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:55:02.098557 13771 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "52df62f7f1aa4b38be89f6198cf01f24" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:55:02.099128 13562 leader_election.cc:304] T 52df62f7f1aa4b38be89f6198cf01f24 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b5e454d98894637b466ea27f1b647f9; no voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:55:02.099517 16074 raft_consensus.cc:2747] T 52df62f7f1aa4b38be89f6198cf01f24 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:55:02.101843 13476 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f192693039a24e3cb0bec646c8d11056" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:55:02.102061 13476 raft_consensus.cc:2466] T f192693039a24e3cb0bec646c8d11056 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 0.
I20250830 07:55:02.104185 13124 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskbivBUj/build/asan/bin/kudu
/tmp/dist-test-taskbivBUj/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.209.62:39725
--webserver_interface=127.12.209.62
--webserver_port=35923
--builtin_ntp_servers=127.12.209.20:33943
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.209.62:39725,127.12.209.61:44241,127.12.209.60:43889
--hive_metastore_notification_log_poll_period_seconds=1
--enable_metadata_cleanup_for_deleted_tables_and_tablets=true
--catalog_manager_bg_task_wait_ms=10
--metadata_for_deleted_table_and_tablet_reserved_secs=0
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
W20250830 07:55:02.104296 13703 consensus_peers.cc:489] T adbacbbb13d840a29d8d7d08ea04f6b1 P 9b057ade5dce45af9f8bf0bedf8b917f -> Peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Couldn't send request to peer 6b5e454d98894637b466ea27f1b647f9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20250830 07:55:02.105571 13612 raft_consensus.cc:3058] T 1fee3e58f31b4befa42ffbb8d7bd6f4e P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:55:02.110632 13476 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "1ca83bbf848744f38206ceb4126271be" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba"
I20250830 07:55:02.110848 13476 raft_consensus.cc:3058] T 1ca83bbf848744f38206ceb4126271be P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:55:02.112313 13887 tablet_bootstrap.cc:492] T 78fe9f6325c243a490f361aa79295c36 P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:55:02.112506 13887 ts_tablet_manager.cc:1397] T 78fe9f6325c243a490f361aa79295c36 P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.109s user 0.005s sys 0.008s
I20250830 07:55:02.113013 13611 raft_consensus.cc:3058] T bdeb89bbb3ad4e67bbc74b78454eeb7e P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:55:02.113907 13887 raft_consensus.cc:357] T 78fe9f6325c243a490f361aa79295c36 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:02.114403 13887 raft_consensus.cc:383] T 78fe9f6325c243a490f361aa79295c36 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:55:02.114434 13488 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f479eef0171c401bbd27beec4486a8b2" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba"
I20250830 07:55:02.114558 13488 raft_consensus.cc:3058] T f479eef0171c401bbd27beec4486a8b2 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:55:02.114491 13887 raft_consensus.cc:738] T 78fe9f6325c243a490f361aa79295c36 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:55:02.114899 13887 consensus_queue.cc:260] T 78fe9f6325c243a490f361aa79295c36 P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:02.117372 13488 raft_consensus.cc:2466] T f479eef0171c401bbd27beec4486a8b2 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 1.
I20250830 07:55:02.118521 13886 tablet_bootstrap.cc:492] T 7e9d6af1d7fc4d4b961583b44f2f962a P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:55:02.118803 13886 ts_tablet_manager.cc:1397] T 7e9d6af1d7fc4d4b961583b44f2f962a P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.094s user 0.008s sys 0.007s
I20250830 07:55:02.125859 15720 raft_consensus.cc:491] T af449cc407c046eeb5cdfdacffc617a4 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:55:02.125980 15720 raft_consensus.cc:513] T af449cc407c046eeb5cdfdacffc617a4 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:02.127648 13624 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "af449cc407c046eeb5cdfdacffc617a4" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:55:02.126572 15720 leader_election.cc:290] T af449cc407c046eeb5cdfdacffc617a4 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
W20250830 07:55:02.128682 13703 leader_election.cc:343] T af449cc407c046eeb5cdfdacffc617a4 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:55:02.126451 13886 raft_consensus.cc:357] T 7e9d6af1d7fc4d4b961583b44f2f962a P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:02.129292 13476 raft_consensus.cc:2466] T 1ca83bbf848744f38206ceb4126271be P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 1.
I20250830 07:55:02.129860 13771 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "986878a23a0b47ee865e09277b027bb0" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:55:02.128897 13886 raft_consensus.cc:383] T 7e9d6af1d7fc4d4b961583b44f2f962a P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:55:02.131742 13886 raft_consensus.cc:738] T 7e9d6af1d7fc4d4b961583b44f2f962a P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:55:02.132001 16101 consensus_queue.cc:1035] T 6720d2b945814305845beea0a2cb9912 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:55:02.132359 13887 ts_tablet_manager.cc:1428] T 78fe9f6325c243a490f361aa79295c36 P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.020s user 0.003s sys 0.000s
I20250830 07:55:02.134423 13887 tablet_bootstrap.cc:492] T 75359721445e48d2bc0dd6fd17649bc1 P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:55:02.134151 13886 consensus_queue.cc:260] T 7e9d6af1d7fc4d4b961583b44f2f962a P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:02.138545 15720 consensus_queue.cc:1035] T adbacbbb13d840a29d8d7d08ea04f6b1 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:55:02.138545 13886 ts_tablet_manager.cc:1428] T 7e9d6af1d7fc4d4b961583b44f2f962a P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.020s user 0.001s sys 0.001s
I20250830 07:55:02.139431 13886 tablet_bootstrap.cc:492] T 78fe9f6325c243a490f361aa79295c36 P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:55:02.141638 13701 leader_election.cc:304] T f192693039a24e3cb0bec646c8d11056 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:55:02.141924 15863 raft_consensus.cc:2802] T f192693039a24e3cb0bec646c8d11056 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:55:02.141999 15863 raft_consensus.cc:491] T f192693039a24e3cb0bec646c8d11056 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:55:02.142063 15863 raft_consensus.cc:3058] T f192693039a24e3cb0bec646c8d11056 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:55:02.144898 15863 raft_consensus.cc:513] T f192693039a24e3cb0bec646c8d11056 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:02.145661 15863 leader_election.cc:290] T f192693039a24e3cb0bec646c8d11056 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Requested vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
I20250830 07:55:02.146790 13611 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f192693039a24e3cb0bec646c8d11056" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9"
I20250830 07:55:02.146979 13624 raft_consensus.cc:3058] T 14d4d2506e2a47ea906bfb81d5509829 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:55:02.150313 16081 raft_consensus.cc:491] T 7dc061ebaa334c109d1e457e2dc860df P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:55:02.150452 16081 raft_consensus.cc:513] T 7dc061ebaa334c109d1e457e2dc860df P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:02.151129 16081 leader_election.cc:290] T 7dc061ebaa334c109d1e457e2dc860df P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:55:02.152041 13887 tablet_bootstrap.cc:654] T 75359721445e48d2bc0dd6fd17649bc1 P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:55:02.152069 13612 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "7dc061ebaa334c109d1e457e2dc860df" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
W20250830 07:55:02.152148 13703 leader_election.cc:343] T f192693039a24e3cb0bec646c8d11056 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
W20250830 07:55:02.152580 13423 leader_election.cc:343] T 7dc061ebaa334c109d1e457e2dc860df P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:55:02.152802 13422 leader_election.cc:304] T 76dd9dd481fc427fb20f5091e4a3b738 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:55:02.153149 15919 raft_consensus.cc:2802] T 76dd9dd481fc427fb20f5091e4a3b738 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election won for term 1
I20250830 07:55:02.153240 15919 raft_consensus.cc:695] T 76dd9dd481fc427fb20f5091e4a3b738 P 2065c332f15a4739899af79f3669c3ba [term 1 LEADER]: Becoming Leader. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Running, Role: LEADER
I20250830 07:55:02.153204 15720 consensus_queue.cc:1035] T dcb8b326dbec4d40af26b4f143157468 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:55:02.153465 15919 consensus_queue.cc:237] T 76dd9dd481fc427fb20f5091e4a3b738 P 2065c332f15a4739899af79f3669c3ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:02.159060 13701 leader_election.cc:304] T f479eef0171c401bbd27beec4486a8b2 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:55:02.159574 16224 raft_consensus.cc:2802] T f479eef0171c401bbd27beec4486a8b2 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election won for term 1
I20250830 07:55:02.159991 16224 raft_consensus.cc:695] T f479eef0171c401bbd27beec4486a8b2 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 LEADER]: Becoming Leader. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Running, Role: LEADER
I20250830 07:55:02.160271 16224 consensus_queue.cc:237] T f479eef0171c401bbd27beec4486a8b2 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:02.162160 13882 tablet_bootstrap.cc:492] T 34199145292d4ddb8c603e5c581f1d15 P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:55:02.162349 13882 ts_tablet_manager.cc:1397] T 34199145292d4ddb8c603e5c581f1d15 P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.101s user 0.006s sys 0.001s
I20250830 07:55:02.163115 13882 raft_consensus.cc:357] T 34199145292d4ddb8c603e5c581f1d15 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:02.163846 13882 raft_consensus.cc:383] T 34199145292d4ddb8c603e5c581f1d15 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:55:02.164034 13882 raft_consensus.cc:738] T 34199145292d4ddb8c603e5c581f1d15 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:55:02.164392 13882 consensus_queue.cc:260] T 34199145292d4ddb8c603e5c581f1d15 P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:02.165377 13882 ts_tablet_manager.cc:1428] T 34199145292d4ddb8c603e5c581f1d15 P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20250830 07:55:02.167089 13882 tablet_bootstrap.cc:492] T 50dfc24a0b9645e4860cd99b1df3bd61 P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:55:02.167251 15582 raft_consensus.cc:491] T 63168840534246b59a2fdbfdfeebff47 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:55:02.167373 15582 raft_consensus.cc:513] T 63168840534246b59a2fdbfdfeebff47 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:02.167876 15582 leader_election.cc:290] T 63168840534246b59a2fdbfdfeebff47 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:55:02.168053 13422 leader_election.cc:304] T f192693039a24e3cb0bec646c8d11056 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:55:02.168740 15919 raft_consensus.cc:2802] T f192693039a24e3cb0bec646c8d11056 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:55:02.168853 15919 raft_consensus.cc:491] T f192693039a24e3cb0bec646c8d11056 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:55:02.168975 15919 raft_consensus.cc:3058] T f192693039a24e3cb0bec646c8d11056 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:55:02.169199 15608 raft_consensus.cc:491] T 0d16bc64dd6e43f7ba313b77c2bbb728 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:55:02.169333 15608 raft_consensus.cc:513] T 0d16bc64dd6e43f7ba313b77c2bbb728 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:02.169900 13771 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "63168840534246b59a2fdbfdfeebff47" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:55:02.169922 13476 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "63168840534246b59a2fdbfdfeebff47" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:55:02.170051 13771 raft_consensus.cc:2466] T 63168840534246b59a2fdbfdfeebff47 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b5e454d98894637b466ea27f1b647f9 in term 0.
I20250830 07:55:02.170070 13476 raft_consensus.cc:2466] T 63168840534246b59a2fdbfdfeebff47 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b5e454d98894637b466ea27f1b647f9 in term 0.
I20250830 07:55:02.170464 13561 leader_election.cc:304] T 63168840534246b59a2fdbfdfeebff47 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 6b5e454d98894637b466ea27f1b647f9; no voters:
I20250830 07:55:02.170768 15582 raft_consensus.cc:2802] T 63168840534246b59a2fdbfdfeebff47 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:55:02.170855 15582 raft_consensus.cc:491] T 63168840534246b59a2fdbfdfeebff47 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:55:02.170946 15582 raft_consensus.cc:3058] T 63168840534246b59a2fdbfdfeebff47 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:55:02.171909 15919 raft_consensus.cc:513] T f192693039a24e3cb0bec646c8d11056 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:02.172611 15919 leader_election.cc:290] T f192693039a24e3cb0bec646c8d11056 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 election: Requested vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
W20250830 07:55:02.173719 13422 leader_election.cc:343] T 986878a23a0b47ee865e09277b027bb0 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:55:02.174024 15582 raft_consensus.cc:513] T 63168840534246b59a2fdbfdfeebff47 P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:02.173995 13422 leader_election.cc:304] T 986878a23a0b47ee865e09277b027bb0 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba; no voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:55:02.174643 15582 leader_election.cc:290] T 63168840534246b59a2fdbfdfeebff47 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 election: Requested vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:55:02.174837 15919 raft_consensus.cc:2747] T 986878a23a0b47ee865e09277b027bb0 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:55:02.175268 13488 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "63168840534246b59a2fdbfdfeebff47" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba"
I20250830 07:55:02.175407 13488 raft_consensus.cc:3058] T 63168840534246b59a2fdbfdfeebff47 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:55:02.176355 13701 leader_election.cc:304] T 1ca83bbf848744f38206ceb4126271be P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:55:02.176815 16259 raft_consensus.cc:2802] T 1ca83bbf848744f38206ceb4126271be P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election won for term 1
I20250830 07:55:02.177001 16259 raft_consensus.cc:695] T 1ca83bbf848744f38206ceb4126271be P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 LEADER]: Becoming Leader. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Running, Role: LEADER
I20250830 07:55:02.177721 13488 raft_consensus.cc:2466] T 63168840534246b59a2fdbfdfeebff47 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b5e454d98894637b466ea27f1b647f9 in term 1.
I20250830 07:55:02.178229 13561 leader_election.cc:304] T 63168840534246b59a2fdbfdfeebff47 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 6b5e454d98894637b466ea27f1b647f9; no voters:
I20250830 07:55:02.178463 16259 consensus_queue.cc:237] T 1ca83bbf848744f38206ceb4126271be P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:02.178741 16255 raft_consensus.cc:491] T e74a3e4b3b234c41aca30f772525652e P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:55:02.178857 16255 raft_consensus.cc:513] T e74a3e4b3b234c41aca30f772525652e P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:02.179422 16255 leader_election.cc:290] T e74a3e4b3b234c41aca30f772525652e P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:55:02.179548 16255 raft_consensus.cc:2802] T 63168840534246b59a2fdbfdfeebff47 P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Leader election won for term 1
I20250830 07:55:02.179679 16255 raft_consensus.cc:695] T 63168840534246b59a2fdbfdfeebff47 P 6b5e454d98894637b466ea27f1b647f9 [term 1 LEADER]: Becoming Leader. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Running, Role: LEADER
I20250830 07:55:02.179935 16255 consensus_queue.cc:237] T 63168840534246b59a2fdbfdfeebff47 P 6b5e454d98894637b466ea27f1b647f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:02.181816 13488 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "e74a3e4b3b234c41aca30f772525652e" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:55:02.182051 13488 raft_consensus.cc:2391] T e74a3e4b3b234c41aca30f772525652e P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b5e454d98894637b466ea27f1b647f9 in current term 1: Already voted for candidate 2065c332f15a4739899af79f3669c3ba in this term.
I20250830 07:55:02.182258 13482 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "af449cc407c046eeb5cdfdacffc617a4" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:55:02.182405 13482 raft_consensus.cc:2466] T af449cc407c046eeb5cdfdacffc617a4 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 0.
I20250830 07:55:02.182870 13882 tablet_bootstrap.cc:654] T 50dfc24a0b9645e4860cd99b1df3bd61 P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
I20250830 07:55:02.183724 15720 raft_consensus.cc:491] T c6355878115a4907ae1f0a45fb2c6492 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:55:02.186295 13612 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f192693039a24e3cb0bec646c8d11056" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9"
I20250830 07:55:02.187005 13772 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "e74a3e4b3b234c41aca30f772525652e" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:55:02.187186 13772 raft_consensus.cc:2391] T e74a3e4b3b234c41aca30f772525652e P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b5e454d98894637b466ea27f1b647f9 in current term 1: Already voted for candidate 9b057ade5dce45af9f8bf0bedf8b917f in this term.
I20250830 07:55:02.187157 13771 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "63168840534246b59a2fdbfdfeebff47" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f"
I20250830 07:55:02.187283 13771 raft_consensus.cc:3058] T 63168840534246b59a2fdbfdfeebff47 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:55:02.183897 15720 raft_consensus.cc:513] T c6355878115a4907ae1f0a45fb2c6492 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:02.189078 15720 leader_election.cc:290] T c6355878115a4907ae1f0a45fb2c6492 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
W20250830 07:55:02.190232 13423 leader_election.cc:343] T f192693039a24e3cb0bec646c8d11056 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:55:02.190397 13562 leader_election.cc:304] T e74a3e4b3b234c41aca30f772525652e P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b5e454d98894637b466ea27f1b647f9; no voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:55:02.190935 13612 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "c6355878115a4907ae1f0a45fb2c6492" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:55:02.191108 13764 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "7dc061ebaa334c109d1e457e2dc860df" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:55:02.191434 13771 raft_consensus.cc:2466] T 63168840534246b59a2fdbfdfeebff47 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b5e454d98894637b466ea27f1b647f9 in term 1.
I20250830 07:55:02.191612 15608 leader_election.cc:290] T 0d16bc64dd6e43f7ba313b77c2bbb728 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
I20250830 07:55:02.191947 13771 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f192693039a24e3cb0bec646c8d11056" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f"
I20250830 07:55:02.192157 13771 raft_consensus.cc:2391] T f192693039a24e3cb0bec646c8d11056 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 2065c332f15a4739899af79f3669c3ba in current term 1: Already voted for candidate 9b057ade5dce45af9f8bf0bedf8b917f in this term.
I20250830 07:55:02.192198 16074 raft_consensus.cc:3058] T e74a3e4b3b234c41aca30f772525652e P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:55:02.194691 16074 raft_consensus.cc:2747] T e74a3e4b3b234c41aca30f772525652e P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:55:02.195251 13886 tablet_bootstrap.cc:654] T 78fe9f6325c243a490f361aa79295c36 P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:55:02.196373 13612 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "0d16bc64dd6e43f7ba313b77c2bbb728" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
W20250830 07:55:02.196789 13703 leader_election.cc:343] T c6355878115a4907ae1f0a45fb2c6492 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:55:02.197011 16101 raft_consensus.cc:491] T 8ee98b748d0245bc8bf9eeac727b495e P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:55:02.197165 16101 raft_consensus.cc:513] T 8ee98b748d0245bc8bf9eeac727b495e P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:02.197691 16101 leader_election.cc:290] T 8ee98b748d0245bc8bf9eeac727b495e P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
W20250830 07:55:02.200855 13703 leader_election.cc:343] T 0d16bc64dd6e43f7ba313b77c2bbb728 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:55:02.200974 13886 tablet_bootstrap.cc:492] T 78fe9f6325c243a490f361aa79295c36 P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:55:02.201103 13886 ts_tablet_manager.cc:1397] T 78fe9f6325c243a490f361aa79295c36 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.062s user 0.002s sys 0.001s
I20250830 07:55:02.201726 13624 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "8ee98b748d0245bc8bf9eeac727b495e" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:55:02.201850 13886 raft_consensus.cc:357] T 78fe9f6325c243a490f361aa79295c36 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:02.201987 13886 raft_consensus.cc:383] T 78fe9f6325c243a490f361aa79295c36 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:55:02.202044 13886 raft_consensus.cc:738] T 78fe9f6325c243a490f361aa79295c36 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:55:02.202217 13886 consensus_queue.cc:260] T 78fe9f6325c243a490f361aa79295c36 P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:02.202664 13886 ts_tablet_manager.cc:1428] T 78fe9f6325c243a490f361aa79295c36 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
W20250830 07:55:02.203858 13703 leader_election.cc:343] T 8ee98b748d0245bc8bf9eeac727b495e P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:55:02.206017 13886 tablet_bootstrap.cc:492] T 283aa82b808e49528ceb19133748ffc8 P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:55:02.207695 13886 tablet_bootstrap.cc:654] T 283aa82b808e49528ceb19133748ffc8 P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:55:02.207947 13887 tablet_bootstrap.cc:492] T 75359721445e48d2bc0dd6fd17649bc1 P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:55:02.208076 13887 ts_tablet_manager.cc:1397] T 75359721445e48d2bc0dd6fd17649bc1 P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.074s user 0.001s sys 0.005s
I20250830 07:55:02.208746 13887 raft_consensus.cc:357] T 75359721445e48d2bc0dd6fd17649bc1 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:02.208899 13887 raft_consensus.cc:383] T 75359721445e48d2bc0dd6fd17649bc1 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:55:02.208966 13887 raft_consensus.cc:738] T 75359721445e48d2bc0dd6fd17649bc1 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:55:02.209178 13887 consensus_queue.cc:260] T 75359721445e48d2bc0dd6fd17649bc1 P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:02.209656 13887 ts_tablet_manager.cc:1428] T 75359721445e48d2bc0dd6fd17649bc1 P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20250830 07:55:02.209892 13887 tablet_bootstrap.cc:492] T 1f5471a94dc24a28bce5f9dcaa10334a P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:55:02.214040 13476 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f192693039a24e3cb0bec646c8d11056" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba"
I20250830 07:55:02.214277 13476 raft_consensus.cc:2391] T f192693039a24e3cb0bec646c8d11056 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 9b057ade5dce45af9f8bf0bedf8b917f in current term 1: Already voted for candidate 2065c332f15a4739899af79f3669c3ba in this term.
I20250830 07:55:02.215629 13886 tablet_bootstrap.cc:492] T 283aa82b808e49528ceb19133748ffc8 P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:55:02.215621 16255 raft_consensus.cc:491] T 8c01157324ba45bda5b3a9a328bf319b P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:55:02.215757 13886 ts_tablet_manager.cc:1397] T 283aa82b808e49528ceb19133748ffc8 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.013s user 0.003s sys 0.000s
I20250830 07:55:02.215870 16255 raft_consensus.cc:513] T 8c01157324ba45bda5b3a9a328bf319b P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:02.216413 13886 raft_consensus.cc:357] T 283aa82b808e49528ceb19133748ffc8 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:02.216542 13886 raft_consensus.cc:383] T 283aa82b808e49528ceb19133748ffc8 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:55:02.216593 13886 raft_consensus.cc:738] T 283aa82b808e49528ceb19133748ffc8 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:55:02.216769 13886 consensus_queue.cc:260] T 283aa82b808e49528ceb19133748ffc8 P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:02.217281 13886 ts_tablet_manager.cc:1428] T 283aa82b808e49528ceb19133748ffc8 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20250830 07:55:02.217519 13886 tablet_bootstrap.cc:492] T 122bec4220c74dfaa8228f6d153cd50e P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:55:02.221100 13476 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "c6355878115a4907ae1f0a45fb2c6492" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:55:02.221256 13476 raft_consensus.cc:2466] T c6355878115a4907ae1f0a45fb2c6492 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 0.
I20250830 07:55:02.221506 16255 leader_election.cc:290] T 8c01157324ba45bda5b3a9a328bf319b P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:55:02.221939 13481 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "8c01157324ba45bda5b3a9a328bf319b" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:55:02.222654 13481 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "0d16bc64dd6e43f7ba313b77c2bbb728" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:55:02.222805 13481 raft_consensus.cc:2466] T 0d16bc64dd6e43f7ba313b77c2bbb728 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 0.
I20250830 07:55:02.223620 13481 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "8ee98b748d0245bc8bf9eeac727b495e" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:55:02.223760 13481 raft_consensus.cc:2466] T 8ee98b748d0245bc8bf9eeac727b495e P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 0.
I20250830 07:55:02.224828 16294 raft_consensus.cc:2747] T 00000000000000000000000000000000 P 3ea183a890b84f408b20b55e9eb7c7ed [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20250830 07:55:02.225096 14988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.209.61:44241, user_credentials={real_user=slave}} blocked reactor thread for 151576us
I20250830 07:55:02.227712 13701 leader_election.cc:304] T af449cc407c046eeb5cdfdacffc617a4 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:55:02.228968 15365 raft_consensus.cc:2802] T af449cc407c046eeb5cdfdacffc617a4 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:55:02.229070 15365 raft_consensus.cc:491] T af449cc407c046eeb5cdfdacffc617a4 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:55:02.229240 15365 raft_consensus.cc:3058] T af449cc407c046eeb5cdfdacffc617a4 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:55:02.231388 13701 leader_election.cc:304] T f192693039a24e3cb0bec646c8d11056 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 2065c332f15a4739899af79f3669c3ba, 6b5e454d98894637b466ea27f1b647f9
I20250830 07:55:02.231805 16101 raft_consensus.cc:2747] T f192693039a24e3cb0bec646c8d11056 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20250830 07:55:02.232440 15919 raft_consensus.cc:491] T 75359721445e48d2bc0dd6fd17649bc1 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:55:02.232554 15919 raft_consensus.cc:513] T 75359721445e48d2bc0dd6fd17649bc1 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:02.233269 13771 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "8c01157324ba45bda5b3a9a328bf319b" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:55:02.233335 15919 leader_election.cc:290] T 75359721445e48d2bc0dd6fd17649bc1 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:55:02.234936 15365 raft_consensus.cc:513] T af449cc407c046eeb5cdfdacffc617a4 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:02.235669 15365 leader_election.cc:290] T af449cc407c046eeb5cdfdacffc617a4 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Requested vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
I20250830 07:55:02.236805 13886 tablet_bootstrap.cc:654] T 122bec4220c74dfaa8228f6d153cd50e P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:55:02.238628 13887 tablet_bootstrap.cc:654] T 1f5471a94dc24a28bce5f9dcaa10334a P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:55:02.244225 13887 tablet_bootstrap.cc:492] T 1f5471a94dc24a28bce5f9dcaa10334a P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:55:02.244379 13887 ts_tablet_manager.cc:1397] T 1f5471a94dc24a28bce5f9dcaa10334a P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.035s user 0.003s sys 0.000s
I20250830 07:55:02.245039 13887 raft_consensus.cc:357] T 1f5471a94dc24a28bce5f9dcaa10334a P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:02.245198 13887 raft_consensus.cc:383] T 1f5471a94dc24a28bce5f9dcaa10334a P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:55:02.245255 13887 raft_consensus.cc:738] T 1f5471a94dc24a28bce5f9dcaa10334a P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:55:02.245424 13887 consensus_queue.cc:260] T 1f5471a94dc24a28bce5f9dcaa10334a P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:02.245862 13887 ts_tablet_manager.cc:1428] T 1f5471a94dc24a28bce5f9dcaa10334a P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20250830 07:55:02.246104 13887 tablet_bootstrap.cc:492] T e24d68b8f5ba4df59a9aeec8ebd6403d P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:55:02.248991 15365 raft_consensus.cc:491] T 78fe9f6325c243a490f361aa79295c36 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:55:02.249645 13701 leader_election.cc:304] T c6355878115a4907ae1f0a45fb2c6492 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:55:02.249858 15980 raft_consensus.cc:2802] T c6355878115a4907ae1f0a45fb2c6492 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:55:02.249971 15980 raft_consensus.cc:491] T c6355878115a4907ae1f0a45fb2c6492 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:55:02.250056 15980 raft_consensus.cc:3058] T c6355878115a4907ae1f0a45fb2c6492 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:55:02.250818 13701 leader_election.cc:304] T 0d16bc64dd6e43f7ba313b77c2bbb728 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:55:02.252403 16101 raft_consensus.cc:2802] T 0d16bc64dd6e43f7ba313b77c2bbb728 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:55:02.252734 16101 raft_consensus.cc:491] T 0d16bc64dd6e43f7ba313b77c2bbb728 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:55:02.253188 16101 raft_consensus.cc:3058] T 0d16bc64dd6e43f7ba313b77c2bbb728 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:55:02.253252 13701 leader_election.cc:304] T 8ee98b748d0245bc8bf9eeac727b495e P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:55:02.253213 15980 raft_consensus.cc:513] T c6355878115a4907ae1f0a45fb2c6492 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:02.254204 15863 raft_consensus.cc:2802] T 8ee98b748d0245bc8bf9eeac727b495e P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:55:02.254256 15980 leader_election.cc:290] T c6355878115a4907ae1f0a45fb2c6492 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Requested vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
I20250830 07:55:02.254312 15863 raft_consensus.cc:491] T 8ee98b748d0245bc8bf9eeac727b495e P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:55:02.254426 15863 raft_consensus.cc:3058] T 8ee98b748d0245bc8bf9eeac727b495e P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:55:02.257016 15863 raft_consensus.cc:513] T 8ee98b748d0245bc8bf9eeac727b495e P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:02.257699 15863 leader_election.cc:290] T 8ee98b748d0245bc8bf9eeac727b495e P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Requested vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
W20250830 07:55:02.253310 13422 leader_election.cc:343] T 7dc061ebaa334c109d1e457e2dc860df P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:55:02.258862 13886 tablet_bootstrap.cc:492] T 122bec4220c74dfaa8228f6d153cd50e P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:55:02.259254 13886 ts_tablet_manager.cc:1397] T 122bec4220c74dfaa8228f6d153cd50e P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.042s user 0.004s sys 0.002s
I20250830 07:55:02.260054 13886 raft_consensus.cc:357] T 122bec4220c74dfaa8228f6d153cd50e P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:02.260296 13886 raft_consensus.cc:383] T 122bec4220c74dfaa8228f6d153cd50e P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:55:02.260383 13886 raft_consensus.cc:738] T 122bec4220c74dfaa8228f6d153cd50e P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:55:02.249269 15365 raft_consensus.cc:513] T 78fe9f6325c243a490f361aa79295c36 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:02.260635 13886 consensus_queue.cc:260] T 122bec4220c74dfaa8228f6d153cd50e P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:02.261173 13886 ts_tablet_manager.cc:1428] T 122bec4220c74dfaa8228f6d153cd50e P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20250830 07:55:02.261459 13886 tablet_bootstrap.cc:492] T e7e9d2e9b1ca4ddfb0c6a7bced613c35 P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:55:02.263180 13886 tablet_bootstrap.cc:654] T e7e9d2e9b1ca4ddfb0c6a7bced613c35 P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:55:02.264271 15365 leader_election.cc:290] T 78fe9f6325c243a490f361aa79295c36 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
I20250830 07:55:02.264832 16101 raft_consensus.cc:513] T 0d16bc64dd6e43f7ba313b77c2bbb728 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:02.265195 13562 leader_election.cc:304] T 8c01157324ba45bda5b3a9a328bf319b P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b5e454d98894637b466ea27f1b647f9; no voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:55:02.266266 16255 raft_consensus.cc:2747] T 8c01157324ba45bda5b3a9a328bf319b P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:55:02.267326 16101 leader_election.cc:290] T 0d16bc64dd6e43f7ba313b77c2bbb728 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Requested vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
I20250830 07:55:02.264659 13887 tablet_bootstrap.cc:654] T e24d68b8f5ba4df59a9aeec8ebd6403d P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:55:02.269232 13624 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "75359721445e48d2bc0dd6fd17649bc1" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:55:02.268832 13422 leader_election.cc:304] T 7dc061ebaa334c109d1e457e2dc860df P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba; no voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:55:02.270730 13887 tablet_bootstrap.cc:492] T e24d68b8f5ba4df59a9aeec8ebd6403d P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:55:02.270866 13887 ts_tablet_manager.cc:1397] T e24d68b8f5ba4df59a9aeec8ebd6403d P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.025s user 0.003s sys 0.000s
I20250830 07:55:02.271770 15919 raft_consensus.cc:2747] T 7dc061ebaa334c109d1e457e2dc860df P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:55:02.271924 13886 tablet_bootstrap.cc:492] T e7e9d2e9b1ca4ddfb0c6a7bced613c35 P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:55:02.272074 13886 ts_tablet_manager.cc:1397] T e7e9d2e9b1ca4ddfb0c6a7bced613c35 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.011s user 0.003s sys 0.000s
I20250830 07:55:02.272809 13886 raft_consensus.cc:357] T e7e9d2e9b1ca4ddfb0c6a7bced613c35 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:02.272935 13615 raft_consensus.cc:3058] T 1db4109dc43b489d89c5de9eeb64a771 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Advancing to term 2
I20250830 07:55:02.272971 13886 raft_consensus.cc:383] T e7e9d2e9b1ca4ddfb0c6a7bced613c35 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:55:02.273090 13886 raft_consensus.cc:738] T e7e9d2e9b1ca4ddfb0c6a7bced613c35 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:55:02.273298 13886 consensus_queue.cc:260] T e7e9d2e9b1ca4ddfb0c6a7bced613c35 P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:02.273821 13886 ts_tablet_manager.cc:1428] T e7e9d2e9b1ca4ddfb0c6a7bced613c35 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20250830 07:55:02.274108 13886 tablet_bootstrap.cc:492] T 508d21af038c4801a9680ce275eb504c P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:55:02.275288 13624 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "af449cc407c046eeb5cdfdacffc617a4" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9"
I20250830 07:55:02.275632 13886 tablet_bootstrap.cc:654] T 508d21af038c4801a9680ce275eb504c P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:55:02.276592 13887 raft_consensus.cc:357] T e24d68b8f5ba4df59a9aeec8ebd6403d P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:02.276734 13887 raft_consensus.cc:383] T e24d68b8f5ba4df59a9aeec8ebd6403d P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:55:02.276782 13887 raft_consensus.cc:738] T e24d68b8f5ba4df59a9aeec8ebd6403d P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:55:02.276925 13887 consensus_queue.cc:260] T e24d68b8f5ba4df59a9aeec8ebd6403d P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:02.277043 13422 leader_election.cc:304] T f192693039a24e3cb0bec646c8d11056 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba; no voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:55:02.279052 13624 raft_consensus.cc:1273] T 7aed56dba39e40518e9c3325bcccd74a P 6b5e454d98894637b466ea27f1b647f9 [term 2 FOLLOWER]: Refusing update from remote peer 9b057ade5dce45af9f8bf0bedf8b917f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20250830 07:55:02.287214 13887 ts_tablet_manager.cc:1428] T e24d68b8f5ba4df59a9aeec8ebd6403d P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.016s user 0.001s sys 0.000s
I20250830 07:55:02.287474 13887 tablet_bootstrap.cc:492] T e2ef8300fb994f98b3565ad708f880cf P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:55:02.288923 13887 tablet_bootstrap.cc:654] T e2ef8300fb994f98b3565ad708f880cf P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:55:02.292601 15919 raft_consensus.cc:2747] T f192693039a24e3cb0bec646c8d11056 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20250830 07:55:02.293751 13624 raft_consensus.cc:3058] T 0ac39adafe144280b39f5c3fe5804087 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:55:02.301308 13886 tablet_bootstrap.cc:492] T 508d21af038c4801a9680ce275eb504c P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:55:02.301496 13886 ts_tablet_manager.cc:1397] T 508d21af038c4801a9680ce275eb504c P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.027s user 0.000s sys 0.002s
I20250830 07:55:02.302673 13886 raft_consensus.cc:357] T 508d21af038c4801a9680ce275eb504c P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:02.304011 13887 tablet_bootstrap.cc:492] T e2ef8300fb994f98b3565ad708f880cf P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:55:02.304147 13887 ts_tablet_manager.cc:1397] T e2ef8300fb994f98b3565ad708f880cf P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.017s user 0.002s sys 0.000s
I20250830 07:55:02.304836 13887 raft_consensus.cc:357] T e2ef8300fb994f98b3565ad708f880cf P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:02.305034 13887 raft_consensus.cc:383] T e2ef8300fb994f98b3565ad708f880cf P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:55:02.305087 13887 raft_consensus.cc:738] T e2ef8300fb994f98b3565ad708f880cf P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:55:02.305298 13887 consensus_queue.cc:260] T e2ef8300fb994f98b3565ad708f880cf P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:02.305805 13887 ts_tablet_manager.cc:1428] T e2ef8300fb994f98b3565ad708f880cf P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20250830 07:55:02.306051 13887 tablet_bootstrap.cc:492] T 0c32e597f17e4e75a0f584b6b7b02c36 P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:55:02.307566 13887 tablet_bootstrap.cc:654] T 0c32e597f17e4e75a0f584b6b7b02c36 P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:55:02.309355 13612 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "c6355878115a4907ae1f0a45fb2c6492" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9"
I20250830 07:55:02.309860 13615 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "8ee98b748d0245bc8bf9eeac727b495e" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9"
I20250830 07:55:02.310181 13615 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "78fe9f6325c243a490f361aa79295c36" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:55:02.310395 13612 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "0d16bc64dd6e43f7ba313b77c2bbb728" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9"
I20250830 07:55:02.302899 13886 raft_consensus.cc:383] T 508d21af038c4801a9680ce275eb504c P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:55:02.311120 13886 raft_consensus.cc:738] T 508d21af038c4801a9680ce275eb504c P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:55:02.311364 13886 consensus_queue.cc:260] T 508d21af038c4801a9680ce275eb504c P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:02.311911 13886 ts_tablet_manager.cc:1428] T 508d21af038c4801a9680ce275eb504c P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.010s user 0.002s sys 0.000s
W20250830 07:55:02.315208 13423 leader_election.cc:343] T 75359721445e48d2bc0dd6fd17649bc1 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:55:02.320199 15365 raft_consensus.cc:491] T 50360492db824755a6de251436cab5c6 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:55:02.320333 15365 raft_consensus.cc:513] T 50360492db824755a6de251436cab5c6 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:02.320950 15365 leader_election.cc:290] T 50360492db824755a6de251436cab5c6 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
I20250830 07:55:02.332129 13887 tablet_bootstrap.cc:492] T 0c32e597f17e4e75a0f584b6b7b02c36 P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:55:02.332247 13887 ts_tablet_manager.cc:1397] T 0c32e597f17e4e75a0f584b6b7b02c36 P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.026s user 0.002s sys 0.000s
I20250830 07:55:02.332928 13887 raft_consensus.cc:357] T 0c32e597f17e4e75a0f584b6b7b02c36 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:02.333105 13887 raft_consensus.cc:383] T 0c32e597f17e4e75a0f584b6b7b02c36 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:55:02.333159 13887 raft_consensus.cc:738] T 0c32e597f17e4e75a0f584b6b7b02c36 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:55:02.333328 13887 consensus_queue.cc:260] T 0c32e597f17e4e75a0f584b6b7b02c36 P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:02.333777 13887 ts_tablet_manager.cc:1428] T 0c32e597f17e4e75a0f584b6b7b02c36 P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20250830 07:55:02.334035 13887 tablet_bootstrap.cc:492] T 53766699d42e4f6e9b42d9a98613726c P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:55:02.334820 13771 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "75359721445e48d2bc0dd6fd17649bc1" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:55:02.335813 13887 tablet_bootstrap.cc:654] T 53766699d42e4f6e9b42d9a98613726c P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:55:02.340466 13488 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "af449cc407c046eeb5cdfdacffc617a4" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba"
I20250830 07:55:02.340623 13488 raft_consensus.cc:3058] T af449cc407c046eeb5cdfdacffc617a4 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:55:02.341295 13476 raft_consensus.cc:1273] T 7aed56dba39e40518e9c3325bcccd74a P 2065c332f15a4739899af79f3669c3ba [term 2 FOLLOWER]: Refusing update from remote peer 9b057ade5dce45af9f8bf0bedf8b917f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20250830 07:55:02.342653 13476 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "c6355878115a4907ae1f0a45fb2c6492" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba"
I20250830 07:55:02.342777 13476 raft_consensus.cc:3058] T c6355878115a4907ae1f0a45fb2c6492 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:55:02.343851 13488 raft_consensus.cc:2466] T af449cc407c046eeb5cdfdacffc617a4 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 1.
I20250830 07:55:02.345208 13476 raft_consensus.cc:2466] T c6355878115a4907ae1f0a45fb2c6492 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 1.
W20250830 07:55:02.351145 13703 leader_election.cc:343] T af449cc407c046eeb5cdfdacffc617a4 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:55:02.352459 15863 consensus_queue.cc:1035] T 7aed56dba39e40518e9c3325bcccd74a P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:55:02.353638 13476 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "8ee98b748d0245bc8bf9eeac727b495e" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba"
I20250830 07:55:02.353848 13476 raft_consensus.cc:3058] T 8ee98b748d0245bc8bf9eeac727b495e P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:55:02.356559 13476 raft_consensus.cc:2466] T 8ee98b748d0245bc8bf9eeac727b495e P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 1.
W20250830 07:55:02.358449 13703 leader_election.cc:343] T c6355878115a4907ae1f0a45fb2c6492 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
W20250830 07:55:02.360002 13703 leader_election.cc:343] T 8ee98b748d0245bc8bf9eeac727b495e P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
W20250830 07:55:02.360510 13703 leader_election.cc:343] T 78fe9f6325c243a490f361aa79295c36 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
W20250830 07:55:02.361588 13703 leader_election.cc:343] T 0d16bc64dd6e43f7ba313b77c2bbb728 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:55:02.362129 13476 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "78fe9f6325c243a490f361aa79295c36" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:55:02.362345 13476 raft_consensus.cc:2466] T 78fe9f6325c243a490f361aa79295c36 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 0.
W20250830 07:55:02.362778 13703 consensus_peers.cc:489] T 4b9d9d4b65964fd49d8e25092a14d774 P 9b057ade5dce45af9f8bf0bedf8b917f -> Peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Couldn't send request to peer 6b5e454d98894637b466ea27f1b647f9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20250830 07:55:02.364477 13476 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "0d16bc64dd6e43f7ba313b77c2bbb728" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba"
I20250830 07:55:02.364739 13476 raft_consensus.cc:3058] T 0d16bc64dd6e43f7ba313b77c2bbb728 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:55:02.364886 13887 tablet_bootstrap.cc:492] T 53766699d42e4f6e9b42d9a98613726c P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:55:02.365027 13887 ts_tablet_manager.cc:1397] T 53766699d42e4f6e9b42d9a98613726c P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.031s user 0.000s sys 0.004s
I20250830 07:55:02.365718 13887 raft_consensus.cc:357] T 53766699d42e4f6e9b42d9a98613726c P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:02.365852 13887 raft_consensus.cc:383] T 53766699d42e4f6e9b42d9a98613726c P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:55:02.365903 13887 raft_consensus.cc:738] T 53766699d42e4f6e9b42d9a98613726c P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:55:02.366096 13887 consensus_queue.cc:260] T 53766699d42e4f6e9b42d9a98613726c P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:02.366526 13887 ts_tablet_manager.cc:1428] T 53766699d42e4f6e9b42d9a98613726c P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20250830 07:55:02.366748 13887 tablet_bootstrap.cc:492] T 91da20bcd25341b5a0f6605b3ec58fb3 P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:55:02.368248 13887 tablet_bootstrap.cc:654] T 91da20bcd25341b5a0f6605b3ec58fb3 P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:55:02.368595 13476 raft_consensus.cc:2466] T 0d16bc64dd6e43f7ba313b77c2bbb728 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 1.
I20250830 07:55:02.372421 13886 tablet_bootstrap.cc:492] T 370441c443be46c2a33132fbc5c41f89 P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:55:02.373991 13886 tablet_bootstrap.cc:654] T 370441c443be46c2a33132fbc5c41f89 P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:55:02.376827 13882 tablet_bootstrap.cc:492] T 50dfc24a0b9645e4860cd99b1df3bd61 P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:55:02.377295 13882 ts_tablet_manager.cc:1397] T 50dfc24a0b9645e4860cd99b1df3bd61 P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.210s user 0.004s sys 0.009s
I20250830 07:55:02.378829 13882 raft_consensus.cc:357] T 50dfc24a0b9645e4860cd99b1df3bd61 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:02.379071 13882 raft_consensus.cc:383] T 50dfc24a0b9645e4860cd99b1df3bd61 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:55:02.379180 13882 raft_consensus.cc:738] T 50dfc24a0b9645e4860cd99b1df3bd61 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:55:02.379423 13882 consensus_queue.cc:260] T 50dfc24a0b9645e4860cd99b1df3bd61 P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:02.380786 13882 ts_tablet_manager.cc:1428] T 50dfc24a0b9645e4860cd99b1df3bd61 P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20250830 07:55:02.381747 13882 tablet_bootstrap.cc:492] T b2248b305c9f448a9e30661142ad10ea P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:55:02.386958 13887 tablet_bootstrap.cc:492] T 91da20bcd25341b5a0f6605b3ec58fb3 P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:55:02.387121 13887 ts_tablet_manager.cc:1397] T 91da20bcd25341b5a0f6605b3ec58fb3 P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.020s user 0.005s sys 0.000s
I20250830 07:55:02.387760 13887 raft_consensus.cc:357] T 91da20bcd25341b5a0f6605b3ec58fb3 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:02.387907 13887 raft_consensus.cc:383] T 91da20bcd25341b5a0f6605b3ec58fb3 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:55:02.387954 13887 raft_consensus.cc:738] T 91da20bcd25341b5a0f6605b3ec58fb3 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:55:02.387990 13612 raft_consensus.cc:3058] T 2c31d119743f49589703c434ac6c7548 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:55:02.388113 13887 consensus_queue.cc:260] T 91da20bcd25341b5a0f6605b3ec58fb3 P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:02.388513 13887 ts_tablet_manager.cc:1428] T 91da20bcd25341b5a0f6605b3ec58fb3 P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20250830 07:55:02.388711 13887 tablet_bootstrap.cc:492] T 559fdab1ef804325978db705431a0ad8 P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:55:02.395771 13624 raft_consensus.cc:3058] T 439fc51afa6b435e81bc38b9e88d4041 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:55:02.397828 13886 tablet_bootstrap.cc:492] T 370441c443be46c2a33132fbc5c41f89 P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:55:02.397987 13886 ts_tablet_manager.cc:1397] T 370441c443be46c2a33132fbc5c41f89 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.026s user 0.003s sys 0.006s
I20250830 07:55:02.398743 13886 raft_consensus.cc:357] T 370441c443be46c2a33132fbc5c41f89 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:02.398932 13886 raft_consensus.cc:383] T 370441c443be46c2a33132fbc5c41f89 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:55:02.399049 13886 raft_consensus.cc:738] T 370441c443be46c2a33132fbc5c41f89 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:55:02.399267 13886 consensus_queue.cc:260] T 370441c443be46c2a33132fbc5c41f89 P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:02.399791 13886 ts_tablet_manager.cc:1428] T 370441c443be46c2a33132fbc5c41f89 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20250830 07:55:02.400077 13886 tablet_bootstrap.cc:492] T bac72b4ba9ba4ca69f93e799dccb0e93 P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:55:02.401820 13886 tablet_bootstrap.cc:654] T bac72b4ba9ba4ca69f93e799dccb0e93 P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:55:02.409880 16081 consensus_queue.cc:1035] T 439fc51afa6b435e81bc38b9e88d4041 P 2065c332f15a4739899af79f3669c3ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:55:02.410868 13887 tablet_bootstrap.cc:654] T 559fdab1ef804325978db705431a0ad8 P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:55:02.413832 13615 raft_consensus.cc:3058] T dcb8b326dbec4d40af26b4f143157468 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:55:02.412088 13882 tablet_bootstrap.cc:654] T b2248b305c9f448a9e30661142ad10ea P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
I20250830 07:55:02.417719 15365 raft_consensus.cc:491] T ccc9091018cb48ffb2affd98e8bbfa05 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20250830 07:55:02.417889 15746 lock_manager.cc:585] Waited 6 seconds to obtain row lock on key '<redacted>' (key hash 4012713805250960239) tablet 00000000000000000000000000000000 cur holder 0x61700003a700
I20250830 07:55:02.417889 15365 raft_consensus.cc:513] T ccc9091018cb48ffb2affd98e8bbfa05 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:02.418403 15365 leader_election.cc:290] T ccc9091018cb48ffb2affd98e8bbfa05 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
I20250830 07:55:02.418550 13887 tablet_bootstrap.cc:492] T 559fdab1ef804325978db705431a0ad8 P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:55:02.418654 13887 ts_tablet_manager.cc:1397] T 559fdab1ef804325978db705431a0ad8 P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.030s user 0.004s sys 0.002s
I20250830 07:55:02.424203 15863 raft_consensus.cc:491] T 55bd3f378b854476a24f657f5e23843d P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:55:02.424314 15863 raft_consensus.cc:513] T 55bd3f378b854476a24f657f5e23843d P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:02.424742 15863 leader_election.cc:290] T 55bd3f378b854476a24f657f5e23843d P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
I20250830 07:55:02.426666 13887 raft_consensus.cc:357] T 559fdab1ef804325978db705431a0ad8 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:02.426877 13887 raft_consensus.cc:383] T 559fdab1ef804325978db705431a0ad8 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:55:02.426972 13887 raft_consensus.cc:738] T 559fdab1ef804325978db705431a0ad8 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:55:02.427775 13887 consensus_queue.cc:260] T 559fdab1ef804325978db705431a0ad8 P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:02.428320 13887 ts_tablet_manager.cc:1428] T 559fdab1ef804325978db705431a0ad8 P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.010s user 0.002s sys 0.000s
I20250830 07:55:02.428567 13887 tablet_bootstrap.cc:492] T 8028ac4c928a48f3a077d61aec24f3bd P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:55:02.430292 13887 tablet_bootstrap.cc:654] T 8028ac4c928a48f3a077d61aec24f3bd P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:55:02.433485 16081 raft_consensus.cc:491] T fac764a2d269411c86b85ceeaec0b014 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:55:02.433602 16081 raft_consensus.cc:513] T fac764a2d269411c86b85ceeaec0b014 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:02.434087 16081 leader_election.cc:290] T fac764a2d269411c86b85ceeaec0b014 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:55:02.439358 13484 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "ccc9091018cb48ffb2affd98e8bbfa05" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:55:02.439548 13484 raft_consensus.cc:2466] T ccc9091018cb48ffb2affd98e8bbfa05 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 0.
I20250830 07:55:02.440840 13624 raft_consensus.cc:3058] T 52df62f7f1aa4b38be89f6198cf01f24 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:55:02.445508 13484 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "55bd3f378b854476a24f657f5e23843d" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:55:02.445657 13484 raft_consensus.cc:2466] T 55bd3f378b854476a24f657f5e23843d P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 0.
I20250830 07:55:02.447628 13701 leader_election.cc:304] T af449cc407c046eeb5cdfdacffc617a4 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:55:02.447942 13887 tablet_bootstrap.cc:492] T 8028ac4c928a48f3a077d61aec24f3bd P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:55:02.448066 13887 ts_tablet_manager.cc:1397] T 8028ac4c928a48f3a077d61aec24f3bd P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.020s user 0.004s sys 0.000s
I20250830 07:55:02.448060 13701 leader_election.cc:304] T c6355878115a4907ae1f0a45fb2c6492 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:55:02.448401 13701 leader_election.cc:304] T 8ee98b748d0245bc8bf9eeac727b495e P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:55:02.448776 15980 consensus_queue.cc:1035] T 50dfc24a0b9645e4860cd99b1df3bd61 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:55:02.448813 13887 raft_consensus.cc:357] T 8028ac4c928a48f3a077d61aec24f3bd P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:02.448958 13887 raft_consensus.cc:383] T 8028ac4c928a48f3a077d61aec24f3bd P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:55:02.449025 13887 raft_consensus.cc:738] T 8028ac4c928a48f3a077d61aec24f3bd P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:55:02.449098 15980 consensus_queue.cc:1035] T 7aed56dba39e40518e9c3325bcccd74a P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:55:02.449188 13887 consensus_queue.cc:260] T 8028ac4c928a48f3a077d61aec24f3bd P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:02.449440 15980 raft_consensus.cc:2802] T af449cc407c046eeb5cdfdacffc617a4 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election won for term 1
I20250830 07:55:02.449528 15365 raft_consensus.cc:2802] T c6355878115a4907ae1f0a45fb2c6492 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election won for term 1
I20250830 07:55:02.449581 15980 raft_consensus.cc:695] T af449cc407c046eeb5cdfdacffc617a4 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 LEADER]: Becoming Leader. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Running, Role: LEADER
I20250830 07:55:02.449645 15365 raft_consensus.cc:695] T c6355878115a4907ae1f0a45fb2c6492 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 LEADER]: Becoming Leader. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Running, Role: LEADER
I20250830 07:55:02.449702 13887 ts_tablet_manager.cc:1428] T 8028ac4c928a48f3a077d61aec24f3bd P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20250830 07:55:02.449931 13887 tablet_bootstrap.cc:492] T 6f8b6f233e5c49b39b3ef6314508e9d9 P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:55:02.449851 15980 consensus_queue.cc:237] T af449cc407c046eeb5cdfdacffc617a4 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:02.450165 15863 raft_consensus.cc:2802] T 8ee98b748d0245bc8bf9eeac727b495e P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election won for term 1
I20250830 07:55:02.450301 15863 raft_consensus.cc:695] T 8ee98b748d0245bc8bf9eeac727b495e P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 LEADER]: Becoming Leader. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Running, Role: LEADER
I20250830 07:55:02.450531 15863 consensus_queue.cc:237] T 8ee98b748d0245bc8bf9eeac727b495e P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:02.452491 13882 tablet_bootstrap.cc:492] T b2248b305c9f448a9e30661142ad10ea P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:55:02.452641 13882 ts_tablet_manager.cc:1397] T b2248b305c9f448a9e30661142ad10ea P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.071s user 0.003s sys 0.000s
I20250830 07:55:02.452771 15365 consensus_queue.cc:237] T c6355878115a4907ae1f0a45fb2c6492 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:02.453106 16081 raft_consensus.cc:491] T 559fdab1ef804325978db705431a0ad8 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:55:02.453246 16081 raft_consensus.cc:513] T 559fdab1ef804325978db705431a0ad8 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:02.453853 16081 leader_election.cc:290] T 559fdab1ef804325978db705431a0ad8 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:55:02.454591 13882 raft_consensus.cc:357] T b2248b305c9f448a9e30661142ad10ea P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:02.454730 13882 raft_consensus.cc:383] T b2248b305c9f448a9e30661142ad10ea P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:55:02.454777 13882 raft_consensus.cc:738] T b2248b305c9f448a9e30661142ad10ea P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:55:02.455022 13887 tablet_bootstrap.cc:654] T 6f8b6f233e5c49b39b3ef6314508e9d9 P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:55:02.454979 13882 consensus_queue.cc:260] T b2248b305c9f448a9e30661142ad10ea P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:02.455262 13701 leader_election.cc:304] T 78fe9f6325c243a490f361aa79295c36 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:55:02.455582 13701 leader_election.cc:304] T 0d16bc64dd6e43f7ba313b77c2bbb728 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:55:02.456456 16259 raft_consensus.cc:2802] T 78fe9f6325c243a490f361aa79295c36 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:55:02.456547 16259 raft_consensus.cc:491] T 78fe9f6325c243a490f361aa79295c36 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:55:02.456643 16259 raft_consensus.cc:3058] T 78fe9f6325c243a490f361aa79295c36 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:55:02.458070 13882 ts_tablet_manager.cc:1428] T b2248b305c9f448a9e30661142ad10ea P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.005s user 0.003s sys 0.000s
I20250830 07:55:02.458396 13887 tablet_bootstrap.cc:492] T 6f8b6f233e5c49b39b3ef6314508e9d9 P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:55:02.458508 13887 ts_tablet_manager.cc:1397] T 6f8b6f233e5c49b39b3ef6314508e9d9 P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.009s user 0.000s sys 0.003s
I20250830 07:55:02.459061 15608 raft_consensus.cc:2802] T 0d16bc64dd6e43f7ba313b77c2bbb728 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election won for term 1
I20250830 07:55:02.459144 13882 tablet_bootstrap.cc:492] T b6717031830f4c57967e87ce077ddb21 P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:55:02.459144 13887 raft_consensus.cc:357] T 6f8b6f233e5c49b39b3ef6314508e9d9 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:02.459224 15608 raft_consensus.cc:695] T 0d16bc64dd6e43f7ba313b77c2bbb728 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 LEADER]: Becoming Leader. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Running, Role: LEADER
I20250830 07:55:02.459290 13887 raft_consensus.cc:383] T 6f8b6f233e5c49b39b3ef6314508e9d9 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:55:02.459337 13887 raft_consensus.cc:738] T 6f8b6f233e5c49b39b3ef6314508e9d9 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:55:02.459463 15608 consensus_queue.cc:237] T 0d16bc64dd6e43f7ba313b77c2bbb728 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:02.461632 13619 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "ccc9091018cb48ffb2affd98e8bbfa05" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
W20250830 07:55:02.462241 13701 leader_election.cc:343] T 50360492db824755a6de251436cab5c6 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): Not found: Tablet not found: 50360492db824755a6de251436cab5c6
I20250830 07:55:02.463084 13887 consensus_queue.cc:260] T 6f8b6f233e5c49b39b3ef6314508e9d9 P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:02.463593 13887 ts_tablet_manager.cc:1428] T 6f8b6f233e5c49b39b3ef6314508e9d9 P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.005s user 0.000s sys 0.001s
I20250830 07:55:02.463824 13887 tablet_bootstrap.cc:492] T b4c345013ff04cf991989f456aa2d420 P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:55:02.465487 13887 tablet_bootstrap.cc:654] T b4c345013ff04cf991989f456aa2d420 P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:55:02.465983 13886 tablet_bootstrap.cc:492] T bac72b4ba9ba4ca69f93e799dccb0e93 P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:55:02.466166 13886 ts_tablet_manager.cc:1397] T bac72b4ba9ba4ca69f93e799dccb0e93 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.066s user 0.003s sys 0.013s
I20250830 07:55:02.466948 13886 raft_consensus.cc:357] T bac72b4ba9ba4ca69f93e799dccb0e93 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:02.467128 13886 raft_consensus.cc:383] T bac72b4ba9ba4ca69f93e799dccb0e93 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:55:02.467211 13886 raft_consensus.cc:738] T bac72b4ba9ba4ca69f93e799dccb0e93 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:55:02.467442 13886 consensus_queue.cc:260] T bac72b4ba9ba4ca69f93e799dccb0e93 P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:02.467917 13886 ts_tablet_manager.cc:1428] T bac72b4ba9ba4ca69f93e799dccb0e93 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20250830 07:55:02.468209 13886 tablet_bootstrap.cc:492] T 690cf258639a4c1ea5a0ac4f2fd39f88 P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:55:02.469803 13886 tablet_bootstrap.cc:654] T 690cf258639a4c1ea5a0ac4f2fd39f88 P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:55:02.471316 13619 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "55bd3f378b854476a24f657f5e23843d" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
W20250830 07:55:02.476804 13703 leader_election.cc:343] T 50360492db824755a6de251436cab5c6 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Not found: Tablet not found: 50360492db824755a6de251436cab5c6
I20250830 07:55:02.476922 13703 leader_election.cc:304] T 50360492db824755a6de251436cab5c6 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 2065c332f15a4739899af79f3669c3ba, 6b5e454d98894637b466ea27f1b647f9
W20250830 07:55:02.477499 13703 consensus_peers.cc:489] T cd9903bdfaef4139a1a582c54689da4a P 9b057ade5dce45af9f8bf0bedf8b917f -> Peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Couldn't send request to peer 6b5e454d98894637b466ea27f1b647f9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20250830 07:55:02.479140 16252 raft_consensus.cc:2747] T 50360492db824755a6de251436cab5c6 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:55:02.479276 16252 consensus_queue.cc:1035] T dcb8b326dbec4d40af26b4f143157468 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:55:02.480682 13701 leader_election.cc:304] T ccc9091018cb48ffb2affd98e8bbfa05 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters:
I20250830 07:55:02.481539 15751 raft_consensus.cc:2802] T ccc9091018cb48ffb2affd98e8bbfa05 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:55:02.481613 15751 raft_consensus.cc:491] T ccc9091018cb48ffb2affd98e8bbfa05 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:55:02.481674 15751 raft_consensus.cc:3058] T ccc9091018cb48ffb2affd98e8bbfa05 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:55:02.481933 16072 raft_consensus.cc:491] T 508d21af038c4801a9680ce275eb504c P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:55:02.482043 16072 raft_consensus.cc:513] T 508d21af038c4801a9680ce275eb504c P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:02.482586 16072 leader_election.cc:290] T 508d21af038c4801a9680ce275eb504c P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:55:02.483567 16072 raft_consensus.cc:491] T b85843ab0e3a40e1b453cfdd71bbae5e P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20250830 07:55:02.483706 13422 leader_election.cc:343] T 75359721445e48d2bc0dd6fd17649bc1 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:55:02.483681 16072 raft_consensus.cc:513] T b85843ab0e3a40e1b453cfdd71bbae5e P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:02.483798 13422 leader_election.cc:304] T 75359721445e48d2bc0dd6fd17649bc1 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba; no voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:55:02.484162 16072 leader_election.cc:290] T b85843ab0e3a40e1b453cfdd71bbae5e P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:55:02.484293 16072 raft_consensus.cc:2747] T 75359721445e48d2bc0dd6fd17649bc1 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:55:02.484900 15751 raft_consensus.cc:513] T ccc9091018cb48ffb2affd98e8bbfa05 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:02.485189 13882 tablet_bootstrap.cc:654] T b6717031830f4c57967e87ce077ddb21 P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
I20250830 07:55:02.485708 15751 leader_election.cc:290] T ccc9091018cb48ffb2affd98e8bbfa05 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Requested vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
I20250830 07:55:02.491253 16259 raft_consensus.cc:513] T 78fe9f6325c243a490f361aa79295c36 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:02.495138 16259 leader_election.cc:290] T 78fe9f6325c243a490f361aa79295c36 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Requested vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
I20250830 07:55:02.496852 13886 tablet_bootstrap.cc:492] T 690cf258639a4c1ea5a0ac4f2fd39f88 P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:55:02.497052 13886 ts_tablet_manager.cc:1397] T 690cf258639a4c1ea5a0ac4f2fd39f88 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.029s user 0.002s sys 0.003s
I20250830 07:55:02.497555 13612 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "559fdab1ef804325978db705431a0ad8" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:55:02.499121 13612 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "508d21af038c4801a9680ce275eb504c" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:55:02.499837 13612 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "b85843ab0e3a40e1b453cfdd71bbae5e" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:55:02.501251 13701 leader_election.cc:304] T 55bd3f378b854476a24f657f5e23843d P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters:
I20250830 07:55:02.499902 13886 raft_consensus.cc:357] T 690cf258639a4c1ea5a0ac4f2fd39f88 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
W20250830 07:55:02.501844 13423 leader_election.cc:343] T 559fdab1ef804325978db705431a0ad8 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:55:02.501957 13886 raft_consensus.cc:383] T 690cf258639a4c1ea5a0ac4f2fd39f88 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20250830 07:55:02.502619 13423 leader_election.cc:343] T 508d21af038c4801a9680ce275eb504c P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
W20250830 07:55:02.503068 13423 leader_election.cc:343] T b85843ab0e3a40e1b453cfdd71bbae5e P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:55:02.503052 13624 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "fac764a2d269411c86b85ceeaec0b014" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:55:02.502633 13886 raft_consensus.cc:738] T 690cf258639a4c1ea5a0ac4f2fd39f88 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:55:02.505303 13886 consensus_queue.cc:260] T 690cf258639a4c1ea5a0ac4f2fd39f88 P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:02.501688 15720 raft_consensus.cc:2802] T 55bd3f378b854476a24f657f5e23843d P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:55:02.507727 15720 raft_consensus.cc:491] T 55bd3f378b854476a24f657f5e23843d P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:55:02.507805 15720 raft_consensus.cc:3058] T 55bd3f378b854476a24f657f5e23843d P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
W20250830 07:55:02.508526 13423 leader_election.cc:343] T fac764a2d269411c86b85ceeaec0b014 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:55:02.510222 15720 raft_consensus.cc:513] T 55bd3f378b854476a24f657f5e23843d P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:02.510717 15720 leader_election.cc:290] T 55bd3f378b854476a24f657f5e23843d P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Requested vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
I20250830 07:55:02.511029 16255 raft_consensus.cc:491] T 50dfc24a0b9645e4860cd99b1df3bd61 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:55:02.511147 16255 raft_consensus.cc:513] T 50dfc24a0b9645e4860cd99b1df3bd61 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:02.511755 16255 leader_election.cc:290] T 50dfc24a0b9645e4860cd99b1df3bd61 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:55:02.512373 13484 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "50dfc24a0b9645e4860cd99b1df3bd61" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:55:02.512591 13484 raft_consensus.cc:2391] T 50dfc24a0b9645e4860cd99b1df3bd61 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b5e454d98894637b466ea27f1b647f9 in current term 1: Already voted for candidate 9b057ade5dce45af9f8bf0bedf8b917f in this term.
I20250830 07:55:02.512957 13886 ts_tablet_manager.cc:1428] T 690cf258639a4c1ea5a0ac4f2fd39f88 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.015s user 0.001s sys 0.001s
W20250830 07:55:02.517084 13561 consensus_peers.cc:489] T 65f1ee59e6e9498381d686f16a865e23 P 6b5e454d98894637b466ea27f1b647f9 -> Peer 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): Couldn't send request to peer 2065c332f15a4739899af79f3669c3ba. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 65f1ee59e6e9498381d686f16a865e23. This is attempt 6: this message will repeat every 5th retry.
I20250830 07:55:02.516961 13886 tablet_bootstrap.cc:492] T e24d68b8f5ba4df59a9aeec8ebd6403d P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:55:02.517422 13882 tablet_bootstrap.cc:492] T b6717031830f4c57967e87ce077ddb21 P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:55:02.517525 13882 ts_tablet_manager.cc:1397] T b6717031830f4c57967e87ce077ddb21 P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.058s user 0.006s sys 0.000s
I20250830 07:55:02.518162 13882 raft_consensus.cc:357] T b6717031830f4c57967e87ce077ddb21 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:02.518306 13882 raft_consensus.cc:383] T b6717031830f4c57967e87ce077ddb21 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:55:02.518352 13882 raft_consensus.cc:738] T b6717031830f4c57967e87ce077ddb21 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:55:02.518529 13882 consensus_queue.cc:260] T b6717031830f4c57967e87ce077ddb21 P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:02.519034 13882 ts_tablet_manager.cc:1428] T b6717031830f4c57967e87ce077ddb21 P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20250830 07:55:02.526259 15919 raft_consensus.cc:491] T 9bc54e40f9eb4271aa3132986c249e51 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:55:02.526373 15919 raft_consensus.cc:513] T 9bc54e40f9eb4271aa3132986c249e51 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:02.526928 15919 leader_election.cc:290] T 9bc54e40f9eb4271aa3132986c249e51 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:55:02.528333 13886 tablet_bootstrap.cc:654] T e24d68b8f5ba4df59a9aeec8ebd6403d P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
W20250830 07:55:02.531037 13561 consensus_peers.cc:489] T f52dd8eeb64a4b8a92babf34387b6c5b P 6b5e454d98894637b466ea27f1b647f9 -> Peer 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): Couldn't send request to peer 2065c332f15a4739899af79f3669c3ba. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f52dd8eeb64a4b8a92babf34387b6c5b. This is attempt 6: this message will repeat every 5th retry.
I20250830 07:55:02.535079 13764 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "fac764a2d269411c86b85ceeaec0b014" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:55:02.535245 13887 tablet_bootstrap.cc:492] T b4c345013ff04cf991989f456aa2d420 P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:55:02.535380 13887 ts_tablet_manager.cc:1397] T b4c345013ff04cf991989f456aa2d420 P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.072s user 0.009s sys 0.009s
I20250830 07:55:02.535497 13764 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "559fdab1ef804325978db705431a0ad8" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:55:02.535919 13764 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "508d21af038c4801a9680ce275eb504c" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:55:02.536072 13764 raft_consensus.cc:2466] T 508d21af038c4801a9680ce275eb504c P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2065c332f15a4739899af79f3669c3ba in term 0.
I20250830 07:55:02.536270 13887 raft_consensus.cc:357] T b4c345013ff04cf991989f456aa2d420 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:02.536466 13887 raft_consensus.cc:383] T b4c345013ff04cf991989f456aa2d420 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:55:02.536514 13887 raft_consensus.cc:738] T b4c345013ff04cf991989f456aa2d420 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:55:02.536581 13764 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "b85843ab0e3a40e1b453cfdd71bbae5e" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:55:02.536697 13887 consensus_queue.cc:260] T b4c345013ff04cf991989f456aa2d420 P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:02.537312 13887 ts_tablet_manager.cc:1428] T b4c345013ff04cf991989f456aa2d420 P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20250830 07:55:02.537540 13887 tablet_bootstrap.cc:492] T d72ef294123b4bcdb8ff63af5de9c621 P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:55:02.539040 13887 tablet_bootstrap.cc:654] T d72ef294123b4bcdb8ff63af5de9c621 P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:55:02.541186 13886 tablet_bootstrap.cc:492] T e24d68b8f5ba4df59a9aeec8ebd6403d P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:55:02.541551 13482 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "ccc9091018cb48ffb2affd98e8bbfa05" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba"
I20250830 07:55:02.541702 13482 raft_consensus.cc:3058] T ccc9091018cb48ffb2affd98e8bbfa05 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:55:02.542269 13886 ts_tablet_manager.cc:1397] T e24d68b8f5ba4df59a9aeec8ebd6403d P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.026s user 0.004s sys 0.000s
I20250830 07:55:02.544049 13482 raft_consensus.cc:2466] T ccc9091018cb48ffb2affd98e8bbfa05 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 1.
I20250830 07:55:02.544876 13482 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "78fe9f6325c243a490f361aa79295c36" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba"
I20250830 07:55:02.545010 13482 raft_consensus.cc:3058] T 78fe9f6325c243a490f361aa79295c36 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:55:02.548022 13482 raft_consensus.cc:2466] T 78fe9f6325c243a490f361aa79295c36 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 1.
I20250830 07:55:02.547760 13886 raft_consensus.cc:357] T e24d68b8f5ba4df59a9aeec8ebd6403d P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:02.549340 13886 raft_consensus.cc:383] T e24d68b8f5ba4df59a9aeec8ebd6403d P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:55:02.550253 13886 raft_consensus.cc:738] T e24d68b8f5ba4df59a9aeec8ebd6403d P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:55:02.553267 13481 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "55bd3f378b854476a24f657f5e23843d" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba"
I20250830 07:55:02.553434 13481 raft_consensus.cc:3058] T 55bd3f378b854476a24f657f5e23843d P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:55:02.554327 13887 tablet_bootstrap.cc:492] T d72ef294123b4bcdb8ff63af5de9c621 P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:55:02.554453 13887 ts_tablet_manager.cc:1397] T d72ef294123b4bcdb8ff63af5de9c621 P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.017s user 0.002s sys 0.005s
W20250830 07:55:02.554503 13422 leader_election.cc:343] T fac764a2d269411c86b85ceeaec0b014 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:55:02.554591 13422 leader_election.cc:304] T fac764a2d269411c86b85ceeaec0b014 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba; no voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:55:02.554744 16081 raft_consensus.cc:2747] T fac764a2d269411c86b85ceeaec0b014 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20250830 07:55:02.555083 13422 leader_election.cc:343] T 559fdab1ef804325978db705431a0ad8 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:55:02.555176 13422 leader_election.cc:304] T 559fdab1ef804325978db705431a0ad8 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba; no voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:55:02.555203 13887 raft_consensus.cc:357] T d72ef294123b4bcdb8ff63af5de9c621 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:02.555356 13887 raft_consensus.cc:383] T d72ef294123b4bcdb8ff63af5de9c621 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:55:02.555404 13887 raft_consensus.cc:738] T d72ef294123b4bcdb8ff63af5de9c621 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:55:02.555619 13481 raft_consensus.cc:2466] T 55bd3f378b854476a24f657f5e23843d P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 1.
I20250830 07:55:02.555579 13887 consensus_queue.cc:260] T d72ef294123b4bcdb8ff63af5de9c621 P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:02.552493 13886 consensus_queue.cc:260] T e24d68b8f5ba4df59a9aeec8ebd6403d P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:02.560604 13886 ts_tablet_manager.cc:1428] T e24d68b8f5ba4df59a9aeec8ebd6403d P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.018s user 0.001s sys 0.001s
I20250830 07:55:02.563460 13619 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "9bc54e40f9eb4271aa3132986c249e51" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:55:02.567553 13886 tablet_bootstrap.cc:492] T b678fd915c534a2dac8521c21ab93396 P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:55:02.569677 13882 tablet_bootstrap.cc:492] T 135d754d83ad422eb05909d2daa19d34 P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:55:02.571372 13882 tablet_bootstrap.cc:654] T 135d754d83ad422eb05909d2daa19d34 P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
I20250830 07:55:02.575798 16081 raft_consensus.cc:2747] T 559fdab1ef804325978db705431a0ad8 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20250830 07:55:02.575924 13423 leader_election.cc:343] T 9bc54e40f9eb4271aa3132986c249e51 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:55:02.576081 13887 ts_tablet_manager.cc:1428] T d72ef294123b4bcdb8ff63af5de9c621 P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.022s user 0.002s sys 0.000s
I20250830 07:55:02.576349 13422 leader_election.cc:304] T 508d21af038c4801a9680ce275eb504c P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
W20250830 07:55:02.576737 13422 leader_election.cc:343] T b85843ab0e3a40e1b453cfdd71bbae5e P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:55:02.576876 13422 leader_election.cc:304] T b85843ab0e3a40e1b453cfdd71bbae5e P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba; no voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:55:02.577232 15919 raft_consensus.cc:2802] T 508d21af038c4801a9680ce275eb504c P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:55:02.577280 16072 raft_consensus.cc:2747] T b85843ab0e3a40e1b453cfdd71bbae5e P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:55:02.577301 15919 raft_consensus.cc:491] T 508d21af038c4801a9680ce275eb504c P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:55:02.577351 15919 raft_consensus.cc:3058] T 508d21af038c4801a9680ce275eb504c P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:55:02.577386 16072 consensus_queue.cc:1035] T 439fc51afa6b435e81bc38b9e88d4041 P 2065c332f15a4739899af79f3669c3ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:55:02.578141 13886 tablet_bootstrap.cc:654] T b678fd915c534a2dac8521c21ab93396 P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:55:02.579180 13887 tablet_bootstrap.cc:492] T dad2dfa1a19d45778933780b1029d924 P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:55:02.580663 13887 tablet_bootstrap.cc:654] T dad2dfa1a19d45778933780b1029d924 P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:55:02.581895 15919 raft_consensus.cc:513] T 508d21af038c4801a9680ce275eb504c P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:02.582580 15919 leader_election.cc:290] T 508d21af038c4801a9680ce275eb504c P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 election: Requested vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:55:02.584640 13619 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "508d21af038c4801a9680ce275eb504c" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9"
W20250830 07:55:02.585098 13423 leader_election.cc:343] T 508d21af038c4801a9680ce275eb504c P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:55:02.585734 13886 tablet_bootstrap.cc:492] T b678fd915c534a2dac8521c21ab93396 P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:55:02.586297 13886 ts_tablet_manager.cc:1397] T b678fd915c534a2dac8521c21ab93396 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.019s user 0.002s sys 0.002s
I20250830 07:55:02.590646 13886 raft_consensus.cc:357] T b678fd915c534a2dac8521c21ab93396 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:02.591604 13886 raft_consensus.cc:383] T b678fd915c534a2dac8521c21ab93396 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:55:02.592145 13886 raft_consensus.cc:738] T b678fd915c534a2dac8521c21ab93396 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:55:02.593690 13886 consensus_queue.cc:260] T b678fd915c534a2dac8521c21ab93396 P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:02.596478 13886 ts_tablet_manager.cc:1428] T b678fd915c534a2dac8521c21ab93396 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.010s user 0.001s sys 0.001s
I20250830 07:55:02.598413 13886 tablet_bootstrap.cc:492] T 7dc061ebaa334c109d1e457e2dc860df P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:55:02.609067 13701 leader_election.cc:304] T ccc9091018cb48ffb2affd98e8bbfa05 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters:
I20250830 07:55:02.609292 15980 raft_consensus.cc:2802] T ccc9091018cb48ffb2affd98e8bbfa05 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election won for term 1
I20250830 07:55:02.609369 15720 consensus_queue.cc:1035] T cd9903bdfaef4139a1a582c54689da4a P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:55:02.610095 13701 leader_election.cc:304] T 78fe9f6325c243a490f361aa79295c36 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters:
I20250830 07:55:02.610333 15720 raft_consensus.cc:2802] T 78fe9f6325c243a490f361aa79295c36 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election won for term 1
I20250830 07:55:02.610517 15980 raft_consensus.cc:695] T ccc9091018cb48ffb2affd98e8bbfa05 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 LEADER]: Becoming Leader. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Running, Role: LEADER
I20250830 07:55:02.610692 15720 raft_consensus.cc:695] T 78fe9f6325c243a490f361aa79295c36 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 LEADER]: Becoming Leader. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Running, Role: LEADER
I20250830 07:55:02.610773 15980 consensus_queue.cc:237] T ccc9091018cb48ffb2affd98e8bbfa05 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:02.611076 15720 consensus_queue.cc:237] T 78fe9f6325c243a490f361aa79295c36 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:02.612336 15751 consensus_queue.cc:1035] T 4b9d9d4b65964fd49d8e25092a14d774 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:55:02.614114 16259 consensus_queue.cc:1035] T d94215b0b1f142178f0b791518d1baf2 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:55:02.614656 13701 leader_election.cc:304] T 55bd3f378b854476a24f657f5e23843d P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters:
I20250830 07:55:02.615294 15863 raft_consensus.cc:2802] T 55bd3f378b854476a24f657f5e23843d P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election won for term 1
I20250830 07:55:02.621482 16079 raft_consensus.cc:491] T 6fb5cd3618584dd3a0ee43a10f7a2660 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:55:02.621596 16079 raft_consensus.cc:513] T 6fb5cd3618584dd3a0ee43a10f7a2660 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:02.622071 16079 leader_election.cc:290] T 6fb5cd3618584dd3a0ee43a10f7a2660 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:55:02.622601 13624 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "6fb5cd3618584dd3a0ee43a10f7a2660" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
W20250830 07:55:02.623006 13423 leader_election.cc:343] T 6fb5cd3618584dd3a0ee43a10f7a2660 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:55:02.627223 15863 raft_consensus.cc:695] T 55bd3f378b854476a24f657f5e23843d P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 LEADER]: Becoming Leader. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Running, Role: LEADER
I20250830 07:55:02.627799 15863 consensus_queue.cc:237] T 55bd3f378b854476a24f657f5e23843d P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:02.628103 13886 tablet_bootstrap.cc:654] T 7dc061ebaa334c109d1e457e2dc860df P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:55:02.633615 13764 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "9bc54e40f9eb4271aa3132986c249e51" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:55:02.637105 13882 tablet_bootstrap.cc:492] T 135d754d83ad422eb05909d2daa19d34 P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:55:02.637256 13882 ts_tablet_manager.cc:1397] T 135d754d83ad422eb05909d2daa19d34 P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.068s user 0.005s sys 0.005s
I20250830 07:55:02.638054 13882 raft_consensus.cc:357] T 135d754d83ad422eb05909d2daa19d34 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:02.638221 13882 raft_consensus.cc:383] T 135d754d83ad422eb05909d2daa19d34 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:55:02.638278 13882 raft_consensus.cc:738] T 135d754d83ad422eb05909d2daa19d34 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:55:02.638459 13882 consensus_queue.cc:260] T 135d754d83ad422eb05909d2daa19d34 P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:02.641090 13882 ts_tablet_manager.cc:1428] T 135d754d83ad422eb05909d2daa19d34 P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20250830 07:55:02.641352 13882 tablet_bootstrap.cc:492] T af449cc407c046eeb5cdfdacffc617a4 P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:55:02.642998 13882 tablet_bootstrap.cc:654] T af449cc407c046eeb5cdfdacffc617a4 P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
I20250830 07:55:02.644596 13887 tablet_bootstrap.cc:492] T dad2dfa1a19d45778933780b1029d924 P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:55:02.644721 13887 ts_tablet_manager.cc:1397] T dad2dfa1a19d45778933780b1029d924 P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.066s user 0.003s sys 0.006s
I20250830 07:55:02.645403 13887 raft_consensus.cc:357] T dad2dfa1a19d45778933780b1029d924 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:02.645546 13887 raft_consensus.cc:383] T dad2dfa1a19d45778933780b1029d924 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:55:02.645599 13887 raft_consensus.cc:738] T dad2dfa1a19d45778933780b1029d924 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:55:02.645768 13887 consensus_queue.cc:260] T dad2dfa1a19d45778933780b1029d924 P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:02.646186 13887 ts_tablet_manager.cc:1428] T dad2dfa1a19d45778933780b1029d924 P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20250830 07:55:02.646400 13887 tablet_bootstrap.cc:492] T 5dffbacf2fcd4a38a1d61cf5bb9c5eeb P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:55:02.648407 13887 tablet_bootstrap.cc:654] T 5dffbacf2fcd4a38a1d61cf5bb9c5eeb P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:55:02.649587 13764 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "508d21af038c4801a9680ce275eb504c" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f"
I20250830 07:55:02.649732 13764 raft_consensus.cc:3058] T 508d21af038c4801a9680ce275eb504c P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:55:02.652359 13764 raft_consensus.cc:2466] T 508d21af038c4801a9680ce275eb504c P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2065c332f15a4739899af79f3669c3ba in term 1.
I20250830 07:55:02.655472 13887 tablet_bootstrap.cc:492] T 5dffbacf2fcd4a38a1d61cf5bb9c5eeb P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:55:02.655584 13887 ts_tablet_manager.cc:1397] T 5dffbacf2fcd4a38a1d61cf5bb9c5eeb P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.009s user 0.000s sys 0.003s
I20250830 07:55:02.656227 13887 raft_consensus.cc:357] T 5dffbacf2fcd4a38a1d61cf5bb9c5eeb P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:02.656378 13887 raft_consensus.cc:383] T 5dffbacf2fcd4a38a1d61cf5bb9c5eeb P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:55:02.656432 13887 raft_consensus.cc:738] T 5dffbacf2fcd4a38a1d61cf5bb9c5eeb P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:55:02.656652 13886 tablet_bootstrap.cc:492] T 7dc061ebaa334c109d1e457e2dc860df P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:55:02.656606 13887 consensus_queue.cc:260] T 5dffbacf2fcd4a38a1d61cf5bb9c5eeb P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:02.656774 13886 ts_tablet_manager.cc:1397] T 7dc061ebaa334c109d1e457e2dc860df P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.059s user 0.001s sys 0.007s
I20250830 07:55:02.657028 13887 ts_tablet_manager.cc:1428] T 5dffbacf2fcd4a38a1d61cf5bb9c5eeb P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20250830 07:55:02.657260 13887 tablet_bootstrap.cc:492] T b678fd915c534a2dac8521c21ab93396 P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:55:02.657366 13886 raft_consensus.cc:357] T 7dc061ebaa334c109d1e457e2dc860df P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:02.657506 13886 raft_consensus.cc:383] T 7dc061ebaa334c109d1e457e2dc860df P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:55:02.657559 13886 raft_consensus.cc:738] T 7dc061ebaa334c109d1e457e2dc860df P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:55:02.657727 13886 consensus_queue.cc:260] T 7dc061ebaa334c109d1e457e2dc860df P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:02.658161 13886 ts_tablet_manager.cc:1428] T 7dc061ebaa334c109d1e457e2dc860df P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20250830 07:55:02.658398 13886 tablet_bootstrap.cc:492] T 4639d1b6add8447c9ce071af71a99869 P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:55:02.658650 13887 tablet_bootstrap.cc:654] T b678fd915c534a2dac8521c21ab93396 P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:55:02.660048 13886 tablet_bootstrap.cc:654] T 4639d1b6add8447c9ce071af71a99869 P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:55:02.660238 13882 tablet_bootstrap.cc:492] T af449cc407c046eeb5cdfdacffc617a4 P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:55:02.660337 13882 ts_tablet_manager.cc:1397] T af449cc407c046eeb5cdfdacffc617a4 P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.019s user 0.000s sys 0.003s
I20250830 07:55:02.660957 13882 raft_consensus.cc:357] T af449cc407c046eeb5cdfdacffc617a4 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:02.661110 13882 raft_consensus.cc:383] T af449cc407c046eeb5cdfdacffc617a4 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:55:02.661165 13882 raft_consensus.cc:738] T af449cc407c046eeb5cdfdacffc617a4 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:55:02.661382 13882 consensus_queue.cc:260] T af449cc407c046eeb5cdfdacffc617a4 P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:02.661933 13882 ts_tablet_manager.cc:1428] T af449cc407c046eeb5cdfdacffc617a4 P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20250830 07:55:02.662168 13882 tablet_bootstrap.cc:492] T ccc9091018cb48ffb2affd98e8bbfa05 P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:55:02.663995 13882 tablet_bootstrap.cc:654] T ccc9091018cb48ffb2affd98e8bbfa05 P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
I20250830 07:55:02.667744 13887 tablet_bootstrap.cc:492] T b678fd915c534a2dac8521c21ab93396 P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:55:02.667857 13887 ts_tablet_manager.cc:1397] T b678fd915c534a2dac8521c21ab93396 P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.011s user 0.002s sys 0.000s
I20250830 07:55:02.668459 13887 raft_consensus.cc:357] T b678fd915c534a2dac8521c21ab93396 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:02.668597 13887 raft_consensus.cc:383] T b678fd915c534a2dac8521c21ab93396 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:55:02.668654 13887 raft_consensus.cc:738] T b678fd915c534a2dac8521c21ab93396 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:55:02.668814 13887 consensus_queue.cc:260] T b678fd915c534a2dac8521c21ab93396 P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:02.669344 13887 ts_tablet_manager.cc:1428] T b678fd915c534a2dac8521c21ab93396 P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20250830 07:55:02.669746 13887 tablet_bootstrap.cc:492] T 2d91b0ba74034b85812a13719e21dc6c P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:55:02.670727 16349 raft_consensus.cc:491] T 6f8b6f233e5c49b39b3ef6314508e9d9 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:55:02.670850 16349 raft_consensus.cc:513] T 6f8b6f233e5c49b39b3ef6314508e9d9 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:02.671391 16349 leader_election.cc:290] T 6f8b6f233e5c49b39b3ef6314508e9d9 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:55:02.671742 13624 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "6f8b6f233e5c49b39b3ef6314508e9d9" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
W20250830 07:55:02.672217 13423 leader_election.cc:343] T 6f8b6f233e5c49b39b3ef6314508e9d9 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:55:02.676143 13886 tablet_bootstrap.cc:492] T 4639d1b6add8447c9ce071af71a99869 P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:55:02.676265 13886 ts_tablet_manager.cc:1397] T 4639d1b6add8447c9ce071af71a99869 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.018s user 0.002s sys 0.000s
I20250830 07:55:02.676862 13886 raft_consensus.cc:357] T 4639d1b6add8447c9ce071af71a99869 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:02.677000 13886 raft_consensus.cc:383] T 4639d1b6add8447c9ce071af71a99869 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:55:02.677050 13886 raft_consensus.cc:738] T 4639d1b6add8447c9ce071af71a99869 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:55:02.677227 13886 consensus_queue.cc:260] T 4639d1b6add8447c9ce071af71a99869 P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:02.677665 13886 ts_tablet_manager.cc:1428] T 4639d1b6add8447c9ce071af71a99869 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20250830 07:55:02.677874 13886 tablet_bootstrap.cc:492] T 0c32e597f17e4e75a0f584b6b7b02c36 P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:55:02.680474 13886 tablet_bootstrap.cc:654] T 0c32e597f17e4e75a0f584b6b7b02c36 P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:55:02.682060 13882 tablet_bootstrap.cc:492] T ccc9091018cb48ffb2affd98e8bbfa05 P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:55:02.682178 13882 ts_tablet_manager.cc:1397] T ccc9091018cb48ffb2affd98e8bbfa05 P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.020s user 0.003s sys 0.000s
I20250830 07:55:02.683053 13882 raft_consensus.cc:357] T ccc9091018cb48ffb2affd98e8bbfa05 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:02.683218 13882 raft_consensus.cc:383] T ccc9091018cb48ffb2affd98e8bbfa05 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:55:02.683269 13882 raft_consensus.cc:738] T ccc9091018cb48ffb2affd98e8bbfa05 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
W20250830 07:55:02.685830 13703 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.209.2:38967, user_credentials={real_user=slave}} blocked reactor thread for 128929us
W20250830 07:55:02.689070 13703 leader_election.cc:343] T ccc9091018cb48ffb2affd98e8bbfa05 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
W20250830 07:55:02.689405 13703 consensus_peers.cc:489] T d94215b0b1f142178f0b791518d1baf2 P 9b057ade5dce45af9f8bf0bedf8b917f -> Peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Couldn't send request to peer 6b5e454d98894637b466ea27f1b647f9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20250830 07:55:02.692178 13703 leader_election.cc:343] T 55bd3f378b854476a24f657f5e23843d P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:55:02.692937 13882 consensus_queue.cc:260] T ccc9091018cb48ffb2affd98e8bbfa05 P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:02.696918 13882 ts_tablet_manager.cc:1428] T ccc9091018cb48ffb2affd98e8bbfa05 P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.015s user 0.002s sys 0.000s
I20250830 07:55:02.697183 13882 tablet_bootstrap.cc:492] T d94215b0b1f142178f0b791518d1baf2 P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:55:02.698642 13886 tablet_bootstrap.cc:492] T 0c32e597f17e4e75a0f584b6b7b02c36 P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:55:02.698808 13882 tablet_bootstrap.cc:654] T d94215b0b1f142178f0b791518d1baf2 P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
I20250830 07:55:02.698822 13886 ts_tablet_manager.cc:1397] T 0c32e597f17e4e75a0f584b6b7b02c36 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.021s user 0.004s sys 0.000s
I20250830 07:55:02.701215 13887 tablet_bootstrap.cc:654] T 2d91b0ba74034b85812a13719e21dc6c P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
W20250830 07:55:02.708331 13422 leader_election.cc:343] T 9bc54e40f9eb4271aa3132986c249e51 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:55:02.708438 13422 leader_election.cc:304] T 9bc54e40f9eb4271aa3132986c249e51 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba; no voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:55:02.708640 16349 raft_consensus.cc:2747] T 9bc54e40f9eb4271aa3132986c249e51 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:55:02.713205 16079 consensus_queue.cc:1035] T 2aea1a69d22544899b0218be7e0f8799 P 2065c332f15a4739899af79f3669c3ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:55:02.713754 13422 leader_election.cc:304] T 508d21af038c4801a9680ce275eb504c P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:55:02.714286 13886 raft_consensus.cc:357] T 0c32e597f17e4e75a0f584b6b7b02c36 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:02.714429 13886 raft_consensus.cc:383] T 0c32e597f17e4e75a0f584b6b7b02c36 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:55:02.714476 13886 raft_consensus.cc:738] T 0c32e597f17e4e75a0f584b6b7b02c36 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:55:02.714612 13886 consensus_queue.cc:260] T 0c32e597f17e4e75a0f584b6b7b02c36 P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:02.715046 13886 ts_tablet_manager.cc:1428] T 0c32e597f17e4e75a0f584b6b7b02c36 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.016s user 0.001s sys 0.000s
I20250830 07:55:02.715299 13886 tablet_bootstrap.cc:492] T 4df6d481baab40e2b2c1309d1a8c5351 P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:55:02.715404 13887 tablet_bootstrap.cc:492] T 2d91b0ba74034b85812a13719e21dc6c P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:55:02.715528 13887 ts_tablet_manager.cc:1397] T 2d91b0ba74034b85812a13719e21dc6c P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.046s user 0.005s sys 0.001s
I20250830 07:55:02.716523 13886 tablet_bootstrap.cc:654] T 4df6d481baab40e2b2c1309d1a8c5351 P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:55:02.717240 16079 raft_consensus.cc:2802] T 508d21af038c4801a9680ce275eb504c P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election won for term 1
I20250830 07:55:02.717370 16079 raft_consensus.cc:695] T 508d21af038c4801a9680ce275eb504c P 2065c332f15a4739899af79f3669c3ba [term 1 LEADER]: Becoming Leader. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Running, Role: LEADER
I20250830 07:55:02.717446 13887 raft_consensus.cc:357] T 2d91b0ba74034b85812a13719e21dc6c P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:02.717585 13887 raft_consensus.cc:383] T 2d91b0ba74034b85812a13719e21dc6c P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:55:02.717643 13887 raft_consensus.cc:738] T 2d91b0ba74034b85812a13719e21dc6c P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:55:02.717664 16079 consensus_queue.cc:237] T 508d21af038c4801a9680ce275eb504c P 2065c332f15a4739899af79f3669c3ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:02.717778 13887 consensus_queue.cc:260] T 2d91b0ba74034b85812a13719e21dc6c P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:02.718212 13887 ts_tablet_manager.cc:1428] T 2d91b0ba74034b85812a13719e21dc6c P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.003s user 0.000s sys 0.000s
I20250830 07:55:02.718427 13887 tablet_bootstrap.cc:492] T d075a38c613c46398ec533c1e00a24c6 P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:55:02.720106 13882 tablet_bootstrap.cc:492] T d94215b0b1f142178f0b791518d1baf2 P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:55:02.720216 13882 ts_tablet_manager.cc:1397] T d94215b0b1f142178f0b791518d1baf2 P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.023s user 0.005s sys 0.000s
I20250830 07:55:02.720865 13882 raft_consensus.cc:357] T d94215b0b1f142178f0b791518d1baf2 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:02.721024 13882 raft_consensus.cc:383] T d94215b0b1f142178f0b791518d1baf2 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:55:02.721073 13882 raft_consensus.cc:738] T d94215b0b1f142178f0b791518d1baf2 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:55:02.721244 13882 consensus_queue.cc:260] T d94215b0b1f142178f0b791518d1baf2 P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:02.721750 13882 ts_tablet_manager.cc:1428] T d94215b0b1f142178f0b791518d1baf2 P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20250830 07:55:02.721997 13882 tablet_bootstrap.cc:492] T cd9903bdfaef4139a1a582c54689da4a P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:55:02.723594 13882 tablet_bootstrap.cc:654] T cd9903bdfaef4139a1a582c54689da4a P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
I20250830 07:55:02.724665 15365 consensus_queue.cc:1035] T 3f70097c1b3a48dfbc1ad129fa7a3730 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:55:02.724854 13887 tablet_bootstrap.cc:654] T d075a38c613c46398ec533c1e00a24c6 P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:55:02.729929 16101 consensus_queue.cc:1035] T d1d5e0d40a91457da65a0e925289309e P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:55:02.731516 13624 raft_consensus.cc:3058] T 50dfc24a0b9645e4860cd99b1df3bd61 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:55:02.733037 13771 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "6fb5cd3618584dd3a0ee43a10f7a2660" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:55:02.735230 13882 tablet_bootstrap.cc:492] T cd9903bdfaef4139a1a582c54689da4a P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:55:02.735409 13882 ts_tablet_manager.cc:1397] T cd9903bdfaef4139a1a582c54689da4a P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.013s user 0.003s sys 0.000s
I20250830 07:55:02.738281 13619 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "ccc9091018cb48ffb2affd98e8bbfa05" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9"
I20250830 07:55:02.738314 16349 raft_consensus.cc:491] T e24d68b8f5ba4df59a9aeec8ebd6403d P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:55:02.738436 13619 raft_consensus.cc:3058] T ccc9091018cb48ffb2affd98e8bbfa05 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:55:02.738427 16349 raft_consensus.cc:513] T e24d68b8f5ba4df59a9aeec8ebd6403d P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:02.738894 16349 leader_election.cc:290] T e24d68b8f5ba4df59a9aeec8ebd6403d P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:55:02.739991 13611 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "55bd3f378b854476a24f657f5e23843d" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9"
I20250830 07:55:02.740060 13886 tablet_bootstrap.cc:492] T 4df6d481baab40e2b2c1309d1a8c5351 P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:55:02.740239 13886 ts_tablet_manager.cc:1397] T 4df6d481baab40e2b2c1309d1a8c5351 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.025s user 0.005s sys 0.002s
I20250830 07:55:02.740790 13619 raft_consensus.cc:2466] T ccc9091018cb48ffb2affd98e8bbfa05 P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 1.
I20250830 07:55:02.741089 13612 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "78fe9f6325c243a490f361aa79295c36" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9"
I20250830 07:55:02.741344 13886 raft_consensus.cc:357] T 4df6d481baab40e2b2c1309d1a8c5351 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:02.741612 13886 raft_consensus.cc:383] T 4df6d481baab40e2b2c1309d1a8c5351 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:55:02.741794 13886 raft_consensus.cc:738] T 4df6d481baab40e2b2c1309d1a8c5351 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:55:02.742084 13886 consensus_queue.cc:260] T 4df6d481baab40e2b2c1309d1a8c5351 P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:02.742208 13619 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "e24d68b8f5ba4df59a9aeec8ebd6403d" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
W20250830 07:55:02.742604 13423 leader_election.cc:343] T e24d68b8f5ba4df59a9aeec8ebd6403d P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:55:02.742835 13886 ts_tablet_manager.cc:1428] T 4df6d481baab40e2b2c1309d1a8c5351 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20250830 07:55:02.743233 13886 tablet_bootstrap.cc:492] T 11042d702d4048c99644f0f06a6212d6 P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:55:02.744446 13619 raft_consensus.cc:3058] T 34199145292d4ddb8c603e5c581f1d15 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:55:02.744773 13771 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "6f8b6f233e5c49b39b3ef6314508e9d9" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:55:02.753916 13611 raft_consensus.cc:3058] T 0c70140d87d34bde919714f08a5c94d4 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:55:02.759145 13629 raft_consensus.cc:3058] T 8c01157324ba45bda5b3a9a328bf319b P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:55:02.759433 13886 tablet_bootstrap.cc:654] T 11042d702d4048c99644f0f06a6212d6 P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:55:02.766057 13617 raft_consensus.cc:1273] T 6ccbaf109e36453ea6645dfd090f5a1a P 6b5e454d98894637b466ea27f1b647f9 [term 2 FOLLOWER]: Refusing update from remote peer 9b057ade5dce45af9f8bf0bedf8b917f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20250830 07:55:02.769994 13882 raft_consensus.cc:357] T cd9903bdfaef4139a1a582c54689da4a P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:02.770154 13882 raft_consensus.cc:383] T cd9903bdfaef4139a1a582c54689da4a P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:55:02.770221 13882 raft_consensus.cc:738] T cd9903bdfaef4139a1a582c54689da4a P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:55:02.770776 13882 consensus_queue.cc:260] T cd9903bdfaef4139a1a582c54689da4a P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:02.780239 13771 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "50dfc24a0b9645e4860cd99b1df3bd61" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:55:02.780678 13882 ts_tablet_manager.cc:1428] T cd9903bdfaef4139a1a582c54689da4a P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.045s user 0.001s sys 0.000s
W20250830 07:55:02.781186 13422 leader_election.cc:343] T 6fb5cd3618584dd3a0ee43a10f7a2660 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:55:02.781324 13422 leader_election.cc:304] T 6fb5cd3618584dd3a0ee43a10f7a2660 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba; no voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:55:02.781911 16349 raft_consensus.cc:2747] T 6fb5cd3618584dd3a0ee43a10f7a2660 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:55:02.783282 13887 tablet_bootstrap.cc:492] T d075a38c613c46398ec533c1e00a24c6 P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:55:02.783406 13887 ts_tablet_manager.cc:1397] T d075a38c613c46398ec533c1e00a24c6 P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.065s user 0.003s sys 0.001s
I20250830 07:55:02.784422 13887 raft_consensus.cc:357] T d075a38c613c46398ec533c1e00a24c6 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:02.784592 13887 raft_consensus.cc:383] T d075a38c613c46398ec533c1e00a24c6 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:55:02.784664 13887 raft_consensus.cc:738] T d075a38c613c46398ec533c1e00a24c6 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:55:02.784866 13887 consensus_queue.cc:260] T d075a38c613c46398ec533c1e00a24c6 P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:02.785334 13887 ts_tablet_manager.cc:1428] T d075a38c613c46398ec533c1e00a24c6 P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20250830 07:55:02.785518 16101 raft_consensus.cc:491] T 7dc061ebaa334c109d1e457e2dc860df P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:55:02.785677 16101 raft_consensus.cc:513] T 7dc061ebaa334c109d1e457e2dc860df P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:02.786170 16101 leader_election.cc:290] T 7dc061ebaa334c109d1e457e2dc860df P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
I20250830 07:55:02.786299 13887 tablet_bootstrap.cc:492] T 11042d702d4048c99644f0f06a6212d6 P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:55:02.788348 16079 raft_consensus.cc:491] T d72ef294123b4bcdb8ff63af5de9c621 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:55:02.788465 16079 raft_consensus.cc:513] T d72ef294123b4bcdb8ff63af5de9c621 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:02.788941 16079 leader_election.cc:290] T d72ef294123b4bcdb8ff63af5de9c621 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:55:02.789582 13887 tablet_bootstrap.cc:654] T 11042d702d4048c99644f0f06a6212d6 P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
W20250830 07:55:02.792582 13422 leader_election.cc:343] T 6f8b6f233e5c49b39b3ef6314508e9d9 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:55:02.792809 13611 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "d72ef294123b4bcdb8ff63af5de9c621" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:55:02.792883 13617 raft_consensus.cc:3058] T ba4e1fccb8f046d6b63afe67c1f9d538 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Advancing to term 1
W20250830 07:55:02.793247 13423 leader_election.cc:343] T d72ef294123b4bcdb8ff63af5de9c621 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:55:02.794293 13422 leader_election.cc:304] T 6f8b6f233e5c49b39b3ef6314508e9d9 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba; no voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:55:02.795027 16349 raft_consensus.cc:2747] T 6f8b6f233e5c49b39b3ef6314508e9d9 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:55:02.795492 13562 leader_election.cc:304] T 50dfc24a0b9645e4860cd99b1df3bd61 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b5e454d98894637b466ea27f1b647f9; no voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:55:02.795717 16074 raft_consensus.cc:2747] T 50dfc24a0b9645e4860cd99b1df3bd61 P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:55:02.803220 13771 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "e24d68b8f5ba4df59a9aeec8ebd6403d" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:55:02.803364 13771 raft_consensus.cc:2466] T e24d68b8f5ba4df59a9aeec8ebd6403d P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2065c332f15a4739899af79f3669c3ba in term 0.
I20250830 07:55:02.803273 13882 tablet_bootstrap.cc:492] T f479eef0171c401bbd27beec4486a8b2 P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:55:02.804836 15863 raft_consensus.cc:491] T e7e9d2e9b1ca4ddfb0c6a7bced613c35 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:55:02.805042 15863 raft_consensus.cc:513] T e7e9d2e9b1ca4ddfb0c6a7bced613c35 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:02.805593 15863 leader_election.cc:290] T e7e9d2e9b1ca4ddfb0c6a7bced613c35 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
I20250830 07:55:02.807956 15863 raft_consensus.cc:491] T 370441c443be46c2a33132fbc5c41f89 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:55:02.808104 15863 raft_consensus.cc:513] T 370441c443be46c2a33132fbc5c41f89 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:02.808507 15863 leader_election.cc:290] T 370441c443be46c2a33132fbc5c41f89 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967)
I20250830 07:55:02.811035 16079 raft_consensus.cc:491] T b678fd915c534a2dac8521c21ab93396 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:55:02.811175 16079 raft_consensus.cc:513] T b678fd915c534a2dac8521c21ab93396 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:02.811686 16079 leader_election.cc:290] T b678fd915c534a2dac8521c21ab93396 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:55:02.829267 13473 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "7dc061ebaa334c109d1e457e2dc860df" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:55:02.829443 13473 raft_consensus.cc:2466] T 7dc061ebaa334c109d1e457e2dc860df P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 0.
I20250830 07:55:02.830439 13624 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "b678fd915c534a2dac8521c21ab93396" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:55:02.830498 13473 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "e7e9d2e9b1ca4ddfb0c6a7bced613c35" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:55:02.830669 13473 raft_consensus.cc:2466] T e7e9d2e9b1ca4ddfb0c6a7bced613c35 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 0.
I20250830 07:55:02.831019 13473 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "370441c443be46c2a33132fbc5c41f89" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
W20250830 07:55:02.831483 13423 leader_election.cc:343] T b678fd915c534a2dac8521c21ab93396 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:55:02.831892 16079 consensus_queue.cc:1035] T 2aea1a69d22544899b0218be7e0f8799 P 2065c332f15a4739899af79f3669c3ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:55:02.839108 13422 leader_election.cc:304] T e24d68b8f5ba4df59a9aeec8ebd6403d P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:55:02.839661 13886 tablet_bootstrap.cc:492] T 11042d702d4048c99644f0f06a6212d6 P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:55:02.840000 16349 raft_consensus.cc:2802] T e24d68b8f5ba4df59a9aeec8ebd6403d P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:55:02.840083 16349 raft_consensus.cc:491] T e24d68b8f5ba4df59a9aeec8ebd6403d P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:55:02.840160 16349 raft_consensus.cc:3058] T e24d68b8f5ba4df59a9aeec8ebd6403d P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:55:02.840188 13886 ts_tablet_manager.cc:1397] T 11042d702d4048c99644f0f06a6212d6 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.097s user 0.004s sys 0.004s
I20250830 07:55:02.841291 16079 raft_consensus.cc:491] T b6717031830f4c57967e87ce077ddb21 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:55:02.841331 15751 consensus_queue.cc:1035] T 50dfc24a0b9645e4860cd99b1df3bd61 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20250830 07:55:02.841410 13703 leader_election.cc:343] T 55bd3f378b854476a24f657f5e23843d P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:55:02.841413 16079 raft_consensus.cc:513] T b6717031830f4c57967e87ce077ddb21 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:02.841892 16079 leader_election.cc:290] T b6717031830f4c57967e87ce077ddb21 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:55:02.842741 16349 raft_consensus.cc:513] T e24d68b8f5ba4df59a9aeec8ebd6403d P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:02.843289 16349 leader_election.cc:290] T e24d68b8f5ba4df59a9aeec8ebd6403d P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 election: Requested vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:55:02.844343 15863 consensus_queue.cc:1035] T a36f38ada7314165a5e9d6ee7bbf69e3 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:55:02.844493 13624 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "7dc061ebaa334c109d1e457e2dc860df" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:55:02.845405 16385 raft_consensus.cc:491] T 00000000000000000000000000000000 P 3ea183a890b84f408b20b55e9eb7c7ed [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:55:02.845584 16385 raft_consensus.cc:513] T 00000000000000000000000000000000 P 3ea183a890b84f408b20b55e9eb7c7ed [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fea6152429cc4e79a25b18e02aafae57" member_type: VOTER last_known_addr { host: "127.12.209.62" port: 39725 } } peers { permanent_uuid: "5e9d6449ae824acab24c459a72075e88" member_type: VOTER last_known_addr { host: "127.12.209.61" port: 44241 } } peers { permanent_uuid: "3ea183a890b84f408b20b55e9eb7c7ed" member_type: VOTER last_known_addr { host: "127.12.209.60" port: 43889 } }
I20250830 07:55:02.846316 16385 leader_election.cc:290] T 00000000000000000000000000000000 P 3ea183a890b84f408b20b55e9eb7c7ed [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fea6152429cc4e79a25b18e02aafae57 (127.12.209.62:39725), 5e9d6449ae824acab24c459a72075e88 (127.12.209.61:44241)
W20250830 07:55:02.847213 13703 leader_election.cc:343] T 78fe9f6325c243a490f361aa79295c36 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
W20250830 07:55:02.852587 13703 consensus_peers.cc:489] T a36f38ada7314165a5e9d6ee7bbf69e3 P 9b057ade5dce45af9f8bf0bedf8b917f -> Peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Couldn't send request to peer 6b5e454d98894637b466ea27f1b647f9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20250830 07:55:02.859404 13882 tablet_bootstrap.cc:654] T f479eef0171c401bbd27beec4486a8b2 P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
I20250830 07:55:02.862275 13887 tablet_bootstrap.cc:492] T 11042d702d4048c99644f0f06a6212d6 P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:55:02.862412 13887 ts_tablet_manager.cc:1397] T 11042d702d4048c99644f0f06a6212d6 P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.076s user 0.002s sys 0.010s
I20250830 07:55:02.862401 13619 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "b6717031830f4c57967e87ce077ddb21" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:55:02.862540 13619 raft_consensus.cc:2466] T b6717031830f4c57967e87ce077ddb21 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2065c332f15a4739899af79f3669c3ba in term 0.
I20250830 07:55:02.863034 13619 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "e24d68b8f5ba4df59a9aeec8ebd6403d" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9"
I20250830 07:55:02.863063 13887 raft_consensus.cc:357] T 11042d702d4048c99644f0f06a6212d6 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:02.863240 13887 raft_consensus.cc:383] T 11042d702d4048c99644f0f06a6212d6 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:55:02.863322 13887 raft_consensus.cc:738] T 11042d702d4048c99644f0f06a6212d6 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:55:02.863648 13887 consensus_queue.cc:260] T 11042d702d4048c99644f0f06a6212d6 P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:02.864343 13423 leader_election.cc:304] T b6717031830f4c57967e87ce077ddb21 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 6b5e454d98894637b466ea27f1b647f9; no voters:
W20250830 07:55:02.864611 13423 leader_election.cc:343] T e24d68b8f5ba4df59a9aeec8ebd6403d P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:55:02.864938 15919 raft_consensus.cc:2802] T b6717031830f4c57967e87ce077ddb21 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:55:02.865041 15919 raft_consensus.cc:491] T b6717031830f4c57967e87ce077ddb21 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:55:02.865118 15919 raft_consensus.cc:3058] T b6717031830f4c57967e87ce077ddb21 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:55:02.867506 15919 raft_consensus.cc:513] T b6717031830f4c57967e87ce077ddb21 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:02.867940 15919 leader_election.cc:290] T b6717031830f4c57967e87ce077ddb21 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 election: Requested vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:55:02.868566 13887 ts_tablet_manager.cc:1428] T 11042d702d4048c99644f0f06a6212d6 P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
I20250830 07:55:02.868566 13619 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "b6717031830f4c57967e87ce077ddb21" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9"
I20250830 07:55:02.868788 13619 raft_consensus.cc:3058] T b6717031830f4c57967e87ce077ddb21 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:55:02.868850 13887 tablet_bootstrap.cc:492] T 4df6d481baab40e2b2c1309d1a8c5351 P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:55:02.870237 13887 tablet_bootstrap.cc:654] T 4df6d481baab40e2b2c1309d1a8c5351 P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:55:02.871330 13619 raft_consensus.cc:2466] T b6717031830f4c57967e87ce077ddb21 P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2065c332f15a4739899af79f3669c3ba in term 1.
I20250830 07:55:02.871896 13423 leader_election.cc:304] T b6717031830f4c57967e87ce077ddb21 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 6b5e454d98894637b466ea27f1b647f9; no voters:
I20250830 07:55:02.872135 16079 raft_consensus.cc:2802] T b6717031830f4c57967e87ce077ddb21 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election won for term 1
I20250830 07:55:02.872249 16079 raft_consensus.cc:695] T b6717031830f4c57967e87ce077ddb21 P 2065c332f15a4739899af79f3669c3ba [term 1 LEADER]: Becoming Leader. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Running, Role: LEADER
I20250830 07:55:02.872493 16079 consensus_queue.cc:237] T b6717031830f4c57967e87ce077ddb21 P 2065c332f15a4739899af79f3669c3ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:02.874272 15751 raft_consensus.cc:491] T 283aa82b808e49528ceb19133748ffc8 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:55:02.874380 15751 raft_consensus.cc:513] T 283aa82b808e49528ceb19133748ffc8 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:02.874845 15751 leader_election.cc:290] T 283aa82b808e49528ceb19133748ffc8 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
I20250830 07:55:02.876003 13887 tablet_bootstrap.cc:492] T 4df6d481baab40e2b2c1309d1a8c5351 P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:55:02.876231 13887 ts_tablet_manager.cc:1397] T 4df6d481baab40e2b2c1309d1a8c5351 P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.007s user 0.001s sys 0.002s
I20250830 07:55:02.876353 13701 leader_election.cc:304] T 7dc061ebaa334c109d1e457e2dc860df P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters:
I20250830 07:55:02.877089 13887 raft_consensus.cc:357] T 4df6d481baab40e2b2c1309d1a8c5351 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:02.877246 13887 raft_consensus.cc:383] T 4df6d481baab40e2b2c1309d1a8c5351 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:55:02.877326 13887 raft_consensus.cc:738] T 4df6d481baab40e2b2c1309d1a8c5351 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:55:02.877586 13887 consensus_queue.cc:260] T 4df6d481baab40e2b2c1309d1a8c5351 P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:02.878075 13887 ts_tablet_manager.cc:1428] T 4df6d481baab40e2b2c1309d1a8c5351 P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20250830 07:55:02.878295 15603 raft_consensus.cc:2802] T 7dc061ebaa334c109d1e457e2dc860df P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:55:02.878365 15603 raft_consensus.cc:491] T 7dc061ebaa334c109d1e457e2dc860df P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:55:02.878422 15603 raft_consensus.cc:3058] T 7dc061ebaa334c109d1e457e2dc860df P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
W20250830 07:55:02.879194 14992 leader_election.cc:336] T 00000000000000000000000000000000 P 3ea183a890b84f408b20b55e9eb7c7ed [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer fea6152429cc4e79a25b18e02aafae57 (127.12.209.62:39725): Network error: Client connection negotiation failed: client connection to 127.12.209.62:39725: connect: Connection refused (error 111)
I20250830 07:55:02.880134 15751 consensus_queue.cc:1035] T 6ccbaf109e36453ea6645dfd090f5a1a P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:55:02.880733 15603 raft_consensus.cc:513] T 7dc061ebaa334c109d1e457e2dc860df P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:02.881227 15603 leader_election.cc:290] T 7dc061ebaa334c109d1e457e2dc860df P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Requested vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
I20250830 07:55:02.882867 13886 raft_consensus.cc:357] T 11042d702d4048c99644f0f06a6212d6 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:02.883006 13886 raft_consensus.cc:383] T 11042d702d4048c99644f0f06a6212d6 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:55:02.883051 13886 raft_consensus.cc:738] T 11042d702d4048c99644f0f06a6212d6 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:55:02.883219 13701 leader_election.cc:304] T e7e9d2e9b1ca4ddfb0c6a7bced613c35 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters:
I20250830 07:55:02.883420 15980 raft_consensus.cc:2802] T e7e9d2e9b1ca4ddfb0c6a7bced613c35 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:55:02.883479 15980 raft_consensus.cc:491] T e7e9d2e9b1ca4ddfb0c6a7bced613c35 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:55:02.883536 15980 raft_consensus.cc:3058] T e7e9d2e9b1ca4ddfb0c6a7bced613c35 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:55:02.883349 13886 consensus_queue.cc:260] T 11042d702d4048c99644f0f06a6212d6 P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:02.884615 13886 ts_tablet_manager.cc:1428] T 11042d702d4048c99644f0f06a6212d6 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.044s user 0.001s sys 0.000s
I20250830 07:55:02.884835 13886 tablet_bootstrap.cc:492] T d7afb311a699495aa8376db6ab206d94 P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:55:02.885896 15980 raft_consensus.cc:513] T e7e9d2e9b1ca4ddfb0c6a7bced613c35 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:02.886349 15980 leader_election.cc:290] T e7e9d2e9b1ca4ddfb0c6a7bced613c35 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Requested vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
W20250830 07:55:02.886754 13701 leader_election.cc:343] T 370441c443be46c2a33132fbc5c41f89 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:55:02.887488 13886 tablet_bootstrap.cc:654] T d7afb311a699495aa8376db6ab206d94 P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:55:02.888988 13771 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "d72ef294123b4bcdb8ff63af5de9c621" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:55:02.890362 13771 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "b678fd915c534a2dac8521c21ab93396" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:55:02.890488 13771 raft_consensus.cc:2466] T b678fd915c534a2dac8521c21ab93396 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2065c332f15a4739899af79f3669c3ba in term 0.
I20250830 07:55:02.890888 13771 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "b6717031830f4c57967e87ce077ddb21" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:55:02.891059 13771 raft_consensus.cc:2466] T b6717031830f4c57967e87ce077ddb21 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2065c332f15a4739899af79f3669c3ba in term 0.
I20250830 07:55:02.891425 13771 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "e24d68b8f5ba4df59a9aeec8ebd6403d" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f"
I20250830 07:55:02.891558 13771 raft_consensus.cc:3058] T e24d68b8f5ba4df59a9aeec8ebd6403d P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:55:02.891743 16079 raft_consensus.cc:491] T 4df6d481baab40e2b2c1309d1a8c5351 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:55:02.891812 13887 tablet_bootstrap.cc:492] T d7afb311a699495aa8376db6ab206d94 P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:55:02.891901 16079 raft_consensus.cc:513] T 4df6d481baab40e2b2c1309d1a8c5351 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:02.892428 16079 leader_election.cc:290] T 4df6d481baab40e2b2c1309d1a8c5351 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:55:02.893862 13887 tablet_bootstrap.cc:654] T d7afb311a699495aa8376db6ab206d94 P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:55:02.893918 13771 raft_consensus.cc:2466] T e24d68b8f5ba4df59a9aeec8ebd6403d P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2065c332f15a4739899af79f3669c3ba in term 1.
I20250830 07:55:02.894430 13764 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "b6717031830f4c57967e87ce077ddb21" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f"
I20250830 07:55:02.894551 13764 raft_consensus.cc:3058] T b6717031830f4c57967e87ce077ddb21 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:55:02.896884 13764 raft_consensus.cc:2466] T b6717031830f4c57967e87ce077ddb21 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2065c332f15a4739899af79f3669c3ba in term 1.
I20250830 07:55:02.897675 13764 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "4df6d481baab40e2b2c1309d1a8c5351" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:55:02.897841 13764 raft_consensus.cc:2466] T 4df6d481baab40e2b2c1309d1a8c5351 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2065c332f15a4739899af79f3669c3ba in term 0.
I20250830 07:55:02.901332 13471 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "283aa82b808e49528ceb19133748ffc8" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:55:02.901553 13471 raft_consensus.cc:2466] T 283aa82b808e49528ceb19133748ffc8 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 0.
I20250830 07:55:02.903160 13471 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "7dc061ebaa334c109d1e457e2dc860df" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba"
I20250830 07:55:02.903350 13471 raft_consensus.cc:3058] T 7dc061ebaa334c109d1e457e2dc860df P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:55:02.906140 13471 raft_consensus.cc:2466] T 7dc061ebaa334c109d1e457e2dc860df P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 1.
I20250830 07:55:02.907294 13471 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "e7e9d2e9b1ca4ddfb0c6a7bced613c35" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba"
I20250830 07:55:02.907507 13471 raft_consensus.cc:3058] T e7e9d2e9b1ca4ddfb0c6a7bced613c35 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:55:02.909891 13471 raft_consensus.cc:2466] T e7e9d2e9b1ca4ddfb0c6a7bced613c35 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 1.
W20250830 07:55:02.910643 13422 leader_election.cc:343] T d72ef294123b4bcdb8ff63af5de9c621 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:55:02.910776 13422 leader_election.cc:304] T d72ef294123b4bcdb8ff63af5de9c621 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba; no voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:55:02.911092 16079 raft_consensus.cc:2747] T d72ef294123b4bcdb8ff63af5de9c621 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:55:02.911897 13422 leader_election.cc:304] T b678fd915c534a2dac8521c21ab93396 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:55:02.912182 16079 raft_consensus.cc:2802] T b678fd915c534a2dac8521c21ab93396 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:55:02.912302 16079 raft_consensus.cc:491] T b678fd915c534a2dac8521c21ab93396 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:55:02.912400 16079 raft_consensus.cc:3058] T b678fd915c534a2dac8521c21ab93396 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:55:02.912739 13422 leader_election.cc:304] T e24d68b8f5ba4df59a9aeec8ebd6403d P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:55:02.913748 16349 raft_consensus.cc:2802] T e24d68b8f5ba4df59a9aeec8ebd6403d P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election won for term 1
I20250830 07:55:02.913885 16349 raft_consensus.cc:695] T e24d68b8f5ba4df59a9aeec8ebd6403d P 2065c332f15a4739899af79f3669c3ba [term 1 LEADER]: Becoming Leader. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Running, Role: LEADER
I20250830 07:55:02.914182 16349 consensus_queue.cc:237] T e24d68b8f5ba4df59a9aeec8ebd6403d P 2065c332f15a4739899af79f3669c3ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:02.916823 16079 raft_consensus.cc:513] T b678fd915c534a2dac8521c21ab93396 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:02.918494 16079 leader_election.cc:290] T b678fd915c534a2dac8521c21ab93396 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 election: Requested vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:55:02.922118 13886 tablet_bootstrap.cc:492] T d7afb311a699495aa8376db6ab206d94 P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:55:02.922256 13886 ts_tablet_manager.cc:1397] T d7afb311a699495aa8376db6ab206d94 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.037s user 0.004s sys 0.001s
I20250830 07:55:02.922377 13422 leader_election.cc:304] T 4df6d481baab40e2b2c1309d1a8c5351 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters:
I20250830 07:55:02.922637 16079 raft_consensus.cc:2802] T 4df6d481baab40e2b2c1309d1a8c5351 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:55:02.922726 16079 raft_consensus.cc:491] T 4df6d481baab40e2b2c1309d1a8c5351 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:55:02.922829 16079 raft_consensus.cc:3058] T 4df6d481baab40e2b2c1309d1a8c5351 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:55:02.922964 13886 raft_consensus.cc:357] T d7afb311a699495aa8376db6ab206d94 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:02.923341 13886 raft_consensus.cc:383] T d7afb311a699495aa8376db6ab206d94 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:55:02.923431 13886 raft_consensus.cc:738] T d7afb311a699495aa8376db6ab206d94 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:55:02.923679 13886 consensus_queue.cc:260] T d7afb311a699495aa8376db6ab206d94 P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:02.925942 16079 raft_consensus.cc:513] T 4df6d481baab40e2b2c1309d1a8c5351 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:02.926491 13886 ts_tablet_manager.cc:1428] T d7afb311a699495aa8376db6ab206d94 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20250830 07:55:02.927439 16079 leader_election.cc:290] T 4df6d481baab40e2b2c1309d1a8c5351 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 election: Requested vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:55:02.928423 13886 tablet_bootstrap.cc:492] T 53766699d42e4f6e9b42d9a98613726c P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:55:02.931196 13612 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "b678fd915c534a2dac8521c21ab93396" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9"
I20250830 07:55:02.931615 13622 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "4df6d481baab40e2b2c1309d1a8c5351" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9"
I20250830 07:55:02.931982 13617 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "4df6d481baab40e2b2c1309d1a8c5351" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:55:02.932617 13771 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "b678fd915c534a2dac8521c21ab93396" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f"
I20250830 07:55:02.932802 13771 raft_consensus.cc:3058] T b678fd915c534a2dac8521c21ab93396 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:55:02.935400 13771 raft_consensus.cc:2466] T b678fd915c534a2dac8521c21ab93396 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2065c332f15a4739899af79f3669c3ba in term 1.
I20250830 07:55:02.936100 13771 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "4df6d481baab40e2b2c1309d1a8c5351" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f"
I20250830 07:55:02.936286 13771 raft_consensus.cc:3058] T 4df6d481baab40e2b2c1309d1a8c5351 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:55:02.938818 13771 raft_consensus.cc:2466] T 4df6d481baab40e2b2c1309d1a8c5351 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2065c332f15a4739899af79f3669c3ba in term 1.
W20250830 07:55:02.940235 13423 leader_election.cc:343] T b678fd915c534a2dac8521c21ab93396 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
W20250830 07:55:02.940493 13423 leader_election.cc:343] T 4df6d481baab40e2b2c1309d1a8c5351 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
W20250830 07:55:02.940732 13423 leader_election.cc:343] T 4df6d481baab40e2b2c1309d1a8c5351 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
W20250830 07:55:02.939743 13703 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.209.2:38967, user_credentials={real_user=slave}} blocked reactor thread for 62336.2us
I20250830 07:55:02.941237 13701 leader_election.cc:304] T 283aa82b808e49528ceb19133748ffc8 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters:
I20250830 07:55:02.942127 13886 tablet_bootstrap.cc:654] T 53766699d42e4f6e9b42d9a98613726c P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:55:02.945888 15751 raft_consensus.cc:2802] T 283aa82b808e49528ceb19133748ffc8 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:55:02.945959 15751 raft_consensus.cc:491] T 283aa82b808e49528ceb19133748ffc8 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:55:02.946018 15751 raft_consensus.cc:3058] T 283aa82b808e49528ceb19133748ffc8 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:55:02.948271 15751 raft_consensus.cc:513] T 283aa82b808e49528ceb19133748ffc8 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:02.948730 15751 leader_election.cc:290] T 283aa82b808e49528ceb19133748ffc8 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Requested vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
I20250830 07:55:02.948271 13701 leader_election.cc:304] T 7dc061ebaa334c109d1e457e2dc860df P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters:
W20250830 07:55:02.950058 13703 consensus_peers.cc:489] T 3f70097c1b3a48dfbc1ad129fa7a3730 P 9b057ade5dce45af9f8bf0bedf8b917f -> Peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Couldn't send request to peer 6b5e454d98894637b466ea27f1b647f9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20250830 07:55:02.950620 16101 raft_consensus.cc:2802] T 7dc061ebaa334c109d1e457e2dc860df P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election won for term 1
I20250830 07:55:02.951190 16101 raft_consensus.cc:695] T 7dc061ebaa334c109d1e457e2dc860df P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 LEADER]: Becoming Leader. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Running, Role: LEADER
I20250830 07:55:02.951408 16101 consensus_queue.cc:237] T 7dc061ebaa334c109d1e457e2dc860df P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:02.958653 13887 tablet_bootstrap.cc:492] T d7afb311a699495aa8376db6ab206d94 P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:55:02.958807 13887 ts_tablet_manager.cc:1397] T d7afb311a699495aa8376db6ab206d94 P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.067s user 0.015s sys 0.026s
I20250830 07:55:02.959637 13887 raft_consensus.cc:357] T d7afb311a699495aa8376db6ab206d94 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:02.959822 13887 raft_consensus.cc:383] T d7afb311a699495aa8376db6ab206d94 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:55:02.959892 13887 raft_consensus.cc:738] T d7afb311a699495aa8376db6ab206d94 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:55:02.960121 13887 consensus_queue.cc:260] T d7afb311a699495aa8376db6ab206d94 P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:02.960647 13887 ts_tablet_manager.cc:1428] T d7afb311a699495aa8376db6ab206d94 P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20250830 07:55:02.961439 13887 tablet_bootstrap.cc:492] T 4639d1b6add8447c9ce071af71a99869 P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:55:02.963310 13887 tablet_bootstrap.cc:654] T 4639d1b6add8447c9ce071af71a99869 P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:55:02.967238 13886 tablet_bootstrap.cc:492] T 53766699d42e4f6e9b42d9a98613726c P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:55:02.967346 13886 ts_tablet_manager.cc:1397] T 53766699d42e4f6e9b42d9a98613726c P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.039s user 0.002s sys 0.003s
I20250830 07:55:02.967924 13886 raft_consensus.cc:357] T 53766699d42e4f6e9b42d9a98613726c P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:02.968079 13886 raft_consensus.cc:383] T 53766699d42e4f6e9b42d9a98613726c P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:55:02.968120 13886 raft_consensus.cc:738] T 53766699d42e4f6e9b42d9a98613726c P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:55:02.968262 13886 consensus_queue.cc:260] T 53766699d42e4f6e9b42d9a98613726c P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:02.968628 13886 ts_tablet_manager.cc:1428] T 53766699d42e4f6e9b42d9a98613726c P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20250830 07:55:02.969736 13886 tablet_bootstrap.cc:492] T 75359721445e48d2bc0dd6fd17649bc1 P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:55:02.971179 13886 tablet_bootstrap.cc:654] T 75359721445e48d2bc0dd6fd17649bc1 P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:55:02.950776 13701 leader_election.cc:304] T e7e9d2e9b1ca4ddfb0c6a7bced613c35 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters:
I20250830 07:55:02.985702 13886 tablet_bootstrap.cc:492] T 75359721445e48d2bc0dd6fd17649bc1 P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:55:02.985809 13886 ts_tablet_manager.cc:1397] T 75359721445e48d2bc0dd6fd17649bc1 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.016s user 0.002s sys 0.000s
I20250830 07:55:02.986791 15365 raft_consensus.cc:2802] T e7e9d2e9b1ca4ddfb0c6a7bced613c35 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election won for term 1
I20250830 07:55:02.986891 15365 raft_consensus.cc:695] T e7e9d2e9b1ca4ddfb0c6a7bced613c35 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 LEADER]: Becoming Leader. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Running, Role: LEADER
I20250830 07:55:02.987100 15365 consensus_queue.cc:237] T e7e9d2e9b1ca4ddfb0c6a7bced613c35 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:02.987486 15751 raft_consensus.cc:491] T a3ac09a6d8604297aa8736d1f60484e2 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:55:02.987573 15751 raft_consensus.cc:513] T a3ac09a6d8604297aa8736d1f60484e2 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:02.988015 15751 leader_election.cc:290] T a3ac09a6d8604297aa8736d1f60484e2 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
I20250830 07:55:02.990758 13886 raft_consensus.cc:357] T 75359721445e48d2bc0dd6fd17649bc1 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:02.991506 13886 raft_consensus.cc:383] T 75359721445e48d2bc0dd6fd17649bc1 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:55:02.991576 13886 raft_consensus.cc:738] T 75359721445e48d2bc0dd6fd17649bc1 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:55:02.991747 13886 consensus_queue.cc:260] T 75359721445e48d2bc0dd6fd17649bc1 P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:02.992264 13886 ts_tablet_manager.cc:1428] T 75359721445e48d2bc0dd6fd17649bc1 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
I20250830 07:55:02.993650 13886 tablet_bootstrap.cc:492] T b85843ab0e3a40e1b453cfdd71bbae5e P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
W20250830 07:55:02.995136 13701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.209.1:45325, user_credentials={real_user=slave}} blocked reactor thread for 44377.3us
I20250830 07:55:02.998767 13886 tablet_bootstrap.cc:654] T b85843ab0e3a40e1b453cfdd71bbae5e P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:55:03.001981 16079 raft_consensus.cc:491] T 8028ac4c928a48f3a077d61aec24f3bd P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:55:03.002126 16079 raft_consensus.cc:513] T 8028ac4c928a48f3a077d61aec24f3bd P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:03.002630 16079 leader_election.cc:290] T 8028ac4c928a48f3a077d61aec24f3bd P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:55:03.003655 13624 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "8028ac4c928a48f3a077d61aec24f3bd" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
W20250830 07:55:03.004356 13423 leader_election.cc:343] T 8028ac4c928a48f3a077d61aec24f3bd P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:55:03.004446 13887 tablet_bootstrap.cc:492] T 4639d1b6add8447c9ce071af71a99869 P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:55:03.004566 13887 ts_tablet_manager.cc:1397] T 4639d1b6add8447c9ce071af71a99869 P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.043s user 0.029s sys 0.008s
I20250830 07:55:03.005443 13481 raft_consensus.cc:1273] T 6ccbaf109e36453ea6645dfd090f5a1a P 2065c332f15a4739899af79f3669c3ba [term 2 FOLLOWER]: Refusing update from remote peer 9b057ade5dce45af9f8bf0bedf8b917f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
W20250830 07:55:03.007169 13703 leader_election.cc:343] T 7dc061ebaa334c109d1e457e2dc860df P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:55:03.008076 13422 leader_election.cc:304] T b678fd915c534a2dac8521c21ab93396 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:55:03.008427 15919 raft_consensus.cc:2802] T b678fd915c534a2dac8521c21ab93396 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election won for term 1
I20250830 07:55:03.008584 15919 raft_consensus.cc:695] T b678fd915c534a2dac8521c21ab93396 P 2065c332f15a4739899af79f3669c3ba [term 1 LEADER]: Becoming Leader. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Running, Role: LEADER
I20250830 07:55:03.008919 13422 leader_election.cc:304] T 4df6d481baab40e2b2c1309d1a8c5351 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:55:03.009366 16349 raft_consensus.cc:2802] T 4df6d481baab40e2b2c1309d1a8c5351 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election won for term 1
I20250830 07:55:03.009519 16349 raft_consensus.cc:695] T 4df6d481baab40e2b2c1309d1a8c5351 P 2065c332f15a4739899af79f3669c3ba [term 1 LEADER]: Becoming Leader. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Running, Role: LEADER
I20250830 07:55:03.009809 16349 consensus_queue.cc:237] T 4df6d481baab40e2b2c1309d1a8c5351 P 2065c332f15a4739899af79f3669c3ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:03.009972 15919 consensus_queue.cc:237] T b678fd915c534a2dac8521c21ab93396 P 2065c332f15a4739899af79f3669c3ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:03.011302 13481 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "283aa82b808e49528ceb19133748ffc8" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba"
I20250830 07:55:03.011498 13481 raft_consensus.cc:3058] T 283aa82b808e49528ceb19133748ffc8 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:55:03.013109 13887 raft_consensus.cc:357] T 4639d1b6add8447c9ce071af71a99869 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:03.013281 13887 raft_consensus.cc:383] T 4639d1b6add8447c9ce071af71a99869 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:55:03.013371 13887 raft_consensus.cc:738] T 4639d1b6add8447c9ce071af71a99869 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:55:03.013577 13887 consensus_queue.cc:260] T 4639d1b6add8447c9ce071af71a99869 P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:03.015182 13617 raft_consensus.cc:3058] T 135d754d83ad422eb05909d2daa19d34 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:55:03.016057 13619 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "370441c443be46c2a33132fbc5c41f89" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:55:03.017110 15992 raft_consensus.cc:491] T b2248b305c9f448a9e30661142ad10ea P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:55:03.017208 15992 raft_consensus.cc:513] T b2248b305c9f448a9e30661142ad10ea P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:03.017689 15992 leader_election.cc:290] T b2248b305c9f448a9e30661142ad10ea P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:55:03.017889 13612 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "e7e9d2e9b1ca4ddfb0c6a7bced613c35" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:55:03.018265 13477 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "a3ac09a6d8604297aa8736d1f60484e2" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:55:03.020881 13611 raft_consensus.cc:3058] T b2248b305c9f448a9e30661142ad10ea P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:55:03.023664 13887 ts_tablet_manager.cc:1428] T 4639d1b6add8447c9ce071af71a99869 P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.009s user 0.000s sys 0.001s
I20250830 07:55:03.023970 13887 tablet_bootstrap.cc:492] T 370441c443be46c2a33132fbc5c41f89 P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:55:03.024132 13484 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "b2248b305c9f448a9e30661142ad10ea" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:55:03.024153 13481 raft_consensus.cc:2466] T 283aa82b808e49528ceb19133748ffc8 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 1.
I20250830 07:55:03.028115 13886 tablet_bootstrap.cc:492] T b85843ab0e3a40e1b453cfdd71bbae5e P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:55:03.028249 13886 ts_tablet_manager.cc:1397] T b85843ab0e3a40e1b453cfdd71bbae5e P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.035s user 0.003s sys 0.000s
I20250830 07:55:03.028987 13886 raft_consensus.cc:357] T b85843ab0e3a40e1b453cfdd71bbae5e P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:03.029168 13886 raft_consensus.cc:383] T b85843ab0e3a40e1b453cfdd71bbae5e P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:55:03.029217 13886 raft_consensus.cc:738] T b85843ab0e3a40e1b453cfdd71bbae5e P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:55:03.029394 13886 consensus_queue.cc:260] T b85843ab0e3a40e1b453cfdd71bbae5e P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:03.029857 13886 ts_tablet_manager.cc:1428] T b85843ab0e3a40e1b453cfdd71bbae5e P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20250830 07:55:03.030099 13886 tablet_bootstrap.cc:492] T 2d91b0ba74034b85812a13719e21dc6c P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:55:03.032406 13886 tablet_bootstrap.cc:654] T 2d91b0ba74034b85812a13719e21dc6c P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:55:03.034121 13882 tablet_bootstrap.cc:492] T f479eef0171c401bbd27beec4486a8b2 P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:55:03.034247 13882 ts_tablet_manager.cc:1397] T f479eef0171c401bbd27beec4486a8b2 P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.232s user 0.009s sys 0.009s
I20250830 07:55:03.036316 13882 raft_consensus.cc:357] T f479eef0171c401bbd27beec4486a8b2 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:03.036497 13882 raft_consensus.cc:383] T f479eef0171c401bbd27beec4486a8b2 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:55:03.036552 13882 raft_consensus.cc:738] T f479eef0171c401bbd27beec4486a8b2 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:55:03.036760 13882 consensus_queue.cc:260] T f479eef0171c401bbd27beec4486a8b2 P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:03.037248 13882 ts_tablet_manager.cc:1428] T f479eef0171c401bbd27beec4486a8b2 P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20250830 07:55:03.037513 13882 tablet_bootstrap.cc:492] T 1ca83bbf848744f38206ceb4126271be P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:55:03.039280 13611 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "283aa82b808e49528ceb19133748ffc8" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:55:03.039502 13615 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "7dc061ebaa334c109d1e457e2dc860df" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9"
I20250830 07:55:03.040052 13764 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "8028ac4c928a48f3a077d61aec24f3bd" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:55:03.041651 15751 raft_consensus.cc:491] T 7e9d6af1d7fc4d4b961583b44f2f962a P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:55:03.041826 15751 raft_consensus.cc:513] T 7e9d6af1d7fc4d4b961583b44f2f962a P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:03.042395 15751 leader_election.cc:290] T 7e9d6af1d7fc4d4b961583b44f2f962a P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967)
I20250830 07:55:03.044013 13882 tablet_bootstrap.cc:654] T 1ca83bbf848744f38206ceb4126271be P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
I20250830 07:55:03.048372 13477 raft_consensus.cc:2466] T a3ac09a6d8604297aa8736d1f60484e2 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 0.
I20250830 07:55:03.050134 13484 raft_consensus.cc:2391] T b2248b305c9f448a9e30661142ad10ea P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b5e454d98894637b466ea27f1b647f9 in current term 1: Already voted for candidate 9b057ade5dce45af9f8bf0bedf8b917f in this term.
I20250830 07:55:03.051546 13617 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "e7e9d2e9b1ca4ddfb0c6a7bced613c35" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9"
I20250830 07:55:03.057698 15992 consensus_queue.cc:1035] T 63168840534246b59a2fdbfdfeebff47 P 6b5e454d98894637b466ea27f1b647f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20250830 07:55:03.060246 13423 consensus_peers.cc:489] T b4ab964a64a64e00a78ffd2b220aef46 P 2065c332f15a4739899af79f3669c3ba -> Peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Couldn't send request to peer 6b5e454d98894637b466ea27f1b647f9. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b4ab964a64a64e00a78ffd2b220aef46. This is attempt 16: this message will repeat every 5th retry.
I20250830 07:55:03.060426 13887 tablet_bootstrap.cc:654] T 370441c443be46c2a33132fbc5c41f89 P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:55:03.060705 16081 raft_consensus.cc:491] T b4c345013ff04cf991989f456aa2d420 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:55:03.060835 16081 raft_consensus.cc:513] T b4c345013ff04cf991989f456aa2d420 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
W20250830 07:55:03.061149 13422 leader_election.cc:343] T 8028ac4c928a48f3a077d61aec24f3bd P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:55:03.062506 13612 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "283aa82b808e49528ceb19133748ffc8" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9"
I20250830 07:55:03.064357 13422 leader_election.cc:304] T 8028ac4c928a48f3a077d61aec24f3bd P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba; no voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:55:03.064392 16081 leader_election.cc:290] T b4c345013ff04cf991989f456aa2d420 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:55:03.064787 16081 raft_consensus.cc:2747] T 8028ac4c928a48f3a077d61aec24f3bd P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:55:03.067587 16079 raft_consensus.cc:491] T d075a38c613c46398ec533c1e00a24c6 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:55:03.067760 16079 raft_consensus.cc:513] T d075a38c613c46398ec533c1e00a24c6 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:03.068428 16079 leader_election.cc:290] T d075a38c613c46398ec533c1e00a24c6 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:55:03.068519 13482 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "7e9d6af1d7fc4d4b961583b44f2f962a" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:55:03.068694 13482 raft_consensus.cc:2466] T 7e9d6af1d7fc4d4b961583b44f2f962a P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 0.
I20250830 07:55:03.068567 16079 raft_consensus.cc:491] T 0c32e597f17e4e75a0f584b6b7b02c36 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:55:03.069305 16079 raft_consensus.cc:513] T 0c32e597f17e4e75a0f584b6b7b02c36 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:03.069892 16079 leader_election.cc:290] T 0c32e597f17e4e75a0f584b6b7b02c36 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:55:03.070796 16079 raft_consensus.cc:491] T 1f5471a94dc24a28bce5f9dcaa10334a P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:55:03.071043 16079 raft_consensus.cc:513] T 1f5471a94dc24a28bce5f9dcaa10334a P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:03.071585 16079 leader_election.cc:290] T 1f5471a94dc24a28bce5f9dcaa10334a P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:55:03.074601 13612 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "a3ac09a6d8604297aa8736d1f60484e2" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:55:03.075598 15751 consensus_queue.cc:1035] T 6ccbaf109e36453ea6645dfd090f5a1a P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:55:03.078137 15751 consensus_queue.cc:1035] T 3bca390f6d4343cba7a9fb07f0d4d72b P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:55:03.081037 13612 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "b4c345013ff04cf991989f456aa2d420" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:55:03.081357 15748 raft_consensus.cc:491] T 122bec4220c74dfaa8228f6d153cd50e P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:55:03.081507 15748 raft_consensus.cc:513] T 122bec4220c74dfaa8228f6d153cd50e P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:03.082096 15748 leader_election.cc:290] T 122bec4220c74dfaa8228f6d153cd50e P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
I20250830 07:55:03.088357 13701 leader_election.cc:304] T 283aa82b808e49528ceb19133748ffc8 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters:
I20250830 07:55:03.088673 15751 raft_consensus.cc:2802] T 283aa82b808e49528ceb19133748ffc8 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election won for term 1
I20250830 07:55:03.088798 15751 raft_consensus.cc:695] T 283aa82b808e49528ceb19133748ffc8 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 LEADER]: Becoming Leader. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Running, Role: LEADER
I20250830 07:55:03.089027 15751 consensus_queue.cc:237] T 283aa82b808e49528ceb19133748ffc8 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:03.093202 13701 leader_election.cc:304] T a3ac09a6d8604297aa8736d1f60484e2 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters:
I20250830 07:55:03.093474 16101 raft_consensus.cc:2802] T a3ac09a6d8604297aa8736d1f60484e2 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:55:03.093572 16101 raft_consensus.cc:491] T a3ac09a6d8604297aa8736d1f60484e2 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:55:03.093660 16101 raft_consensus.cc:3058] T a3ac09a6d8604297aa8736d1f60484e2 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:55:03.097007 16101 raft_consensus.cc:513] T a3ac09a6d8604297aa8736d1f60484e2 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:03.097635 16101 leader_election.cc:290] T a3ac09a6d8604297aa8736d1f60484e2 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Requested vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
I20250830 07:55:03.100068 13887 tablet_bootstrap.cc:492] T 370441c443be46c2a33132fbc5c41f89 P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:55:03.100279 13887 ts_tablet_manager.cc:1397] T 370441c443be46c2a33132fbc5c41f89 P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.076s user 0.002s sys 0.006s
I20250830 07:55:03.101661 13887 raft_consensus.cc:357] T 370441c443be46c2a33132fbc5c41f89 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:03.101910 13887 raft_consensus.cc:383] T 370441c443be46c2a33132fbc5c41f89 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:55:03.102002 13887 raft_consensus.cc:738] T 370441c443be46c2a33132fbc5c41f89 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:55:03.102279 13887 consensus_queue.cc:260] T 370441c443be46c2a33132fbc5c41f89 P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:03.102929 13887 ts_tablet_manager.cc:1428] T 370441c443be46c2a33132fbc5c41f89 P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20250830 07:55:03.103319 13887 tablet_bootstrap.cc:492] T 533f17f5a9104a6582d9682287c9f1f7 P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:55:03.105160 13701 leader_election.cc:304] T 7e9d6af1d7fc4d4b961583b44f2f962a P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters:
I20250830 07:55:03.105451 15748 raft_consensus.cc:2802] T 7e9d6af1d7fc4d4b961583b44f2f962a P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:55:03.105549 15748 raft_consensus.cc:491] T 7e9d6af1d7fc4d4b961583b44f2f962a P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:55:03.105628 15748 raft_consensus.cc:3058] T 7e9d6af1d7fc4d4b961583b44f2f962a P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:55:03.106426 13887 tablet_bootstrap.cc:654] T 533f17f5a9104a6582d9682287c9f1f7 P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:55:03.108215 15748 raft_consensus.cc:513] T 7e9d6af1d7fc4d4b961583b44f2f962a P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:03.108714 15748 leader_election.cc:290] T 7e9d6af1d7fc4d4b961583b44f2f962a P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Requested vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967)
I20250830 07:55:03.109108 13764 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "b2248b305c9f448a9e30661142ad10ea" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:55:03.116029 16101 raft_consensus.cc:491] T 11042d702d4048c99644f0f06a6212d6 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:55:03.116178 16101 raft_consensus.cc:513] T 11042d702d4048c99644f0f06a6212d6 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:03.116679 16101 leader_election.cc:290] T 11042d702d4048c99644f0f06a6212d6 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
I20250830 07:55:03.120065 13482 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "122bec4220c74dfaa8228f6d153cd50e" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:55:03.120285 13482 raft_consensus.cc:2466] T 122bec4220c74dfaa8228f6d153cd50e P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 0.
W20250830 07:55:03.125615 13221 catalog_manager.cc:4726] Async tablet task AlterTable RPC for tablet ce68cb69909c42c4bb602338f73940d6 (table default.Table_5c9e71b2c5e44597922aff797fd2f700 [id=32173f9afbfe423e9e9421cd4dd21c48], current schema version=2) failed: Not found: failed to reset TS proxy: No leader found: Tablet ce68cb69909c42c4bb602338f73940d6 has no consensus state
I20250830 07:55:03.126471 13471 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "a3ac09a6d8604297aa8736d1f60484e2" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba"
I20250830 07:55:03.126981 13471 raft_consensus.cc:3058] T a3ac09a6d8604297aa8736d1f60484e2 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:55:03.127610 13476 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "7e9d6af1d7fc4d4b961583b44f2f962a" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba"
I20250830 07:55:03.127789 13476 raft_consensus.cc:3058] T 7e9d6af1d7fc4d4b961583b44f2f962a P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:55:03.130481 13476 raft_consensus.cc:2466] T 7e9d6af1d7fc4d4b961583b44f2f962a P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 1.
I20250830 07:55:03.131150 13476 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "11042d702d4048c99644f0f06a6212d6" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:55:03.131335 13476 raft_consensus.cc:2466] T 11042d702d4048c99644f0f06a6212d6 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 0.
I20250830 07:55:03.131510 13562 leader_election.cc:304] T b2248b305c9f448a9e30661142ad10ea P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b5e454d98894637b466ea27f1b647f9; no voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:55:03.131942 16255 raft_consensus.cc:2747] T b2248b305c9f448a9e30661142ad10ea P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:55:03.133780 13887 tablet_bootstrap.cc:492] T 533f17f5a9104a6582d9682287c9f1f7 P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:55:03.133984 13887 ts_tablet_manager.cc:1397] T 533f17f5a9104a6582d9682287c9f1f7 P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.031s user 0.002s sys 0.002s
I20250830 07:55:03.135057 13887 raft_consensus.cc:357] T 533f17f5a9104a6582d9682287c9f1f7 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:55:03.135339 13887 raft_consensus.cc:383] T 533f17f5a9104a6582d9682287c9f1f7 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:55:03.135486 13887 raft_consensus.cc:738] T 533f17f5a9104a6582d9682287c9f1f7 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:55:03.135802 13887 consensus_queue.cc:260] T 533f17f5a9104a6582d9682287c9f1f7 P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:55:03.137121 13887 ts_tablet_manager.cc:1428] T 533f17f5a9104a6582d9682287c9f1f7 P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20250830 07:55:03.138121 13887 tablet_bootstrap.cc:492] T aab8d9a009d34166920905ad06ed153b P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:55:03.139201 13764 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "b4c345013ff04cf991989f456aa2d420" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:55:03.140215 16079 raft_consensus.cc:491] T 53766699d42e4f6e9b42d9a98613726c P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:55:03.140676 13764 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "d075a38c613c46398ec533c1e00a24c6" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:55:03.141052 16255 raft_consensus.cc:491] T af449cc407c046eeb5cdfdacffc617a4 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:55:03.141155 16255 raft_consensus.cc:513] T af449cc407c046eeb5cdfdacffc617a4 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:03.141436 13764 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "0c32e597f17e4e75a0f584b6b7b02c36" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:55:03.141564 13764 raft_consensus.cc:2466] T 0c32e597f17e4e75a0f584b6b7b02c36 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2065c332f15a4739899af79f3669c3ba in term 0.
I20250830 07:55:03.141803 16255 leader_election.cc:290] T af449cc407c046eeb5cdfdacffc617a4 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:55:03.142194 13476 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "af449cc407c046eeb5cdfdacffc617a4" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:55:03.142381 13476 raft_consensus.cc:2391] T af449cc407c046eeb5cdfdacffc617a4 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b5e454d98894637b466ea27f1b647f9 in current term 1: Already voted for candidate 9b057ade5dce45af9f8bf0bedf8b917f in this term.
I20250830 07:55:03.142309 16255 consensus_queue.cc:1035] T 63168840534246b59a2fdbfdfeebff47 P 6b5e454d98894637b466ea27f1b647f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:55:03.143225 13764 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "1f5471a94dc24a28bce5f9dcaa10334a" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
W20250830 07:55:03.144785 13703 leader_election.cc:343] T 370441c443be46c2a33132fbc5c41f89 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:55:03.144879 13703 leader_election.cc:304] T 370441c443be46c2a33132fbc5c41f89 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 2065c332f15a4739899af79f3669c3ba, 6b5e454d98894637b466ea27f1b647f9
W20250830 07:55:03.145188 13703 leader_election.cc:343] T e7e9d2e9b1ca4ddfb0c6a7bced613c35 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:55:03.145604 15603 raft_consensus.cc:2747] T 370441c443be46c2a33132fbc5c41f89 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20250830 07:55:03.148129 13422 leader_election.cc:343] T b4c345013ff04cf991989f456aa2d420 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Illegal state: must be running to vote when last-logged opid is not known
W20250830 07:55:03.148347 13422 leader_election.cc:343] T d075a38c613c46398ec533c1e00a24c6 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:55:03.148459 13422 leader_election.cc:304] T 0c32e597f17e4e75a0f584b6b7b02c36 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters:
I20250830 07:55:03.148644 16081 raft_consensus.cc:2802] T 0c32e597f17e4e75a0f584b6b7b02c36 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election won for term 1
W20250830 07:55:03.148646 13422 leader_election.cc:343] T 1f5471a94dc24a28bce5f9dcaa10334a P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:55:03.148730 16081 raft_consensus.cc:491] T 0c32e597f17e4e75a0f584b6b7b02c36 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:55:03.148784 16081 raft_consensus.cc:3058] T 0c32e597f17e4e75a0f584b6b7b02c36 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
W20250830 07:55:03.150518 13703 leader_election.cc:343] T 283aa82b808e49528ceb19133748ffc8 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:55:03.150532 15603 consensus_queue.cc:1035] T b2248b305c9f448a9e30661142ad10ea P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20250830 07:55:03.150790 13703 leader_election.cc:343] T 7dc061ebaa334c109d1e457e2dc860df P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
W20250830 07:55:03.151307 13703 leader_election.cc:343] T e7e9d2e9b1ca4ddfb0c6a7bced613c35 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:55:03.152007 16081 raft_consensus.cc:513] T 0c32e597f17e4e75a0f584b6b7b02c36 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:03.152495 16081 leader_election.cc:290] T 0c32e597f17e4e75a0f584b6b7b02c36 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 election: Requested vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:55:03.152807 13624 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "7e9d6af1d7fc4d4b961583b44f2f962a" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:55:03.153955 13471 raft_consensus.cc:2466] T a3ac09a6d8604297aa8736d1f60484e2 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 1.
I20250830 07:55:03.156194 15751 consensus_queue.cc:1035] T f479eef0171c401bbd27beec4486a8b2 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:55:03.156411 13701 leader_election.cc:304] T 122bec4220c74dfaa8228f6d153cd50e P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters:
I20250830 07:55:03.160458 15751 raft_consensus.cc:2802] T 122bec4220c74dfaa8228f6d153cd50e P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:55:03.160553 15751 raft_consensus.cc:491] T 122bec4220c74dfaa8228f6d153cd50e P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:55:03.160640 15751 raft_consensus.cc:3058] T 122bec4220c74dfaa8228f6d153cd50e P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:55:03.164294 13701 leader_election.cc:304] T 7e9d6af1d7fc4d4b961583b44f2f962a P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters:
W20250830 07:55:03.164533 13703 consensus_peers.cc:489] T ad7a45187569416bad6c71db9f8ab702 P 9b057ade5dce45af9f8bf0bedf8b917f -> Peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Couldn't send request to peer 6b5e454d98894637b466ea27f1b647f9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20250830 07:55:03.164758 15748 raft_consensus.cc:2802] T 7e9d6af1d7fc4d4b961583b44f2f962a P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election won for term 1
I20250830 07:55:03.164774 16101 consensus_queue.cc:1035] T d1d5e0d40a91457da65a0e925289309e P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:55:03.165083 13701 leader_election.cc:304] T 11042d702d4048c99644f0f06a6212d6 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters:
I20250830 07:55:03.165309 16259 raft_consensus.cc:2802] T 11042d702d4048c99644f0f06a6212d6 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:55:03.165369 16259 raft_consensus.cc:491] T 11042d702d4048c99644f0f06a6212d6 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:55:03.165426 16259 raft_consensus.cc:3058] T 11042d702d4048c99644f0f06a6212d6 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:55:03.165494 15748 raft_consensus.cc:695] T 7e9d6af1d7fc4d4b961583b44f2f962a P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 LEADER]: Becoming Leader. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Running, Role: LEADER
W20250830 07:55:03.167321 13703 leader_election.cc:343] T 283aa82b808e49528ceb19133748ffc8 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:55:03.168644 13701 leader_election.cc:304] T a3ac09a6d8604297aa8736d1f60484e2 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters:
I20250830 07:55:03.165699 15748 consensus_queue.cc:237] T 7e9d6af1d7fc4d4b961583b44f2f962a P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:03.171065 13612 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "122bec4220c74dfaa8228f6d153cd50e" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:55:03.171237 15980 raft_consensus.cc:2802] T a3ac09a6d8604297aa8736d1f60484e2 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election won for term 1
I20250830 07:55:03.171269 15751 raft_consensus.cc:513] T 122bec4220c74dfaa8228f6d153cd50e P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:03.171343 15980 raft_consensus.cc:695] T a3ac09a6d8604297aa8736d1f60484e2 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 LEADER]: Becoming Leader. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Running, Role: LEADER
I20250830 07:55:03.171456 16074 raft_consensus.cc:491] T cd9903bdfaef4139a1a582c54689da4a P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:55:03.171545 15980 consensus_queue.cc:237] T a3ac09a6d8604297aa8736d1f60484e2 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:03.171568 16074 raft_consensus.cc:513] T cd9903bdfaef4139a1a582c54689da4a P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:03.172076 16074 leader_election.cc:290] T cd9903bdfaef4139a1a582c54689da4a P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:55:03.172588 13471 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "cd9903bdfaef4139a1a582c54689da4a" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:55:03.172693 15751 leader_election.cc:290] T 122bec4220c74dfaa8228f6d153cd50e P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Requested vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
I20250830 07:55:03.173103 16259 raft_consensus.cc:513] T 11042d702d4048c99644f0f06a6212d6 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:03.173192 13887 tablet_bootstrap.cc:654] T aab8d9a009d34166920905ad06ed153b P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:55:03.179031 16416 raft_consensus.cc:491] T 2d91b0ba74034b85812a13719e21dc6c P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:55:03.179178 16416 raft_consensus.cc:513] T 2d91b0ba74034b85812a13719e21dc6c P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:03.179803 16416 leader_election.cc:290] T 2d91b0ba74034b85812a13719e21dc6c P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:55:03.182636 13484 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "122bec4220c74dfaa8228f6d153cd50e" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba"
I20250830 07:55:03.182654 16349 raft_consensus.cc:491] T e2ef8300fb994f98b3565ad708f880cf P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:55:03.182786 13484 raft_consensus.cc:3058] T 122bec4220c74dfaa8228f6d153cd50e P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:55:03.182796 16349 raft_consensus.cc:513] T e2ef8300fb994f98b3565ad708f880cf P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:03.183382 16349 leader_election.cc:290] T e2ef8300fb994f98b3565ad708f880cf P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
W20250830 07:55:03.184299 13423 leader_election.cc:343] T b4c345013ff04cf991989f456aa2d420 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:55:03.184405 13423 leader_election.cc:304] T b4c345013ff04cf991989f456aa2d420 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba; no voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:55:03.184620 16349 raft_consensus.cc:2747] T b4c345013ff04cf991989f456aa2d420 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:55:03.185408 13484 raft_consensus.cc:2466] T 122bec4220c74dfaa8228f6d153cd50e P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 1.
I20250830 07:55:03.188050 15365 raft_consensus.cc:491] T bac72b4ba9ba4ca69f93e799dccb0e93 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:55:03.188155 15365 raft_consensus.cc:513] T bac72b4ba9ba4ca69f93e799dccb0e93 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:03.192173 16079 raft_consensus.cc:513] T 53766699d42e4f6e9b42d9a98613726c P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
W20250830 07:55:03.192845 13703 leader_election.cc:343] T a3ac09a6d8604297aa8736d1f60484e2 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:55:03.194411 16079 leader_election.cc:290] T 53766699d42e4f6e9b42d9a98613726c P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:55:03.196283 13624 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "a3ac09a6d8604297aa8736d1f60484e2" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9"
I20250830 07:55:03.192021 13764 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "0c32e597f17e4e75a0f584b6b7b02c36" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f"
I20250830 07:55:03.197700 13764 raft_consensus.cc:3058] T 0c32e597f17e4e75a0f584b6b7b02c36 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:55:03.198544 15365 leader_election.cc:290] T bac72b4ba9ba4ca69f93e799dccb0e93 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
I20250830 07:55:03.198792 16259 leader_election.cc:290] T 11042d702d4048c99644f0f06a6212d6 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Requested vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
I20250830 07:55:03.193312 13772 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "2d91b0ba74034b85812a13719e21dc6c" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:55:03.200060 13611 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "7e9d6af1d7fc4d4b961583b44f2f962a" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9"
I20250830 07:55:03.200985 13611 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "11042d702d4048c99644f0f06a6212d6" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:55:03.213827 13765 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "e2ef8300fb994f98b3565ad708f880cf" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:55:03.214155 13622 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "122bec4220c74dfaa8228f6d153cd50e" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9"
I20250830 07:55:03.213776 13775 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "53766699d42e4f6e9b42d9a98613726c" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:55:03.214632 13775 raft_consensus.cc:2466] T 53766699d42e4f6e9b42d9a98613726c P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2065c332f15a4739899af79f3669c3ba in term 0.
I20250830 07:55:03.217097 13887 tablet_bootstrap.cc:492] T aab8d9a009d34166920905ad06ed153b P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:55:03.217303 13887 ts_tablet_manager.cc:1397] T aab8d9a009d34166920905ad06ed153b P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.080s user 0.003s sys 0.000s
I20250830 07:55:03.218047 13887 raft_consensus.cc:357] T aab8d9a009d34166920905ad06ed153b P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:55:03.218245 13887 raft_consensus.cc:383] T aab8d9a009d34166920905ad06ed153b P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:55:03.218374 13887 raft_consensus.cc:738] T aab8d9a009d34166920905ad06ed153b P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:55:03.218576 13887 consensus_queue.cc:260] T aab8d9a009d34166920905ad06ed153b P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:55:03.220049 13764 raft_consensus.cc:2466] T 0c32e597f17e4e75a0f584b6b7b02c36 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2065c332f15a4739899af79f3669c3ba in term 1.
I20250830 07:55:03.220817 13882 tablet_bootstrap.cc:492] T 1ca83bbf848744f38206ceb4126271be P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:55:03.220968 13882 ts_tablet_manager.cc:1397] T 1ca83bbf848744f38206ceb4126271be P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.184s user 0.022s sys 0.013s
I20250830 07:55:03.221669 13882 raft_consensus.cc:357] T 1ca83bbf848744f38206ceb4126271be P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:03.222411 13882 raft_consensus.cc:383] T 1ca83bbf848744f38206ceb4126271be P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:55:03.222470 13882 raft_consensus.cc:738] T 1ca83bbf848744f38206ceb4126271be P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:55:03.222666 13882 consensus_queue.cc:260] T 1ca83bbf848744f38206ceb4126271be P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:03.223707 13882 ts_tablet_manager.cc:1428] T 1ca83bbf848744f38206ceb4126271be P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20250830 07:55:03.223853 13484 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "bac72b4ba9ba4ca69f93e799dccb0e93" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:55:03.223994 13882 tablet_bootstrap.cc:492] T 55bd3f378b854476a24f657f5e23843d P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:55:03.224097 13484 raft_consensus.cc:2466] T bac72b4ba9ba4ca69f93e799dccb0e93 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 0.
I20250830 07:55:03.224748 13484 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "11042d702d4048c99644f0f06a6212d6" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba"
I20250830 07:55:03.224922 13484 raft_consensus.cc:3058] T 11042d702d4048c99644f0f06a6212d6 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:55:03.225600 13882 tablet_bootstrap.cc:654] T 55bd3f378b854476a24f657f5e23843d P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
I20250830 07:55:03.226260 13887 ts_tablet_manager.cc:1428] T aab8d9a009d34166920905ad06ed153b P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.009s user 0.002s sys 0.000s
I20250830 07:55:03.226505 13887 tablet_bootstrap.cc:492] T 9f27983af2c84dd6a40e7e0b900a9dc6 P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:55:03.227661 13886 tablet_bootstrap.cc:492] T 2d91b0ba74034b85812a13719e21dc6c P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:55:03.227789 13886 ts_tablet_manager.cc:1397] T 2d91b0ba74034b85812a13719e21dc6c P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.198s user 0.020s sys 0.023s
I20250830 07:55:03.228353 13484 raft_consensus.cc:2466] T 11042d702d4048c99644f0f06a6212d6 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 1.
I20250830 07:55:03.229628 13886 raft_consensus.cc:357] T 2d91b0ba74034b85812a13719e21dc6c P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:03.229776 13886 raft_consensus.cc:383] T 2d91b0ba74034b85812a13719e21dc6c P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:55:03.229835 13886 raft_consensus.cc:738] T 2d91b0ba74034b85812a13719e21dc6c P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:55:03.229997 13886 consensus_queue.cc:260] T 2d91b0ba74034b85812a13719e21dc6c P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:03.230341 13886 ts_tablet_manager.cc:1428] T 2d91b0ba74034b85812a13719e21dc6c P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
W20250830 07:55:03.231377 13422 leader_election.cc:343] T e2ef8300fb994f98b3565ad708f880cf P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:55:03.231513 13886 tablet_bootstrap.cc:492] T dad2dfa1a19d45778933780b1029d924 P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:55:03.232175 13775 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "af449cc407c046eeb5cdfdacffc617a4" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:55:03.233444 13886 tablet_bootstrap.cc:654] T dad2dfa1a19d45778933780b1029d924 P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
W20250830 07:55:03.234444 13422 leader_election.cc:343] T 2d91b0ba74034b85812a13719e21dc6c P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:55:03.241514 13764 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "cd9903bdfaef4139a1a582c54689da4a" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:55:03.241842 13422 leader_election.cc:304] T 53766699d42e4f6e9b42d9a98613726c P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters:
I20250830 07:55:03.242110 16416 raft_consensus.cc:2802] T 53766699d42e4f6e9b42d9a98613726c P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:55:03.242200 16416 raft_consensus.cc:491] T 53766699d42e4f6e9b42d9a98613726c P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:55:03.242264 16416 raft_consensus.cc:3058] T 53766699d42e4f6e9b42d9a98613726c P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:55:03.242885 13622 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "d075a38c613c46398ec533c1e00a24c6" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:55:03.243903 13622 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "0c32e597f17e4e75a0f584b6b7b02c36" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:55:03.244577 16416 raft_consensus.cc:513] T 53766699d42e4f6e9b42d9a98613726c P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:03.244983 13622 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "1f5471a94dc24a28bce5f9dcaa10334a" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:55:03.245082 16416 leader_election.cc:290] T 53766699d42e4f6e9b42d9a98613726c P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 election: Requested vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:55:03.245584 13701 leader_election.cc:304] T 122bec4220c74dfaa8228f6d153cd50e P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters:
I20250830 07:55:03.245992 15863 raft_consensus.cc:2802] T 122bec4220c74dfaa8228f6d153cd50e P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election won for term 1
I20250830 07:55:03.246088 15863 raft_consensus.cc:695] T 122bec4220c74dfaa8228f6d153cd50e P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 LEADER]: Becoming Leader. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Running, Role: LEADER
I20250830 07:55:03.246266 15863 consensus_queue.cc:237] T 122bec4220c74dfaa8228f6d153cd50e P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:03.247383 13622 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "0c32e597f17e4e75a0f584b6b7b02c36" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9"
I20250830 07:55:03.249778 13622 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "2d91b0ba74034b85812a13719e21dc6c" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:55:03.251056 13622 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "e2ef8300fb994f98b3565ad708f880cf" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:55:03.252260 13622 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "53766699d42e4f6e9b42d9a98613726c" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:55:03.252516 15365 consensus_queue.cc:1035] T 0f34ed0fe6e9400fae5c0edebb615ebd P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:55:03.253232 13886 tablet_bootstrap.cc:492] T dad2dfa1a19d45778933780b1029d924 P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:55:03.253456 13886 ts_tablet_manager.cc:1397] T dad2dfa1a19d45778933780b1029d924 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.022s user 0.001s sys 0.006s
I20250830 07:55:03.254118 13886 raft_consensus.cc:357] T dad2dfa1a19d45778933780b1029d924 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:03.254253 13886 raft_consensus.cc:383] T dad2dfa1a19d45778933780b1029d924 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:55:03.254307 13886 raft_consensus.cc:738] T dad2dfa1a19d45778933780b1029d924 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:55:03.254475 13886 consensus_queue.cc:260] T dad2dfa1a19d45778933780b1029d924 P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:03.255175 13886 ts_tablet_manager.cc:1428] T dad2dfa1a19d45778933780b1029d924 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20250830 07:55:03.255419 13886 tablet_bootstrap.cc:492] T 7676b4d6a75c4c6aacced1f2a1beb555 P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:55:03.255391 13701 leader_election.cc:304] T bac72b4ba9ba4ca69f93e799dccb0e93 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters:
I20250830 07:55:03.256996 15365 raft_consensus.cc:2802] T bac72b4ba9ba4ca69f93e799dccb0e93 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:55:03.257067 15365 raft_consensus.cc:491] T bac72b4ba9ba4ca69f93e799dccb0e93 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:55:03.257025 13622 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "53766699d42e4f6e9b42d9a98613726c" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9"
I20250830 07:55:03.257117 15365 raft_consensus.cc:3058] T bac72b4ba9ba4ca69f93e799dccb0e93 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
W20250830 07:55:03.259443 13423 leader_election.cc:343] T d075a38c613c46398ec533c1e00a24c6 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:55:03.259543 13423 leader_election.cc:304] T d075a38c613c46398ec533c1e00a24c6 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba; no voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f
W20250830 07:55:03.259886 13423 leader_election.cc:343] T 0c32e597f17e4e75a0f584b6b7b02c36 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:55:03.260123 16416 raft_consensus.cc:2747] T d075a38c613c46398ec533c1e00a24c6 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20250830 07:55:03.260411 13423 leader_election.cc:343] T 1f5471a94dc24a28bce5f9dcaa10334a P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:55:03.260509 13423 leader_election.cc:304] T 1f5471a94dc24a28bce5f9dcaa10334a P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba; no voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:55:03.260600 15608 raft_consensus.cc:491] T 690cf258639a4c1ea5a0ac4f2fd39f88 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:55:03.260742 15608 raft_consensus.cc:513] T 690cf258639a4c1ea5a0ac4f2fd39f88 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:03.260885 16416 raft_consensus.cc:2747] T 1f5471a94dc24a28bce5f9dcaa10334a P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:55:03.261250 15608 leader_election.cc:290] T 690cf258639a4c1ea5a0ac4f2fd39f88 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967)
I20250830 07:55:03.261679 15608 raft_consensus.cc:491] T d7afb311a699495aa8376db6ab206d94 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:55:03.261816 15608 raft_consensus.cc:513] T d7afb311a699495aa8376db6ab206d94 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:03.261919 13701 leader_election.cc:304] T 11042d702d4048c99644f0f06a6212d6 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters:
I20250830 07:55:03.262117 15748 raft_consensus.cc:2802] T 11042d702d4048c99644f0f06a6212d6 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election won for term 1
I20250830 07:55:03.262216 15748 raft_consensus.cc:695] T 11042d702d4048c99644f0f06a6212d6 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 LEADER]: Becoming Leader. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Running, Role: LEADER
I20250830 07:55:03.262230 15608 leader_election.cc:290] T d7afb311a699495aa8376db6ab206d94 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967)
W20250830 07:55:03.262491 13423 leader_election.cc:343] T 0c32e597f17e4e75a0f584b6b7b02c36 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:55:03.262418 15748 consensus_queue.cc:237] T 11042d702d4048c99644f0f06a6212d6 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:03.261677 15365 raft_consensus.cc:513] T bac72b4ba9ba4ca69f93e799dccb0e93 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:03.263875 15365 leader_election.cc:290] T bac72b4ba9ba4ca69f93e799dccb0e93 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Requested vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
I20250830 07:55:03.266661 13562 leader_election.cc:304] T af449cc407c046eeb5cdfdacffc617a4 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b5e454d98894637b466ea27f1b647f9; no voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f
W20250830 07:55:03.267035 13423 leader_election.cc:343] T 2d91b0ba74034b85812a13719e21dc6c P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:55:03.267114 13423 leader_election.cc:304] T 2d91b0ba74034b85812a13719e21dc6c P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba; no voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:55:03.267400 15992 raft_consensus.cc:3058] T af449cc407c046eeb5cdfdacffc617a4 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Advancing to term 1
W20250830 07:55:03.267387 13423 leader_election.cc:343] T e2ef8300fb994f98b3565ad708f880cf P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:55:03.267464 13423 leader_election.cc:304] T e2ef8300fb994f98b3565ad708f880cf P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba; no voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f
W20250830 07:55:03.267724 13423 leader_election.cc:343] T 53766699d42e4f6e9b42d9a98613726c P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
W20250830 07:55:03.268023 13423 consensus_peers.cc:489] T 76dd9dd481fc427fb20f5091e4a3b738 P 2065c332f15a4739899af79f3669c3ba -> Peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Couldn't send request to peer 6b5e454d98894637b466ea27f1b647f9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20250830 07:55:03.268117 13423 leader_election.cc:343] T 53766699d42e4f6e9b42d9a98613726c P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:55:03.268291 16079 raft_consensus.cc:2747] T 2d91b0ba74034b85812a13719e21dc6c P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:55:03.268416 16079 raft_consensus.cc:2747] T e2ef8300fb994f98b3565ad708f880cf P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:55:03.269651 15992 raft_consensus.cc:2747] T af449cc407c046eeb5cdfdacffc617a4 P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20250830 07:55:03.269717 13703 consensus_peers.cc:489] T 0f34ed0fe6e9400fae5c0edebb615ebd P 9b057ade5dce45af9f8bf0bedf8b917f -> Peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Couldn't send request to peer 6b5e454d98894637b466ea27f1b647f9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20250830 07:55:03.270100 13703 leader_election.cc:343] T 7e9d6af1d7fc4d4b961583b44f2f962a P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:55:03.270237 16081 raft_consensus.cc:491] T 91da20bcd25341b5a0f6605b3ec58fb3 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:55:03.270373 16081 raft_consensus.cc:513] T 91da20bcd25341b5a0f6605b3ec58fb3 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:03.270888 16081 leader_election.cc:290] T 91da20bcd25341b5a0f6605b3ec58fb3 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
W20250830 07:55:03.271325 13703 leader_election.cc:343] T 122bec4220c74dfaa8228f6d153cd50e P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:55:03.271996 13562 leader_election.cc:304] T cd9903bdfaef4139a1a582c54689da4a P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b5e454d98894637b466ea27f1b647f9; no voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:55:03.272627 15992 raft_consensus.cc:2747] T cd9903bdfaef4139a1a582c54689da4a P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:55:03.273373 13422 leader_election.cc:304] T 0c32e597f17e4e75a0f584b6b7b02c36 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:55:03.274575 13887 tablet_bootstrap.cc:654] T 9f27983af2c84dd6a40e7e0b900a9dc6 P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:55:03.274677 13886 tablet_bootstrap.cc:654] T 7676b4d6a75c4c6aacced1f2a1beb555 P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:55:03.274722 16081 raft_consensus.cc:2802] T 0c32e597f17e4e75a0f584b6b7b02c36 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election won for term 1
I20250830 07:55:03.275185 16081 raft_consensus.cc:695] T 0c32e597f17e4e75a0f584b6b7b02c36 P 2065c332f15a4739899af79f3669c3ba [term 1 LEADER]: Becoming Leader. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Running, Role: LEADER
W20250830 07:55:03.275493 13703 leader_election.cc:343] T a3ac09a6d8604297aa8736d1f60484e2 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:55:03.275437 16081 consensus_queue.cc:237] T 0c32e597f17e4e75a0f584b6b7b02c36 P 2065c332f15a4739899af79f3669c3ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
W20250830 07:55:03.277508 13703 leader_election.cc:343] T 7e9d6af1d7fc4d4b961583b44f2f962a P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
W20250830 07:55:03.277727 13703 leader_election.cc:343] T 11042d702d4048c99644f0f06a6212d6 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
W20250830 07:55:03.279234 13703 leader_election.cc:343] T 122bec4220c74dfaa8228f6d153cd50e P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:55:03.295249 15863 raft_consensus.cc:491] T 4639d1b6add8447c9ce071af71a99869 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:55:03.295396 15863 raft_consensus.cc:513] T 4639d1b6add8447c9ce071af71a99869 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:03.295899 15863 leader_election.cc:290] T 4639d1b6add8447c9ce071af71a99869 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
I20250830 07:55:03.297178 13887 tablet_bootstrap.cc:492] T 9f27983af2c84dd6a40e7e0b900a9dc6 P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:55:03.297365 13887 ts_tablet_manager.cc:1397] T 9f27983af2c84dd6a40e7e0b900a9dc6 P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.071s user 0.005s sys 0.002s
I20250830 07:55:03.298168 13887 raft_consensus.cc:357] T 9f27983af2c84dd6a40e7e0b900a9dc6 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:55:03.298529 13887 raft_consensus.cc:383] T 9f27983af2c84dd6a40e7e0b900a9dc6 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:55:03.298633 13887 raft_consensus.cc:738] T 9f27983af2c84dd6a40e7e0b900a9dc6 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:55:03.298892 13887 consensus_queue.cc:260] T 9f27983af2c84dd6a40e7e0b900a9dc6 P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:55:03.299480 13887 ts_tablet_manager.cc:1428] T 9f27983af2c84dd6a40e7e0b900a9dc6 P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20250830 07:55:03.302021 13622 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "bac72b4ba9ba4ca69f93e799dccb0e93" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:55:03.302994 13622 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "11042d702d4048c99644f0f06a6212d6" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9"
I20250830 07:55:03.309860 13764 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "91da20bcd25341b5a0f6605b3ec58fb3" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:55:03.309953 13775 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "53766699d42e4f6e9b42d9a98613726c" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f"
I20250830 07:55:03.310052 13775 raft_consensus.cc:3058] T 53766699d42e4f6e9b42d9a98613726c P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:55:03.311367 15365 consensus_queue.cc:1035] T b2248b305c9f448a9e30661142ad10ea P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:55:03.313519 13882 tablet_bootstrap.cc:492] T 55bd3f378b854476a24f657f5e23843d P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:55:03.313638 13882 ts_tablet_manager.cc:1397] T 55bd3f378b854476a24f657f5e23843d P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.090s user 0.004s sys 0.004s
I20250830 07:55:03.314098 13471 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "690cf258639a4c1ea5a0ac4f2fd39f88" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:55:03.314237 13471 raft_consensus.cc:2466] T 690cf258639a4c1ea5a0ac4f2fd39f88 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 0.
I20250830 07:55:03.314313 13882 raft_consensus.cc:357] T 55bd3f378b854476a24f657f5e23843d P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:03.314446 13882 raft_consensus.cc:383] T 55bd3f378b854476a24f657f5e23843d P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:55:03.314497 13882 raft_consensus.cc:738] T 55bd3f378b854476a24f657f5e23843d P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:55:03.314594 13775 raft_consensus.cc:2466] T 53766699d42e4f6e9b42d9a98613726c P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2065c332f15a4739899af79f3669c3ba in term 1.
I20250830 07:55:03.314664 13882 consensus_queue.cc:260] T 55bd3f378b854476a24f657f5e23843d P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:03.314858 13471 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "d7afb311a699495aa8376db6ab206d94" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:55:03.315018 13471 raft_consensus.cc:2466] T d7afb311a699495aa8376db6ab206d94 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 0.
I20250830 07:55:03.315446 13882 ts_tablet_manager.cc:1428] T 55bd3f378b854476a24f657f5e23843d P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20250830 07:55:03.315727 13882 tablet_bootstrap.cc:492] T e7e9d2e9b1ca4ddfb0c6a7bced613c35 P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:55:03.317283 13882 tablet_bootstrap.cc:654] T e7e9d2e9b1ca4ddfb0c6a7bced613c35 P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
I20250830 07:55:03.317590 13471 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "bac72b4ba9ba4ca69f93e799dccb0e93" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba"
I20250830 07:55:03.317719 13471 raft_consensus.cc:3058] T bac72b4ba9ba4ca69f93e799dccb0e93 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:55:03.318620 13886 tablet_bootstrap.cc:492] T 7676b4d6a75c4c6aacced1f2a1beb555 P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:55:03.318720 13886 ts_tablet_manager.cc:1397] T 7676b4d6a75c4c6aacced1f2a1beb555 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.063s user 0.001s sys 0.001s
I20250830 07:55:03.319454 13886 raft_consensus.cc:357] T 7676b4d6a75c4c6aacced1f2a1beb555 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:03.319578 13886 raft_consensus.cc:383] T 7676b4d6a75c4c6aacced1f2a1beb555 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:55:03.319617 13886 raft_consensus.cc:738] T 7676b4d6a75c4c6aacced1f2a1beb555 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:55:03.319770 13886 consensus_queue.cc:260] T 7676b4d6a75c4c6aacced1f2a1beb555 P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:03.320220 13886 ts_tablet_manager.cc:1428] T 7676b4d6a75c4c6aacced1f2a1beb555 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20250830 07:55:03.320214 13471 raft_consensus.cc:2466] T bac72b4ba9ba4ca69f93e799dccb0e93 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 1.
I20250830 07:55:03.320488 13886 tablet_bootstrap.cc:492] T 8028ac4c928a48f3a077d61aec24f3bd P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:55:03.322132 13886 tablet_bootstrap.cc:654] T 8028ac4c928a48f3a077d61aec24f3bd P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:55:03.323887 15603 consensus_queue.cc:1035] T c6355878115a4907ae1f0a45fb2c6492 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:55:03.324373 13471 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "4639d1b6add8447c9ce071af71a99869" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:55:03.324725 13471 raft_consensus.cc:2466] T 4639d1b6add8447c9ce071af71a99869 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 0.
I20250830 07:55:03.329264 13701 leader_election.cc:304] T 690cf258639a4c1ea5a0ac4f2fd39f88 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters:
I20250830 07:55:03.329514 15603 raft_consensus.cc:2802] T 690cf258639a4c1ea5a0ac4f2fd39f88 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:55:03.329636 15603 raft_consensus.cc:491] T 690cf258639a4c1ea5a0ac4f2fd39f88 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:55:03.329735 15603 raft_consensus.cc:3058] T 690cf258639a4c1ea5a0ac4f2fd39f88 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:55:03.332830 15603 raft_consensus.cc:513] T 690cf258639a4c1ea5a0ac4f2fd39f88 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:03.333424 15603 leader_election.cc:290] T 690cf258639a4c1ea5a0ac4f2fd39f88 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Requested vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967)
I20250830 07:55:03.337215 13701 leader_election.cc:304] T d7afb311a699495aa8376db6ab206d94 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters:
I20250830 07:55:03.337461 15365 raft_consensus.cc:2802] T d7afb311a699495aa8376db6ab206d94 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:55:03.337534 13701 leader_election.cc:304] T bac72b4ba9ba4ca69f93e799dccb0e93 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters:
I20250830 07:55:03.337585 15365 raft_consensus.cc:491] T d7afb311a699495aa8376db6ab206d94 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:55:03.337695 15365 raft_consensus.cc:3058] T d7afb311a699495aa8376db6ab206d94 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:55:03.340456 15365 raft_consensus.cc:513] T d7afb311a699495aa8376db6ab206d94 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:03.341089 15365 leader_election.cc:290] T d7afb311a699495aa8376db6ab206d94 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Requested vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967)
I20250830 07:55:03.341811 15365 raft_consensus.cc:2802] T bac72b4ba9ba4ca69f93e799dccb0e93 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election won for term 1
I20250830 07:55:03.342020 15365 raft_consensus.cc:695] T bac72b4ba9ba4ca69f93e799dccb0e93 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 LEADER]: Becoming Leader. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Running, Role: LEADER
I20250830 07:55:03.342293 15365 consensus_queue.cc:237] T bac72b4ba9ba4ca69f93e799dccb0e93 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:03.342765 16081 raft_consensus.cc:491] T 370441c443be46c2a33132fbc5c41f89 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:55:03.342870 16081 raft_consensus.cc:513] T 370441c443be46c2a33132fbc5c41f89 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:03.343506 16081 leader_election.cc:290] T 370441c443be46c2a33132fbc5c41f89 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:55:03.354697 13882 tablet_bootstrap.cc:492] T e7e9d2e9b1ca4ddfb0c6a7bced613c35 P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:55:03.354823 13882 ts_tablet_manager.cc:1397] T e7e9d2e9b1ca4ddfb0c6a7bced613c35 P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.039s user 0.002s sys 0.002s
I20250830 07:55:03.355392 13887 tablet_bootstrap.cc:492] T 4b692717d4d34919af71cabb1a82bfd8 P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:55:03.355532 13882 raft_consensus.cc:357] T e7e9d2e9b1ca4ddfb0c6a7bced613c35 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:03.355679 13882 raft_consensus.cc:383] T e7e9d2e9b1ca4ddfb0c6a7bced613c35 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:55:03.355731 13882 raft_consensus.cc:738] T e7e9d2e9b1ca4ddfb0c6a7bced613c35 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:55:03.355891 13882 consensus_queue.cc:260] T e7e9d2e9b1ca4ddfb0c6a7bced613c35 P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:03.356812 13887 tablet_bootstrap.cc:654] T 4b692717d4d34919af71cabb1a82bfd8 P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:55:03.356961 15603 consensus_queue.cc:1035] T ad7a45187569416bad6c71db9f8ab702 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:55:03.357412 13611 raft_consensus.cc:3058] T d94215b0b1f142178f0b791518d1baf2 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:55:03.357764 13701 leader_election.cc:304] T 4639d1b6add8447c9ce071af71a99869 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters:
I20250830 07:55:03.358088 15603 raft_consensus.cc:2802] T 4639d1b6add8447c9ce071af71a99869 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:55:03.358196 15603 raft_consensus.cc:491] T 4639d1b6add8447c9ce071af71a99869 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:55:03.358302 15603 raft_consensus.cc:3058] T 4639d1b6add8447c9ce071af71a99869 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:55:03.360740 13886 tablet_bootstrap.cc:492] T 8028ac4c928a48f3a077d61aec24f3bd P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:55:03.360911 13886 ts_tablet_manager.cc:1397] T 8028ac4c928a48f3a077d61aec24f3bd P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.040s user 0.000s sys 0.002s
I20250830 07:55:03.361757 13886 raft_consensus.cc:357] T 8028ac4c928a48f3a077d61aec24f3bd P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:03.361994 13886 raft_consensus.cc:383] T 8028ac4c928a48f3a077d61aec24f3bd P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:55:03.361909 15603 raft_consensus.cc:513] T 4639d1b6add8447c9ce071af71a99869 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:03.362067 13886 raft_consensus.cc:738] T 8028ac4c928a48f3a077d61aec24f3bd P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:55:03.362311 13886 consensus_queue.cc:260] T 8028ac4c928a48f3a077d61aec24f3bd P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:03.362854 13886 ts_tablet_manager.cc:1428] T 8028ac4c928a48f3a077d61aec24f3bd P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20250830 07:55:03.363371 13882 ts_tablet_manager.cc:1428] T e7e9d2e9b1ca4ddfb0c6a7bced613c35 P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.008s user 0.002s sys 0.000s
I20250830 07:55:03.363615 13882 tablet_bootstrap.cc:492] T 76dd9dd481fc427fb20f5091e4a3b738 P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:55:03.365126 13882 tablet_bootstrap.cc:654] T 76dd9dd481fc427fb20f5091e4a3b738 P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
I20250830 07:55:03.363040 15603 leader_election.cc:290] T 4639d1b6add8447c9ce071af71a99869 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Requested vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
I20250830 07:55:03.376015 13886 tablet_bootstrap.cc:492] T 9bc54e40f9eb4271aa3132986c249e51 P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:55:03.377630 13624 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "690cf258639a4c1ea5a0ac4f2fd39f88" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:55:03.379573 13886 tablet_bootstrap.cc:654] T 9bc54e40f9eb4271aa3132986c249e51 P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:55:03.381033 13482 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "690cf258639a4c1ea5a0ac4f2fd39f88" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba"
I20250830 07:55:03.381186 13482 raft_consensus.cc:3058] T 690cf258639a4c1ea5a0ac4f2fd39f88 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:55:03.381349 13481 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "d7afb311a699495aa8376db6ab206d94" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba"
I20250830 07:55:03.381515 13481 raft_consensus.cc:3058] T d7afb311a699495aa8376db6ab206d94 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:55:03.384181 13482 raft_consensus.cc:2466] T 690cf258639a4c1ea5a0ac4f2fd39f88 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 1.
I20250830 07:55:03.384434 13481 raft_consensus.cc:2466] T d7afb311a699495aa8376db6ab206d94 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 1.
I20250830 07:55:03.385155 13887 tablet_bootstrap.cc:492] T 4b692717d4d34919af71cabb1a82bfd8 P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:55:03.385352 13887 ts_tablet_manager.cc:1397] T 4b692717d4d34919af71cabb1a82bfd8 P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.030s user 0.002s sys 0.008s
I20250830 07:55:03.386055 13887 raft_consensus.cc:357] T 4b692717d4d34919af71cabb1a82bfd8 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:55:03.386245 13887 raft_consensus.cc:383] T 4b692717d4d34919af71cabb1a82bfd8 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:55:03.386328 13887 raft_consensus.cc:738] T 4b692717d4d34919af71cabb1a82bfd8 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:55:03.386562 13887 consensus_queue.cc:260] T 4b692717d4d34919af71cabb1a82bfd8 P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:55:03.387241 13887 ts_tablet_manager.cc:1428] T 4b692717d4d34919af71cabb1a82bfd8 P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20250830 07:55:03.387524 13887 tablet_bootstrap.cc:492] T 8921c85fefac415f9a4e5bb7dc38a134 P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:55:03.389573 13887 tablet_bootstrap.cc:654] T 8921c85fefac415f9a4e5bb7dc38a134 P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:55:03.401526 13624 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "d7afb311a699495aa8376db6ab206d94" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:55:03.402210 13624 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "bac72b4ba9ba4ca69f93e799dccb0e93" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9"
I20250830 07:55:03.403666 13624 raft_consensus.cc:3058] T f479eef0171c401bbd27beec4486a8b2 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:55:03.404973 13887 tablet_bootstrap.cc:492] T 8921c85fefac415f9a4e5bb7dc38a134 P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:55:03.405090 13887 ts_tablet_manager.cc:1397] T 8921c85fefac415f9a4e5bb7dc38a134 P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.018s user 0.002s sys 0.002s
I20250830 07:55:03.405741 13887 raft_consensus.cc:357] T 8921c85fefac415f9a4e5bb7dc38a134 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:55:03.405885 13887 raft_consensus.cc:383] T 8921c85fefac415f9a4e5bb7dc38a134 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:55:03.405925 13887 raft_consensus.cc:738] T 8921c85fefac415f9a4e5bb7dc38a134 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:55:03.406064 13887 consensus_queue.cc:260] T 8921c85fefac415f9a4e5bb7dc38a134 P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:55:03.406563 13887 ts_tablet_manager.cc:1428] T 8921c85fefac415f9a4e5bb7dc38a134 P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.001s user 0.001s sys 0.001s
I20250830 07:55:03.406796 13887 tablet_bootstrap.cc:492] T 736de5dbaf7f4f449f6fc323ab6a72d8 P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:55:03.408090 13887 tablet_bootstrap.cc:654] T 736de5dbaf7f4f449f6fc323ab6a72d8 P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
W20250830 07:55:03.418069 15746 lock_manager.cc:585] Waited 7 seconds to obtain row lock on key '<redacted>' (key hash 4012713805250960239) tablet 00000000000000000000000000000000 cur holder 0x61700003a700
I20250830 07:55:03.419373 13477 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "4639d1b6add8447c9ce071af71a99869" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba"
I20250830 07:55:03.419546 13477 raft_consensus.cc:3058] T 4639d1b6add8447c9ce071af71a99869 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:55:03.419961 13887 tablet_bootstrap.cc:492] T 736de5dbaf7f4f449f6fc323ab6a72d8 P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:55:03.420064 13887 ts_tablet_manager.cc:1397] T 736de5dbaf7f4f449f6fc323ab6a72d8 P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.013s user 0.002s sys 0.000s
I20250830 07:55:03.420626 13887 raft_consensus.cc:357] T 736de5dbaf7f4f449f6fc323ab6a72d8 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:55:03.420779 13887 raft_consensus.cc:383] T 736de5dbaf7f4f449f6fc323ab6a72d8 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:55:03.420822 13887 raft_consensus.cc:738] T 736de5dbaf7f4f449f6fc323ab6a72d8 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:55:03.420966 13887 consensus_queue.cc:260] T 736de5dbaf7f4f449f6fc323ab6a72d8 P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:55:03.421296 13887 ts_tablet_manager.cc:1428] T 736de5dbaf7f4f449f6fc323ab6a72d8 P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20250830 07:55:03.421543 13887 tablet_bootstrap.cc:492] T 51aecb7681034f7ca67039ca86a0a618 P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:55:03.422317 13477 raft_consensus.cc:2466] T 4639d1b6add8447c9ce071af71a99869 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 1.
I20250830 07:55:03.423218 13887 tablet_bootstrap.cc:654] T 51aecb7681034f7ca67039ca86a0a618 P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:55:03.442281 13624 raft_consensus.cc:3058] T 1ca83bbf848744f38206ceb4126271be P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:55:03.447564 13622 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "4639d1b6add8447c9ce071af71a99869" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:55:03.450985 13612 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "690cf258639a4c1ea5a0ac4f2fd39f88" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9"
I20250830 07:55:03.453143 13612 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "d7afb311a699495aa8376db6ab206d94" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9"
I20250830 07:55:03.455435 13612 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "4639d1b6add8447c9ce071af71a99869" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9"
I20250830 07:55:03.456687 13887 tablet_bootstrap.cc:492] T 51aecb7681034f7ca67039ca86a0a618 P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:55:03.456821 13887 ts_tablet_manager.cc:1397] T 51aecb7681034f7ca67039ca86a0a618 P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.035s user 0.004s sys 0.000s
I20250830 07:55:03.457010 15992 raft_consensus.cc:491] T 02be33dc658d428fa55e59784a2342f6 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:55:03.457131 15992 raft_consensus.cc:513] T 02be33dc658d428fa55e59784a2342f6 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:03.457468 13887 raft_consensus.cc:357] T 51aecb7681034f7ca67039ca86a0a618 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:55:03.457625 13887 raft_consensus.cc:383] T 51aecb7681034f7ca67039ca86a0a618 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:55:03.457679 15992 leader_election.cc:290] T 02be33dc658d428fa55e59784a2342f6 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:55:03.457710 13887 raft_consensus.cc:738] T 51aecb7681034f7ca67039ca86a0a618 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:55:03.457909 13887 consensus_queue.cc:260] T 51aecb7681034f7ca67039ca86a0a618 P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:55:03.458391 13887 ts_tablet_manager.cc:1428] T 51aecb7681034f7ca67039ca86a0a618 P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20250830 07:55:03.458632 13887 tablet_bootstrap.cc:492] T 0b574113fee342f98c5574703440ba3a P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
W20250830 07:55:03.459272 13561 leader_election.cc:343] T 02be33dc658d428fa55e59784a2342f6 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): Not found: Tablet not found: 02be33dc658d428fa55e59784a2342f6
I20250830 07:55:03.460180 13887 tablet_bootstrap.cc:654] T 0b574113fee342f98c5574703440ba3a P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:55:03.465551 16081 raft_consensus.cc:491] T 5dffbacf2fcd4a38a1d61cf5bb9c5eeb P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:55:03.465680 16081 raft_consensus.cc:513] T 5dffbacf2fcd4a38a1d61cf5bb9c5eeb P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:03.466276 16081 leader_election.cc:290] T 5dffbacf2fcd4a38a1d61cf5bb9c5eeb P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
W20250830 07:55:03.473644 13422 leader_election.cc:343] T 91da20bcd25341b5a0f6605b3ec58fb3 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:55:03.474624 13422 leader_election.cc:304] T 53766699d42e4f6e9b42d9a98613726c P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:55:03.475214 16349 raft_consensus.cc:2802] T 53766699d42e4f6e9b42d9a98613726c P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election won for term 1
I20250830 07:55:03.475340 16349 raft_consensus.cc:695] T 53766699d42e4f6e9b42d9a98613726c P 2065c332f15a4739899af79f3669c3ba [term 1 LEADER]: Becoming Leader. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Running, Role: LEADER
I20250830 07:55:03.475605 16349 consensus_queue.cc:237] T 53766699d42e4f6e9b42d9a98613726c P 2065c332f15a4739899af79f3669c3ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:03.484889 13882 tablet_bootstrap.cc:492] T 76dd9dd481fc427fb20f5091e4a3b738 P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:55:03.485039 13882 ts_tablet_manager.cc:1397] T 76dd9dd481fc427fb20f5091e4a3b738 P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.121s user 0.009s sys 0.020s
I20250830 07:55:03.485788 13882 raft_consensus.cc:357] T 76dd9dd481fc427fb20f5091e4a3b738 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:03.485946 13882 raft_consensus.cc:383] T 76dd9dd481fc427fb20f5091e4a3b738 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:55:03.486016 13882 raft_consensus.cc:738] T 76dd9dd481fc427fb20f5091e4a3b738 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:55:03.486231 13882 consensus_queue.cc:260] T 76dd9dd481fc427fb20f5091e4a3b738 P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:03.486688 13882 ts_tablet_manager.cc:1428] T 76dd9dd481fc427fb20f5091e4a3b738 P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20250830 07:55:03.486992 13882 tablet_bootstrap.cc:492] T 122bec4220c74dfaa8228f6d153cd50e P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:55:03.488745 13882 tablet_bootstrap.cc:654] T 122bec4220c74dfaa8228f6d153cd50e P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
I20250830 07:55:03.490299 13882 tablet_bootstrap.cc:492] T 122bec4220c74dfaa8228f6d153cd50e P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:55:03.490406 13882 ts_tablet_manager.cc:1397] T 122bec4220c74dfaa8228f6d153cd50e P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.004s user 0.003s sys 0.000s
I20250830 07:55:03.491027 13882 raft_consensus.cc:357] T 122bec4220c74dfaa8228f6d153cd50e P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:03.491171 13882 raft_consensus.cc:383] T 122bec4220c74dfaa8228f6d153cd50e P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:55:03.491217 13882 raft_consensus.cc:738] T 122bec4220c74dfaa8228f6d153cd50e P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:55:03.491372 13882 consensus_queue.cc:260] T 122bec4220c74dfaa8228f6d153cd50e P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:03.492038 13882 ts_tablet_manager.cc:1428] T 122bec4220c74dfaa8228f6d153cd50e P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20250830 07:55:03.492297 13882 tablet_bootstrap.cc:492] T a36f38ada7314165a5e9d6ee7bbf69e3 P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:55:03.493607 13882 tablet_bootstrap.cc:654] T a36f38ada7314165a5e9d6ee7bbf69e3 P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
I20250830 07:55:03.499166 16349 raft_consensus.cc:491] T 51aecb7681034f7ca67039ca86a0a618 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:55:03.499428 16349 raft_consensus.cc:513] T 51aecb7681034f7ca67039ca86a0a618 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:55:03.500836 16349 leader_election.cc:290] T 51aecb7681034f7ca67039ca86a0a618 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:55:03.489661 13775 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "370441c443be46c2a33132fbc5c41f89" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:55:03.502015 13882 tablet_bootstrap.cc:492] T a36f38ada7314165a5e9d6ee7bbf69e3 P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:55:03.502121 13882 ts_tablet_manager.cc:1397] T a36f38ada7314165a5e9d6ee7bbf69e3 P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.010s user 0.002s sys 0.007s
I20250830 07:55:03.502723 13882 raft_consensus.cc:357] T a36f38ada7314165a5e9d6ee7bbf69e3 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:03.502857 13882 raft_consensus.cc:383] T a36f38ada7314165a5e9d6ee7bbf69e3 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:55:03.502898 13882 raft_consensus.cc:738] T a36f38ada7314165a5e9d6ee7bbf69e3 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:55:03.503254 13886 tablet_bootstrap.cc:492] T 9bc54e40f9eb4271aa3132986c249e51 P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:55:03.503228 13775 raft_consensus.cc:2466] T 370441c443be46c2a33132fbc5c41f89 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2065c332f15a4739899af79f3669c3ba in term 0.
I20250830 07:55:03.503418 13886 ts_tablet_manager.cc:1397] T 9bc54e40f9eb4271aa3132986c249e51 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.127s user 0.010s sys 0.019s
I20250830 07:55:03.504156 13886 raft_consensus.cc:357] T 9bc54e40f9eb4271aa3132986c249e51 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:03.504323 13886 raft_consensus.cc:383] T 9bc54e40f9eb4271aa3132986c249e51 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:55:03.504372 13886 raft_consensus.cc:738] T 9bc54e40f9eb4271aa3132986c249e51 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:55:03.504526 13886 consensus_queue.cc:260] T 9bc54e40f9eb4271aa3132986c249e51 P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:03.504834 13886 ts_tablet_manager.cc:1428] T 9bc54e40f9eb4271aa3132986c249e51 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20250830 07:55:03.505071 13886 tablet_bootstrap.cc:492] T d075a38c613c46398ec533c1e00a24c6 P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:55:03.506366 13886 tablet_bootstrap.cc:654] T d075a38c613c46398ec533c1e00a24c6 P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:55:03.503122 13882 consensus_queue.cc:260] T a36f38ada7314165a5e9d6ee7bbf69e3 P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:03.507370 13882 ts_tablet_manager.cc:1428] T a36f38ada7314165a5e9d6ee7bbf69e3 P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.005s user 0.000s sys 0.001s
I20250830 07:55:03.507592 13882 tablet_bootstrap.cc:492] T 3f70097c1b3a48dfbc1ad129fa7a3730 P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:55:03.509073 13882 tablet_bootstrap.cc:654] T 3f70097c1b3a48dfbc1ad129fa7a3730 P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
I20250830 07:55:03.511910 13611 raft_consensus.cc:3058] T a36f38ada7314165a5e9d6ee7bbf69e3 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:55:03.518783 13882 tablet_bootstrap.cc:492] T 3f70097c1b3a48dfbc1ad129fa7a3730 P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:55:03.518891 13882 ts_tablet_manager.cc:1397] T 3f70097c1b3a48dfbc1ad129fa7a3730 P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.011s user 0.003s sys 0.001s
I20250830 07:55:03.520198 13882 raft_consensus.cc:357] T 3f70097c1b3a48dfbc1ad129fa7a3730 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:03.520339 13882 raft_consensus.cc:383] T 3f70097c1b3a48dfbc1ad129fa7a3730 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:55:03.520392 13882 raft_consensus.cc:738] T 3f70097c1b3a48dfbc1ad129fa7a3730 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:55:03.520566 13882 consensus_queue.cc:260] T 3f70097c1b3a48dfbc1ad129fa7a3730 P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:03.521065 13882 ts_tablet_manager.cc:1428] T 3f70097c1b3a48dfbc1ad129fa7a3730 P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20250830 07:55:03.521299 13882 tablet_bootstrap.cc:492] T 8ee98b748d0245bc8bf9eeac727b495e P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:55:03.524096 13886 tablet_bootstrap.cc:492] T d075a38c613c46398ec533c1e00a24c6 P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:55:03.524231 13886 ts_tablet_manager.cc:1397] T d075a38c613c46398ec533c1e00a24c6 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.019s user 0.000s sys 0.008s
I20250830 07:55:03.525007 13886 raft_consensus.cc:357] T d075a38c613c46398ec533c1e00a24c6 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:03.525190 13886 raft_consensus.cc:383] T d075a38c613c46398ec533c1e00a24c6 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:55:03.525256 13886 raft_consensus.cc:738] T d075a38c613c46398ec533c1e00a24c6 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:55:03.525441 13886 consensus_queue.cc:260] T d075a38c613c46398ec533c1e00a24c6 P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:03.525815 13886 ts_tablet_manager.cc:1428] T d075a38c613c46398ec533c1e00a24c6 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20250830 07:55:03.526070 13886 tablet_bootstrap.cc:492] T e2ef8300fb994f98b3565ad708f880cf P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:55:03.526224 16349 raft_consensus.cc:491] T 4b692717d4d34919af71cabb1a82bfd8 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:55:03.526332 16349 raft_consensus.cc:513] T 4b692717d4d34919af71cabb1a82bfd8 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:55:03.526968 16349 leader_election.cc:290] T 4b692717d4d34919af71cabb1a82bfd8 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:55:03.527336 13886 tablet_bootstrap.cc:654] T e2ef8300fb994f98b3565ad708f880cf P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:55:03.522902 13882 tablet_bootstrap.cc:654] T 8ee98b748d0245bc8bf9eeac727b495e P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
I20250830 07:55:03.532196 13887 tablet_bootstrap.cc:492] T 0b574113fee342f98c5574703440ba3a P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:55:03.532393 13887 ts_tablet_manager.cc:1397] T 0b574113fee342f98c5574703440ba3a P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.074s user 0.002s sys 0.010s
I20250830 07:55:03.533170 13882 tablet_bootstrap.cc:492] T 8ee98b748d0245bc8bf9eeac727b495e P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:55:03.533277 13882 ts_tablet_manager.cc:1397] T 8ee98b748d0245bc8bf9eeac727b495e P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.012s user 0.002s sys 0.003s
I20250830 07:55:03.533128 13887 raft_consensus.cc:357] T 0b574113fee342f98c5574703440ba3a P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:55:03.533576 13887 raft_consensus.cc:383] T 0b574113fee342f98c5574703440ba3a P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:55:03.533684 13887 raft_consensus.cc:738] T 0b574113fee342f98c5574703440ba3a P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:55:03.533972 13887 consensus_queue.cc:260] T 0b574113fee342f98c5574703440ba3a P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:55:03.534327 13882 raft_consensus.cc:357] T 8ee98b748d0245bc8bf9eeac727b495e P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:03.534829 13887 ts_tablet_manager.cc:1428] T 0b574113fee342f98c5574703440ba3a P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20250830 07:55:03.535197 13887 tablet_bootstrap.cc:492] T af3f79e46d6149aa921a4c0ce19c7172 P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
W20250830 07:55:03.538744 13703 leader_election.cc:343] T bac72b4ba9ba4ca69f93e799dccb0e93 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
W20250830 07:55:03.539040 13703 leader_election.cc:343] T 11042d702d4048c99644f0f06a6212d6 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
W20250830 07:55:03.539407 13703 consensus_peers.cc:489] T 3bca390f6d4343cba7a9fb07f0d4d72b P 9b057ade5dce45af9f8bf0bedf8b917f -> Peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Couldn't send request to peer 6b5e454d98894637b466ea27f1b647f9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20250830 07:55:03.539613 13703 consensus_peers.cc:489] T 13df49c2c2cd4e5cae26a540835b74c9 P 9b057ade5dce45af9f8bf0bedf8b917f -> Peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Couldn't send request to peer 6b5e454d98894637b466ea27f1b647f9. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 13df49c2c2cd4e5cae26a540835b74c9. This is attempt 6: this message will repeat every 5th retry.
W20250830 07:55:03.543293 13703 leader_election.cc:343] T 690cf258639a4c1ea5a0ac4f2fd39f88 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
W20250830 07:55:03.543604 13703 consensus_peers.cc:489] T 0d16bc64dd6e43f7ba313b77c2bbb728 P 9b057ade5dce45af9f8bf0bedf8b917f -> Peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Couldn't send request to peer 6b5e454d98894637b466ea27f1b647f9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20250830 07:55:03.543773 13703 leader_election.cc:343] T d7afb311a699495aa8376db6ab206d94 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
W20250830 07:55:03.544054 13703 leader_election.cc:343] T bac72b4ba9ba4ca69f93e799dccb0e93 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:55:03.534497 13882 raft_consensus.cc:383] T 8ee98b748d0245bc8bf9eeac727b495e P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:55:03.544591 13882 raft_consensus.cc:738] T 8ee98b748d0245bc8bf9eeac727b495e P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:55:03.545933 15751 consensus_queue.cc:1035] T f479eef0171c401bbd27beec4486a8b2 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:55:03.546267 13882 consensus_queue.cc:260] T 8ee98b748d0245bc8bf9eeac727b495e P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:03.538072 13622 raft_consensus.cc:3058] T cd9903bdfaef4139a1a582c54689da4a P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:55:03.547624 15751 consensus_queue.cc:1035] T 1ca83bbf848744f38206ceb4126271be P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20250830 07:55:03.548261 13703 leader_election.cc:343] T 4639d1b6add8447c9ce071af71a99869 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
W20250830 07:55:03.550016 13703 consensus_peers.cc:489] T c6355878115a4907ae1f0a45fb2c6492 P 9b057ade5dce45af9f8bf0bedf8b917f -> Peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Couldn't send request to peer 6b5e454d98894637b466ea27f1b647f9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20250830 07:55:03.550237 13703 leader_election.cc:343] T 690cf258639a4c1ea5a0ac4f2fd39f88 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
W20250830 07:55:03.551245 13703 leader_election.cc:343] T d7afb311a699495aa8376db6ab206d94 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
W20250830 07:55:03.552351 13703 leader_election.cc:343] T 4639d1b6add8447c9ce071af71a99869 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
W20250830 07:55:03.554292 13703 consensus_peers.cc:489] T 78fe9f6325c243a490f361aa79295c36 P 9b057ade5dce45af9f8bf0bedf8b917f -> Peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Couldn't send request to peer 6b5e454d98894637b466ea27f1b647f9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20250830 07:55:03.555755 15751 consensus_queue.cc:1035] T af449cc407c046eeb5cdfdacffc617a4 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20250830 07:55:03.557703 13703 consensus_peers.cc:489] T 8ee98b748d0245bc8bf9eeac727b495e P 9b057ade5dce45af9f8bf0bedf8b917f -> Peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Couldn't send request to peer 6b5e454d98894637b466ea27f1b647f9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20250830 07:55:03.573591 13886 tablet_bootstrap.cc:492] T e2ef8300fb994f98b3565ad708f880cf P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:55:03.573730 13886 ts_tablet_manager.cc:1397] T e2ef8300fb994f98b3565ad708f880cf P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.048s user 0.005s sys 0.000s
I20250830 07:55:03.574437 13886 raft_consensus.cc:357] T e2ef8300fb994f98b3565ad708f880cf P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:03.574591 13886 raft_consensus.cc:383] T e2ef8300fb994f98b3565ad708f880cf P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:55:03.574640 13886 raft_consensus.cc:738] T e2ef8300fb994f98b3565ad708f880cf P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:55:03.574808 13886 consensus_queue.cc:260] T e2ef8300fb994f98b3565ad708f880cf P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:03.575271 13886 ts_tablet_manager.cc:1428] T e2ef8300fb994f98b3565ad708f880cf P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20250830 07:55:03.575527 13886 tablet_bootstrap.cc:492] T 838616d8274648fc9ea4f1583bdb97f9 P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:55:03.576833 13886 tablet_bootstrap.cc:654] T 838616d8274648fc9ea4f1583bdb97f9 P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:55:03.582875 15919 raft_consensus.cc:491] T dad2dfa1a19d45778933780b1029d924 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:55:03.583063 15919 raft_consensus.cc:513] T dad2dfa1a19d45778933780b1029d924 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:03.583177 13887 tablet_bootstrap.cc:654] T af3f79e46d6149aa921a4c0ce19c7172 P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:55:03.583742 15919 leader_election.cc:290] T dad2dfa1a19d45778933780b1029d924 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:55:03.584895 13882 ts_tablet_manager.cc:1428] T 8ee98b748d0245bc8bf9eeac727b495e P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.052s user 0.004s sys 0.003s
I20250830 07:55:03.585493 13882 tablet_bootstrap.cc:492] T ad7a45187569416bad6c71db9f8ab702 P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:55:03.589269 13882 tablet_bootstrap.cc:654] T ad7a45187569416bad6c71db9f8ab702 P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
I20250830 07:55:03.597523 16463 raft_consensus.cc:491] T f479eef0171c401bbd27beec4486a8b2 P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:55:03.597517 13422 leader_election.cc:304] T 370441c443be46c2a33132fbc5c41f89 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters:
I20250830 07:55:03.597671 16463 raft_consensus.cc:513] T f479eef0171c401bbd27beec4486a8b2 P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:03.598287 16463 leader_election.cc:290] T f479eef0171c401bbd27beec4486a8b2 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:55:03.598621 13481 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f479eef0171c401bbd27beec4486a8b2" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:55:03.599532 16349 raft_consensus.cc:2802] T 370441c443be46c2a33132fbc5c41f89 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:55:03.599617 16349 raft_consensus.cc:491] T 370441c443be46c2a33132fbc5c41f89 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:55:03.599680 16349 raft_consensus.cc:3058] T 370441c443be46c2a33132fbc5c41f89 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:55:03.602555 16349 raft_consensus.cc:513] T 370441c443be46c2a33132fbc5c41f89 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:03.603477 16349 leader_election.cc:290] T 370441c443be46c2a33132fbc5c41f89 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 election: Requested vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:55:03.604652 13886 tablet_bootstrap.cc:492] T 838616d8274648fc9ea4f1583bdb97f9 P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:55:03.604772 13886 ts_tablet_manager.cc:1397] T 838616d8274648fc9ea4f1583bdb97f9 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.029s user 0.006s sys 0.001s
I20250830 07:55:03.605458 13886 raft_consensus.cc:357] T 838616d8274648fc9ea4f1583bdb97f9 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:03.605607 13886 raft_consensus.cc:383] T 838616d8274648fc9ea4f1583bdb97f9 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:55:03.605672 13886 raft_consensus.cc:738] T 838616d8274648fc9ea4f1583bdb97f9 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:55:03.606076 16463 raft_consensus.cc:491] T 3f70097c1b3a48dfbc1ad129fa7a3730 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:55:03.606153 13886 consensus_queue.cc:260] T 838616d8274648fc9ea4f1583bdb97f9 P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:03.606232 16463 raft_consensus.cc:513] T 3f70097c1b3a48dfbc1ad129fa7a3730 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:03.607118 13484 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "3f70097c1b3a48dfbc1ad129fa7a3730" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:55:03.607561 13886 ts_tablet_manager.cc:1428] T 838616d8274648fc9ea4f1583bdb97f9 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20250830 07:55:03.607793 16463 leader_election.cc:290] T 3f70097c1b3a48dfbc1ad129fa7a3730 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:55:03.608805 13886 tablet_bootstrap.cc:492] T d72ef294123b4bcdb8ff63af5de9c621 P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:55:03.609892 13882 tablet_bootstrap.cc:492] T ad7a45187569416bad6c71db9f8ab702 P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:55:03.610105 13886 tablet_bootstrap.cc:654] T d72ef294123b4bcdb8ff63af5de9c621 P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:55:03.610100 13882 ts_tablet_manager.cc:1397] T ad7a45187569416bad6c71db9f8ab702 P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.025s user 0.002s sys 0.005s
I20250830 07:55:03.611503 13882 raft_consensus.cc:357] T ad7a45187569416bad6c71db9f8ab702 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:03.612871 13887 tablet_bootstrap.cc:492] T af3f79e46d6149aa921a4c0ce19c7172 P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:55:03.613040 13887 ts_tablet_manager.cc:1397] T af3f79e46d6149aa921a4c0ce19c7172 P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.078s user 0.002s sys 0.002s
I20250830 07:55:03.613839 13887 raft_consensus.cc:357] T af3f79e46d6149aa921a4c0ce19c7172 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:55:03.614043 13887 raft_consensus.cc:383] T af3f79e46d6149aa921a4c0ce19c7172 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:55:03.614126 13887 raft_consensus.cc:738] T af3f79e46d6149aa921a4c0ce19c7172 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:55:03.614349 13887 consensus_queue.cc:260] T af3f79e46d6149aa921a4c0ce19c7172 P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:55:03.615334 13887 ts_tablet_manager.cc:1428] T af3f79e46d6149aa921a4c0ce19c7172 P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20250830 07:55:03.619007 13765 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f479eef0171c401bbd27beec4486a8b2" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:55:03.619251 13767 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "51aecb7681034f7ca67039ca86a0a618" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:55:03.619417 13771 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "5dffbacf2fcd4a38a1d61cf5bb9c5eeb" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:55:03.619732 13775 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "3f70097c1b3a48dfbc1ad129fa7a3730" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:55:03.620282 13765 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "4b692717d4d34919af71cabb1a82bfd8" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:55:03.620455 13774 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "dad2dfa1a19d45778933780b1029d924" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:55:03.620591 13774 raft_consensus.cc:2466] T dad2dfa1a19d45778933780b1029d924 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2065c332f15a4739899af79f3669c3ba in term 0.
I20250830 07:55:03.633666 13887 tablet_bootstrap.cc:492] T 78a8df3642224d99a86637c1a3a9de5c P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:55:03.634927 13774 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "370441c443be46c2a33132fbc5c41f89" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f"
I20250830 07:55:03.635114 13774 raft_consensus.cc:3058] T 370441c443be46c2a33132fbc5c41f89 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:55:03.635553 16462 consensus_queue.cc:1035] T af449cc407c046eeb5cdfdacffc617a4 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:55:03.637233 13701 leader_election.cc:304] T 690cf258639a4c1ea5a0ac4f2fd39f88 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:55:03.637454 15608 raft_consensus.cc:2802] T 690cf258639a4c1ea5a0ac4f2fd39f88 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election won for term 1
I20250830 07:55:03.637562 13701 leader_election.cc:304] T d7afb311a699495aa8376db6ab206d94 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:55:03.637595 13774 raft_consensus.cc:2466] T 370441c443be46c2a33132fbc5c41f89 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2065c332f15a4739899af79f3669c3ba in term 1.
I20250830 07:55:03.637573 15608 raft_consensus.cc:695] T 690cf258639a4c1ea5a0ac4f2fd39f88 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 LEADER]: Becoming Leader. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Running, Role: LEADER
I20250830 07:55:03.637851 15608 consensus_queue.cc:237] T 690cf258639a4c1ea5a0ac4f2fd39f88 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:03.637989 15751 raft_consensus.cc:2802] T d7afb311a699495aa8376db6ab206d94 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election won for term 1
I20250830 07:55:03.638089 15751 raft_consensus.cc:695] T d7afb311a699495aa8376db6ab206d94 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 LEADER]: Becoming Leader. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Running, Role: LEADER
I20250830 07:55:03.638280 15751 consensus_queue.cc:237] T d7afb311a699495aa8376db6ab206d94 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:03.613387 13611 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "91da20bcd25341b5a0f6605b3ec58fb3" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:55:03.614048 13622 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "370441c443be46c2a33132fbc5c41f89" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:55:03.614662 13617 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "5dffbacf2fcd4a38a1d61cf5bb9c5eeb" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:55:03.615795 13619 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "51aecb7681034f7ca67039ca86a0a618" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:55:03.615988 13629 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "4b692717d4d34919af71cabb1a82bfd8" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:55:03.616480 13624 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "dad2dfa1a19d45778933780b1029d924" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:55:03.617271 13610 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "370441c443be46c2a33132fbc5c41f89" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9"
I20250830 07:55:03.639647 13882 raft_consensus.cc:383] T ad7a45187569416bad6c71db9f8ab702 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:55:03.630549 16463 raft_consensus.cc:491] T 8ee98b748d0245bc8bf9eeac727b495e P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:55:03.640456 16463 raft_consensus.cc:513] T 8ee98b748d0245bc8bf9eeac727b495e P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:03.641045 16463 leader_election.cc:290] T 8ee98b748d0245bc8bf9eeac727b495e P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:55:03.641518 13481 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "8ee98b748d0245bc8bf9eeac727b495e" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:55:03.641714 13481 raft_consensus.cc:2391] T 8ee98b748d0245bc8bf9eeac727b495e P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b5e454d98894637b466ea27f1b647f9 in current term 1: Already voted for candidate 9b057ade5dce45af9f8bf0bedf8b917f in this term.
W20250830 07:55:03.633636 13562 leader_election.cc:343] T 02be33dc658d428fa55e59784a2342f6 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Not found: Tablet not found: 02be33dc658d428fa55e59784a2342f6
I20250830 07:55:03.643477 13562 leader_election.cc:304] T 02be33dc658d428fa55e59784a2342f6 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b5e454d98894637b466ea27f1b647f9; no voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:55:03.644980 16464 raft_consensus.cc:2747] T 02be33dc658d428fa55e59784a2342f6 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:55:03.646200 13562 leader_election.cc:304] T f479eef0171c401bbd27beec4486a8b2 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b5e454d98894637b466ea27f1b647f9; no voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:55:03.646513 13886 tablet_bootstrap.cc:492] T d72ef294123b4bcdb8ff63af5de9c621 P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:55:03.646642 13886 ts_tablet_manager.cc:1397] T d72ef294123b4bcdb8ff63af5de9c621 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.038s user 0.000s sys 0.005s
I20250830 07:55:03.647473 13886 raft_consensus.cc:357] T d72ef294123b4bcdb8ff63af5de9c621 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:03.647632 13886 raft_consensus.cc:383] T d72ef294123b4bcdb8ff63af5de9c621 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:55:03.647676 13886 raft_consensus.cc:738] T d72ef294123b4bcdb8ff63af5de9c621 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:55:03.648267 16255 raft_consensus.cc:2747] T f479eef0171c401bbd27beec4486a8b2 P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20250830 07:55:03.648514 13562 leader_election.cc:304] T 3f70097c1b3a48dfbc1ad129fa7a3730 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b5e454d98894637b466ea27f1b647f9; no voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:55:03.648717 16255 raft_consensus.cc:2747] T 3f70097c1b3a48dfbc1ad129fa7a3730 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:55:03.650350 13701 leader_election.cc:304] T 4639d1b6add8447c9ce071af71a99869 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:55:03.650700 13886 consensus_queue.cc:260] T d72ef294123b4bcdb8ff63af5de9c621 P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:03.651036 15980 raft_consensus.cc:2802] T 4639d1b6add8447c9ce071af71a99869 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election won for term 1
I20250830 07:55:03.651130 15980 raft_consensus.cc:695] T 4639d1b6add8447c9ce071af71a99869 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 LEADER]: Becoming Leader. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Running, Role: LEADER
I20250830 07:55:03.651300 15980 consensus_queue.cc:237] T 4639d1b6add8447c9ce071af71a99869 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:03.651845 16349 raft_consensus.cc:491] T 8921c85fefac415f9a4e5bb7dc38a134 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:55:03.651963 16349 raft_consensus.cc:513] T 8921c85fefac415f9a4e5bb7dc38a134 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:55:03.652493 16349 leader_election.cc:290] T 8921c85fefac415f9a4e5bb7dc38a134 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:55:03.658156 13887 tablet_bootstrap.cc:654] T 78a8df3642224d99a86637c1a3a9de5c P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:55:03.668736 16255 raft_consensus.cc:491] T e7e9d2e9b1ca4ddfb0c6a7bced613c35 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:55:03.668866 16255 raft_consensus.cc:513] T e7e9d2e9b1ca4ddfb0c6a7bced613c35 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:03.669399 16255 leader_election.cc:290] T e7e9d2e9b1ca4ddfb0c6a7bced613c35 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:55:03.669874 13481 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "e7e9d2e9b1ca4ddfb0c6a7bced613c35" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:55:03.670082 13481 raft_consensus.cc:2391] T e7e9d2e9b1ca4ddfb0c6a7bced613c35 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b5e454d98894637b466ea27f1b647f9 in current term 1: Already voted for candidate 9b057ade5dce45af9f8bf0bedf8b917f in this term.
I20250830 07:55:03.640466 13882 raft_consensus.cc:738] T ad7a45187569416bad6c71db9f8ab702 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:55:03.677488 13882 consensus_queue.cc:260] T ad7a45187569416bad6c71db9f8ab702 P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:03.667110 13886 ts_tablet_manager.cc:1428] T d72ef294123b4bcdb8ff63af5de9c621 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.020s user 0.001s sys 0.000s
I20250830 07:55:03.685024 13886 tablet_bootstrap.cc:492] T b4c345013ff04cf991989f456aa2d420 P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:55:03.687968 13886 tablet_bootstrap.cc:654] T b4c345013ff04cf991989f456aa2d420 P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
W20250830 07:55:03.686411 13701 consensus_peers.cc:489] T 1fa571e9490e499792225d7b786e8658 P 9b057ade5dce45af9f8bf0bedf8b917f -> Peer 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325): Couldn't send request to peer 2065c332f15a4739899af79f3669c3ba. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1fa571e9490e499792225d7b786e8658. This is attempt 11: this message will repeat every 5th retry.
I20250830 07:55:03.688691 13887 tablet_bootstrap.cc:492] T 78a8df3642224d99a86637c1a3a9de5c P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:55:03.689651 13887 ts_tablet_manager.cc:1397] T 78a8df3642224d99a86637c1a3a9de5c P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.057s user 0.005s sys 0.003s
I20250830 07:55:03.695919 13887 raft_consensus.cc:357] T 78a8df3642224d99a86637c1a3a9de5c P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:55:03.697247 13887 raft_consensus.cc:383] T 78a8df3642224d99a86637c1a3a9de5c P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:55:03.697486 13887 raft_consensus.cc:738] T 78a8df3642224d99a86637c1a3a9de5c P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:55:03.698251 13887 consensus_queue.cc:260] T 78a8df3642224d99a86637c1a3a9de5c P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:55:03.700397 13887 ts_tablet_manager.cc:1428] T 78a8df3642224d99a86637c1a3a9de5c P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.010s user 0.002s sys 0.000s
I20250830 07:55:03.702982 15863 raft_consensus.cc:491] T 2d91b0ba74034b85812a13719e21dc6c P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:55:03.703110 15863 raft_consensus.cc:513] T 2d91b0ba74034b85812a13719e21dc6c P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:03.703617 15863 leader_election.cc:290] T 2d91b0ba74034b85812a13719e21dc6c P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967)
I20250830 07:55:03.706597 13887 tablet_bootstrap.cc:492] T 7efdf13fd50d419da921c28e21c25757 P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:55:03.707382 15863 consensus_queue.cc:1035] T 8ee98b748d0245bc8bf9eeac727b495e P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:55:03.709512 13887 tablet_bootstrap.cc:654] T 7efdf13fd50d419da921c28e21c25757 P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:55:03.710070 15863 consensus_queue.cc:1035] T 55bd3f378b854476a24f657f5e23843d P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:55:03.710919 15863 consensus_queue.cc:1035] T 1ca83bbf848744f38206ceb4126271be P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:55:03.720269 15863 consensus_queue.cc:1035] T 0d16bc64dd6e43f7ba313b77c2bbb728 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:55:03.720815 13882 ts_tablet_manager.cc:1428] T ad7a45187569416bad6c71db9f8ab702 P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.111s user 0.000s sys 0.002s
I20250830 07:55:03.721128 13882 tablet_bootstrap.cc:492] T ed364f03bdad42b88e181b7d0e1e4011 P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:55:03.725008 13882 tablet_bootstrap.cc:654] T ed364f03bdad42b88e181b7d0e1e4011 P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
W20250830 07:55:03.725541 13422 leader_election.cc:343] T 51aecb7681034f7ca67039ca86a0a618 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Illegal state: must be running to vote when last-logged opid is not known
W20250830 07:55:03.726212 13422 leader_election.cc:343] T 5dffbacf2fcd4a38a1d61cf5bb9c5eeb P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Illegal state: must be running to vote when last-logged opid is not known
W20250830 07:55:03.728206 13422 leader_election.cc:343] T 4b692717d4d34919af71cabb1a82bfd8 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:55:03.728528 13422 leader_election.cc:304] T dad2dfa1a19d45778933780b1029d924 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters:
I20250830 07:55:03.728806 16349 raft_consensus.cc:2802] T dad2dfa1a19d45778933780b1029d924 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:55:03.728873 16349 raft_consensus.cc:491] T dad2dfa1a19d45778933780b1029d924 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:55:03.728929 16349 raft_consensus.cc:3058] T dad2dfa1a19d45778933780b1029d924 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:55:03.730187 13887 tablet_bootstrap.cc:492] T 7efdf13fd50d419da921c28e21c25757 P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:55:03.730297 13887 ts_tablet_manager.cc:1397] T 7efdf13fd50d419da921c28e21c25757 P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.024s user 0.004s sys 0.000s
I20250830 07:55:03.730870 13887 raft_consensus.cc:357] T 7efdf13fd50d419da921c28e21c25757 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:55:03.731036 13887 raft_consensus.cc:383] T 7efdf13fd50d419da921c28e21c25757 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:55:03.731081 13887 raft_consensus.cc:738] T 7efdf13fd50d419da921c28e21c25757 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:55:03.731246 13887 consensus_queue.cc:260] T 7efdf13fd50d419da921c28e21c25757 P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:55:03.731576 16349 raft_consensus.cc:513] T dad2dfa1a19d45778933780b1029d924 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:03.731688 13887 ts_tablet_manager.cc:1428] T 7efdf13fd50d419da921c28e21c25757 P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250830 07:55:03.731925 13887 tablet_bootstrap.cc:492] T 930081bb13454b85ae17bbc4b2b59053 P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:55:03.732105 16349 leader_election.cc:290] T dad2dfa1a19d45778933780b1029d924 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 election: Requested vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:55:03.731690 13629 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "2d91b0ba74034b85812a13719e21dc6c" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:55:03.733230 16349 consensus_queue.cc:1035] T 76dd9dd481fc427fb20f5091e4a3b738 P 2065c332f15a4739899af79f3669c3ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:55:03.733796 13887 tablet_bootstrap.cc:654] T 930081bb13454b85ae17bbc4b2b59053 P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:55:03.733911 16349 consensus_queue.cc:1035] T 508d21af038c4801a9680ce275eb504c P 2065c332f15a4739899af79f3669c3ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:55:03.744779 13774 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "8921c85fefac415f9a4e5bb7dc38a134" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:55:03.747879 13887 tablet_bootstrap.cc:492] T 930081bb13454b85ae17bbc4b2b59053 P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:55:03.747994 13887 ts_tablet_manager.cc:1397] T 930081bb13454b85ae17bbc4b2b59053 P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.016s user 0.003s sys 0.001s
I20250830 07:55:03.748303 13775 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "dad2dfa1a19d45778933780b1029d924" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f"
I20250830 07:55:03.748443 13775 raft_consensus.cc:3058] T dad2dfa1a19d45778933780b1029d924 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:55:03.748613 13887 raft_consensus.cc:357] T 930081bb13454b85ae17bbc4b2b59053 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:55:03.748749 13887 raft_consensus.cc:383] T 930081bb13454b85ae17bbc4b2b59053 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:55:03.748803 13887 raft_consensus.cc:738] T 930081bb13454b85ae17bbc4b2b59053 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:55:03.748962 13887 consensus_queue.cc:260] T 930081bb13454b85ae17bbc4b2b59053 P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:55:03.749316 13887 ts_tablet_manager.cc:1428] T 930081bb13454b85ae17bbc4b2b59053 P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20250830 07:55:03.749517 13887 tablet_bootstrap.cc:492] T 7f749e9eb58b44408d70a5461f10a3ef P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:55:03.750842 13775 raft_consensus.cc:2466] T dad2dfa1a19d45778933780b1029d924 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2065c332f15a4739899af79f3669c3ba in term 1.
I20250830 07:55:03.750908 13887 tablet_bootstrap.cc:654] T 7f749e9eb58b44408d70a5461f10a3ef P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:55:03.760044 13471 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "2d91b0ba74034b85812a13719e21dc6c" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:55:03.760229 13471 raft_consensus.cc:2466] T 2d91b0ba74034b85812a13719e21dc6c P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 0.
I20250830 07:55:03.767068 13629 raft_consensus.cc:3058] T 3f70097c1b3a48dfbc1ad129fa7a3730 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:55:03.773290 13887 tablet_bootstrap.cc:492] T 7f749e9eb58b44408d70a5461f10a3ef P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:55:03.773407 13887 ts_tablet_manager.cc:1397] T 7f749e9eb58b44408d70a5461f10a3ef P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.024s user 0.001s sys 0.005s
I20250830 07:55:03.774009 13887 raft_consensus.cc:357] T 7f749e9eb58b44408d70a5461f10a3ef P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:55:03.774144 13887 raft_consensus.cc:383] T 7f749e9eb58b44408d70a5461f10a3ef P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:55:03.774185 13887 raft_consensus.cc:738] T 7f749e9eb58b44408d70a5461f10a3ef P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:55:03.774327 13887 consensus_queue.cc:260] T 7f749e9eb58b44408d70a5461f10a3ef P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:55:03.774729 13887 ts_tablet_manager.cc:1428] T 7f749e9eb58b44408d70a5461f10a3ef P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20250830 07:55:03.774988 13887 tablet_bootstrap.cc:492] T 473fcf65d49b42dabe9b787cee681f76 P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:55:03.776369 13887 tablet_bootstrap.cc:654] T 473fcf65d49b42dabe9b787cee681f76 P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:55:03.784884 13624 raft_consensus.cc:3058] T 55bd3f378b854476a24f657f5e23843d P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:55:03.788385 13886 tablet_bootstrap.cc:492] T b4c345013ff04cf991989f456aa2d420 P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:55:03.788547 13886 ts_tablet_manager.cc:1397] T b4c345013ff04cf991989f456aa2d420 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.104s user 0.009s sys 0.000s
I20250830 07:55:03.789108 13886 raft_consensus.cc:357] T b4c345013ff04cf991989f456aa2d420 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:03.789367 13886 raft_consensus.cc:383] T b4c345013ff04cf991989f456aa2d420 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:55:03.789454 13886 raft_consensus.cc:738] T b4c345013ff04cf991989f456aa2d420 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:55:03.789639 13886 consensus_queue.cc:260] T b4c345013ff04cf991989f456aa2d420 P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:03.790035 13886 ts_tablet_manager.cc:1428] T b4c345013ff04cf991989f456aa2d420 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250830 07:55:03.790294 13886 tablet_bootstrap.cc:492] T 1f5471a94dc24a28bce5f9dcaa10334a P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:55:03.791848 13886 tablet_bootstrap.cc:654] T 1f5471a94dc24a28bce5f9dcaa10334a P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
W20250830 07:55:03.794524 13423 leader_election.cc:343] T 91da20bcd25341b5a0f6605b3ec58fb3 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:55:03.794646 13423 leader_election.cc:304] T 91da20bcd25341b5a0f6605b3ec58fb3 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba; no voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:55:03.795114 16349 raft_consensus.cc:2747] T 91da20bcd25341b5a0f6605b3ec58fb3 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:55:03.797610 15992 raft_consensus.cc:491] T 55bd3f378b854476a24f657f5e23843d P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:55:03.797734 15992 raft_consensus.cc:513] T 55bd3f378b854476a24f657f5e23843d P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:03.798210 15992 leader_election.cc:290] T 55bd3f378b854476a24f657f5e23843d P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:55:03.798936 13488 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "55bd3f378b854476a24f657f5e23843d" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:55:03.804870 15992 raft_consensus.cc:491] T 122bec4220c74dfaa8228f6d153cd50e P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:55:03.805004 15992 raft_consensus.cc:513] T 122bec4220c74dfaa8228f6d153cd50e P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:03.805552 15992 leader_election.cc:290] T 122bec4220c74dfaa8228f6d153cd50e P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:55:03.806813 13488 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "122bec4220c74dfaa8228f6d153cd50e" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:55:03.807063 13488 raft_consensus.cc:2391] T 122bec4220c74dfaa8228f6d153cd50e P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b5e454d98894637b466ea27f1b647f9 in current term 1: Already voted for candidate 9b057ade5dce45af9f8bf0bedf8b917f in this term.
W20250830 07:55:03.822201 13423 leader_election.cc:343] T 370441c443be46c2a33132fbc5c41f89 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
W20250830 07:55:03.822645 13423 leader_election.cc:343] T 5dffbacf2fcd4a38a1d61cf5bb9c5eeb P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:55:03.822738 13423 leader_election.cc:304] T 5dffbacf2fcd4a38a1d61cf5bb9c5eeb P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba; no voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:55:03.823206 16349 raft_consensus.cc:2747] T 5dffbacf2fcd4a38a1d61cf5bb9c5eeb P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:55:03.824057 13882 tablet_bootstrap.cc:492] T ed364f03bdad42b88e181b7d0e1e4011 P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:55:03.824190 13882 ts_tablet_manager.cc:1397] T ed364f03bdad42b88e181b7d0e1e4011 P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.103s user 0.002s sys 0.000s
W20250830 07:55:03.824626 13423 leader_election.cc:343] T 51aecb7681034f7ca67039ca86a0a618 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:55:03.824728 13423 leader_election.cc:304] T 51aecb7681034f7ca67039ca86a0a618 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba; no voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:55:03.825027 16349 raft_consensus.cc:2747] T 51aecb7681034f7ca67039ca86a0a618 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20250830 07:55:03.825603 13423 leader_election.cc:343] T 4b692717d4d34919af71cabb1a82bfd8 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:55:03.825690 13423 leader_election.cc:304] T 4b692717d4d34919af71cabb1a82bfd8 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba; no voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:55:03.825986 16349 raft_consensus.cc:2747] T 4b692717d4d34919af71cabb1a82bfd8 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20250830 07:55:03.826277 13423 leader_election.cc:343] T dad2dfa1a19d45778933780b1029d924 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
W20250830 07:55:03.826619 13423 leader_election.cc:343] T 370441c443be46c2a33132fbc5c41f89 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:55:03.828249 13887 tablet_bootstrap.cc:492] T 473fcf65d49b42dabe9b787cee681f76 P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:55:03.828373 13887 ts_tablet_manager.cc:1397] T 473fcf65d49b42dabe9b787cee681f76 P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.053s user 0.004s sys 0.015s
I20250830 07:55:03.828922 13422 leader_election.cc:304] T 370441c443be46c2a33132fbc5c41f89 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:55:03.829592 13887 raft_consensus.cc:357] T 473fcf65d49b42dabe9b787cee681f76 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:55:03.830124 13887 raft_consensus.cc:383] T 473fcf65d49b42dabe9b787cee681f76 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:55:03.830336 13887 raft_consensus.cc:738] T 473fcf65d49b42dabe9b787cee681f76 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:55:03.830811 13887 consensus_queue.cc:260] T 473fcf65d49b42dabe9b787cee681f76 P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:55:03.831112 16349 raft_consensus.cc:2802] T 370441c443be46c2a33132fbc5c41f89 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election won for term 1
I20250830 07:55:03.810369 15980 raft_consensus.cc:491] T b85843ab0e3a40e1b453cfdd71bbae5e P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:55:03.827323 13774 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "8ee98b748d0245bc8bf9eeac727b495e" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:55:03.828171 15863 raft_consensus.cc:491] T e2ef8300fb994f98b3565ad708f880cf P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:55:03.834434 15980 raft_consensus.cc:513] T b85843ab0e3a40e1b453cfdd71bbae5e P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:03.834470 15863 raft_consensus.cc:513] T e2ef8300fb994f98b3565ad708f880cf P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:03.834951 15980 leader_election.cc:290] T b85843ab0e3a40e1b453cfdd71bbae5e P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967)
I20250830 07:55:03.835062 15863 leader_election.cc:290] T e2ef8300fb994f98b3565ad708f880cf P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
I20250830 07:55:03.829483 13775 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "e7e9d2e9b1ca4ddfb0c6a7bced613c35" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:55:03.830204 15751 consensus_queue.cc:1035] T ccc9091018cb48ffb2affd98e8bbfa05 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:55:03.835201 13882 raft_consensus.cc:357] T ed364f03bdad42b88e181b7d0e1e4011 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:03.835348 13882 raft_consensus.cc:383] T ed364f03bdad42b88e181b7d0e1e4011 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:55:03.835392 13882 raft_consensus.cc:738] T ed364f03bdad42b88e181b7d0e1e4011 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:55:03.835537 13882 consensus_queue.cc:260] T ed364f03bdad42b88e181b7d0e1e4011 P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:03.835915 13882 ts_tablet_manager.cc:1428] T ed364f03bdad42b88e181b7d0e1e4011 P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.012s user 0.001s sys 0.000s
I20250830 07:55:03.836128 13882 tablet_bootstrap.cc:492] T 4b9d9d4b65964fd49d8e25092a14d774 P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:55:03.841368 13629 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "8921c85fefac415f9a4e5bb7dc38a134" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:55:03.842355 13882 tablet_bootstrap.cc:654] T 4b9d9d4b65964fd49d8e25092a14d774 P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
I20250830 07:55:03.843497 13624 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "dad2dfa1a19d45778933780b1029d924" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9"
I20250830 07:55:03.844211 16349 raft_consensus.cc:695] T 370441c443be46c2a33132fbc5c41f89 P 2065c332f15a4739899af79f3669c3ba [term 1 LEADER]: Becoming Leader. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Running, Role: LEADER
I20250830 07:55:03.844457 16349 consensus_queue.cc:237] T 370441c443be46c2a33132fbc5c41f89 P 2065c332f15a4739899af79f3669c3ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
W20250830 07:55:03.845562 13703 leader_election.cc:343] T 2d91b0ba74034b85812a13719e21dc6c P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:55:03.846779 15980 consensus_queue.cc:1035] T 55bd3f378b854476a24f657f5e23843d P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:55:03.847620 15919 raft_consensus.cc:491] T 533f17f5a9104a6582d9682287c9f1f7 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:55:03.847723 15919 raft_consensus.cc:513] T 533f17f5a9104a6582d9682287c9f1f7 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:55:03.848212 15919 leader_election.cc:290] T 533f17f5a9104a6582d9682287c9f1f7 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:55:03.850450 13887 ts_tablet_manager.cc:1428] T 473fcf65d49b42dabe9b787cee681f76 P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.022s user 0.002s sys 0.000s
I20250830 07:55:03.851613 13887 tablet_bootstrap.cc:492] T 581ae087d60d45e291d899fa03fb89e2 P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:55:03.855826 13887 tablet_bootstrap.cc:654] T 581ae087d60d45e291d899fa03fb89e2 P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:55:03.856402 15919 raft_consensus.cc:491] T 0b574113fee342f98c5574703440ba3a P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:55:03.856513 15919 raft_consensus.cc:513] T 0b574113fee342f98c5574703440ba3a P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
W20250830 07:55:03.856403 16301 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20250830 07:55:03.856771 16301 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20250830 07:55:03.856868 16301 flags.cc:425] Enabled unsafe flag: --never_fsync=true
I20250830 07:55:03.856932 15919 leader_election.cc:290] T 0b574113fee342f98c5574703440ba3a P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:55:03.859009 13882 tablet_bootstrap.cc:492] T 4b9d9d4b65964fd49d8e25092a14d774 P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:55:03.859135 13882 ts_tablet_manager.cc:1397] T 4b9d9d4b65964fd49d8e25092a14d774 P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.023s user 0.004s sys 0.000s
W20250830 07:55:03.832150 13422 leader_election.cc:343] T 8921c85fefac415f9a4e5bb7dc38a134 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:55:03.859799 13882 raft_consensus.cc:357] T 4b9d9d4b65964fd49d8e25092a14d774 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:03.859954 13882 raft_consensus.cc:383] T 4b9d9d4b65964fd49d8e25092a14d774 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:55:03.860005 13882 raft_consensus.cc:738] T 4b9d9d4b65964fd49d8e25092a14d774 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:55:03.860164 13882 consensus_queue.cc:260] T 4b9d9d4b65964fd49d8e25092a14d774 P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:03.860610 13882 ts_tablet_manager.cc:1428] T 4b9d9d4b65964fd49d8e25092a14d774 P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20250830 07:55:03.860863 13882 tablet_bootstrap.cc:492] T adbacbbb13d840a29d8d7d08ea04f6b1 P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:55:03.862389 13882 tablet_bootstrap.cc:654] T adbacbbb13d840a29d8d7d08ea04f6b1 P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
I20250830 07:55:03.864337 13422 leader_election.cc:304] T dad2dfa1a19d45778933780b1029d924 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters:
I20250830 07:55:03.864980 16349 raft_consensus.cc:2802] T dad2dfa1a19d45778933780b1029d924 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election won for term 1
I20250830 07:55:03.865324 16349 raft_consensus.cc:695] T dad2dfa1a19d45778933780b1029d924 P 2065c332f15a4739899af79f3669c3ba [term 1 LEADER]: Becoming Leader. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Running, Role: LEADER
I20250830 07:55:03.865569 16349 consensus_queue.cc:237] T dad2dfa1a19d45778933780b1029d924 P 2065c332f15a4739899af79f3669c3ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:03.874796 15608 consensus_queue.cc:1035] T ccc9091018cb48ffb2affd98e8bbfa05 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:55:03.880019 16252 consensus_queue.cc:1035] T 78fe9f6325c243a490f361aa79295c36 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20250830 07:55:03.882884 13701 leader_election.cc:304] T 2d91b0ba74034b85812a13719e21dc6c P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:55:03.884392 16252 raft_consensus.cc:2802] T 2d91b0ba74034b85812a13719e21dc6c P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:55:03.885470 16252 raft_consensus.cc:491] T 2d91b0ba74034b85812a13719e21dc6c P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:55:03.885686 16252 raft_consensus.cc:3058] T 2d91b0ba74034b85812a13719e21dc6c P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:55:03.888988 13624 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "e2ef8300fb994f98b3565ad708f880cf" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:55:03.889541 13629 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "b85843ab0e3a40e1b453cfdd71bbae5e" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
W20250830 07:55:03.902276 16301 flags.cc:425] Enabled experimental flag: --enable_metadata_cleanup_for_deleted_tables_and_tablets=true
I20250830 07:55:03.903008 15608 raft_consensus.cc:491] T 75359721445e48d2bc0dd6fd17649bc1 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:55:03.903910 15608 raft_consensus.cc:513] T 75359721445e48d2bc0dd6fd17649bc1 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:03.904417 13882 tablet_bootstrap.cc:492] T adbacbbb13d840a29d8d7d08ea04f6b1 P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:55:03.904534 13882 ts_tablet_manager.cc:1397] T adbacbbb13d840a29d8d7d08ea04f6b1 P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.044s user 0.005s sys 0.000s
I20250830 07:55:03.905179 13882 raft_consensus.cc:357] T adbacbbb13d840a29d8d7d08ea04f6b1 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:03.905330 13882 raft_consensus.cc:383] T adbacbbb13d840a29d8d7d08ea04f6b1 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:55:03.905376 13882 raft_consensus.cc:738] T adbacbbb13d840a29d8d7d08ea04f6b1 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:55:03.905531 13882 consensus_queue.cc:260] T adbacbbb13d840a29d8d7d08ea04f6b1 P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:03.905972 13882 ts_tablet_manager.cc:1428] T adbacbbb13d840a29d8d7d08ea04f6b1 P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20250830 07:55:03.906198 13882 tablet_bootstrap.cc:492] T 283aa82b808e49528ceb19133748ffc8 P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:55:03.906230 15608 leader_election.cc:290] T 75359721445e48d2bc0dd6fd17649bc1 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
I20250830 07:55:03.907732 13882 tablet_bootstrap.cc:654] T 283aa82b808e49528ceb19133748ffc8 P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
I20250830 07:55:03.913939 13887 tablet_bootstrap.cc:492] T 581ae087d60d45e291d899fa03fb89e2 P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:55:03.914095 13887 ts_tablet_manager.cc:1397] T 581ae087d60d45e291d899fa03fb89e2 P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.063s user 0.005s sys 0.011s
I20250830 07:55:03.914786 13887 raft_consensus.cc:357] T 581ae087d60d45e291d899fa03fb89e2 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:55:03.914994 13887 raft_consensus.cc:383] T 581ae087d60d45e291d899fa03fb89e2 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:55:03.915066 13887 raft_consensus.cc:738] T 581ae087d60d45e291d899fa03fb89e2 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:55:03.915280 13887 consensus_queue.cc:260] T 581ae087d60d45e291d899fa03fb89e2 P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:55:03.915562 13619 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "75359721445e48d2bc0dd6fd17649bc1" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:55:03.915836 13887 ts_tablet_manager.cc:1428] T 581ae087d60d45e291d899fa03fb89e2 P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20250830 07:55:03.916081 13887 tablet_bootstrap.cc:492] T 529e743ea8ba4dcb879dad1d28087486 P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:55:03.916384 13775 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "55bd3f378b854476a24f657f5e23843d" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:55:03.917393 13882 tablet_bootstrap.cc:492] T 283aa82b808e49528ceb19133748ffc8 P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:55:03.917523 13882 ts_tablet_manager.cc:1397] T 283aa82b808e49528ceb19133748ffc8 P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.011s user 0.003s sys 0.000s
I20250830 07:55:03.918140 13882 raft_consensus.cc:357] T 283aa82b808e49528ceb19133748ffc8 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:03.918322 13882 raft_consensus.cc:383] T 283aa82b808e49528ceb19133748ffc8 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:55:03.918355 13887 tablet_bootstrap.cc:654] T 529e743ea8ba4dcb879dad1d28087486 P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:55:03.918376 13882 raft_consensus.cc:738] T 283aa82b808e49528ceb19133748ffc8 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:55:03.918547 13775 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "533f17f5a9104a6582d9682287c9f1f7" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:55:03.918556 13882 consensus_queue.cc:260] T 283aa82b808e49528ceb19133748ffc8 P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:03.919015 13882 ts_tablet_manager.cc:1428] T 283aa82b808e49528ceb19133748ffc8 P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20250830 07:55:03.919989 13882 tablet_bootstrap.cc:492] T 508d21af038c4801a9680ce275eb504c P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:55:03.921686 13882 tablet_bootstrap.cc:654] T 508d21af038c4801a9680ce275eb504c P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
W20250830 07:55:03.922544 16301 flags.cc:425] Enabled experimental flag: --metadata_for_deleted_table_and_tablet_reserved_secs=0
W20250830 07:55:03.922669 16301 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20250830 07:55:03.923321 16301 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20250830 07:55:03.923434 16301 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20250830 07:55:03.923501 16301 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20250830 07:55:03.925238 15980 raft_consensus.cc:491] T 7676b4d6a75c4c6aacced1f2a1beb555 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:55:03.925365 15980 raft_consensus.cc:513] T 7676b4d6a75c4c6aacced1f2a1beb555 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:03.925828 15980 leader_election.cc:290] T 7676b4d6a75c4c6aacced1f2a1beb555 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967)
I20250830 07:55:03.927119 16349 raft_consensus.cc:491] T 7efdf13fd50d419da921c28e21c25757 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:55:03.927227 16349 raft_consensus.cc:513] T 7efdf13fd50d419da921c28e21c25757 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:55:03.927827 16349 leader_election.cc:290] T 7efdf13fd50d419da921c28e21c25757 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:55:03.931766 13765 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "122bec4220c74dfaa8228f6d153cd50e" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:55:03.931830 13775 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "0b574113fee342f98c5574703440ba3a" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
W20250830 07:55:03.934752 13423 leader_election.cc:343] T 8921c85fefac415f9a4e5bb7dc38a134 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:55:03.934872 13423 leader_election.cc:304] T 8921c85fefac415f9a4e5bb7dc38a134 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba; no voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f
W20250830 07:55:03.935370 13423 consensus_peers.cc:489] T 8dddcfe56522436287aea212e316a729 P 2065c332f15a4739899af79f3669c3ba -> Peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Couldn't send request to peer 6b5e454d98894637b466ea27f1b647f9. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8dddcfe56522436287aea212e316a729. This is attempt 6: this message will repeat every 5th retry.
I20250830 07:55:03.935572 16416 raft_consensus.cc:2747] T 8921c85fefac415f9a4e5bb7dc38a134 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20250830 07:55:03.935616 13423 leader_election.cc:343] T dad2dfa1a19d45778933780b1029d924 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:55:03.936400 15992 raft_consensus.cc:491] T ad7a45187569416bad6c71db9f8ab702 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:55:03.936517 15992 raft_consensus.cc:513] T ad7a45187569416bad6c71db9f8ab702 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:03.936980 15992 leader_election.cc:290] T ad7a45187569416bad6c71db9f8ab702 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:55:03.937003 16252 raft_consensus.cc:513] T 2d91b0ba74034b85812a13719e21dc6c P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:03.939940 13882 tablet_bootstrap.cc:492] T 508d21af038c4801a9680ce275eb504c P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:55:03.940218 13882 ts_tablet_manager.cc:1397] T 508d21af038c4801a9680ce275eb504c P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.020s user 0.002s sys 0.002s
I20250830 07:55:03.940923 13882 raft_consensus.cc:357] T 508d21af038c4801a9680ce275eb504c P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:03.941066 13882 raft_consensus.cc:383] T 508d21af038c4801a9680ce275eb504c P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:55:03.941121 13882 raft_consensus.cc:738] T 508d21af038c4801a9680ce275eb504c P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:55:03.941316 13882 consensus_queue.cc:260] T 508d21af038c4801a9680ce275eb504c P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:03.941816 13882 ts_tablet_manager.cc:1428] T 508d21af038c4801a9680ce275eb504c P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20250830 07:55:03.942775 13882 tablet_bootstrap.cc:492] T 0f34ed0fe6e9400fae5c0edebb615ebd P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:55:03.945598 13882 tablet_bootstrap.cc:654] T 0f34ed0fe6e9400fae5c0edebb615ebd P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
W20250830 07:55:03.943564 13703 leader_election.cc:343] T e2ef8300fb994f98b3565ad708f880cf P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
W20250830 07:55:03.946749 13703 leader_election.cc:343] T b85843ab0e3a40e1b453cfdd71bbae5e P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:55:03.947345 13471 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "ad7a45187569416bad6c71db9f8ab702" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
W20250830 07:55:03.947659 13703 leader_election.cc:343] T 75359721445e48d2bc0dd6fd17649bc1 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:55:03.946260 13886 tablet_bootstrap.cc:492] T 1f5471a94dc24a28bce5f9dcaa10334a P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:55:03.949107 13886 ts_tablet_manager.cc:1397] T 1f5471a94dc24a28bce5f9dcaa10334a P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.159s user 0.006s sys 0.002s
I20250830 07:55:03.949224 13471 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "b85843ab0e3a40e1b453cfdd71bbae5e" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:55:03.949378 13471 raft_consensus.cc:2466] T b85843ab0e3a40e1b453cfdd71bbae5e P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 0.
I20250830 07:55:03.949843 13886 raft_consensus.cc:357] T 1f5471a94dc24a28bce5f9dcaa10334a P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:03.950016 13886 raft_consensus.cc:383] T 1f5471a94dc24a28bce5f9dcaa10334a P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:55:03.950068 13886 raft_consensus.cc:738] T 1f5471a94dc24a28bce5f9dcaa10334a P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:55:03.950461 13886 consensus_queue.cc:260] T 1f5471a94dc24a28bce5f9dcaa10334a P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:03.950968 13886 ts_tablet_manager.cc:1428] T 1f5471a94dc24a28bce5f9dcaa10334a P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20250830 07:55:03.951054 13471 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "e2ef8300fb994f98b3565ad708f880cf" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:55:03.951228 13886 tablet_bootstrap.cc:492] T 559fdab1ef804325978db705431a0ad8 P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:55:03.951210 13471 raft_consensus.cc:2466] T e2ef8300fb994f98b3565ad708f880cf P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 0.
I20250830 07:55:03.952768 13562 leader_election.cc:304] T 8ee98b748d0245bc8bf9eeac727b495e P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b5e454d98894637b466ea27f1b647f9; no voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:55:03.953377 16252 leader_election.cc:290] T 2d91b0ba74034b85812a13719e21dc6c P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Requested vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967)
I20250830 07:55:03.954336 13886 tablet_bootstrap.cc:654] T 559fdab1ef804325978db705431a0ad8 P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:55:03.954252 16301 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.209.20:33943
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/master-0/wal
--catalog_manager_bg_task_wait_ms=10
--enable_metadata_cleanup_for_deleted_tables_and_tablets=true
--metadata_for_deleted_table_and_tablet_reserved_secs=0
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.12.209.62:39725,127.12.209.61:44241,127.12.209.60:43889
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.209.62:39725
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.209.62
--webserver_port=35923
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.19.0-SNAPSHOT
revision 06466b25e294b4d7d455e6c56263318dc34a80ef
build type FASTDEBUG
built by None at 30 Aug 2025 07:43:23 UTC on 24a791456cd2
build id 7812
ASAN enabled
I20250830 07:55:03.955020 16463 raft_consensus.cc:3058] T 8ee98b748d0245bc8bf9eeac727b495e P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:55:03.957372 16463 raft_consensus.cc:2747] T 8ee98b748d0245bc8bf9eeac727b495e P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:55:03.958698 13562 leader_election.cc:304] T e7e9d2e9b1ca4ddfb0c6a7bced613c35 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b5e454d98894637b466ea27f1b647f9; no voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:55:03.958976 16463 raft_consensus.cc:3058] T e7e9d2e9b1ca4ddfb0c6a7bced613c35 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:55:03.962335 16463 raft_consensus.cc:2747] T e7e9d2e9b1ca4ddfb0c6a7bced613c35 P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:55:03.963367 13562 leader_election.cc:304] T 55bd3f378b854476a24f657f5e23843d P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b5e454d98894637b466ea27f1b647f9; no voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:55:03.963665 16463 raft_consensus.cc:2747] T 55bd3f378b854476a24f657f5e23843d P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20250830 07:55:03.964588 13562 leader_election.cc:304] T 122bec4220c74dfaa8228f6d153cd50e P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b5e454d98894637b466ea27f1b647f9; no voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:55:03.964828 16463 raft_consensus.cc:3058] T 122bec4220c74dfaa8228f6d153cd50e P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:55:03.967038 16463 raft_consensus.cc:2747] T 122bec4220c74dfaa8228f6d153cd50e P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:55:03.968286 13624 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "533f17f5a9104a6582d9682287c9f1f7" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:55:03.969005 13624 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "0b574113fee342f98c5574703440ba3a" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:55:03.969560 13624 raft_consensus.cc:3058] T 508d21af038c4801a9680ce275eb504c P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:55:03.972870 13882 tablet_bootstrap.cc:492] T 0f34ed0fe6e9400fae5c0edebb615ebd P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:55:03.972972 13882 ts_tablet_manager.cc:1397] T 0f34ed0fe6e9400fae5c0edebb615ebd P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.030s user 0.004s sys 0.000s
I20250830 07:55:03.973569 13882 raft_consensus.cc:357] T 0f34ed0fe6e9400fae5c0edebb615ebd P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:03.973698 13882 raft_consensus.cc:383] T 0f34ed0fe6e9400fae5c0edebb615ebd P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:55:03.973744 13882 raft_consensus.cc:738] T 0f34ed0fe6e9400fae5c0edebb615ebd P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:55:03.973917 13882 consensus_queue.cc:260] T 0f34ed0fe6e9400fae5c0edebb615ebd P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:03.974340 13882 ts_tablet_manager.cc:1428] T 0f34ed0fe6e9400fae5c0edebb615ebd P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.001s user 0.001s sys 0.001s
I20250830 07:55:03.974560 13882 tablet_bootstrap.cc:492] T f192693039a24e3cb0bec646c8d11056 P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:55:03.975915 13882 tablet_bootstrap.cc:654] T f192693039a24e3cb0bec646c8d11056 P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
I20250830 07:55:03.975925 13629 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "7efdf13fd50d419da921c28e21c25757" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:55:03.977376 13767 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "ad7a45187569416bad6c71db9f8ab702" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:55:03.978684 13887 tablet_bootstrap.cc:492] T 529e743ea8ba4dcb879dad1d28087486 P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:55:03.978801 13887 ts_tablet_manager.cc:1397] T 529e743ea8ba4dcb879dad1d28087486 P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.063s user 0.006s sys 0.003s
W20250830 07:55:03.978967 13423 leader_election.cc:343] T 533f17f5a9104a6582d9682287c9f1f7 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
W20250830 07:55:03.979151 13423 leader_election.cc:343] T 0b574113fee342f98c5574703440ba3a P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:55:03.979643 16081 consensus_queue.cc:1035] T 508d21af038c4801a9680ce275eb504c P 2065c332f15a4739899af79f3669c3ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:55:03.979827 16301 env_posix.cc:2264] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20250830 07:55:03.983568 13887 raft_consensus.cc:357] T 529e743ea8ba4dcb879dad1d28087486 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:55:03.983737 13887 raft_consensus.cc:383] T 529e743ea8ba4dcb879dad1d28087486 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:55:03.983786 13887 raft_consensus.cc:738] T 529e743ea8ba4dcb879dad1d28087486 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:55:03.983927 13887 consensus_queue.cc:260] T 529e743ea8ba4dcb879dad1d28087486 P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:55:03.985114 13887 ts_tablet_manager.cc:1428] T 529e743ea8ba4dcb879dad1d28087486 P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.006s user 0.000s sys 0.002s
I20250830 07:55:03.986791 13887 tablet_bootstrap.cc:492] T cf75d4190d30460f811ce563b16e334b P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:55:03.986974 16301 file_cache.cc:492] Constructed file cache file cache with capacity 419430
I20250830 07:55:03.989285 13887 tablet_bootstrap.cc:654] T cf75d4190d30460f811ce563b16e334b P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:55:03.996152 13887 tablet_bootstrap.cc:492] T cf75d4190d30460f811ce563b16e334b P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:55:03.996263 13887 ts_tablet_manager.cc:1397] T cf75d4190d30460f811ce563b16e334b P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.011s user 0.002s sys 0.000s
I20250830 07:55:03.999076 13471 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "75359721445e48d2bc0dd6fd17649bc1" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:55:03.999245 13471 raft_consensus.cc:2466] T 75359721445e48d2bc0dd6fd17649bc1 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 0.
I20250830 07:55:04.004192 13887 raft_consensus.cc:357] T cf75d4190d30460f811ce563b16e334b P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:55:04.004333 13887 raft_consensus.cc:383] T cf75d4190d30460f811ce563b16e334b P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:55:04.004396 13887 raft_consensus.cc:738] T cf75d4190d30460f811ce563b16e334b P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:55:04.004427 13473 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "7676b4d6a75c4c6aacced1f2a1beb555" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:55:04.004577 13473 raft_consensus.cc:2466] T 7676b4d6a75c4c6aacced1f2a1beb555 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 0.
I20250830 07:55:04.004586 13887 consensus_queue.cc:260] T cf75d4190d30460f811ce563b16e334b P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:55:04.006330 13887 ts_tablet_manager.cc:1428] T cf75d4190d30460f811ce563b16e334b P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.010s user 0.001s sys 0.001s
I20250830 07:55:04.006618 13887 tablet_bootstrap.cc:492] T f0b5a16ef15e466d908a623e64391a0f P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:55:04.008316 13887 tablet_bootstrap.cc:654] T f0b5a16ef15e466d908a623e64391a0f P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:55:04.015091 13882 tablet_bootstrap.cc:492] T f192693039a24e3cb0bec646c8d11056 P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:55:04.015231 13882 ts_tablet_manager.cc:1397] T f192693039a24e3cb0bec646c8d11056 P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.041s user 0.009s sys 0.001s
I20250830 07:55:04.015847 13882 raft_consensus.cc:357] T f192693039a24e3cb0bec646c8d11056 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:04.016010 13882 raft_consensus.cc:383] T f192693039a24e3cb0bec646c8d11056 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:55:04.016079 13882 raft_consensus.cc:738] T f192693039a24e3cb0bec646c8d11056 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:55:04.016291 13882 consensus_queue.cc:260] T f192693039a24e3cb0bec646c8d11056 P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:04.017401 13629 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "7676b4d6a75c4c6aacced1f2a1beb555" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:55:04.017491 13882 ts_tablet_manager.cc:1428] T f192693039a24e3cb0bec646c8d11056 P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20250830 07:55:04.018503 13882 tablet_bootstrap.cc:492] T a3ac09a6d8604297aa8736d1f60484e2 P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:55:04.020110 13882 tablet_bootstrap.cc:654] T a3ac09a6d8604297aa8736d1f60484e2 P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
I20250830 07:55:04.020239 13629 raft_consensus.cc:3058] T 283aa82b808e49528ceb19133748ffc8 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:55:04.020251 13887 tablet_bootstrap.cc:492] T f0b5a16ef15e466d908a623e64391a0f P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:55:04.020869 13887 ts_tablet_manager.cc:1397] T f0b5a16ef15e466d908a623e64391a0f P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.014s user 0.000s sys 0.003s
W20250830 07:55:04.021278 13423 consensus_peers.cc:489] T b678fd915c534a2dac8521c21ab93396 P 2065c332f15a4739899af79f3669c3ba -> Peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Couldn't send request to peer 6b5e454d98894637b466ea27f1b647f9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20250830 07:55:04.021541 13887 raft_consensus.cc:357] T f0b5a16ef15e466d908a623e64391a0f P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:55:04.021551 16081 consensus_queue.cc:1035] T b6717031830f4c57967e87ce077ddb21 P 2065c332f15a4739899af79f3669c3ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:55:04.021726 13887 raft_consensus.cc:383] T f0b5a16ef15e466d908a623e64391a0f P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:55:04.021782 13887 raft_consensus.cc:738] T f0b5a16ef15e466d908a623e64391a0f P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
W20250830 07:55:04.021986 13423 leader_election.cc:343] T 7efdf13fd50d419da921c28e21c25757 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
W20250830 07:55:04.022562 13423 consensus_peers.cc:489] T e24d68b8f5ba4df59a9aeec8ebd6403d P 2065c332f15a4739899af79f3669c3ba -> Peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Couldn't send request to peer 6b5e454d98894637b466ea27f1b647f9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20250830 07:55:04.021996 13887 consensus_queue.cc:260] T f0b5a16ef15e466d908a623e64391a0f P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:55:04.024190 13887 ts_tablet_manager.cc:1428] T f0b5a16ef15e466d908a623e64391a0f P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.003s user 0.000s sys 0.001s
I20250830 07:55:04.024463 13887 tablet_bootstrap.cc:492] T 669e649b53984db3bad8c6121f39fb73 P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:55:04.025013 13476 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "2d91b0ba74034b85812a13719e21dc6c" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba"
I20250830 07:55:04.025254 13476 raft_consensus.cc:3058] T 2d91b0ba74034b85812a13719e21dc6c P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:55:04.027509 13887 tablet_bootstrap.cc:654] T 669e649b53984db3bad8c6121f39fb73 P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:55:04.029867 13886 tablet_bootstrap.cc:492] T 559fdab1ef804325978db705431a0ad8 P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:55:04.030030 13886 ts_tablet_manager.cc:1397] T 559fdab1ef804325978db705431a0ad8 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.079s user 0.003s sys 0.000s
I20250830 07:55:04.031644 13886 raft_consensus.cc:357] T 559fdab1ef804325978db705431a0ad8 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:04.031868 13886 raft_consensus.cc:383] T 559fdab1ef804325978db705431a0ad8 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:55:04.031996 13886 raft_consensus.cc:738] T 559fdab1ef804325978db705431a0ad8 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:55:04.032533 13886 consensus_queue.cc:260] T 559fdab1ef804325978db705431a0ad8 P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:04.035746 13886 ts_tablet_manager.cc:1428] T 559fdab1ef804325978db705431a0ad8 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.006s user 0.001s sys 0.000s
W20250830 07:55:04.035859 16533 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20250830 07:55:04.036546 13882 tablet_bootstrap.cc:492] T a3ac09a6d8604297aa8736d1f60484e2 P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:55:04.037482 13882 ts_tablet_manager.cc:1397] T a3ac09a6d8604297aa8736d1f60484e2 P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.018s user 0.003s sys 0.000s
W20250830 07:55:04.037976 16536 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20250830 07:55:04.038997 13882 raft_consensus.cc:357] T a3ac09a6d8604297aa8736d1f60484e2 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:04.039418 13882 raft_consensus.cc:383] T a3ac09a6d8604297aa8736d1f60484e2 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:55:04.039511 13882 raft_consensus.cc:738] T a3ac09a6d8604297aa8736d1f60484e2 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:55:04.039858 13882 consensus_queue.cc:260] T a3ac09a6d8604297aa8736d1f60484e2 P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:04.040081 13886 tablet_bootstrap.cc:492] T 91da20bcd25341b5a0f6605b3ec58fb3 P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:55:04.040531 13882 ts_tablet_manager.cc:1428] T a3ac09a6d8604297aa8736d1f60484e2 P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20250830 07:55:04.040998 13882 tablet_bootstrap.cc:492] T 4df6d481baab40e2b2c1309d1a8c5351 P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:55:04.041610 13886 tablet_bootstrap.cc:654] T 91da20bcd25341b5a0f6605b3ec58fb3 P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
W20250830 07:55:04.041726 16539 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20250830 07:55:04.042860 13882 tablet_bootstrap.cc:654] T 4df6d481baab40e2b2c1309d1a8c5351 P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
I20250830 07:55:04.043762 13476 raft_consensus.cc:2466] T 2d91b0ba74034b85812a13719e21dc6c P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 1.
I20250830 07:55:04.044790 13887 tablet_bootstrap.cc:492] T 669e649b53984db3bad8c6121f39fb73 P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:55:04.045634 13624 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "2d91b0ba74034b85812a13719e21dc6c" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9"
I20250830 07:55:04.045787 13887 ts_tablet_manager.cc:1397] T 669e649b53984db3bad8c6121f39fb73 P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.021s user 0.000s sys 0.003s
I20250830 07:55:04.046380 16301 server_base.cc:1047] running on GCE node
I20250830 07:55:04.047089 13887 raft_consensus.cc:357] T 669e649b53984db3bad8c6121f39fb73 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:55:04.047564 16301 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20250830 07:55:04.047380 13887 raft_consensus.cc:383] T 669e649b53984db3bad8c6121f39fb73 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:55:04.048256 13887 raft_consensus.cc:738] T 669e649b53984db3bad8c6121f39fb73 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:55:04.050176 13774 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "7efdf13fd50d419da921c28e21c25757" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:55:04.053292 13701 leader_election.cc:304] T b85843ab0e3a40e1b453cfdd71bbae5e P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:55:04.052479 13887 consensus_queue.cc:260] T 669e649b53984db3bad8c6121f39fb73 P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:55:04.053746 15748 raft_consensus.cc:2802] T b85843ab0e3a40e1b453cfdd71bbae5e P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:55:04.053812 15748 raft_consensus.cc:491] T b85843ab0e3a40e1b453cfdd71bbae5e P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:55:04.053884 15748 raft_consensus.cc:3058] T b85843ab0e3a40e1b453cfdd71bbae5e P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:55:04.056350 15748 raft_consensus.cc:513] T b85843ab0e3a40e1b453cfdd71bbae5e P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:04.056286 13887 ts_tablet_manager.cc:1428] T 669e649b53984db3bad8c6121f39fb73 P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.010s user 0.001s sys 0.001s
I20250830 07:55:04.056862 15748 leader_election.cc:290] T b85843ab0e3a40e1b453cfdd71bbae5e P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Requested vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967)
I20250830 07:55:04.057718 13701 leader_election.cc:304] T e2ef8300fb994f98b3565ad708f880cf P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:55:04.057739 13887 tablet_bootstrap.cc:492] T 9b9631c8038a4c6eb9fd0530511777ac P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:55:04.058642 15751 raft_consensus.cc:2802] T e2ef8300fb994f98b3565ad708f880cf P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:55:04.058705 15751 raft_consensus.cc:491] T e2ef8300fb994f98b3565ad708f880cf P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:55:04.058764 15751 raft_consensus.cc:3058] T e2ef8300fb994f98b3565ad708f880cf P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:55:04.061132 15751 raft_consensus.cc:513] T e2ef8300fb994f98b3565ad708f880cf P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:04.061614 15751 leader_election.cc:290] T e2ef8300fb994f98b3565ad708f880cf P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Requested vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
W20250830 07:55:04.062011 13703 leader_election.cc:343] T 7676b4d6a75c4c6aacced1f2a1beb555 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:55:04.063625 13886 tablet_bootstrap.cc:492] T 91da20bcd25341b5a0f6605b3ec58fb3 P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:55:04.063740 13886 ts_tablet_manager.cc:1397] T 91da20bcd25341b5a0f6605b3ec58fb3 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.024s user 0.002s sys 0.000s
I20250830 07:55:04.064440 13886 raft_consensus.cc:357] T 91da20bcd25341b5a0f6605b3ec58fb3 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:04.064626 13886 raft_consensus.cc:383] T 91da20bcd25341b5a0f6605b3ec58fb3 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:55:04.064678 13886 raft_consensus.cc:738] T 91da20bcd25341b5a0f6605b3ec58fb3 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:55:04.064949 13886 consensus_queue.cc:260] T 91da20bcd25341b5a0f6605b3ec58fb3 P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:04.065433 13886 ts_tablet_manager.cc:1428] T 91da20bcd25341b5a0f6605b3ec58fb3 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20250830 07:55:04.065662 13886 tablet_bootstrap.cc:492] T 986878a23a0b47ee865e09277b027bb0 P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:55:04.067309 13886 tablet_bootstrap.cc:654] T 986878a23a0b47ee865e09277b027bb0 P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:55:04.073609 13886 tablet_bootstrap.cc:492] T 986878a23a0b47ee865e09277b027bb0 P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:55:04.073732 13886 ts_tablet_manager.cc:1397] T 986878a23a0b47ee865e09277b027bb0 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.008s user 0.000s sys 0.004s
I20250830 07:55:04.074281 13886 raft_consensus.cc:357] T 986878a23a0b47ee865e09277b027bb0 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:04.074421 13886 raft_consensus.cc:383] T 986878a23a0b47ee865e09277b027bb0 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:55:04.074472 13886 raft_consensus.cc:738] T 986878a23a0b47ee865e09277b027bb0 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:55:04.075363 16301 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20250830 07:55:04.075716 16259 raft_consensus.cc:491] T 9bc54e40f9eb4271aa3132986c249e51 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:55:04.075812 16259 raft_consensus.cc:513] T 9bc54e40f9eb4271aa3132986c249e51 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:04.076233 16259 leader_election.cc:290] T 9bc54e40f9eb4271aa3132986c249e51 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
I20250830 07:55:04.076699 13886 consensus_queue.cc:260] T 986878a23a0b47ee865e09277b027bb0 P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:04.077407 13886 ts_tablet_manager.cc:1428] T 986878a23a0b47ee865e09277b027bb0 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20250830 07:55:04.077879 13886 tablet_bootstrap.cc:492] T fac764a2d269411c86b85ceeaec0b014 P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:55:04.079155 13701 leader_election.cc:304] T 75359721445e48d2bc0dd6fd17649bc1 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:55:04.079456 16259 raft_consensus.cc:2802] T 75359721445e48d2bc0dd6fd17649bc1 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:55:04.079527 16259 raft_consensus.cc:491] T 75359721445e48d2bc0dd6fd17649bc1 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:55:04.079578 16259 raft_consensus.cc:3058] T 75359721445e48d2bc0dd6fd17649bc1 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:55:04.079999 13886 tablet_bootstrap.cc:654] T fac764a2d269411c86b85ceeaec0b014 P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:55:04.082207 16259 raft_consensus.cc:513] T 75359721445e48d2bc0dd6fd17649bc1 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:04.082810 16259 leader_election.cc:290] T 75359721445e48d2bc0dd6fd17649bc1 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Requested vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
I20250830 07:55:04.082830 16301 hybrid_clock.cc:648] HybridClock initialized: now 1756540504082738 us; error 92 us; skew 500 ppm
I20250830 07:55:04.083274 16301 server_base.cc:847] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20250830 07:55:04.084136 16463 raft_consensus.cc:491] T 0f34ed0fe6e9400fae5c0edebb615ebd P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:55:04.084261 16463 raft_consensus.cc:513] T 0f34ed0fe6e9400fae5c0edebb615ebd P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:04.084460 13701 leader_election.cc:304] T 7676b4d6a75c4c6aacced1f2a1beb555 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:55:04.084774 16463 leader_election.cc:290] T 0f34ed0fe6e9400fae5c0edebb615ebd P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:55:04.084862 15751 raft_consensus.cc:2802] T 7676b4d6a75c4c6aacced1f2a1beb555 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:55:04.084932 15751 raft_consensus.cc:491] T 7676b4d6a75c4c6aacced1f2a1beb555 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:55:04.085004 15751 raft_consensus.cc:3058] T 7676b4d6a75c4c6aacced1f2a1beb555 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:55:04.085399 13476 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "0f34ed0fe6e9400fae5c0edebb615ebd" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:55:04.087549 15751 raft_consensus.cc:513] T 7676b4d6a75c4c6aacced1f2a1beb555 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:04.088092 15751 leader_election.cc:290] T 7676b4d6a75c4c6aacced1f2a1beb555 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Requested vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967)
I20250830 07:55:04.091409 13887 tablet_bootstrap.cc:654] T 9b9631c8038a4c6eb9fd0530511777ac P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:55:04.101603 15720 consensus_queue.cc:1035] T e7e9d2e9b1ca4ddfb0c6a7bced613c35 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:55:04.102965 16259 raft_consensus.cc:491] T e74a3e4b3b234c41aca30f772525652e P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:55:04.103132 16259 raft_consensus.cc:513] T e74a3e4b3b234c41aca30f772525652e P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:04.103910 16259 leader_election.cc:290] T e74a3e4b3b234c41aca30f772525652e P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
I20250830 07:55:04.107084 15980 raft_consensus.cc:491] T 986878a23a0b47ee865e09277b027bb0 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:55:04.107236 15980 raft_consensus.cc:513] T 986878a23a0b47ee865e09277b027bb0 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:04.108165 15980 leader_election.cc:290] T 986878a23a0b47ee865e09277b027bb0 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
I20250830 07:55:04.115890 16543 consensus_queue.cc:1035] T 283aa82b808e49528ceb19133748ffc8 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20250830 07:55:04.117069 13703 consensus_peers.cc:489] T 3525652a73b8413b8ccbcb5824cc5880 P 9b057ade5dce45af9f8bf0bedf8b917f -> Peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Couldn't send request to peer 6b5e454d98894637b466ea27f1b647f9. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3525652a73b8413b8ccbcb5824cc5880. This is attempt 6: this message will repeat every 5th retry.
W20250830 07:55:04.117941 13703 leader_election.cc:343] T 2d91b0ba74034b85812a13719e21dc6c P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
W20250830 07:55:04.118163 13422 leader_election.cc:343] T 533f17f5a9104a6582d9682287c9f1f7 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Illegal state: must be running to vote when last-logged opid is not known
W20250830 07:55:04.118332 13703 consensus_peers.cc:489] T 7dc061ebaa334c109d1e457e2dc860df P 9b057ade5dce45af9f8bf0bedf8b917f -> Peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Couldn't send request to peer 6b5e454d98894637b466ea27f1b647f9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20250830 07:55:04.118376 13422 leader_election.cc:304] T 533f17f5a9104a6582d9682287c9f1f7 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba; no voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:55:04.118763 16529 raft_consensus.cc:2747] T 533f17f5a9104a6582d9682287c9f1f7 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20250830 07:55:04.129885 13422 leader_election.cc:343] T 0b574113fee342f98c5574703440ba3a P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:55:04.130152 13422 leader_election.cc:304] T 0b574113fee342f98c5574703440ba3a P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba; no voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:55:04.130611 16529 raft_consensus.cc:2747] T 0b574113fee342f98c5574703440ba3a P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:55:04.133525 16529 consensus_queue.cc:1035] T 4df6d481baab40e2b2c1309d1a8c5351 P 2065c332f15a4739899af79f3669c3ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:55:04.134585 13886 tablet_bootstrap.cc:492] T fac764a2d269411c86b85ceeaec0b014 P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:55:04.134696 13886 ts_tablet_manager.cc:1397] T fac764a2d269411c86b85ceeaec0b014 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.057s user 0.005s sys 0.012s
I20250830 07:55:04.134867 13882 tablet_bootstrap.cc:492] T 4df6d481baab40e2b2c1309d1a8c5351 P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:55:04.135076 13882 ts_tablet_manager.cc:1397] T 4df6d481baab40e2b2c1309d1a8c5351 P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.094s user 0.020s sys 0.004s
I20250830 07:55:04.135253 13886 raft_consensus.cc:357] T fac764a2d269411c86b85ceeaec0b014 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:04.135380 13886 raft_consensus.cc:383] T fac764a2d269411c86b85ceeaec0b014 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:55:04.135738 13882 raft_consensus.cc:357] T 4df6d481baab40e2b2c1309d1a8c5351 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:04.135885 13882 raft_consensus.cc:383] T 4df6d481baab40e2b2c1309d1a8c5351 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:55:04.135932 13882 raft_consensus.cc:738] T 4df6d481baab40e2b2c1309d1a8c5351 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:55:04.136134 13882 consensus_queue.cc:260] T 4df6d481baab40e2b2c1309d1a8c5351 P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:04.137100 13882 ts_tablet_manager.cc:1428] T 4df6d481baab40e2b2c1309d1a8c5351 P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20250830 07:55:04.137346 13882 tablet_bootstrap.cc:492] T 7e9d6af1d7fc4d4b961583b44f2f962a P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:55:04.135424 13886 raft_consensus.cc:738] T fac764a2d269411c86b85ceeaec0b014 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:55:04.138895 13882 tablet_bootstrap.cc:654] T 7e9d6af1d7fc4d4b961583b44f2f962a P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
I20250830 07:55:04.138811 13887 tablet_bootstrap.cc:492] T 9b9631c8038a4c6eb9fd0530511777ac P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:55:04.139278 13887 ts_tablet_manager.cc:1397] T 9b9631c8038a4c6eb9fd0530511777ac P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.082s user 0.004s sys 0.001s
I20250830 07:55:04.140427 13886 consensus_queue.cc:260] T fac764a2d269411c86b85ceeaec0b014 P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:04.141106 13887 raft_consensus.cc:357] T 9b9631c8038a4c6eb9fd0530511777ac P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:55:04.141669 13886 ts_tablet_manager.cc:1428] T fac764a2d269411c86b85ceeaec0b014 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
I20250830 07:55:04.141482 13887 raft_consensus.cc:383] T 9b9631c8038a4c6eb9fd0530511777ac P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20250830 07:55:04.142132 13221 catalog_manager.cc:4726] Async tablet task AlterTable RPC for tablet 6fe94553af384cbdbbde85dd285fc2f3 (table default.Table_cb7e61ad3b5141c9967497b29c213e2d [id=58c192ac19924218a9657d9b89cd398c], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 6fe94553af384cbdbbde85dd285fc2f3 has no consensus state
I20250830 07:55:04.142117 13887 raft_consensus.cc:738] T 9b9631c8038a4c6eb9fd0530511777ac P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:55:04.142575 13886 tablet_bootstrap.cc:492] T 5dffbacf2fcd4a38a1d61cf5bb9c5eeb P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:55:04.143087 13887 consensus_queue.cc:260] T 9b9631c8038a4c6eb9fd0530511777ac P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:55:04.144219 13886 tablet_bootstrap.cc:654] T 5dffbacf2fcd4a38a1d61cf5bb9c5eeb P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
W20250830 07:55:04.136351 13422 leader_election.cc:343] T 7efdf13fd50d419da921c28e21c25757 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:55:04.144642 13422 leader_election.cc:304] T 7efdf13fd50d419da921c28e21c25757 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba; no voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:55:04.145642 13887 ts_tablet_manager.cc:1428] T 9b9631c8038a4c6eb9fd0530511777ac P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.006s user 0.001s sys 0.001s
I20250830 07:55:04.146118 16301 webserver.cc:480] Webserver started at http://127.12.209.62:35923/ using document root <none> and password file <none>
I20250830 07:55:04.146585 16529 raft_consensus.cc:2747] T 7efdf13fd50d419da921c28e21c25757 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:55:04.147198 16301 fs_manager.cc:362] Metadata directory not provided
I20250830 07:55:04.147310 16301 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20250830 07:55:04.148926 13887 tablet_bootstrap.cc:492] T becf9667a0fc4507bc114407090c055c P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:55:04.153170 13701 leader_election.cc:304] T 2d91b0ba74034b85812a13719e21dc6c P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters: 6b5e454d98894637b466ea27f1b647f9
I20250830 07:55:04.153614 16252 raft_consensus.cc:2802] T 2d91b0ba74034b85812a13719e21dc6c P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election won for term 1
I20250830 07:55:04.153741 16252 raft_consensus.cc:695] T 2d91b0ba74034b85812a13719e21dc6c P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 LEADER]: Becoming Leader. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Running, Role: LEADER
I20250830 07:55:04.153981 16252 consensus_queue.cc:237] T 2d91b0ba74034b85812a13719e21dc6c P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:04.155652 13886 tablet_bootstrap.cc:492] T 5dffbacf2fcd4a38a1d61cf5bb9c5eeb P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:55:04.155750 13886 ts_tablet_manager.cc:1397] T 5dffbacf2fcd4a38a1d61cf5bb9c5eeb P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.014s user 0.002s sys 0.000s
I20250830 07:55:04.156337 13886 raft_consensus.cc:357] T 5dffbacf2fcd4a38a1d61cf5bb9c5eeb P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:04.156507 13886 raft_consensus.cc:383] T 5dffbacf2fcd4a38a1d61cf5bb9c5eeb P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:55:04.156546 13886 raft_consensus.cc:738] T 5dffbacf2fcd4a38a1d61cf5bb9c5eeb P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:55:04.156719 13886 consensus_queue.cc:260] T 5dffbacf2fcd4a38a1d61cf5bb9c5eeb P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:04.158025 16349 raft_consensus.cc:491] T cf75d4190d30460f811ce563b16e334b P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:55:04.158138 16349 raft_consensus.cc:513] T cf75d4190d30460f811ce563b16e334b P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:55:04.158304 13562 leader_election.cc:304] T ad7a45187569416bad6c71db9f8ab702 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b5e454d98894637b466ea27f1b647f9; no voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:55:04.158628 16349 leader_election.cc:290] T cf75d4190d30460f811ce563b16e334b P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:55:04.158696 15992 raft_consensus.cc:2747] T ad7a45187569416bad6c71db9f8ab702 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:55:04.159144 13886 ts_tablet_manager.cc:1428] T 5dffbacf2fcd4a38a1d61cf5bb9c5eeb P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20250830 07:55:04.159726 13886 tablet_bootstrap.cc:492] T 6fb5cd3618584dd3a0ee43a10f7a2660 P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:55:04.161230 13886 tablet_bootstrap.cc:654] T 6fb5cd3618584dd3a0ee43a10f7a2660 P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:55:04.169548 13882 tablet_bootstrap.cc:492] T 7e9d6af1d7fc4d4b961583b44f2f962a P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:55:04.169649 13882 ts_tablet_manager.cc:1397] T 7e9d6af1d7fc4d4b961583b44f2f962a P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.032s user 0.002s sys 0.000s
I20250830 07:55:04.173229 13774 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "0f34ed0fe6e9400fae5c0edebb615ebd" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:55:04.173704 16301 fs_manager.cc:714] Time spent opening directory manager: real 0.024s user 0.005s sys 0.002s
I20250830 07:55:04.175266 16529 raft_consensus.cc:491] T aab8d9a009d34166920905ad06ed153b P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:55:04.175446 16529 raft_consensus.cc:513] T aab8d9a009d34166920905ad06ed153b P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:55:04.176136 16529 leader_election.cc:290] T aab8d9a009d34166920905ad06ed153b P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:55:04.176916 13882 raft_consensus.cc:357] T 7e9d6af1d7fc4d4b961583b44f2f962a P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:04.177059 13882 raft_consensus.cc:383] T 7e9d6af1d7fc4d4b961583b44f2f962a P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:55:04.177100 13882 raft_consensus.cc:738] T 7e9d6af1d7fc4d4b961583b44f2f962a P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:55:04.180202 13886 tablet_bootstrap.cc:492] T 6fb5cd3618584dd3a0ee43a10f7a2660 P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:55:04.180313 13886 ts_tablet_manager.cc:1397] T 6fb5cd3618584dd3a0ee43a10f7a2660 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.021s user 0.001s sys 0.003s
I20250830 07:55:04.180814 13886 raft_consensus.cc:357] T 6fb5cd3618584dd3a0ee43a10f7a2660 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:04.180970 13886 raft_consensus.cc:383] T 6fb5cd3618584dd3a0ee43a10f7a2660 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:55:04.181026 13886 raft_consensus.cc:738] T 6fb5cd3618584dd3a0ee43a10f7a2660 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:55:04.181186 13886 consensus_queue.cc:260] T 6fb5cd3618584dd3a0ee43a10f7a2660 P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:04.182032 16529 raft_consensus.cc:491] T 9f27983af2c84dd6a40e7e0b900a9dc6 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:55:04.182049 13886 ts_tablet_manager.cc:1428] T 6fb5cd3618584dd3a0ee43a10f7a2660 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20250830 07:55:04.182175 16529 raft_consensus.cc:513] T 9f27983af2c84dd6a40e7e0b900a9dc6 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:55:04.182266 13886 tablet_bootstrap.cc:492] T a5eea1950d1945f1b755fd34597b2fb4 P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:55:04.182766 16529 leader_election.cc:290] T 9f27983af2c84dd6a40e7e0b900a9dc6 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:55:04.184557 13886 tablet_bootstrap.cc:654] T a5eea1950d1945f1b755fd34597b2fb4 P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:55:04.187188 16558 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20250830 07:55:04.187443 16349 raft_consensus.cc:491] T 736de5dbaf7f4f449f6fc323ab6a72d8 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:55:04.187551 16349 raft_consensus.cc:513] T 736de5dbaf7f4f449f6fc323ab6a72d8 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:55:04.187989 16349 leader_election.cc:290] T 736de5dbaf7f4f449f6fc323ab6a72d8 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:55:04.188865 16301 fs_manager.cc:730] Time spent opening block manager: real 0.013s user 0.002s sys 0.000s
I20250830 07:55:04.189076 16301 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/master-0/data,/tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/master-0/wal
uuid: "fea6152429cc4e79a25b18e02aafae57"
format_stamp: "Formatted at 2025-08-30 07:54:27 on dist-test-slave-g8n5"
I20250830 07:55:04.189998 16301 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskbivBUj/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1756540467382493-13124-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20250830 07:55:04.193511 13476 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "b85843ab0e3a40e1b453cfdd71bbae5e" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba"
I20250830 07:55:04.193652 13476 raft_consensus.cc:3058] T b85843ab0e3a40e1b453cfdd71bbae5e P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:55:04.195809 13887 tablet_bootstrap.cc:654] T becf9667a0fc4507bc114407090c055c P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:55:04.196985 13471 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "e2ef8300fb994f98b3565ad708f880cf" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba"
I20250830 07:55:04.197149 13471 raft_consensus.cc:3058] T e2ef8300fb994f98b3565ad708f880cf P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:55:04.198321 13476 raft_consensus.cc:2466] T b85843ab0e3a40e1b453cfdd71bbae5e P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 1.
I20250830 07:55:04.199227 13886 tablet_bootstrap.cc:492] T a5eea1950d1945f1b755fd34597b2fb4 P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:55:04.199316 13886 ts_tablet_manager.cc:1397] T a5eea1950d1945f1b755fd34597b2fb4 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.017s user 0.003s sys 0.000s
I20250830 07:55:04.199476 13471 raft_consensus.cc:2466] T e2ef8300fb994f98b3565ad708f880cf P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 1.
I20250830 07:55:04.199828 13886 raft_consensus.cc:357] T a5eea1950d1945f1b755fd34597b2fb4 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:04.199990 13886 raft_consensus.cc:383] T a5eea1950d1945f1b755fd34597b2fb4 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:55:04.200034 13886 raft_consensus.cc:738] T a5eea1950d1945f1b755fd34597b2fb4 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:55:04.193352 13882 consensus_queue.cc:260] T 7e9d6af1d7fc4d4b961583b44f2f962a P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:04.200184 13886 consensus_queue.cc:260] T a5eea1950d1945f1b755fd34597b2fb4 P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:04.200500 13886 ts_tablet_manager.cc:1428] T a5eea1950d1945f1b755fd34597b2fb4 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20250830 07:55:04.201161 13886 tablet_bootstrap.cc:492] T 6f8b6f233e5c49b39b3ef6314508e9d9 P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:55:04.201661 13624 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "b85843ab0e3a40e1b453cfdd71bbae5e" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9"
I20250830 07:55:04.203044 13886 tablet_bootstrap.cc:654] T 6f8b6f233e5c49b39b3ef6314508e9d9 P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:55:04.202643 13882 ts_tablet_manager.cc:1428] T 7e9d6af1d7fc4d4b961583b44f2f962a P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.028s user 0.001s sys 0.000s
I20250830 07:55:04.203819 13471 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "9bc54e40f9eb4271aa3132986c249e51" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:55:04.204007 13471 raft_consensus.cc:2466] T 9bc54e40f9eb4271aa3132986c249e51 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 0.
I20250830 07:55:04.204630 13624 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "e2ef8300fb994f98b3565ad708f880cf" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9"
I20250830 07:55:04.205118 13882 tablet_bootstrap.cc:492] T a5eea1950d1945f1b755fd34597b2fb4 P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:55:04.206332 16463 raft_consensus.cc:491] T adbacbbb13d840a29d8d7d08ea04f6b1 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:55:04.206440 16463 raft_consensus.cc:513] T adbacbbb13d840a29d8d7d08ea04f6b1 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:04.207124 16463 leader_election.cc:290] T adbacbbb13d840a29d8d7d08ea04f6b1 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:55:04.207684 13471 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "adbacbbb13d840a29d8d7d08ea04f6b1" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:55:04.208129 13473 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "75359721445e48d2bc0dd6fd17649bc1" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba"
I20250830 07:55:04.208287 13473 raft_consensus.cc:3058] T 75359721445e48d2bc0dd6fd17649bc1 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:55:04.210340 13476 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "7676b4d6a75c4c6aacced1f2a1beb555" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba"
I20250830 07:55:04.210512 13476 raft_consensus.cc:3058] T 7676b4d6a75c4c6aacced1f2a1beb555 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:55:04.210638 13473 raft_consensus.cc:2466] T 75359721445e48d2bc0dd6fd17649bc1 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 1.
I20250830 07:55:04.211333 13624 raft_consensus.cc:3058] T adbacbbb13d840a29d8d7d08ea04f6b1 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:55:04.213234 13476 raft_consensus.cc:2466] T 7676b4d6a75c4c6aacced1f2a1beb555 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 1.
I20250830 07:55:04.215420 13629 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "9bc54e40f9eb4271aa3132986c249e51" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:55:04.216595 13629 raft_consensus.cc:3058] T 7e9d6af1d7fc4d4b961583b44f2f962a P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:55:04.218014 13886 tablet_bootstrap.cc:492] T 6f8b6f233e5c49b39b3ef6314508e9d9 P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:55:04.218134 13886 ts_tablet_manager.cc:1397] T 6f8b6f233e5c49b39b3ef6314508e9d9 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.017s user 0.001s sys 0.004s
I20250830 07:55:04.218663 13886 raft_consensus.cc:357] T 6f8b6f233e5c49b39b3ef6314508e9d9 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:04.218802 13886 raft_consensus.cc:383] T 6f8b6f233e5c49b39b3ef6314508e9d9 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:55:04.218842 13886 raft_consensus.cc:738] T 6f8b6f233e5c49b39b3ef6314508e9d9 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:55:04.219017 13886 consensus_queue.cc:260] T 6f8b6f233e5c49b39b3ef6314508e9d9 P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:04.219776 13886 ts_tablet_manager.cc:1428] T 6f8b6f233e5c49b39b3ef6314508e9d9 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20250830 07:55:04.220299 13886 tablet_bootstrap.cc:492] T 669e649b53984db3bad8c6121f39fb73 P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:55:04.221828 13886 tablet_bootstrap.cc:654] T 669e649b53984db3bad8c6121f39fb73 P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:55:04.221807 13471 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "e74a3e4b3b234c41aca30f772525652e" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:55:04.222013 13471 raft_consensus.cc:2466] T e74a3e4b3b234c41aca30f772525652e P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 1.
I20250830 07:55:04.222586 13887 tablet_bootstrap.cc:492] T becf9667a0fc4507bc114407090c055c P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:55:04.222731 13471 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "986878a23a0b47ee865e09277b027bb0" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:55:04.222919 13471 raft_consensus.cc:2466] T 986878a23a0b47ee865e09277b027bb0 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 0.
I20250830 07:55:04.222729 13887 ts_tablet_manager.cc:1397] T becf9667a0fc4507bc114407090c055c P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.074s user 0.002s sys 0.002s
W20250830 07:55:04.227267 15882 negotiation.cc:337] Failed RPC negotiation. Trace:
0830 07:55:01.212389 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.209.61:44241 (local address 127.0.0.1:40260)
0830 07:55:01.212515 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0830 07:55:01.212530 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0830 07:55:01.212626 (+ 96us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0830 07:55:04.227093 (+3014467us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.12.209.61:44241: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":37}
W20250830 07:55:04.227443 14988 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: Client connection negotiation failed: client connection to 127.12.209.61:44241: received 0 of 4 requested bytes [suppressed 3 similar messages]
I20250830 07:55:04.227766 13887 raft_consensus.cc:357] T becf9667a0fc4507bc114407090c055c P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:55:04.227941 13887 raft_consensus.cc:383] T becf9667a0fc4507bc114407090c055c P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:55:04.228029 13887 raft_consensus.cc:738] T becf9667a0fc4507bc114407090c055c P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:55:04.228513 13887 consensus_queue.cc:260] T becf9667a0fc4507bc114407090c055c P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:55:04.229290 13887 ts_tablet_manager.cc:1428] T becf9667a0fc4507bc114407090c055c P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20250830 07:55:04.229642 13887 tablet_bootstrap.cc:492] T d1a99857f707440d9edd0b30d918b2ff P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:55:04.230792 13629 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "75359721445e48d2bc0dd6fd17649bc1" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9"
I20250830 07:55:04.231997 13887 tablet_bootstrap.cc:654] T d1a99857f707440d9edd0b30d918b2ff P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:55:04.239040 13619 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "7676b4d6a75c4c6aacced1f2a1beb555" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9"
I20250830 07:55:04.253391 13886 tablet_bootstrap.cc:492] T 669e649b53984db3bad8c6121f39fb73 P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:55:04.253511 13886 ts_tablet_manager.cc:1397] T 669e649b53984db3bad8c6121f39fb73 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.034s user 0.003s sys 0.001s
I20250830 07:55:04.254063 13886 raft_consensus.cc:357] T 669e649b53984db3bad8c6121f39fb73 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:55:04.254204 13886 raft_consensus.cc:383] T 669e649b53984db3bad8c6121f39fb73 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:55:04.254247 13886 raft_consensus.cc:738] T 669e649b53984db3bad8c6121f39fb73 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:55:04.254423 13886 consensus_queue.cc:260] T 669e649b53984db3bad8c6121f39fb73 P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:55:04.254961 13886 ts_tablet_manager.cc:1428] T 669e649b53984db3bad8c6121f39fb73 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.001s user 0.001s sys 0.001s
I20250830 07:55:04.255168 13886 tablet_bootstrap.cc:492] T 7f749e9eb58b44408d70a5461f10a3ef P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:55:04.257089 13886 tablet_bootstrap.cc:654] T 7f749e9eb58b44408d70a5461f10a3ef P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:55:04.257494 13619 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "e74a3e4b3b234c41aca30f772525652e" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:55:04.257645 13619 raft_consensus.cc:2466] T e74a3e4b3b234c41aca30f772525652e P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 1.
I20250830 07:55:04.260259 13882 tablet_bootstrap.cc:654] T a5eea1950d1945f1b755fd34597b2fb4 P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
I20250830 07:55:04.261768 13887 tablet_bootstrap.cc:492] T d1a99857f707440d9edd0b30d918b2ff P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:55:04.261950 13887 ts_tablet_manager.cc:1397] T d1a99857f707440d9edd0b30d918b2ff P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.032s user 0.004s sys 0.008s
I20250830 07:55:04.262573 13887 raft_consensus.cc:357] T d1a99857f707440d9edd0b30d918b2ff P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:55:04.260766 13619 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "986878a23a0b47ee865e09277b027bb0" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:55:04.265264 16252 raft_consensus.cc:491] T 1f5471a94dc24a28bce5f9dcaa10334a P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:55:04.265524 16252 raft_consensus.cc:513] T 1f5471a94dc24a28bce5f9dcaa10334a P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:04.267735 13886 tablet_bootstrap.cc:492] T 7f749e9eb58b44408d70a5461f10a3ef P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:55:04.267864 13886 ts_tablet_manager.cc:1397] T 7f749e9eb58b44408d70a5461f10a3ef P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.013s user 0.003s sys 0.000s
I20250830 07:55:04.268509 13886 raft_consensus.cc:357] T 7f749e9eb58b44408d70a5461f10a3ef P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:55:04.268633 13886 raft_consensus.cc:383] T 7f749e9eb58b44408d70a5461f10a3ef P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:55:04.268673 13886 raft_consensus.cc:738] T 7f749e9eb58b44408d70a5461f10a3ef P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:55:04.269016 16252 leader_election.cc:290] T 1f5471a94dc24a28bce5f9dcaa10334a P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
I20250830 07:55:04.269881 16463 raft_consensus.cc:491] T 76dd9dd481fc427fb20f5091e4a3b738 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:55:04.270004 16463 raft_consensus.cc:513] T 76dd9dd481fc427fb20f5091e4a3b738 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:04.270591 16463 leader_election.cc:290] T 76dd9dd481fc427fb20f5091e4a3b738 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:55:04.272408 15748 raft_consensus.cc:491] T 91da20bcd25341b5a0f6605b3ec58fb3 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:55:04.272545 15748 raft_consensus.cc:513] T 91da20bcd25341b5a0f6605b3ec58fb3 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:04.273118 15748 leader_election.cc:290] T 91da20bcd25341b5a0f6605b3ec58fb3 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
I20250830 07:55:04.275020 13886 consensus_queue.cc:260] T 7f749e9eb58b44408d70a5461f10a3ef P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:55:04.276124 13886 ts_tablet_manager.cc:1428] T 7f749e9eb58b44408d70a5461f10a3ef P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.008s user 0.001s sys 0.001s
I20250830 07:55:04.276854 13886 tablet_bootstrap.cc:492] T cf75d4190d30460f811ce563b16e334b P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:55:04.276840 13887 raft_consensus.cc:383] T d1a99857f707440d9edd0b30d918b2ff P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:55:04.276942 13887 raft_consensus.cc:738] T d1a99857f707440d9edd0b30d918b2ff P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:55:04.277141 16529 raft_consensus.cc:491] T 473fcf65d49b42dabe9b787cee681f76 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:55:04.277377 13887 consensus_queue.cc:260] T d1a99857f707440d9edd0b30d918b2ff P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:55:04.277889 13887 ts_tablet_manager.cc:1428] T d1a99857f707440d9edd0b30d918b2ff P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.016s user 0.001s sys 0.001s
I20250830 07:55:04.278977 13886 tablet_bootstrap.cc:654] T cf75d4190d30460f811ce563b16e334b P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:55:04.283489 16301 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20250830 07:55:04.284590 16301 env_posix.cc:2264] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20250830 07:55:04.284926 16301 kserver.cc:163] Server-wide thread pool size limit: 3276
I20250830 07:55:04.288635 16529 raft_consensus.cc:513] T 473fcf65d49b42dabe9b787cee681f76 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:55:04.289517 16529 leader_election.cc:290] T 473fcf65d49b42dabe9b787cee681f76 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:55:04.290210 13887 tablet_bootstrap.cc:492] T cd48d5c2d81a4b26aa1128b4f1cd01f3 P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:55:04.292034 13887 tablet_bootstrap.cc:654] T cd48d5c2d81a4b26aa1128b4f1cd01f3 P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:55:04.292573 13471 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "76dd9dd481fc427fb20f5091e4a3b738" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:55:04.301697 13476 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "91da20bcd25341b5a0f6605b3ec58fb3" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:55:04.301888 13476 raft_consensus.cc:2466] T 91da20bcd25341b5a0f6605b3ec58fb3 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 0.
I20250830 07:55:04.303552 13767 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "cf75d4190d30460f811ce563b16e334b" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:55:04.307854 16529 raft_consensus.cc:491] T d1a99857f707440d9edd0b30d918b2ff P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:55:04.308250 16529 raft_consensus.cc:513] T d1a99857f707440d9edd0b30d918b2ff P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:55:04.308913 16529 leader_election.cc:290] T d1a99857f707440d9edd0b30d918b2ff P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:55:04.309156 13471 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "1f5471a94dc24a28bce5f9dcaa10334a" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:55:04.309288 13471 raft_consensus.cc:2466] T 1f5471a94dc24a28bce5f9dcaa10334a P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 0.
I20250830 07:55:04.309499 16252 raft_consensus.cc:491] T 8028ac4c928a48f3a077d61aec24f3bd P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:55:04.309600 16252 raft_consensus.cc:513] T 8028ac4c928a48f3a077d61aec24f3bd P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:04.310186 16252 leader_election.cc:290] T 8028ac4c928a48f3a077d61aec24f3bd P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967)
I20250830 07:55:04.316056 13617 raft_consensus.cc:3058] T ad7a45187569416bad6c71db9f8ab702 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:55:04.318867 16252 raft_consensus.cc:491] T 5dffbacf2fcd4a38a1d61cf5bb9c5eeb P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:55:04.318993 16252 raft_consensus.cc:513] T 5dffbacf2fcd4a38a1d61cf5bb9c5eeb P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:04.319438 16252 leader_election.cc:290] T 5dffbacf2fcd4a38a1d61cf5bb9c5eeb P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967)
I20250830 07:55:04.320771 13767 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "aab8d9a009d34166920905ad06ed153b" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:55:04.322877 13767 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "9f27983af2c84dd6a40e7e0b900a9dc6" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:55:04.326949 13767 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "736de5dbaf7f4f449f6fc323ab6a72d8" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:55:04.334280 13887 tablet_bootstrap.cc:492] T cd48d5c2d81a4b26aa1128b4f1cd01f3 P 2065c332f15a4739899af79f3669c3ba: No bootstrap required, opened a new log
I20250830 07:55:04.334561 13887 ts_tablet_manager.cc:1397] T cd48d5c2d81a4b26aa1128b4f1cd01f3 P 2065c332f15a4739899af79f3669c3ba: Time spent bootstrapping tablet: real 0.044s user 0.004s sys 0.005s
I20250830 07:55:04.335884 13887 raft_consensus.cc:357] T cd48d5c2d81a4b26aa1128b4f1cd01f3 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:55:04.336259 13887 raft_consensus.cc:383] T cd48d5c2d81a4b26aa1128b4f1cd01f3 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:55:04.336474 13887 raft_consensus.cc:738] T cd48d5c2d81a4b26aa1128b4f1cd01f3 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2065c332f15a4739899af79f3669c3ba, State: Initialized, Role: FOLLOWER
I20250830 07:55:04.337318 13887 consensus_queue.cc:260] T cd48d5c2d81a4b26aa1128b4f1cd01f3 P 2065c332f15a4739899af79f3669c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:55:04.339139 13887 ts_tablet_manager.cc:1428] T cd48d5c2d81a4b26aa1128b4f1cd01f3 P 2065c332f15a4739899af79f3669c3ba: Time spent starting tablet: real 0.004s user 0.000s sys 0.002s
I20250830 07:55:04.339686 13887 tablet_bootstrap.cc:492] T 99c52db41f6747d1a8a1e59157aa4bfd P 2065c332f15a4739899af79f3669c3ba: Bootstrap starting.
I20250830 07:55:04.342826 13887 tablet_bootstrap.cc:654] T 99c52db41f6747d1a8a1e59157aa4bfd P 2065c332f15a4739899af79f3669c3ba: Neither blocks nor log segments found. Creating new log.
I20250830 07:55:04.345082 13701 leader_election.cc:304] T b85843ab0e3a40e1b453cfdd71bbae5e P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters:
I20250830 07:55:04.345392 15748 raft_consensus.cc:2802] T b85843ab0e3a40e1b453cfdd71bbae5e P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election won for term 1
I20250830 07:55:04.345532 15748 raft_consensus.cc:695] T b85843ab0e3a40e1b453cfdd71bbae5e P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 LEADER]: Becoming Leader. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Running, Role: LEADER
I20250830 07:55:04.345763 15748 consensus_queue.cc:237] T b85843ab0e3a40e1b453cfdd71bbae5e P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:04.349270 16529 raft_consensus.cc:491] T 7f749e9eb58b44408d70a5461f10a3ef P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:55:04.349486 16529 raft_consensus.cc:513] T 7f749e9eb58b44408d70a5461f10a3ef P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:55:04.350378 16529 leader_election.cc:290] T 7f749e9eb58b44408d70a5461f10a3ef P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:55:04.352289 13619 raft_consensus.cc:3058] T 4b9d9d4b65964fd49d8e25092a14d774 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:55:04.357231 13882 tablet_bootstrap.cc:492] T a5eea1950d1945f1b755fd34597b2fb4 P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:55:04.358191 13882 ts_tablet_manager.cc:1397] T a5eea1950d1945f1b755fd34597b2fb4 P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.153s user 0.002s sys 0.002s
I20250830 07:55:04.358991 13701 leader_election.cc:304] T e2ef8300fb994f98b3565ad708f880cf P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters:
I20250830 07:55:04.359234 16252 raft_consensus.cc:2802] T e2ef8300fb994f98b3565ad708f880cf P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election won for term 1
I20250830 07:55:04.359351 16252 raft_consensus.cc:695] T e2ef8300fb994f98b3565ad708f880cf P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 LEADER]: Becoming Leader. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Running, Role: LEADER
I20250830 07:55:04.359546 16252 consensus_queue.cc:237] T e2ef8300fb994f98b3565ad708f880cf P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:04.362452 13882 raft_consensus.cc:357] T a5eea1950d1945f1b755fd34597b2fb4 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:04.372900 13882 raft_consensus.cc:383] T a5eea1950d1945f1b755fd34597b2fb4 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:55:04.373142 13882 raft_consensus.cc:738] T a5eea1950d1945f1b755fd34597b2fb4 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:55:04.370448 13617 raft_consensus.cc:3058] T 0f34ed0fe6e9400fae5c0edebb615ebd P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:55:04.375396 13882 consensus_queue.cc:260] T a5eea1950d1945f1b755fd34597b2fb4 P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:04.375463 13701 leader_election.cc:304] T 9bc54e40f9eb4271aa3132986c249e51 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters:
I20250830 07:55:04.375696 16543 raft_consensus.cc:2802] T 9bc54e40f9eb4271aa3132986c249e51 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:55:04.375784 16543 raft_consensus.cc:491] T 9bc54e40f9eb4271aa3132986c249e51 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:55:04.375842 16543 raft_consensus.cc:3058] T 9bc54e40f9eb4271aa3132986c249e51 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:55:04.378355 13882 ts_tablet_manager.cc:1428] T a5eea1950d1945f1b755fd34597b2fb4 P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.017s user 0.001s sys 0.001s
I20250830 07:55:04.378628 13882 tablet_bootstrap.cc:492] T 6fb5cd3618584dd3a0ee43a10f7a2660 P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:55:04.378643 16543 raft_consensus.cc:513] T 9bc54e40f9eb4271aa3132986c249e51 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:04.379145 16543 leader_election.cc:290] T 9bc54e40f9eb4271aa3132986c249e51 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Requested vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
I20250830 07:55:04.380187 13612 raft_consensus.cc:3058] T a3ac09a6d8604297aa8736d1f60484e2 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:55:04.382269 13886 tablet_bootstrap.cc:492] T cf75d4190d30460f811ce563b16e334b P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:55:04.382373 13886 ts_tablet_manager.cc:1397] T cf75d4190d30460f811ce563b16e334b P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.106s user 0.000s sys 0.002s
I20250830 07:55:04.383155 16529 raft_consensus.cc:491] T 930081bb13454b85ae17bbc4b2b59053 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:55:04.383102 13886 raft_consensus.cc:357] T cf75d4190d30460f811ce563b16e334b P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:55:04.383294 13886 raft_consensus.cc:383] T cf75d4190d30460f811ce563b16e334b P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:55:04.383349 13886 raft_consensus.cc:738] T cf75d4190d30460f811ce563b16e334b P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:55:04.383530 16529 raft_consensus.cc:513] T 930081bb13454b85ae17bbc4b2b59053 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:55:04.383535 13886 consensus_queue.cc:260] T cf75d4190d30460f811ce563b16e334b P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:55:04.384024 13886 ts_tablet_manager.cc:1428] T cf75d4190d30460f811ce563b16e334b P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20250830 07:55:04.384296 13886 tablet_bootstrap.cc:492] T 581ae087d60d45e291d899fa03fb89e2 P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:55:04.384335 16529 leader_election.cc:290] T 930081bb13454b85ae17bbc4b2b59053 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:55:04.387249 13886 tablet_bootstrap.cc:654] T 581ae087d60d45e291d899fa03fb89e2 P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:55:04.390295 16529 raft_consensus.cc:491] T 78a8df3642224d99a86637c1a3a9de5c P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:55:04.390475 16529 raft_consensus.cc:513] T 78a8df3642224d99a86637c1a3a9de5c P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:55:04.391398 16529 leader_election.cc:290] T 78a8df3642224d99a86637c1a3a9de5c P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:55:04.396330 13612 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "1f5471a94dc24a28bce5f9dcaa10334a" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:55:04.396974 13612 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "91da20bcd25341b5a0f6605b3ec58fb3" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:55:04.398454 13701 leader_election.cc:304] T 75359721445e48d2bc0dd6fd17649bc1 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters:
I20250830 07:55:04.398844 15720 raft_consensus.cc:2802] T 75359721445e48d2bc0dd6fd17649bc1 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election won for term 1
I20250830 07:55:04.399003 15720 raft_consensus.cc:695] T 75359721445e48d2bc0dd6fd17649bc1 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 LEADER]: Becoming Leader. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Running, Role: LEADER
I20250830 07:55:04.399189 15720 consensus_queue.cc:237] T 75359721445e48d2bc0dd6fd17649bc1 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:04.399713 13612 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "8028ac4c928a48f3a077d61aec24f3bd" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:55:04.400821 13612 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "5dffbacf2fcd4a38a1d61cf5bb9c5eeb" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:55:04.402602 13244 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "3ea183a890b84f408b20b55e9eb7c7ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 856 } } ignore_live_leader: false dest_uuid: "5e9d6449ae824acab24c459a72075e88" is_pre_election: true
I20250830 07:55:04.403272 14988 leader_election.cc:304] T 00000000000000000000000000000000 P 3ea183a890b84f408b20b55e9eb7c7ed [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ea183a890b84f408b20b55e9eb7c7ed; no voters: 5e9d6449ae824acab24c459a72075e88, fea6152429cc4e79a25b18e02aafae57
I20250830 07:55:04.403878 16586 raft_consensus.cc:2747] T 00000000000000000000000000000000 P 3ea183a890b84f408b20b55e9eb7c7ed [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20250830 07:55:04.403960 16543 raft_consensus.cc:491] T 559fdab1ef804325978db705431a0ad8 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:55:04.404146 16543 raft_consensus.cc:513] T 559fdab1ef804325978db705431a0ad8 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:04.404651 13882 tablet_bootstrap.cc:654] T 6fb5cd3618584dd3a0ee43a10f7a2660 P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
I20250830 07:55:04.405450 16543 leader_election.cc:290] T 559fdab1ef804325978db705431a0ad8 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
I20250830 07:55:04.409310 16529 raft_consensus.cc:491] T 581ae087d60d45e291d899fa03fb89e2 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:55:04.409533 16529 raft_consensus.cc:513] T 581ae087d60d45e291d899fa03fb89e2 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:55:04.410414 16529 leader_election.cc:290] T 581ae087d60d45e291d899fa03fb89e2 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:55:04.414130 13612 raft_consensus.cc:3058] T ed364f03bdad42b88e181b7d0e1e4011 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Advancing to term 1
W20250830 07:55:04.418292 15746 lock_manager.cc:585] Waited 8 seconds to obtain row lock on key '<redacted>' (key hash 4012713805250960239) tablet 00000000000000000000000000000000 cur holder 0x61700003a700
I20250830 07:55:04.418519 13701 leader_election.cc:304] T 7676b4d6a75c4c6aacced1f2a1beb555 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters:
I20250830 07:55:04.418824 16259 raft_consensus.cc:2802] T 7676b4d6a75c4c6aacced1f2a1beb555 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election won for term 1
I20250830 07:55:04.418951 16259 raft_consensus.cc:695] T 7676b4d6a75c4c6aacced1f2a1beb555 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 LEADER]: Becoming Leader. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Running, Role: LEADER
I20250830 07:55:04.419150 16259 consensus_queue.cc:237] T 7676b4d6a75c4c6aacced1f2a1beb555 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:04.420547 13619 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "559fdab1ef804325978db705431a0ad8" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:55:04.421018 13617 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "9bc54e40f9eb4271aa3132986c249e51" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9"
I20250830 07:55:04.427402 13619 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "cf75d4190d30460f811ce563b16e334b" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:55:04.429152 13619 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "aab8d9a009d34166920905ad06ed153b" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:55:04.431227 13617 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "9f27983af2c84dd6a40e7e0b900a9dc6" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:55:04.432173 13619 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "736de5dbaf7f4f449f6fc323ab6a72d8" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:55:04.433418 13619 raft_consensus.cc:3058] T 4df6d481baab40e2b2c1309d1a8c5351 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:55:04.439344 16543 consensus_queue.cc:1035] T bac72b4ba9ba4ca69f93e799dccb0e93 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:55:04.440222 13624 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "473fcf65d49b42dabe9b787cee681f76" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:55:04.442260 13612 raft_consensus.cc:3058] T 76dd9dd481fc427fb20f5091e4a3b738 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:55:04.444356 13882 tablet_bootstrap.cc:492] T 6fb5cd3618584dd3a0ee43a10f7a2660 P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:55:04.444519 13882 ts_tablet_manager.cc:1397] T 6fb5cd3618584dd3a0ee43a10f7a2660 P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.066s user 0.004s sys 0.000s
I20250830 07:55:04.445399 13882 raft_consensus.cc:357] T 6fb5cd3618584dd3a0ee43a10f7a2660 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:04.445521 13624 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "d1a99857f707440d9edd0b30d918b2ff" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:55:04.445621 13882 raft_consensus.cc:383] T 6fb5cd3618584dd3a0ee43a10f7a2660 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:55:04.445689 13882 raft_consensus.cc:738] T 6fb5cd3618584dd3a0ee43a10f7a2660 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:55:04.445902 13882 consensus_queue.cc:260] T 6fb5cd3618584dd3a0ee43a10f7a2660 P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:04.446493 13882 ts_tablet_manager.cc:1428] T 6fb5cd3618584dd3a0ee43a10f7a2660 P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20250830 07:55:04.446768 13882 tablet_bootstrap.cc:492] T e24d68b8f5ba4df59a9aeec8ebd6403d P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:55:04.448647 13882 tablet_bootstrap.cc:654] T e24d68b8f5ba4df59a9aeec8ebd6403d P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
I20250830 07:55:04.449072 13624 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "7f749e9eb58b44408d70a5461f10a3ef" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:55:04.449751 13701 leader_election.cc:304] T e74a3e4b3b234c41aca30f772525652e P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters:
I20250830 07:55:04.450139 13701 leader_election.cc:304] T 986878a23a0b47ee865e09277b027bb0 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters:
I20250830 07:55:04.450227 16462 raft_consensus.cc:2802] T e74a3e4b3b234c41aca30f772525652e P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20250830 07:55:04.450316 16462 raft_consensus.cc:491] T e74a3e4b3b234c41aca30f772525652e P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:55:04.450417 16462 raft_consensus.cc:3058] T e74a3e4b3b234c41aca30f772525652e P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Advancing to term 2
I20250830 07:55:04.450567 16224 raft_consensus.cc:2802] T 986878a23a0b47ee865e09277b027bb0 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:55:04.450660 16224 raft_consensus.cc:491] T 986878a23a0b47ee865e09277b027bb0 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:55:04.450783 16224 raft_consensus.cc:3058] T 986878a23a0b47ee865e09277b027bb0 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:55:04.453017 16224 raft_consensus.cc:513] T 986878a23a0b47ee865e09277b027bb0 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:04.453310 16463 raft_consensus.cc:491] T a5eea1950d1945f1b755fd34597b2fb4 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:55:04.453405 16463 raft_consensus.cc:513] T a5eea1950d1945f1b755fd34597b2fb4 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:04.453511 16224 leader_election.cc:290] T 986878a23a0b47ee865e09277b027bb0 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Requested vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
I20250830 07:55:04.452941 16462 raft_consensus.cc:513] T e74a3e4b3b234c41aca30f772525652e P 9b057ade5dce45af9f8bf0bedf8b917f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:04.453876 16463 leader_election.cc:290] T a5eea1950d1945f1b755fd34597b2fb4 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:55:04.454236 16462 leader_election.cc:290] T e74a3e4b3b234c41aca30f772525652e P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 2 election: Requested vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
I20250830 07:55:04.454421 13471 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "a5eea1950d1945f1b755fd34597b2fb4" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:55:04.454589 13471 raft_consensus.cc:2466] T a5eea1950d1945f1b755fd34597b2fb4 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b5e454d98894637b466ea27f1b647f9 in term 0.
I20250830 07:55:04.455173 13561 leader_election.cc:304] T a5eea1950d1945f1b755fd34597b2fb4 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 6b5e454d98894637b466ea27f1b647f9; no voters:
I20250830 07:55:04.455479 16463 raft_consensus.cc:2802] T a5eea1950d1945f1b755fd34597b2fb4 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:55:04.455550 16463 raft_consensus.cc:491] T a5eea1950d1945f1b755fd34597b2fb4 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:55:04.455610 16463 raft_consensus.cc:3058] T a5eea1950d1945f1b755fd34597b2fb4 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:55:04.456934 16462 consensus_queue.cc:1035] T 7e9d6af1d7fc4d4b961583b44f2f962a P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:55:04.457859 16463 raft_consensus.cc:513] T a5eea1950d1945f1b755fd34597b2fb4 P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:04.458828 16463 leader_election.cc:290] T a5eea1950d1945f1b755fd34597b2fb4 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 election: Requested vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:55:04.459146 13471 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "a5eea1950d1945f1b755fd34597b2fb4" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba"
I20250830 07:55:04.459298 13471 raft_consensus.cc:3058] T a5eea1950d1945f1b755fd34597b2fb4 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:55:04.461938 13471 raft_consensus.cc:2466] T a5eea1950d1945f1b755fd34597b2fb4 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b5e454d98894637b466ea27f1b647f9 in term 1.
I20250830 07:55:04.463719 13561 leader_election.cc:304] T a5eea1950d1945f1b755fd34597b2fb4 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 6b5e454d98894637b466ea27f1b647f9; no voters:
I20250830 07:55:04.464993 16463 raft_consensus.cc:2802] T a5eea1950d1945f1b755fd34597b2fb4 P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Leader election won for term 1
I20250830 07:55:04.465951 16463 raft_consensus.cc:695] T a5eea1950d1945f1b755fd34597b2fb4 P 6b5e454d98894637b466ea27f1b647f9 [term 1 LEADER]: Becoming Leader. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Running, Role: LEADER
I20250830 07:55:04.466284 16463 consensus_queue.cc:237] T a5eea1950d1945f1b755fd34597b2fb4 P 6b5e454d98894637b466ea27f1b647f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:04.471129 13624 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "930081bb13454b85ae17bbc4b2b59053" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:55:04.471812 13882 tablet_bootstrap.cc:492] T e24d68b8f5ba4df59a9aeec8ebd6403d P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:55:04.471783 13624 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "78a8df3642224d99a86637c1a3a9de5c" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:55:04.471993 13882 ts_tablet_manager.cc:1397] T e24d68b8f5ba4df59a9aeec8ebd6403d P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.025s user 0.003s sys 0.000s
I20250830 07:55:04.472512 13624 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "581ae087d60d45e291d899fa03fb89e2" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:55:04.472816 13882 raft_consensus.cc:357] T e24d68b8f5ba4df59a9aeec8ebd6403d P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:04.472994 13882 raft_consensus.cc:383] T e24d68b8f5ba4df59a9aeec8ebd6403d P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:55:04.473063 13882 raft_consensus.cc:738] T e24d68b8f5ba4df59a9aeec8ebd6403d P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:55:04.473261 13882 consensus_queue.cc:260] T e24d68b8f5ba4df59a9aeec8ebd6403d P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:04.473809 13882 ts_tablet_manager.cc:1428] T e24d68b8f5ba4df59a9aeec8ebd6403d P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20250830 07:55:04.474181 13882 tablet_bootstrap.cc:492] T b678fd915c534a2dac8521c21ab93396 P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:55:04.484112 16462 consensus_queue.cc:1035] T 283aa82b808e49528ceb19133748ffc8 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:55:04.484776 16462 consensus_queue.cc:1035] T 7dc061ebaa334c109d1e457e2dc860df P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:55:04.487164 13882 tablet_bootstrap.cc:654] T b678fd915c534a2dac8521c21ab93396 P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
W20250830 07:55:04.494764 13703 leader_election.cc:343] T b85843ab0e3a40e1b453cfdd71bbae5e P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:55:04.497598 13886 tablet_bootstrap.cc:492] T 581ae087d60d45e291d899fa03fb89e2 P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:55:04.497740 13886 ts_tablet_manager.cc:1397] T 581ae087d60d45e291d899fa03fb89e2 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.113s user 0.002s sys 0.007s
I20250830 07:55:04.498513 13886 raft_consensus.cc:357] T 581ae087d60d45e291d899fa03fb89e2 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:55:04.498693 13886 raft_consensus.cc:383] T 581ae087d60d45e291d899fa03fb89e2 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:55:04.498795 13886 raft_consensus.cc:738] T 581ae087d60d45e291d899fa03fb89e2 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
W20250830 07:55:04.499769 13703 leader_election.cc:343] T e2ef8300fb994f98b3565ad708f880cf P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:55:04.500600 13767 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "adbacbbb13d840a29d8d7d08ea04f6b1" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:55:04.501092 16464 raft_consensus.cc:491] T 6fb5cd3618584dd3a0ee43a10f7a2660 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20250830 07:55:04.501205 13703 consensus_peers.cc:489] T 11042d702d4048c99644f0f06a6212d6 P 9b057ade5dce45af9f8bf0bedf8b917f -> Peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Couldn't send request to peer 6b5e454d98894637b466ea27f1b647f9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20250830 07:55:04.501251 16464 raft_consensus.cc:513] T 6fb5cd3618584dd3a0ee43a10f7a2660 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
W20250830 07:55:04.501500 13703 leader_election.cc:343] T 9bc54e40f9eb4271aa3132986c249e51 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:55:04.501950 16464 leader_election.cc:290] T 6fb5cd3618584dd3a0ee43a10f7a2660 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:55:04.502256 15720 consensus_queue.cc:1035] T 7e9d6af1d7fc4d4b961583b44f2f962a P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:55:04.502466 13471 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "6fb5cd3618584dd3a0ee43a10f7a2660" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:55:04.502638 13471 raft_consensus.cc:2466] T 6fb5cd3618584dd3a0ee43a10f7a2660 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b5e454d98894637b466ea27f1b647f9 in term 0.
I20250830 07:55:04.502954 13561 leader_election.cc:304] T 6fb5cd3618584dd3a0ee43a10f7a2660 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 6b5e454d98894637b466ea27f1b647f9; no voters:
I20250830 07:55:04.503320 16464 raft_consensus.cc:2802] T 6fb5cd3618584dd3a0ee43a10f7a2660 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:55:04.503379 16464 raft_consensus.cc:491] T 6fb5cd3618584dd3a0ee43a10f7a2660 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:55:04.503422 16464 raft_consensus.cc:3058] T 6fb5cd3618584dd3a0ee43a10f7a2660 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:55:04.503809 13767 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "473fcf65d49b42dabe9b787cee681f76" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:55:04.506143 16464 raft_consensus.cc:513] T 6fb5cd3618584dd3a0ee43a10f7a2660 P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
W20250830 07:55:04.506525 13703 leader_election.cc:343] T 75359721445e48d2bc0dd6fd17649bc1 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:55:04.507086 16464 leader_election.cc:290] T 6fb5cd3618584dd3a0ee43a10f7a2660 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 election: Requested vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
W20250830 07:55:04.507989 13703 leader_election.cc:343] T 7676b4d6a75c4c6aacced1f2a1beb555 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:55:04.510192 16464 raft_consensus.cc:491] T f192693039a24e3cb0bec646c8d11056 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:55:04.510310 16464 raft_consensus.cc:513] T f192693039a24e3cb0bec646c8d11056 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:04.510739 16464 leader_election.cc:290] T f192693039a24e3cb0bec646c8d11056 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
W20250830 07:55:04.512239 13423 leader_election.cc:343] T cf75d4190d30460f811ce563b16e334b P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
W20250830 07:55:04.512676 13423 leader_election.cc:343] T aab8d9a009d34166920905ad06ed153b P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:55:04.523590 13775 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "76dd9dd481fc427fb20f5091e4a3b738" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:55:04.525187 16224 raft_consensus.cc:491] T d075a38c613c46398ec533c1e00a24c6 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:55:04.525326 16224 raft_consensus.cc:513] T d075a38c613c46398ec533c1e00a24c6 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:04.525665 13882 tablet_bootstrap.cc:492] T b678fd915c534a2dac8521c21ab93396 P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:55:04.525804 13882 ts_tablet_manager.cc:1397] T b678fd915c534a2dac8521c21ab93396 P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.052s user 0.012s sys 0.008s
I20250830 07:55:04.525802 16224 leader_election.cc:290] T d075a38c613c46398ec533c1e00a24c6 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
I20250830 07:55:04.527400 13764 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "a5eea1950d1945f1b755fd34597b2fb4" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f"
I20250830 07:55:04.527576 13764 raft_consensus.cc:3058] T a5eea1950d1945f1b755fd34597b2fb4 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:55:04.529910 13767 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "a5eea1950d1945f1b755fd34597b2fb4" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:55:04.529999 13562 leader_election.cc:304] T 0f34ed0fe6e9400fae5c0edebb615ebd P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b5e454d98894637b466ea27f1b647f9; no voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:55:04.530012 13764 raft_consensus.cc:2466] T a5eea1950d1945f1b755fd34597b2fb4 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b5e454d98894637b466ea27f1b647f9 in term 1.
W20250830 07:55:04.530369 13703 leader_election.cc:343] T 986878a23a0b47ee865e09277b027bb0 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:55:04.530400 15992 raft_consensus.cc:491] T a3ac09a6d8604297aa8736d1f60484e2 P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:55:04.530490 15992 raft_consensus.cc:513] T a3ac09a6d8604297aa8736d1f60484e2 P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:04.530680 13882 raft_consensus.cc:357] T b678fd915c534a2dac8521c21ab93396 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:04.530885 13882 raft_consensus.cc:383] T b678fd915c534a2dac8521c21ab93396 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:55:04.530967 13882 raft_consensus.cc:738] T b678fd915c534a2dac8521c21ab93396 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:55:04.531062 15992 leader_election.cc:290] T a3ac09a6d8604297aa8736d1f60484e2 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:55:04.531170 15992 raft_consensus.cc:2747] T 0f34ed0fe6e9400fae5c0edebb615ebd P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:55:04.531184 13882 consensus_queue.cc:260] T b678fd915c534a2dac8521c21ab93396 P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:04.531829 13882 ts_tablet_manager.cc:1428] T b678fd915c534a2dac8521c21ab93396 P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
I20250830 07:55:04.532176 13882 tablet_bootstrap.cc:492] T 0d16bc64dd6e43f7ba313b77c2bbb728 P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:55:04.534108 13882 tablet_bootstrap.cc:654] T 0d16bc64dd6e43f7ba313b77c2bbb728 P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
I20250830 07:55:04.536055 13562 leader_election.cc:304] T adbacbbb13d840a29d8d7d08ea04f6b1 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b5e454d98894637b466ea27f1b647f9; no voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:55:04.536518 15992 raft_consensus.cc:2747] T adbacbbb13d840a29d8d7d08ea04f6b1 P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:55:04.537583 15751 consensus_queue.cc:1035] T e7e9d2e9b1ca4ddfb0c6a7bced613c35 P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:55:04.539259 13624 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "986878a23a0b47ee865e09277b027bb0" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9"
W20250830 07:55:04.539392 13703 consensus_peers.cc:489] T bac72b4ba9ba4ca69f93e799dccb0e93 P 9b057ade5dce45af9f8bf0bedf8b917f -> Peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Couldn't send request to peer 6b5e454d98894637b466ea27f1b647f9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20250830 07:55:04.539798 13624 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "e74a3e4b3b234c41aca30f772525652e" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9"
I20250830 07:55:04.539913 13624 raft_consensus.cc:3058] T e74a3e4b3b234c41aca30f772525652e P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Advancing to term 2
I20250830 07:55:04.542052 15751 raft_consensus.cc:491] T 838616d8274648fc9ea4f1583bdb97f9 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:55:04.542160 15751 raft_consensus.cc:513] T 838616d8274648fc9ea4f1583bdb97f9 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:04.542647 15751 leader_election.cc:290] T 838616d8274648fc9ea4f1583bdb97f9 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
I20250830 07:55:04.543730 13624 raft_consensus.cc:2466] T e74a3e4b3b234c41aca30f772525652e P 6b5e454d98894637b466ea27f1b647f9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 2.
I20250830 07:55:04.549819 13882 tablet_bootstrap.cc:492] T 0d16bc64dd6e43f7ba313b77c2bbb728 P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:55:04.549973 13882 ts_tablet_manager.cc:1397] T 0d16bc64dd6e43f7ba313b77c2bbb728 P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.018s user 0.003s sys 0.007s
I20250830 07:55:04.550711 13882 raft_consensus.cc:357] T 0d16bc64dd6e43f7ba313b77c2bbb728 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:04.550885 13882 raft_consensus.cc:383] T 0d16bc64dd6e43f7ba313b77c2bbb728 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:55:04.550987 13882 raft_consensus.cc:738] T 0d16bc64dd6e43f7ba313b77c2bbb728 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:55:04.551195 13882 consensus_queue.cc:260] T 0d16bc64dd6e43f7ba313b77c2bbb728 P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:04.551666 13882 ts_tablet_manager.cc:1428] T 0d16bc64dd6e43f7ba313b77c2bbb728 P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20250830 07:55:04.551992 13882 tablet_bootstrap.cc:492] T dad2dfa1a19d45778933780b1029d924 P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:55:04.553910 13882 tablet_bootstrap.cc:654] T dad2dfa1a19d45778933780b1029d924 P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
W20250830 07:55:04.555104 13701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.209.1:45325, user_credentials={real_user=slave}} blocked reactor thread for 46512.3us
I20250830 07:55:04.555619 13701 leader_election.cc:304] T 91da20bcd25341b5a0f6605b3ec58fb3 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters:
I20250830 07:55:04.556829 16462 raft_consensus.cc:2802] T 91da20bcd25341b5a0f6605b3ec58fb3 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:55:04.556911 16462 raft_consensus.cc:491] T 91da20bcd25341b5a0f6605b3ec58fb3 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:55:04.556991 16462 raft_consensus.cc:3058] T 91da20bcd25341b5a0f6605b3ec58fb3 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:55:04.559480 16462 raft_consensus.cc:513] T 91da20bcd25341b5a0f6605b3ec58fb3 P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:04.560045 16462 leader_election.cc:290] T 91da20bcd25341b5a0f6605b3ec58fb3 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Requested vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
I20250830 07:55:04.561645 15992 raft_consensus.cc:491] T 4df6d481baab40e2b2c1309d1a8c5351 P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:55:04.561758 15992 raft_consensus.cc:513] T 4df6d481baab40e2b2c1309d1a8c5351 P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:04.562233 15992 leader_election.cc:290] T 4df6d481baab40e2b2c1309d1a8c5351 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:55:04.567209 13882 tablet_bootstrap.cc:492] T dad2dfa1a19d45778933780b1029d924 P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:55:04.567334 13882 ts_tablet_manager.cc:1397] T dad2dfa1a19d45778933780b1029d924 P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.015s user 0.001s sys 0.003s
I20250830 07:55:04.568084 13882 raft_consensus.cc:357] T dad2dfa1a19d45778933780b1029d924 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:04.568270 13882 raft_consensus.cc:383] T dad2dfa1a19d45778933780b1029d924 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:55:04.568333 13882 raft_consensus.cc:738] T dad2dfa1a19d45778933780b1029d924 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:55:04.568516 13882 consensus_queue.cc:260] T dad2dfa1a19d45778933780b1029d924 P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:04.569022 13882 ts_tablet_manager.cc:1428] T dad2dfa1a19d45778933780b1029d924 P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20250830 07:55:04.569295 13882 tablet_bootstrap.cc:492] T 370441c443be46c2a33132fbc5c41f89 P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:55:04.571267 13882 tablet_bootstrap.cc:654] T 370441c443be46c2a33132fbc5c41f89 P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
I20250830 07:55:04.571961 13886 consensus_queue.cc:260] T 581ae087d60d45e291d899fa03fb89e2 P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:55:04.572430 13886 ts_tablet_manager.cc:1428] T 581ae087d60d45e291d899fa03fb89e2 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.075s user 0.000s sys 0.002s
I20250830 07:55:04.573872 16349 consensus_queue.cc:1035] T b6717031830f4c57967e87ce077ddb21 P 2065c332f15a4739899af79f3669c3ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20250830 07:55:04.574431 13422 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.209.3:38743, user_credentials={real_user=slave}} blocked reactor thread for 71048.1us
I20250830 07:55:04.581508 13471 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "6fb5cd3618584dd3a0ee43a10f7a2660" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba"
I20250830 07:55:04.581719 13471 raft_consensus.cc:3058] T 6fb5cd3618584dd3a0ee43a10f7a2660 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:55:04.582350 13476 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f192693039a24e3cb0bec646c8d11056" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:55:04.582557 13476 raft_consensus.cc:2391] T f192693039a24e3cb0bec646c8d11056 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b5e454d98894637b466ea27f1b647f9 in current term 1: Already voted for candidate 2065c332f15a4739899af79f3669c3ba in this term.
I20250830 07:55:04.582859 13882 tablet_bootstrap.cc:492] T 370441c443be46c2a33132fbc5c41f89 P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:55:04.583000 13882 ts_tablet_manager.cc:1397] T 370441c443be46c2a33132fbc5c41f89 P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.014s user 0.006s sys 0.000s
I20250830 07:55:04.583320 13477 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "a3ac09a6d8604297aa8736d1f60484e2" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:55:04.583484 13477 raft_consensus.cc:2466] T a3ac09a6d8604297aa8736d1f60484e2 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b5e454d98894637b466ea27f1b647f9 in term 1.
I20250830 07:55:04.583864 13886 tablet_bootstrap.cc:492] T 78a8df3642224d99a86637c1a3a9de5c P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:55:04.584159 13484 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "4df6d481baab40e2b2c1309d1a8c5351" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:55:04.584168 13882 raft_consensus.cc:357] T 370441c443be46c2a33132fbc5c41f89 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:04.584355 13882 raft_consensus.cc:383] T 370441c443be46c2a33132fbc5c41f89 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:55:04.584409 13882 raft_consensus.cc:738] T 370441c443be46c2a33132fbc5c41f89 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
W20250830 07:55:04.584427 13423 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.209.2:38967, user_credentials={real_user=slave}} blocked reactor thread for 71448us
W20250830 07:55:04.584667 13423 leader_election.cc:343] T 9f27983af2c84dd6a40e7e0b900a9dc6 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:55:04.584605 13882 consensus_queue.cc:260] T 370441c443be46c2a33132fbc5c41f89 P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
W20250830 07:55:04.584841 13423 leader_election.cc:343] T 736de5dbaf7f4f449f6fc323ab6a72d8 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:55:04.585140 13882 ts_tablet_manager.cc:1428] T 370441c443be46c2a33132fbc5c41f89 P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20250830 07:55:04.585436 13882 tablet_bootstrap.cc:492] T 4639d1b6add8447c9ce071af71a99869 P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:55:04.585896 16349 consensus_queue.cc:1035] T 4df6d481baab40e2b2c1309d1a8c5351 P 2065c332f15a4739899af79f3669c3ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:55:04.587186 13886 tablet_bootstrap.cc:654] T 78a8df3642224d99a86637c1a3a9de5c P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:55:04.587477 13882 tablet_bootstrap.cc:654] T 4639d1b6add8447c9ce071af71a99869 P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
I20250830 07:55:04.589920 13561 leader_election.cc:304] T a3ac09a6d8604297aa8736d1f60484e2 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 6b5e454d98894637b466ea27f1b647f9; no voters:
I20250830 07:55:04.590242 16596 raft_consensus.cc:2802] T a3ac09a6d8604297aa8736d1f60484e2 P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20250830 07:55:04.590301 16596 raft_consensus.cc:491] T a3ac09a6d8604297aa8736d1f60484e2 P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:55:04.590349 16596 raft_consensus.cc:3058] T a3ac09a6d8604297aa8736d1f60484e2 P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Advancing to term 2
I20250830 07:55:04.592742 16596 raft_consensus.cc:513] T a3ac09a6d8604297aa8736d1f60484e2 P 6b5e454d98894637b466ea27f1b647f9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:04.593209 16596 leader_election.cc:290] T a3ac09a6d8604297aa8736d1f60484e2 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 2 election: Requested vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:55:04.593787 13484 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "a3ac09a6d8604297aa8736d1f60484e2" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba"
I20250830 07:55:04.593961 13484 raft_consensus.cc:3058] T a3ac09a6d8604297aa8736d1f60484e2 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Advancing to term 2
I20250830 07:55:04.595985 13882 tablet_bootstrap.cc:492] T 4639d1b6add8447c9ce071af71a99869 P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:55:04.596114 13882 ts_tablet_manager.cc:1397] T 4639d1b6add8447c9ce071af71a99869 P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.011s user 0.003s sys 0.000s
I20250830 07:55:04.596839 13882 raft_consensus.cc:357] T 4639d1b6add8447c9ce071af71a99869 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:04.597029 13882 raft_consensus.cc:383] T 4639d1b6add8447c9ce071af71a99869 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:55:04.597079 13882 raft_consensus.cc:738] T 4639d1b6add8447c9ce071af71a99869 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:55:04.597258 13882 consensus_queue.cc:260] T 4639d1b6add8447c9ce071af71a99869 P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:04.597865 13882 ts_tablet_manager.cc:1428] T 4639d1b6add8447c9ce071af71a99869 P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20250830 07:55:04.598157 13882 tablet_bootstrap.cc:492] T 7676b4d6a75c4c6aacced1f2a1beb555 P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:55:04.600226 13882 tablet_bootstrap.cc:654] T 7676b4d6a75c4c6aacced1f2a1beb555 P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
I20250830 07:55:04.600199 15608 raft_consensus.cc:491] T d72ef294123b4bcdb8ff63af5de9c621 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:55:04.600317 15608 raft_consensus.cc:513] T d72ef294123b4bcdb8ff63af5de9c621 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:04.601200 15608 leader_election.cc:290] T d72ef294123b4bcdb8ff63af5de9c621 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
I20250830 07:55:04.605764 16081 raft_consensus.cc:491] T af3f79e46d6149aa921a4c0ce19c7172 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:55:04.605914 16081 raft_consensus.cc:513] T af3f79e46d6149aa921a4c0ce19c7172 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:55:04.606472 16081 leader_election.cc:290] T af3f79e46d6149aa921a4c0ce19c7172 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:55:04.613957 13471 raft_consensus.cc:2466] T 6fb5cd3618584dd3a0ee43a10f7a2660 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b5e454d98894637b466ea27f1b647f9 in term 1.
I20250830 07:55:04.615208 13882 tablet_bootstrap.cc:492] T 7676b4d6a75c4c6aacced1f2a1beb555 P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:55:04.615352 13882 ts_tablet_manager.cc:1397] T 7676b4d6a75c4c6aacced1f2a1beb555 P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.017s user 0.000s sys 0.005s
I20250830 07:55:04.615499 13561 leader_election.cc:304] T 6fb5cd3618584dd3a0ee43a10f7a2660 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 6b5e454d98894637b466ea27f1b647f9; no voters:
I20250830 07:55:04.615736 16463 raft_consensus.cc:2802] T 6fb5cd3618584dd3a0ee43a10f7a2660 P 6b5e454d98894637b466ea27f1b647f9 [term 1 FOLLOWER]: Leader election won for term 1
I20250830 07:55:04.615847 16463 raft_consensus.cc:695] T 6fb5cd3618584dd3a0ee43a10f7a2660 P 6b5e454d98894637b466ea27f1b647f9 [term 1 LEADER]: Becoming Leader. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Running, Role: LEADER
I20250830 07:55:04.616041 16463 consensus_queue.cc:237] T 6fb5cd3618584dd3a0ee43a10f7a2660 P 6b5e454d98894637b466ea27f1b647f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:04.616317 13484 raft_consensus.cc:2466] T a3ac09a6d8604297aa8736d1f60484e2 P 2065c332f15a4739899af79f3669c3ba [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b5e454d98894637b466ea27f1b647f9 in term 2.
I20250830 07:55:04.616271 13882 raft_consensus.cc:357] T 7676b4d6a75c4c6aacced1f2a1beb555 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:04.616453 13882 raft_consensus.cc:383] T 7676b4d6a75c4c6aacced1f2a1beb555 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:55:04.616501 13882 raft_consensus.cc:738] T 7676b4d6a75c4c6aacced1f2a1beb555 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:55:04.616742 13882 consensus_queue.cc:260] T 7676b4d6a75c4c6aacced1f2a1beb555 P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:04.617208 13882 ts_tablet_manager.cc:1428] T 7676b4d6a75c4c6aacced1f2a1beb555 P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20250830 07:55:04.617435 13882 tablet_bootstrap.cc:492] T 11042d702d4048c99644f0f06a6212d6 P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:55:04.618091 13561 leader_election.cc:304] T a3ac09a6d8604297aa8736d1f60484e2 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 6b5e454d98894637b466ea27f1b647f9; no voters:
I20250830 07:55:04.618407 16596 raft_consensus.cc:2802] T a3ac09a6d8604297aa8736d1f60484e2 P 6b5e454d98894637b466ea27f1b647f9 [term 2 FOLLOWER]: Leader election won for term 2
I20250830 07:55:04.618513 16596 raft_consensus.cc:695] T a3ac09a6d8604297aa8736d1f60484e2 P 6b5e454d98894637b466ea27f1b647f9 [term 2 LEADER]: Becoming Leader. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Running, Role: LEADER
I20250830 07:55:04.618721 16596 consensus_queue.cc:237] T a3ac09a6d8604297aa8736d1f60484e2 P 6b5e454d98894637b466ea27f1b647f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
W20250830 07:55:04.619155 13422 leader_election.cc:343] T cf75d4190d30460f811ce563b16e334b P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:55:04.619269 13422 leader_election.cc:304] T cf75d4190d30460f811ce563b16e334b P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba; no voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:55:04.619305 13882 tablet_bootstrap.cc:654] T 11042d702d4048c99644f0f06a6212d6 P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
I20250830 07:55:04.619819 16349 consensus_queue.cc:1035] T b678fd915c534a2dac8521c21ab93396 P 2065c332f15a4739899af79f3669c3ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:55:04.620216 16349 raft_consensus.cc:2747] T cf75d4190d30460f811ce563b16e334b P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:55:04.620397 16349 consensus_queue.cc:1035] T e24d68b8f5ba4df59a9aeec8ebd6403d P 2065c332f15a4739899af79f3669c3ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20250830 07:55:04.621296 13422 leader_election.cc:343] T aab8d9a009d34166920905ad06ed153b P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:55:04.621445 13422 leader_election.cc:304] T aab8d9a009d34166920905ad06ed153b P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba; no voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:55:04.621695 16349 raft_consensus.cc:2747] T aab8d9a009d34166920905ad06ed153b P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20250830 07:55:04.622062 13422 leader_election.cc:343] T 9f27983af2c84dd6a40e7e0b900a9dc6 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:55:04.622315 13422 leader_election.cc:304] T 9f27983af2c84dd6a40e7e0b900a9dc6 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba; no voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:55:04.622551 16349 raft_consensus.cc:2747] T 9f27983af2c84dd6a40e7e0b900a9dc6 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20250830 07:55:04.623260 13422 leader_election.cc:343] T 736de5dbaf7f4f449f6fc323ab6a72d8 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:55:04.623414 13422 leader_election.cc:304] T 736de5dbaf7f4f449f6fc323ab6a72d8 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba; no voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:55:04.623733 16349 raft_consensus.cc:2747] T 736de5dbaf7f4f449f6fc323ab6a72d8 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:55:04.624806 16602 raft_consensus.cc:491] T 669e649b53984db3bad8c6121f39fb73 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:55:04.624994 16602 raft_consensus.cc:513] T 669e649b53984db3bad8c6121f39fb73 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:55:04.625742 16602 leader_election.cc:290] T 669e649b53984db3bad8c6121f39fb73 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:55:04.626886 13882 tablet_bootstrap.cc:492] T 11042d702d4048c99644f0f06a6212d6 P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:55:04.627058 13882 ts_tablet_manager.cc:1397] T 11042d702d4048c99644f0f06a6212d6 P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.010s user 0.003s sys 0.001s
I20250830 07:55:04.626957 15980 raft_consensus.cc:491] T b4c345013ff04cf991989f456aa2d420 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:55:04.627214 15980 raft_consensus.cc:513] T b4c345013ff04cf991989f456aa2d420 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:04.627781 15980 leader_election.cc:290] T b4c345013ff04cf991989f456aa2d420 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
I20250830 07:55:04.627861 13882 raft_consensus.cc:357] T 11042d702d4048c99644f0f06a6212d6 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:04.628058 13882 raft_consensus.cc:383] T 11042d702d4048c99644f0f06a6212d6 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:55:04.628129 13882 raft_consensus.cc:738] T 11042d702d4048c99644f0f06a6212d6 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:55:04.628340 16462 raft_consensus.cc:491] T 669e649b53984db3bad8c6121f39fb73 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:55:04.628340 13882 consensus_queue.cc:260] T 11042d702d4048c99644f0f06a6212d6 P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:04.628566 16462 raft_consensus.cc:513] T 669e649b53984db3bad8c6121f39fb73 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:55:04.628804 13882 ts_tablet_manager.cc:1428] T 11042d702d4048c99644f0f06a6212d6 P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20250830 07:55:04.629069 13882 tablet_bootstrap.cc:492] T 690cf258639a4c1ea5a0ac4f2fd39f88 P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:55:04.629184 16462 leader_election.cc:290] T 669e649b53984db3bad8c6121f39fb73 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
I20250830 07:55:04.631134 13882 tablet_bootstrap.cc:654] T 690cf258639a4c1ea5a0ac4f2fd39f88 P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
W20250830 07:55:04.632171 13422 leader_election.cc:343] T 473fcf65d49b42dabe9b787cee681f76 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:55:04.634696 13471 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "8028ac4c928a48f3a077d61aec24f3bd" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:55:04.634965 13471 raft_consensus.cc:2466] T 8028ac4c928a48f3a077d61aec24f3bd P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 0.
I20250830 07:55:04.636500 13886 tablet_bootstrap.cc:492] T 78a8df3642224d99a86637c1a3a9de5c P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:55:04.636907 13886 ts_tablet_manager.cc:1397] T 78a8df3642224d99a86637c1a3a9de5c P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.053s user 0.000s sys 0.004s
I20250830 07:55:04.643572 13882 tablet_bootstrap.cc:492] T 690cf258639a4c1ea5a0ac4f2fd39f88 P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:55:04.643720 13882 ts_tablet_manager.cc:1397] T 690cf258639a4c1ea5a0ac4f2fd39f88 P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.015s user 0.000s sys 0.006s
I20250830 07:55:04.644640 13882 raft_consensus.cc:357] T 690cf258639a4c1ea5a0ac4f2fd39f88 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:04.644842 13882 raft_consensus.cc:383] T 690cf258639a4c1ea5a0ac4f2fd39f88 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:55:04.644908 13882 raft_consensus.cc:738] T 690cf258639a4c1ea5a0ac4f2fd39f88 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:55:04.645130 13882 consensus_queue.cc:260] T 690cf258639a4c1ea5a0ac4f2fd39f88 P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:04.645859 13882 ts_tablet_manager.cc:1428] T 690cf258639a4c1ea5a0ac4f2fd39f88 P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20250830 07:55:04.646106 13882 tablet_bootstrap.cc:492] T e2ef8300fb994f98b3565ad708f880cf P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:55:04.648106 13882 tablet_bootstrap.cc:654] T e2ef8300fb994f98b3565ad708f880cf P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
I20250830 07:55:04.654493 13882 tablet_bootstrap.cc:492] T e2ef8300fb994f98b3565ad708f880cf P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:55:04.654628 13882 ts_tablet_manager.cc:1397] T e2ef8300fb994f98b3565ad708f880cf P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.009s user 0.000s sys 0.003s
I20250830 07:55:04.655386 13882 raft_consensus.cc:357] T e2ef8300fb994f98b3565ad708f880cf P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:04.655556 13882 raft_consensus.cc:383] T e2ef8300fb994f98b3565ad708f880cf P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:55:04.655627 13882 raft_consensus.cc:738] T e2ef8300fb994f98b3565ad708f880cf P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:55:04.655818 13882 consensus_queue.cc:260] T e2ef8300fb994f98b3565ad708f880cf P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:04.656575 13882 ts_tablet_manager.cc:1428] T e2ef8300fb994f98b3565ad708f880cf P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20250830 07:55:04.656855 13882 tablet_bootstrap.cc:492] T 3bca390f6d4343cba7a9fb07f0d4d72b P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:55:04.664112 13886 raft_consensus.cc:357] T 78a8df3642224d99a86637c1a3a9de5c P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:55:04.664409 13886 raft_consensus.cc:383] T 78a8df3642224d99a86637c1a3a9de5c P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:55:04.664605 13886 raft_consensus.cc:738] T 78a8df3642224d99a86637c1a3a9de5c P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:55:04.665064 13886 consensus_queue.cc:260] T 78a8df3642224d99a86637c1a3a9de5c P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:55:04.667464 13882 tablet_bootstrap.cc:654] T 3bca390f6d4343cba7a9fb07f0d4d72b P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
I20250830 07:55:04.668365 13471 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "5dffbacf2fcd4a38a1d61cf5bb9c5eeb" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:55:04.668551 13471 raft_consensus.cc:2466] T 5dffbacf2fcd4a38a1d61cf5bb9c5eeb P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 0.
I20250830 07:55:04.677143 13482 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "9bc54e40f9eb4271aa3132986c249e51" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba"
I20250830 07:55:04.677325 13482 raft_consensus.cc:3058] T 9bc54e40f9eb4271aa3132986c249e51 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:55:04.678359 13476 raft_consensus.cc:1238] T a3ac09a6d8604297aa8736d1f60484e2 P 2065c332f15a4739899af79f3669c3ba [term 2 FOLLOWER]: Rejecting Update request from peer 9b057ade5dce45af9f8bf0bedf8b917f for earlier term 1. Current term is 2. Ops: []
I20250830 07:55:04.679845 13482 raft_consensus.cc:2466] T 9bc54e40f9eb4271aa3132986c249e51 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 1.
I20250830 07:55:04.680068 13488 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "559fdab1ef804325978db705431a0ad8" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:55:04.680222 13488 raft_consensus.cc:2466] T 559fdab1ef804325978db705431a0ad8 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 0.
I20250830 07:55:04.687951 13882 tablet_bootstrap.cc:492] T 3bca390f6d4343cba7a9fb07f0d4d72b P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:55:04.688091 13882 ts_tablet_manager.cc:1397] T 3bca390f6d4343cba7a9fb07f0d4d72b P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.031s user 0.004s sys 0.001s
I20250830 07:55:04.688830 13882 raft_consensus.cc:357] T 3bca390f6d4343cba7a9fb07f0d4d72b P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:04.689005 13882 raft_consensus.cc:383] T 3bca390f6d4343cba7a9fb07f0d4d72b P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:55:04.689077 13882 raft_consensus.cc:738] T 3bca390f6d4343cba7a9fb07f0d4d72b P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:55:04.689286 13882 consensus_queue.cc:260] T 3bca390f6d4343cba7a9fb07f0d4d72b P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:04.689601 13886 ts_tablet_manager.cc:1428] T 78a8df3642224d99a86637c1a3a9de5c P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.052s user 0.000s sys 0.002s
I20250830 07:55:04.689935 13882 ts_tablet_manager.cc:1428] T 3bca390f6d4343cba7a9fb07f0d4d72b P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20250830 07:55:04.690302 13886 tablet_bootstrap.cc:492] T 529e743ea8ba4dcb879dad1d28087486 P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:55:04.690534 13882 tablet_bootstrap.cc:492] T 9bc54e40f9eb4271aa3132986c249e51 P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:55:04.692569 13882 tablet_bootstrap.cc:654] T 9bc54e40f9eb4271aa3132986c249e51 P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
I20250830 07:55:04.694180 13886 tablet_bootstrap.cc:654] T 529e743ea8ba4dcb879dad1d28087486 P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
W20250830 07:55:04.697316 13423 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.209.2:38967, user_credentials={real_user=slave}} blocked reactor thread for 112111us
W20250830 07:55:04.697583 13423 leader_election.cc:343] T 473fcf65d49b42dabe9b787cee681f76 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:55:04.705626 13882 tablet_bootstrap.cc:492] T 9bc54e40f9eb4271aa3132986c249e51 P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:55:04.705766 13882 ts_tablet_manager.cc:1397] T 9bc54e40f9eb4271aa3132986c249e51 P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.015s user 0.003s sys 0.000s
I20250830 07:55:04.706594 13882 raft_consensus.cc:357] T 9bc54e40f9eb4271aa3132986c249e51 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:04.706779 13882 raft_consensus.cc:383] T 9bc54e40f9eb4271aa3132986c249e51 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:55:04.706842 13882 raft_consensus.cc:738] T 9bc54e40f9eb4271aa3132986c249e51 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:55:04.707063 13882 consensus_queue.cc:260] T 9bc54e40f9eb4271aa3132986c249e51 P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:04.707753 13882 ts_tablet_manager.cc:1428] T 9bc54e40f9eb4271aa3132986c249e51 P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20250830 07:55:04.697700 13423 leader_election.cc:304] T 473fcf65d49b42dabe9b787cee681f76 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba; no voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:55:04.708047 13882 tablet_bootstrap.cc:492] T 7dc061ebaa334c109d1e457e2dc860df P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:55:04.709843 13882 tablet_bootstrap.cc:654] T 7dc061ebaa334c109d1e457e2dc860df P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
W20250830 07:55:04.710446 13423 consensus_peers.cc:489] T 0c32e597f17e4e75a0f584b6b7b02c36 P 2065c332f15a4739899af79f3669c3ba -> Peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Couldn't send request to peer 6b5e454d98894637b466ea27f1b647f9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20250830 07:55:04.711427 13423 leader_election.cc:343] T d1a99857f707440d9edd0b30d918b2ff P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:55:04.713035 16604 raft_consensus.cc:2747] T 473fcf65d49b42dabe9b787cee681f76 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20250830 07:55:04.714764 13423 leader_election.cc:343] T 7f749e9eb58b44408d70a5461f10a3ef P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:55:04.717268 16463 raft_consensus.cc:491] T e24d68b8f5ba4df59a9aeec8ebd6403d P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:55:04.717377 16463 raft_consensus.cc:513] T e24d68b8f5ba4df59a9aeec8ebd6403d P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:04.717844 16463 leader_election.cc:290] T e24d68b8f5ba4df59a9aeec8ebd6403d P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
W20250830 07:55:04.717324 13423 consensus_peers.cc:489] T 53766699d42e4f6e9b42d9a98613726c P 2065c332f15a4739899af79f3669c3ba -> Peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Couldn't send request to peer 6b5e454d98894637b466ea27f1b647f9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20250830 07:55:04.718281 16463 raft_consensus.cc:491] T 690cf258639a4c1ea5a0ac4f2fd39f88 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:55:04.718381 16463 raft_consensus.cc:513] T 690cf258639a4c1ea5a0ac4f2fd39f88 P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:04.718537 15980 raft_consensus.cc:491] T 6fb5cd3618584dd3a0ee43a10f7a2660 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:55:04.718650 15980 raft_consensus.cc:513] T 6fb5cd3618584dd3a0ee43a10f7a2660 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:04.718847 16463 leader_election.cc:290] T 690cf258639a4c1ea5a0ac4f2fd39f88 P 6b5e454d98894637b466ea27f1b647f9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:55:04.719208 15980 leader_election.cc:290] T 6fb5cd3618584dd3a0ee43a10f7a2660 P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
W20250830 07:55:04.718384 13423 leader_election.cc:343] T 930081bb13454b85ae17bbc4b2b59053 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:55:04.720144 13482 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "690cf258639a4c1ea5a0ac4f2fd39f88" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:55:04.723740 13482 raft_consensus.cc:2391] T 690cf258639a4c1ea5a0ac4f2fd39f88 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b5e454d98894637b466ea27f1b647f9 in current term 1: Already voted for candidate 9b057ade5dce45af9f8bf0bedf8b917f in this term.
I20250830 07:55:04.723914 13488 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "e74a3e4b3b234c41aca30f772525652e" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba"
I20250830 07:55:04.724121 13488 raft_consensus.cc:3058] T e74a3e4b3b234c41aca30f772525652e P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Advancing to term 2
W20250830 07:55:04.725226 13423 leader_election.cc:343] T 78a8df3642224d99a86637c1a3a9de5c P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
W20250830 07:55:04.726414 13423 leader_election.cc:343] T 581ae087d60d45e291d899fa03fb89e2 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:55:04.728317 13882 tablet_bootstrap.cc:492] T 7dc061ebaa334c109d1e457e2dc860df P 6b5e454d98894637b466ea27f1b647f9: No bootstrap required, opened a new log
I20250830 07:55:04.728456 13882 ts_tablet_manager.cc:1397] T 7dc061ebaa334c109d1e457e2dc860df P 6b5e454d98894637b466ea27f1b647f9: Time spent bootstrapping tablet: real 0.020s user 0.001s sys 0.002s
I20250830 07:55:04.729259 13882 raft_consensus.cc:357] T 7dc061ebaa334c109d1e457e2dc860df P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:04.729425 13882 raft_consensus.cc:383] T 7dc061ebaa334c109d1e457e2dc860df P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:55:04.729501 13882 raft_consensus.cc:738] T 7dc061ebaa334c109d1e457e2dc860df P 6b5e454d98894637b466ea27f1b647f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e454d98894637b466ea27f1b647f9, State: Initialized, Role: FOLLOWER
I20250830 07:55:04.729609 13488 raft_consensus.cc:2466] T e74a3e4b3b234c41aca30f772525652e P 2065c332f15a4739899af79f3669c3ba [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 2.
I20250830 07:55:04.729722 13882 consensus_queue.cc:260] T 7dc061ebaa334c109d1e457e2dc860df P 6b5e454d98894637b466ea27f1b647f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:04.730490 13882 ts_tablet_manager.cc:1428] T 7dc061ebaa334c109d1e457e2dc860df P 6b5e454d98894637b466ea27f1b647f9: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20250830 07:55:04.730647 13485 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "d075a38c613c46398ec533c1e00a24c6" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:55:04.730716 13882 tablet_bootstrap.cc:492] T b85843ab0e3a40e1b453cfdd71bbae5e P 6b5e454d98894637b466ea27f1b647f9: Bootstrap starting.
I20250830 07:55:04.730801 13485 raft_consensus.cc:2466] T d075a38c613c46398ec533c1e00a24c6 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 0.
I20250830 07:55:04.732779 13882 tablet_bootstrap.cc:654] T b85843ab0e3a40e1b453cfdd71bbae5e P 6b5e454d98894637b466ea27f1b647f9: Neither blocks nor log segments found. Creating new log.
I20250830 07:55:04.720346 13471 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "e24d68b8f5ba4df59a9aeec8ebd6403d" candidate_uuid: "6b5e454d98894637b466ea27f1b647f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:55:04.722690 13484 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "986878a23a0b47ee865e09277b027bb0" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba"
I20250830 07:55:04.742019 13484 raft_consensus.cc:3058] T 986878a23a0b47ee865e09277b027bb0 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:55:04.742381 13485 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "91da20bcd25341b5a0f6605b3ec58fb3" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba"
I20250830 07:55:04.742506 13485 raft_consensus.cc:3058] T 91da20bcd25341b5a0f6605b3ec58fb3 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:55:04.744311 13482 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "d72ef294123b4bcdb8ff63af5de9c621" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:55:04.744462 13482 raft_consensus.cc:2466] T d72ef294123b4bcdb8ff63af5de9c621 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 0.
I20250830 07:55:04.745123 13481 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "669e649b53984db3bad8c6121f39fb73" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:55:04.745260 13481 raft_consensus.cc:2466] T 669e649b53984db3bad8c6121f39fb73 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 0.
I20250830 07:55:04.745313 13476 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "838616d8274648fc9ea4f1583bdb97f9" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:55:04.745424 13476 raft_consensus.cc:2466] T 838616d8274648fc9ea4f1583bdb97f9 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 0.
I20250830 07:55:04.744966 13474 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "b4c345013ff04cf991989f456aa2d420" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:55:04.745635 13474 raft_consensus.cc:2466] T b4c345013ff04cf991989f456aa2d420 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 0.
I20250830 07:55:04.747859 13484 raft_consensus.cc:2466] T 986878a23a0b47ee865e09277b027bb0 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 1.
I20250830 07:55:04.753793 13485 raft_consensus.cc:2466] T 91da20bcd25341b5a0f6605b3ec58fb3 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 1.
I20250830 07:55:04.760016 13612 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "af3f79e46d6149aa921a4c0ce19c7172" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:55:04.760545 13612 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "669e649b53984db3bad8c6121f39fb73" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:55:04.763020 13485 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "6fb5cd3618584dd3a0ee43a10f7a2660" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba" is_pre_election: true
I20250830 07:55:04.763204 13485 raft_consensus.cc:2391] T 6fb5cd3618584dd3a0ee43a10f7a2660 P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b057ade5dce45af9f8bf0bedf8b917f in current term 1: Already voted for candidate 6b5e454d98894637b466ea27f1b647f9 in this term.
I20250830 07:55:04.765129 13764 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "d1a99857f707440d9edd0b30d918b2ff" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" is_pre_election: true
I20250830 07:55:04.765569 13701 leader_election.cc:304] T 1f5471a94dc24a28bce5f9dcaa10334a P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters:
I20250830 07:55:04.765826 15980 raft_consensus.cc:2802] T 1f5471a94dc24a28bce5f9dcaa10334a P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:55:04.765890 15980 raft_consensus.cc:491] T 1f5471a94dc24a28bce5f9dcaa10334a P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:55:04.765939 15980 raft_consensus.cc:3058] T 1f5471a94dc24a28bce5f9dcaa10334a P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:55:04.768306 15980 raft_consensus.cc:513] T 1f5471a94dc24a28bce5f9dcaa10334a P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:04.768857 15980 leader_election.cc:290] T 1f5471a94dc24a28bce5f9dcaa10334a P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Requested vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
I20250830 07:55:04.771530 13701 leader_election.cc:304] T 8028ac4c928a48f3a077d61aec24f3bd P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters:
I20250830 07:55:04.771864 13701 leader_election.cc:304] T 5dffbacf2fcd4a38a1d61cf5bb9c5eeb P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba, 9b057ade5dce45af9f8bf0bedf8b917f; no voters:
I20250830 07:55:04.772650 16252 consensus_queue.cc:1035] T 122bec4220c74dfaa8228f6d153cd50e P 9b057ade5dce45af9f8bf0bedf8b917f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250830 07:55:04.773083 16252 raft_consensus.cc:2802] T 8028ac4c928a48f3a077d61aec24f3bd P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:55:04.773155 16252 raft_consensus.cc:491] T 8028ac4c928a48f3a077d61aec24f3bd P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:55:04.773226 16252 raft_consensus.cc:3058] T 8028ac4c928a48f3a077d61aec24f3bd P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:55:04.775144 15748 raft_consensus.cc:2802] T 5dffbacf2fcd4a38a1d61cf5bb9c5eeb P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250830 07:55:04.775238 15748 raft_consensus.cc:491] T 5dffbacf2fcd4a38a1d61cf5bb9c5eeb P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250830 07:55:04.775298 15748 raft_consensus.cc:3058] T 5dffbacf2fcd4a38a1d61cf5bb9c5eeb P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:55:04.777575 16602 raft_consensus.cc:491] T 529e743ea8ba4dcb879dad1d28087486 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:55:04.777676 16602 raft_consensus.cc:513] T 529e743ea8ba4dcb879dad1d28087486 P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:55:04.777981 15748 raft_consensus.cc:513] T 5dffbacf2fcd4a38a1d61cf5bb9c5eeb P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:04.778126 16602 leader_election.cc:290] T 529e743ea8ba4dcb879dad1d28087486 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:55:04.778436 15748 leader_election.cc:290] T 5dffbacf2fcd4a38a1d61cf5bb9c5eeb P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Requested vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967)
I20250830 07:55:04.779788 16602 raft_consensus.cc:491] T becf9667a0fc4507bc114407090c055c P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:55:04.779898 16602 raft_consensus.cc:513] T becf9667a0fc4507bc114407090c055c P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:55:04.780314 16602 leader_election.cc:290] T becf9667a0fc4507bc114407090c055c P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:55:04.780539 16602 raft_consensus.cc:491] T 9b9631c8038a4c6eb9fd0530511777ac P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:55:04.780633 16602 raft_consensus.cc:513] T 9b9631c8038a4c6eb9fd0530511777ac P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:55:04.781060 16602 leader_election.cc:290] T 9b9631c8038a4c6eb9fd0530511777ac P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743)
I20250830 07:55:04.781541 16252 raft_consensus.cc:513] T 8028ac4c928a48f3a077d61aec24f3bd P 9b057ade5dce45af9f8bf0bedf8b917f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } } peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } }
I20250830 07:55:04.782049 16252 leader_election.cc:290] T 8028ac4c928a48f3a077d61aec24f3bd P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 election: Requested vote from peers 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325), 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967)
I20250830 07:55:04.786721 13479 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "1f5471a94dc24a28bce5f9dcaa10334a" candidate_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2065c332f15a4739899af79f3669c3ba"
I20250830 07:55:04.786851 13479 raft_consensus.cc:3058] T 1f5471a94dc24a28bce5f9dcaa10334a P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Advancing to term 1
I20250830 07:55:04.789438 13479 raft_consensus.cc:2466] T 1f5471a94dc24a28bce5f9dcaa10334a P 2065c332f15a4739899af79f3669c3ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b057ade5dce45af9f8bf0bedf8b917f in term 1.
I20250830 07:55:04.789525 13612 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "529e743ea8ba4dcb879dad1d28087486" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
W20250830 07:55:04.789696 13422 leader_election.cc:343] T d1a99857f707440d9edd0b30d918b2ff P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b057ade5dce45af9f8bf0bedf8b917f (127.12.209.3:38743): Illegal state: must be running to vote when last-logged opid is not known
I20250830 07:55:04.789776 13422 leader_election.cc:304] T d1a99857f707440d9edd0b30d918b2ff P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2065c332f15a4739899af79f3669c3ba; no voters: 6b5e454d98894637b466ea27f1b647f9, 9b057ade5dce45af9f8bf0bedf8b917f
I20250830 07:55:04.790550 16605 raft_consensus.cc:2747] T d1a99857f707440d9edd0b30d918b2ff P 2065c332f15a4739899af79f3669c3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250830 07:55:04.790655 15980 raft_consensus.cc:491] T 78a8df3642224d99a86637c1a3a9de5c P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250830 07:55:04.790840 15980 raft_consensus.cc:513] T 78a8df3642224d99a86637c1a3a9de5c P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:55:04.791659 15980 leader_election.cc:290] T 78a8df3642224d99a86637c1a3a9de5c P 9b057ade5dce45af9f8bf0bedf8b917f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967), 2065c332f15a4739899af79f3669c3ba (127.12.209.1:45325)
I20250830 07:55:04.793403 13612 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "becf9667a0fc4507bc114407090c055c" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
I20250830 07:55:04.794713 13886 tablet_bootstrap.cc:492] T 529e743ea8ba4dcb879dad1d28087486 P 9b057ade5dce45af9f8bf0bedf8b917f: No bootstrap required, opened a new log
I20250830 07:55:04.794839 13886 ts_tablet_manager.cc:1397] T 529e743ea8ba4dcb879dad1d28087486 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent bootstrapping tablet: real 0.105s user 0.005s sys 0.000s
I20250830 07:55:04.795470 13886 raft_consensus.cc:357] T 529e743ea8ba4dcb879dad1d28087486 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:55:04.795599 13886 raft_consensus.cc:383] T 529e743ea8ba4dcb879dad1d28087486 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250830 07:55:04.795647 13886 raft_consensus.cc:738] T 529e743ea8ba4dcb879dad1d28087486 P 9b057ade5dce45af9f8bf0bedf8b917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b057ade5dce45af9f8bf0bedf8b917f, State: Initialized, Role: FOLLOWER
I20250830 07:55:04.795794 13886 consensus_queue.cc:260] T 529e743ea8ba4dcb879dad1d28087486 P 9b057ade5dce45af9f8bf0bedf8b917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5e454d98894637b466ea27f1b647f9" member_type: VOTER last_known_addr { host: "127.12.209.2" port: 38967 } } peers { permanent_uuid: "9b057ade5dce45af9f8bf0bedf8b917f" member_type: VOTER last_known_addr { host: "127.12.209.3" port: 38743 } } peers { permanent_uuid: "2065c332f15a4739899af79f3669c3ba" member_type: VOTER last_known_addr { host: "127.12.209.1" port: 45325 } }
I20250830 07:55:04.796200 13886 ts_tablet_manager.cc:1428] T 529e743ea8ba4dcb879dad1d28087486 P 9b057ade5dce45af9f8bf0bedf8b917f: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20250830 07:55:04.796866 13886 tablet_bootstrap.cc:492] T 9b9631c8038a4c6eb9fd0530511777ac P 9b057ade5dce45af9f8bf0bedf8b917f: Bootstrap starting.
I20250830 07:55:04.798492 13886 tablet_bootstrap.cc:654] T 9b9631c8038a4c6eb9fd0530511777ac P 9b057ade5dce45af9f8bf0bedf8b917f: Neither blocks nor log segments found. Creating new log.
I20250830 07:55:04.800410 13612 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "9b9631c8038a4c6eb9fd0530511777ac" candidate_uuid: "2065c332f15a4739899af79f3669c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5e454d98894637b466ea27f1b647f9" is_pre_election: true
W20250830 07:55:04.804476 13423 leader_election.cc:343] T af3f79e46d6149aa921a4c0ce19c7172 P 2065c332f15a4739899af79f3669c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5e454d98894637b466ea27f1b647f9 (127.12.209.2:38967): Illegal state: must be running to vote when last-logged opid is not known
W20250830 07:55:04.804607 13703 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus ->